2024-04-25T15:36:29.517 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T15:36:29.518 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230 --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/orig.config.yaml 2024-04-25T15:36:29.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:36:29.658 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} email: pdonnell@redhat.com first_in_suite: false job_id: '7673230' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - client session with non-allowable root sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGftt3p0Z3QW4HH2ur8GPVRxQZ7Fj2VtyXBGEZacf7cuB3NULC9e8E7eCC6wClc+JUkHZna/FHPswQFgzeHa0U= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGH7jE023E30ZC+TxER1LNj8+lBZL156eWWcVwHhzT8t9uAqCpdsZJ7Urr7Q4F2j0qP56PsZgNGPe20QHtreDmA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T15:36:29.658 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T15:36:29.659 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T15:36:29.659 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T15:36:29.661 INFO:teuthology.task.internal:Checking packages... 2024-04-25T15:36:29.687 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T15:36:29.687 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T15:36:29.687 INFO:teuthology.packaging:ref: None 2024-04-25T15:36:29.687 INFO:teuthology.packaging:tag: None 2024-04-25T15:36:29.687 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:36:29.687 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:36:29.687 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:36:29.836 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T15:36:29.837 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T15:36:29.845 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T15:36:29.845 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T15:36:29.856 INFO:teuthology.task.internal:Saving configuration 2024-04-25T15:36:29.876 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T15:36:29.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T15:36:29.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:31:17.513491', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGftt3p0Z3QW4HH2ur8GPVRxQZ7Fj2VtyXBGEZacf7cuB3NULC9e8E7eCC6wClc+JUkHZna/FHPswQFgzeHa0U='} 2024-04-25T15:36:29.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:31:17.511705', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGH7jE023E30ZC+TxER1LNj8+lBZL156eWWcVwHhzT8t9uAqCpdsZJ7Urr7Q4F2j0qP56PsZgNGPe20QHtreDmA='} 2024-04-25T15:36:29.924 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T15:36:29.931 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T15:36:29.931 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T15:36:29.931 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T15:36:30.003 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f738b16bf70>, signals=[15]) 2024-04-25T15:36:30.003 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T15:36:30.009 INFO:teuthology.task.internal:Opening connections... 2024-04-25T15:36:30.009 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:36:30.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:36:30.085 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:36:30.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:36:30.184 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T15:36:30.192 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-25T15:36:30.211 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-25T15:36:30.211 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-25T15:36:30.269 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-25T15:36:30.269 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-25T15:36:30.269 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-25T15:36:30.269 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:36:30.270 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-25T15:36:30.270 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:36:30.270 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:36:30.270 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-25T15:36:30.270 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:36:30.270 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:36:30.271 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:36:30.271 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:36:30.271 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:36:30.271 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:36:30.274 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-25T15:36:30.296 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-25T15:36:30.315 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-25T15:36:30.315 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-25T15:36:30.372 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-25T15:36:30.372 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:36:30.373 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:36:30.374 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-25T15:36:30.396 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T15:36:30.410 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T15:36:30.416 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T15:36:30.417 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:36:30.419 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:36:30.435 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T15:36:30.442 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T15:36:30.442 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:36:30.476 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:36:30.557 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T15:36:30.613 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T15:36:30.628 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T15:36:30.628 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T15:36:30.629 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T15:36:30.629 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:36:30.629 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:36:30.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:36:30.645 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-25T15:36:30.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:36:30.646 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-04-25T15:36:30.703 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:36:30.703 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-437.el9.x86_64 2024-04-25T15:36:30.703 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-04-25T15:36:30.704 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:36:30.704 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.14.0-437.el9.x86_64 2024-04-25T15:36:30.705 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-04-25T15:36:33.164 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.0 MB 00:00 2024-04-25T15:36:33.168 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-25T15:36:35.315 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-25T15:36:35.770 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-25T15:36:39.433 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T15:36:39.828 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-25T15:36:41.864 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-25T15:36:42.593 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 16 kB 00:01 2024-04-25T15:36:43.603 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-25T15:36:45.590 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 21 MB 00:03 2024-04-25T15:36:48.611 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-25T15:36:50.558 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T15:36:50.559 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T15:36:50.590 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T15:36:50.650 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T15:36:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-04-25T15:36:50.651 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T15:36:50.778 DEBUG:teuthology.orchestra.run.smithi080:> echo no | sudo yum reinstall kernel || true 2024-04-25T15:36:51.279 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:36:48 PM UTC. 2024-04-25T15:36:51.405 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T15:36:51.414 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T15:36:51.414 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-25T15:36:51.414 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-25T15:36:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:Operation aborted. 2024-04-25T15:36:51.479 INFO:teuthology.orchestra.run.smithi080.stdout:Is this ok [y/N]: 2024-04-25T15:36:51.480 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum reinstall -y kernel || true 2024-04-25T15:36:51.974 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:36:48 PM UTC. 2024-04-25T15:36:52.090 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T15:36:52.090 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-25T15:36:52.091 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-25T15:36:52.371 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-04-25T15:36:52.371 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:36:52.371 INFO:teuthology.orchestra.run.smithi080.stdout:Total 909 kB/s | 255 kB 00:00 2024-04-25T15:36:52.390 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-25T15:36:52.530 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T15:36:52.530 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T15:36:52.564 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-25T15:36:52.564 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-25T15:36:52.569 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-25T15:36:52.569 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-25T15:36:52.631 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T15:36:52.632 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-25T15:36:52.632 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T15:36:52.699 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-25T15:36:52.746 DEBUG:teuthology.orchestra.run.smithi195:> echo no | sudo yum reinstall kernel || true 2024-04-25T15:36:52.771 INFO:teuthology.orchestra.run.smithi080.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:36:52.772 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:36:53.244 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:36:50 PM UTC. 2024-04-25T15:36:53.368 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T15:36:53.380 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalling: 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T15:36:53.381 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:36:53.382 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 255 k 2024-04-25T15:36:53.382 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 0 2024-04-25T15:36:53.382 INFO:teuthology.orchestra.run.smithi195.stderr:Operation aborted. 2024-04-25T15:36:53.433 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:36:53.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:36:53.438 INFO:teuthology.orchestra.run.smithi195.stdout:Is this ok [y/N]: 2024-04-25T15:36:53.439 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum reinstall -y kernel || true 2024-04-25T15:36:53.937 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:36:50 PM UTC. 2024-04-25T15:36:54.053 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T15:36:54.053 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T15:36:54.053 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalling: 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 255 k 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 0 2024-04-25T15:36:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T15:36:54.177 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:36:54.177 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:36:54.177 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalled: 2024-04-25T15:36:54.177 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T15:36:54.177 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:36:54.177 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T15:36:54.351 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T15:36:54.392 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-25T15:36:54.392 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:36:54.393 INFO:teuthology.orchestra.run.smithi195.stdout:Total 753 kB/s | 255 kB 00:00 2024-04-25T15:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T15:36:54.398 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T15:36:54.398 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T15:36:54.399 DEBUG:teuthology.parallel:result is None 2024-04-25T15:36:54.411 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T15:36:54.596 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T15:36:54.596 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T15:36:54.601 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T15:36:54.601 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T15:36:54.745 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T15:36:54.818 INFO:teuthology.orchestra.run.smithi195.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:36:54.818 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:36:55.459 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:36:55.459 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:36:56.168 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:36:56.168 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:36:56.168 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalled: 2024-04-25T15:36:56.169 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T15:36:56.169 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:36:56.169 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T15:36:56.329 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T15:36:56.375 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T15:36:56.375 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T15:36:56.375 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T15:36:56.376 DEBUG:teuthology.parallel:result is None 2024-04-25T15:36:56.376 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T15:36:56.384 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T15:36:56.384 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:36:56.387 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:36:56.402 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T15:36:56.409 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T15:36:56.421 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T15:36:56.421 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:36:56.445 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:36:56.605 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T15:36:56.612 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T15:36:56.612 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:36:56.615 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:36:56.645 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:36:56.663 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:36:56.664 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:36:56.678 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:36:56.679 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T15:36:56.686 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T15:36:56.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:36:56.709 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:36:56.733 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T15:36:56.741 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T15:36:56.741 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:36:56.775 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:36:56.790 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:36:56.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:36:56.923 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:36:57.005 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:36:57.045 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:36:57.045 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:36:57.109 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:36:57.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:36:57.195 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:36:57.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:36:57.316 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:36:57.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:36:57.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-04-25T15:36:57.382 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-25T15:36:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:36:57.462 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:36:57.750 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T15:36:57.759 INFO:teuthology.task.internal:Starting timer... 2024-04-25T15:36:57.759 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T15:36:57.770 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T15:36:57.779 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T15:36:57.779 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-04-25T15:36:57.843 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-04-25T15:36:57.845 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-25T15:36:57.897 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-25T15:36:57.898 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T15:36:57.899 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-04-25T15:36:57.920 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-04-25T15:36:57.920 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-25T15:36:57.939 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-25T15:36:57.939 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-25T15:36:57.940 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:36:57.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:36:57.984 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:36:58.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:36:58.009 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T15:36:58.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:36:58.048 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:36:58.073 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T15:36:58.082 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T15:36:58.099 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T15:36:58.100 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T15:40:24.563 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-25T15:40:24.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-25T15:40:24.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:40:24.641 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-25T15:40:24.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-25T15:40:24.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T15:40:24.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:40:24.799 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-25T15:40:24.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T15:40:24.883 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T15:40:24.894 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T15:40:24.894 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:40:24.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:40:24.897 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:40:24.898 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:40:24.925 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:40:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:40:24.951 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:40:24.961 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-04-25T15:40:24.964 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:40:24.972 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-04-25T15:40:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:40:24.988 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-25T15:40:24.998 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:40:24.998 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-25T15:40:25.011 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:40:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:40:25.058 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:40:25.061 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:40:25.061 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-25T15:40:25.061 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.062 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.062 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.062 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:40:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:40:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T15:40:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.085 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:40:25.086 INFO:teuthology.run_tasks:Running task install... 2024-04-25T15:40:25.095 DEBUG:teuthology.task.install:project ceph 2024-04-25T15:40:25.095 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T15:40:25.095 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T15:40:25.096 INFO:teuthology.task.install:Using flavor: default 2024-04-25T15:40:25.101 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T15:40:25.101 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T15:40:25.102 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:40:25.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:40:25.105 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:40:25.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:40:25.247 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:40:25.247 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:40:25.252 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:40:25.253 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:40:25.561 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:40:25.561 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:40:25.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:40:25.572 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:40:25.572 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:40:25.572 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:40:25.588 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:40:25.588 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:40:25.598 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:40:25.598 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:40:25.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:40:25.664 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:40:25.732 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:40:25.738 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:40:25.795 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-04-25T15:40:25.797 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-04-25T15:40:25.801 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-25T15:40:25.803 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-25T15:40:26.019 INFO:teuthology.orchestra.run.smithi080.stdout:48 files removed 2024-04-25T15:40:26.026 INFO:teuthology.orchestra.run.smithi195.stdout:48 files removed 2024-04-25T15:40:26.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:40:26.053 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:40:27.190 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 94 kB/s | 84 kB 00:00 2024-04-25T15:40:27.190 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 95 kB/s | 84 kB 00:00 2024-04-25T15:40:27.791 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-04-25T15:40:27.849 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 19 kB/s | 12 kB 00:00 2024-04-25T15:40:28.391 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-04-25T15:40:28.399 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-04-25T15:40:29.177 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T15:40:29.327 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-04-25T15:40:31.337 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-25T15:40:31.770 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-25T15:40:35.612 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.2 MB 00:00 2024-04-25T15:40:35.921 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-04-25T15:40:37.169 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-25T15:40:37.285 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 16 kB 00:00 2024-04-25T15:40:38.562 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T15:40:39.270 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T15:40:43.662 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T15:40:44.311 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-25T15:40:45.814 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:40:45.814 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:40:45.825 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:40:45.826 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:40:45.827 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:40:45.828 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:40:45.829 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:40:45.832 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:40:45.833 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:40:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T15:40:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:40:45.903 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:40:45.904 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:40:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:40:45.906 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:40:45.907 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:40:45.908 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:40:45.909 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:40:45.910 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:40:45.911 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:40:45.912 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:40:45.913 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T15:40:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:Install 148 Packages 2024-04-25T15:40:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 4 Packages 2024-04-25T15:40:45.915 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:40:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 214 M 2024-04-25T15:40:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T15:40:46.473 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:40:46.474 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:40:46.485 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:40:46.486 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:40:46.487 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:40:46.487 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:40:46.489 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:40:46.491 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:40:46.492 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:40:46.552 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:40:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:40:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:40:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:40:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:40:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:40:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:40:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:40:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:40:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:40:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:40:46.572 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout:Install 148 Packages 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 4 Packages 2024-04-25T15:40:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:40:46.574 INFO:teuthology.orchestra.run.smithi195.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-04-25T15:40:46.574 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 214 M 2024-04-25T15:40:46.574 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-25T15:40:46.772 INFO:teuthology.orchestra.run.smithi195.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 4.2 MB/s | 863 kB 00:00 2024-04-25T15:40:46.839 INFO:teuthology.orchestra.run.smithi195.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 2.1 MB/s | 147 kB 00:00 2024-04-25T15:40:47.015 INFO:teuthology.orchestra.run.smithi195.stdout:(4/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 8.8 MB/s | 5.4 MB 00:00 2024-04-25T15:40:47.098 INFO:teuthology.orchestra.run.smithi195.stdout:(5/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 8.7 MB/s | 2.3 MB 00:00 2024-04-25T15:40:47.140 INFO:teuthology.orchestra.run.smithi195.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 12 MB/s | 1.5 MB 00:00 2024-04-25T15:40:47.181 INFO:teuthology.orchestra.run.smithi080.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-04-25T15:40:47.674 INFO:teuthology.orchestra.run.smithi195.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 8.5 MB/s | 4.9 MB 00:00 2024-04-25T15:40:48.882 INFO:teuthology.orchestra.run.smithi195.stdout:(8/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x86 10 MB/s | 18 MB 00:01 2024-04-25T15:40:48.933 INFO:teuthology.orchestra.run.smithi195.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 506 kB/s | 25 kB 00:00 2024-04-25T15:40:49.023 INFO:teuthology.orchestra.run.smithi080.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 468 kB/s | 863 kB 00:01 2024-04-25T15:40:49.116 INFO:teuthology.orchestra.run.smithi195.stdout:(10/152): ceph-common-19.0.0-3291.g994e2f20.el9 7.2 MB/s | 20 MB 00:02 2024-04-25T15:40:49.148 INFO:teuthology.orchestra.run.smithi080.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 1.2 MB/s | 147 kB 00:00 2024-04-25T15:40:49.200 INFO:teuthology.orchestra.run.smithi195.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.6 MB/s | 224 kB 00:00 2024-04-25T15:40:49.350 INFO:teuthology.orchestra.run.smithi195.stdout:(12/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 6.0 MB/s | 10 MB 00:01 2024-04-25T15:40:49.367 INFO:teuthology.orchestra.run.smithi195.stdout:(13/152): cephfs-shell-19.0.0-3291.g994e2f20.el 162 kB/s | 27 kB 00:00 2024-04-25T15:40:49.409 INFO:teuthology.orchestra.run.smithi195.stdout:(14/152): libcephfs-devel-19.0.0-3291.g994e2f20 543 kB/s | 32 kB 00:00 2024-04-25T15:40:49.492 INFO:teuthology.orchestra.run.smithi195.stdout:(15/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 5.9 MB/s | 756 kB 00:00 2024-04-25T15:40:49.517 INFO:teuthology.orchestra.run.smithi195.stdout:(16/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.4 MB/s | 158 kB 00:00 2024-04-25T15:40:49.568 INFO:teuthology.orchestra.run.smithi195.stdout:(17/152): librados-devel-19.0.0-3291.g994e2f20. 1.6 MB/s | 127 kB 00:00 2024-04-25T15:40:49.643 INFO:teuthology.orchestra.run.smithi195.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 3.9 MB/s | 497 kB 00:00 2024-04-25T15:40:49.718 INFO:teuthology.orchestra.run.smithi195.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 602 kB/s | 45 kB 00:00 2024-04-25T15:40:49.835 INFO:teuthology.orchestra.run.smithi195.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.1 MB/s | 135 kB 00:00 2024-04-25T15:40:49.961 INFO:teuthology.orchestra.run.smithi195.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.3 MB/s | 161 kB 00:00 2024-04-25T15:40:50.069 INFO:teuthology.orchestra.run.smithi195.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.9 MB/s | 321 kB 00:00 2024-04-25T15:40:50.161 INFO:teuthology.orchestra.run.smithi195.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 3.2 MB/s | 298 kB 00:00 2024-04-25T15:40:50.245 INFO:teuthology.orchestra.run.smithi195.stdout:(24/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 7.6 MB/s | 5.2 MB 00:00 2024-04-25T15:40:50.271 INFO:teuthology.orchestra.run.smithi195.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 914 kB/s | 100 kB 00:00 2024-04-25T15:40:50.304 INFO:teuthology.orchestra.run.smithi195.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.4 MB/s | 86 kB 00:00 2024-04-25T15:40:50.396 INFO:teuthology.orchestra.run.smithi195.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.8 MB/s | 169 kB 00:00 2024-04-25T15:40:50.488 INFO:teuthology.orchestra.run.smithi195.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 373 kB/s | 34 kB 00:00 2024-04-25T15:40:50.572 INFO:teuthology.orchestra.run.smithi195.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.7 MB/s | 142 kB 00:00 2024-04-25T15:40:50.822 INFO:teuthology.orchestra.run.smithi195.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 5.5 MB/s | 3.0 MB 00:00 2024-04-25T15:40:50.998 INFO:teuthology.orchestra.run.smithi195.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 8.3 MB/s | 3.5 MB 00:00 2024-04-25T15:40:51.089 INFO:teuthology.orchestra.run.smithi195.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 2.7 MB/s | 249 kB 00:00 2024-04-25T15:40:51.098 INFO:teuthology.orchestra.run.smithi080.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 1.2 MB/s | 2.3 MB 00:01 2024-04-25T15:40:51.190 INFO:teuthology.orchestra.run.smithi195.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 493 kB/s | 49 kB 00:00 2024-04-25T15:40:51.281 INFO:teuthology.orchestra.run.smithi195.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 180 kB/s | 16 kB 00:00 2024-04-25T15:40:51.382 INFO:teuthology.orchestra.run.smithi195.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 2.7 MB/s | 273 kB 00:00 2024-04-25T15:40:51.507 INFO:teuthology.orchestra.run.smithi195.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 6.0 MB/s | 762 kB 00:00 2024-04-25T15:40:51.548 INFO:teuthology.orchestra.run.smithi080.stdout:(5/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-04-25T15:40:51.582 INFO:teuthology.orchestra.run.smithi195.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 243 kB/s | 18 kB 00:00 2024-04-25T15:40:51.683 INFO:teuthology.orchestra.run.smithi195.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 805 kB/s | 80 kB 00:00 2024-04-25T15:40:51.758 INFO:teuthology.orchestra.run.smithi195.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T15:40:51.865 INFO:teuthology.orchestra.run.smithi080.stdout:(6/152): ceph-common-19.0.0-3291.g994e2f20.el9. 4.0 MB/s | 20 MB 00:04 2024-04-25T15:40:51.908 INFO:teuthology.orchestra.run.smithi195.stdout:(40/152): ceph-mgr-diskprediction-local-19.0.0- 6.8 MB/s | 7.4 MB 00:01 2024-04-25T15:40:51.934 INFO:teuthology.orchestra.run.smithi195.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-25T15:40:51.959 INFO:teuthology.orchestra.run.smithi195.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-25T15:40:51.992 INFO:teuthology.orchestra.run.smithi195.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T15:40:52.009 INFO:teuthology.orchestra.run.smithi195.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 2.2 MB/s | 106 kB 00:00 2024-04-25T15:40:52.034 INFO:teuthology.orchestra.run.smithi195.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-25T15:40:52.060 INFO:teuthology.orchestra.run.smithi195.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T15:40:52.077 INFO:teuthology.orchestra.run.smithi195.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-25T15:40:52.090 INFO:teuthology.orchestra.run.smithi080.stdout:(7/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 1.5 MB/s | 1.5 MB 00:00 2024-04-25T15:40:52.112 INFO:teuthology.orchestra.run.smithi195.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-25T15:40:52.153 INFO:teuthology.orchestra.run.smithi195.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-25T15:40:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-25T15:40:52.203 INFO:teuthology.orchestra.run.smithi195.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-25T15:40:52.228 INFO:teuthology.orchestra.run.smithi195.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T15:40:52.253 INFO:teuthology.orchestra.run.smithi195.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 662 kB/s | 33 kB 00:00 2024-04-25T15:40:52.296 INFO:teuthology.orchestra.run.smithi195.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 451 kB/s | 18 kB 00:00 2024-04-25T15:40:52.346 INFO:teuthology.orchestra.run.smithi195.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T15:40:52.371 INFO:teuthology.orchestra.run.smithi195.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 154 kB/s | 11 kB 00:00 2024-04-25T15:40:52.396 INFO:teuthology.orchestra.run.smithi195.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T15:40:52.422 INFO:teuthology.orchestra.run.smithi195.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-04-25T15:40:52.463 INFO:teuthology.orchestra.run.smithi195.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-04-25T15:40:52.489 INFO:teuthology.orchestra.run.smithi195.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 582 kB 00:00 2024-04-25T15:40:52.514 INFO:teuthology.orchestra.run.smithi195.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 514 kB/s | 25 kB 00:00 2024-04-25T15:40:52.540 INFO:teuthology.orchestra.run.smithi195.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-25T15:40:52.565 INFO:teuthology.orchestra.run.smithi195.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T15:40:52.582 INFO:teuthology.orchestra.run.smithi195.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-25T15:40:52.607 INFO:teuthology.orchestra.run.smithi195.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 851 kB/s | 35 kB 00:00 2024-04-25T15:40:52.749 INFO:teuthology.orchestra.run.smithi195.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-04-25T15:40:52.816 INFO:teuthology.orchestra.run.smithi195.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-04-25T15:40:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-25T15:40:52.900 INFO:teuthology.orchestra.run.smithi195.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-25T15:40:52.925 INFO:teuthology.orchestra.run.smithi195.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T15:40:52.999 INFO:teuthology.orchestra.run.smithi080.stdout:(8/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 3.4 MB/s | 4.9 MB 00:01 2024-04-25T15:40:53.041 INFO:teuthology.orchestra.run.smithi080.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 609 kB/s | 25 kB 00:00 2024-04-25T15:40:53.309 INFO:teuthology.orchestra.run.smithi195.stdout:(71/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 9.9 MB/s | 43 MB 00:04 2024-04-25T15:40:53.351 INFO:teuthology.orchestra.run.smithi195.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-04-25T15:40:53.576 INFO:teuthology.orchestra.run.smithi195.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 8.6 MB/s | 5.8 MB 00:00 2024-04-25T15:40:53.601 INFO:teuthology.orchestra.run.smithi195.stdout:(74/152): python3-attrs-20.3.0-7.el9.noarch.rpm 301 kB/s | 87 kB 00:00 2024-04-25T15:40:53.691 INFO:teuthology.orchestra.run.smithi080.stdout:(10/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 9.7 MB/s | 18 MB 00:01 2024-04-25T15:40:53.758 INFO:teuthology.orchestra.run.smithi080.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 3.3 MB/s | 224 kB 00:00 2024-04-25T15:40:53.816 INFO:teuthology.orchestra.run.smithi080.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 464 kB/s | 27 kB 00:00 2024-04-25T15:40:53.818 INFO:teuthology.orchestra.run.smithi195.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-04-25T15:40:53.844 INFO:teuthology.orchestra.run.smithi195.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.0 MB/s | 248 kB 00:00 2024-04-25T15:40:53.875 INFO:teuthology.orchestra.run.smithi080.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 544 kB/s | 32 kB 00:00 2024-04-25T15:40:53.919 INFO:teuthology.orchestra.run.smithi195.stdout:(77/152): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-25T15:40:53.944 INFO:teuthology.orchestra.run.smithi195.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-04-25T15:40:53.969 INFO:teuthology.orchestra.run.smithi195.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-04-25T15:40:53.992 INFO:teuthology.orchestra.run.smithi080.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 6.3 MB/s | 756 kB 00:00 2024-04-25T15:40:53.994 INFO:teuthology.orchestra.run.smithi195.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T15:40:54.020 INFO:teuthology.orchestra.run.smithi195.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 463 kB/s | 35 kB 00:00 2024-04-25T15:40:54.059 INFO:teuthology.orchestra.run.smithi080.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 2.3 MB/s | 158 kB 00:00 2024-04-25T15:40:54.126 INFO:teuthology.orchestra.run.smithi080.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.9 MB/s | 127 kB 00:00 2024-04-25T15:40:54.128 INFO:teuthology.orchestra.run.smithi195.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.1 MB/s | 222 kB 00:00 2024-04-25T15:40:54.153 INFO:teuthology.orchestra.run.smithi195.stdout:(83/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 250 kB 00:00 2024-04-25T15:40:54.210 INFO:teuthology.orchestra.run.smithi080.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 5.8 MB/s | 497 kB 00:00 2024-04-25T15:40:54.220 INFO:teuthology.orchestra.run.smithi195.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-04-25T15:40:54.246 INFO:teuthology.orchestra.run.smithi195.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-04-25T15:40:54.271 INFO:teuthology.orchestra.run.smithi195.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 368 kB/s | 42 kB 00:00 2024-04-25T15:40:54.296 INFO:teuthology.orchestra.run.smithi195.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T15:40:54.330 INFO:teuthology.orchestra.run.smithi195.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-25T15:40:54.355 INFO:teuthology.orchestra.run.smithi195.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-04-25T15:40:54.380 INFO:teuthology.orchestra.run.smithi195.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 617 kB/s | 51 kB 00:00 2024-04-25T15:40:54.399 INFO:teuthology.orchestra.run.smithi195.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-04-25T15:40:54.433 INFO:teuthology.orchestra.run.smithi195.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 799 kB/s | 42 kB 00:00 2024-04-25T15:40:54.466 INFO:teuthology.orchestra.run.smithi195.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 677 kB/s | 44 kB 00:00 2024-04-25T15:40:54.468 INFO:teuthology.orchestra.run.smithi080.stdout:(18/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 4.3 MB/s | 10 MB 00:02 2024-04-25T15:40:54.533 INFO:teuthology.orchestra.run.smithi195.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-04-25T15:40:54.543 INFO:teuthology.orchestra.run.smithi080.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 604 kB/s | 45 kB 00:00 2024-04-25T15:40:54.575 INFO:teuthology.orchestra.run.smithi195.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 340 kB/s | 36 kB 00:00 2024-04-25T15:40:54.594 INFO:teuthology.orchestra.run.smithi080.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 2.6 MB/s | 135 kB 00:00 2024-04-25T15:40:54.669 INFO:teuthology.orchestra.run.smithi080.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 2.1 MB/s | 161 kB 00:00 2024-04-25T15:40:54.675 INFO:teuthology.orchestra.run.smithi195.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 340 kB/s | 47 kB 00:00 2024-04-25T15:40:54.717 INFO:teuthology.orchestra.run.smithi195.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-04-25T15:40:54.811 INFO:teuthology.orchestra.run.smithi080.stdout:(22/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 8.6 MB/s | 5.2 MB 00:00 2024-04-25T15:40:54.836 INFO:teuthology.orchestra.run.smithi080.stdout:(23/152): python3-rados-19.0.0-3291.g994e2f20.e 1.9 MB/s | 321 kB 00:00 2024-04-25T15:40:54.876 INFO:teuthology.orchestra.run.smithi195.stdout:(98/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-25T15:40:54.878 INFO:teuthology.orchestra.run.smithi080.stdout:(24/152): python3-rbd-19.0.0-3291.g994e2f20.el9 4.3 MB/s | 298 kB 00:00 2024-04-25T15:40:54.901 INFO:teuthology.orchestra.run.smithi195.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 259 kB/s | 58 kB 00:00 2024-04-25T15:40:54.903 INFO:teuthology.orchestra.run.smithi080.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.4 MB/s | 100 kB 00:00 2024-04-25T15:40:54.926 INFO:teuthology.orchestra.run.smithi195.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 450 kB/s | 94 kB 00:00 2024-04-25T15:40:54.937 INFO:teuthology.orchestra.run.smithi080.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.4 MB/s | 86 kB 00:00 2024-04-25T15:40:54.952 INFO:teuthology.orchestra.run.smithi195.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-04-25T15:40:54.977 INFO:teuthology.orchestra.run.smithi195.stdout:(102/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 850 kB/s | 64 kB 00:00 2024-04-25T15:40:55.013 INFO:teuthology.orchestra.run.smithi080.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 2.2 MB/s | 169 kB 00:00 2024-04-25T15:40:55.030 INFO:teuthology.orchestra.run.smithi195.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 216 kB/s | 22 kB 00:00 2024-04-25T15:40:55.069 INFO:teuthology.orchestra.run.smithi195.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-04-25T15:40:55.138 INFO:teuthology.orchestra.run.smithi080.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 273 kB/s | 34 kB 00:00 2024-04-25T15:40:55.236 INFO:teuthology.orchestra.run.smithi195.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 117 kB/s | 19 kB 00:00 2024-04-25T15:40:55.264 INFO:teuthology.orchestra.run.smithi080.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.1 MB/s | 142 kB 00:00 2024-04-25T15:40:55.378 INFO:teuthology.orchestra.run.smithi195.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 893 kB/s | 309 kB 00:00 2024-04-25T15:40:55.445 INFO:teuthology.orchestra.run.smithi195.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-04-25T15:40:55.470 INFO:teuthology.orchestra.run.smithi195.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-25T15:40:55.512 INFO:teuthology.orchestra.run.smithi195.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 727 kB/s | 49 kB 00:00 2024-04-25T15:40:55.546 INFO:teuthology.orchestra.run.smithi195.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 894 kB/s | 67 kB 00:00 2024-04-25T15:40:55.588 INFO:teuthology.orchestra.run.smithi195.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-25T15:40:55.671 INFO:teuthology.orchestra.run.smithi195.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-04-25T15:40:55.738 INFO:teuthology.orchestra.run.smithi195.stdout:(113/152): libarrow-9.0.0-10.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-04-25T15:40:55.764 INFO:teuthology.orchestra.run.smithi195.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-04-25T15:40:55.789 INFO:teuthology.orchestra.run.smithi195.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-04-25T15:40:55.814 INFO:teuthology.orchestra.run.smithi195.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-04-25T15:40:55.839 INFO:teuthology.orchestra.run.smithi195.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-25T15:40:55.864 INFO:teuthology.orchestra.run.smithi195.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-25T15:40:55.889 INFO:teuthology.orchestra.run.smithi080.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 5.7 MB/s | 3.5 MB 00:00 2024-04-25T15:40:55.890 INFO:teuthology.orchestra.run.smithi195.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-04-25T15:40:55.915 INFO:teuthology.orchestra.run.smithi195.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-25T15:40:55.940 INFO:teuthology.orchestra.run.smithi195.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 467 kB/s | 35 kB 00:00 2024-04-25T15:40:55.974 INFO:teuthology.orchestra.run.smithi195.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-25T15:40:56.033 INFO:teuthology.orchestra.run.smithi195.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-25T15:40:56.058 INFO:teuthology.orchestra.run.smithi195.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-25T15:40:56.083 INFO:teuthology.orchestra.run.smithi195.stdout:(125/152): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-04-25T15:40:56.109 INFO:teuthology.orchestra.run.smithi195.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-25T15:40:56.126 INFO:teuthology.orchestra.run.smithi195.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 345 kB/s | 23 kB 00:00 2024-04-25T15:40:56.139 INFO:teuthology.orchestra.run.smithi080.stdout:(31/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 2.5 MB/s | 3.0 MB 00:01 2024-04-25T15:40:56.151 INFO:teuthology.orchestra.run.smithi195.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-25T15:40:56.168 INFO:teuthology.orchestra.run.smithi195.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-04-25T15:40:56.210 INFO:teuthology.orchestra.run.smithi195.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-25T15:40:56.226 INFO:teuthology.orchestra.run.smithi195.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 614 kB/s | 46 kB 00:00 2024-04-25T15:40:56.252 INFO:teuthology.orchestra.run.smithi195.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 940 kB/s | 79 kB 00:00 2024-04-25T15:40:56.269 INFO:teuthology.orchestra.run.smithi195.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 980 kB/s | 58 kB 00:00 2024-04-25T15:40:56.289 INFO:teuthology.orchestra.run.smithi080.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.6 MB/s | 249 kB 00:00 2024-04-25T15:40:56.302 INFO:teuthology.orchestra.run.smithi195.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T15:40:56.328 INFO:teuthology.orchestra.run.smithi195.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-25T15:40:56.353 INFO:teuthology.orchestra.run.smithi195.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-25T15:40:56.378 INFO:teuthology.orchestra.run.smithi195.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-25T15:40:56.381 INFO:teuthology.orchestra.run.smithi080.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 555 kB/s | 49 kB 00:00 2024-04-25T15:40:56.404 INFO:teuthology.orchestra.run.smithi195.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-04-25T15:40:56.429 INFO:teuthology.orchestra.run.smithi195.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T15:40:56.454 INFO:teuthology.orchestra.run.smithi195.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-04-25T15:40:56.479 INFO:teuthology.orchestra.run.smithi195.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-04-25T15:40:56.482 INFO:teuthology.orchestra.run.smithi080.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 164 kB/s | 16 kB 00:00 2024-04-25T15:40:56.504 INFO:teuthology.orchestra.run.smithi195.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-04-25T15:40:56.538 INFO:teuthology.orchestra.run.smithi195.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-25T15:40:56.563 INFO:teuthology.orchestra.run.smithi195.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-25T15:40:56.589 INFO:teuthology.orchestra.run.smithi195.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T15:40:56.614 INFO:teuthology.orchestra.run.smithi195.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-25T15:40:56.639 INFO:teuthology.orchestra.run.smithi195.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-25T15:40:56.648 INFO:teuthology.orchestra.run.smithi080.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.6 MB/s | 273 kB 00:00 2024-04-25T15:40:56.689 INFO:teuthology.orchestra.run.smithi195.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T15:40:56.757 INFO:teuthology.orchestra.run.smithi195.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T15:40:56.840 INFO:teuthology.orchestra.run.smithi195.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-04-25T15:40:57.015 INFO:teuthology.orchestra.run.smithi080.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 2.0 MB/s | 762 kB 00:00 2024-04-25T15:40:57.124 INFO:teuthology.orchestra.run.smithi080.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 168 kB/s | 18 kB 00:00 2024-04-25T15:40:57.249 INFO:teuthology.orchestra.run.smithi080.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 5.4 MB/s | 7.4 MB 00:01 2024-04-25T15:40:57.308 INFO:teuthology.orchestra.run.smithi080.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 438 kB/s | 80 kB 00:00 2024-04-25T15:40:57.367 INFO:teuthology.orchestra.run.smithi080.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2024-04-25T15:40:57.392 INFO:teuthology.orchestra.run.smithi080.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-25T15:40:57.415 INFO:teuthology.orchestra.run.smithi195.stdout:(151/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-04-25T15:40:57.417 INFO:teuthology.orchestra.run.smithi080.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-25T15:40:57.459 INFO:teuthology.orchestra.run.smithi080.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-25T15:40:57.484 INFO:teuthology.orchestra.run.smithi080.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T15:40:57.510 INFO:teuthology.orchestra.run.smithi080.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T15:40:57.535 INFO:teuthology.orchestra.run.smithi080.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T15:40:57.540 INFO:teuthology.orchestra.run.smithi195.stdout:(152/152): librados2-19.0.0-3291.g994e2f20.el9. 3.6 MB/s | 3.3 MB 00:00 2024-04-25T15:40:57.545 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:40:57.545 INFO:teuthology.orchestra.run.smithi195.stdout:Total 18 MB/s | 214 MB 00:11 2024-04-25T15:40:57.560 INFO:teuthology.orchestra.run.smithi080.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T15:40:57.585 INFO:teuthology.orchestra.run.smithi080.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-25T15:40:57.627 INFO:teuthology.orchestra.run.smithi080.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-25T15:40:57.662 INFO:teuthology.orchestra.run.smithi080.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-25T15:40:57.687 INFO:teuthology.orchestra.run.smithi080.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-25T15:40:57.712 INFO:teuthology.orchestra.run.smithi080.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T15:40:57.737 INFO:teuthology.orchestra.run.smithi080.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 658 kB/s | 33 kB 00:00 2024-04-25T15:40:57.779 INFO:teuthology.orchestra.run.smithi080.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 449 kB/s | 18 kB 00:00 2024-04-25T15:40:57.829 INFO:teuthology.orchestra.run.smithi080.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T15:40:57.855 INFO:teuthology.orchestra.run.smithi080.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 154 kB/s | 11 kB 00:00 2024-04-25T15:40:57.880 INFO:teuthology.orchestra.run.smithi080.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T15:40:57.905 INFO:teuthology.orchestra.run.smithi080.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-04-25T15:40:57.931 INFO:teuthology.orchestra.run.smithi080.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T15:40:57.964 INFO:teuthology.orchestra.run.smithi080.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-25T15:40:57.989 INFO:teuthology.orchestra.run.smithi080.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 441 kB/s | 25 kB 00:00 2024-04-25T15:40:58.015 INFO:teuthology.orchestra.run.smithi080.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-25T15:40:58.040 INFO:teuthology.orchestra.run.smithi080.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T15:40:58.066 INFO:teuthology.orchestra.run.smithi080.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T15:40:58.091 INFO:teuthology.orchestra.run.smithi080.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 708 kB/s | 35 kB 00:00 2024-04-25T15:40:58.350 INFO:teuthology.orchestra.run.smithi080.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-25T15:40:58.417 INFO:teuthology.orchestra.run.smithi080.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T15:40:58.458 INFO:teuthology.orchestra.run.smithi080.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-25T15:40:58.500 INFO:teuthology.orchestra.run.smithi080.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-25T15:40:58.526 INFO:teuthology.orchestra.run.smithi080.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T15:40:58.609 INFO:teuthology.orchestra.run.smithi080.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-25T15:40:58.657 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T15:40:58.668 INFO:teuthology.orchestra.run.smithi080.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T15:40:58.743 INFO:teuthology.orchestra.run.smithi080.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-04-25T15:40:58.800 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T15:40:58.800 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T15:40:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.3 MB/s | 244 kB 00:00 2024-04-25T15:40:58.886 INFO:teuthology.orchestra.run.smithi080.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 6.0 MB 00:00 2024-04-25T15:40:58.910 INFO:teuthology.orchestra.run.smithi080.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-04-25T15:40:58.936 INFO:teuthology.orchestra.run.smithi080.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-25T15:40:58.962 INFO:teuthology.orchestra.run.smithi080.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 379 kB/s | 19 kB 00:00 2024-04-25T15:40:58.995 INFO:teuthology.orchestra.run.smithi080.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T15:40:59.021 INFO:teuthology.orchestra.run.smithi080.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-04-25T15:40:59.062 INFO:teuthology.orchestra.run.smithi080.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.1 MB/s | 250 kB 00:00 2024-04-25T15:40:59.105 INFO:teuthology.orchestra.run.smithi080.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 5.6 MB/s | 222 kB 00:00 2024-04-25T15:40:59.171 INFO:teuthology.orchestra.run.smithi080.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-25T15:40:59.197 INFO:teuthology.orchestra.run.smithi080.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 851 kB/s | 77 kB 00:00 2024-04-25T15:40:59.222 INFO:teuthology.orchestra.run.smithi080.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-04-25T15:40:59.247 INFO:teuthology.orchestra.run.smithi080.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-25T15:40:59.273 INFO:teuthology.orchestra.run.smithi080.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T15:40:59.306 INFO:teuthology.orchestra.run.smithi080.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-25T15:40:59.331 INFO:teuthology.orchestra.run.smithi080.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 880 kB/s | 51 kB 00:00 2024-04-25T15:40:59.357 INFO:teuthology.orchestra.run.smithi080.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T15:40:59.390 INFO:teuthology.orchestra.run.smithi080.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2024-04-25T15:40:59.432 INFO:teuthology.orchestra.run.smithi080.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-04-25T15:40:59.483 INFO:teuthology.orchestra.run.smithi080.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.6 MB/s | 221 kB 00:00 2024-04-25T15:40:59.525 INFO:teuthology.orchestra.run.smithi080.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 931 kB/s | 36 kB 00:00 2024-04-25T15:40:59.567 INFO:teuthology.orchestra.run.smithi080.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2024-04-25T15:40:59.759 INFO:teuthology.orchestra.run.smithi080.stdout:(96/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-04-25T15:40:59.784 INFO:teuthology.orchestra.run.smithi080.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-04-25T15:40:59.809 INFO:teuthology.orchestra.run.smithi080.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T15:40:59.835 INFO:teuthology.orchestra.run.smithi080.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T15:40:59.860 INFO:teuthology.orchestra.run.smithi080.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T15:40:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-04-25T15:40:59.910 INFO:teuthology.orchestra.run.smithi080.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-04-25T15:40:59.944 INFO:teuthology.orchestra.run.smithi080.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-04-25T15:41:00.345 INFO:teuthology.orchestra.run.smithi080.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 772 kB/s | 309 kB 00:00 2024-04-25T15:41:00.411 INFO:teuthology.orchestra.run.smithi080.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-25T15:41:00.437 INFO:teuthology.orchestra.run.smithi080.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-04-25T15:41:00.512 INFO:teuthology.orchestra.run.smithi080.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-25T15:41:00.524 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T15:41:00.524 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T15:41:00.596 INFO:teuthology.orchestra.run.smithi080.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-04-25T15:41:00.688 INFO:teuthology.orchestra.run.smithi080.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 736 kB/s | 67 kB 00:00 2024-04-25T15:41:00.763 INFO:teuthology.orchestra.run.smithi080.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-25T15:41:00.788 INFO:teuthology.orchestra.run.smithi080.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-04-25T15:41:00.863 INFO:teuthology.orchestra.run.smithi080.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 838 kB 00:00 2024-04-25T15:41:00.980 INFO:teuthology.orchestra.run.smithi080.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 372 kB/s | 43 kB 00:00 2024-04-25T15:41:01.005 INFO:teuthology.orchestra.run.smithi080.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-04-25T15:41:01.039 INFO:teuthology.orchestra.run.smithi080.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2024-04-25T15:41:01.065 INFO:teuthology.orchestra.run.smithi080.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-04-25T15:41:01.115 INFO:teuthology.orchestra.run.smithi080.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-25T15:41:01.157 INFO:teuthology.orchestra.run.smithi080.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-25T15:41:01.190 INFO:teuthology.orchestra.run.smithi080.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-25T15:41:01.224 INFO:teuthology.orchestra.run.smithi080.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 529 kB/s | 35 kB 00:00 2024-04-25T15:41:01.266 INFO:teuthology.orchestra.run.smithi080.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T15:41:01.341 INFO:teuthology.orchestra.run.smithi080.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-25T15:41:01.417 INFO:teuthology.orchestra.run.smithi080.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T15:41:01.492 INFO:teuthology.orchestra.run.smithi080.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 71 kB/s | 11 kB 00:00 2024-04-25T15:41:01.517 INFO:teuthology.orchestra.run.smithi080.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2024-04-25T15:41:01.559 INFO:teuthology.orchestra.run.smithi080.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 345 kB/s | 23 kB 00:00 2024-04-25T15:41:01.584 INFO:teuthology.orchestra.run.smithi080.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-25T15:41:01.626 INFO:teuthology.orchestra.run.smithi080.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-04-25T15:41:01.676 INFO:teuthology.orchestra.run.smithi080.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-25T15:41:01.702 INFO:teuthology.orchestra.run.smithi080.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-04-25T15:41:01.735 INFO:teuthology.orchestra.run.smithi080.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-25T15:41:01.769 INFO:teuthology.orchestra.run.smithi080.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2024-04-25T15:41:01.811 INFO:teuthology.orchestra.run.smithi080.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T15:41:01.836 INFO:teuthology.orchestra.run.smithi080.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-04-25T15:41:02.220 INFO:teuthology.orchestra.run.smithi080.stdout:(135/152): ceph-test-19.0.0-3291.g994e2f20.el9. 4.7 MB/s | 43 MB 00:09 2024-04-25T15:41:02.245 INFO:teuthology.orchestra.run.smithi080.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 69 kB/s | 28 kB 00:00 2024-04-25T15:41:02.262 INFO:teuthology.orchestra.run.smithi080.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 199 kB/s | 90 kB 00:00 2024-04-25T15:41:02.313 INFO:teuthology.orchestra.run.smithi080.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-25T15:41:02.338 INFO:teuthology.orchestra.run.smithi080.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-25T15:41:02.380 INFO:teuthology.orchestra.run.smithi080.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2024-04-25T15:41:02.405 INFO:teuthology.orchestra.run.smithi080.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2024-04-25T15:41:02.455 INFO:teuthology.orchestra.run.smithi080.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T15:41:02.481 INFO:teuthology.orchestra.run.smithi080.stdout:(143/152): python3-repoze-lru-0.7-16.el9.noarch 118 kB/s | 31 kB 00:00 2024-04-25T15:41:02.505 INFO:teuthology.orchestra.run.smithi080.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-04-25T15:41:02.539 INFO:teuthology.orchestra.run.smithi080.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T15:41:02.565 INFO:teuthology.orchestra.run.smithi080.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-04-25T15:41:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T15:41:02.640 INFO:teuthology.orchestra.run.smithi080.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T15:41:02.699 INFO:teuthology.orchestra.run.smithi080.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-25T15:41:02.774 INFO:teuthology.orchestra.run.smithi080.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-04-25T15:41:02.883 INFO:teuthology.orchestra.run.smithi080.stdout:(151/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 11 MB/s | 3.1 MB 00:00 2024-04-25T15:41:03.216 INFO:teuthology.orchestra.run.smithi080.stdout:(152/152): librados2-19.0.0-3291.g994e2f20.el9. 5.1 MB/s | 3.3 MB 00:00 2024-04-25T15:41:03.223 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:41:03.223 INFO:teuthology.orchestra.run.smithi080.stdout:Total 13 MB/s | 214 MB 00:16 2024-04-25T15:41:04.342 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-25T15:41:04.484 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-25T15:41:04.484 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-25T15:41:06.250 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-25T15:41:06.251 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-25T15:41:06.432 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T15:41:06.519 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T15:41:06.557 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T15:41:06.619 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T15:41:06.653 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T15:41:06.679 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T15:41:06.722 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T15:41:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T15:41:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:41:07.305 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:41:07.339 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:41:07.430 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:41:07.468 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:41:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T15:41:07.673 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T15:41:07.701 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:41:07.805 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:41:07.844 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:41:07.906 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:41:07.928 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:41:07.949 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:41:08.120 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:41:08.153 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:41:08.261 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T15:41:08.356 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T15:41:08.394 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T15:41:08.428 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T15:41:08.493 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T15:41:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T15:41:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T15:41:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T15:41:08.631 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T15:41:08.692 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T15:41:08.745 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T15:41:08.775 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T15:41:08.811 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T15:41:08.887 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T15:41:08.922 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T15:41:08.965 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T15:41:09.003 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T15:41:09.073 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T15:41:09.125 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T15:41:09.200 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T15:41:09.334 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T15:41:09.386 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T15:41:09.917 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T15:41:09.999 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T15:41:10.035 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T15:41:10.078 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T15:41:10.116 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T15:41:10.159 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T15:41:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T15:41:10.386 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T15:41:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T15:41:10.513 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T15:41:10.545 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T15:41:10.581 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T15:41:10.628 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T15:41:10.664 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T15:41:10.707 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T15:41:10.749 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T15:41:10.894 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T15:41:10.946 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T15:41:10.977 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T15:41:11.032 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T15:41:11.129 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T15:41:11.169 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T15:41:11.208 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T15:41:11.233 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T15:41:11.258 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T15:41:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T15:41:11.452 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T15:41:11.490 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T15:41:11.518 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T15:41:11.553 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T15:41:11.592 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T15:41:11.623 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T15:41:11.653 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T15:41:11.688 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T15:41:11.721 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T15:41:11.762 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T15:41:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T15:41:11.893 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T15:41:11.952 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T15:41:11.983 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T15:41:12.031 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T15:41:12.180 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-25T15:41:12.269 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T15:41:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T15:41:12.369 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T15:41:12.380 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T15:41:12.538 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T15:41:12.579 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T15:41:12.604 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T15:41:12.647 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T15:41:12.981 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T15:41:13.094 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T15:41:13.105 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:41:13.140 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T15:41:13.174 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T15:41:13.230 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:41:13.256 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:41:13.275 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T15:41:13.324 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T15:41:13.347 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:41:13.377 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:41:13.412 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T15:41:13.459 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T15:41:13.522 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T15:41:13.574 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T15:41:13.602 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:41:13.638 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T15:41:13.665 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T15:41:13.706 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:41:13.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T15:41:13.753 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:41:13.816 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:41:13.838 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:41:13.856 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:41:14.046 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:41:14.079 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:41:14.186 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T15:41:14.281 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T15:41:14.311 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T15:41:14.345 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T15:41:14.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T15:41:14.420 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T15:41:14.454 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T15:41:14.498 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T15:41:14.505 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T15:41:14.537 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T15:41:14.568 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T15:41:14.659 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T15:41:14.714 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T15:41:14.744 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T15:41:14.788 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T15:41:14.865 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T15:41:14.924 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T15:41:14.967 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T15:41:15.004 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T15:41:15.074 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T15:41:15.119 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T15:41:15.193 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T15:41:15.327 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T15:41:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T15:41:15.751 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T15:41:15.845 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T15:41:15.874 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T15:41:15.905 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T15:41:15.906 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T15:41:15.991 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T15:41:16.020 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T15:41:16.055 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T15:41:16.093 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T15:41:16.135 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T15:41:16.228 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T15:41:16.277 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:41:16.287 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T15:41:16.338 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T15:41:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:41:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T15:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T15:41:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T15:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T15:41:16.497 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T15:41:16.534 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T15:41:16.580 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T15:41:16.616 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T15:41:16.659 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T15:41:16.710 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T15:41:16.845 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T15:41:16.899 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T15:41:16.914 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T15:41:16.929 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T15:41:16.946 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:41:16.970 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T15:41:17.034 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:41:17.056 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T15:41:17.063 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T15:41:17.095 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T15:41:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T15:41:17.161 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T15:41:17.186 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T15:41:17.261 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T15:41:17.387 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T15:41:17.427 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T15:41:17.455 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T15:41:17.489 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T15:41:17.528 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T15:41:17.559 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T15:41:17.590 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T15:41:17.624 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T15:41:17.657 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T15:41:17.699 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T15:41:17.742 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T15:41:17.828 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T15:41:17.956 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T15:41:17.987 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T15:41:18.034 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T15:41:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T15:41:18.180 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T15:41:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T15:41:18.944 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T15:41:18.978 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T15:41:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T15:41:19.127 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T15:41:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T15:41:19.271 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T15:41:19.308 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:41:19.336 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:41:19.452 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T15:41:19.603 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T15:41:19.679 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T15:41:19.895 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:41:19.931 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:41:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:41:20.023 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:41:20.023 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:41:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:41:20.313 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T15:41:20.426 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T15:41:21.641 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T15:41:21.724 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T15:41:21.752 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T15:41:21.785 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T15:41:22.106 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T15:41:22.157 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:41:22.247 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:41:22.270 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T15:41:22.306 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T15:41:22.794 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T15:41:22.827 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:41:22.898 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:41:22.928 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T15:41:25.178 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:41:25.216 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:41:25.778 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:41:25.820 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:41:25.914 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:41:25.914 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:41:25.914 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:41:25.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:25.946 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:41:31.726 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:41:31.726 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-25T15:41:31.726 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-25T15:41:31.727 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-25T15:41:31.727 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-25T15:41:31.727 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-25T15:41:31.727 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-04-25T15:41:31.727 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-25T15:41:31.727 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:31.904 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:41:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:41:31.919 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:31.919 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:41:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:41:33.575 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:41:33.575 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:33.575 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:41:33.575 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:33.576 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:33.576 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:33.800 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:41:33.822 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:41:33.822 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:33.822 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:41:33.822 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:33.822 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:33.822 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:34.283 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:41:34.306 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:41:34.306 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:34.306 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:41:34.306 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:34.306 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:34.306 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T15:41:34.463 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T15:41:34.518 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T15:41:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T15:41:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T15:41:34.829 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T15:41:34.919 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:41:35.057 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:41:35.101 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T15:41:35.133 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T15:41:35.161 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T15:41:35.529 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:41:35.559 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:41:35.591 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T15:41:35.653 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T15:41:35.682 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:41:36.723 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:41:36.759 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-04-25T15:41:37.618 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-04-25T15:41:37.619 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-04-25T15:41:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:37.727 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:41:37.759 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:41:37.793 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:41:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:41:37.810 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:37.810 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:41:37.810 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:37.863 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:41:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T15:41:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:41:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:41:38.085 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:38.085 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:41:38.085 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:38.085 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:41:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:41:38.239 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T15:41:38.285 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T15:41:39.220 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T15:41:39.248 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:41:39.271 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:41:39.271 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:39.271 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:41:39.271 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:39.271 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:39.271 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:39.324 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:41:39.346 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:41:39.346 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:39.346 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:41:39.346 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:39.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:41:39.413 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:41:39.413 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:39.414 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:41:39.414 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:39.414 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:39.414 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:39.446 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:41:39.472 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:41:39.472 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:39.472 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:41:39.472 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:39.472 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:39.473 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:41:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:41:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:41:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:39.733 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:41:39.756 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:41:39.756 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:39.756 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:41:39.756 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:39.756 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:39.756 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:40.181 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:41:40.205 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:41:40.205 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:40.205 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:41:40.205 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:40.205 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:40.205 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:40.302 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T15:41:40.351 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T15:41:40.406 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T15:41:40.589 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T15:41:40.640 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T15:41:40.718 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T15:41:40.815 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:41:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:41:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T15:41:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T15:41:41.059 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T15:41:41.511 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:41:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:41:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T15:41:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T15:41:41.672 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:41:42.714 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:41:42.750 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:41:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:41:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:41:43.843 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:41:44.017 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T15:41:44.020 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T15:41:44.044 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:41:44.062 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T15:41:44.066 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:41:44.066 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:44.067 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:41:44.067 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:44.067 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:44.067 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:44.102 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T15:41:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:41:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:41:44.134 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T15:41:44.162 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T15:41:44.220 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T15:41:44.267 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T15:41:44.351 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T15:41:44.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T15:41:44.421 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T15:41:45.042 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:41:45.077 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:41:45.096 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:41:45.198 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T15:41:45.222 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:41:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:41:45.245 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:45.245 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:41:45.245 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:45.245 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:41:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:41:45.320 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:45.320 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:41:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:41:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:41:45.388 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:45.388 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:41:45.388 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:45.388 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:45.699 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:41:45.722 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:41:45.722 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:45.722 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:41:45.722 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:45.722 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:45.722 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:41:45.923 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T15:41:45.998 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T15:41:46.039 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T15:41:46.121 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T15:41:46.169 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T15:41:46.170 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:41:46.270 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:41:46.303 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:41:46.303 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:41:46.379 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:41:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:41:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T15:41:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T15:41:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T15:41:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T15:41:50.144 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T15:41:50.318 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T15:41:50.357 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T15:41:50.387 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T15:41:50.926 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:41:50.960 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:41:50.980 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:41:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T15:41:51.899 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T15:41:51.940 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T15:41:52.021 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T15:41:52.053 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T15:41:52.054 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:41:52.137 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:41:52.170 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:41:52.171 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:41:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:41:52.323 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:41:52.350 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:41:52.350 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:41:52.351 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T15:41:52.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T15:41:52.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T15:41:52.354 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T15:41:52.355 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T15:41:52.356 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T15:41:52.357 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T15:41:52.358 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T15:41:52.359 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T15:41:52.360 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T15:41:52.361 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:41:52.362 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T15:41:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:41:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:54.449 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-25T15:41:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:41:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:41:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:41:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:41:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:41:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:41:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:41:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:41:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:41:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:41:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:41:54.461 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T15:41:54.810 DEBUG:teuthology.parallel:result is None 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:41:58.412 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T15:41:58.413 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T15:41:58.414 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T15:41:58.427 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T15:41:58.427 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T15:41:58.427 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T15:41:58.427 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T15:41:58.427 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T15:41:58.428 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T15:41:58.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T15:41:58.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T15:41:58.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T15:41:58.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T15:41:58.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T15:41:58.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T15:41:58.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T15:41:58.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T15:41:58.432 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T15:41:58.433 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T15:41:58.434 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T15:41:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T15:41:58.436 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T15:41:58.437 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T15:41:58.438 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T15:41:58.439 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T15:41:58.439 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T15:41:58.439 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T15:41:58.439 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:41:58.439 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T15:42:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:42:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:00.513 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-04-25T15:42:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:42:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:42:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:42:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:42:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:42:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:42:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:42:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:42:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:42:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:42:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:42:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:00.525 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T15:42:00.949 DEBUG:teuthology.parallel:result is None 2024-04-25T15:42:00.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:42:01.192 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:42:01.212 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:42:01.213 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:42:01.213 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:42:01.215 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:42:01.364 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:42:01.389 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:42:01.390 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:42:01.390 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:42:01.391 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T15:42:01.392 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:01.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:42:01.418 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:01.418 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:42:01.459 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T15:42:01.459 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:01.459 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:42:01.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:42:01.548 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:01.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:42:01.574 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:42:01.640 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T15:42:01.641 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:01.641 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:42:01.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:42:01.728 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:01.728 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:42:01.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:42:01.820 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T15:42:01.820 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:01.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:42:01.843 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:42:01.907 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:01.908 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:42:01.932 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:42:01.998 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T15:42:02.087 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T15:42:02.088 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-04-25T15:42:02.090 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-04-25T15:42:02.114 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T15:42:02.114 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:42:02.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:42:02.178 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T15:42:02.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:42:02.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:42:02.249 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T15:42:02.249 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T15:42:02.249 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T15:42:02.250 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:02.250 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:42:02.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:02.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:02.442 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:02.442 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:42:02.457 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:02.565 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:02.611 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T15:42:02.612 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T15:42:02.612 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673230', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'client session with non-allowable root'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGftt3p0Z3QW4HH2ur8GPVRxQZ7Fj2VtyXBGEZacf7cuB3NULC9e8E7eCC6wClc+JUkHZna/FHPswQFgzeHa0U=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGH7jE023E30ZC+TxER1LNj8+lBZL156eWWcVwHhzT8t9uAqCpdsZJ7Urr7Q4F2j0qP56PsZgNGPe20QHtreDmA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'client session with non-allowable root'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T15:42:02.612 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:42:02.615 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:42:02.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:42:02.669 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:42:02.723 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:02.723 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:42:02.745 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:42:02.745 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-04-25T15:42:02.799 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:42:02.799 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:02.799 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-25T15:42:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 15:41:52.676501803 +0000 2024-04-25T15:42:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 15:40:05.716395874 +0000 2024-04-25T15:42:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 15:40:05.716395874 +0000 2024-04-25T15:42:02.800 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 15:40:05.716395874 +0000 2024-04-25T15:42:02.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:42:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T15:42:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T15:42:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000192279 s, 2.7 MB/s 2024-04-25T15:42:02.863 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:42:02.918 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 15:41:52.676501803 +0000 2024-04-25T15:42:02.973 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 15:40:06.060386815 +0000 2024-04-25T15:42:02.974 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 15:40:06.060386815 +0000 2024-04-25T15:42:02.974 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 15:40:06.060386815 +0000 2024-04-25T15:42:02.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:42:03.036 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T15:42:03.036 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T15:42:03.036 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000168191 s, 3.0 MB/s 2024-04-25T15:42:03.037 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:42:03.094 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 15:41:52.677501780 +0000 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 15:40:06.388378177 +0000 2024-04-25T15:42:03.148 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 15:40:06.388378177 +0000 2024-04-25T15:42:03.149 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 15:40:06.388378177 +0000 2024-04-25T15:42:03.149 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:42:03.210 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T15:42:03.210 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T15:42:03.211 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000170724 s, 3.0 MB/s 2024-04-25T15:42:03.212 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:42:03.267 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-04-25T15:42:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:42:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:03.321 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T15:42:03.321 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:03.321 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:03.321 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 15:41:52.677501780 +0000 2024-04-25T15:42:03.322 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 15:40:06.705369829 +0000 2024-04-25T15:42:03.322 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 15:40:06.705369829 +0000 2024-04-25T15:42:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 15:40:06.705369829 +0000 2024-04-25T15:42:03.322 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:42:03.384 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T15:42:03.384 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T15:42:03.384 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000207891 s, 2.5 MB/s 2024-04-25T15:42:03.385 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:42:03.441 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:03.441 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:03.441 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:42:03.456 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:42:03.456 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-25T15:42:03.511 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:42:03.511 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:03.511 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T15:42:03.512 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:03.512 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:03.512 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 15:41:46.854134532 +0000 2024-04-25T15:42:03.512 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 15:40:05.714975759 +0000 2024-04-25T15:42:03.512 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 15:40:05.714975759 +0000 2024-04-25T15:42:03.512 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 15:40:05.714975759 +0000 2024-04-25T15:42:03.512 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:42:03.575 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T15:42:03.575 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T15:42:03.575 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000107281 s, 4.8 MB/s 2024-04-25T15:42:03.576 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:42:03.631 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-25T15:42:03.686 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:42:03.686 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:03.686 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T15:42:03.686 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:03.686 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:03.686 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 15:41:46.855134513 +0000 2024-04-25T15:42:03.687 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 15:40:06.046969300 +0000 2024-04-25T15:42:03.687 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 15:40:06.046969300 +0000 2024-04-25T15:42:03.687 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 15:40:06.046969300 +0000 2024-04-25T15:42:03.687 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:42:03.748 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T15:42:03.748 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T15:42:03.749 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.8695e-05 s, 5.8 MB/s 2024-04-25T15:42:03.750 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:42:03.805 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 15:41:46.855134513 +0000 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 15:40:06.376962879 +0000 2024-04-25T15:42:03.859 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 15:40:06.376962879 +0000 2024-04-25T15:42:03.860 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 15:40:06.376962879 +0000 2024-04-25T15:42:03.860 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:42:03.921 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T15:42:03.921 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T15:42:03.921 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.0135e-05 s, 6.4 MB/s 2024-04-25T15:42:03.922 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:42:03.978 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-25T15:42:04.033 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:42:04.033 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:42:04.033 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T15:42:04.033 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:42:04.033 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:42:04.034 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 15:41:46.855134513 +0000 2024-04-25T15:42:04.034 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 15:40:06.706956459 +0000 2024-04-25T15:42:04.034 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 15:40:06.706956459 +0000 2024-04-25T15:42:04.034 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 15:40:06.706956459 +0000 2024-04-25T15:42:04.034 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:42:04.095 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T15:42:04.095 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T15:42:04.095 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.9829e-05 s, 5.1 MB/s 2024-04-25T15:42:04.096 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:42:04.152 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:04.152 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:42:04.152 INFO:tasks.ceph:Generating config... 2024-04-25T15:42:04.154 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T15:42:04.154 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T15:42:04.154 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T15:42:04.154 INFO:tasks.ceph:[client] pid file = 2024-04-25T15:42:04.154 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T15:42:04.154 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T15:42:04.154 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T15:42:04.154 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T15:42:04.154 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T15:42:04.154 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T15:42:04.154 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T15:42:04.155 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T15:42:04.155 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T15:42:04.156 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T15:42:04.156 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T15:42:04.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T15:42:04.226 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T15:42:04.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T15:42:04.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:42:04.303 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2024-04-25T15:42:04.303 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T15:42:04.304 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:04.304 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:42:04.357 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.80 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = quincy 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:fsid e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2024-04-25T15:42:04.452540+0000 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-04-25T15:42:04.452540+0000 2024-04-25T15:42:04.452 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 17 (quincy) 2024-04-25T15:42:04.453 INFO:teuthology.orchestra.run.smithi080.stdout:election_strategy: 1 2024-04-25T15:42:04.453 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T15:42:04.453 INFO:teuthology.orchestra.run.smithi080.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2024-04-25T15:42:04.453 INFO:teuthology.orchestra.run.smithi080.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2024-04-25T15:42:04.453 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T15:42:04.454 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:42:04.468 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e35f5388-3109-4b08-854a-9a0b33367f12... 2024-04-25T15:42:04.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:42:04.510 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:42:04.547 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-25T15:42:04.547 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:42:04.548 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:42:04.549 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on skipped message = False 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.550 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-04-25T15:42:04.551 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-04-25T15:42:04.552 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 20 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 20 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 10 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-04-25T15:42:04.553 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-04-25T15:42:04.554 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.555 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: mon down mkfs grace = 300 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T15:42:04.556 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = "" 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-04-25T15:42:04.557 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T15:42:04.558 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-25T15:42:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-25T15:42:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on skipped message = False 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:42:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-25T15:42:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-25T15:42:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 20 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 20 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 10 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:42:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:42:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: mon down mkfs grace = 300 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T15:42:04.567 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T15:42:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T15:42:04.569 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T15:42:04.570 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T15:42:04.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T15:42:04.673 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T15:42:04.673 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:04.673 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T15:42:04.687 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:04.687 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T15:42:04.742 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:42:04.742 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:04.742 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:42:04.742 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:42:04.814 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:04.814 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:04.869 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:42:04.869 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:04.869 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:42:04.869 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:42:04.904 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:04.904 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:04.959 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T15:42:04.959 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T15:42:04.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:42:05.015 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:42:05.019 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:42:05.111 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:42:05.114 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T15:42:05.114 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:42:05.172 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:42:05.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T15:42:05.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:42:05.297 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:42:05.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T15:42:05.322 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:42:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:42:05.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T15:42:05.406 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:42:05.504 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:42:05.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T15:42:05.530 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T15:42:05.530 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T15:42:05.579 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T15:42:05.591 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T15:42:05.638 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T15:42:05.651 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T15:42:05.699 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T15:42:05.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T15:42:05.758 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T15:42:05.771 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T15:42:05.771 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:42:05.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T15:42:05.794 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:05.794 INFO:tasks.ceph:role: osd.0 2024-04-25T15:42:05.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:42:05.794 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:05.865 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:06.376 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T15:42:06.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T15:42:06.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T15:42:06.502 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T15:42:06.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T15:42:06.595 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:06.595 INFO:tasks.ceph:role: osd.1 2024-04-25T15:42:06.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:42:06.595 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:06.665 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:07.125 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T15:42:07.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T15:42:07.127 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T15:42:07.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T15:42:07.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T15:42:07.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:07.309 INFO:tasks.ceph:role: osd.2 2024-04-25T15:42:07.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:42:07.309 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:42:07.378 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:07.379 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:07.858 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T15:42:07.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T15:42:07.860 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T15:42:07.968 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T15:42:07.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T15:42:08.060 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:08.060 INFO:tasks.ceph:role: osd.3 2024-04-25T15:42:08.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:42:08.061 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:08.132 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:08.133 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:08.133 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:08.133 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:08.642 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-25T15:42:08.644 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-25T15:42:08.644 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T15:42:08.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T15:42:08.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:08.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:08.888+0000 7f2c451d8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T15:42:08.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:08.888+0000 7f2c451d8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T15:42:08.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:08.888+0000 7f2c451d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:42:08.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:08.888+0000 7f2c451d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:42:08.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:08.888+0000 7f2c451d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:42:08.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:08.889+0000 7f2c451d8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T15:42:11.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T15:42:11.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:11.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:11.868+0000 7feb0449d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T15:42:11.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:11.868+0000 7feb0449d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T15:42:11.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:11.868+0000 7feb0449d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:42:11.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:11.868+0000 7feb0449d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:42:11.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:11.868+0000 7feb0449d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:42:11.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:11.869+0000 7feb0449d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T15:42:14.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T15:42:14.752 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:14.853+0000 7ff564410640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T15:42:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:14.853+0000 7ff564410640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T15:42:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:14.853+0000 7ff564410640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:42:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:14.853+0000 7ff564410640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:42:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:14.853+0000 7ff564410640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:42:14.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:14.854+0000 7ff564410640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T15:42:17.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T15:42:17.737 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:17.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:17.838+0000 7f3fd5414640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T15:42:17.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:17.838+0000 7f3fd5414640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T15:42:17.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:17.838+0000 7f3fd5414640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:42:17.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:17.838+0000 7f3fd5414640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:42:17.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:17.838+0000 7f3fd5414640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:42:17.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:17.839+0000 7f3fd5414640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T15:42:20.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T15:42:20.720 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T15:42:20.750 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:20.750 INFO:tasks.ceph:role: osd.4 2024-04-25T15:42:20.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:42:20.751 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:20.817 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T15:42:20.851 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T15:42:20.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T15:42:20.921 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T15:42:20.991 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T15:42:21.055 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:21.055 INFO:tasks.ceph:role: osd.5 2024-04-25T15:42:21.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:42:21.055 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:21.118 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:21.119 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:21.119 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:21.119 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:21.151 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T15:42:21.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T15:42:21.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T15:42:21.220 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T15:42:21.287 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T15:42:21.350 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:21.350 INFO:tasks.ceph:role: osd.6 2024-04-25T15:42:21.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:42:21.350 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:42:21.413 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:21.414 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:21.415 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:21.415 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:21.445 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T15:42:21.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T15:42:21.447 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T15:42:21.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T15:42:21.583 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T15:42:21.647 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:42:21.648 INFO:tasks.ceph:role: osd.7 2024-04-25T15:42:21.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:42:21.648 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:42:21.710 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:42:21.710 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:42:21.710 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:42:21.710 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:42:21.711 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:42:21.711 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:42:21.711 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:42:21.711 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:42:21.711 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:42:21.711 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:42:21.742 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-25T15:42:21.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-25T15:42:21.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T15:42:21.811 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T15:42:21.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:21.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:21.983+0000 7f45e533e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T15:42:21.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:21.983+0000 7f45e533e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T15:42:21.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:21.983+0000 7f45e533e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:42:21.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:21.983+0000 7f45e533e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:42:21.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:21.983+0000 7f45e533e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:42:21.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:21.983+0000 7f45e533e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T15:42:24.837 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T15:42:24.863 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:24.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:24.959+0000 7f376e92c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T15:42:24.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:24.959+0000 7f376e92c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T15:42:24.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:24.959+0000 7f376e92c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:42:24.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:24.959+0000 7f376e92c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:42:24.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:24.959+0000 7f376e92c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:42:24.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:24.960+0000 7f376e92c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T15:42:27.802 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T15:42:27.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:27.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:27.924+0000 7f39db010640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T15:42:27.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:27.924+0000 7f39db010640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T15:42:27.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:27.924+0000 7f39db010640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:42:27.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:27.924+0000 7f39db010640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:42:27.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:27.924+0000 7f39db010640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:42:27.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:27.924+0000 7f39db010640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T15:42:30.767 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T15:42:30.795 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:30.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:30.894+0000 7fb193da7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T15:42:30.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:30.894+0000 7fb193da7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T15:42:30.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:30.894+0000 7fb193da7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:42:30.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:30.894+0000 7fb193da7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:42:30.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:30.894+0000 7fb193da7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:42:30.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:30.894+0000 7fb193da7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T15:42:32.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:32.617 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:42:33.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T15:42:33.770 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T15:42:33.770 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:33.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T15:42:33.798 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:33.798 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T15:42:33.866 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:33.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T15:42:33.934 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:33.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T15:42:34.001 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:34.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T15:42:34.067 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:34.067 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T15:42:34.133 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:34.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T15:42:34.197 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.197 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T15:42:34.226 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.226 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T15:42:34.293 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.293 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T15:42:34.359 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.359 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T15:42:34.425 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.425 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T15:42:34.490 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T15:42:34.553 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T15:42:34.618 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:34.618 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T15:42:34.635 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:34.635 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T15:42:34.692 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.692 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T15:42:34.707 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:34.708 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T15:42:34.762 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T15:42:34.763 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:42:34.765 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og== 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw== 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA== 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g== 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-04-25T15:42:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw== 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-04-25T15:42:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA== 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA== 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg== 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout:[client.2] 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g== 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw== 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout:[client.3] 2024-04-25T15:42:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw== 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og== 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw== 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA== 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g== 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw== 2024-04-25T15:42:34.825 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA== 2024-04-25T15:42:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA== 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg== 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout:[client.2] 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g== 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw== 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout:[client.3] 2024-04-25T15:42:34.827 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw== 2024-04-25T15:42:34.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:42:34.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:42:34.928 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:34.931 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:34.992 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:34.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:35.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.058 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.119 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.179 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.240 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:42:35.303 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:42:35.361 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:35.364 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:35.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:35.427 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:42:35.488 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.551 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.611 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.672 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:42:35.730 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.732 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.795 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.859 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.922 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:42:35.984 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T15:42:35.984 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T15:42:36.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:42:36.112 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T15:42:36.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T15:42:36.160 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:42:36.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T15:42:36.290 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T15:42:36.353 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:42:36.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T15:42:36.482 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:36.484 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:42:36.536 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T15:42:36.536 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T15:42:36.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T15:42:36.539 INFO:tasks.ceph.mon.a:Started 2024-04-25T15:42:36.539 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T15:42:36.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T15:42:36.579 INFO:tasks.ceph.mon.b:Started 2024-04-25T15:42:36.579 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T15:42:36.579 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T15:42:36.581 INFO:tasks.ceph.mon.c:Started 2024-04-25T15:42:36.581 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T15:42:36.581 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T15:42:36.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T15:42:36.583 INFO:tasks.ceph.mgr.y:Started 2024-04-25T15:42:36.583 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T15:42:36.584 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T15:42:36.586 INFO:tasks.ceph.mgr.x:Started 2024-04-25T15:42:36.586 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T15:42:36.586 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T15:42:36.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.695+0000 7f243c36c640 1 Processor -- start 2024-04-25T15:42:36.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.695+0000 7f243c36c640 1 -- start start 2024-04-25T15:42:36.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243c36c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 0x7f24340b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243c36c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 0x7f24340d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243c36c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24340d2fc0 con 0x7f24340d2bb0 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243c36c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f243409bb90 con 0x7f243406e6a0 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243c36c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f24340b2810 con 0x7f243409b620 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f2439907640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 0x7f24340d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243a909640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f24340d2bb0 0x7f24340d0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52360/0 (socket says 172.21.15.80:52360) 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.696+0000 7f243a909640 1 -- 172.21.15.80:0/1559429311 learned_addr learned my addr 172.21.15.80:0/1559429311 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f2439907640 1 -- 172.21.15.80:0/1559429311 >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 msgr2=0x7f24340d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f2439907640 1 -- 172.21.15.80:0/1559429311 >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 msgr2=0x7f24340d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f2439907640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 0x7f24340d2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f2439907640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 0x7f24340d2670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 0x7f24340b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f243a108640 1 -- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 msgr2=0x7f24340b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:42:36.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f243a108640 1 -- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 msgr2=0x7f24340b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:42:36.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 0x7f24340b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:42:36.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.697+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 0x7f24340b3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:42:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310319040 0 0) 0x7f242c001490 con 0x7f24340d2bb0 2024-04-25T15:42:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2420003520 con 0x7f24340d2bb0 2024-04-25T15:42:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3096106492 0 0) 0x7f2420003520 con 0x7f24340d2bb0 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 msgr2=0x7f24340b3d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.195:3300/0 conn(0x7f243409b620 0x7f24340b3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 msgr2=0x7f24340d2670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 --2- 172.21.15.80:0/1559429311 >> v2:172.21.15.80:3300/0 conn(0x7f243406e6a0 0x7f24340d2670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24340b2250 con 0x7f24340d2bb0 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f242c001be0 con 0x7f24340d2bb0 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 >> v1:172.21.15.80:6789/0 conn(0x7f24340d2bb0 legacy=0x7f24340d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24200039b0 0x7f2420003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2420004800 0x7f2420004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24200052c0 0x7f242000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f243409bb90 con 0x7f24200039b0 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24340b2810 con 0x7f24200052c0 2024-04-25T15:42:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.853+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f242000c2d0 con 0x7f2420004800 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24200039b0 0x7f2420003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a909640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24200052c0 0x7f242000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f2439907640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2420004800 0x7f2420004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a108640 1 -- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2420004800 msgr2=0x7f2420004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2420004800 0x7f2420004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a108640 1 -- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24200052c0 msgr2=0x7f242000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24200052c0 0x7f242000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a909640 1 -- 172.21.15.80:0/1559429311 reap_dead start 2024-04-25T15:42:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.854+0000 7f243a108640 1 -- 172.21.15.80:0/1559429311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2420003520 con 0x7f24200039b0 2024-04-25T15:42:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.855+0000 7f243a108640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24200039b0 0x7f2420003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f243000b5a0 tx=0x7f2420005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee43b9a30795d8a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.855+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243003c070 con 0x7f24200039b0 2024-04-25T15:42:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.855+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2430037410 con 0x7f24200039b0 2024-04-25T15:42:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.855+0000 7f2439106640 1 -- 172.21.15.80:0/1559429311 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243000b5e0 con 0x7f24200039b0 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 -- 172.21.15.80:0/1559429311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24200039b0 msgr2=0x7f2420003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24200039b0 0x7f2420003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f243000b5a0 tx=0x7f2420005830 comp rx=0 tx=0).stop 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 -- 172.21.15.80:0/1559429311 shutdown_connections 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 --2- 172.21.15.80:0/1559429311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24200039b0 0x7f2420003e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 -- 172.21.15.80:0/1559429311 >> 172.21.15.80:0/1559429311 conn(0x7f24340b7690 msgr2=0x7f24340b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 -- 172.21.15.80:0/1559429311 shutdown_connections 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.856+0000 7f243c36c640 1 -- 172.21.15.80:0/1559429311 wait complete. 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.858+0000 7f243c36c640 1 Processor -- start 2024-04-25T15:42:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.858+0000 7f243c36c640 1 -- start start 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243c36c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24200039b0 0x7f24340cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243c36c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 0x7f243414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243c36c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243414a370 0x7f243414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243c36c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f243406eab0 con 0x7f2434149f60 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243c36c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f243406e180 con 0x7f243414a370 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243c36c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f243406ef10 con 0x7f24200039b0 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 0x7f243414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243a108640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24200039b0 0x7f24340cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 0x7f243414f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58836/0 (socket says 172.21.15.80:58836) 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 -- 172.21.15.80:0/1432103435 learned_addr learned my addr 172.21.15.80:0/1432103435 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f243a909640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243414a370 0x7f243414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 -- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24200039b0 msgr2=0x7f24340cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24200039b0 0x7f24340cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 -- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243414a370 msgr2=0x7f243414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.860+0000 7f2439907640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243414a370 0x7f243414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f2439907640 1 -- 172.21.15.80:0/1432103435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2434149c90 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f243a108640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24200039b0 0x7f24340cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f2439907640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 0x7f243414f470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f242400f490 tx=0x7f242400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424018020 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2424014870 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24340cf490 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424014c40 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24340ce190 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f242401b020 con 0x7f2434149f60 2024-04-25T15:42:36.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.861+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f24240133c0 con 0x7f2434149f60 2024-04-25T15:42:36.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.862+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243406a100 con 0x7f2434149f60 2024-04-25T15:42:36.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.866+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2424022020 con 0x7f2434149f60 2024-04-25T15:42:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.931+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f24340cdbd0 con 0x7f2434149f60 2024-04-25T15:42:36.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.933+0000 7f242affd640 1 -- 172.21.15.80:0/1432103435 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f242401d400 con 0x7f2434149f60 2024-04-25T15:42:36.934 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-04-25T15:42:36.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 msgr2=0x7f243414f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 0x7f243414f470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f242400f490 tx=0x7f242400f890 comp rx=0 tx=0).stop 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 shutdown_connections 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243414a370 0x7f243414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434149f60 0x7f243414f470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 --2- 172.21.15.80:0/1432103435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24200039b0 0x7f24340cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 >> 172.21.15.80:0/1432103435 conn(0x7f24340b7690 msgr2=0x7f24340b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 shutdown_connections 2024-04-25T15:42:36.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:36.934+0000 7f243c36c640 1 -- 172.21.15.80:0/1432103435 wait complete. 2024-04-25T15:42:36.946 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T15:42:36.946 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T15:42:36.946 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:36.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T15:42:36.967 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:36.966+0000 7f9fe5e17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:42:36.971 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:36.971 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T15:42:36.974 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:36.974+0000 7fad90c1f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:42:37.037 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:37.037 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T15:42:37.100 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:42:37.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T15:42:37.130 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:37.129+0000 7f9fe5e17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:42:37.131 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:37.131+0000 7fad90c1f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:42:37.153 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:37.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T15:42:37.178 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:37.178 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T15:42:37.186 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:37.185+0000 7f9fe5e17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:42:37.187 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:37.186+0000 7fad90c1f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:42:37.209 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:37.209 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T15:42:37.273 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:42:37.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T15:42:37.337 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 2943c120-51b2-4818-bfd7-9b2baf1a86a9 0 2024-04-25T15:42:37.421 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:37.420+0000 7f9fe5e17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:42:37.440 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:37.440+0000 7fad90c1f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:42:37.467 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:37.466+0000 7f9fe5e17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:42:37.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.485+0000 7f4f69834640 1 Processor -- start 2024-04-25T15:42:37.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.485+0000 7f4f69834640 1 -- start start 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f69834640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4f6409b620 0x7f4f640b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f69834640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6409bb90 con 0x7f4f6406e6a0 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f69834640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f640b2810 con 0x7f4f640d2d80 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f69834640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4f640b2250 con 0x7f4f6409b620 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f62ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4f6409b620 0x7f4f640b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f637fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4f640d2d80 0x7f4f640d0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:51598/0 (socket says 172.21.15.195:51598) 2024-04-25T15:42:37.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f637fe640 1 -- 172.21.15.195:0/2664846826 learned_addr learned my addr 172.21.15.195:0/2664846826 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T15:42:37.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f62ffd640 1 -- 172.21.15.195:0/2664846826 >> v1:172.21.15.195:6789/0 conn(0x7f4f640d2d80 legacy=0x7f4f640d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f62ffd640 1 -- 172.21.15.195:0/2664846826 >> v1:172.21.15.80:6789/0 conn(0x7f4f6406e6a0 legacy=0x7f4f640d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.487+0000 7f4f62ffd640 1 -- 172.21.15.195:0/2664846826 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f640b2530 con 0x7f4f6409b620 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.488+0000 7f4f62ffd640 1 --2- 172.21.15.195:0/2664846826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f640b3d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097a0 tx=0x7f4f5402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21312c0c41c184d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.488+0000 7f4f627fc640 1 -- 172.21.15.195:0/2664846826 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54037070 con 0x7f4f6409b620 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.488+0000 7f4f627fc640 1 -- 172.21.15.195:0/2664846826 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54032440 con 0x7f4f6409b620 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.488+0000 7f4f627fc640 1 -- 172.21.15.195:0/2664846826 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5402ae60 con 0x7f4f6409b620 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 -- 172.21.15.195:0/2664846826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 msgr2=0x7f4f640b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 --2- 172.21.15.195:0/2664846826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f640b3d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097a0 tx=0x7f4f5402a110 comp rx=0 tx=0).stop 2024-04-25T15:42:37.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 -- 172.21.15.195:0/2664846826 shutdown_connections 2024-04-25T15:42:37.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 --2- 172.21.15.195:0/2664846826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f640b3d80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 -- 172.21.15.195:0/2664846826 >> 172.21.15.195:0/2664846826 conn(0x7f4f640b7690 msgr2=0x7f4f640b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:37.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 -- 172.21.15.195:0/2664846826 shutdown_connections 2024-04-25T15:42:37.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.489+0000 7f4f69834640 1 -- 172.21.15.195:0/2664846826 wait complete. 2024-04-25T15:42:37.490 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:37.490+0000 7fad90c1f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:42:37.491 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.491+0000 7f4f69834640 1 Processor -- start 2024-04-25T15:42:37.491 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.491+0000 7f4f69834640 1 -- start start 2024-04-25T15:42:37.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f69834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f6406e6a0 0x7f4f64157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f69834640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f6406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f69834640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 0x7f4f6406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f69834640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6406ef10 con 0x7f4f6406e6a0 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f69834640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6406eab0 con 0x7f4f6409b620 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f69834640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6406f090 con 0x7f4f640cfad0 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f5a7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f6406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f637fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 0x7f4f6406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f5a7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f6406c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:37644/0 (socket says 172.21.15.195:37644) 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f5a7fc640 1 -- 172.21.15.195:0/581762768 learned_addr learned my addr 172.21.15.195:0/581762768 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f637fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 0x7f4f6406cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37838/0 (socket says 172.21.15.195:37838) 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.492+0000 7f4f62ffd640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f6406e6a0 0x7f4f64157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f637fe640 1 -- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 msgr2=0x7f4f6406c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f637fe640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f6406c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f637fe640 1 -- 172.21.15.195:0/581762768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f6406e6a0 msgr2=0x7f4f64157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f637fe640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f6406e6a0 0x7f4f64157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f637fe640 1 -- 172.21.15.195:0/581762768 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f640cd130 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f62ffd640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f6406e6a0 0x7f4f64157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f5a7fc640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f6406c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f637fe640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 0x7f4f6406cb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00ca70 tx=0x7f4f5c00cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c017070 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00ab10 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c012400 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f640cd410 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f640cd9d0 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f5c01a070 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.493+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4f5c01cad0 con 0x7f4f640cfad0 2024-04-25T15:42:37.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.494+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f640ca4e0 con 0x7f4f640cfad0 2024-04-25T15:42:37.497 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.496+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4f5c012650 con 0x7f4f640cfad0 2024-04-25T15:42:37.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.566+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2943c120-51b2-4818-bfd7-9b2baf1a86a9", "id": 0} v 0) -- 0x7f4f6406a100 con 0x7f4f640cfad0 2024-04-25T15:42:37.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.570+0000 7f4f60ff9640 1 -- 172.21.15.195:0/581762768 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2943c120-51b2-4818-bfd7-9b2baf1a86a9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4f5c012960 con 0x7f4f640cfad0 2024-04-25T15:42:37.570 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-04-25T15:42:37.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 msgr2=0x7f4f6406cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 0x7f4f6406cb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00ca70 tx=0x7f4f5c00cf30 comp rx=0 tx=0).stop 2024-04-25T15:42:37.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 shutdown_connections 2024-04-25T15:42:37.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f640cfad0 0x7f4f6406cb00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6409b620 0x7f4f6406c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 --2- 172.21.15.195:0/581762768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f6406e6a0 0x7f4f64157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 >> 172.21.15.195:0/581762768 conn(0x7f4f640b7690 msgr2=0x7f4f64070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:37.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 shutdown_connections 2024-04-25T15:42:37.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.571+0000 7f4f69834640 1 -- 172.21.15.195:0/581762768 wait complete. 2024-04-25T15:42:37.582 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 6edee3a0-8e7f-484c-b8ec-0c323840b462 1 2024-04-25T15:42:37.690 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.689+0000 7fb953284640 1 Processor -- start 2024-04-25T15:42:37.690 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.690+0000 7fb953284640 1 -- start start 2024-04-25T15:42:37.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb953284640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb953284640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb94c09b850 0x7fb94c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb953284640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 0x7fb94c0af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb953284640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb94c1607a0 con 0x7fb94c09b850 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb953284640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb94c0cd220 con 0x7fb94c0ce800 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb953284640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c0cd500 con 0x7fb94c09c0a0 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951821640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 0x7fb94c0af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951821640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 0x7fb94c0af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:37646/0 (socket says 172.21.15.195:37646) 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37846/0 (socket says 172.21.15.195:37846) 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951821640 1 -- 172.21.15.195:0/214795514 learned_addr learned my addr 172.21.15.195:0/214795514 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb95081f640 1 --2- 172.21.15.195:0/214795514 >> v2:172.21.15.80:3300/0 conn(0x7fb94c09b850 0x7fb94c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 -- 172.21.15.195:0/214795514 >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 msgr2=0x7fb94c0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 --2- 172.21.15.195:0/214795514 >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 0x7fb94c0af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 -- 172.21.15.195:0/214795514 >> v2:172.21.15.80:3300/0 conn(0x7fb94c09b850 msgr2=0x7fb94c0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 --2- 172.21.15.195:0/214795514 >> v2:172.21.15.80:3300/0 conn(0x7fb94c09b850 0x7fb94c0ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951020640 1 -- 172.21.15.195:0/214795514 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c0cd7e0 con 0x7fb94c09c0a0 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.691+0000 7fb951821640 1 --2- 172.21.15.195:0/214795514 >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 0x7fb94c0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.692+0000 7fb951020640 1 --2- 172.21.15.195:0/214795514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c160260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0d3940 tx=0x7fb94802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f48666e1758892f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.692+0000 7fb943fff640 1 -- 172.21.15.195:0/214795514 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948037070 con 0x7fb94c09c0a0 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.692+0000 7fb943fff640 1 -- 172.21.15.195:0/214795514 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94802ae50 con 0x7fb94c09c0a0 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.692+0000 7fb943fff640 1 -- 172.21.15.195:0/214795514 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948032660 con 0x7fb94c09c0a0 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 -- 172.21.15.195:0/214795514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 msgr2=0x7fb94c160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 --2- 172.21.15.195:0/214795514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c160260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0d3940 tx=0x7fb94802a100 comp rx=0 tx=0).stop 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 -- 172.21.15.195:0/214795514 shutdown_connections 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 --2- 172.21.15.195:0/214795514 >> v2:172.21.15.195:3300/0 conn(0x7fb94c0ce800 0x7fb94c0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 --2- 172.21.15.195:0/214795514 >> v2:172.21.15.80:3300/0 conn(0x7fb94c09b850 0x7fb94c0ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 --2- 172.21.15.195:0/214795514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c160260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 -- 172.21.15.195:0/214795514 >> 172.21.15.195:0/214795514 conn(0x7fb94c0b75b0 msgr2=0x7fb94c0b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:37.696 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 -- 172.21.15.195:0/214795514 shutdown_connections 2024-04-25T15:42:37.696 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.693+0000 7fb953284640 1 -- 172.21.15.195:0/214795514 wait complete. 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.695+0000 7fb953284640 1 Processor -- start 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.695+0000 7fb953284640 1 -- start start 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb953284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb94c09b850 0x7fb94c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb953284640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb953284640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 0x7fb94c0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb953284640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0ccef0 con 0x7fb94c09b850 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb953284640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0cdda0 con 0x7fb94c0ce800 2024-04-25T15:42:37.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb953284640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c0afb30 con 0x7fb94c09c0a0 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb95081f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb951821640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 0x7fb94c0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb951821640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 0x7fb94c0c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:37662/0 (socket says 172.21.15.195:37662) 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb95081f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c0c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37862/0 (socket says 172.21.15.195:37862) 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb951821640 1 -- 172.21.15.195:0/3881365782 learned_addr learned my addr 172.21.15.195:0/3881365782 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.696+0000 7fb951020640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb94c09b850 0x7fb94c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb95081f640 1 -- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 msgr2=0x7fb94c0c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb95081f640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 0x7fb94c0c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb95081f640 1 -- 172.21.15.195:0/3881365782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb94c09b850 msgr2=0x7fb94c151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb95081f640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb94c09b850 0x7fb94c151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb95081f640 1 -- 172.21.15.195:0/3881365782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c161b80 con 0x7fb94c09c0a0 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb951821640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 0x7fb94c0c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb95081f640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c0c6520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0727e0 tx=0x7fb93c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:37.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c017070 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c00c700 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94c160f00 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00cad0 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94c1614c0 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb93c01a070 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.697+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb93c01c800 con 0x7fb94c09c0a0 2024-04-25T15:42:37.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.698+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94c160c50 con 0x7fb94c09c0a0 2024-04-25T15:42:37.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.702+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb94c161b80 con 0x7fb94c09c0a0 2024-04-25T15:42:37.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.774+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6edee3a0-8e7f-484c-b8ec-0c323840b462", "id": 1} v 0) -- 0x7fb94c06a100 con 0x7fb94c09c0a0 2024-04-25T15:42:37.782 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.782+0000 7fb941ffb640 1 -- 172.21.15.195:0/3881365782 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6edee3a0-8e7f-484c-b8ec-0c323840b462", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb93c00cdb0 con 0x7fb94c09c0a0 2024-04-25T15:42:37.782 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 msgr2=0x7fb94c0c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c0c6520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0727e0 tx=0x7fb93c00ecd0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 shutdown_connections 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb94c0ce800 0x7fb94c0c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94c09c0a0 0x7fb94c0c6520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 --2- 172.21.15.195:0/3881365782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb94c09b850 0x7fb94c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 >> 172.21.15.195:0/3881365782 conn(0x7fb94c0b75b0 msgr2=0x7fb94c06e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:37.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 shutdown_connections 2024-04-25T15:42:37.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.783+0000 7fb953284640 1 -- 172.21.15.195:0/3881365782 wait complete. 2024-04-25T15:42:37.794 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc 2 2024-04-25T15:42:37.904 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.904+0000 7f48216e2640 1 Processor -- start 2024-04-25T15:42:37.904 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.904+0000 7f48216e2640 1 -- start start 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.905+0000 7f48216e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.905+0000 7f48216e2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f481c0b3cb0 0x7f481c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.905+0000 7f48216e2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481c0d02c0 con 0x7f481c06ece0 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.905+0000 7f48216e2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f481c06cab0 con 0x7f481c0b3cb0 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.905+0000 7f48216e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f481c0d1f10 con 0x7f481c0cf2f0 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481b7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f481c0b3cb0 0x7f481c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0d19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37874/0 (socket says 172.21.15.195:37874) 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 -- 172.21.15.195:0/2693975857 learned_addr learned my addr 172.21.15.195:0/2693975857 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481a7fc640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f481c06ece0 0x7f481c0b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:51600/0 (socket says 172.21.15.195:51600) 2024-04-25T15:42:37.907 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 -- 172.21.15.195:0/2693975857 >> v2:172.21.15.195:3300/0 conn(0x7f481c0b3cb0 msgr2=0x7f481c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 --2- 172.21.15.195:0/2693975857 >> v2:172.21.15.195:3300/0 conn(0x7f481c0b3cb0 0x7f481c06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 -- 172.21.15.195:0/2693975857 >> v1:172.21.15.195:6789/0 conn(0x7f481c06ece0 legacy=0x7f481c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481affd640 1 -- 172.21.15.195:0/2693975857 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c0d2160 con 0x7f481c0cf2f0 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.906+0000 7f481b7fe640 1 --2- 172.21.15.195:0/2693975857 >> v2:172.21.15.195:3300/0 conn(0x7f481c0b3cb0 0x7f481c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.907+0000 7f481affd640 1 --2- 172.21.15.195:0/2693975857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0d19d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4814009e50 tx=0x7f481402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f4c27ab048b13b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.907+0000 7f4819ffb640 1 -- 172.21.15.195:0/2693975857 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814036070 con 0x7f481c0cf2f0 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.907+0000 7f4819ffb640 1 -- 172.21.15.195:0/2693975857 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4814031600 con 0x7f481c0cf2f0 2024-04-25T15:42:37.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.907+0000 7f4819ffb640 1 -- 172.21.15.195:0/2693975857 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48140319d0 con 0x7f481c0cf2f0 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 -- 172.21.15.195:0/2693975857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 msgr2=0x7f481c0d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 --2- 172.21.15.195:0/2693975857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0d19d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4814009e50 tx=0x7f481402a710 comp rx=0 tx=0).stop 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 -- 172.21.15.195:0/2693975857 shutdown_connections 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 --2- 172.21.15.195:0/2693975857 >> v2:172.21.15.195:3300/0 conn(0x7f481c0b3cb0 0x7f481c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 --2- 172.21.15.195:0/2693975857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0d19d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 -- 172.21.15.195:0/2693975857 >> 172.21.15.195:0/2693975857 conn(0x7f481c0b75f0 msgr2=0x7f481c0b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 -- 172.21.15.195:0/2693975857 shutdown_connections 2024-04-25T15:42:37.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.908+0000 7f48216e2640 1 -- 172.21.15.195:0/2693975857 wait complete. 2024-04-25T15:42:37.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.910+0000 7f48216e2640 1 Processor -- start 2024-04-25T15:42:37.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.910+0000 7f48216e2640 1 -- start start 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f48216e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f481c06ece0 0x7f481c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f48216e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f48216e2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f481c0b18c0 0x7f481c0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f48216e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f481c06d480 con 0x7f481c06ece0 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f48216e2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f481c06c740 con 0x7f481c0b18c0 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f48216e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f481c06d600 con 0x7f481c0cf2f0 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481a7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481a7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37890/0 (socket says 172.21.15.195:37890) 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f481c0b18c0 0x7f481c0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481a7fc640 1 -- 172.21.15.195:0/2136593019 learned_addr learned my addr 172.21.15.195:0/2136593019 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:37.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481affd640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f481c06ece0 0x7f481c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 -- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 msgr2=0x7f481c0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 -- 172.21.15.195:0/2136593019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f481c06ece0 msgr2=0x7f481c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f481c06ece0 0x7f481c14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 -- 172.21.15.195:0/2136593019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c0b2210 con 0x7f481c0b18c0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481affd640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f481c06ece0 0x7f481c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481a7fc640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.911+0000 7f481b7fe640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f481c0b18c0 0x7f481c0b1cd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f480c012c10 tx=0x7f480c010490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c00d0d0 con 0x7f481c0b18c0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480c00d290 con 0x7f481c0b18c0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481c0c8b20 con 0x7f481c0b18c0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c010d60 con 0x7f481c0b18c0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481c09cc30 con 0x7f481c0b18c0 2024-04-25T15:42:37.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f480c01f030 con 0x7f481c0b18c0 2024-04-25T15:42:37.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.912+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f480c003610 con 0x7f481c0b18c0 2024-04-25T15:42:37.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.913+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481c06a100 con 0x7f481c0b18c0 2024-04-25T15:42:37.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.915+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f480c026060 con 0x7f481c0b18c0 2024-04-25T15:42:37.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.988+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc", "id": 2} v 0) -- 0x7f481c0702f0 con 0x7f481c0b18c0 2024-04-25T15:42:37.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.994+0000 7f48137fe640 1 -- 172.21.15.195:0/2136593019 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f481c0b2210 con 0x7f481c0b18c0 2024-04-25T15:42:37.994 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-04-25T15:42:37.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f481c0b18c0 msgr2=0x7f481c0b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:37.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f481c0b18c0 0x7f481c0b1cd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f480c012c10 tx=0x7f480c010490 comp rx=0 tx=0).stop 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 shutdown_connections 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f481c0b18c0 0x7f481c0b1cd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f481c0cf2f0 0x7f481c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 --2- 172.21.15.195:0/2136593019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f481c06ece0 0x7f481c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 >> 172.21.15.195:0/2136593019 conn(0x7f481c0b75f0 msgr2=0x7f481c071340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 shutdown_connections 2024-04-25T15:42:37.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:37.995+0000 7f48216e2640 1 -- 172.21.15.195:0/2136593019 wait complete. 2024-04-25T15:42:38.006 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new cdf05e74-3831-4b2e-9eec-cacec0ea3b2b 3 2024-04-25T15:42:38.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.118+0000 7fa77c19e640 1 Processor -- start 2024-04-25T15:42:38.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.118+0000 7fa77c19e640 1 -- start start 2024-04-25T15:42:38.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa77c19e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa77c19e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa77406d850 0x7fa7740ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa77c19e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa77406dc60 con 0x7fa7740c6f60 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa77c19e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa77406cc10 con 0x7fa77406d850 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa77c19e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa77406c930 con 0x7fa7741603a0 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa779739640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa77a73b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa77406d850 0x7fa7740ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa779739640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37894/0 (socket says 172.21.15.195:37894) 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.119+0000 7fa779739640 1 -- 172.21.15.195:0/1298091734 learned_addr learned my addr 172.21.15.195:0/1298091734 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.120+0000 7fa779739640 1 -- 172.21.15.195:0/1298091734 >> v2:172.21.15.195:3300/0 conn(0x7fa77406d850 msgr2=0x7fa7740ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.120+0000 7fa779739640 1 --2- 172.21.15.195:0/1298091734 >> v2:172.21.15.195:3300/0 conn(0x7fa77406d850 0x7fa7740ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.120+0000 7fa779739640 1 -- 172.21.15.195:0/1298091734 >> v1:172.21.15.80:6789/0 conn(0x7fa7740c6f60 legacy=0x7fa7740b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.120+0000 7fa779739640 1 -- 172.21.15.195:0/1298091734 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7740c8a80 con 0x7fa7741603a0 2024-04-25T15:42:38.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.120+0000 7fa77a73b640 1 --2- 172.21.15.195:0/1298091734 >> v2:172.21.15.195:3300/0 conn(0x7fa77406d850 0x7fa7740ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:38.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.120+0000 7fa779739640 1 --2- 172.21.15.195:0/1298091734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77406d310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa770009870 tx=0x7fa77002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf0eff17e6fa746 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa778f38640 1 -- 172.21.15.195:0/1298091734 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770037070 con 0x7fa7741603a0 2024-04-25T15:42:38.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa778f38640 1 -- 172.21.15.195:0/1298091734 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa770032440 con 0x7fa7741603a0 2024-04-25T15:42:38.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa778f38640 1 -- 172.21.15.195:0/1298091734 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770032810 con 0x7fa7741603a0 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa77c19e640 1 -- 172.21.15.195:0/1298091734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 msgr2=0x7fa77406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa77c19e640 1 --2- 172.21.15.195:0/1298091734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77406d310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa770009870 tx=0x7fa77002a270 comp rx=0 tx=0).stop 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa77c19e640 1 -- 172.21.15.195:0/1298091734 shutdown_connections 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa77c19e640 1 --2- 172.21.15.195:0/1298091734 >> v2:172.21.15.195:3300/0 conn(0x7fa77406d850 0x7fa7740ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa77c19e640 1 --2- 172.21.15.195:0/1298091734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77406d310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.121+0000 7fa77c19e640 1 -- 172.21.15.195:0/1298091734 >> 172.21.15.195:0/1298091734 conn(0x7fa77409b410 msgr2=0x7fa7740b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.122+0000 7fa77c19e640 1 -- 172.21.15.195:0/1298091734 shutdown_connections 2024-04-25T15:42:38.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.122+0000 7fa77c19e640 1 -- 172.21.15.195:0/1298091734 wait complete. 2024-04-25T15:42:38.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.123+0000 7fa77c19e640 1 Processor -- start 2024-04-25T15:42:38.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.123+0000 7fa77c19e640 1 -- start start 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77406d850 0x7fa7741609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 0x7fa774150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741607b0 con 0x7fa77406d850 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa7740c7370 con 0x7fa7740c6f60 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa77406c5c0 con 0x7fa7741603a0 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa779739640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 0x7fa774150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa779739640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 0x7fa774150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:37698/0 (socket says 172.21.15.195:37698) 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa779739640 1 -- 172.21.15.195:0/2426125574 learned_addr learned my addr 172.21.15.195:0/2426125574 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa779f3a640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77406d850 0x7fa7741609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 -- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 msgr2=0x7fa774150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 0x7fa774150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 -- 172.21.15.195:0/2426125574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77406d850 msgr2=0x7fa7741609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77406d850 0x7fa7741609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 -- 172.21.15.195:0/2426125574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa774162360 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa779739640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 0x7fa774150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77a73b640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77415e9f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00ef90 tx=0x7fa76c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c018020 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76c014480 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c014870 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741612c0 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.125+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa774161880 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.126+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa76c005d10 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.126+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa76c01dc70 con 0x7fa7741603a0 2024-04-25T15:42:38.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.126+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77406a100 con 0x7fa7741603a0 2024-04-25T15:42:38.129 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.128+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa76c022030 con 0x7fa7741603a0 2024-04-25T15:42:38.184 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.183+0000 7f9fe5e17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:42:38.201 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.201+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdf05e74-3831-4b2e-9eec-cacec0ea3b2b", "id": 3} v 0) -- 0x7fa7740b6540 con 0x7fa7741603a0 2024-04-25T15:42:38.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.207+0000 7fa76a7fc640 1 -- 172.21.15.195:0/2426125574 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdf05e74-3831-4b2e-9eec-cacec0ea3b2b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa76c010040 con 0x7fa7741603a0 2024-04-25T15:42:38.207 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-04-25T15:42:38.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 msgr2=0x7fa77415e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77415e9f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00ef90 tx=0x7fa76c00c490 comp rx=0 tx=0).stop 2024-04-25T15:42:38.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 shutdown_connections 2024-04-25T15:42:38.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7741603a0 0x7fa77415e9f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7740c6f60 0x7fa774150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 --2- 172.21.15.195:0/2426125574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77406d850 0x7fa7741609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 >> 172.21.15.195:0/2426125574 conn(0x7fa77409b410 msgr2=0x7fa7740b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 shutdown_connections 2024-04-25T15:42:38.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.208+0000 7fa77c19e640 1 -- 172.21.15.195:0/2426125574 wait complete. 2024-04-25T15:42:38.219 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new ee93c108-d2f4-44fa-88f2-9029d0a1002e 4 2024-04-25T15:42:38.236 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.236+0000 7fad90c1f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:42:38.272 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.272+0000 7f9fe5e17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:42:38.315 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.314+0000 7f9fe5e17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:42:38.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.327+0000 7f1e62d72640 1 Processor -- start 2024-04-25T15:42:38.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.327+0000 7f1e62d72640 1 -- start start 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e62d72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e5c160610 0x7f1e5c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e62d72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e5c0af410 0x7f1e5c071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e62d72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c0b1990 con 0x7f1e5c0717b0 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e62d72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c0af8e0 con 0x7f1e5c160610 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e62d72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c0afbc0 con 0x7f1e5c0af410 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e5bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e5c0af410 0x7f1e5c071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e6130f640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1e5c0717b0 0x7f1e5c06c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:51602/0 (socket says 172.21.15.195:51602) 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e6130f640 1 -- 172.21.15.195:0/2684821990 learned_addr learned my addr 172.21.15.195:0/2684821990 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T15:42:38.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e60b0e640 1 --2- 172.21.15.195:0/2684821990 >> v2:172.21.15.80:3300/0 conn(0x7f1e5c160610 0x7f1e5c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e5b7fe640 1 -- 172.21.15.195:0/2684821990 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107163624 0 0) 0x7f1e5c0b1990 con 0x7f1e5c0717b0 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.328+0000 7f1e5b7fe640 1 -- 172.21.15.195:0/2684821990 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4c003520 con 0x7f1e5c0717b0 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.329+0000 7f1e5bfff640 1 -- 172.21.15.195:0/2684821990 >> v2:172.21.15.80:3300/0 conn(0x7f1e5c160610 msgr2=0x7f1e5c0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.329+0000 7f1e5bfff640 1 --2- 172.21.15.195:0/2684821990 >> v2:172.21.15.80:3300/0 conn(0x7f1e5c160610 0x7f1e5c0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.329+0000 7f1e5bfff640 1 -- 172.21.15.195:0/2684821990 >> v1:172.21.15.195:6789/0 conn(0x7f1e5c0717b0 legacy=0x7f1e5c06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.329+0000 7f1e5bfff640 1 -- 172.21.15.195:0/2684821990 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c0afea0 con 0x7f1e5c0af410 2024-04-25T15:42:38.330 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.330+0000 7f1e5bfff640 1 --2- 172.21.15.195:0/2684821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0af410 0x7f1e5c071270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c163ea0 tx=0x7f1e4802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a613c20c9e0534a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.331 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.330+0000 7fad90c1f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:42:38.332 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.330+0000 7f1e5b7fe640 1 -- 172.21.15.195:0/2684821990 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48037070 con 0x7f1e5c0af410 2024-04-25T15:42:38.332 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.330+0000 7f1e5b7fe640 1 -- 172.21.15.195:0/2684821990 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e48032440 con 0x7f1e5c0af410 2024-04-25T15:42:38.332 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.330+0000 7f1e5b7fe640 1 -- 172.21.15.195:0/2684821990 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4802ae60 con 0x7f1e5c0af410 2024-04-25T15:42:38.332 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 -- 172.21.15.195:0/2684821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0af410 msgr2=0x7f1e5c071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.332 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 --2- 172.21.15.195:0/2684821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0af410 0x7f1e5c071270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c163ea0 tx=0x7f1e4802a110 comp rx=0 tx=0).stop 2024-04-25T15:42:38.332 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 -- 172.21.15.195:0/2684821990 shutdown_connections 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 --2- 172.21.15.195:0/2684821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0af410 0x7f1e5c071270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 --2- 172.21.15.195:0/2684821990 >> v2:172.21.15.80:3300/0 conn(0x7f1e5c160610 0x7f1e5c0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 -- 172.21.15.195:0/2684821990 >> 172.21.15.195:0/2684821990 conn(0x7f1e5c09b410 msgr2=0x7f1e5c0b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 -- 172.21.15.195:0/2684821990 shutdown_connections 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.331+0000 7f1e62d72640 1 -- 172.21.15.195:0/2684821990 wait complete. 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.332+0000 7f1e62d72640 1 Processor -- start 2024-04-25T15:42:38.333 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.332+0000 7f1e62d72640 1 -- start start 2024-04-25T15:42:38.335 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e62d72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 0x7f1e5c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e62d72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e5c0af410 0x7f1e5c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e62d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5c160610 0x7f1e5c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e62d72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c071bc0 con 0x7f1e5c160610 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e62d72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c0b0460 con 0x7f1e5c0717b0 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e62d72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c0cfcf0 con 0x7f1e5c0af410 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 0x7f1e5c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e5bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e5c0af410 0x7f1e5c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 0x7f1e5c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:37722/0 (socket says 172.21.15.195:37722) 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 -- 172.21.15.195:0/3223422408 learned_addr learned my addr 172.21.15.195:0/3223422408 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e6130f640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5c160610 0x7f1e5c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 -- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e5c0af410 msgr2=0x7f1e5c1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e5c0af410 0x7f1e5c1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 -- 172.21.15.195:0/3223422408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5c160610 msgr2=0x7f1e5c159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5c160610 0x7f1e5c159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e60b0e640 1 -- 172.21.15.195:0/3223422408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c1e8620 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.334+0000 7f1e5bfff640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e5c0af410 0x7f1e5c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e60b0e640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 0x7f1e5c1464e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000e870 tx=0x7f1e5000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50017070 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5000c940 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c0d13a0 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000ccf0 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c0d1960 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1e5001a070 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.335+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1e5001cbc0 con 0x7f1e5c0717b0 2024-04-25T15:42:38.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.336+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c06a100 con 0x7f1e5c0717b0 2024-04-25T15:42:38.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.338+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1e5001cdc0 con 0x7f1e5c0717b0 2024-04-25T15:42:38.374 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.374+0000 7fad90c1f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:42:38.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.409+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee93c108-d2f4-44fa-88f2-9029d0a1002e", "id": 4} v 0) -- 0x7f1e5c068ca0 con 0x7f1e5c0717b0 2024-04-25T15:42:38.415 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.415+0000 7f1e597fa640 1 -- 172.21.15.195:0/3223422408 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee93c108-d2f4-44fa-88f2-9029d0a1002e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1e5001c650 con 0x7f1e5c0717b0 2024-04-25T15:42:38.415 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-04-25T15:42:38.416 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 msgr2=0x7f1e5c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.416 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 0x7f1e5c1464e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000e870 tx=0x7f1e5000ed30 comp rx=0 tx=0).stop 2024-04-25T15:42:38.416 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 shutdown_connections 2024-04-25T15:42:38.416 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5c160610 0x7f1e5c159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.416 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e5c0af410 0x7f1e5c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.417 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 --2- 172.21.15.195:0/3223422408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e5c0717b0 0x7f1e5c1464e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.417 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 >> 172.21.15.195:0/3223422408 conn(0x7f1e5c09b410 msgr2=0x7f1e5c158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.417 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 shutdown_connections 2024-04-25T15:42:38.417 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.416+0000 7f1e62d72640 1 -- 172.21.15.195:0/3223422408 wait complete. 2024-04-25T15:42:38.427 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 35258f96-0ef1-4a49-a732-25d05c3ed73f 5 2024-04-25T15:42:38.481 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.480+0000 7f9fe5e17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:42:38.545 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.544+0000 7f9fe5e17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:42:38.547 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.547+0000 7fad90c1f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:42:38.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.575+0000 7f38618ee640 1 Processor -- start 2024-04-25T15:42:38.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.575+0000 7f38618ee640 1 -- start start 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f38618ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f385c0d0b00 0x7f385c0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f38618ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f385c1643f0 con 0x7f385c0b5490 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f38618ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f385c1646d0 con 0x7f385c0d2b80 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f38618ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f385c1649b0 con 0x7f385c0d0b00 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f385a7fc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f385c0d0b00 0x7f385c0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f385b7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f385c0d2b80 0x7f385c0d47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:51606/0 (socket says 172.21.15.195:51606) 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.576+0000 7f385b7fe640 1 -- 172.21.15.195:0/975371305 learned_addr learned my addr 172.21.15.195:0/975371305 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f385a7fc640 1 -- 172.21.15.195:0/975371305 >> v1:172.21.15.195:6789/0 conn(0x7f385c0d2b80 legacy=0x7f385c0d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f385a7fc640 1 -- 172.21.15.195:0/975371305 >> v1:172.21.15.80:6789/0 conn(0x7f385c0b5490 legacy=0x7f385c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f385a7fc640 1 -- 172.21.15.195:0/975371305 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c164c90 con 0x7f385c0d0b00 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f385a7fc640 1 --2- 172.21.15.195:0/975371305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d0b00 0x7f385c0d2640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38500097a0 tx=0x7f385002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2134e54caaa112f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f3859ffb640 1 -- 172.21.15.195:0/975371305 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850037070 con 0x7f385c0d0b00 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f3859ffb640 1 -- 172.21.15.195:0/975371305 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850032440 con 0x7f385c0d0b00 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.577+0000 7f3859ffb640 1 -- 172.21.15.195:0/975371305 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850032810 con 0x7f385c0d0b00 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 -- 172.21.15.195:0/975371305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d0b00 msgr2=0x7f385c0d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 --2- 172.21.15.195:0/975371305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d0b00 0x7f385c0d2640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38500097a0 tx=0x7f385002a230 comp rx=0 tx=0).stop 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 -- 172.21.15.195:0/975371305 shutdown_connections 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 --2- 172.21.15.195:0/975371305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d0b00 0x7f385c0d2640 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 -- 172.21.15.195:0/975371305 >> 172.21.15.195:0/975371305 conn(0x7f385c06e650 msgr2=0x7f385c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 -- 172.21.15.195:0/975371305 shutdown_connections 2024-04-25T15:42:38.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.578+0000 7f38618ee640 1 -- 172.21.15.195:0/975371305 wait complete. 2024-04-25T15:42:38.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.580+0000 7f38618ee640 1 Processor -- start 2024-04-25T15:42:38.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.580+0000 7f38618ee640 1 -- start start 2024-04-25T15:42:38.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.581+0000 7f38618ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f385c0d0b00 0x7f385c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.581+0000 7f38618ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d2b80 0x7f385c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.581+0000 7f38618ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 0x7f385c0b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.581+0000 7f38618ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0b94e0 con 0x7f385c0d0b00 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.581+0000 7f38618ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0b9360 con 0x7f385c0d2b80 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.581+0000 7f38618ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f385c163f80 con 0x7f385c0c9980 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 0x7f385c0b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f385c0d0b00 0x7f385c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385a7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d2b80 0x7f385c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 0x7f385c0b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37922/0 (socket says 172.21.15.195:37922) 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 -- 172.21.15.195:0/1948839387 learned_addr learned my addr 172.21.15.195:0/1948839387 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 -- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d2b80 msgr2=0x7f385c14d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d2b80 0x7f385c14d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 -- 172.21.15.195:0/1948839387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f385c0d0b00 msgr2=0x7f385c0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f385c0d0b00 0x7f385c0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 -- 172.21.15.195:0/1948839387 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c0ca420 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385affd640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f385c0d0b00 0x7f385c0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f385b7fe640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 0x7f385c0b73a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f385400caa0 tx=0x7f385400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854017070 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385400ac00 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c0ca700 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854012400 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.582+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c0cacc0 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.583+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f385401a070 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.583+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f385401cce0 con 0x7f385c0c9980 2024-04-25T15:42:38.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.583+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c06a100 con 0x7f385c0c9980 2024-04-25T15:42:38.586 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.585+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f385401c760 con 0x7f385c0c9980 2024-04-25T15:42:38.597 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.597+0000 7f9fe5e17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:42:38.598 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.598+0000 7fad90c1f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:42:38.652 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.652+0000 7fad90c1f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:42:38.658 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.658+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35258f96-0ef1-4a49-a732-25d05c3ed73f", "id": 5} v 0) -- 0x7f385c0d41d0 con 0x7f385c0c9980 2024-04-25T15:42:38.662 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.662+0000 7f3843fff640 1 -- 172.21.15.195:0/1948839387 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35258f96-0ef1-4a49-a732-25d05c3ed73f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f385401ca10 con 0x7f385c0c9980 2024-04-25T15:42:38.662 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 msgr2=0x7f385c0b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 0x7f385c0b73a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f385400caa0 tx=0x7f385400cf60 comp rx=0 tx=0).stop 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 shutdown_connections 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f385c0c9980 0x7f385c0b73a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f385c0d2b80 0x7f385c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 --2- 172.21.15.195:0/1948839387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f385c0d0b00 0x7f385c0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 >> 172.21.15.195:0/1948839387 conn(0x7f385c06e650 msgr2=0x7f385c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 shutdown_connections 2024-04-25T15:42:38.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.663+0000 7f38618ee640 1 -- 172.21.15.195:0/1948839387 wait complete. 2024-04-25T15:42:38.674 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 4b187a84-2107-4e8e-b674-fbe439014fac 6 2024-04-25T15:42:38.710 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:38.709+0000 7f9fe5e17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:42:38.773 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:38.772+0000 7fad90c1f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:42:38.781 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.781+0000 7f7a311ee640 1 Processor -- start 2024-04-25T15:42:38.781 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.781+0000 7f7a311ee640 1 -- start start 2024-04-25T15:42:38.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a311ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7a2c06d780 0x7f7a2c16aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.783 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a311ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2c0b0910 con 0x7f7a2c160520 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a311ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2c0b0bf0 con 0x7f7a2c0d28c0 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a311ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2c0b1520 con 0x7f7a2c06d780 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a2a59c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7a2c0d28c0 0x7f7a2c0d2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:51620/0 (socket says 172.21.15.195:51620) 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a2a59c640 1 -- 172.21.15.195:0/4128929764 learned_addr learned my addr 172.21.15.195:0/4128929764 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a2b59e640 1 --2- 172.21.15.195:0/4128929764 >> v2:172.21.15.80:3300/0 conn(0x7f7a2c06d780 0x7f7a2c16aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546553915 0 0) 0x7f7a2c0b0bf0 con 0x7f7a2c0d28c0 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.782+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a14003520 con 0x7f7a2c0d28c0 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.783+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304602068 0 0) 0x7f7a2c0b0910 con 0x7f7a2c160520 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.783+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a2c0b0bf0 con 0x7f7a2c160520 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.783+0000 7f7a2b59e640 1 -- 172.21.15.195:0/4128929764 >> v1:172.21.15.195:6789/0 conn(0x7f7a2c0d28c0 legacy=0x7f7a2c0d2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.783+0000 7f7a2b59e640 1 -- 172.21.15.195:0/4128929764 >> v1:172.21.15.80:6789/0 conn(0x7f7a2c160520 legacy=0x7f7a2c09bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.784 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.783+0000 7f7a2b59e640 1 -- 172.21.15.195:0/4128929764 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2c0b0ed0 con 0x7f7a2c06d780 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.784+0000 7f7a2b59e640 1 --2- 172.21.15.195:0/4128929764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c06d780 0x7f7a2c16aeb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009d90 tx=0x7f7a2402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2dae47a564ae60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.784+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24007740 con 0x7f7a2c06d780 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.784+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240078e0 con 0x7f7a2c06d780 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.784+0000 7f7a29d9b640 1 -- 172.21.15.195:0/4128929764 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24007c90 con 0x7f7a2c06d780 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 -- 172.21.15.195:0/4128929764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c06d780 msgr2=0x7f7a2c16aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 --2- 172.21.15.195:0/4128929764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c06d780 0x7f7a2c16aeb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009d90 tx=0x7f7a2402a6f0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 -- 172.21.15.195:0/4128929764 shutdown_connections 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 --2- 172.21.15.195:0/4128929764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c06d780 0x7f7a2c16aeb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 -- 172.21.15.195:0/4128929764 >> 172.21.15.195:0/4128929764 conn(0x7f7a2c0b7690 msgr2=0x7f7a2c0b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 -- 172.21.15.195:0/4128929764 shutdown_connections 2024-04-25T15:42:38.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.785+0000 7f7a311ee640 1 -- 172.21.15.195:0/4128929764 wait complete. 2024-04-25T15:42:38.787 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.787+0000 7f7a311ee640 1 Processor -- start 2024-04-25T15:42:38.787 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.787+0000 7f7a311ee640 1 -- start start 2024-04-25T15:42:38.789 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a311ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 0x7f7a2c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.789 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a311ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c0d28c0 0x7f7a2c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a311ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a2c160520 0x7f7a2c1f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a311ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c09c2f0 con 0x7f7a2c0d28c0 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a311ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c06ef60 con 0x7f7a2c160520 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a311ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a2c16b3f0 con 0x7f7a2c06d780 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a2ad9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 0x7f7a2c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a2b59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a2c160520 0x7f7a2c1f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a2ad9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 0x7f7a2c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37936/0 (socket says 172.21.15.195:37936) 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a2ad9d640 1 -- 172.21.15.195:0/3442502035 learned_addr learned my addr 172.21.15.195:0/3442502035 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.788+0000 7f7a2a59c640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c0d28c0 0x7f7a2c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2ad9d640 1 -- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a2c160520 msgr2=0x7f7a2c1f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2ad9d640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a2c160520 0x7f7a2c1f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2ad9d640 1 -- 172.21.15.195:0/3442502035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c0d28c0 msgr2=0x7f7a2c1f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2ad9d640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c0d28c0 0x7f7a2c1f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2ad9d640 1 -- 172.21.15.195:0/3442502035 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2c1f7390 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2b59e640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a2c160520 0x7f7a2c1f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a2ad9d640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 0x7f7a2c156780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00c390 tx=0x7f7a1c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c017070 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0052d0 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2c1f7670 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c003810 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2c0cd270 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a1c01a070 con 0x7f7a2c06d780 2024-04-25T15:42:38.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.789+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7a1c011b80 con 0x7f7a2c06d780 2024-04-25T15:42:38.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.790+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2c06a100 con 0x7f7a2c06d780 2024-04-25T15:42:38.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.792+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7a1c021020 con 0x7f7a2c06d780 2024-04-25T15:42:38.866 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.866+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4b187a84-2107-4e8e-b674-fbe439014fac", "id": 6} v 0) -- 0x7f7a2c0b4a20 con 0x7f7a2c06d780 2024-04-25T15:42:38.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.871+0000 7f7a137fe640 1 -- 172.21.15.195:0/3442502035 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b187a84-2107-4e8e-b674-fbe439014fac", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7a1c011590 con 0x7f7a2c06d780 2024-04-25T15:42:38.872 INFO:teuthology.orchestra.run.smithi195.stdout:6 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 msgr2=0x7f7a2c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 0x7f7a2c156780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00c390 tx=0x7f7a1c00c850 comp rx=0 tx=0).stop 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 shutdown_connections 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a2c160520 0x7f7a2c1f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c0d28c0 0x7f7a2c1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 --2- 172.21.15.195:0/3442502035 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a2c06d780 0x7f7a2c156780 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 >> 172.21.15.195:0/3442502035 conn(0x7f7a2c0b7690 msgr2=0x7f7a2c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.872+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 shutdown_connections 2024-04-25T15:42:38.873 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.873+0000 7f7a311ee640 1 -- 172.21.15.195:0/3442502035 wait complete. 2024-04-25T15:42:38.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 9b484b8a-acda-45b2-a9e9-772f421ae600 7 2024-04-25T15:42:38.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.990+0000 7f99c80b1640 1 Processor -- start 2024-04-25T15:42:38.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.991+0000 7f99c80b1640 1 -- start start 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c80b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00d3000 0x7f99c00ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c80b1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99c00ce910 0x7f99c006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c80b1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c00d01a0 con 0x7f99c00c90a0 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c80b1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f99c006d100 con 0x7f99c00ce910 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c80b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99c006d3e0 con 0x7f99c00d3000 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c564c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00d3000 0x7f99c00ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c5e4d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f99c00c90a0 0x7f99c00d28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:51628/0 (socket says 172.21.15.195:51628) 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c5e4d640 1 -- 172.21.15.195:0/1936271141 learned_addr learned my addr 172.21.15.195:0/1936271141 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.992+0000 7f99c664e640 1 --2- 172.21.15.195:0/1936271141 >> v2:172.21.15.80:3300/0 conn(0x7f99c00ce910 0x7f99c006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c4e4b640 1 -- 172.21.15.195:0/1936271141 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702047195 0 0) 0x7f99b0001110 con 0x7f99c00c90a0 2024-04-25T15:42:38.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c564c640 1 -- 172.21.15.195:0/1936271141 >> v2:172.21.15.80:3300/0 conn(0x7f99c00ce910 msgr2=0x7f99c006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:38.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c564c640 1 --2- 172.21.15.195:0/1936271141 >> v2:172.21.15.80:3300/0 conn(0x7f99c00ce910 0x7f99c006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c564c640 1 -- 172.21.15.195:0/1936271141 >> v1:172.21.15.195:6789/0 conn(0x7f99c00c90a0 legacy=0x7f99c00d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c564c640 1 -- 172.21.15.195:0/1936271141 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c006d6c0 con 0x7f99c00d3000 2024-04-25T15:42:38.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c664e640 1 --2- 172.21.15.195:0/1936271141 >> v2:172.21.15.80:3300/0 conn(0x7f99c00ce910 0x7f99c006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c564c640 1 --2- 172.21.15.195:0/1936271141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00d3000 0x7f99c00ce3d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0097a0 tx=0x7f99bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=383ba5e347221b3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c4e4b640 1 -- 172.21.15.195:0/1936271141 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc037070 con 0x7f99c00d3000 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.993+0000 7f99c4e4b640 1 -- 172.21.15.195:0/1936271141 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc032440 con 0x7f99c00d3000 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c4e4b640 1 -- 172.21.15.195:0/1936271141 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc032810 con 0x7f99c00d3000 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 -- 172.21.15.195:0/1936271141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00d3000 msgr2=0x7f99c00ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 --2- 172.21.15.195:0/1936271141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00d3000 0x7f99c00ce3d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0097a0 tx=0x7f99bc02a180 comp rx=0 tx=0).stop 2024-04-25T15:42:38.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 -- 172.21.15.195:0/1936271141 shutdown_connections 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 --2- 172.21.15.195:0/1936271141 >> v2:172.21.15.80:3300/0 conn(0x7f99c00ce910 0x7f99c006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 --2- 172.21.15.195:0/1936271141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00d3000 0x7f99c00ce3d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 -- 172.21.15.195:0/1936271141 >> 172.21.15.195:0/1936271141 conn(0x7f99c00b7690 msgr2=0x7f99c00b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 -- 172.21.15.195:0/1936271141 shutdown_connections 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.994+0000 7f99c80b1640 1 -- 172.21.15.195:0/1936271141 wait complete. 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.996+0000 7f99c80b1640 1 Processor -- start 2024-04-25T15:42:38.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.996+0000 7f99c80b1640 1 -- start start 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 0x7f99c01fa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99c00ce910 0x7f99c00c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c00c71c0 0x7f99c01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99c00ceea0 con 0x7f99c00ce910 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99c00ced20 con 0x7f99c00c71c0 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99c006e400 con 0x7f99c00c90a0 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c5e4d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 0x7f99c01fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:38.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c00c71c0 0x7f99c01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c5e4d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 0x7f99c01fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:37960/0 (socket says 172.21.15.195:37960) 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c5e4d640 1 -- 172.21.15.195:0/3809153033 learned_addr learned my addr 172.21.15.195:0/3809153033 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c564c640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99c00ce910 0x7f99c00c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 -- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 msgr2=0x7f99c01fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 0x7f99c01fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 -- 172.21.15.195:0/3809153033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99c00ce910 msgr2=0x7f99c00c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99c00ce910 0x7f99c00c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 -- 172.21.15.195:0/3809153033 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c00b13e0 con 0x7f99c00c71c0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c5e4d640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 0x7f99c01fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c664e640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c00c71c0 0x7f99c01528f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f99c0073d50 tx=0x7f99b800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b801a070 con 0x7f99c00c71c0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b8003990 con 0x7f99c00c71c0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c00b16c0 con 0x7f99c00c71c0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8003d80 con 0x7f99c00c71c0 2024-04-25T15:42:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.998+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c00af760 con 0x7f99c00c71c0 2024-04-25T15:42:39.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.999+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99b801d070 con 0x7f99c00c71c0 2024-04-25T15:42:39.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:38.999+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f99b8015aa0 con 0x7f99c00c71c0 2024-04-25T15:42:39.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.000+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c00afa70 con 0x7f99c00c71c0 2024-04-25T15:42:39.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.002+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f99b8024020 con 0x7f99c00c71c0 2024-04-25T15:42:39.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.074+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b484b8a-acda-45b2-a9e9-772f421ae600", "id": 7} v 0) -- 0x7f99c006a100 con 0x7f99c00c71c0 2024-04-25T15:42:39.080 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.081+0000 7f99b67fc640 1 -- 172.21.15.195:0/3809153033 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b484b8a-acda-45b2-a9e9-772f421ae600", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f99b8010070 con 0x7f99c00c71c0 2024-04-25T15:42:39.081 INFO:teuthology.orchestra.run.smithi195.stdout:7 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c00c71c0 msgr2=0x7f99c01528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c00c71c0 0x7f99c01528f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f99c0073d50 tx=0x7f99b800d4a0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 shutdown_connections 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c00c71c0 0x7f99c01528f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99c00ce910 0x7f99c00c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 --2- 172.21.15.195:0/3809153033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99c00c90a0 0x7f99c01fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 >> 172.21.15.195:0/3809153033 conn(0x7f99c00b7690 msgr2=0x7f99c0070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:39.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 shutdown_connections 2024-04-25T15:42:39.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:42:39.082+0000 7f99c80b1640 1 -- 172.21.15.195:0/3809153033 wait complete. 2024-04-25T15:42:39.092 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T15:42:39.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T15:42:39.093 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:39.091+0000 7f9fe5e17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:42:39.095 INFO:tasks.ceph.osd.0:Started 2024-04-25T15:42:39.095 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T15:42:39.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T15:42:39.098 INFO:tasks.ceph.osd.1:Started 2024-04-25T15:42:39.098 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T15:42:39.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T15:42:39.100 INFO:tasks.ceph.osd.2:Started 2024-04-25T15:42:39.100 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T15:42:39.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T15:42:39.102 INFO:tasks.ceph.osd.3:Started 2024-04-25T15:42:39.102 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T15:42:39.103 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T15:42:39.104 INFO:tasks.ceph.osd.4:Started 2024-04-25T15:42:39.105 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T15:42:39.105 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T15:42:39.106 INFO:tasks.ceph.osd.5:Started 2024-04-25T15:42:39.107 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T15:42:39.107 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T15:42:39.109 INFO:tasks.ceph.osd.6:Started 2024-04-25T15:42:39.109 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T15:42:39.109 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T15:42:39.113 INFO:tasks.ceph.osd.7:Started 2024-04-25T15:42:39.113 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:42:39.214 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:39.213+0000 7fad90c1f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:42:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.259+0000 7f4de7d34640 1 Processor -- start 2024-04-25T15:42:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.259+0000 7f4de7d34640 1 -- start start 2024-04-25T15:42:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de7d34640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4de00ce860 0x7f4de00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de7d34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de0073a40 0x7f4de01601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de7d34640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de01642e0 con 0x7f4de0163e00 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de7d34640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4de01606e0 con 0x7f4de00ce860 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de7d34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4de01645c0 con 0x7f4de0073a40 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de5ad0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4de00ce860 0x7f4de00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de5ad0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4de00ce860 0x7f4de00b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58872/0 (socket says 172.21.15.80:58872) 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de5ad0640 1 -- 172.21.15.80:0/139726921 learned_addr learned my addr 172.21.15.80:0/139726921 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.260+0000 7f4de62d1640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de0073a40 0x7f4de01601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de5ad0640 1 -- 172.21.15.80:0/139726921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de0073a40 msgr2=0x7f4de01601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de5ad0640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de0073a40 0x7f4de01601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de5ad0640 1 -- 172.21.15.80:0/139726921 >> v1:172.21.15.195:6789/0 conn(0x7f4de0163e00 legacy=0x7f4de0073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de5ad0640 1 -- 172.21.15.80:0/139726921 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de01648a0 con 0x7f4de00ce860 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de62d1640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de0073a40 0x7f4de01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de5ad0640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de00ce860 0x7f4de00b2f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009870 tx=0x7f4dd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b863859a3a2b5e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:39.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de4ace640 1 -- 172.21.15.80:0/139726921 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0037070 con 0x7f4de00ce860 2024-04-25T15:42:39.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.261+0000 7f4de4ace640 1 -- 172.21.15.80:0/139726921 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd0032440 con 0x7f4de00ce860 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de4ace640 1 -- 172.21.15.80:0/139726921 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0032810 con 0x7f4de00ce860 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de7d34640 1 -- 172.21.15.80:0/139726921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de00ce860 msgr2=0x7f4de00b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de7d34640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de00ce860 0x7f4de00b2f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009870 tx=0x7f4dd002a270 comp rx=0 tx=0).stop 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de7d34640 1 -- 172.21.15.80:0/139726921 shutdown_connections 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de7d34640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de0073a40 0x7f4de01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de7d34640 1 --2- 172.21.15.80:0/139726921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de00ce860 0x7f4de00b2f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.262+0000 7f4de7d34640 1 -- 172.21.15.80:0/139726921 >> 172.21.15.80:0/139726921 conn(0x7f4de00d3ea0 msgr2=0x7f4de00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.263+0000 7f4de7d34640 1 -- 172.21.15.80:0/139726921 shutdown_connections 2024-04-25T15:42:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.263+0000 7f4de7d34640 1 -- 172.21.15.80:0/139726921 wait complete. 2024-04-25T15:42:39.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.264+0000 7f4de7d34640 1 Processor -- start 2024-04-25T15:42:39.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.265+0000 7f4de7d34640 1 -- start start 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de7d34640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de00ce860 0x7f4de00b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de7d34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 0x7f4de00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de7d34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de00b9190 0x7f4de00b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de7d34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4de006e730 con 0x7f4de0163e00 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de7d34640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00d1aa0 con 0x7f4de00ce860 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de7d34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4de006e8b0 con 0x7f4de00b9190 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 0x7f4de00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 0x7f4de00b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58886/0 (socket says 172.21.15.80:58886) 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 -- 172.21.15.80:0/1252091307 learned_addr learned my addr 172.21.15.80:0/1252091307 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de5ad0640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de00ce860 0x7f4de00b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de62d1640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de00b9190 0x7f4de00b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 -- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de00b9190 msgr2=0x7f4de00b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de00b9190 0x7f4de00b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 -- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de00ce860 msgr2=0x7f4de00b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de00ce860 0x7f4de00b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.266+0000 7f4de52cf640 1 -- 172.21.15.80:0/1252091307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de00b73f0 con 0x7f4de0163e00 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.267+0000 7f4de52cf640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 0x7f4de00b22a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c3c0 tx=0x7f4ddc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.267+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0052d0 con 0x7f4de0163e00 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.267+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0054b0 con 0x7f4de0163e00 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.267+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc006a40 con 0x7f4de0163e00 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.267+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de00b76d0 con 0x7f4de0163e00 2024-04-25T15:42:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.267+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de00b7c90 con 0x7f4de0163e00 2024-04-25T15:42:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.268+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ddc006be0 con 0x7f4de0163e00 2024-04-25T15:42:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.268+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4ddc003c30 con 0x7f4de0163e00 2024-04-25T15:42:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.268+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de006a100 con 0x7f4de0163e00 2024-04-25T15:42:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.270+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4ddc003640 con 0x7f4de0163e00 2024-04-25T15:42:39.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.365+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4de006de90 con 0x7f4de0163e00 2024-04-25T15:42:39.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.365+0000 7f4dd67fc640 1 -- 172.21.15.80:0/1252091307 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4ddc003820 con 0x7f4de0163e00 2024-04-25T15:42:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:39.367 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:42:39.076130+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:42:39.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 msgr2=0x7f4de00b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 0x7f4de00b22a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c3c0 tx=0x7f4ddc00c880 comp rx=0 tx=0).stop 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 shutdown_connections 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4de00b9190 0x7f4de00b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de0163e00 0x7f4de00b22a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 --2- 172.21.15.80:0/1252091307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de00ce860 0x7f4de00b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 >> 172.21.15.80:0/1252091307 conn(0x7f4de00d3ea0 msgr2=0x7f4de0162170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 shutdown_connections 2024-04-25T15:42:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:39.366+0000 7f4de7d34640 1 -- 172.21.15.80:0/1252091307 wait complete. 2024-04-25T15:42:39.378 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T15:42:39.378 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T15:42:39.420 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:39.419+0000 7f9fe5e17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:42:39.473 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:39.472+0000 7f9fe5e17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:42:39.474 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:39.474+0000 7fad90c1f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:42:39.527 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:39.527+0000 7fad90c1f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:42:39.588 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:39.587+0000 7f9fe5e17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:42:39.641 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:39.641+0000 7fad90c1f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:42:39.711 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T15:42:39.711+0000 7ff4d6d33640 -1 Falling back to public interface 2024-04-25T15:42:39.715 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T15:42:39.715+0000 7f4157dda640 -1 Falling back to public interface 2024-04-25T15:42:39.723 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T15:42:39.723+0000 7fcd23523640 -1 Falling back to public interface 2024-04-25T15:42:39.727 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-25T15:42:39.726+0000 7f85237cb640 -1 Falling back to public interface 2024-04-25T15:42:39.732 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-25T15:42:39.731+0000 7fd3af4db640 -1 Falling back to public interface 2024-04-25T15:42:39.733 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-25T15:42:39.732+0000 7f8955db1640 -1 Falling back to public interface 2024-04-25T15:42:39.733 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-25T15:42:39.732+0000 7fd3ae48a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6809/0: (98) Address already in use 2024-04-25T15:42:39.738 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-25T15:42:39.738+0000 7f5941e33640 -1 Falling back to public interface 2024-04-25T15:42:39.752 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T15:42:39.752+0000 7f1f8022c640 -1 Falling back to public interface 2024-04-25T15:42:39.873 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:39.872+0000 7f9fe5e17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:42:39.921 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:39.920+0000 7f9fe5e17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:42:39.929 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:39.929+0000 7fad90c1f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:42:39.977 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:39.977+0000 7fad90c1f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:42:40.079 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.078+0000 7f9fe5e17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:42:40.136 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:40.136+0000 7fad90c1f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:42:40.183 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:42:40.217 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.216+0000 7f9fe5e17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:42:40.269 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.268+0000 7f9fe5e17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:42:40.273 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:40.273+0000 7fad90c1f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:42:40.282 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.281+0000 7fb6abb64640 1 Processor -- start 2024-04-25T15:42:40.283 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.282+0000 7fb6abb64640 1 -- start start 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6abb64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6a40ce4a0 0x7fb6a415de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6abb64640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a40ce8b0 con 0x7fb6a40cf290 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6abb64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a4161bc0 con 0x7fb6a40d0bb0 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6abb64640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a415e3a0 con 0x7fb6a40ce4a0 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6a90ff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb6a40cf290 0x7fb6a40d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52402/0 (socket says 172.21.15.80:52402) 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6a90ff640 1 -- 172.21.15.80:0/3274639559 learned_addr learned my addr 172.21.15.80:0/3274639559 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:40.287 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6aa101640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6a40ce4a0 0x7fb6a415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 66554545 0 0) 0x7fb6a40ce8b0 con 0x7fb6a40cf290 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.283+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb690003520 con 0x7fb6a40cf290 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302808768 0 0) 0x7fb6a4161bc0 con 0x7fb6a40d0bb0 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a40ce8b0 con 0x7fb6a40d0bb0 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2637339380 0 0) 0x7fb690003520 con 0x7fb6a40cf290 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6a40ce4a0 msgr2=0x7fb6a415de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6a40ce4a0 0x7fb6a415de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 >> v1:172.21.15.195:6789/0 conn(0x7fb6a40d0bb0 legacy=0x7fb6a40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a4161ea0 con 0x7fb6a40cf290 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb694001670 con 0x7fb6a40cf290 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 >> v1:172.21.15.80:6789/0 conn(0x7fb6a40cf290 legacy=0x7fb6a40d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb690003b70 0x7fb690003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb690004800 0x7fb690004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.288 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690005210 0x7fb69000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a415e3a0 con 0x7fb690004800 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb69000c140 con 0x7fb690003b70 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb69000c340 con 0x7fb690005210 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6aa101640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6a40ce4a0 0x7fb6a415de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a90ff640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb690004800 0x7fb690004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a9900640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb690003b70 0x7fb690003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6aa101640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690005210 0x7fb69000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a90ff640 1 -- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690005210 msgr2=0x7fb69000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a90ff640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690005210 0x7fb69000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a90ff640 1 -- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb690003b70 msgr2=0x7fb690003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a90ff640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb690003b70 0x7fb690003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.289 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.284+0000 7fb6a90ff640 1 -- 172.21.15.80:0/3274639559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb690003520 con 0x7fb690004800 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.285+0000 7fb6a90ff640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb690004800 0x7fb690004c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ce1b0 tx=0x7fb690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9bd1ac3557596b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.285+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694007ca0 con 0x7fb690004800 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.285+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb694005ad0 con 0x7fb690004800 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.285+0000 7fb6a88fe640 1 -- 172.21.15.80:0/3274639559 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694007070 con 0x7fb690004800 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6abb64640 1 -- 172.21.15.80:0/3274639559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb690004800 msgr2=0x7fb690004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6abb64640 1 --2- 172.21.15.80:0/3274639559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb690004800 0x7fb690004c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ce1b0 tx=0x7fb690005830 comp rx=0 tx=0).stop 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6aa101640 1 -- 172.21.15.80:0/3274639559 reap_dead start 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6abb64640 1 -- 172.21.15.80:0/3274639559 shutdown_connections 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6abb64640 1 -- 172.21.15.80:0/3274639559 >> 172.21.15.80:0/3274639559 conn(0x7fb6a40b54c0 msgr2=0x7fb6a40b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6abb64640 1 -- 172.21.15.80:0/3274639559 shutdown_connections 2024-04-25T15:42:40.290 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.286+0000 7fb6abb64640 1 -- 172.21.15.80:0/3274639559 wait complete. 2024-04-25T15:42:40.292 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.288+0000 7fb6abb64640 1 Processor -- start 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.288+0000 7fb6abb64640 1 -- start start 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6abb64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690004800 0x7fb6a415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6abb64640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6a4155170 0x7fb6a40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6abb64640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 0x7fb6a4158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6abb64640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4162740 con 0x7fb6a4157c80 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6abb64640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4162460 con 0x7fb6a4155170 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6abb64640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40b6dc0 con 0x7fb690004800 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6aa101640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 0x7fb6a4158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6aa101640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 0x7fb6a4158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58904/0 (socket says 172.21.15.80:58904) 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6aa101640 1 -- 172.21.15.80:0/1539137378 learned_addr learned my addr 172.21.15.80:0/1539137378 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6a90ff640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6a4155170 0x7fb6a40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.289+0000 7fb6a9900640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690004800 0x7fb6a415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:40.293 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6aa101640 1 -- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690004800 msgr2=0x7fb6a415ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6aa101640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690004800 0x7fb6a415ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6aa101640 1 -- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6a4155170 msgr2=0x7fb6a40ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6aa101640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6a4155170 0x7fb6a40ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6aa101640 1 -- 172.21.15.80:0/1539137378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a41608b0 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6aa101640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 0x7fb6a4158090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb6a408cd50 tx=0x7fb6a00119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0004440 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a001c070 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a4160b90 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0003850 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a41558d0 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6a00039f0 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.290+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb6a0015b30 con 0x7fb6a4157c80 2024-04-25T15:42:40.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.291+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a4160620 con 0x7fb6a4157c80 2024-04-25T15:42:40.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.293+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb6a0005990 con 0x7fb6a4157c80 2024-04-25T15:42:40.325 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:40.325+0000 7fad90c1f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:42:40.344 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.343+0000 7f9fe5e17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:42:40.354 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.354+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6a4050740 con 0x7fb6a4157c80 2024-04-25T15:42:40.355 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.354+0000 7fb69a7fc640 1 -- 172.21.15.80:0/1539137378 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb6a0015e00 con 0x7fb6a4157c80 2024-04-25T15:42:40.355 INFO:teuthology.misc.health.smithi080.stdout: 2024-04-25T15:42:40.356 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":10,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:42:39.076130+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:42:40.356 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 msgr2=0x7fb6a4158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 0x7fb6a4158090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb6a408cd50 tx=0x7fb6a00119c0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 shutdown_connections 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a4157c80 0x7fb6a4158090 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6a4155170 0x7fb6a40ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 --2- 172.21.15.80:0/1539137378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb690004800 0x7fb6a415ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 >> 172.21.15.80:0/1539137378 conn(0x7fb6a40b54c0 msgr2=0x7fb6a40d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 shutdown_connections 2024-04-25T15:42:40.357 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:40.355+0000 7fb6abb64640 1 -- 172.21.15.80:0/1539137378 wait complete. 2024-04-25T15:42:40.366 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:42:40.392 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.391+0000 7f9fe5e17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:42:40.395 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:40.395+0000 7fad90c1f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:42:40.440 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:40.440+0000 7fad90c1f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:42:40.871 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.870+0000 7f9fe5e17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:42:40.919 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:40.919+0000 7fad90c1f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:42:40.986 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:40.985+0000 7f9fe5e17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:42:41.039 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-25T15:42:41.039+0000 7fad90c1f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:42:42.000 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:41.999+0000 7f9f85d84640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T15:42:42.001 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-25T15:42:41.999+0000 7f9f85d84640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T15:42:43.166 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T15:42:43.166+0000 7f4157dda640 -1 osd.4 0 log_to_monitors true 2024-04-25T15:42:43.208 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T15:42:43.208+0000 7ff4d6d33640 -1 osd.5 0 log_to_monitors true 2024-04-25T15:42:43.238 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-25T15:42:43.237+0000 7fd3af4db640 -1 osd.0 0 log_to_monitors true 2024-04-25T15:42:43.241 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-25T15:42:43.240+0000 7f85237cb640 -1 osd.2 0 log_to_monitors true 2024-04-25T15:42:43.251 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T15:42:43.251+0000 7fcd23523640 -1 osd.7 0 log_to_monitors true 2024-04-25T15:42:43.253 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-25T15:42:43.253+0000 7f5941e33640 -1 osd.1 0 log_to_monitors true 2024-04-25T15:42:43.258 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-25T15:42:43.257+0000 7f8955db1640 -1 osd.3 0 log_to_monitors true 2024-04-25T15:42:43.265 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T15:42:43.266+0000 7f1f8022c640 -1 osd.6 0 log_to_monitors true 2024-04-25T15:42:46.253 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T15:42:46.253+0000 7f4153d70640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T15:42:46.282 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-25T15:42:46.282+0000 7f414bb6b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:46.329 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T15:42:46.329+0000 7fcd1f4b9640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T15:42:46.347 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-25T15:42:46.347+0000 7fcd172b4640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:46.359 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T15:42:46.359+0000 7ff4d2cc9640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T15:42:46.399 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-25T15:42:46.399+0000 7ff4caac4640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:47.173 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:42:47.194 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-25T15:42:47.192+0000 7f593d380640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T15:42:47.204 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-25T15:42:47.203+0000 7f8951d47640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T15:42:47.212 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-25T15:42:47.211+0000 7f593518c640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:47.227 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-25T15:42:47.226+0000 7f851f761640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T15:42:47.228 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-25T15:42:47.227+0000 7f8949b42640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:47.240 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-25T15:42:47.239+0000 7fd3ab471640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T15:42:47.241 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-25T15:42:47.241+0000 7f851755c640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:47.256 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-25T15:42:47.255+0000 7fd3a326c640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:47.291 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.289+0000 7f983c6b6640 1 Processor -- start 2024-04-25T15:42:47.291 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.289+0000 7f983c6b6640 1 -- start start 2024-04-25T15:42:47.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983c6b6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9834160410 0x7f98340b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983c6b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f98340b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983c6b6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98340b9780 0x7f98340d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983c6b6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f98340b5050 con 0x7f98340b9780 2024-04-25T15:42:47.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983c6b6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f98340d3f30 con 0x7f9834160410 2024-04-25T15:42:47.294 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983c6b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f98340d4210 con 0x7f98340d1460 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98340b9780 0x7f98340d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98340b9780 0x7f98340d2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41128/0 (socket says 172.21.15.80:41128) 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 -- 172.21.15.80:0/4226105815 learned_addr learned my addr 172.21.15.80:0/4226105815 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983a452640 1 --2- 172.21.15.80:0/4226105815 >> v2:172.21.15.195:3300/0 conn(0x7f9834160410 0x7f98340b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f9839c51640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f98340b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 -- 172.21.15.80:0/4226105815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 msgr2=0x7f98340b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f98340b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 -- 172.21.15.80:0/4226105815 >> v2:172.21.15.195:3300/0 conn(0x7f9834160410 msgr2=0x7f98340b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 --2- 172.21.15.80:0/4226105815 >> v2:172.21.15.195:3300/0 conn(0x7f9834160410 0x7f98340b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983ac53640 1 -- 172.21.15.80:0/4226105815 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98340d44f0 con 0x7f98340b9780 2024-04-25T15:42:47.295 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f983a452640 1 --2- 172.21.15.80:0/4226105815 >> v2:172.21.15.195:3300/0 conn(0x7f9834160410 0x7f98340b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.291+0000 7f9839c51640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f98340b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.292+0000 7f983ac53640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98340b9780 0x7f98340d2500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98340d3770 tx=0x7f982c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612f3eb044bddace server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.292+0000 7f9839450640 1 -- 172.21.15.80:0/4226105815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c036070 con 0x7f98340b9780 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.292+0000 7f9839450640 1 -- 172.21.15.80:0/4226105815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c031600 con 0x7f98340b9780 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.292+0000 7f9839450640 1 -- 172.21.15.80:0/4226105815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c0319d0 con 0x7f98340b9780 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 -- 172.21.15.80:0/4226105815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98340b9780 msgr2=0x7f98340d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98340b9780 0x7f98340d2500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98340d3770 tx=0x7f982c02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 -- 172.21.15.80:0/4226105815 shutdown_connections 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98340b9780 0x7f98340d2500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 --2- 172.21.15.80:0/4226105815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f98340b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 --2- 172.21.15.80:0/4226105815 >> v2:172.21.15.195:3300/0 conn(0x7f9834160410 0x7f98340b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 -- 172.21.15.80:0/4226105815 >> 172.21.15.80:0/4226105815 conn(0x7f98340b7720 msgr2=0x7f98340b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:47.296 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 -- 172.21.15.80:0/4226105815 shutdown_connections 2024-04-25T15:42:47.297 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.293+0000 7f983c6b6640 1 -- 172.21.15.80:0/4226105815 wait complete. 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.295+0000 7f983c6b6640 1 Processor -- start 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.295+0000 7f983c6b6640 1 -- start start 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983c6b6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98340b9780 0x7f9834152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983c6b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f9834160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983c6b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 0x7f983415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983c6b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f98340d2a40 con 0x7f9834160410 2024-04-25T15:42:47.299 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983c6b6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f98340b4d60 con 0x7f98340b9780 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983c6b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f98340d2bc0 con 0x7f98340d1460 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 0x7f983415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 0x7f983415ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41140/0 (socket says 172.21.15.80:41140) 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983a452640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98340b9780 0x7f9834152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 -- 172.21.15.80:0/1945866338 learned_addr learned my addr 172.21.15.80:0/1945866338 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f9839c51640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f9834160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 -- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 msgr2=0x7f9834160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f9834160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 -- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98340b9780 msgr2=0x7f9834152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98340b9780 0x7f9834152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.296+0000 7f983ac53640 1 -- 172.21.15.80:0/1945866338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9834152e90 con 0x7f9834160410 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.297+0000 7f983ac53640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 0x7f983415ee50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f982c034040 tx=0x7f982c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:47.300 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.297+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c036050 con 0x7f9834160410 2024-04-25T15:42:47.301 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.297+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c042070 con 0x7f9834160410 2024-04-25T15:42:47.301 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.297+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98340cdec0 con 0x7f9834160410 2024-04-25T15:42:47.301 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.297+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c009510 con 0x7f9834160410 2024-04-25T15:42:47.301 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.297+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98340ce160 con 0x7f9834160410 2024-04-25T15:42:47.301 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.298+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98340b9540 con 0x7f9834160410 2024-04-25T15:42:47.301 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.298+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f982c007bd0 con 0x7f9834160410 2024-04-25T15:42:47.302 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.299+0000 7f982affd640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9818074450 0x7f9818076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:47.302 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.299+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3071+0+0 (secure 0 0 0) 0x7f982c0b5410 con 0x7f9834160410 2024-04-25T15:42:47.302 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.299+0000 7f983a452640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9818074450 0x7f9818076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:47.302 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.299+0000 7f983a452640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9818074450 0x7f9818076960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9824006fd0 tx=0x7f9824008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:47.304 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.304+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f98340b9540 con 0x7f9834160410 2024-04-25T15:42:47.386 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T15:42:47.386+0000 7f1f7b780640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T15:42:47.401 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-25T15:42:47.401+0000 7f1f7358c640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:42:47.484 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.483+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9834050740 con 0x7f9834160410 2024-04-25T15:42:47.484 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.484+0000 7f982affd640 1 -- 172.21.15.80:0/1945866338 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8539 (secure 0 0 0) 0x7f982c080080 con 0x7f9834160410 2024-04-25T15:42:47.485 INFO:teuthology.misc.health.smithi080.stdout: 2024-04-25T15:42:47.485 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":13,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:42:47.126738+0000","last_up_change":"2024-04-25T15:42:47.126738+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.485+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9818074450 msgr2=0x7f9818076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.485+0000 7f983c6b6640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9818074450 0x7f9818076960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9824006fd0 tx=0x7f9824008040 comp rx=0 tx=0).stop 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.485+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 msgr2=0x7f983415ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.485+0000 7f983c6b6640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 0x7f983415ee50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f982c034040 tx=0x7f982c004a40 comp rx=0 tx=0).stop 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 shutdown_connections 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9818074450 0x7f9818076960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9834160410 0x7f983415ee50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98340d1460 0x7f9834160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 --2- 172.21.15.80:0/1945866338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98340b9780 0x7f9834152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:47.487 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 >> 172.21.15.80:0/1945866338 conn(0x7f98340b7720 msgr2=0x7f98340d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:47.488 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 shutdown_connections 2024-04-25T15:42:47.488 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:47.486+0000 7f983c6b6640 1 -- 172.21.15.80:0/1945866338 wait complete. 2024-04-25T15:42:47.496 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-04-25T15:42:54.303 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:42:54.413 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.413+0000 7fcd2a57a640 1 Processor -- start 2024-04-25T15:42:54.414 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.413+0000 7fcd2a57a640 1 -- start start 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd2a57a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd240b5100 0x7fcd24161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd2a57a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd240b7da0 0x7fcd240d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd2a57a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd240d1760 con 0x7fcd240d0f80 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd2a57a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcd240d3f40 con 0x7fcd240b7da0 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd2a57a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240d38f0 con 0x7fcd240b5100 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd28b17640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd240b7da0 0x7fcd240d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd237fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcd240d0f80 0x7fcd240b7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52954/0 (socket says 172.21.15.80:52954) 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd237fe640 1 -- 172.21.15.80:0/696784744 learned_addr learned my addr 172.21.15.80:0/696784744 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd23fff640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd240b5100 0x7fcd24161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd28b17640 1 -- 172.21.15.80:0/696784744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd240b5100 msgr2=0x7fcd24161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd28b17640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd240b5100 0x7fcd24161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd28b17640 1 -- 172.21.15.80:0/696784744 >> v1:172.21.15.80:6789/0 conn(0x7fcd240d0f80 legacy=0x7fcd240b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd28b17640 1 -- 172.21.15.80:0/696784744 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240d3bd0 con 0x7fcd240b7da0 2024-04-25T15:42:54.417 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd22ffd640 1 -- 172.21.15.80:0/696784744 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620024921 0 0) 0x7fcd240d1760 con 0x7fcd240d0f80 2024-04-25T15:42:54.417 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.415+0000 7fcd23fff640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd240b5100 0x7fcd24161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:54.417 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.416+0000 7fcd28b17640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240b7da0 0x7fcd240d43d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009d90 tx=0x7fcd1c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6adcf859f966f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:54.417 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.416+0000 7fcd22ffd640 1 -- 172.21.15.80:0/696784744 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c007740 con 0x7fcd240b7da0 2024-04-25T15:42:54.417 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.416+0000 7fcd22ffd640 1 -- 172.21.15.80:0/696784744 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c0078e0 con 0x7fcd240b7da0 2024-04-25T15:42:54.417 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.416+0000 7fcd22ffd640 1 -- 172.21.15.80:0/696784744 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c007cb0 con 0x7fcd240b7da0 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 -- 172.21.15.80:0/696784744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240b7da0 msgr2=0x7fcd240d43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240b7da0 0x7fcd240d43d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009d90 tx=0x7fcd1c02a680 comp rx=0 tx=0).stop 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 -- 172.21.15.80:0/696784744 shutdown_connections 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240b7da0 0x7fcd240d43d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/696784744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd240b5100 0x7fcd24161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 -- 172.21.15.80:0/696784744 >> 172.21.15.80:0/696784744 conn(0x7fcd240d2690 msgr2=0x7fcd240d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 -- 172.21.15.80:0/696784744 shutdown_connections 2024-04-25T15:42:54.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.417+0000 7fcd2a57a640 1 -- 172.21.15.80:0/696784744 wait complete. 2024-04-25T15:42:54.419 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.419+0000 7fcd2a57a640 1 Processor -- start 2024-04-25T15:42:54.419 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.419+0000 7fcd2a57a640 1 -- start start 2024-04-25T15:42:54.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd2a57a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd240b5100 0x7fcd241f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd2a57a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 0x7fcd2414b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd2a57a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd2414bfc0 0x7fcd2414b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd2a57a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d1510 con 0x7fcd240d0f80 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd2a57a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d1390 con 0x7fcd240b5100 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd2a57a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240d4910 con 0x7fcd2414bfc0 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 0x7fcd2414b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 0x7fcd2414b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56980/0 (socket says 172.21.15.80:56980) 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 -- 172.21.15.80:0/3557572771 learned_addr learned my addr 172.21.15.80:0/3557572771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd23fff640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd240b5100 0x7fcd241f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd28b17640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd2414bfc0 0x7fcd2414b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 -- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd2414bfc0 msgr2=0x7fcd2414b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd2414bfc0 0x7fcd2414b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 -- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd240b5100 msgr2=0x7fcd241f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd240b5100 0x7fcd241f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.420+0000 7fcd237fe640 1 -- 172.21.15.80:0/3557572771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240cea10 con 0x7fcd240d0f80 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.421+0000 7fcd237fe640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 0x7fcd2414b2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd2408eb60 tx=0x7fcd1800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:54.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.421+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180074e0 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.421+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd180047e0 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.421+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd24149240 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.421+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18004bb0 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.421+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd24149800 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.422+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd240ce780 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.422+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcd18011070 con 0x7fcd240d0f80 2024-04-25T15:42:54.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.423+0000 7fcd20ff9640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcd100744e0 0x7fcd100769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.425 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.423+0000 7fcd23fff640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcd100744e0 0x7fcd100769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.425 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.423+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcd18094a90 con 0x7fcd240d0f80 2024-04-25T15:42:54.425 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.424+0000 7fcd23fff640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcd100744e0 0x7fcd100769f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd14006fd0 tx=0x7fcd14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:54.428 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.428+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd1805f570 con 0x7fcd240d0f80 2024-04-25T15:42:54.604 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.604+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd24050740 con 0x7fcd240d0f80 2024-04-25T15:42:54.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.605+0000 7fcd20ff9640 1 -- 172.21.15.80:0/3557572771 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7fcd1805ee70 con 0x7fcd240d0f80 2024-04-25T15:42:54.605 INFO:teuthology.misc.health.smithi080.stdout: 2024-04-25T15:42:54.605 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":17,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:42:51.223030+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:42:54.607 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcd100744e0 msgr2=0x7fcd100769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.607 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcd100744e0 0x7fcd100769f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd14006fd0 tx=0x7fcd14008040 comp rx=0 tx=0).stop 2024-04-25T15:42:54.607 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 msgr2=0x7fcd2414b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 0x7fcd2414b2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd2408eb60 tx=0x7fcd1800c870 comp rx=0 tx=0).stop 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 shutdown_connections 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcd100744e0 0x7fcd100769f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd2414bfc0 0x7fcd2414b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd240d0f80 0x7fcd2414b2d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 --2- 172.21.15.80:0/3557572771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd240b5100 0x7fcd241f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 >> 172.21.15.80:0/3557572771 conn(0x7fcd240d2690 msgr2=0x7fcd240b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 shutdown_connections 2024-04-25T15:42:54.608 INFO:teuthology.misc.health.smithi080.stderr:2024-04-25T15:42:54.607+0000 7fcd2a57a640 1 -- 172.21.15.80:0/3557572771 wait complete. 2024-04-25T15:42:54.618 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T15:42:54.618 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T15:42:54.618 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:42:54.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:42:54.621 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:42:54.621 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:42:54.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:42:54.623 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:42:54.623 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:42:54.623 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:42:54.626 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:42:54.626 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:42:54.626 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:42:54.628 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:42:54.629 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T15:42:54.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:42:54.705 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:42:54.705 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:42:54.720 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:42:54.721 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:42:54.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.743+0000 7f67e371f640 1 Processor -- start 2024-04-25T15:42:54.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.743+0000 7f67e371f640 1 -- start start 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e371f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f67dc0b48d0 0x7f67dc0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e371f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67dc0b7b90 0x7f67dc0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e371f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b7fa0 con 0x7f67dc0d41b0 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e371f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f67dc163fb0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e371f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f67dc164270 con 0x7f67dc0b48d0 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67dc0b7b90 0x7f67dc0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67dc0b7b90 0x7f67dc0d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57030/0 (socket says 172.21.15.80:57030) 2024-04-25T15:42:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 -- 172.21.15.80:0/3979629859 learned_addr learned my addr 172.21.15.80:0/3979629859 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e0cba640 1 --2- 172.21.15.80:0/3979629859 >> v2:172.21.15.195:3300/0 conn(0x7f67dc0b48d0 0x7f67dc0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 -- 172.21.15.80:0/3979629859 >> v2:172.21.15.195:3300/0 conn(0x7f67dc0b48d0 msgr2=0x7f67dc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 --2- 172.21.15.80:0/3979629859 >> v2:172.21.15.195:3300/0 conn(0x7f67dc0b48d0 0x7f67dc0b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 -- 172.21.15.80:0/3979629859 >> v1:172.21.15.195:6789/0 conn(0x7f67dc0d41b0 legacy=0x7f67dc1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e1cbc640 1 -- 172.21.15.80:0/3979629859 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc164550 con 0x7f67dc0b7b90 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.745+0000 7f67e0cba640 1 --2- 172.21.15.80:0/3979629859 >> v2:172.21.15.195:3300/0 conn(0x7f67dc0b48d0 0x7f67dc0b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.746+0000 7f67e1cbc640 1 --2- 172.21.15.80:0/3979629859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc0d49c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67dc08ee90 tx=0x7f67d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff6bbcebf710f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.746+0000 7f67d3fff640 1 -- 172.21.15.80:0/3979629859 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4036070 con 0x7f67dc0b7b90 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.746+0000 7f67d3fff640 1 -- 172.21.15.80:0/3979629859 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d4031600 con 0x7f67dc0b7b90 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.746+0000 7f67d3fff640 1 -- 172.21.15.80:0/3979629859 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40319d0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 -- 172.21.15.80:0/3979629859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 msgr2=0x7f67dc0d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 --2- 172.21.15.80:0/3979629859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc0d49c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67dc08ee90 tx=0x7f67d402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 -- 172.21.15.80:0/3979629859 shutdown_connections 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 --2- 172.21.15.80:0/3979629859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc0d49c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 --2- 172.21.15.80:0/3979629859 >> v2:172.21.15.195:3300/0 conn(0x7f67dc0b48d0 0x7f67dc0b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 -- 172.21.15.80:0/3979629859 >> 172.21.15.80:0/3979629859 conn(0x7f67dc06e9f0 msgr2=0x7f67dc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 -- 172.21.15.80:0/3979629859 shutdown_connections 2024-04-25T15:42:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.747+0000 7f67e371f640 1 -- 172.21.15.80:0/3979629859 wait complete. 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.748+0000 7f67e371f640 1 Processor -- start 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.748+0000 7f67e371f640 1 -- start start 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67dc0b48d0 0x7f67dc1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc14b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67dc0d41b0 0x7f67dc0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc0b4fd0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc164b10 con 0x7f67dc0b48d0 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f67dc0b5150 con 0x7f67dc0d41b0 2024-04-25T15:42:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc14b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc14b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57032/0 (socket says 172.21.15.80:57032) 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 -- 172.21.15.80:0/3205312232 learned_addr learned my addr 172.21.15.80:0/3205312232 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e14bb640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67dc0b48d0 0x7f67dc1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e1cbc640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67dc0d41b0 0x7f67dc0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 -- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67dc0d41b0 msgr2=0x7f67dc0b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67dc0d41b0 0x7f67dc0b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 -- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67dc0b48d0 msgr2=0x7f67dc1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67dc0b48d0 0x7f67dc1612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 -- 172.21.15.80:0/3205312232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc14b9f0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e0cba640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc14b4b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67d800d800 tx=0x7f67d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8004030 con 0x7f67dc0b7b90 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d80041d0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d80096a0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.750+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67dc0caa10 con 0x7f67dc0b7b90 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.751+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67dc0ca450 con 0x7f67dc0b7b90 2024-04-25T15:42:54.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.752+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc161880 con 0x7f67dc0b7b90 2024-04-25T15:42:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.752+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f67d8009840 con 0x7f67dc0b7b90 2024-04-25T15:42:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.753+0000 7f67d1ffb640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67c00744b0 0x7f67c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.753+0000 7f67e14bb640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67c00744b0 0x7f67c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.753+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f67d8094f80 con 0x7f67dc0b7b90 2024-04-25T15:42:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.753+0000 7f67e14bb640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67c00744b0 0x7f67c00769c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67cc000f60 tx=0x7f67cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:54.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.757+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67dc0caa10 con 0x7f67dc0b7b90 2024-04-25T15:42:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.932+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67dc0d19c0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.932+0000 7f67d1ffb640 1 -- 172.21.15.80:0/3205312232 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f67dc0d19c0 con 0x7f67dc0b7b90 2024-04-25T15:42:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:54.933 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:42:51.223030+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.934+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67c00744b0 msgr2=0x7f67c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.934+0000 7f67e371f640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67c00744b0 0x7f67c00769c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67cc000f60 tx=0x7f67cc009040 comp rx=0 tx=0).stop 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.934+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 msgr2=0x7f67dc14b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.934+0000 7f67e371f640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc14b4b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67d800d800 tx=0x7f67d800dcc0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 shutdown_connections 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67c00744b0 0x7f67c00769c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67dc0d41b0 0x7f67dc0b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67dc0b7b90 0x7f67dc14b4b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 --2- 172.21.15.80:0/3205312232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67dc0b48d0 0x7f67dc1612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:54.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 >> 172.21.15.80:0/3205312232 conn(0x7f67dc06e9f0 msgr2=0x7f67dc15d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 shutdown_connections 2024-04-25T15:42:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:54.935+0000 7f67e371f640 1 -- 172.21.15.80:0/3205312232 wait complete. 2024-04-25T15:42:54.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:42:54.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:42:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.056+0000 7f07fd242640 1 Processor -- start 2024-04-25T15:42:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.056+0000 7f07fd242640 1 -- start start 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.057+0000 7f07fd242640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f80b2db0 0x7f07f8160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.057+0000 7f07fd242640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f07f80d2010 0x7f07f806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.057+0000 7f07fd242640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07f80ce640 con 0x7f07f80718d0 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.057+0000 7f07fd242640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f07f80cef30 con 0x7f07f80b2db0 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.057+0000 7f07fd242640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f07f80b31c0 con 0x7f07f80d2010 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f80b2db0 0x7f07f8160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f80b2db0 0x7f07f8160090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57038/0 (socket says 172.21.15.80:57038) 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 -- 172.21.15.80:0/2782899920 learned_addr learned my addr 172.21.15.80:0/2782899920 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 -- 172.21.15.80:0/2782899920 >> v2:172.21.15.195:3300/0 conn(0x7f07f80d2010 msgr2=0x7f07f806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f659c640 1 --2- 172.21.15.80:0/2782899920 >> v2:172.21.15.195:3300/0 conn(0x7f07f80d2010 0x7f07f806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 --2- 172.21.15.80:0/2782899920 >> v2:172.21.15.195:3300/0 conn(0x7f07f80d2010 0x7f07f806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 -- 172.21.15.80:0/2782899920 >> v1:172.21.15.195:6789/0 conn(0x7f07f80718d0 legacy=0x7f07f8071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:55.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 -- 172.21.15.80:0/2782899920 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f80d2840 con 0x7f07f80b2db0 2024-04-25T15:42:55.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f659c640 1 --2- 172.21.15.80:0/2782899920 >> v2:172.21.15.195:3300/0 conn(0x7f07f80d2010 0x7f07f806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:42:55.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.058+0000 7f07f6d9d640 1 --2- 172.21.15.80:0/2782899920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80b2db0 0x7f07f8160090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07f806a000 tx=0x7f07e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16950724c9bda0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:55.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07f5d9b640 1 -- 172.21.15.80:0/2782899920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8037070 con 0x7f07f80b2db0 2024-04-25T15:42:55.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07f5d9b640 1 -- 172.21.15.80:0/2782899920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e8032440 con 0x7f07f80b2db0 2024-04-25T15:42:55.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07f5d9b640 1 -- 172.21.15.80:0/2782899920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8032810 con 0x7f07f80b2db0 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 -- 172.21.15.80:0/2782899920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80b2db0 msgr2=0x7f07f8160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 --2- 172.21.15.80:0/2782899920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80b2db0 0x7f07f8160090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07f806a000 tx=0x7f07e802a180 comp rx=0 tx=0).stop 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 -- 172.21.15.80:0/2782899920 shutdown_connections 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 --2- 172.21.15.80:0/2782899920 >> v2:172.21.15.195:3300/0 conn(0x7f07f80d2010 0x7f07f806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 --2- 172.21.15.80:0/2782899920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80b2db0 0x7f07f8160090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 -- 172.21.15.80:0/2782899920 >> 172.21.15.80:0/2782899920 conn(0x7f07f80d3a30 msgr2=0x7f07f80d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 -- 172.21.15.80:0/2782899920 shutdown_connections 2024-04-25T15:42:55.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.059+0000 7f07fd242640 1 -- 172.21.15.80:0/2782899920 wait complete. 2024-04-25T15:42:55.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.061+0000 7f07fd242640 1 Processor -- start 2024-04-25T15:42:55.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.061+0000 7f07fd242640 1 -- start start 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07f80718d0 0x7f07f81f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07f80b2db0 0x7f07f80b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 0x7f07f80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f07f80cebc0 con 0x7f07f80d2010 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f07f81605d0 con 0x7f07f80718d0 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f07f80d2420 con 0x7f07f80b2db0 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 0x7f07f80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f6d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07f80718d0 0x7f07f81f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 0x7f07f80b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57048/0 (socket says 172.21.15.80:57048) 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f659c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07f80b2db0 0x7f07f80b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 -- 172.21.15.80:0/3528937582 learned_addr learned my addr 172.21.15.80:0/3528937582 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 -- 172.21.15.80:0/3528937582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07f80b2db0 msgr2=0x7f07f80b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07f80b2db0 0x7f07f80b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 -- 172.21.15.80:0/3528937582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07f80718d0 msgr2=0x7f07f81f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07f80718d0 0x7f07f81f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 -- 172.21.15.80:0/3528937582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f80b1b00 con 0x7f07f80d2010 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07f759e640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 0x7f07f80b0150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f000b9e0 tx=0x7f07f000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0003b70 con 0x7f07f80d2010 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f0003d10 con 0x7f07f80d2010 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f80af0b0 con 0x7f07f80d2010 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f000cb60 con 0x7f07f80d2010 2024-04-25T15:42:55.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.063+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f80af670 con 0x7f07f80d2010 2024-04-25T15:42:55.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.064+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f806a100 con 0x7f07f80d2010 2024-04-25T15:42:55.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.065+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f07f000cd00 con 0x7f07f80d2010 2024-04-25T15:42:55.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.065+0000 7f07df7fe640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07e40744e0 0x7f07e40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.065+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f07f0094b90 con 0x7f07f80d2010 2024-04-25T15:42:55.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.065+0000 7f07f6d9d640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07e40744e0 0x7f07e40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.066+0000 7f07f6d9d640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07e40744e0 0x7f07e40769f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07e8034000 tx=0x7f07e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:55.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.070+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f07f005f140 con 0x7f07f80d2010 2024-04-25T15:42:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.245+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f07f806e950 con 0x7f07f80d2010 2024-04-25T15:42:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.245+0000 7f07df7fe640 1 -- 172.21.15.80:0/3528937582 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f07f0063440 con 0x7f07f80d2010 2024-04-25T15:42:55.245 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07e40744e0 msgr2=0x7f07e40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07e40744e0 0x7f07e40769f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07e8034000 tx=0x7f07e802e000 comp rx=0 tx=0).stop 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 msgr2=0x7f07f80b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 0x7f07f80b0150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f000b9e0 tx=0x7f07f000bea0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 shutdown_connections 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07e40744e0 0x7f07e40769f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f80d2010 0x7f07f80b0150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07f80b2db0 0x7f07f80b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 --2- 172.21.15.80:0/3528937582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07f80718d0 0x7f07f81f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.247+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 >> 172.21.15.80:0/3528937582 conn(0x7f07f80d3a30 msgr2=0x7f07f81625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.248+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 shutdown_connections 2024-04-25T15:42:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.248+0000 7f07fd242640 1 -- 172.21.15.80:0/3528937582 wait complete. 2024-04-25T15:42:55.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:42:55.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.365+0000 7fce9a2af640 1 Processor -- start 2024-04-25T15:42:55.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.366+0000 7fce9a2af640 1 -- start start 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce9a2af640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 0x7fce940d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce9a2af640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fce940d2480 0x7fce940d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce9a2af640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940b2f30 con 0x7fce940b4b60 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce9a2af640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fce9406eb60 con 0x7fce940d2480 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce9a2af640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce940b2c90 con 0x7fce940b91c0 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce93fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fce940b4b60 0x7fce9406d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52674/0 (socket says 172.21.15.80:52674) 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce93fff640 1 -- 172.21.15.80:0/902740870 learned_addr learned my addr 172.21.15.80:0/902740870 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce9884c640 1 --2- 172.21.15.80:0/902740870 >> v2:172.21.15.195:3300/0 conn(0x7fce940d2480 0x7fce940d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce937fe640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 0x7fce940d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455197110 0 0) 0x7fce940b2f30 con 0x7fce940b4b60 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce7c003520 con 0x7fce940b4b60 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2535588115 0 0) 0x7fce7c003520 con 0x7fce940b4b60 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 msgr2=0x7fce940d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 0x7fce940d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 >> v2:172.21.15.195:3300/0 conn(0x7fce940d2480 msgr2=0x7fce940d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 --2- 172.21.15.80:0/902740870 >> v2:172.21.15.195:3300/0 conn(0x7fce940d2480 0x7fce940d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.367+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940d10a0 con 0x7fce940b4b60 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fce840017f0 con 0x7fce940b4b60 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 >> v1:172.21.15.80:6789/0 conn(0x7fce940b4b60 legacy=0x7fce9406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce7c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce7c004800 0x7fce7c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 0x7fce7c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fce9406eb60 con 0x7fce7c0039b0 2024-04-25T15:42:55.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fce940b2c90 con 0x7fce7c004800 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c00baa0 con 0x7fce940b91c0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce93fff640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce7c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce937fe640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce7c004800 0x7fce7c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce9884c640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 0x7fce7c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce93fff640 1 -- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 msgr2=0x7fce7c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce93fff640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce940b91c0 0x7fce7c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce93fff640 1 -- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce7c004800 msgr2=0x7fce7c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce93fff640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce7c004800 0x7fce7c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.368+0000 7fce93fff640 1 -- 172.21.15.80:0/902740870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c003520 con 0x7fce7c0039b0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce93fff640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce7c003e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c260 tx=0x7fce7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bd599ef99b9e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84007cf0 con 0x7fce7c0039b0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84007270 con 0x7fce7c0039b0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce92ffd640 1 -- 172.21.15.80:0/902740870 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840057a0 con 0x7fce7c0039b0 2024-04-25T15:42:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce9a2af640 1 -- 172.21.15.80:0/902740870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 msgr2=0x7fce7c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce9a2af640 1 --2- 172.21.15.80:0/902740870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce7c003e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c260 tx=0x7fce7c005830 comp rx=0 tx=0).stop 2024-04-25T15:42:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce9884c640 1 -- 172.21.15.80:0/902740870 reap_dead start 2024-04-25T15:42:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce9a2af640 1 -- 172.21.15.80:0/902740870 shutdown_connections 2024-04-25T15:42:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.369+0000 7fce9a2af640 1 -- 172.21.15.80:0/902740870 >> 172.21.15.80:0/902740870 conn(0x7fce940d0450 msgr2=0x7fce940d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.370+0000 7fce9a2af640 1 -- 172.21.15.80:0/902740870 shutdown_connections 2024-04-25T15:42:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.370+0000 7fce9a2af640 1 -- 172.21.15.80:0/902740870 wait complete. 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.371+0000 7fce9a2af640 1 Processor -- start 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.371+0000 7fce9a2af640 1 -- start start 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce941dbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce941f9ed0 0x7fce9409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9409ed20 0x7fce940b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fce9409d0e0 con 0x7fce7c0039b0 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fce9409cbe0 con 0x7fce9409ed20 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce9409d260 con 0x7fce941f9ed0 2024-04-25T15:42:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce941dbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce941dbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57060/0 (socket says 172.21.15.80:57060) 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 -- 172.21.15.80:0/240744551 learned_addr learned my addr 172.21.15.80:0/240744551 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9884c640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9409ed20 0x7fce940b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce937fe640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce941f9ed0 0x7fce9409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 -- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce941f9ed0 msgr2=0x7fce9409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce941f9ed0 0x7fce9409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 -- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9409ed20 msgr2=0x7fce940b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9409ed20 0x7fce940b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 -- 172.21.15.80:0/240744551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9409f460 con 0x7fce7c0039b0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce937fe640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce941f9ed0 0x7fce9409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce93fff640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce941dbb20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce84034040 tx=0x7fce84001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84042070 con 0x7fce7c0039b0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84000f70 con 0x7fce7c0039b0 2024-04-25T15:42:55.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8403e450 con 0x7fce7c0039b0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.373+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce941f93f0 con 0x7fce7c0039b0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.374+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce941f99b0 con 0x7fce7c0039b0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.374+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9406a100 con 0x7fce7c0039b0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.375+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fce84045070 con 0x7fce7c0039b0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.375+0000 7fce90ff9640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce800744e0 0x7fce800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.376+0000 7fce937fe640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce800744e0 0x7fce800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.376+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fce840b5ba0 con 0x7fce7c0039b0 2024-04-25T15:42:55.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.376+0000 7fce937fe640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce800744e0 0x7fce800769f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce940c72d0 tx=0x7fce88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:55.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.380+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce84080030 con 0x7fce7c0039b0 2024-04-25T15:42:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.592+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce940731e0 con 0x7fce7c0039b0 2024-04-25T15:42:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.592+0000 7fce90ff9640 1 -- 172.21.15.80:0/240744551 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fce84084330 con 0x7fce7c0039b0 2024-04-25T15:42:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:55.592 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T15:42:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 2 2024-04-25T15:42:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce800744e0 msgr2=0x7fce800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce800744e0 0x7fce800769f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce940c72d0 tx=0x7fce88008040 comp rx=0 tx=0).stop 2024-04-25T15:42:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 msgr2=0x7fce941dbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce941dbb20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce84034040 tx=0x7fce84001ab0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 shutdown_connections 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce800744e0 0x7fce800769f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9409ed20 0x7fce940b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce941f9ed0 0x7fce9409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 --2- 172.21.15.80:0/240744551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce7c0039b0 0x7fce941dbb20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 >> 172.21.15.80:0/240744551 conn(0x7fce940d0450 msgr2=0x7fce940d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 shutdown_connections 2024-04-25T15:42:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:55.594+0000 7fce9a2af640 1 -- 172.21.15.80:0/240744551 wait complete. 2024-04-25T15:42:57.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:42:57.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.724+0000 7f372176b640 1 Processor -- start 2024-04-25T15:42:57.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.724+0000 7f372176b640 1 -- start start 2024-04-25T15:42:57.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f372176b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f371c0d41b0 0x7f371c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:57.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f372176b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c163fb0 con 0x7f371c1602a0 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f372176b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c164270 con 0x7f371c0b7d60 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f372176b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f371c164550 con 0x7f371c0d41b0 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f371a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f371c1602a0 0x7f371c0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52680/0 (socket says 172.21.15.80:52680) 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f371affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f371c0d41b0 0x7f371c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f371a7fc640 1 -- 172.21.15.80:0/465828493 learned_addr learned my addr 172.21.15.80:0/465828493 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f371affd640 1 -- 172.21.15.80:0/465828493 >> v1:172.21.15.195:6789/0 conn(0x7f371c0b7d60 legacy=0x7f371c0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f371affd640 1 -- 172.21.15.80:0/465828493 >> v1:172.21.15.80:6789/0 conn(0x7f371c1602a0 legacy=0x7f371c0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f371affd640 1 -- 172.21.15.80:0/465828493 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c164830 con 0x7f371c0d41b0 2024-04-25T15:42:57.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.726+0000 7f3719ffb640 1 -- 172.21.15.80:0/465828493 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409642314 0 0) 0x7f371c163fb0 con 0x7f371c1602a0 2024-04-25T15:42:57.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.727+0000 7f371affd640 1 --2- 172.21.15.80:0/465828493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0d41b0 0x7f371c0b48d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f370c009d90 tx=0x7f370c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf1f42739e44b67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:57.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.727+0000 7f3719ffb640 1 -- 172.21.15.80:0/465828493 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c007740 con 0x7f371c0d41b0 2024-04-25T15:42:57.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.727+0000 7f3719ffb640 1 -- 172.21.15.80:0/465828493 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c0078e0 con 0x7f371c0d41b0 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.727+0000 7f3719ffb640 1 -- 172.21.15.80:0/465828493 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c007cb0 con 0x7f371c0d41b0 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 -- 172.21.15.80:0/465828493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0d41b0 msgr2=0x7f371c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 --2- 172.21.15.80:0/465828493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0d41b0 0x7f371c0b48d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f370c009d90 tx=0x7f370c02a660 comp rx=0 tx=0).stop 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 -- 172.21.15.80:0/465828493 shutdown_connections 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 --2- 172.21.15.80:0/465828493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0d41b0 0x7f371c0b48d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 -- 172.21.15.80:0/465828493 >> 172.21.15.80:0/465828493 conn(0x7f371c06e9f0 msgr2=0x7f371c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 -- 172.21.15.80:0/465828493 shutdown_connections 2024-04-25T15:42:57.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.728+0000 7f372176b640 1 -- 172.21.15.80:0/465828493 wait complete. 2024-04-25T15:42:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.730+0000 7f372176b640 1 Processor -- start 2024-04-25T15:42:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.730+0000 7f372176b640 1 -- start start 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f372176b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f371c0d41b0 0x7f371c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f372176b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f371c1602a0 0x7f371c162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f372176b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 0x7f371c0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f372176b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f371c0b5150 con 0x7f371c0cfaa0 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f372176b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f371c0b4fd0 con 0x7f371c0d41b0 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f372176b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f371c0b9220 con 0x7f371c1602a0 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f371b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 0x7f371c0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f371b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 0x7f371c0cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57074/0 (socket says 172.21.15.80:57074) 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f371b7fe640 1 -- 172.21.15.80:0/1590091140 learned_addr learned my addr 172.21.15.80:0/1590091140 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f371affd640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f371c0d41b0 0x7f371c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.731+0000 7f371a7fc640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f371c1602a0 0x7f371c162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f371b7fe640 1 -- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f371c1602a0 msgr2=0x7f371c162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f371b7fe640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f371c1602a0 0x7f371c162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f371b7fe640 1 -- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f371c0d41b0 msgr2=0x7f371c0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f371b7fe640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f371c0d41b0 0x7f371c0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f371b7fe640 1 -- 172.21.15.80:0/1590091140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c0ce2c0 con 0x7f371c0cfaa0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f371b7fe640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 0x7f371c0cfeb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f371400c3f0 tx=0x7f371400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714017070 con 0x7f371c0cfaa0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37140052d0 con 0x7f371c0cfaa0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714003830 con 0x7f371c0cfaa0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c0ce5a0 con 0x7f371c0cfaa0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.732+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c0ceb60 con 0x7f371c0cfaa0 2024-04-25T15:42:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.733+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c06a100 con 0x7f371c0cfaa0 2024-04-25T15:42:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.734+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f371401a070 con 0x7f371c0cfaa0 2024-04-25T15:42:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.734+0000 7f37037fe640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37080744e0 0x7f37080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.734+0000 7f371affd640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37080744e0 0x7f37080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.734+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f37140941b0 con 0x7f371c0cfaa0 2024-04-25T15:42:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.735+0000 7f371affd640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37080744e0 0x7f37080769f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f370c034000 tx=0x7f370c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.739+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f371405ed50 con 0x7f371c0cfaa0 2024-04-25T15:42:57.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.953+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f371c0ce050 con 0x7f371c0cfaa0 2024-04-25T15:42:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.954+0000 7f37037fe640 1 -- 172.21.15.80:0/1590091140 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f371405e650 con 0x7f371c0cfaa0 2024-04-25T15:42:57.954 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:57.954 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T15:42:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37080744e0 msgr2=0x7f37080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37080744e0 0x7f37080769f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f370c034000 tx=0x7f370c02f000 comp rx=0 tx=0).stop 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 msgr2=0x7f371c0cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 0x7f371c0cfeb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f371400c3f0 tx=0x7f371400c7f0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 shutdown_connections 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37080744e0 0x7f37080769f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c0cfaa0 0x7f371c0cfeb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f371c1602a0 0x7f371c162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 --2- 172.21.15.80:0/1590091140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f371c0d41b0 0x7f371c0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:57.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 >> 172.21.15.80:0/1590091140 conn(0x7f371c06e9f0 msgr2=0x7f371c0cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:57.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 shutdown_connections 2024-04-25T15:42:57.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:57.956+0000 7f372176b640 1 -- 172.21.15.80:0/1590091140 wait complete. 2024-04-25T15:42:57.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:42:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.073+0000 7f497b220640 1 Processor -- start 2024-04-25T15:42:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.073+0000 7f497b220640 1 -- start start 2024-04-25T15:42:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f497b220640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 0x7f49740b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f497b220640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f49740b3ac0 0x7f49740b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f497b220640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49740d1010 con 0x7f497406da90 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f497b220640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f497409cdf0 con 0x7f49740b3ac0 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f497b220640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f497409d0d0 con 0x7f49740d34a0 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f4973fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f497406da90 0x7f497406e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52686/0 (socket says 172.21.15.80:52686) 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f4973fff640 1 -- 172.21.15.80:0/1462676709 learned_addr learned my addr 172.21.15.80:0/1462676709 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f4978fbc640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 0x7f49740b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49797bd640 1 --2- 172.21.15.80:0/1462676709 >> v2:172.21.15.195:3300/0 conn(0x7f49740b3ac0 0x7f49740b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701868408 0 0) 0x7f49740d1010 con 0x7f497406da90 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f495c003520 con 0x7f497406da90 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 850131052 0 0) 0x7f495c003520 con 0x7f497406da90 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 msgr2=0x7f49740b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 0x7f49740b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 >> v2:172.21.15.195:3300/0 conn(0x7f49740b3ac0 msgr2=0x7f49740b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 --2- 172.21.15.80:0/1462676709 >> v2:172.21.15.195:3300/0 conn(0x7f49740b3ac0 0x7f49740b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497406ec70 con 0x7f497406da90 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f4968001670 con 0x7f497406da90 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 >> v1:172.21.15.80:6789/0 conn(0x7f497406da90 legacy=0x7f497406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 0x7f495c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f495c003f30 0x7f495c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f495c004d40 0x7f495c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f497409cdf0 con 0x7f495c004d40 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f497409d0d0 con 0x7f495c003f30 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.075+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f495c00ba10 con 0x7f49740d34a0 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f49797bd640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f495c004d40 0x7f495c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f4978fbc640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 0x7f495c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f4973fff640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f495c003f30 0x7f495c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f49797bd640 1 -- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 msgr2=0x7f495c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f49797bd640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49740d34a0 0x7f495c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f49797bd640 1 -- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f495c003f30 msgr2=0x7f495c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f49797bd640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f495c003f30 0x7f495c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.076+0000 7f49797bd640 1 -- 172.21.15.80:0/1462676709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c003520 con 0x7f495c004d40 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f49797bd640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f495c004d40 0x7f495c005150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f496c009f90 tx=0x7f495c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbba2c9f28e315b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c009c10 con 0x7f495c004d40 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c036070 con 0x7f495c004d40 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f49737fe640 1 -- 172.21.15.80:0/1462676709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c031880 con 0x7f495c004d40 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f497b220640 1 -- 172.21.15.80:0/1462676709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f495c004d40 msgr2=0x7f495c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f497b220640 1 --2- 172.21.15.80:0/1462676709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f495c004d40 0x7f495c005150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f496c009f90 tx=0x7f495c005830 comp rx=0 tx=0).stop 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f49797bd640 1 -- 172.21.15.80:0/1462676709 reap_dead start 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f497b220640 1 -- 172.21.15.80:0/1462676709 shutdown_connections 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f497b220640 1 -- 172.21.15.80:0/1462676709 >> 172.21.15.80:0/1462676709 conn(0x7f49740d0450 msgr2=0x7f49740d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f497b220640 1 -- 172.21.15.80:0/1462676709 shutdown_connections 2024-04-25T15:42:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.077+0000 7f497b220640 1 -- 172.21.15.80:0/1462676709 wait complete. 2024-04-25T15:42:58.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.079+0000 7f497b220640 1 Processor -- start 2024-04-25T15:42:58.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.079+0000 7f497b220640 1 -- start start 2024-04-25T15:42:58.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f495c004d40 0x7f497415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f497414c0a0 0x7f49740b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 0x7f497414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f49740b91b0 con 0x7f497414bac0 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f497406d7b0 con 0x7f497414c0a0 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f49740b9330 con 0x7f495c004d40 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 0x7f497414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 0x7f497414d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57100/0 (socket says 172.21.15.80:57100) 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 -- 172.21.15.80:0/3659956158 learned_addr learned my addr 172.21.15.80:0/3659956158 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f4978fbc640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f495c004d40 0x7f497415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f4973fff640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f497414c0a0 0x7f49740b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 -- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f495c004d40 msgr2=0x7f497415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f495c004d40 0x7f497415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 -- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f497414c0a0 msgr2=0x7f49740b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f497414c0a0 0x7f49740b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 -- 172.21.15.80:0/3659956158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49740b15d0 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f4973fff640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f497414c0a0 0x7f49740b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49797bd640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 0x7f497414d6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f496c009f90 tx=0x7f496c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c009c10 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c031dd0 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497414c640 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c003bd0 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.081+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497414cc00 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.082+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497406a100 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.083+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f496c005d10 con 0x7f497414bac0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.083+0000 7f49717fa640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49600744e0 0x7f49600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.084+0000 7f4978fbc640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49600744e0 0x7f49600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.084+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f496c0b6770 con 0x7f497414bac0 2024-04-25T15:42:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.084+0000 7f4978fbc640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49600744e0 0x7f49600769f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4964009af0 tx=0x7f4964008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.088+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f496c04a060 con 0x7f497414bac0 2024-04-25T15:42:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.264+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49740b52a0 con 0x7f497414bac0 2024-04-25T15:42:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.265+0000 7f49717fa640 1 -- 172.21.15.80:0/3659956158 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f496c081250 con 0x7f497414bac0 2024-04-25T15:42:58.265 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:58.265 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:42:51.223030+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49600744e0 msgr2=0x7f49600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49600744e0 0x7f49600769f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4964009af0 tx=0x7f4964008040 comp rx=0 tx=0).stop 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 msgr2=0x7f497414d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 0x7f497414d6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f496c009f90 tx=0x7f496c009750 comp rx=0 tx=0).stop 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 shutdown_connections 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49600744e0 0x7f49600769f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497414bac0 0x7f497414d6e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f497414c0a0 0x7f49740b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 --2- 172.21.15.80:0/3659956158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f495c004d40 0x7f497415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 >> 172.21.15.80:0/3659956158 conn(0x7f49740d0450 msgr2=0x7f49740d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 shutdown_connections 2024-04-25T15:42:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.267+0000 7f497b220640 1 -- 172.21.15.80:0/3659956158 wait complete. 2024-04-25T15:42:58.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:42:58.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:42:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.389+0000 7fdfb7a92640 1 Processor -- start 2024-04-25T15:42:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.389+0000 7fdfb7a92640 1 -- start start 2024-04-25T15:42:58.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb7a92640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdfb00d26a0 0x7fdfb00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb7a92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb00b2b00 con 0x7fdfb006c5c0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb7a92640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb006cb80 con 0x7fdfb01618b0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb7a92640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb006ce60 con 0x7fdfb00d26a0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb602f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdfb006c5c0 0x7fdfb00cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52698/0 (socket says 172.21.15.80:52698) 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb602f640 1 -- 172.21.15.80:0/507081707 learned_addr learned my addr 172.21.15.80:0/507081707 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb502d640 1 --2- 172.21.15.80:0/507081707 >> v2:172.21.15.195:3300/0 conn(0x7fdfb00d26a0 0x7fdfb00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174777557 0 0) 0x7fdfa8001490 con 0x7fdfb006c5c0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf9c003520 con 0x7fdfb006c5c0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1329641140 0 0) 0x7fdf9c003520 con 0x7fdfb006c5c0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 >> v2:172.21.15.195:3300/0 conn(0x7fdfb00d26a0 msgr2=0x7fdfb00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 --2- 172.21.15.80:0/507081707 >> v2:172.21.15.195:3300/0 conn(0x7fdfb00d26a0 0x7fdfb00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 >> v1:172.21.15.195:6789/0 conn(0x7fdfb01618b0 legacy=0x7fdfb00d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb00b2d80 con 0x7fdfb006c5c0 2024-04-25T15:42:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fdfa8001bc0 con 0x7fdfb006c5c0 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 >> v1:172.21.15.80:6789/0 conn(0x7fdfb006c5c0 legacy=0x7fdfb00cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c0039b0 0x7fdf9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.391+0000 7fdfb482c640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf9c004800 0x7fdf9c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb482c640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf9c005150 0x7fdf9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb006ce60 con 0x7fdf9c005150 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c00c0c0 con 0x7fdf9c0039b0 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9c00c2c0 con 0x7fdf9c004800 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb602f640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf9c005150 0x7fdf9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb582e640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c0039b0 0x7fdf9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb502d640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf9c004800 0x7fdf9c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb602f640 1 -- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf9c004800 msgr2=0x7fdf9c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb602f640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf9c004800 0x7fdf9c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb602f640 1 -- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c0039b0 msgr2=0x7fdf9c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb602f640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c0039b0 0x7fdf9c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.392+0000 7fdfb602f640 1 -- 172.21.15.80:0/507081707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c003520 con 0x7fdf9c005150 2024-04-25T15:42:58.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb602f640 1 -- 172.21.15.80:0/507081707 reap_dead start 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb602f640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf9c005150 0x7fdf9c00b9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800aa40 tx=0x7fdf9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaca6cfff44e44f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800a690 con 0x7fdf9c005150 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa802f070 con 0x7fdf9c005150 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb482c640 1 -- 172.21.15.80:0/507081707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8034470 con 0x7fdf9c005150 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb7a92640 1 -- 172.21.15.80:0/507081707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf9c005150 msgr2=0x7fdf9c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf9c005150 0x7fdf9c00b9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800aa40 tx=0x7fdf9c005830 comp rx=0 tx=0).stop 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb7a92640 1 -- 172.21.15.80:0/507081707 shutdown_connections 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/507081707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf9c005150 0x7fdf9c00b9c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.393+0000 7fdfb7a92640 1 -- 172.21.15.80:0/507081707 >> 172.21.15.80:0/507081707 conn(0x7fdfb009b410 msgr2=0x7fdfb00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.394+0000 7fdfb7a92640 1 -- 172.21.15.80:0/507081707 shutdown_connections 2024-04-25T15:42:58.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.394+0000 7fdfb7a92640 1 -- 172.21.15.80:0/507081707 wait complete. 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.395+0000 7fdfb7a92640 1 Processor -- start 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.395+0000 7fdfb7a92640 1 -- start start 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c005150 0x7fdfb015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfb01f5bc0 0x7fdfb00d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 0x7fdfb00d1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb01618b0 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0076270 con 0x7fdf9c005150 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb0161a30 con 0x7fdfb01f5bc0 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 0x7fdfb00d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 0x7fdfb00d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57116/0 (socket says 172.21.15.80:57116) 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 -- 172.21.15.80:0/2113196088 learned_addr learned my addr 172.21.15.80:0/2113196088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb502d640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfb01f5bc0 0x7fdfb00d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb582e640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c005150 0x7fdfb015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 -- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfb01f5bc0 msgr2=0x7fdfb00d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfb01f5bc0 0x7fdfb00d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 -- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c005150 msgr2=0x7fdfb015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c005150 0x7fdfb015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 -- 172.21.15.80:0/2113196088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb01f66b0 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb602f640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 0x7fdfb00d1810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8000f80 tx=0x7fdfa8001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800a690 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8001bb0 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb01f6990 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80346b0 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.397+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb00ca580 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.398+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb006a100 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.399+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdfa8034850 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.399+0000 7fdfa67fc640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf940744b0 0x7fdf940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.399+0000 7fdfb582e640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf940744b0 0x7fdf940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.399+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdfa80b4ca0 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.400+0000 7fdfb582e640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf940744b0 0x7fdf940769c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0072c10 tx=0x7fdfac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.404+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfb00b2b00 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.578+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdfb01f6b60 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.579+0000 7fdfa67fc640 1 -- 172.21.15.80:0/2113196088 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fdfa807f810 con 0x7fdfb01f5fd0 2024-04-25T15:42:58.579 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf940744b0 msgr2=0x7fdf940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf940744b0 0x7fdf940769c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0072c10 tx=0x7fdfac009040 comp rx=0 tx=0).stop 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 msgr2=0x7fdfb00d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 0x7fdfb00d1810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8000f80 tx=0x7fdfa8001f90 comp rx=0 tx=0).stop 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 shutdown_connections 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf940744b0 0x7fdf940769c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfb01f5fd0 0x7fdfb00d1810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfb01f5bc0 0x7fdfb00d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 --2- 172.21.15.80:0/2113196088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf9c005150 0x7fdfb015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 >> 172.21.15.80:0/2113196088 conn(0x7fdfb009b410 msgr2=0x7fdfb00aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:58.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 shutdown_connections 2024-04-25T15:42:58.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.581+0000 7fdfb7a92640 1 -- 172.21.15.80:0/2113196088 wait complete. 2024-04-25T15:42:58.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:42:58.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.698+0000 7f924a8e0640 1 Processor -- start 2024-04-25T15:42:58.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.698+0000 7f924a8e0640 1 -- start start 2024-04-25T15:42:58.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f924a8e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b7d60 0x7f924416b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f924a8e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92440d59d0 con 0x7f92440d41b0 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f924a8e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9244163fb0 con 0x7f92440b48d0 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f924a8e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9244164270 con 0x7f92440b7d60 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9243fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f92440d41b0 0x7f92441602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52700/0 (socket says 172.21.15.80:52700) 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9243fff640 1 -- 172.21.15.80:0/261543780 learned_addr learned my addr 172.21.15.80:0/261543780 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9248e7d640 1 --2- 172.21.15.80:0/261543780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b7d60 0x7f924416b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9242ffd640 1 -- 172.21.15.80:0/261543780 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3205693617 0 0) 0x7f92440d59d0 con 0x7f92440d41b0 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9242ffd640 1 -- 172.21.15.80:0/261543780 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922c003520 con 0x7f92440d41b0 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9242ffd640 1 -- 172.21.15.80:0/261543780 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785064907 0 0) 0x7f9244163fb0 con 0x7f92440b48d0 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9248e7d640 1 -- 172.21.15.80:0/261543780 >> v1:172.21.15.195:6789/0 conn(0x7f92440b48d0 legacy=0x7f92440b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9248e7d640 1 -- 172.21.15.80:0/261543780 >> v1:172.21.15.80:6789/0 conn(0x7f92440d41b0 legacy=0x7f92441602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.700+0000 7f9248e7d640 1 -- 172.21.15.80:0/261543780 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9244164550 con 0x7f92440b7d60 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.701+0000 7f9248e7d640 1 --2- 172.21.15.80:0/261543780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b7d60 0x7f924416b2e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f923c009dc0 tx=0x7f923c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c52a47e3a120fd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.701+0000 7f9242ffd640 1 -- 172.21.15.80:0/261543780 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c035020 con 0x7f92440b7d60 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.701+0000 7f9242ffd640 1 -- 172.21.15.80:0/261543780 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c007540 con 0x7f92440b7d60 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.701+0000 7f9242ffd640 1 -- 172.21.15.80:0/261543780 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234001670 con 0x7f92440b7d60 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 -- 172.21.15.80:0/261543780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b7d60 msgr2=0x7f924416b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 --2- 172.21.15.80:0/261543780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b7d60 0x7f924416b2e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f923c009dc0 tx=0x7f923c02a640 comp rx=0 tx=0).stop 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 -- 172.21.15.80:0/261543780 shutdown_connections 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 --2- 172.21.15.80:0/261543780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b7d60 0x7f924416b2e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 -- 172.21.15.80:0/261543780 >> 172.21.15.80:0/261543780 conn(0x7f924406e9f0 msgr2=0x7f92440d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 -- 172.21.15.80:0/261543780 shutdown_connections 2024-04-25T15:42:58.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.702+0000 7f924a8e0640 1 -- 172.21.15.80:0/261543780 wait complete. 2024-04-25T15:42:58.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.704+0000 7f924a8e0640 1 Processor -- start 2024-04-25T15:42:58.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.704+0000 7f924a8e0640 1 -- start start 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f924a8e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b48d0 0x7f92440cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f924a8e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 0x7f9244157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f924a8e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9244160a40 0x7f92441622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f924a8e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92440b4fd0 con 0x7f92440d41b0 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f924a8e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9244164b10 con 0x7f9244160a40 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f924a8e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f92440b5150 con 0x7f92440b48d0 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f92437fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 0x7f9244157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f92437fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 0x7f9244157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57130/0 (socket says 172.21.15.80:57130) 2024-04-25T15:42:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.705+0000 7f92437fe640 1 -- 172.21.15.80:0/3385577509 learned_addr learned my addr 172.21.15.80:0/3385577509 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9243fff640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b48d0 0x7f92440cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9248e7d640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9244160a40 0x7f92441622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f92437fe640 1 -- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b48d0 msgr2=0x7f92440cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f92437fe640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b48d0 0x7f92440cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f92437fe640 1 -- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9244160a40 msgr2=0x7f92441622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f92437fe640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9244160a40 0x7f92441622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f92437fe640 1 -- 172.21.15.80:0/3385577509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92441f5c70 con 0x7f92440d41b0 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9243fff640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b48d0 0x7f92440cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9248e7d640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9244160a40 0x7f92441622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f92437fe640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 0x7f9244157100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f923800c440 tx=0x7f923800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238017070 con 0x7f92440d41b0 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92380035f0 con 0x7f92440d41b0 2024-04-25T15:42:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9244161250 con 0x7f92440d41b0 2024-04-25T15:42:58.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92380039e0 con 0x7f92440d41b0 2024-04-25T15:42:58.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.706+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9244161810 con 0x7f92440d41b0 2024-04-25T15:42:58.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.707+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924406a100 con 0x7f92440d41b0 2024-04-25T15:42:58.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.708+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f923801a070 con 0x7f92440d41b0 2024-04-25T15:42:58.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.708+0000 7f9240ff9640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92300744b0 0x7f92300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:58.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.708+0000 7f9243fff640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92300744b0 0x7f92300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:58.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.708+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f92380941b0 con 0x7f92440d41b0 2024-04-25T15:42:58.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.708+0000 7f9243fff640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92300744b0 0x7f92300769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92340017e0 tx=0x7f9234009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:58.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.713+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f923805ec90 con 0x7f92440d41b0 2024-04-25T15:42:58.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.889+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9244160fe0 con 0x7f92440d41b0 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.890+0000 7f9240ff9640 1 -- 172.21.15.80:0/3385577509 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f923805e590 con 0x7f92440d41b0 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:42:58.890 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.891+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92300744b0 msgr2=0x7f92300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92300744b0 0x7f92300769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92340017e0 tx=0x7f9234009040 comp rx=0 tx=0).stop 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 msgr2=0x7f9244157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 0x7f9244157100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f923800c440 tx=0x7f923800c900 comp rx=0 tx=0).stop 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 shutdown_connections 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92300744b0 0x7f92300769c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9244160a40 0x7f92441622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92440d41b0 0x7f9244157100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 --2- 172.21.15.80:0/3385577509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92440b48d0 0x7f92440cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 >> 172.21.15.80:0/3385577509 conn(0x7f924406e9f0 msgr2=0x7f924415d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 shutdown_connections 2024-04-25T15:42:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:58.892+0000 7f924a8e0640 1 -- 172.21.15.80:0/3385577509 wait complete. 2024-04-25T15:42:58.902 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:42:58.903 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:42:59.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.013+0000 7fb45464a640 1 Processor -- start 2024-04-25T15:42:59.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.013+0000 7fb45464a640 1 -- start start 2024-04-25T15:42:59.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb45464a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb44c0d4a40 0x7fb44c0bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb45464a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44c160ce0 con 0x7fb44c0b7ff0 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb45464a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44c0d4fb0 con 0x7fb44c0b5240 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb45464a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb44c0d5290 con 0x7fb44c0d4a40 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb451be5640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb44c0b7ff0 0x7fb44c0b9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52704/0 (socket says 172.21.15.80:52704) 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb451be5640 1 -- 172.21.15.80:0/953978529 learned_addr learned my addr 172.21.15.80:0/953978529 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb452be7640 1 --2- 172.21.15.80:0/953978529 >> v2:172.21.15.195:3300/0 conn(0x7fb44c0d4a40 0x7fb44c0bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb4513e4640 1 -- 172.21.15.80:0/953978529 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758169316 0 0) 0x7fb44c160ce0 con 0x7fb44c0b7ff0 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.015+0000 7fb4513e4640 1 -- 172.21.15.80:0/953978529 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb438003520 con 0x7fb44c0b7ff0 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.016+0000 7fb452be7640 1 -- 172.21.15.80:0/953978529 >> v1:172.21.15.195:6789/0 conn(0x7fb44c0b5240 legacy=0x7fb44c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.016+0000 7fb452be7640 1 -- 172.21.15.80:0/953978529 >> v1:172.21.15.80:6789/0 conn(0x7fb44c0b7ff0 legacy=0x7fb44c0b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.016+0000 7fb4513e4640 1 -- 172.21.15.80:0/953978529 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3399354077 0 0) 0x7fb438003520 con 0x7fb44c0b7ff0 2024-04-25T15:42:59.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.016+0000 7fb452be7640 1 -- 172.21.15.80:0/953978529 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c0d5570 con 0x7fb44c0d4a40 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.016+0000 7fb452be7640 1 --2- 172.21.15.80:0/953978529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0bb4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb4440097a0 tx=0x7fb44402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c913f8d9d8209a1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.017+0000 7fb4513e4640 1 -- 172.21.15.80:0/953978529 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444037070 con 0x7fb44c0d4a40 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.017+0000 7fb4513e4640 1 -- 172.21.15.80:0/953978529 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44402ace0 con 0x7fb44c0d4a40 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.017+0000 7fb4513e4640 1 -- 172.21.15.80:0/953978529 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c001670 con 0x7fb44c0d4a40 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.017+0000 7fb45464a640 1 -- 172.21.15.80:0/953978529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 msgr2=0x7fb44c0bb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.017+0000 7fb45464a640 1 --2- 172.21.15.80:0/953978529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0bb4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb4440097a0 tx=0x7fb44402a250 comp rx=0 tx=0).stop 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.018+0000 7fb45464a640 1 -- 172.21.15.80:0/953978529 shutdown_connections 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.018+0000 7fb45464a640 1 --2- 172.21.15.80:0/953978529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0bb4a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.018+0000 7fb45464a640 1 -- 172.21.15.80:0/953978529 >> 172.21.15.80:0/953978529 conn(0x7fb44c0d28e0 msgr2=0x7fb44c0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.018+0000 7fb45464a640 1 -- 172.21.15.80:0/953978529 shutdown_connections 2024-04-25T15:42:59.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.018+0000 7fb45464a640 1 -- 172.21.15.80:0/953978529 wait complete. 2024-04-25T15:42:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.019+0000 7fb45464a640 1 Processor -- start 2024-04-25T15:42:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.019+0000 7fb45464a640 1 -- start start 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb44c0b5240 0x7fb44c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 0x7fb44c0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c0d18d0 con 0x7fb44c0b2af0 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c0d5b30 con 0x7fb44c0d4a40 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb44c0d1a50 con 0x7fb44c0b5240 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 0x7fb44c0b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 0x7fb44c0b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57144/0 (socket says 172.21.15.80:57144) 2024-04-25T15:42:59.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 -- 172.21.15.80:0/3088315598 learned_addr learned my addr 172.21.15.80:0/3088315598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb451be5640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb4523e6640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb44c0b5240 0x7fb44c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 -- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb44c0b5240 msgr2=0x7fb44c15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb44c0b5240 0x7fb44c15e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 -- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 msgr2=0x7fb44c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 -- 172.21.15.80:0/3088315598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c0b3440 con 0x7fb44c0b2af0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb4523e6640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb44c0b5240 0x7fb44c15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb452be7640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 0x7fb44c0b2f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4440097a0 tx=0x7fb4440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444037040 con 0x7fb44c0b2af0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb444004250 con 0x7fb44c0b2af0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444003610 con 0x7fb44c0b2af0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c0b0790 con 0x7fb44c0b2af0 2024-04-25T15:42:59.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.021+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c0b0d50 con 0x7fb44c0b2af0 2024-04-25T15:42:59.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.023+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44c0af060 con 0x7fb44c0b2af0 2024-04-25T15:42:59.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.023+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb4440037b0 con 0x7fb44c0b2af0 2024-04-25T15:42:59.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.023+0000 7fb442ffd640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4300744b0 0x7fb4300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.024+0000 7fb4523e6640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4300744b0 0x7fb4300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.024+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb4440b5d80 con 0x7fb44c0b2af0 2024-04-25T15:42:59.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.024+0000 7fb4523e6640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4300744b0 0x7fb4300769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4480012e0 tx=0x7fb448009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:59.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.028+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb44c0b3440 con 0x7fb44c0b2af0 2024-04-25T15:42:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.201+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb44c06a100 con 0x7fb44c0b2af0 2024-04-25T15:42:59.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.243+0000 7fb442ffd640 1 -- 172.21.15.80:0/3088315598 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fb444080900 con 0x7fb44c0b2af0 2024-04-25T15:42:59.244 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4300744b0 msgr2=0x7fb4300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4300744b0 0x7fb4300769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4480012e0 tx=0x7fb448009040 comp rx=0 tx=0).stop 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 msgr2=0x7fb44c0b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 0x7fb44c0b2f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4440097a0 tx=0x7fb4440046c0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 shutdown_connections 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4300744b0 0x7fb4300769c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb44c0b2af0 0x7fb44c0b2f00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb44c0d4a40 0x7fb44c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 --2- 172.21.15.80:0/3088315598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb44c0b5240 0x7fb44c15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 >> 172.21.15.80:0/3088315598 conn(0x7fb44c0d28e0 msgr2=0x7fb44c160320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 shutdown_connections 2024-04-25T15:42:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.245+0000 7fb45464a640 1 -- 172.21.15.80:0/3088315598 wait complete. 2024-04-25T15:42:59.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T15:42:59.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.374+0000 7ffa4ad55640 1 Processor -- start 2024-04-25T15:42:59.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.374+0000 7ffa4ad55640 1 -- start start 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa4ad55640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa440d34a0 0x7ffa440b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa4ad55640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffa4406da90 0x7ffa4406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa4ad55640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa440d1010 con 0x7ffa4406eaa0 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa4ad55640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4409cdf0 con 0x7ffa440d34a0 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa4ad55640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4409d0d0 con 0x7ffa4406da90 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa440d34a0 0x7ffa440b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa440d34a0 0x7ffa440b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57160/0 (socket says 172.21.15.80:57160) 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 -- 172.21.15.80:0/2241467753 learned_addr learned my addr 172.21.15.80:0/2241467753 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa492f2640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffa4406eaa0 0x7ffa440b3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52716/0 (socket says 172.21.15.80:52716) 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 -- 172.21.15.80:0/2241467753 >> v2:172.21.15.195:3300/0 conn(0x7ffa4406da90 msgr2=0x7ffa4406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa43fff640 1 --2- 172.21.15.80:0/2241467753 >> v2:172.21.15.195:3300/0 conn(0x7ffa4406da90 0x7ffa4406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa437fe640 1 -- 172.21.15.80:0/2241467753 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456396637 0 0) 0x7ffa440d1010 con 0x7ffa4406eaa0 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 --2- 172.21.15.80:0/2241467753 >> v2:172.21.15.195:3300/0 conn(0x7ffa4406da90 0x7ffa4406e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 -- 172.21.15.80:0/2241467753 >> v1:172.21.15.80:6789/0 conn(0x7ffa4406eaa0 legacy=0x7ffa440b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.376+0000 7ffa48af1640 1 -- 172.21.15.80:0/2241467753 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa440d2f50 con 0x7ffa440d34a0 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.377+0000 7ffa48af1640 1 --2- 172.21.15.80:0/2241467753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa440d34a0 0x7ffa440b91b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa440691b0 tx=0x7ffa3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa3a9f4934b00fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.377+0000 7ffa437fe640 1 -- 172.21.15.80:0/2241467753 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004030 con 0x7ffa440d34a0 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.377+0000 7ffa437fe640 1 -- 172.21.15.80:0/2241467753 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa340041d0 con 0x7ffa440d34a0 2024-04-25T15:42:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.377+0000 7ffa437fe640 1 -- 172.21.15.80:0/2241467753 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34003610 con 0x7ffa440d34a0 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 -- 172.21.15.80:0/2241467753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa440d34a0 msgr2=0x7ffa440b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/2241467753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa440d34a0 0x7ffa440b91b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa440691b0 tx=0x7ffa3402a270 comp rx=0 tx=0).stop 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 -- 172.21.15.80:0/2241467753 shutdown_connections 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/2241467753 >> v2:172.21.15.195:3300/0 conn(0x7ffa4406da90 0x7ffa4406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/2241467753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa440d34a0 0x7ffa440b91b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 -- 172.21.15.80:0/2241467753 >> 172.21.15.80:0/2241467753 conn(0x7ffa440d0450 msgr2=0x7ffa440d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 -- 172.21.15.80:0/2241467753 shutdown_connections 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.378+0000 7ffa4ad55640 1 -- 172.21.15.80:0/2241467753 wait complete. 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.379+0000 7ffa4ad55640 1 Processor -- start 2024-04-25T15:42:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.379+0000 7ffa4ad55640 1 -- start start 2024-04-25T15:42:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa4ad55640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 0x7ffa44151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa4ad55640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa4406eaa0 0x7ffa441f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa4ad55640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa440d34a0 0x7ffa44161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa4ad55640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa440b41d0 con 0x7ffa4406da90 2024-04-25T15:42:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa4ad55640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4406d7b0 con 0x7ffa440d34a0 2024-04-25T15:42:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa4ad55640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffa440b4350 con 0x7ffa4406eaa0 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 0x7ffa44151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 0x7ffa44151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57168/0 (socket says 172.21.15.80:57168) 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 -- 172.21.15.80:0/775804945 learned_addr learned my addr 172.21.15.80:0/775804945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa43fff640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa4406eaa0 0x7ffa441f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa492f2640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa440d34a0 0x7ffa44161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 -- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa4406eaa0 msgr2=0x7ffa441f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa4406eaa0 0x7ffa441f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 -- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa440d34a0 msgr2=0x7ffa44161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa440d34a0 0x7ffa44161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 -- 172.21.15.80:0/775804945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa44152390 con 0x7ffa4406da90 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.381+0000 7ffa48af1640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 0x7ffa44151e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa34000c00 tx=0x7ffa340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.382+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34041020 con 0x7ffa4406da90 2024-04-25T15:42:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.382+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa34003c50 con 0x7ffa4406da90 2024-04-25T15:42:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.382+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa441f76d0 con 0x7ffa4406da90 2024-04-25T15:42:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.382+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004030 con 0x7ffa4406da90 2024-04-25T15:42:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.382+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4415c180 con 0x7ffa4406da90 2024-04-25T15:42:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.383+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa4406a100 con 0x7ffa4406da90 2024-04-25T15:42:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.383+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffa34044020 con 0x7ffa4406da90 2024-04-25T15:42:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.384+0000 7ffa417fa640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffa300744e0 0x7ffa300769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:42:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.384+0000 7ffa43fff640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffa300744e0 0x7ffa300769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:42:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.384+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7ffa340b5d10 con 0x7ffa4406da90 2024-04-25T15:42:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.384+0000 7ffa43fff640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffa300744e0 0x7ffa300769f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa38006fd0 tx=0x7ffa38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:42:59.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.389+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa3404b030 con 0x7ffa4406da90 2024-04-25T15:42:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:42:59.565+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ffa440b52a0 con 0x7ffa4406da90 2024-04-25T15:43:00.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.246+0000 7ffa417fa640 1 -- 172.21.15.80:0/775804945 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7ffa44152390 con 0x7ffa4406da90 2024-04-25T15:43:00.247 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.248+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffa300744e0 msgr2=0x7ffa300769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.248+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffa300744e0 0x7ffa300769f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa38006fd0 tx=0x7ffa38008040 comp rx=0 tx=0).stop 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.248+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 msgr2=0x7ffa44151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.248+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 0x7ffa44151e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa34000c00 tx=0x7ffa340046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 shutdown_connections 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffa300744e0 0x7ffa300769f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa440d34a0 0x7ffa44161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa4406eaa0 0x7ffa441f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 --2- 172.21.15.80:0/775804945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa4406da90 0x7ffa44151e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 >> 172.21.15.80:0/775804945 conn(0x7ffa440d0450 msgr2=0x7ffa440b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 shutdown_connections 2024-04-25T15:43:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.249+0000 7ffa4ad55640 1 -- 172.21.15.80:0/775804945 wait complete. 2024-04-25T15:43:00.277 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:43:00.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.391+0000 7f9b2913f640 1 Processor -- start 2024-04-25T15:43:00.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.391+0000 7f9b2913f640 1 -- start start 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2913f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9b24161d30 0x7f9b2415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2913f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b2415e6b0 0x7f9b24071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2913f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2415f650 con 0x7f9b2415eac0 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2913f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9b240d1d70 con 0x7f9b2415e6b0 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2913f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2415f090 con 0x7f9b24161d30 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b2415e6b0 0x7f9b24071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:00.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2359e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9b2415eac0 0x7f9b240b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52718/0 (socket says 172.21.15.80:52718) 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b2415e6b0 0x7f9b24071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57174/0 (socket says 172.21.15.80:57174) 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2359e640 1 -- 172.21.15.80:0/3529281005 learned_addr learned my addr 172.21.15.80:0/3529281005 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b22d9d640 1 --2- 172.21.15.80:0/3529281005 >> v2:172.21.15.195:3300/0 conn(0x7f9b24161d30 0x7f9b2415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2259c640 1 -- 172.21.15.80:0/3529281005 >> v2:172.21.15.195:3300/0 conn(0x7f9b24161d30 msgr2=0x7f9b2415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2259c640 1 --2- 172.21.15.80:0/3529281005 >> v2:172.21.15.195:3300/0 conn(0x7f9b24161d30 0x7f9b2415bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2259c640 1 -- 172.21.15.80:0/3529281005 >> v1:172.21.15.80:6789/0 conn(0x7f9b2415eac0 legacy=0x7f9b240b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b2259c640 1 -- 172.21.15.80:0/3529281005 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2415f370 con 0x7f9b2415e6b0 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b21d9b640 1 -- 172.21.15.80:0/3529281005 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820175782 0 0) 0x7f9b2415f650 con 0x7f9b2415eac0 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.392+0000 7f9b22d9d640 1 --2- 172.21.15.80:0/3529281005 >> v2:172.21.15.195:3300/0 conn(0x7f9b24161d30 0x7f9b2415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.393+0000 7f9b2259c640 1 --2- 172.21.15.80:0/3529281005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b24071950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b240d1ef0 tx=0x7f9b1802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8b5f8e122fe9a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.393+0000 7f9b21d9b640 1 -- 172.21.15.80:0/3529281005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18037070 con 0x7f9b2415e6b0 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.393+0000 7f9b21d9b640 1 -- 172.21.15.80:0/3529281005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1802add0 con 0x7f9b2415e6b0 2024-04-25T15:43:00.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.393+0000 7f9b21d9b640 1 -- 172.21.15.80:0/3529281005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18032660 con 0x7f9b2415e6b0 2024-04-25T15:43:00.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 -- 172.21.15.80:0/3529281005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 msgr2=0x7f9b24071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:00.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 --2- 172.21.15.80:0/3529281005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b24071950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b240d1ef0 tx=0x7f9b1802a080 comp rx=0 tx=0).stop 2024-04-25T15:43:00.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 -- 172.21.15.80:0/3529281005 shutdown_connections 2024-04-25T15:43:00.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 --2- 172.21.15.80:0/3529281005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b24071950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 --2- 172.21.15.80:0/3529281005 >> v2:172.21.15.195:3300/0 conn(0x7f9b24161d30 0x7f9b2415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 -- 172.21.15.80:0/3529281005 >> 172.21.15.80:0/3529281005 conn(0x7f9b240d39d0 msgr2=0x7f9b240d3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 -- 172.21.15.80:0/3529281005 shutdown_connections 2024-04-25T15:43:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.394+0000 7f9b2913f640 1 -- 172.21.15.80:0/3529281005 wait complete. 2024-04-25T15:43:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.396+0000 7f9b2913f640 1 Processor -- start 2024-04-25T15:43:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.396+0000 7f9b2913f640 1 -- start start 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b2913f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b241f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b2913f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b2415eac0 0x7f9b240ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b2913f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b24161d30 0x7f9b241f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b2913f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9b24071e90 con 0x7f9b2415e6b0 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b2913f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415c070 con 0x7f9b24161d30 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b2913f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9b24072010 con 0x7f9b2415eac0 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b22d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b241f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:00.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b22d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b241f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57178/0 (socket says 172.21.15.80:57178) 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.397+0000 7f9b22d9d640 1 -- 172.21.15.80:0/1787934356 learned_addr learned my addr 172.21.15.80:0/1787934356 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b2359e640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b24161d30 0x7f9b241f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b2259c640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b2415eac0 0x7f9b240ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b22d9d640 1 -- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b2415eac0 msgr2=0x7f9b240ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b22d9d640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b2415eac0 0x7f9b240ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b22d9d640 1 -- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b24161d30 msgr2=0x7f9b241f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b22d9d640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b24161d30 0x7f9b241f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b22d9d640 1 -- 172.21.15.80:0/1787934356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b240ca7d0 con 0x7f9b2415e6b0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b22d9d640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b241f5990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b14007e40 tx=0x7f9b1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14014620 con 0x7f9b2415e6b0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14019070 con 0x7f9b2415e6b0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b24154790 con 0x7f9b2415e6b0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14014a00 con 0x7f9b2415e6b0 2024-04-25T15:43:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.398+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b24154d50 con 0x7f9b2415e6b0 2024-04-25T15:43:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.399+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2406a100 con 0x7f9b2415e6b0 2024-04-25T15:43:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.400+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9b14014ba0 con 0x7f9b2415e6b0 2024-04-25T15:43:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.400+0000 7f9b0b7fe640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b100744b0 0x7f9b100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:00.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.401+0000 7f9b2259c640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b100744b0 0x7f9b100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:00.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.401+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f9b14095920 con 0x7f9b2415e6b0 2024-04-25T15:43:00.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.401+0000 7f9b2259c640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b100744b0 0x7f9b100769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b18034000 tx=0x7f9b1802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:00.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.405+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b1405fac0 con 0x7f9b2415e6b0 2024-04-25T15:43:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:00.618+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9b240d4730 con 0x7f9b2415e6b0 2024-04-25T15:43:01.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.275+0000 7f9b0b7fe640 1 -- 172.21.15.80:0/1787934356 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f9b14063dc0 con 0x7f9b2415e6b0 2024-04-25T15:43:01.277 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T15:43:01.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b100744b0 msgr2=0x7f9b100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:01.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b100744b0 0x7f9b100769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b18034000 tx=0x7f9b1802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:01.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 msgr2=0x7f9b241f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b241f5990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b14007e40 tx=0x7f9b1400e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 shutdown_connections 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b100744b0 0x7f9b100769c0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b18034000 tx=0x7f9b1802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b24161d30 0x7f9b241f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b2415eac0 0x7f9b240ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 --2- 172.21.15.80:0/1787934356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b2415e6b0 0x7f9b241f5990 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b14007e40 tx=0x7f9b1400e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.287+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 >> 172.21.15.80:0/1787934356 conn(0x7f9b240d39d0 msgr2=0x7f9b240c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.288+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 shutdown_connections 2024-04-25T15:43:01.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.288+0000 7f9b2913f640 1 -- 172.21.15.80:0/1787934356 wait complete. 2024-04-25T15:43:01.309 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T15:43:01.309 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T15:43:01.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.423+0000 7f863daf0640 1 Processor -- start 2024-04-25T15:43:01.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.423+0000 7f863daf0640 1 -- start start 2024-04-25T15:43:01.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f863daf0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86380d34a0 0x7f86380b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:01.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f863daf0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f863806da90 0x7f863806e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:01.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f863daf0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86380d1010 con 0x7f863806eaa0 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f863daf0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f863809cdf0 con 0x7f863806da90 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f863daf0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f863809d0d0 con 0x7f86380d34a0 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f863806da90 0x7f863806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f863806da90 0x7f863806e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57180/0 (socket says 172.21.15.80:57180) 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 -- 172.21.15.80:0/2138524416 learned_addr learned my addr 172.21.15.80:0/2138524416 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 -- 172.21.15.80:0/2138524416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86380d34a0 msgr2=0x7f86380b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 --2- 172.21.15.80:0/2138524416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86380d34a0 0x7f86380b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 -- 172.21.15.80:0/2138524416 >> v1:172.21.15.195:6789/0 conn(0x7f863806eaa0 legacy=0x7f86380b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:01.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.424+0000 7f8636ffd640 1 -- 172.21.15.80:0/2138524416 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86380d2f50 con 0x7f863806da90 2024-04-25T15:43:01.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.425+0000 7f8636ffd640 1 --2- 172.21.15.80:0/2138524416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863806da90 0x7f863806e560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f862c009870 tx=0x7f862c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5b481ed24e7b91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.425+0000 7f86367fc640 1 -- 172.21.15.80:0/2138524416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c037070 con 0x7f863806da90 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.425+0000 7f86367fc640 1 -- 172.21.15.80:0/2138524416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c032440 con 0x7f863806da90 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.425+0000 7f86367fc640 1 -- 172.21.15.80:0/2138524416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c032810 con 0x7f863806da90 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 -- 172.21.15.80:0/2138524416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863806da90 msgr2=0x7f863806e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 --2- 172.21.15.80:0/2138524416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863806da90 0x7f863806e560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f862c009870 tx=0x7f862c02a210 comp rx=0 tx=0).stop 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 -- 172.21.15.80:0/2138524416 shutdown_connections 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 --2- 172.21.15.80:0/2138524416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863806da90 0x7f863806e560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 --2- 172.21.15.80:0/2138524416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86380d34a0 0x7f86380b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 -- 172.21.15.80:0/2138524416 >> 172.21.15.80:0/2138524416 conn(0x7f86380d0450 msgr2=0x7f86380d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 -- 172.21.15.80:0/2138524416 shutdown_connections 2024-04-25T15:43:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.426+0000 7f863daf0640 1 -- 172.21.15.80:0/2138524416 wait complete. 2024-04-25T15:43:01.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.428+0000 7f863daf0640 1 Processor -- start 2024-04-25T15:43:01.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.428+0000 7f863daf0640 1 -- start start 2024-04-25T15:43:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f863daf0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f863806da90 0x7f863814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f863daf0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863806eaa0 0x7f86381480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f863daf0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 0x7f86380722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f863daf0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f86380b41d0 con 0x7f86380d34a0 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f863daf0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f863806d7b0 con 0x7f863806da90 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f863daf0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f86380b4350 con 0x7f863806eaa0 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f8637fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 0x7f86380722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f8637fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 0x7f86380722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57188/0 (socket says 172.21.15.80:57188) 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f8637fff640 1 -- 172.21.15.80:0/84923182 learned_addr learned my addr 172.21.15.80:0/84923182 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f8636ffd640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863806eaa0 0x7f86381480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f86377fe640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f863806da90 0x7f863814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.429+0000 7f8637fff640 1 -- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863806eaa0 msgr2=0x7f86381480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f8637fff640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863806eaa0 0x7f86381480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f8637fff640 1 -- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f863806da90 msgr2=0x7f863814b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f8637fff640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f863806da90 0x7f863814b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f8637fff640 1 -- 172.21.15.80:0/84923182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86380b3550 con 0x7f86380d34a0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f8637fff640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 0x7f86380722d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f863000b9a0 tx=0x7f863000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630019070 con 0x7f86380d34a0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863000cba0 con 0x7f86380d34a0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630014440 con 0x7f86380d34a0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863815d610 con 0x7f86380d34a0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.430+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863815d330 con 0x7f86380d34a0 2024-04-25T15:43:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.431+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863806a100 con 0x7f86380d34a0 2024-04-25T15:43:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.432+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f863001c070 con 0x7f86380d34a0 2024-04-25T15:43:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.432+0000 7f861ffff640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f86240744e0 0x7f86240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.432+0000 7f86377fe640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f86240744e0 0x7f86240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.432+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8630094c90 con 0x7f86380d34a0 2024-04-25T15:43:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.433+0000 7f86377fe640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f86240744e0 0x7f86240769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8628009960 tx=0x7f8628009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.437+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f863005eef0 con 0x7f86380d34a0 2024-04-25T15:43:01.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:01.618+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f86380b52a0 con 0x7f86380d34a0 2024-04-25T15:43:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.277+0000 7f861ffff640 1 -- 172.21.15.80:0/84923182 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f86300631f0 con 0x7f86380d34a0 2024-04-25T15:43:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f86240744e0 msgr2=0x7f86240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f86240744e0 0x7f86240769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8628009960 tx=0x7f8628009060 comp rx=0 tx=0).stop 2024-04-25T15:43:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 msgr2=0x7f86380722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 0x7f86380722d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f863000b9a0 tx=0x7f863000be60 comp rx=0 tx=0).stop 2024-04-25T15:43:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 shutdown_connections 2024-04-25T15:43:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f86240744e0 0x7f86240769f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86380d34a0 0x7f86380722d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863806eaa0 0x7f86381480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 --2- 172.21.15.80:0/84923182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f863806da90 0x7f863814b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.279+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 >> 172.21.15.80:0/84923182 conn(0x7f86380d0450 msgr2=0x7f863809bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.280+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 shutdown_connections 2024-04-25T15:43:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.280+0000 7f863daf0640 1 -- 172.21.15.80:0/84923182 wait complete. 2024-04-25T15:43:02.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:43:02.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.410+0000 7fc64cbc5640 1 Processor -- start 2024-04-25T15:43:02.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.410+0000 7fc64cbc5640 1 -- start start 2024-04-25T15:43:02.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc64cbc5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6480b3d20 0x7fc6481605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:02.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc64cbc5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc64809b530 0x7fc64809b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:02.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc64cbc5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64809be80 con 0x7fc6480ced10 2024-04-25T15:43:02.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc64cbc5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc6480d3110 con 0x7fc6480b3d20 2024-04-25T15:43:02.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc64cbc5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc6480d0200 con 0x7fc64809b530 2024-04-25T15:43:02.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc64659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6480b3d20 0x7fc6481605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc646d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6480ced10 0x7fc6480cf120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52730/0 (socket says 172.21.15.80:52730) 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.411+0000 7fc646d9d640 1 -- 172.21.15.80:0/594263124 learned_addr learned my addr 172.21.15.80:0/594263124 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc645d9b640 1 --2- 172.21.15.80:0/594263124 >> v2:172.21.15.195:3300/0 conn(0x7fc64809b530 0x7fc64809b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64659c640 1 -- 172.21.15.80:0/594263124 >> v2:172.21.15.195:3300/0 conn(0x7fc64809b530 msgr2=0x7fc64809b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64659c640 1 --2- 172.21.15.80:0/594263124 >> v2:172.21.15.195:3300/0 conn(0x7fc64809b530 0x7fc64809b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64659c640 1 -- 172.21.15.80:0/594263124 >> v1:172.21.15.80:6789/0 conn(0x7fc6480ced10 legacy=0x7fc6480cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64659c640 1 -- 172.21.15.80:0/594263124 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480d27e0 con 0x7fc6480b3d20 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64559a640 1 -- 172.21.15.80:0/594263124 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289314127 0 0) 0x7fc640001110 con 0x7fc6480ced10 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc645d9b640 1 --2- 172.21.15.80:0/594263124 >> v2:172.21.15.195:3300/0 conn(0x7fc64809b530 0x7fc64809b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64659c640 1 --2- 172.21.15.80:0/594263124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480b3d20 0x7fc6481605b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6480d04e0 tx=0x7fc63802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bdb1991cb74829 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64559a640 1 -- 172.21.15.80:0/594263124 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638007740 con 0x7fc6480b3d20 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64559a640 1 -- 172.21.15.80:0/594263124 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6380078e0 con 0x7fc6480b3d20 2024-04-25T15:43:02.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.412+0000 7fc64559a640 1 -- 172.21.15.80:0/594263124 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638007cb0 con 0x7fc6480b3d20 2024-04-25T15:43:02.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 -- 172.21.15.80:0/594263124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480b3d20 msgr2=0x7fc6481605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:02.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/594263124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480b3d20 0x7fc6481605b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6480d04e0 tx=0x7fc63802a680 comp rx=0 tx=0).stop 2024-04-25T15:43:02.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 -- 172.21.15.80:0/594263124 shutdown_connections 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/594263124 >> v2:172.21.15.195:3300/0 conn(0x7fc64809b530 0x7fc64809b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/594263124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480b3d20 0x7fc6481605b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 -- 172.21.15.80:0/594263124 >> 172.21.15.80:0/594263124 conn(0x7fc6480b7720 msgr2=0x7fc6480b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 -- 172.21.15.80:0/594263124 shutdown_connections 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.413+0000 7fc64cbc5640 1 -- 172.21.15.80:0/594263124 wait complete. 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.415+0000 7fc64cbc5640 1 Processor -- start 2024-04-25T15:43:02.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.415+0000 7fc64cbc5640 1 -- start start 2024-04-25T15:43:02.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc64cbc5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64809b530 0x7fc648157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc64cbc5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480b3d20 0x7fc6480cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc64cbc5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 0x7fc6480cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc64cbc5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc64809c160 con 0x7fc6480ced10 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc64cbc5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d2da0 con 0x7fc64809b530 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc64cbc5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc64809c2e0 con 0x7fc6480b3d20 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.416+0000 7fc646d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 0x7fc6480cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 0x7fc6480cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57198/0 (socket says 172.21.15.80:57198) 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 -- 172.21.15.80:0/3699241944 learned_addr learned my addr 172.21.15.80:0/3699241944 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc64659c640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64809b530 0x7fc648157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc645d9b640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480b3d20 0x7fc6480cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 -- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480b3d20 msgr2=0x7fc6480cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480b3d20 0x7fc6480cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 -- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64809b530 msgr2=0x7fc648157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64809b530 0x7fc648157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 -- 172.21.15.80:0/3699241944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc648161300 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc646d9d640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 0x7fc6480cc230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c440 tx=0x7fc64000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6400074e0 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6400047e0 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481615e0 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640004bd0 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.417+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc648161ba0 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.418+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64806a100 con 0x7fc6480ced10 2024-04-25T15:43:02.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.419+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc640011070 con 0x7fc6480ced10 2024-04-25T15:43:02.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.419+0000 7fc636ffd640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6280744e0 0x7fc6280769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:02.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.419+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fc640094d80 con 0x7fc6480ced10 2024-04-25T15:43:02.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.419+0000 7fc64659c640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6280744e0 0x7fc6280769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:02.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.420+0000 7fc64659c640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6280744e0 0x7fc6280769f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc638034000 tx=0x7fc63802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:02.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.424+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc64809be80 con 0x7fc6480ced10 2024-04-25T15:43:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:02.598+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc64806ecb0 con 0x7fc6480ced10 2024-04-25T15:43:02.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:02.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.292+0000 7fc636ffd640 1 -- 172.21.15.80:0/3699241944 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fc64005ed90 con 0x7fc6480ced10 2024-04-25T15:43:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' created 2024-04-25T15:43:04.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6280744e0 msgr2=0x7fc6280769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6280744e0 0x7fc6280769f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc638034000 tx=0x7fc63802f000 comp rx=0 tx=0).stop 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 msgr2=0x7fc6480cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 0x7fc6480cc230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c440 tx=0x7fc64000c900 comp rx=0 tx=0).stop 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 shutdown_connections 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6280744e0 0x7fc6280769f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6480ced10 0x7fc6480cc230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6480b3d20 0x7fc6480cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.296+0000 7fc64cbc5640 1 --2- 172.21.15.80:0/3699241944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc64809b530 0x7fc648157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.297+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 >> 172.21.15.80:0/3699241944 conn(0x7fc6480b7720 msgr2=0x7fc64815e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:04.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.297+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 shutdown_connections 2024-04-25T15:43:04.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.297+0000 7fc64cbc5640 1 -- 172.21.15.80:0/3699241944 wait complete. 2024-04-25T15:43:04.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T15:43:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.434+0000 7f0b55e67640 1 Processor -- start 2024-04-25T15:43:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.434+0000 7f0b55e67640 1 -- start start 2024-04-25T15:43:04.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b55e67640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b500b7d60 0x7f0b5016b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b55e67640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b500d59d0 con 0x7f0b500d41b0 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b55e67640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b50163fb0 con 0x7f0b500b48d0 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b55e67640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0b50164270 con 0x7f0b500b7d60 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b500d41b0 0x7f0b501602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41814/0 (socket says 172.21.15.80:41814) 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4f7fe640 1 -- 172.21.15.80:0/1823293392 learned_addr learned my addr 172.21.15.80:0/1823293392 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4ffff640 1 --2- 172.21.15.80:0/1823293392 >> v2:172.21.15.195:3300/0 conn(0x7f0b500b7d60 0x7f0b5016b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554035294 0 0) 0x7f0b500d59d0 con 0x7f0b500d41b0 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b38003520 con 0x7f0b500d41b0 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716074222 0 0) 0x7f0b38003520 con 0x7f0b500d41b0 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 >> v2:172.21.15.195:3300/0 conn(0x7f0b500b7d60 msgr2=0x7f0b5016b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 --2- 172.21.15.80:0/1823293392 >> v2:172.21.15.195:3300/0 conn(0x7f0b500b7d60 0x7f0b5016b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 >> v1:172.21.15.195:6789/0 conn(0x7f0b500b48d0 legacy=0x7f0b500b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b50164550 con 0x7f0b500d41b0 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f0b40001670 con 0x7f0b500d41b0 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 >> v1:172.21.15.80:6789/0 conn(0x7f0b500d41b0 legacy=0x7f0b501602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b380039b0 0x7f0b38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38004800 0x7f0b38004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b38005250 0x7f0b3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50164270 con 0x7f0b38005250 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3800c1e0 con 0x7f0b38004800 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.436+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3800c3e0 con 0x7f0b380039b0 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b38005250 0x7f0b3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4f7fe640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b380039b0 0x7f0b38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4effd640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38004800 0x7f0b38004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 -- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b380039b0 msgr2=0x7f0b38003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:04.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b380039b0 0x7f0b38003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 -- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38004800 msgr2=0x7f0b38004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38004800 0x7f0b38004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 -- 172.21.15.80:0/1823293392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b38003520 con 0x7f0b38005250 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.437+0000 7f0b4ffff640 1 -- 172.21.15.80:0/1823293392 reap_dead start 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b4ffff640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b38005250 0x7f0b3800b9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009f90 tx=0x7f0b38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4cb0cfd8a5e8c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48035020 con 0x7f0b38005250 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b48003b90 con 0x7f0b38005250 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b4e7fc640 1 -- 172.21.15.80:0/1823293392 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48009c10 con 0x7f0b38005250 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 -- 172.21.15.80:0/1823293392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b38005250 msgr2=0x7f0b3800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b38005250 0x7f0b3800b9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009f90 tx=0x7f0b38005830 comp rx=0 tx=0).stop 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 -- 172.21.15.80:0/1823293392 shutdown_connections 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 --2- 172.21.15.80:0/1823293392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b38005250 0x7f0b3800b9c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 -- 172.21.15.80:0/1823293392 >> 172.21.15.80:0/1823293392 conn(0x7f0b5006e9f0 msgr2=0x7f0b500d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 -- 172.21.15.80:0/1823293392 shutdown_connections 2024-04-25T15:43:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.438+0000 7f0b55e67640 1 -- 172.21.15.80:0/1823293392 wait complete. 2024-04-25T15:43:04.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.440+0000 7f0b55e67640 1 Processor -- start 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.440+0000 7f0b55e67640 1 -- start start 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38005250 0x7f0b5014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 0x7f0b5014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5014c960 0x7f0b501612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b500b4fd0 con 0x7f0b5014c010 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50164b10 con 0x7f0b38005250 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b500b5150 con 0x7f0b5014c960 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 0x7f0b5014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 0x7f0b5014c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60228/0 (socket says 172.21.15.80:60228) 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 -- 172.21.15.80:0/2877113796 learned_addr learned my addr 172.21.15.80:0/2877113796 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4f7fe640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38005250 0x7f0b5014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4ffff640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5014c960 0x7f0b501612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 -- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5014c960 msgr2=0x7f0b501612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5014c960 0x7f0b501612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 -- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38005250 msgr2=0x7f0b5014a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38005250 0x7f0b5014a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 -- 172.21.15.80:0/2877113796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5014b250 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b4effd640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 0x7f0b5014c420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0b44007810 tx=0x7f0b4400fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440052e0 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b44018070 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5014b530 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44003830 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.442+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5014baf0 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.443+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5006a100 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.444+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0b440039d0 con 0x7f0b5014c010 2024-04-25T15:43:04.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.444+0000 7f0b37fff640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b3c0744b0 0x7f0b3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:04.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.445+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f0b44095080 con 0x7f0b5014c010 2024-04-25T15:43:04.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.445+0000 7f0b4f7fe640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b3c0744b0 0x7f0b3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:04.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.445+0000 7f0b4f7fe640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b3c0744b0 0x7f0b3c0769c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0b400011e0 tx=0x7f0b40000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:04.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.449+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b4405efc0 con 0x7f0b5014c010 2024-04-25T15:43:04.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:04.626+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f0b500cd110 con 0x7f0b5014c010 2024-04-25T15:43:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.297+0000 7f0b37fff640 1 -- 172.21.15.80:0/2877113796 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f0b440632c0 con 0x7f0b5014c010 2024-04-25T15:43:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T15:43:05.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b3c0744b0 msgr2=0x7f0b3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b3c0744b0 0x7f0b3c0769c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0b400011e0 tx=0x7f0b40000ed0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 msgr2=0x7f0b5014c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 0x7f0b5014c420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0b44007810 tx=0x7f0b4400fa50 comp rx=0 tx=0).stop 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 shutdown_connections 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b3c0744b0 0x7f0b3c0769c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5014c960 0x7f0b501612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b5014c010 0x7f0b5014c420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 --2- 172.21.15.80:0/2877113796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b38005250 0x7f0b5014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.300+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 >> 172.21.15.80:0/2877113796 conn(0x7f0b5006e9f0 msgr2=0x7f0b5015d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.301+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 shutdown_connections 2024-04-25T15:43:05.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.301+0000 7f0b55e67640 1 -- 172.21.15.80:0/2877113796 wait complete. 2024-04-25T15:43:05.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T15:43:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.442+0000 7f2fb85f3640 1 Processor -- start 2024-04-25T15:43:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.442+0000 7f2fb85f3640 1 -- start start 2024-04-25T15:43:05.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb85f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00cf2f0 0x7f2fb00d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:05.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb85f3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fb006ece0 0x7f2fb00b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:05.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb85f3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00d02c0 con 0x7f2fb00b3ae0 2024-04-25T15:43:05.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb85f3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb006cab0 con 0x7f2fb006ece0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb85f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb00d1f10 con 0x7f2fb00cf2f0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb5b8e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fb006ece0 0x7f2fb00b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb5b8e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fb006ece0 0x7f2fb00b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60232/0 (socket says 172.21.15.80:60232) 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb6b90640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2fb00b3ae0 0x7f2fb00d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41828/0 (socket says 172.21.15.80:41828) 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.443+0000 7f2fb5b8e640 1 -- 172.21.15.80:0/2693724523 learned_addr learned my addr 172.21.15.80:0/2693724523 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb638f640 1 --2- 172.21.15.80:0/2693724523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00cf2f0 0x7f2fb00d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb5b8e640 1 -- 172.21.15.80:0/2693724523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00cf2f0 msgr2=0x7f2fb00d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb5b8e640 1 --2- 172.21.15.80:0/2693724523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00cf2f0 0x7f2fb00d19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb5b8e640 1 -- 172.21.15.80:0/2693724523 >> v1:172.21.15.80:6789/0 conn(0x7f2fb00b3ae0 legacy=0x7f2fb00d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb538d640 1 -- 172.21.15.80:0/2693724523 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228263984 0 0) 0x7f2fb00d02c0 con 0x7f2fb00b3ae0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb5b8e640 1 -- 172.21.15.80:0/2693724523 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00b3ef0 con 0x7f2fb006ece0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb5b8e640 1 --2- 172.21.15.80:0/2693724523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb00b35a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009870 tx=0x7f2fa002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782a833b7d732534 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.444+0000 7f2fb538d640 1 -- 172.21.15.80:0/2693724523 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0037070 con 0x7f2fb006ece0 2024-04-25T15:43:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb538d640 1 -- 172.21.15.80:0/2693724523 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa0032440 con 0x7f2fb006ece0 2024-04-25T15:43:05.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb538d640 1 -- 172.21.15.80:0/2693724523 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0032810 con 0x7f2fb006ece0 2024-04-25T15:43:05.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 -- 172.21.15.80:0/2693724523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 msgr2=0x7f2fb00b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:05.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/2693724523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb00b35a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009870 tx=0x7f2fa002a270 comp rx=0 tx=0).stop 2024-04-25T15:43:05.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 -- 172.21.15.80:0/2693724523 shutdown_connections 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/2693724523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb00b35a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/2693724523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00cf2f0 0x7f2fb00d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 -- 172.21.15.80:0/2693724523 >> 172.21.15.80:0/2693724523 conn(0x7f2fb00b75f0 msgr2=0x7f2fb00b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 -- 172.21.15.80:0/2693724523 shutdown_connections 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.445+0000 7f2fb85f3640 1 -- 172.21.15.80:0/2693724523 wait complete. 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.447+0000 7f2fb85f3640 1 Processor -- start 2024-04-25T15:43:05.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.447+0000 7f2fb85f3640 1 -- start start 2024-04-25T15:43:05.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb85f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb85f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00b3ae0 0x7f2fb00a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb85f3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00cf2f0 0x7f2fb00cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb85f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb006c740 con 0x7f2fb006ece0 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb85f3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00d2440 con 0x7f2fb00cf2f0 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb85f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb006df50 con 0x7f2fb00b3ae0 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb638f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb638f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60240/0 (socket says 172.21.15.80:60240) 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.448+0000 7f2fb638f640 1 -- 172.21.15.80:0/1657851712 learned_addr learned my addr 172.21.15.80:0/1657851712 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb5b8e640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00b3ae0 0x7f2fb00a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb6b90640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00cf2f0 0x7f2fb00cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb638f640 1 -- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00b3ae0 msgr2=0x7f2fb00a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb638f640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00b3ae0 0x7f2fb00a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb638f640 1 -- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00cf2f0 msgr2=0x7f2fb00cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb638f640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00cf2f0 0x7f2fb00cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb638f640 1 -- 172.21.15.80:0/1657851712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb015cfa0 con 0x7f2fb006ece0 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb638f640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb015ca60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c820 tx=0x7f2fac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac015070 con 0x7f2fb006ece0 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac004020 con 0x7f2fb006ece0 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb00afcd0 con 0x7f2fb006ece0 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0043f0 con 0x7f2fb006ece0 2024-04-25T15:43:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.449+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb00b0290 con 0x7f2fb006ece0 2024-04-25T15:43:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.450+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb006a100 con 0x7f2fb006ece0 2024-04-25T15:43:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.450+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2fac007830 con 0x7f2fb006ece0 2024-04-25T15:43:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.451+0000 7f2fa6ffd640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f940744b0 0x7f2f940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.451+0000 7f2fb5b8e640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f940744b0 0x7f2f940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.451+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f2fac095330 con 0x7f2fb006ece0 2024-04-25T15:43:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.451+0000 7f2fb5b8e640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f940744b0 0x7f2f940769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0034000 tx=0x7f2fa002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:05.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.456+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2fac05f7a0 con 0x7f2fb006ece0 2024-04-25T15:43:05.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:05.667+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f2fb00c94d0 con 0x7f2fb006ece0 2024-04-25T15:43:05.721 INFO:tasks.ceph.mds.b.smithi195.stderr:2024-04-25T15:43:05.720+0000 7f22ea223640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:43:06.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.299+0000 7f2fa6ffd640 1 -- 172.21.15.80:0/1657851712 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f2fac05f0a0 con 0x7f2fb006ece0 2024-04-25T15:43:06.300 INFO:teuthology.orchestra.run.smithi080.stderr:added data pool 4 to fsmap 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.301+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f940744b0 msgr2=0x7f2f940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.301+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f940744b0 0x7f2f940769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0034000 tx=0x7f2fa002e000 comp rx=0 tx=0).stop 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 msgr2=0x7f2fb015ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb015ca60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c820 tx=0x7f2fac00cce0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 shutdown_connections 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f940744b0 0x7f2f940769c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00cf2f0 0x7f2fb00cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb00b3ae0 0x7f2fb00a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 --2- 172.21.15.80:0/1657851712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb006ece0 0x7f2fb015ca60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 >> 172.21.15.80:0/1657851712 conn(0x7f2fb00b75f0 msgr2=0x7f2fb009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:06.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 shutdown_connections 2024-04-25T15:43:06.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.302+0000 7f2fb85f3640 1 -- 172.21.15.80:0/1657851712 wait complete. 2024-04-25T15:43:06.317 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:06.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.427+0000 7f20c1fc5640 1 Processor -- start 2024-04-25T15:43:06.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.427+0000 7f20c1fc5640 1 -- start start 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20c1fc5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f20bc15d310 0x7f20bc09b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20c1fc5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0d2ed0 0x7f20bc0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20c1fc5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20bc06e990 con 0x7f20bc0cfcd0 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20c1fc5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f20bc0d0610 con 0x7f20bc15d310 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20c1fc5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc06ec00 con 0x7f20bc0d2ed0 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20bb7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f20bc15d310 0x7f20bc09b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20bbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0d2ed0 0x7f20bc0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20baffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f20bc0cfcd0 0x7f20bc0d27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:37112/0 (socket says 172.21.15.80:37112) 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.428+0000 7f20baffd640 1 -- 172.21.15.80:0/1689591371 learned_addr learned my addr 172.21.15.80:0/1689591371 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20bbfff640 1 -- 172.21.15.80:0/1689591371 >> v2:172.21.15.195:3300/0 conn(0x7f20bc15d310 msgr2=0x7f20bc09b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20bbfff640 1 --2- 172.21.15.80:0/1689591371 >> v2:172.21.15.195:3300/0 conn(0x7f20bc15d310 0x7f20bc09b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20bbfff640 1 -- 172.21.15.80:0/1689591371 >> v1:172.21.15.195:6789/0 conn(0x7f20bc0cfcd0 legacy=0x7f20bc0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20bbfff640 1 -- 172.21.15.80:0/1689591371 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc06eee0 con 0x7f20bc0d2ed0 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20ba7fc640 1 -- 172.21.15.80:0/1689591371 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422744168 0 0) 0x7f20bc06e990 con 0x7f20bc0cfcd0 2024-04-25T15:43:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20bb7fe640 1 --2- 172.21.15.80:0/1689591371 >> v2:172.21.15.195:3300/0 conn(0x7f20bc15d310 0x7f20bc09b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.429+0000 7f20bbfff640 1 --2- 172.21.15.80:0/1689591371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0d2ed0 0x7f20bc0d0d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009d90 tx=0x7f20b402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9681b44de0c46e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20ba7fc640 1 -- 172.21.15.80:0/1689591371 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4031600 con 0x7f20bc0d2ed0 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20ba7fc640 1 -- 172.21.15.80:0/1689591371 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b40317a0 con 0x7f20bc0d2ed0 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20ba7fc640 1 -- 172.21.15.80:0/1689591371 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4031b70 con 0x7f20bc0d2ed0 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 -- 172.21.15.80:0/1689591371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0d2ed0 msgr2=0x7f20bc0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/1689591371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0d2ed0 0x7f20bc0d0d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009d90 tx=0x7f20b402a5d0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 -- 172.21.15.80:0/1689591371 shutdown_connections 2024-04-25T15:43:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/1689591371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0d2ed0 0x7f20bc0d0d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/1689591371 >> v2:172.21.15.195:3300/0 conn(0x7f20bc15d310 0x7f20bc09b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 -- 172.21.15.80:0/1689591371 >> 172.21.15.80:0/1689591371 conn(0x7f20bc0b7750 msgr2=0x7f20bc0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 -- 172.21.15.80:0/1689591371 shutdown_connections 2024-04-25T15:43:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.430+0000 7f20c1fc5640 1 -- 172.21.15.80:0/1689591371 wait complete. 2024-04-25T15:43:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.432+0000 7f20c1fc5640 1 Processor -- start 2024-04-25T15:43:06.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.432+0000 7f20c1fc5640 1 -- start start 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0cfcd0 0x7f20bc09f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc15d310 0x7f20bc159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 0x7f20bc09ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc0d1440 con 0x7f20bc09e930 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc0d12c0 con 0x7f20bc15d310 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc0d15c0 con 0x7f20bc0cfcd0 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 0x7f20bc09ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0cfcd0 0x7f20bc09f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 0x7f20bc09ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60248/0 (socket says 172.21.15.80:60248) 2024-04-25T15:43:06.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 -- 172.21.15.80:0/3712507438 learned_addr learned my addr 172.21.15.80:0/3712507438 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20baffd640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc15d310 0x7f20bc159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 -- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0cfcd0 msgr2=0x7f20bc09f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0cfcd0 0x7f20bc09f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 -- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc15d310 msgr2=0x7f20bc159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc15d310 0x7f20bc159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 -- 172.21.15.80:0/3712507438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc09f280 con 0x7f20bc09e930 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20bbfff640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 0x7f20bc09ed40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009d90 tx=0x7f20b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b403f070 con 0x7f20bc09e930 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b4030be0 con 0x7f20bc09e930 2024-04-25T15:43:06.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc0b0210 con 0x7f20bc09e930 2024-04-25T15:43:06.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4009450 con 0x7f20bc09e930 2024-04-25T15:43:06.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.434+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc0b07d0 con 0x7f20bc09e930 2024-04-25T15:43:06.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.435+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20bc06a100 con 0x7f20bc09e930 2024-04-25T15:43:06.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.436+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f20b4003990 con 0x7f20bc09e930 2024-04-25T15:43:06.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.436+0000 7f20a3fff640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f20a80744b0 0x7f20a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.436+0000 7f20bb7fe640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f20a80744b0 0x7f20a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.437+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f20b40b60e0 con 0x7f20bc09e930 2024-04-25T15:43:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.437+0000 7f20bb7fe640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f20a80744b0 0x7f20a80769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009560 tx=0x7f20ac009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:06.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.441+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20bc09f280 con 0x7f20bc09e930 2024-04-25T15:43:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.653+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20bc09de20 con 0x7f20bc09e930 2024-04-25T15:43:06.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.654+0000 7f20a3fff640 1 -- 172.21.15.80:0/3712507438 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5180 (secure 0 0 0) 0x7f20b407fed0 con 0x7f20bc09e930 2024-04-25T15:43:06.655 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:06.655 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:05.669345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:06.655 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2024-04-25T15:43:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f20a80744b0 msgr2=0x7f20a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f20a80744b0 0x7f20a80769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009560 tx=0x7f20ac009190 comp rx=0 tx=0).stop 2024-04-25T15:43:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 msgr2=0x7f20bc09ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 0x7f20bc09ed40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009d90 tx=0x7f20b4004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 shutdown_connections 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f20a80744b0 0x7f20a80769c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20bc09e930 0x7f20bc09ed40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc15d310 0x7f20bc159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 --2- 172.21.15.80:0/3712507438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20bc0cfcd0 0x7f20bc09f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 >> 172.21.15.80:0/3712507438 conn(0x7f20bc0b7750 msgr2=0x7f20bc09b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 shutdown_connections 2024-04-25T15:43:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.656+0000 7f20c1fc5640 1 -- 172.21.15.80:0/3712507438 wait complete. 2024-04-25T15:43:06.668 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.774+0000 7fc35d0ee640 1 Processor -- start 2024-04-25T15:43:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.774+0000 7fc35d0ee640 1 -- start start 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35d0ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc35806dce0 0x7fc3580af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35d0ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc3580afc60 0x7fc35815b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35d0ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3580ae960 con 0x7fc3580d1090 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35d0ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc358070470 con 0x7fc35806dce0 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35d0ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc3580aec40 con 0x7fc3580afc60 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc35806dce0 0x7fc3580af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc35806dce0 0x7fc3580af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60264/0 (socket says 172.21.15.80:60264) 2024-04-25T15:43:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 -- 172.21.15.80:0/3670625010 learned_addr learned my addr 172.21.15.80:0/3670625010 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35759e640 1 --2- 172.21.15.80:0/3670625010 >> v2:172.21.15.195:3300/0 conn(0x7fc3580afc60 0x7fc35815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 -- 172.21.15.80:0/3670625010 >> v2:172.21.15.195:3300/0 conn(0x7fc3580afc60 msgr2=0x7fc35815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 --2- 172.21.15.80:0/3670625010 >> v2:172.21.15.195:3300/0 conn(0x7fc3580afc60 0x7fc35815b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 -- 172.21.15.80:0/3670625010 >> v1:172.21.15.195:6789/0 conn(0x7fc3580d1090 legacy=0x7fc35806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.776+0000 7fc35659c640 1 -- 172.21.15.80:0/3670625010 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3580aef20 con 0x7fc35806dce0 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.777+0000 7fc35659c640 1 --2- 172.21.15.80:0/3670625010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35806dce0 0x7fc3580af720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009870 tx=0x7fc34c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb1cf147c5e0c9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.777+0000 7fc355d9b640 1 -- 172.21.15.80:0/3670625010 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c037070 con 0x7fc35806dce0 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.777+0000 7fc355d9b640 1 -- 172.21.15.80:0/3670625010 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c032440 con 0x7fc35806dce0 2024-04-25T15:43:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.777+0000 7fc355d9b640 1 -- 172.21.15.80:0/3670625010 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c032810 con 0x7fc35806dce0 2024-04-25T15:43:06.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 -- 172.21.15.80:0/3670625010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35806dce0 msgr2=0x7fc3580af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/3670625010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35806dce0 0x7fc3580af720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009870 tx=0x7fc34c02a210 comp rx=0 tx=0).stop 2024-04-25T15:43:06.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 -- 172.21.15.80:0/3670625010 shutdown_connections 2024-04-25T15:43:06.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/3670625010 >> v2:172.21.15.195:3300/0 conn(0x7fc3580afc60 0x7fc35815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/3670625010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35806dce0 0x7fc3580af720 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 -- 172.21.15.80:0/3670625010 >> 172.21.15.80:0/3670625010 conn(0x7fc3580d1e20 msgr2=0x7fc358073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 -- 172.21.15.80:0/3670625010 shutdown_connections 2024-04-25T15:43:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.778+0000 7fc35d0ee640 1 -- 172.21.15.80:0/3670625010 wait complete. 2024-04-25T15:43:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.780+0000 7fc35d0ee640 1 Processor -- start 2024-04-25T15:43:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.780+0000 7fc35d0ee640 1 -- start start 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35d0ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3580afc60 0x7fc35813c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35d0ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3580d1090 0x7fc35813e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35d0ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 0x7fc35813c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35d0ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc3580b01f0 con 0x7fc35813eec0 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35d0ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc3580b0070 con 0x7fc3580d1090 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35d0ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc3580d14a0 con 0x7fc3580afc60 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 0x7fc35813c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 0x7fc35813c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60272/0 (socket says 172.21.15.80:60272) 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.781+0000 7fc35759e640 1 -- 172.21.15.80:0/8841687 learned_addr learned my addr 172.21.15.80:0/8841687 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:06.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35659c640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3580d1090 0x7fc35813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc356d9d640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3580afc60 0x7fc35813c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35759e640 1 -- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3580afc60 msgr2=0x7fc35813c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35759e640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3580afc60 0x7fc35813c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35759e640 1 -- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3580d1090 msgr2=0x7fc35813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35759e640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3580d1090 0x7fc35813e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35759e640 1 -- 172.21.15.80:0/8841687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35813f600 con 0x7fc35813eec0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc356d9d640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3580afc60 0x7fc35813c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35659c640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3580d1090 0x7fc35813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35759e640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 0x7fc35813c9f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc35000d5d0 tx=0x7fc35000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500125f0 con 0x7fc35813eec0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc350019070 con 0x7fc35813eec0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35813f8e0 con 0x7fc35813eec0 2024-04-25T15:43:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500129f0 con 0x7fc35813eec0 2024-04-25T15:43:06.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.782+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc358144bf0 con 0x7fc35813eec0 2024-04-25T15:43:06.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.783+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3581449e0 con 0x7fc35813eec0 2024-04-25T15:43:06.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.784+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc350012b90 con 0x7fc35813eec0 2024-04-25T15:43:06.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.784+0000 7fc33f7fe640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3440744b0 0x7fc3440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:06.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.784+0000 7fc356d9d640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3440744b0 0x7fc3440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:06.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.784+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc350095950 con 0x7fc35813eec0 2024-04-25T15:43:06.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.784+0000 7fc356d9d640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3440744b0 0x7fc3440769c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc358147cb0 tx=0x7fc348009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:06.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.789+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc35005fdb0 con 0x7fc35813eec0 2024-04-25T15:43:06.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.963+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc35813f390 con 0x7fc35813eec0 2024-04-25T15:43:06.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.964+0000 7fc33f7fe640 1 -- 172.21.15.80:0/8841687 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fc35005f6b0 con 0x7fc35813eec0 2024-04-25T15:43:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:06.965 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:06.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3440744b0 msgr2=0x7fc3440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3440744b0 0x7fc3440769c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc358147cb0 tx=0x7fc348009040 comp rx=0 tx=0).stop 2024-04-25T15:43:06.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 msgr2=0x7fc35813c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:06.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 0x7fc35813c9f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc35000d5d0 tx=0x7fc35000da90 comp rx=0 tx=0).stop 2024-04-25T15:43:06.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 shutdown_connections 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3440744b0 0x7fc3440769c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35813eec0 0x7fc35813c9f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3580d1090 0x7fc35813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 --2- 172.21.15.80:0/8841687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3580afc60 0x7fc35813c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 >> 172.21.15.80:0/8841687 conn(0x7fc3580d1e20 msgr2=0x7fc3581474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 shutdown_connections 2024-04-25T15:43:06.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:06.966+0000 7fc35d0ee640 1 -- 172.21.15.80:0/8841687 wait complete. 2024-04-25T15:43:06.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:07.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.085+0000 7f449cff3640 1 Processor -- start 2024-04-25T15:43:07.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.085+0000 7f449cff3640 1 -- start start 2024-04-25T15:43:07.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449cff3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44980d34a0 0x7f44980b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449cff3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44980b3ac0 0x7f44980b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449cff3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44980d1010 con 0x7f449806da90 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449cff3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f449809cdf0 con 0x7f44980d34a0 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449cff3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f449809d0d0 con 0x7f44980b3ac0 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44980d34a0 0x7f44980b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44980d34a0 0x7f44980b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60284/0 (socket says 172.21.15.80:60284) 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 -- 172.21.15.80:0/3131006855 learned_addr learned my addr 172.21.15.80:0/3131006855 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f4496d9d640 1 --2- 172.21.15.80:0/3131006855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44980b3ac0 0x7f44980b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 -- 172.21.15.80:0/3131006855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44980b3ac0 msgr2=0x7f44980b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 --2- 172.21.15.80:0/3131006855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44980b3ac0 0x7f44980b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 -- 172.21.15.80:0/3131006855 >> v1:172.21.15.195:6789/0 conn(0x7f449806da90 legacy=0x7f449806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.087+0000 7f449659c640 1 -- 172.21.15.80:0/3131006855 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449806ec70 con 0x7f44980d34a0 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.088+0000 7f449659c640 1 --2- 172.21.15.80:0/3131006855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b91b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4488009ea0 tx=0x7f448802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd15f980870a4380 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.088+0000 7f449559a640 1 -- 172.21.15.80:0/3131006855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488036070 con 0x7f44980d34a0 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.088+0000 7f449559a640 1 -- 172.21.15.80:0/3131006855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4488031600 con 0x7f44980d34a0 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.088+0000 7f449559a640 1 -- 172.21.15.80:0/3131006855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880319d0 con 0x7f44980d34a0 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 -- 172.21.15.80:0/3131006855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 msgr2=0x7f44980b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 --2- 172.21.15.80:0/3131006855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b91b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4488009ea0 tx=0x7f448802a760 comp rx=0 tx=0).stop 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 -- 172.21.15.80:0/3131006855 shutdown_connections 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 --2- 172.21.15.80:0/3131006855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44980b3ac0 0x7f44980b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 --2- 172.21.15.80:0/3131006855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b91b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 -- 172.21.15.80:0/3131006855 >> 172.21.15.80:0/3131006855 conn(0x7f44980d0450 msgr2=0x7f44980d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 -- 172.21.15.80:0/3131006855 shutdown_connections 2024-04-25T15:43:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.089+0000 7f449cff3640 1 -- 172.21.15.80:0/3131006855 wait complete. 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.091+0000 7f449cff3640 1 Processor -- start 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.091+0000 7f449cff3640 1 -- start start 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449cff3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f449806da90 0x7f44980b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449cff3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44980b3ac0 0x7f4498152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449cff3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449cff3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f44980b4410 con 0x7f44980d34a0 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449cff3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f449806d7b0 con 0x7f44980b3ac0 2024-04-25T15:43:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449cff3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f44980b4590 con 0x7f449806da90 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60294/0 (socket says 172.21.15.80:60294) 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 -- 172.21.15.80:0/2481361821 learned_addr learned my addr 172.21.15.80:0/2481361821 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f449659c640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f449806da90 0x7f44980b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4495d9b640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44980b3ac0 0x7f4498152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 -- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f449806da90 msgr2=0x7f44980b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f449806da90 0x7f44980b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 -- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44980b3ac0 msgr2=0x7f4498152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44980b3ac0 0x7f4498152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.092+0000 7f4496d9d640 1 -- 172.21.15.80:0/2481361821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4498153310 con 0x7f44980d34a0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.093+0000 7f4496d9d640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b11b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f449000c540 tx=0x7f449000ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.093+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490015070 con 0x7f44980d34a0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.093+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4490004240 con 0x7f44980d34a0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.093+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490003610 con 0x7f44980d34a0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.093+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44981ea130 con 0x7f44980d34a0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.093+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44981ea6f0 con 0x7f44980d34a0 2024-04-25T15:43:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.094+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449806a100 con 0x7f44980d34a0 2024-04-25T15:43:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.094+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f44900037b0 con 0x7f44980d34a0 2024-04-25T15:43:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.095+0000 7f4486ffd640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44780744b0 0x7f44780769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.095+0000 7f449659c640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44780744b0 0x7f44780769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.095+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f44900951c0 con 0x7f44980d34a0 2024-04-25T15:43:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.095+0000 7f449659c640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44780744b0 0x7f44780769c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4488033000 tx=0x7f4488009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.099+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f449005f730 con 0x7f44980d34a0 2024-04-25T15:43:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.276+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44980b52a0 con 0x7f44980d34a0 2024-04-25T15:43:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.277+0000 7f4486ffd640 1 -- 172.21.15.80:0/2481361821 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f449005f030 con 0x7f44980d34a0 2024-04-25T15:43:07.278 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:07.279 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44780744b0 msgr2=0x7f44780769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44780744b0 0x7f44780769c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4488033000 tx=0x7f4488009000 comp rx=0 tx=0).stop 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 msgr2=0x7f44980b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b11b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f449000c540 tx=0x7f449000ca00 comp rx=0 tx=0).stop 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 shutdown_connections 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44780744b0 0x7f44780769c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44980d34a0 0x7f44980b11b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44980b3ac0 0x7f4498152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 --2- 172.21.15.80:0/2481361821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f449806da90 0x7f44980b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 >> 172.21.15.80:0/2481361821 conn(0x7f44980d0450 msgr2=0x7f44980cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 shutdown_connections 2024-04-25T15:43:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.279+0000 7f449cff3640 1 -- 172.21.15.80:0/2481361821 wait complete. 2024-04-25T15:43:07.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:07.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.414+0000 7f4d3eeb1640 1 Processor -- start 2024-04-25T15:43:07.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.414+0000 7f4d3eeb1640 1 -- start start 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3eeb1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d380b48d0 0x7f4d380b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3eeb1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4d380b7b90 0x7f4d380d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3eeb1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d380b7fa0 con 0x7f4d380d41b0 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3eeb1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4d38163fb0 con 0x7f4d380b48d0 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3eeb1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4d38164270 con 0x7f4d380b7b90 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d380b48d0 0x7f4d380b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d380b48d0 0x7f4d380b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60296/0 (socket says 172.21.15.80:60296) 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3cc4d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d380d41b0 0x7f4d381602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41838/0 (socket says 172.21.15.80:41838) 2024-04-25T15:43:07.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 -- 172.21.15.80:0/3651107593 learned_addr learned my addr 172.21.15.80:0/3651107593 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d3d44e640 1 --2- 172.21.15.80:0/3651107593 >> v2:172.21.15.195:3300/0 conn(0x7f4d380b7b90 0x7f4d380d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 -- 172.21.15.80:0/3651107593 >> v2:172.21.15.195:3300/0 conn(0x7f4d380b7b90 msgr2=0x7f4d380d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 --2- 172.21.15.80:0/3651107593 >> v2:172.21.15.195:3300/0 conn(0x7f4d380b7b90 0x7f4d380d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 -- 172.21.15.80:0/3651107593 >> v1:172.21.15.80:6789/0 conn(0x7f4d380d41b0 legacy=0x7f4d381602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d37fff640 1 -- 172.21.15.80:0/3651107593 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d38164550 con 0x7f4d380b48d0 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.416+0000 7f4d377fe640 1 -- 172.21.15.80:0/3651107593 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136765297 0 0) 0x7f4d28001110 con 0x7f4d380d41b0 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.417+0000 7f4d37fff640 1 --2- 172.21.15.80:0/3651107593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d380b7650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d380b4850 tx=0x7f4d2c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0170c775226733 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.417+0000 7f4d377fe640 1 -- 172.21.15.80:0/3651107593 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c037070 con 0x7f4d380b48d0 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.417+0000 7f4d377fe640 1 -- 172.21.15.80:0/3651107593 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2c032440 con 0x7f4d380b48d0 2024-04-25T15:43:07.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.417+0000 7f4d377fe640 1 -- 172.21.15.80:0/3651107593 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c032810 con 0x7f4d380b48d0 2024-04-25T15:43:07.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/3651107593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 msgr2=0x7f4d380b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/3651107593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d380b7650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d380b4850 tx=0x7f4d2c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/3651107593 shutdown_connections 2024-04-25T15:43:07.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/3651107593 >> v2:172.21.15.195:3300/0 conn(0x7f4d380b7b90 0x7f4d380d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/3651107593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d380b7650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/3651107593 >> 172.21.15.80:0/3651107593 conn(0x7f4d3806e9f0 msgr2=0x7f4d380d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:07.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/3651107593 shutdown_connections 2024-04-25T15:43:07.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.418+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/3651107593 wait complete. 2024-04-25T15:43:07.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.420+0000 7f4d3eeb1640 1 Processor -- start 2024-04-25T15:43:07.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.420+0000 7f4d3eeb1640 1 -- start start 2024-04-25T15:43:07.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3eeb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d38163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3eeb1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d380b7b90 0x7f4d3815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3eeb1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d380d41b0 0x7f4d38162c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3eeb1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380b4fd0 con 0x7f4d380b48d0 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3eeb1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38164b10 con 0x7f4d380d41b0 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3eeb1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d380b5150 con 0x7f4d380b7b90 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d38163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d38163950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60300/0 (socket says 172.21.15.80:60300) 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 -- 172.21.15.80:0/284873725 learned_addr learned my addr 172.21.15.80:0/284873725 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d37fff640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d380b7b90 0x7f4d3815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3d44e640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d380d41b0 0x7f4d38162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 -- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d380b7b90 msgr2=0x7f4d3815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d380b7b90 0x7f4d3815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 -- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d380d41b0 msgr2=0x7f4d38162c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d380d41b0 0x7f4d38162c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.421+0000 7f4d3cc4d640 1 -- 172.21.15.80:0/284873725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d380cbef0 con 0x7f4d380b48d0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.422+0000 7f4d3cc4d640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d38163950 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c430 tx=0x7f4d2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.422+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d280074e0 con 0x7f4d380b48d0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.422+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d280047e0 con 0x7f4d380b48d0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.422+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d380ccd80 con 0x7f4d380b48d0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.422+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28004bd0 con 0x7f4d380b48d0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.422+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d380cd020 con 0x7f4d380b48d0 2024-04-25T15:43:07.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.423+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3806a100 con 0x7f4d380b48d0 2024-04-25T15:43:07.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.423+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4d28011070 con 0x7f4d380b48d0 2024-04-25T15:43:07.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.424+0000 7f4d357fa640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d240744b0 0x7f4d240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.424+0000 7f4d37fff640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d240744b0 0x7f4d240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.424+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4d28095090 con 0x7f4d380b48d0 2024-04-25T15:43:07.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.424+0000 7f4d37fff640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d240744b0 0x7f4d240769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c034000 tx=0x7f4d2c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.428+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d380b7fa0 con 0x7f4d380b48d0 2024-04-25T15:43:07.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.644+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d380d3070 con 0x7f4d380b48d0 2024-04-25T15:43:07.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.645+0000 7f4d357fa640 1 -- 172.21.15.80:0/284873725 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5180 (secure 0 0 0) 0x7f4d2805f570 con 0x7f4d380b48d0 2024-04-25T15:43:07.646 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:07.646 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:05.669345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:07.646 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2024-04-25T15:43:07.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d240744b0 msgr2=0x7f4d240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d240744b0 0x7f4d240769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c034000 tx=0x7f4d2c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:07.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 msgr2=0x7f4d38163950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d38163950 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c430 tx=0x7f4d2800c8f0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 shutdown_connections 2024-04-25T15:43:07.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d240744b0 0x7f4d240769c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d380d41b0 0x7f4d38162c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d380b7b90 0x7f4d3815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 --2- 172.21.15.80:0/284873725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d380b48d0 0x7f4d38163950 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 >> 172.21.15.80:0/284873725 conn(0x7f4d3806e9f0 msgr2=0x7f4d380b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:07.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 shutdown_connections 2024-04-25T15:43:07.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.647+0000 7f4d3eeb1640 1 -- 172.21.15.80:0/284873725 wait complete. 2024-04-25T15:43:07.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.764+0000 7eff02a20640 1 Processor -- start 2024-04-25T15:43:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.764+0000 7eff02a20640 1 -- start start 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7eff02a20640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efefc06db10 0x7efefc15e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7eff02a20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 0x7efefc0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7eff02a20640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc071df0 con 0x7efefc06c5c0 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7eff02a20640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7efefc15faf0 con 0x7efefc06db10 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7eff02a20640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efefc1589c0 con 0x7efefc0714a0 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efefc06db10 0x7efefc15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 0x7efefc0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efefc06db10 0x7efefc15e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:53608/0 (socket says 172.21.15.80:53608) 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 -- 172.21.15.80:0/1143422846 learned_addr learned my addr 172.21.15.80:0/1143422846 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 0x7efefc0718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:52748/0 (socket says 172.21.15.80:52748) 2024-04-25T15:43:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 -- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 msgr2=0x7efefc0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 --2- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 0x7efefc0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 -- 172.21.15.80:0/1143422846 >> v1:172.21.15.195:6789/0 conn(0x7efefc06c5c0 legacy=0x7efefc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefbfff640 1 -- 172.21.15.80:0/1143422846 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc15ee90 con 0x7efefc06db10 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.766+0000 7efefb7fe640 1 --2- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 0x7efefc0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.767+0000 7efefbfff640 1 --2- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc15e520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efeec009870 tx=0x7efeec02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985f9abb77d3148a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.767+0000 7efefaffd640 1 -- 172.21.15.80:0/1143422846 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec037070 con 0x7efefc06db10 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.767+0000 7efefaffd640 1 -- 172.21.15.80:0/1143422846 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeec032440 con 0x7efefc06db10 2024-04-25T15:43:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.767+0000 7efefaffd640 1 -- 172.21.15.80:0/1143422846 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec032810 con 0x7efefc06db10 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 -- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 msgr2=0x7efefc15e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 --2- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc15e520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efeec009870 tx=0x7efeec02a270 comp rx=0 tx=0).stop 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 -- 172.21.15.80:0/1143422846 shutdown_connections 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 --2- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc0714a0 0x7efefc0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 --2- 172.21.15.80:0/1143422846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc15e520 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 -- 172.21.15.80:0/1143422846 >> 172.21.15.80:0/1143422846 conn(0x7efefc0d2080 msgr2=0x7efefc0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 -- 172.21.15.80:0/1143422846 shutdown_connections 2024-04-25T15:43:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.768+0000 7eff02a20640 1 -- 172.21.15.80:0/1143422846 wait complete. 2024-04-25T15:43:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.770+0000 7eff02a20640 1 Processor -- start 2024-04-25T15:43:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.770+0000 7eff02a20640 1 -- start start 2024-04-25T15:43:07.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff02a20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc06c5c0 0x7efefc14c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff02a20640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc1f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff02a20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 0x7efefc1f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff02a20640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efefc15f450 con 0x7efefc0714a0 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff02a20640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efefc15f780 con 0x7efefc06db10 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff02a20640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efefc15ea60 con 0x7efefc06c5c0 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff00fbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 0x7efefc1f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff00fbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 0x7efefc1f80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60310/0 (socket says 172.21.15.80:60310) 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7eff00fbd640 1 -- 172.21.15.80:0/861009179 learned_addr learned my addr 172.21.15.80:0/861009179 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7efefb7fe640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc1f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.771+0000 7efefbfff640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc06c5c0 0x7efefc14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff00fbd640 1 -- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc06c5c0 msgr2=0x7efefc14c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff00fbd640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc06c5c0 0x7efefc14c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff00fbd640 1 -- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 msgr2=0x7efefc1f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff00fbd640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc1f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff00fbd640 1 -- 172.21.15.80:0/861009179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc15a330 con 0x7efefc0714a0 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff00fbd640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 0x7efefc1f80e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efef400c6b0 tx=0x7efef400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4003b70 con 0x7efefc0714a0 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef4003d10 con 0x7efefc0714a0 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc159720 con 0x7efefc0714a0 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4005310 con 0x7efefc0714a0 2024-04-25T15:43:07.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.772+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc159ce0 con 0x7efefc0714a0 2024-04-25T15:43:07.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.773+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efefc06a100 con 0x7efefc0714a0 2024-04-25T15:43:07.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.774+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efef40054b0 con 0x7efefc0714a0 2024-04-25T15:43:07.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.774+0000 7efef8ff9640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efee80744b0 0x7efee80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:07.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.774+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efef4095c60 con 0x7efefc0714a0 2024-04-25T15:43:07.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.774+0000 7efefbfff640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efee80744b0 0x7efee80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:07.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.775+0000 7efefbfff640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efee80744b0 0x7efee80769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efeec034000 tx=0x7efeec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.778+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efefc15a330 con 0x7efefc0714a0 2024-04-25T15:43:07.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.953+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efefc0b1a00 con 0x7efefc0714a0 2024-04-25T15:43:07.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.954+0000 7efef8ff9640 1 -- 172.21.15.80:0/861009179 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7efefc071df0 con 0x7efefc0714a0 2024-04-25T15:43:07.956 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:07.956 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efee80744b0 msgr2=0x7efee80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efee80744b0 0x7efee80769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efeec034000 tx=0x7efeec02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 msgr2=0x7efefc1f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 0x7efefc1f80e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efef400c6b0 tx=0x7efef400cb70 comp rx=0 tx=0).stop 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 shutdown_connections 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efee80744b0 0x7efee80769c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efefc0714a0 0x7efefc1f80e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc06db10 0x7efefc1f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 --2- 172.21.15.80:0/861009179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efefc06c5c0 0x7efefc14c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.956+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 >> 172.21.15.80:0/861009179 conn(0x7efefc0d2080 msgr2=0x7efefc0685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.957+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 shutdown_connections 2024-04-25T15:43:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:07.957+0000 7eff02a20640 1 -- 172.21.15.80:0/861009179 wait complete. 2024-04-25T15:43:08.371 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:43:00.620270+0000', 'modified': '2024-04-25T15:43:05.669345+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.195:6833/1446733248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 1446733248}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 1446733248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-04-25T15:43:08.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:43:08.372 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T15:43:08.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.479+0000 7f10e24b6640 1 Processor -- start 2024-04-25T15:43:08.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.479+0000 7f10e24b6640 1 -- start start 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10e24b6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10dc0b7db0 0x7f10dc1647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10e24b6640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10dc0d1310 con 0x7f10dc160260 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10e24b6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10dc0d15f0 con 0x7f10dc0b4c70 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10e24b6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f10dc163cd0 con 0x7f10dc0b7db0 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10e0a53640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f10dc160260 0x7f10dc0d4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41844/0 (socket says 172.21.15.80:41844) 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10e0a53640 1 -- 172.21.15.80:0/3408882284 learned_addr learned my addr 172.21.15.80:0/3408882284 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10db7fe640 1 --2- 172.21.15.80:0/3408882284 >> v2:172.21.15.195:3300/0 conn(0x7f10dc0b7db0 0x7f10dc1647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018763858 0 0) 0x7f10dc0d1310 con 0x7f10dc160260 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.480+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10c4003520 con 0x7f10dc160260 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1007106521 0 0) 0x7f10c4003520 con 0x7f10dc160260 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 >> v2:172.21.15.195:3300/0 conn(0x7f10dc0b7db0 msgr2=0x7f10dc1647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 --2- 172.21.15.80:0/3408882284 >> v2:172.21.15.195:3300/0 conn(0x7f10dc0b7db0 0x7f10dc1647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 >> v1:172.21.15.195:6789/0 conn(0x7f10dc0b4c70 legacy=0x7f10dc0b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc163fb0 con 0x7f10dc160260 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f10d40019f0 con 0x7f10dc160260 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 >> v1:172.21.15.80:6789/0 conn(0x7f10dc160260 legacy=0x7f10dc0d4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c40039b0 0x7f10c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10c4004800 0x7f10c4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40051c0 0x7f10c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc163cd0 con 0x7f10c40039b0 2024-04-25T15:43:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10c400c160 con 0x7f10c4004800 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10c400c360 con 0x7f10c40051c0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10dbfff640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c40039b0 0x7f10c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10db7fe640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10c4004800 0x7f10c4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10e0a53640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40051c0 0x7f10c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10dbfff640 1 -- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40051c0 msgr2=0x7f10c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10dbfff640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40051c0 0x7f10c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10dbfff640 1 -- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10c4004800 msgr2=0x7f10c4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10dbfff640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10c4004800 0x7f10c4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10dbfff640 1 -- 172.21.15.80:0/3408882284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c4003520 con 0x7f10c40039b0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10e0a53640 1 -- 172.21.15.80:0/3408882284 reap_dead start 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.481+0000 7f10db7fe640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10c4004800 0x7f10c4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.482+0000 7f10dbfff640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c40039b0 0x7f10c4003e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10cc001720 tx=0x7f10c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6c58857ea0a41e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.482+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc001370 con 0x7f10c40039b0 2024-04-25T15:43:08.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.482+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10cc0052d0 con 0x7f10c40039b0 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.482+0000 7f10daffd640 1 -- 172.21.15.80:0/3408882284 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc02aaf0 con 0x7f10c40039b0 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 -- 172.21.15.80:0/3408882284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c40039b0 msgr2=0x7f10c4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c40039b0 0x7f10c4003e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10cc001720 tx=0x7f10c4005830 comp rx=0 tx=0).stop 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 -- 172.21.15.80:0/3408882284 shutdown_connections 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 --2- 172.21.15.80:0/3408882284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c40039b0 0x7f10c4003e20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 -- 172.21.15.80:0/3408882284 >> 172.21.15.80:0/3408882284 conn(0x7f10dc0d26a0 msgr2=0x7f10dc0d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 -- 172.21.15.80:0/3408882284 shutdown_connections 2024-04-25T15:43:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.483+0000 7f10e24b6640 1 -- 172.21.15.80:0/3408882284 wait complete. 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.484+0000 7f10e24b6640 1 Processor -- start 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.485+0000 7f10e24b6640 1 -- start start 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e24b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40039b0 0x7f10dc156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e24b6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10dc0cf0c0 0x7f10dc162000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e24b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 0x7f10dc0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e24b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc0b4720 con 0x7f10dc162540 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e24b6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc0b53a0 con 0x7f10dc0cf0c0 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e24b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10dc0b48a0 con 0x7f10c40039b0 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 0x7f10dc0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 0x7f10dc0ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60322/0 (socket says 172.21.15.80:60322) 2024-04-25T15:43:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 -- 172.21.15.80:0/510077857 learned_addr learned my addr 172.21.15.80:0/510077857 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10dbfff640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40039b0 0x7f10dc156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10db7fe640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10dc0cf0c0 0x7f10dc162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 -- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40039b0 msgr2=0x7f10dc156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40039b0 0x7f10dc156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 -- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10dc0cf0c0 msgr2=0x7f10dc162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10dc0cf0c0 0x7f10dc162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 -- 172.21.15.80:0/510077857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc162950 con 0x7f10dc162540 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.486+0000 7f10e0a53640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 0x7f10dc0ca2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0d37a0 tx=0x7f10d400e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.487+0000 7f10d8ff9640 1 -- 172.21.15.80:0/510077857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d400eb70 con 0x7f10dc162540 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.487+0000 7f10d8ff9640 1 -- 172.21.15.80:0/510077857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d400ed50 con 0x7f10dc162540 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.487+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10dc0cd860 con 0x7f10dc162540 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.487+0000 7f10d8ff9640 1 -- 172.21.15.80:0/510077857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4014670 con 0x7f10dc162540 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.487+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10dc0cde20 con 0x7f10dc162540 2024-04-25T15:43:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.488+0000 7f10d8ff9640 1 -- 172.21.15.80:0/510077857 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f10d4014810 con 0x7f10dc162540 2024-04-25T15:43:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.489+0000 7f10d8ff9640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10c80744b0 0x7f10c80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.489+0000 7f10dbfff640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10c80744b0 0x7f10c80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.489+0000 7f10d8ff9640 1 -- 172.21.15.80:0/510077857 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10d4095310 con 0x7f10dc162540 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.489+0000 7f10dbfff640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10c80744b0 0x7f10c80769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10cc032000 tx=0x7f10cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.490+0000 7f10e936d740 1 Processor -- start 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.490+0000 7f10e936d740 1 -- start start 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f526871600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f52686dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e936d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526847260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e936d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f5267ab740 con 0x55f526484590 2024-04-25T15:43:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f5267473a0 con 0x55f5264a5270 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55f5267a7700 con 0x55f52647c3b0 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526847260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526847260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60328/0 (socket says 172.21.15.80:60328) 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 -- 172.21.15.80:0/414174876 learned_addr learned my addr 172.21.15.80:0/414174876 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 -- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 msgr2=0x55f52686dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f52686dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10dbfff640 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f526871600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 -- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 msgr2=0x55f526871600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f526871600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.491+0000 7f10e0a53640 1 -- 172.21.15.80:0/414174876 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f526763750 con 0x55f526484590 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e0a53640 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526847260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10d405b700 tx=0x7f10d405e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8292cefede5e628b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10c1ffb640 1 -- 172.21.15.80:0/414174876 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4063410 con 0x55f526484590 2024-04-25T15:43:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10c1ffb640 1 -- 172.21.15.80:0/414174876 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d4067ec0 con 0x55f526484590 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10c1ffb640 1 -- 172.21.15.80:0/414174876 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4063070 con 0x55f526484590 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 -- 172.21.15.80:0/414174876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 msgr2=0x55f526847260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526847260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10d405b700 tx=0x7f10d405e880 comp rx=0 tx=0).stop 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 -- 172.21.15.80:0/414174876 shutdown_connections 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526847260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f52686dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 --2- 172.21.15.80:0/414174876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f526871600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 -- 172.21.15.80:0/414174876 >> 172.21.15.80:0/414174876 conn(0x55f5264993c0 msgr2=0x55f5268469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 -- 172.21.15.80:0/414174876 shutdown_connections 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.492+0000 7f10e936d740 1 -- 172.21.15.80:0/414174876 wait complete. 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.493+0000 7f10e936d740 1 -- start start 2024-04-25T15:43:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.494+0000 7f10e936d740 1 Processor -- start 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f526868280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526872da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f52688ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f526732fe0 con 0x55f526484590 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f52689b230 con 0x55f5264a5270 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55f526874e50 con 0x55f52647c3b0 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526872da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e936d740 10 client.0 _ll_register_callbacks cb 0x55f526749150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526872da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60336/0 (socket says 172.21.15.80:60336) 2024-04-25T15:43:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 -- 172.21.15.80:0/100058617 learned_addr learned my addr 172.21.15.80:0/100058617 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e0a53640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f52688ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10dbfff640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f526868280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 -- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 msgr2=0x55f526868280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f526868280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 -- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 msgr2=0x55f52688ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f52688ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 -- 172.21.15.80:0/100058617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5264bd2d0 con 0x55f526484590 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10e0a53640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f52688ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10db7fe640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526872da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10d0003630 tx=0x7f10d0003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf1b2f88273a61e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10baffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.495+0000 7f10baffd640 1 -- 172.21.15.80:0/100058617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d001a070 con 0x55f526484590 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10d4067ec0 con 0x55f526484590 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10baffd640 1 -- 172.21.15.80:0/100058617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10d0009b70 con 0x55f526484590 2024-04-25T15:43:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10baffd640 1 -- 172.21.15.80:0/100058617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f10d0025050 con 0x55f526484590 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 10 client.4437 fetch_fsmap learned FSMap version 6 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55f5265876b0 con 0x55f526484590 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10baffd640 1 -- 172.21.15.80:0/100058617 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d4067ec0 con 0x55f526484590 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10baffd640 1 -- 172.21.15.80:0/100058617 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f10d0028020 con 0x55f526484590 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 10 client.4437 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 10 client.4437 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 20 client.4437 populate_metadata read hostname 'smithi080' 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526463e40 0x55f52689ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 4 client.4437 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 --> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5267b9350 con 0x55f526463e40 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.496+0000 7f10dbfff640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526463e40 0x55f52689ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.497+0000 7f10baffd640 10 client.4437 ms_handle_connect on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.497+0000 7f10dbfff640 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526463e40 0x55f52689ed00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72cc23dba55d6df2 server_cookie=6ac679506d74f88a in_seq=0 out_seq=0 2024-04-25T15:43:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.497+0000 7f10baffd640 1 -- 172.21.15.80:0/100058617 <== mds.0 v2:172.21.15.195:6832/1446733248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f5267b9350 con 0x55f526463e40 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.497+0000 7f10baffd640 10 client.4437 handle_command_reply: tid=0 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.497+0000 7f10e936d740 1 client.4437 shutdown 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 msgr2=0x55f526872da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526872da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10d0003630 tx=0x7f10d0003af0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 shutdown_connections 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526463e40 0x55f52689ed00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5264a5270 0x55f52688ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10baffd640 0 client.4437 ms_handle_reset on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526484590 0x55f526872da0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 --2- 172.21.15.80:0/100058617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f52647c3b0 0x55f526868280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 >> 172.21.15.80:0/100058617 conn(0x55f5264993c0 msgr2=0x55f5268469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 shutdown_connections 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 1 -- 172.21.15.80:0/100058617 wait complete. 2024-04-25T15:43:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.498+0000 7f10e936d740 20 client.4437 trim_cache size 0 max 16384 2024-04-25T15:43:08.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.516+0000 7f10e936d740 1 Processor -- start 2024-04-25T15:43:08.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.516+0000 7f10e936d740 1 -- start start 2024-04-25T15:43:08.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10e936d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f526840be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526841120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f5268a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10e936d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc2034a0 con 0x55f526463e40 2024-04-25T15:43:08.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc202800 con 0x55f52647c3b0 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10dc202e50 con 0x55f526484590 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f526840be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f526840be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60346/0 (socket says 172.21.15.80:60346) 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 -- 172.21.15.80:0/1677333144 learned_addr learned my addr 172.21.15.80:0/1677333144 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 -- 172.21.15.80:0/1677333144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 msgr2=0x55f5268a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f5268a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 -- 172.21.15.80:0/1677333144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 msgr2=0x55f526841120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526841120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 -- 172.21.15.80:0/1677333144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5268716a0 con 0x55f526463e40 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10dbfff640 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f526840be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10cc005040 tx=0x7f10cc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52f68bba24f417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10c17fa640 1 -- 172.21.15.80:0/1677333144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc037040 con 0x55f526463e40 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10c17fa640 1 -- 172.21.15.80:0/1677333144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10cc0067d0 con 0x55f526463e40 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.518+0000 7f10c17fa640 1 -- 172.21.15.80:0/1677333144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc006bc0 con 0x55f526463e40 2024-04-25T15:43:08.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 -- 172.21.15.80:0/1677333144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 msgr2=0x55f526840be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f526840be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10cc005040 tx=0x7f10cc02c000 comp rx=0 tx=0).stop 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 -- 172.21.15.80:0/1677333144 shutdown_connections 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f5268a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526841120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 --2- 172.21.15.80:0/1677333144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f526840be0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 -- 172.21.15.80:0/1677333144 >> 172.21.15.80:0/1677333144 conn(0x55f5264993c0 msgr2=0x55f52688ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 -- 172.21.15.80:0/1677333144 shutdown_connections 2024-04-25T15:43:08.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.519+0000 7f10e936d740 1 -- 172.21.15.80:0/1677333144 wait complete. 2024-04-25T15:43:08.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.520+0000 7f10e936d740 1 -- start start 2024-04-25T15:43:08.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.520+0000 7f10e936d740 1 Processor -- start 2024-04-25T15:43:08.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f5269093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526847020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f526840be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f52688b450 con 0x55f526463e40 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f5268732e0 con 0x55f52647c3b0 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55f526874300 con 0x55f526484590 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10e936d740 10 client.0 _ll_register_callbacks cb 0x7f10d0004730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f5269093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f5269093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60362/0 (socket says 172.21.15.80:60362) 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.521+0000 7f10dbfff640 1 -- 172.21.15.80:0/2457741023 learned_addr learned my addr 172.21.15.80:0/2457741023 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10db7fe640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526847020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e0a53640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f526840be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10dbfff640 1 -- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 msgr2=0x55f526840be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10dbfff640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f526840be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10dbfff640 1 -- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 msgr2=0x55f526847020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10dbfff640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526847020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10dbfff640 1 -- 172.21.15.80:0/2457741023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5268a5230 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10dbfff640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f5269093e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f10cc001780 tx=0x7f10cc001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e78bd70980c889 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10baffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10baffd640 1 -- 172.21.15.80:0/2457741023 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc037040 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10baffd640 1 -- 172.21.15.80:0/2457741023 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10cc006b80 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10cc0067d0 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10baffd640 1 -- 172.21.15.80:0/2457741023 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f10cc05e050 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 10 client.4443 fetch_fsmap learned FSMap version 6 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55f52688eb70 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10baffd640 1 -- 172.21.15.80:0/2457741023 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10cc0067d0 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10baffd640 1 -- 172.21.15.80:0/2457741023 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f10cc061020 con 0x55f526463e40 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 10 client.4443 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T15:43:08.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 10 client.4443 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 20 client.4443 populate_metadata read hostname 'smithi080' 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526439280 0x55f52686cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 4 client.4443 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.522+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 --> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] -- command(tid 0: {"prefix": "status"}) -- 0x55f526842200 con 0x55f526439280 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10db7fe640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526439280 0x55f52686cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10db7fe640 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526439280 0x55f52686cd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c6223226c9322d server_cookie=86c3ae4696c0c9a8 in_seq=0 out_seq=0 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10baffd640 10 client.4443 ms_handle_connect on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10baffd640 1 -- 172.21.15.80:0/2457741023 <== mds.0 v2:172.21.15.195:6832/1446733248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x55f526842200 con 0x55f526439280 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10baffd640 10 client.4443 handle_command_reply: tid=0 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 client.4443 shutdown 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 msgr2=0x55f5269093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f5269093e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f10cc001780 tx=0x7f10cc001190 comp rx=0 tx=0).stop 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 shutdown_connections 2024-04-25T15:43:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x55f526439280 0x55f52686cd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f526484590 0x55f526840be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f52647c3b0 0x55f526847020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10baffd640 0 client.4443 ms_handle_reset on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 --2- 172.21.15.80:0/2457741023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f526463e40 0x55f5269093e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.523+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 >> 172.21.15.80:0/2457741023 conn(0x55f5264993c0 msgr2=0x55f52688acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 shutdown_connections 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e936d740 1 -- 172.21.15.80:0/2457741023 wait complete. 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e936d740 20 client.4443 trim_cache size 0 max 16384 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:43:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4285, 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.246146092, 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 6, 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 25, 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 13.802434812 2024-04-25T15:43:08.531 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10c80744b0 msgr2=0x7f10c80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10c80744b0 0x7f10c80769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10cc032000 tx=0x7f10cc02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 msgr2=0x7f10dc0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 0x7f10dc0ca2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0d37a0 tx=0x7f10d400e160 comp rx=0 tx=0).stop 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 shutdown_connections 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10c80744b0 0x7f10c80769c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10dc162540 0x7f10dc0ca2d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10dc0cf0c0 0x7f10dc162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 --2- 172.21.15.80:0/510077857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10c40039b0 0x7f10dc156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 >> 172.21.15.80:0/510077857 conn(0x7f10dc0d26a0 msgr2=0x7f10dc0b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 shutdown_connections 2024-04-25T15:43:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.524+0000 7f10e24b6640 1 -- 172.21.15.80:0/510077857 wait complete. 2024-04-25T15:43:08.536 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:43:08.536 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:08.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:43:08.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.643+0000 7f42e859d640 1 Processor -- start 2024-04-25T15:43:08.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.643+0000 7f42e859d640 1 -- start start 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e859d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f42e00b1230 0x7f42e0160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e859d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42e00cea40 0x7f42e00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e859d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e0160c60 con 0x7f42e00cf390 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e859d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f42e00cf8c0 con 0x7f42e00cea40 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e859d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f42e006d100 con 0x7f42e00b1230 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e5b38640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42e00cea40 0x7f42e00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e5b38640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42e00cea40 0x7f42e00cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60366/0 (socket says 172.21.15.80:60366) 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.644+0000 7f42e5b38640 1 -- 172.21.15.80:0/3821557993 learned_addr learned my addr 172.21.15.80:0/3821557993 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e6339640 1 --2- 172.21.15.80:0/3821557993 >> v2:172.21.15.195:3300/0 conn(0x7f42e00b1230 0x7f42e0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e5b38640 1 -- 172.21.15.80:0/3821557993 >> v2:172.21.15.195:3300/0 conn(0x7f42e00b1230 msgr2=0x7f42e0160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e5b38640 1 --2- 172.21.15.80:0/3821557993 >> v2:172.21.15.195:3300/0 conn(0x7f42e00b1230 0x7f42e0160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e5b38640 1 -- 172.21.15.80:0/3821557993 >> v1:172.21.15.195:6789/0 conn(0x7f42e00cf390 legacy=0x7f42e00d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:08.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e5b38640 1 -- 172.21.15.80:0/3821557993 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e006d3e0 con 0x7f42e00cea40 2024-04-25T15:43:08.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e5b38640 1 --2- 172.21.15.80:0/3821557993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00cea40 0x7f42e00cee50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42e00b8310 tx=0x7f42d002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373f4b405bce7e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.645+0000 7f42e5337640 1 -- 172.21.15.80:0/3821557993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0032710 con 0x7f42e00cea40 2024-04-25T15:43:08.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e5337640 1 -- 172.21.15.80:0/3821557993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d00328b0 con 0x7f42e00cea40 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e5337640 1 -- 172.21.15.80:0/3821557993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0032ca0 con 0x7f42e00cea40 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 -- 172.21.15.80:0/3821557993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00cea40 msgr2=0x7f42e00cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 --2- 172.21.15.80:0/3821557993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00cea40 0x7f42e00cee50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42e00b8310 tx=0x7f42d002c850 comp rx=0 tx=0).stop 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 -- 172.21.15.80:0/3821557993 shutdown_connections 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 --2- 172.21.15.80:0/3821557993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00cea40 0x7f42e00cee50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 --2- 172.21.15.80:0/3821557993 >> v2:172.21.15.195:3300/0 conn(0x7f42e00b1230 0x7f42e0160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 -- 172.21.15.80:0/3821557993 >> 172.21.15.80:0/3821557993 conn(0x7f42e009b410 msgr2=0x7f42e00b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 -- 172.21.15.80:0/3821557993 shutdown_connections 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.646+0000 7f42e859d640 1 -- 172.21.15.80:0/3821557993 wait complete. 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.648+0000 7f42e859d640 1 Processor -- start 2024-04-25T15:43:08.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.648+0000 7f42e859d640 1 -- start start 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.649+0000 7f42e859d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 0x7f42e0150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.649+0000 7f42e859d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42e00cea40 0x7f42e015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.649+0000 7f42e859d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42e00cf390 0x7f42e01f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.649+0000 7f42e859d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f42e006dec0 con 0x7f42e00b1230 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.649+0000 7f42e859d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f42e006d9a0 con 0x7f42e00cea40 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.649+0000 7f42e859d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42e006e040 con 0x7f42e00cf390 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 0x7f42e0150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 0x7f42e0150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60370/0 (socket says 172.21.15.80:60370) 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 -- 172.21.15.80:0/116259626 learned_addr learned my addr 172.21.15.80:0/116259626 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e5b38640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42e00cea40 0x7f42e015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6b3a640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42e00cf390 0x7f42e01f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 -- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42e00cf390 msgr2=0x7f42e01f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42e00cf390 0x7f42e01f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 -- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42e00cea40 msgr2=0x7f42e015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42e00cea40 0x7f42e015c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 -- 172.21.15.80:0/116259626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e014fa00 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6b3a640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42e00cf390 0x7f42e01f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e6339640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 0x7f42e0150aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00d620 tx=0x7f42dc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00b620 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc019070 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e014fce0 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00ba00 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.650+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e01502a0 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.651+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e006a100 con 0x7f42e00b1230 2024-04-25T15:43:08.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.652+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f42dc00bba0 con 0x7f42e00b1230 2024-04-25T15:43:08.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.652+0000 7f42d6ffd640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42c40744b0 0x7f42c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:08.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.652+0000 7f42e5b38640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42c40744b0 0x7f42c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:08.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.653+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42dc095910 con 0x7f42e00b1230 2024-04-25T15:43:08.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.653+0000 7f42e5b38640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42c40744b0 0x7f42c40769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42d0037000 tx=0x7f42d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:08.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.657+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42dc05fd60 con 0x7f42e00b1230 2024-04-25T15:43:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.870+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f42e015dca0 con 0x7f42e00b1230 2024-04-25T15:43:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.870+0000 7f42d6ffd640 1 -- 172.21.15.80:0/116259626 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f42dc05f660 con 0x7f42e00b1230 2024-04-25T15:43:08.872 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T15:43:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42c40744b0 msgr2=0x7f42c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42c40744b0 0x7f42c40769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42d0037000 tx=0x7f42d0008040 comp rx=0 tx=0).stop 2024-04-25T15:43:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 msgr2=0x7f42e0150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 0x7f42e0150aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00d620 tx=0x7f42dc00dae0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 shutdown_connections 2024-04-25T15:43:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42c40744b0 0x7f42c40769c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42e00cf390 0x7f42e01f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42e00cea40 0x7f42e015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 --2- 172.21.15.80:0/116259626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42e00b1230 0x7f42e0150aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 >> 172.21.15.80:0/116259626 conn(0x7f42e009b410 msgr2=0x7f42e00b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 shutdown_connections 2024-04-25T15:43:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08.873+0000 7f42e859d640 1 -- 172.21.15.80:0/116259626 wait complete. 2024-04-25T15:43:08.884 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:43:08.885 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T15:43:08.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:08.885 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:08.900 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42768sec preferred_lft 42768sec 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:43:08.901 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:08.902 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:43:08.902 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:08.902 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:08.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:43:08.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-25T15:43:08.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-25T15:43:08.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:43:08.903 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:08.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:09.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:09.077 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:43:09.100 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:43:09.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:09.101 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:43:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:43:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:43:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:43:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:43:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:43:09.164 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:09.164 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:09.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:43:09.165 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:43:09.165 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:43:09.165 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:09.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:09.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:09.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:09.421 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:43:09.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:09.436 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-25T15:43:09.490 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:09.491 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:09.491 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T15:43:09.491 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T15:43:09.491 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:09.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:09.608 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T15:43:09.608 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:09.608 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:09.608 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T15:43:09.608 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:43:09.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T15:43:09.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T15:43:09.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T15:43:09.609 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:09.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:09.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:09.729 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:09.730 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:09.730 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:43:09.730 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:43:09.730 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:09.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:09.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:09.805 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T15:43:09.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:09.805 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:09.819 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T15:43:09.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:09.819 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:09.874 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-25T15:43:09.938 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-25T15:43:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-25T15:43:09.995 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T15:43:09.996 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T15:43:09.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:09.997 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-25T15:43:10.048 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T15:43:10.048 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T15:43:10.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-25T15:43:10.113 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-25T15:43:10.172 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-25T15:43:10.173 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T15:43:10.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:10.174 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-25T15:43:10.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:2024-04-25T15:43:10.188+0000 7f0992088480 -1 init, newargv = 0x5557fb217560 newargc=15 2024-04-25T15:43:10.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[41870]: starting ceph client 2024-04-25T15:43:10.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[41870]: starting fuse 2024-04-25T15:43:10.206 INFO:teuthology.orchestra.run.smithi080.stdout:43 2024-04-25T15:43:10.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo stdin-killer -- python3 -c ' 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> import glob 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> import re 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> import os 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> import subprocess 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> def _find_admin_socket(client_name): 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> files = glob.glob(asok_path) 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-25T15:43:10.207 DEBUG:teuthology.orchestra.run.smithi080:> # Given a non-glob path, it better be there 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> if "*" not in asok_path: 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> assert(len(files) == 1) 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> return files[0] 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> for f in files: 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> contents = proc_f.read() 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> if mountpoint in contents: 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> return f 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> print(_find_admin_socket("client.admin")) 2024-04-25T15:43:10.208 DEBUG:teuthology.orchestra.run.smithi080:> ' 2024-04-25T15:43:10.324 INFO:teuthology.orchestra.run.smithi080.stdout:/var/run/ceph/ceph-client.admin.41870.asok 2024-04-25T15:43:10.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:10.334 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41870.asok 2024-04-25T15:43:10.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:10.334 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41870.asok status 2024-04-25T15:43:10.476 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": { 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "admin", 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "pid": "41870", 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_count": 0, 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_pinned_count": 0, 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4452, 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": { 2024-04-25T15:43:10.477 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 4452 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3581780456 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3581780456 2024-04-25T15:43:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "inst_str": "client.4452 192.168.0.1:0/3581780456", 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addr_str": "192.168.0.1:0/3581780456", 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "inode_count": 1, 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_epoch": 6, 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch": 25, 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch_barrier": 0, 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklisted": false, 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs" 2024-04-25T15:43:10.479 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:43:10.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:10.485 DEBUG:teuthology.orchestra.run.smithi080:> stat --file-system '--printf=%T 2024-04-25T15:43:10.485 DEBUG:teuthology.orchestra.run.smithi080:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:10.500 INFO:teuthology.orchestra.run.smithi080.stdout:fuseblk 2024-04-25T15:43:10.500 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:10.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:10.500 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:10.566 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T15:43:10.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:10.680 INFO:teuthology.orchestra.run.smithi080.stdout:# file: . 2024-04-25T15:43:10.680 INFO:teuthology.orchestra.run.smithi080.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T15:43:10.680 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:10.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:10.687 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:10.687 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:10.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:10.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.849+0000 7fc98aa51640 1 Processor -- start 2024-04-25T15:43:10.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.849+0000 7fc98aa51640 1 -- start start 2024-04-25T15:43:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc98aa51640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9840b0d80 0x7fc98415c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc98aa51640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9840703e0 con 0x7fc984074240 2024-04-25T15:43:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc98aa51640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9840affc0 con 0x7fc9840b65a0 2024-04-25T15:43:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc98aa51640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc9840b02a0 con 0x7fc9840b0d80 2024-04-25T15:43:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc983fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9840b0d80 0x7fc98415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:10.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc983fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9840b0d80 0x7fc98415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60386/0 (socket says 172.21.15.80:60386) 2024-04-25T15:43:10.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc988fee640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc984074240 0x7fc9840b4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41846/0 (socket says 172.21.15.80:41846) 2024-04-25T15:43:10.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc983fff640 1 -- 172.21.15.80:0/2201096528 learned_addr learned my addr 172.21.15.80:0/2201096528 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:10.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc983fff640 1 -- 172.21.15.80:0/2201096528 >> v1:172.21.15.195:6789/0 conn(0x7fc9840b65a0 legacy=0x7fc984073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:10.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc983fff640 1 -- 172.21.15.80:0/2201096528 >> v1:172.21.15.80:6789/0 conn(0x7fc984074240 legacy=0x7fc9840b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:10.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.851+0000 7fc983fff640 1 -- 172.21.15.80:0/2201096528 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9840b0580 con 0x7fc9840b0d80 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.852+0000 7fc983fff640 1 --2- 172.21.15.80:0/2201096528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840b0d80 0x7fc98415c670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc974009870 tx=0x7fc97402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255a1096e286789d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.852+0000 7fc982ffd640 1 -- 172.21.15.80:0/2201096528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974037070 con 0x7fc9840b0d80 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.852+0000 7fc982ffd640 1 -- 172.21.15.80:0/2201096528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc974032440 con 0x7fc9840b0d80 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.852+0000 7fc982ffd640 1 -- 172.21.15.80:0/2201096528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974032810 con 0x7fc9840b0d80 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 -- 172.21.15.80:0/2201096528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840b0d80 msgr2=0x7fc98415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 --2- 172.21.15.80:0/2201096528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840b0d80 0x7fc98415c670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc974009870 tx=0x7fc97402a2a0 comp rx=0 tx=0).stop 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 -- 172.21.15.80:0/2201096528 shutdown_connections 2024-04-25T15:43:10.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 --2- 172.21.15.80:0/2201096528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840b0d80 0x7fc98415c670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 -- 172.21.15.80:0/2201096528 >> 172.21.15.80:0/2201096528 conn(0x7fc9840d1e20 msgr2=0x7fc984073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 -- 172.21.15.80:0/2201096528 shutdown_connections 2024-04-25T15:43:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.853+0000 7fc98aa51640 1 -- 172.21.15.80:0/2201096528 wait complete. 2024-04-25T15:43:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.855+0000 7fc98aa51640 1 Processor -- start 2024-04-25T15:43:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.855+0000 7fc98aa51640 1 -- start start 2024-04-25T15:43:10.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc98aa51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9840b0d80 0x7fc9840cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:10.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc98aa51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9840b65a0 0x7fc98414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:10.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc98aa51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 0x7fc9840cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:10.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc98aa51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc98406fe10 con 0x7fc9840cb620 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc98aa51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc9840ae7c0 con 0x7fc9840b0d80 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc98aa51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc98406ff90 con 0x7fc9840b65a0 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 0x7fc9840cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 0x7fc9840cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60392/0 (socket says 172.21.15.80:60392) 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 -- 172.21.15.80:0/4102016825 learned_addr learned my addr 172.21.15.80:0/4102016825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc9837fe640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9840b65a0 0x7fc98414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc983fff640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9840b0d80 0x7fc9840cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 -- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9840b65a0 msgr2=0x7fc98414dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9840b65a0 0x7fc98414dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 -- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9840b0d80 msgr2=0x7fc9840cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9840b0d80 0x7fc9840cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.856+0000 7fc988fee640 1 -- 172.21.15.80:0/4102016825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9840cbf70 con 0x7fc9840cb620 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.857+0000 7fc988fee640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 0x7fc9840cba30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c760 tx=0x7fc97c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.857+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c017070 con 0x7fc9840cb620 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.857+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97c00a640 con 0x7fc9840cb620 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.857+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98415f750 con 0x7fc9840cb620 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.857+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00a9f0 con 0x7fc9840cb620 2024-04-25T15:43:10.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.857+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98415ebd0 con 0x7fc9840cb620 2024-04-25T15:43:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.858+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98406a100 con 0x7fc9840cb620 2024-04-25T15:43:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.858+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc97c01a070 con 0x7fc9840cb620 2024-04-25T15:43:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.859+0000 7fc980ff9640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9700744b0 0x7fc9700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.859+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc97c094a40 con 0x7fc9840cb620 2024-04-25T15:43:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.859+0000 7fc983fff640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9700744b0 0x7fc9700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.859+0000 7fc983fff640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9700744b0 0x7fc9700769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc974034000 tx=0x7fc97402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:10.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:10.864+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9840cbf70 con 0x7fc9840cb620 2024-04-25T15:43:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.041+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9841573f0 con 0x7fc9840cb620 2024-04-25T15:43:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.042+0000 7fc980ff9640 1 -- 172.21.15.80:0/4102016825 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fc97c094e20 con 0x7fc9840cb620 2024-04-25T15:43:11.043 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:11.043 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9700744b0 msgr2=0x7fc9700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9700744b0 0x7fc9700769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc974034000 tx=0x7fc97402e000 comp rx=0 tx=0).stop 2024-04-25T15:43:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 msgr2=0x7fc9840cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 0x7fc9840cba30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c760 tx=0x7fc97c00cc20 comp rx=0 tx=0).stop 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 shutdown_connections 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9700744b0 0x7fc9700769c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9840cb620 0x7fc9840cba30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9840b65a0 0x7fc98414dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 --2- 172.21.15.80:0/4102016825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9840b0d80 0x7fc9840cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 >> 172.21.15.80:0/4102016825 conn(0x7fc9840d1e20 msgr2=0x7fc9840b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 shutdown_connections 2024-04-25T15:43:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.044+0000 7fc98aa51640 1 -- 172.21.15.80:0/4102016825 wait complete. 2024-04-25T15:43:11.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:11.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:11.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.166+0000 7f611e249640 1 Processor -- start 2024-04-25T15:43:11.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.166+0000 7f611e249640 1 -- start start 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f611e249640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f61180cf2f0 0x7f61180d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f611e249640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f611806ece0 0x7f61180b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f611e249640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61180d02c0 con 0x7f61180b3ae0 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f611e249640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f611806cab0 con 0x7f611806ece0 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f611e249640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f61180d1f10 con 0x7f61180cf2f0 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f6116ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f611806ece0 0x7f61180b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f6117fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f61180b3ae0 0x7f61180d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41860/0 (socket says 172.21.15.80:41860) 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f6117fff640 1 -- 172.21.15.80:0/3104903422 learned_addr learned my addr 172.21.15.80:0/3104903422 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.167+0000 7f61177fe640 1 --2- 172.21.15.80:0/3104903422 >> v2:172.21.15.195:3300/0 conn(0x7f61180cf2f0 0x7f61180d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f6116ffd640 1 -- 172.21.15.80:0/3104903422 >> v2:172.21.15.195:3300/0 conn(0x7f61180cf2f0 msgr2=0x7f61180d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f6116ffd640 1 --2- 172.21.15.80:0/3104903422 >> v2:172.21.15.195:3300/0 conn(0x7f61180cf2f0 0x7f61180d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f6116ffd640 1 -- 172.21.15.80:0/3104903422 >> v1:172.21.15.80:6789/0 conn(0x7f61180b3ae0 legacy=0x7f61180d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f6116ffd640 1 -- 172.21.15.80:0/3104903422 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61180b3ef0 con 0x7f611806ece0 2024-04-25T15:43:11.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f61167fc640 1 -- 172.21.15.80:0/3104903422 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298589210 0 0) 0x7f61180d02c0 con 0x7f61180b3ae0 2024-04-25T15:43:11.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f61177fe640 1 --2- 172.21.15.80:0/3104903422 >> v2:172.21.15.195:3300/0 conn(0x7f61180cf2f0 0x7f61180d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f6116ffd640 1 --2- 172.21.15.80:0/3104903422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611806ece0 0x7f61180b35a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61180d3980 tx=0x7f610c02e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af83f814441af4a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f61167fc640 1 -- 172.21.15.80:0/3104903422 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c03a070 con 0x7f611806ece0 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f61167fc640 1 -- 172.21.15.80:0/3104903422 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c00b650 con 0x7f611806ece0 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.168+0000 7f61167fc640 1 -- 172.21.15.80:0/3104903422 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c00ba20 con 0x7f611806ece0 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 -- 172.21.15.80:0/3104903422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611806ece0 msgr2=0x7f61180b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 --2- 172.21.15.80:0/3104903422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611806ece0 0x7f61180b35a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61180d3980 tx=0x7f610c02e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 -- 172.21.15.80:0/3104903422 shutdown_connections 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 --2- 172.21.15.80:0/3104903422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611806ece0 0x7f61180b35a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 --2- 172.21.15.80:0/3104903422 >> v2:172.21.15.195:3300/0 conn(0x7f61180cf2f0 0x7f61180d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 -- 172.21.15.80:0/3104903422 >> 172.21.15.80:0/3104903422 conn(0x7f61180b75f0 msgr2=0x7f61180b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 -- 172.21.15.80:0/3104903422 shutdown_connections 2024-04-25T15:43:11.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.169+0000 7f611e249640 1 -- 172.21.15.80:0/3104903422 wait complete. 2024-04-25T15:43:11.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.171+0000 7f611e249640 1 Processor -- start 2024-04-25T15:43:11.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.171+0000 7f611e249640 1 -- start start 2024-04-25T15:43:11.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f611e249640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f611806ece0 0x7f61181f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f611e249640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61180b3ae0 0x7f611815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f611e249640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 0x7f61180d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f611e249640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f611806c740 con 0x7f61180cf2f0 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f611e249640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f61180d2440 con 0x7f61180b3ae0 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f611e249640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f611806df50 con 0x7f611806ece0 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.172+0000 7f6117fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 0x7f61180d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 0x7f61180d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60412/0 (socket says 172.21.15.80:60412) 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 -- 172.21.15.80:0/66871119 learned_addr learned my addr 172.21.15.80:0/66871119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6116ffd640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61180b3ae0 0x7f611815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f61177fe640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f611806ece0 0x7f61181f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 -- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f611806ece0 msgr2=0x7f61181f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f611806ece0 0x7f61181f6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 -- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61180b3ae0 msgr2=0x7f611815aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61180b3ae0 0x7f611815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 -- 172.21.15.80:0/66871119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61181f69d0 con 0x7f61180cf2f0 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f6117fff640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 0x7f61180d2680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f611000c730 tx=0x7f611000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6110018070 con 0x7f61180cf2f0 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611000ce40 con 0x7f61180cf2f0 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61180c7460 con 0x7f61180cf2f0 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611000a880 con 0x7f61180cf2f0 2024-04-25T15:43:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.173+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61180c7990 con 0x7f61180cf2f0 2024-04-25T15:43:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.174+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61180b1110 con 0x7f61180cf2f0 2024-04-25T15:43:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.175+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f611001b070 con 0x7f61180cf2f0 2024-04-25T15:43:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.175+0000 7f60fffff640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61040744b0 0x7f61040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.175+0000 7f61177fe640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61040744b0 0x7f61040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.176+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6110094a60 con 0x7f61180cf2f0 2024-04-25T15:43:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.176+0000 7f61177fe640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61040744b0 0x7f61040769c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61080096d0 tx=0x7f6108008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.180+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61181f69d0 con 0x7f61180cf2f0 2024-04-25T15:43:11.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.354+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f61180c7720 con 0x7f61180cf2f0 2024-04-25T15:43:11.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.355+0000 7f60fffff640 1 -- 172.21.15.80:0/66871119 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f611005ef40 con 0x7f61180cf2f0 2024-04-25T15:43:11.356 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61040744b0 msgr2=0x7f61040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61040744b0 0x7f61040769c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61080096d0 tx=0x7f6108008040 comp rx=0 tx=0).stop 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 msgr2=0x7f61180d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 0x7f61180d2680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f611000c730 tx=0x7f611000cbf0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 shutdown_connections 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61040744b0 0x7f61040769c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61180cf2f0 0x7f61180d2680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61180b3ae0 0x7f611815aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 --2- 172.21.15.80:0/66871119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f611806ece0 0x7f61181f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 >> 172.21.15.80:0/66871119 conn(0x7f61180b75f0 msgr2=0x7f611815bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 shutdown_connections 2024-04-25T15:43:11.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.357+0000 7f611e249640 1 -- 172.21.15.80:0/66871119 wait complete. 2024-04-25T15:43:11.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:11.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.477+0000 7f50d8b84640 1 Processor -- start 2024-04-25T15:43:11.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.477+0000 7f50d8b84640 1 -- start start 2024-04-25T15:43:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.478+0000 7f50d8b84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40b5490 0x7f50d4160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50d8b84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50d40d0b00 0x7f50d40d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50d8b84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d40d57e0 con 0x7f50d40d2b80 2024-04-25T15:43:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50d8b84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f50d41643f0 con 0x7f50d40d0b00 2024-04-25T15:43:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50d8b84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50d41646d0 con 0x7f50d40b5490 2024-04-25T15:43:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50d40d0b00 0x7f50d40d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50d40d0b00 0x7f50d40d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60428/0 (socket says 172.21.15.80:60428) 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 -- 172.21.15.80:0/4030678041 learned_addr learned my addr 172.21.15.80:0/4030678041 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50d259c640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40b5490 0x7f50d4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 -- 172.21.15.80:0/4030678041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40b5490 msgr2=0x7f50d4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40b5490 0x7f50d4160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 -- 172.21.15.80:0/4030678041 >> v1:172.21.15.195:6789/0 conn(0x7f50d40d2b80 legacy=0x7f50d40b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50cbfff640 1 -- 172.21.15.80:0/4030678041 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d41649b0 con 0x7f50d40d0b00 2024-04-25T15:43:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.479+0000 7f50d259c640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40b5490 0x7f50d4160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:11.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.480+0000 7f50cbfff640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d0b00 0x7f50d40d2640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009870 tx=0x7f50bc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5811e0e89b6e30f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.480+0000 7f50d1d9b640 1 -- 172.21.15.80:0/4030678041 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc037070 con 0x7f50d40d0b00 2024-04-25T15:43:11.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.480+0000 7f50d1d9b640 1 -- 172.21.15.80:0/4030678041 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc032440 con 0x7f50d40d0b00 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.480+0000 7f50d1d9b640 1 -- 172.21.15.80:0/4030678041 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc032810 con 0x7f50d40d0b00 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 -- 172.21.15.80:0/4030678041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d0b00 msgr2=0x7f50d40d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d0b00 0x7f50d40d2640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009870 tx=0x7f50bc02a210 comp rx=0 tx=0).stop 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 -- 172.21.15.80:0/4030678041 shutdown_connections 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d0b00 0x7f50d40d2640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 --2- 172.21.15.80:0/4030678041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40b5490 0x7f50d4160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 -- 172.21.15.80:0/4030678041 >> 172.21.15.80:0/4030678041 conn(0x7f50d406e650 msgr2=0x7f50d406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 -- 172.21.15.80:0/4030678041 shutdown_connections 2024-04-25T15:43:11.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.481+0000 7f50d8b84640 1 -- 172.21.15.80:0/4030678041 wait complete. 2024-04-25T15:43:11.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.482+0000 7f50d8b84640 1 Processor -- start 2024-04-25T15:43:11.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.483+0000 7f50d8b84640 1 -- start start 2024-04-25T15:43:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d8b84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40d0b00 0x7f50d40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d8b84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 0x7f50d40b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d8b84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50d40b0df0 0x7f50d40b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d8b84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50d40d2f90 con 0x7f50d40d2b80 2024-04-25T15:43:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d8b84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4160840 con 0x7f50d40b0df0 2024-04-25T15:43:11.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d8b84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50d40b9360 con 0x7f50d40d0b00 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 0x7f50d40b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 0x7f50d40b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60442/0 (socket says 172.21.15.80:60442) 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 -- 172.21.15.80:0/1598941590 learned_addr learned my addr 172.21.15.80:0/1598941590 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d259c640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40d0b00 0x7f50d40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50d2d9d640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50d40b0df0 0x7f50d40b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 -- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40d0b00 msgr2=0x7f50d40cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40d0b00 0x7f50d40cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 -- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50d40b0df0 msgr2=0x7f50d40b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50d40b0df0 0x7f50d40b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 -- 172.21.15.80:0/1598941590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d40b1b60 con 0x7f50d40d2b80 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50cbfff640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 0x7f50d40b2c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009870 tx=0x7f50bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.484+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc041020 con 0x7f50d40d2b80 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.485+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc030970 con 0x7f50d40d2b80 2024-04-25T15:43:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.485+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc037040 con 0x7f50d40d2b80 2024-04-25T15:43:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.485+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d40b1e40 con 0x7f50d40d2b80 2024-04-25T15:43:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.485+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d40b2400 con 0x7f50d40d2b80 2024-04-25T15:43:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.486+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d406a100 con 0x7f50d40d2b80 2024-04-25T15:43:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.486+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f50bc044020 con 0x7f50d40d2b80 2024-04-25T15:43:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.487+0000 7f50caffd640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50b40744b0 0x7f50b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.487+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f50bc0b6060 con 0x7f50d40d2b80 2024-04-25T15:43:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.487+0000 7f50d259c640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50b40744b0 0x7f50b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.487+0000 7f50d259c640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50b40744b0 0x7f50b40769c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50d40d08c0 tx=0x7f50c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.491+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50bc04b030 con 0x7f50d40d2b80 2024-04-25T15:43:11.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.667+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50d40b18f0 con 0x7f50d40d2b80 2024-04-25T15:43:11.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.667+0000 7f50caffd640 1 -- 172.21.15.80:0/1598941590 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f50bc0804b0 con 0x7f50d40d2b80 2024-04-25T15:43:11.668 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50b40744b0 msgr2=0x7f50b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50b40744b0 0x7f50b40769c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50d40d08c0 tx=0x7f50c4008040 comp rx=0 tx=0).stop 2024-04-25T15:43:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 msgr2=0x7f50d40b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 0x7f50d40b2c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009870 tx=0x7f50bc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 shutdown_connections 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50b40744b0 0x7f50b40769c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50d40b0df0 0x7f50d40b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50d40d2b80 0x7f50d40b2c00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 --2- 172.21.15.80:0/1598941590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50d40d0b00 0x7f50d40cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 >> 172.21.15.80:0/1598941590 conn(0x7f50d406e650 msgr2=0x7f50d40cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 shutdown_connections 2024-04-25T15:43:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.669+0000 7f50d8b84640 1 -- 172.21.15.80:0/1598941590 wait complete. 2024-04-25T15:43:11.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:11.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.789+0000 7f19ff59e640 1 Processor -- start 2024-04-25T15:43:11.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.789+0000 7f19ff59e640 1 -- start start 2024-04-25T15:43:11.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19ff59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19f816b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19ff59e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f80d57e0 con 0x7f19f80b5490 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19ff59e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f81643f0 con 0x7f19f80d0b00 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19ff59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19f81646d0 con 0x7f19f80d2d50 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19fd33a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f19f80b5490 0x7f19f8160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41870/0 (socket says 172.21.15.80:41870) 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19fd33a640 1 -- 172.21.15.80:0/1221919591 learned_addr learned my addr 172.21.15.80:0/1221919591 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19fdb3b640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19f816b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239634592 0 0) 0x7f19f80d57e0 con 0x7f19f80b5490 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19e4003520 con 0x7f19f80b5490 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 757459527 0 0) 0x7f19e4003520 con 0x7f19f80b5490 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 msgr2=0x7f19f816b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19f816b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 >> v1:172.21.15.195:6789/0 conn(0x7f19f80d0b00 legacy=0x7f19f80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f81649b0 con 0x7f19f80b5490 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f19f40019f0 con 0x7f19f80b5490 2024-04-25T15:43:11.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 >> v1:172.21.15.80:6789/0 conn(0x7f19f80b5490 legacy=0x7f19f8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19e4004d40 0x7f19e4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f19f81646d0 con 0x7f19e40039e0 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400ba70 con 0x7f19e4004d40 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19e400bc70 con 0x7f19f80d2d50 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.791+0000 7f19fd33a640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fcb39640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fdb3b640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19e4004d40 0x7f19e4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fd33a640 1 -- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 msgr2=0x7f19e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fd33a640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fd33a640 1 -- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19e4004d40 msgr2=0x7f19e4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fd33a640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19e4004d40 0x7f19e4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fd33a640 1 -- 172.21.15.80:0/1221919591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e4003520 con 0x7f19e40039e0 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fdb3b640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19e4004d40 0x7f19e4005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fcb39640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80d2d50 0x7f19e4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.792+0000 7f19fd33a640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19e4003e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a830 tx=0x7f19e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef830a19ca100155 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f400a480 con 0x7f19e40039e0 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f402f070 con 0x7f19e40039e0 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19effff640 1 -- 172.21.15.80:0/1221919591 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f402bcb0 con 0x7f19e40039e0 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19ff59e640 1 -- 172.21.15.80:0/1221919591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 msgr2=0x7f19e4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19ff59e640 1 --2- 172.21.15.80:0/1221919591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19e4003e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a830 tx=0x7f19e4005830 comp rx=0 tx=0).stop 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19fdb3b640 1 -- 172.21.15.80:0/1221919591 reap_dead start 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19ff59e640 1 -- 172.21.15.80:0/1221919591 shutdown_connections 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19ff59e640 1 -- 172.21.15.80:0/1221919591 >> 172.21.15.80:0/1221919591 conn(0x7f19f806e650 msgr2=0x7f19f806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19ff59e640 1 -- 172.21.15.80:0/1221919591 shutdown_connections 2024-04-25T15:43:11.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.793+0000 7f19ff59e640 1 -- 172.21.15.80:0/1221919591 wait complete. 2024-04-25T15:43:11.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.795+0000 7f19ff59e640 1 Processor -- start 2024-04-25T15:43:11.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.795+0000 7f19ff59e640 1 -- start start 2024-04-25T15:43:11.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19ff59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19f8158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19ff59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80cc190 0x7f19f80d4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19ff59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19f80cc5a0 0x7f19f80d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19ff59e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f19f80b94e0 con 0x7f19e40039e0 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19ff59e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f19f80b9360 con 0x7f19f80cc5a0 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19ff59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19f8163f80 con 0x7f19f80cc190 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19fd33a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19f8158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19fd33a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19f8158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60468/0 (socket says 172.21.15.80:60468) 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.796+0000 7f19fd33a640 1 -- 172.21.15.80:0/3522462214 learned_addr learned my addr 172.21.15.80:0/3522462214 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fdb3b640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19f80cc5a0 0x7f19f80d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fd33a640 1 -- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80cc190 msgr2=0x7f19f80d4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fcb39640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80cc190 0x7f19f80d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fd33a640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80cc190 0x7f19f80d4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fd33a640 1 -- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19f80cc5a0 msgr2=0x7f19f80d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fd33a640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19f80cc5a0 0x7f19f80d4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fd33a640 1 -- 172.21.15.80:0/3522462214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f80cae20 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fdb3b640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19f80cc5a0 0x7f19f80d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19fd33a640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19f8158c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a830 tx=0x7f19f8160a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f400a480 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f4044070 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f80cb100 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4001fd0 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.797+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f80cb6c0 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.798+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f806a100 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.799+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f19f4034870 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.799+0000 7f19edffb640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19dc0744b0 0x7f19dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.799+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f19f40b5ea0 con 0x7f19e40039e0 2024-04-25T15:43:11.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.799+0000 7f19fcb39640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19dc0744b0 0x7f19dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:11.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.800+0000 7f19fcb39640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19dc0744b0 0x7f19dc0769c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19f80d5470 tx=0x7f19e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:11.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.804+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19f4080380 con 0x7f19e40039e0 2024-04-25T15:43:11.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.978+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f19f80b7250 con 0x7f19e40039e0 2024-04-25T15:43:11.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.978+0000 7f19edffb640 1 -- 172.21.15.80:0/3522462214 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f19f407fc80 con 0x7f19e40039e0 2024-04-25T15:43:11.979 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19dc0744b0 msgr2=0x7f19dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19dc0744b0 0x7f19dc0769c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19f80d5470 tx=0x7f19e8009040 comp rx=0 tx=0).stop 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 msgr2=0x7f19f8158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19f8158c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f19f400a830 tx=0x7f19f8160a10 comp rx=0 tx=0).stop 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 shutdown_connections 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19dc0744b0 0x7f19dc0769c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19f80cc5a0 0x7f19f80d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19f80cc190 0x7f19f80d4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 --2- 172.21.15.80:0/3522462214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19e40039e0 0x7f19f8158c10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 >> 172.21.15.80:0/3522462214 conn(0x7f19f806e650 msgr2=0x7f19f80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 shutdown_connections 2024-04-25T15:43:11.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:11.980+0000 7f19ff59e640 1 -- 172.21.15.80:0/3522462214 wait complete. 2024-04-25T15:43:11.992 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:12.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.101+0000 7f63571ee640 1 Processor -- start 2024-04-25T15:43:12.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.101+0000 7f63571ee640 1 -- start start 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f63571ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6350071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f63571ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6350072220 con 0x7f63500b2db0 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f63571ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63500ce640 con 0x7f6350160090 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f63571ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f63500cef30 con 0x7f63500718d0 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f6354f8a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f63500b2db0 0x7f63500d2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41878/0 (socket says 172.21.15.80:41878) 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f6354f8a640 1 -- 172.21.15.80:0/1159106747 learned_addr learned my addr 172.21.15.80:0/1159106747 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f635578b640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6350071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958174359 0 0) 0x7f6340001110 con 0x7f63500b2db0 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6338003520 con 0x7f63500b2db0 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.102+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3754021246 0 0) 0x7f6338003520 con 0x7f63500b2db0 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 msgr2=0x7f6350071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6350071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 >> v1:172.21.15.195:6789/0 conn(0x7f6350160090 legacy=0x7f635006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635006dde0 con 0x7f63500b2db0 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f6340001840 con 0x7f63500b2db0 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 >> v1:172.21.15.80:6789/0 conn(0x7f63500b2db0 legacy=0x7f63500d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63380039e0 0x7f6338003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6338004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6338005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f63500cef30 con 0x7f6338004d40 2024-04-25T15:43:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f633800bb70 con 0x7f63380039e0 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f633800bd70 con 0x7f63500718d0 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f635578b640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6338005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634ffff640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6338004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f6354f8a640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63380039e0 0x7f6338003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f635578b640 1 -- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 msgr2=0x7f6338004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f635578b640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6338004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f635578b640 1 -- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63380039e0 msgr2=0x7f6338003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f635578b640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63380039e0 0x7f6338003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f635578b640 1 -- 172.21.15.80:0/1159106747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6338003520 con 0x7f6338004d40 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.103+0000 7f634ffff640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500718d0 0x7f6338004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.104+0000 7f635578b640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6338005170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6348009f90 tx=0x7f6338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9337701a6c6659b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.104+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348009c10 con 0x7f6338004d40 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.104+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6348036070 con 0x7f6338004d40 2024-04-25T15:43:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.104+0000 7f634f7fe640 1 -- 172.21.15.80:0/1159106747 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348031850 con 0x7f6338004d40 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f63571ee640 1 -- 172.21.15.80:0/1159106747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 msgr2=0x7f6338005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f63571ee640 1 --2- 172.21.15.80:0/1159106747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6338005170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6348009f90 tx=0x7f6338005830 comp rx=0 tx=0).stop 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f635578b640 1 -- 172.21.15.80:0/1159106747 reap_dead start 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f63571ee640 1 -- 172.21.15.80:0/1159106747 shutdown_connections 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f63571ee640 1 -- 172.21.15.80:0/1159106747 >> 172.21.15.80:0/1159106747 conn(0x7f63500d3a30 msgr2=0x7f63500d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f63571ee640 1 -- 172.21.15.80:0/1159106747 shutdown_connections 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.105+0000 7f63571ee640 1 -- 172.21.15.80:0/1159106747 wait complete. 2024-04-25T15:43:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.106+0000 7f63571ee640 1 Processor -- start 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.106+0000 7f63571ee640 1 -- start start 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f63571ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6350162260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f63571ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500b8ae0 0x7f63500b8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f63571ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63500b7620 0x7f63500b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f63571ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f63500ce8e0 con 0x7f6338004d40 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f63571ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f63500b31c0 con 0x7f63500b7620 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f63571ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f63500cebc0 con 0x7f63500b8ae0 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6350162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6350162260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60484/0 (socket says 172.21.15.80:60484) 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 -- 172.21.15.80:0/3867961610 learned_addr learned my addr 172.21.15.80:0/3867961610 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 -- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500b8ae0 msgr2=0x7f63500b8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500b8ae0 0x7f63500b8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 -- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63500b7620 msgr2=0x7f63500b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f635578b640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63500b7620 0x7f63500b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63500b7620 0x7f63500b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 -- 172.21.15.80:0/3867961610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63500b6860 con 0x7f6338004d40 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.108+0000 7f6354f8a640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6350162260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63400019b0 tx=0x7f6340007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.109+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634000f960 con 0x7f6338004d40 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.109+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340018070 con 0x7f6338004d40 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.109+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63500b6b40 con 0x7f6338004d40 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.109+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634000fd00 con 0x7f6338004d40 2024-04-25T15:43:12.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.109+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63500b7100 con 0x7f6338004d40 2024-04-25T15:43:12.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.110+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635006a100 con 0x7f6338004d40 2024-04-25T15:43:12.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.110+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f634001d460 con 0x7f6338004d40 2024-04-25T15:43:12.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.111+0000 7f634d7fa640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f633c0744b0 0x7f633c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.111+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f63400955c0 con 0x7f6338004d40 2024-04-25T15:43:12.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.111+0000 7f634ffff640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f633c0744b0 0x7f633c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.111+0000 7f634ffff640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f633c0744b0 0x7f633c0769c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6350071880 tx=0x7f6344009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.115+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6350072220 con 0x7f6338004d40 2024-04-25T15:43:12.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.291+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f635015d010 con 0x7f6338004d40 2024-04-25T15:43:12.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.291+0000 7f634d7fa640 1 -- 172.21.15.80:0/3867961610 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f634005fa10 con 0x7f6338004d40 2024-04-25T15:43:12.292 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f633c0744b0 msgr2=0x7f633c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f633c0744b0 0x7f633c0769c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6350071880 tx=0x7f6344009040 comp rx=0 tx=0).stop 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 msgr2=0x7f6350162260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6350162260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63400019b0 tx=0x7f6340007720 comp rx=0 tx=0).stop 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 shutdown_connections 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f633c0744b0 0x7f633c0769c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63500b7620 0x7f63500b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63500b8ae0 0x7f63500b8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 --2- 172.21.15.80:0/3867961610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6338004d40 0x7f6350162260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 >> 172.21.15.80:0/3867961610 conn(0x7f63500d3a30 msgr2=0x7f63500b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 shutdown_connections 2024-04-25T15:43:12.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.293+0000 7f63571ee640 1 -- 172.21.15.80:0/3867961610 wait complete. 2024-04-25T15:43:12.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:43:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.413+0000 7fec355f3640 1 Processor -- start 2024-04-25T15:43:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.413+0000 7fec355f3640 1 -- start start 2024-04-25T15:43:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.414+0000 7fec355f3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fec300d41b0 0x7fec300b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec355f3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec30163fb0 con 0x7fec301602a0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec355f3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec30164270 con 0x7fec300b7d60 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec355f3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fec30164550 con 0x7fec300d41b0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fec301602a0 0x7fec300b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41894/0 (socket says 172.21.15.80:41894) 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2e7fc640 1 -- 172.21.15.80:0/3767723825 learned_addr learned my addr 172.21.15.80:0/3767723825 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664571513 0 0) 0x7fec30163fb0 con 0x7fec301602a0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2effd640 1 --2- 172.21.15.80:0/3767723825 >> v2:172.21.15.195:3300/0 conn(0x7fec300d41b0 0x7fec300b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec18003520 con 0x7fec301602a0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3929250684 0 0) 0x7fec18003520 con 0x7fec301602a0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 >> v2:172.21.15.195:3300/0 conn(0x7fec300d41b0 msgr2=0x7fec300b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 --2- 172.21.15.80:0/3767723825 >> v2:172.21.15.195:3300/0 conn(0x7fec300d41b0 0x7fec300b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 >> v1:172.21.15.195:6789/0 conn(0x7fec300b7d60 legacy=0x7fec300d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec30164830 con 0x7fec301602a0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fec24001670 con 0x7fec301602a0 2024-04-25T15:43:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 >> v1:172.21.15.80:6789/0 conn(0x7fec301602a0 legacy=0x7fec300b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec18003a00 0x7fec18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec18004800 0x7fec18004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec180052a0 0x7fec1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fec30164550 con 0x7fec18003a00 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fec1800c230 con 0x7fec180052a0 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fec1800c430 con 0x7fec18004800 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.415+0000 7fec2effd640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec18003a00 0x7fec18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2e7fc640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec18004800 0x7fec18004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2f7fe640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec180052a0 0x7fec1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2effd640 1 -- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec18004800 msgr2=0x7fec18004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2effd640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec18004800 0x7fec18004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2effd640 1 -- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec180052a0 msgr2=0x7fec1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2effd640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec180052a0 0x7fec1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2effd640 1 -- 172.21.15.80:0/3767723825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec18003520 con 0x7fec18003a00 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2f7fe640 1 -- 172.21.15.80:0/3767723825 reap_dead start 2024-04-25T15:43:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2e7fc640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec18004800 0x7fec18004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.416+0000 7fec2effd640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec18003a00 0x7fec18003e70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec20009fa0 tx=0x7fec18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eadbe91c6be2d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20009bf0 con 0x7fec18003a00 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec20036070 con 0x7fec18003a00 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec2dffb640 1 -- 172.21.15.80:0/3767723825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20030850 con 0x7fec18003a00 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 -- 172.21.15.80:0/3767723825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec18003a00 msgr2=0x7fec18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec18003a00 0x7fec18003e70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec20009fa0 tx=0x7fec18005830 comp rx=0 tx=0).stop 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 -- 172.21.15.80:0/3767723825 shutdown_connections 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 --2- 172.21.15.80:0/3767723825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec18003a00 0x7fec18003e70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 -- 172.21.15.80:0/3767723825 >> 172.21.15.80:0/3767723825 conn(0x7fec3006e9f0 msgr2=0x7fec300d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 -- 172.21.15.80:0/3767723825 shutdown_connections 2024-04-25T15:43:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.417+0000 7fec355f3640 1 -- 172.21.15.80:0/3767723825 wait complete. 2024-04-25T15:43:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.419+0000 7fec355f3640 1 Processor -- start 2024-04-25T15:43:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.419+0000 7fec355f3640 1 -- start start 2024-04-25T15:43:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.420+0000 7fec355f3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec18003a00 0x7fec300ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.420+0000 7fec355f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 0x7fec300ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.420+0000 7fec355f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec30161700 0x7fec30161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.420+0000 7fec355f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fec300b5150 con 0x7fec300ce740 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.420+0000 7fec355f3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fec300b4fd0 con 0x7fec18003a00 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.420+0000 7fec355f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fec300b9220 con 0x7fec30161700 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 0x7fec300ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 0x7fec300ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60494/0 (socket says 172.21.15.80:60494) 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 -- 172.21.15.80:0/948738381 learned_addr learned my addr 172.21.15.80:0/948738381 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2effd640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec18003a00 0x7fec300ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2f7fe640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec30161700 0x7fec30161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 -- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec30161700 msgr2=0x7fec30161b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec30161700 0x7fec30161b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 -- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec18003a00 msgr2=0x7fec300ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec18003a00 0x7fec300ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 -- 172.21.15.80:0/948738381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec300cf090 con 0x7fec300ce740 2024-04-25T15:43:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec2e7fc640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 0x7fec300ceb50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec2400e7b0 tx=0x7fec2400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2400c660 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec24018070 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec300cd160 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2400ca00 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.421+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec300cd720 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.422+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3006a100 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.423+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fec2400cba0 con 0x7fec300ce740 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.423+0000 7fec177fe640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fec1c0744b0 0x7fec1c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.423+0000 7fec2effd640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fec1c0744b0 0x7fec1c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.423+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fec240951a0 con 0x7fec300ce740 2024-04-25T15:43:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.424+0000 7fec2effd640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fec1c0744b0 0x7fec1c0769c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec20035000 tx=0x7fec2002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.428+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec2405efa0 con 0x7fec300ce740 2024-04-25T15:43:12.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.616+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fec300d3070 con 0x7fec300ce740 2024-04-25T15:43:12.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.617+0000 7fec177fe640 1 -- 172.21.15.80:0/948738381 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fec240632a0 con 0x7fec300ce740 2024-04-25T15:43:12.618 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:43:12.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fec1c0744b0 msgr2=0x7fec1c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fec1c0744b0 0x7fec1c0769c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec20035000 tx=0x7fec2002f000 comp rx=0 tx=0).stop 2024-04-25T15:43:12.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 msgr2=0x7fec300ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 0x7fec300ceb50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec2400e7b0 tx=0x7fec2400ec70 comp rx=0 tx=0).stop 2024-04-25T15:43:12.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 shutdown_connections 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fec1c0744b0 0x7fec1c0769c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec30161700 0x7fec30161b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec300ce740 0x7fec300ceb50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 --2- 172.21.15.80:0/948738381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec18003a00 0x7fec300ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 >> 172.21.15.80:0/948738381 conn(0x7fec3006e9f0 msgr2=0x7fec300b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 shutdown_connections 2024-04-25T15:43:12.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.619+0000 7fec355f3640 1 -- 172.21.15.80:0/948738381 wait complete. 2024-04-25T15:43:12.631 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:12.631 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:12.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:12.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.792+0000 7fadcfb9d640 1 Processor -- start 2024-04-25T15:43:12.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.792+0000 7fadcfb9d640 1 -- start start 2024-04-25T15:43:12.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.793+0000 7fadcfb9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fadc8160f90 0x7fadc8168b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.793+0000 7fadcfb9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc81589c0 con 0x7fadc80714a0 2024-04-25T15:43:12.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.793+0000 7fadcfb9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc815ee90 con 0x7fadc806db10 2024-04-25T15:43:12.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.793+0000 7fadcfb9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fadc815faf0 con 0x7fadc8160f90 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.793+0000 7fadcd138640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fadc80714a0 0x7fadc80718b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41902/0 (socket says 172.21.15.80:41902) 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.793+0000 7fadcd138640 1 -- 172.21.15.80:0/3986358992 learned_addr learned my addr 172.21.15.80:0/3986358992 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201679171 0 0) 0x7fadc81589c0 con 0x7fadc80714a0 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 --2- 172.21.15.80:0/3986358992 >> v2:172.21.15.195:3300/0 conn(0x7fadc8160f90 0x7fadc8168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb4003520 con 0x7fadc80714a0 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2715392283 0 0) 0x7fadb4003520 con 0x7fadc80714a0 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 >> v2:172.21.15.195:3300/0 conn(0x7fadc8160f90 msgr2=0x7fadc8168b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 --2- 172.21.15.80:0/3986358992 >> v2:172.21.15.195:3300/0 conn(0x7fadc8160f90 0x7fadc8168b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 >> v1:172.21.15.195:6789/0 conn(0x7fadc806db10 legacy=0x7fadc815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc815f170 con 0x7fadc80714a0 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fadb8001690 con 0x7fadc80714a0 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 >> v1:172.21.15.80:6789/0 conn(0x7fadc80714a0 legacy=0x7fadc80718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb40039b0 0x7fadb4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadb4004800 0x7fadb4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb4005270 0x7fadb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fadc815faf0 con 0x7fadb4005270 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fadb400c200 con 0x7fadb4004800 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fadb400c400 con 0x7fadb40039b0 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb4005270 0x7fadb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcd138640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadb4004800 0x7fadb4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadcd939640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb40039b0 0x7fadb4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 -- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb40039b0 msgr2=0x7fadb4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb40039b0 0x7fadb4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 -- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadb4004800 msgr2=0x7fadb4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadb4004800 0x7fadb4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.794+0000 7fadce13a640 1 -- 172.21.15.80:0/3986358992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb4003520 con 0x7fadb4005270 2024-04-25T15:43:12.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.795+0000 7fadce13a640 1 -- 172.21.15.80:0/3986358992 reap_dead start 2024-04-25T15:43:12.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.795+0000 7fadce13a640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb4005270 0x7fadb400b9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009f90 tx=0x7fadb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd5cced47ab87e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.795+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0035020 con 0x7fadb4005270 2024-04-25T15:43:12.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.795+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0003b90 con 0x7fadb4005270 2024-04-25T15:43:12.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.795+0000 7fadcc937640 1 -- 172.21.15.80:0/3986358992 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0009c10 con 0x7fadb4005270 2024-04-25T15:43:12.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 -- 172.21.15.80:0/3986358992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb4005270 msgr2=0x7fadb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb4005270 0x7fadb400b9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009f90 tx=0x7fadb4005830 comp rx=0 tx=0).stop 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 -- 172.21.15.80:0/3986358992 shutdown_connections 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/3986358992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadb4005270 0x7fadb400b9c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 -- 172.21.15.80:0/3986358992 >> 172.21.15.80:0/3986358992 conn(0x7fadc80d2080 msgr2=0x7fadc80d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 -- 172.21.15.80:0/3986358992 shutdown_connections 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.796+0000 7fadcfb9d640 1 -- 172.21.15.80:0/3986358992 wait complete. 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.798+0000 7fadcfb9d640 1 Processor -- start 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.798+0000 7fadcfb9d640 1 -- start start 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcfb9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb4005270 0x7fadc8159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcfb9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadc81f3da0 0x7fadc806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcfb9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 0x7fadc8153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcfb9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fadc80718b0 con 0x7fadc806cb00 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcfb9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fadc815f450 con 0x7fadc81f3da0 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcfb9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fadc8071a30 con 0x7fadb4005270 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 0x7fadc8153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 0x7fadc8153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60514/0 (socket says 172.21.15.80:60514) 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 -- 172.21.15.80:0/576410202 learned_addr learned my addr 172.21.15.80:0/576410202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcd939640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb4005270 0x7fadc8159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcd138640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadc81f3da0 0x7fadc806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 -- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb4005270 msgr2=0x7fadc8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb4005270 0x7fadc8159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 -- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadc81f3da0 msgr2=0x7fadc806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadc81f3da0 0x7fadc806c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadce13a640 1 -- 172.21.15.80:0/576410202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc806cf10 con 0x7fadc806cb00 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcd939640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb4005270 0x7fadc8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:12.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.799+0000 7fadcd138640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadc81f3da0 0x7fadc806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.800+0000 7fadce13a640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 0x7fadc8153430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fadc000e230 tx=0x7fadc0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.800+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0035030 con 0x7fadc806cb00 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.800+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0042070 con 0x7fadc806cb00 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.800+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0009c10 con 0x7fadc806cb00 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.800+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc8159f10 con 0x7fadc806cb00 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.800+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc815a4d0 con 0x7fadc806cb00 2024-04-25T15:43:12.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.801+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc806a100 con 0x7fadc806cb00 2024-04-25T15:43:12.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.801+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fadc0005d10 con 0x7fadc806cb00 2024-04-25T15:43:12.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.802+0000 7fadbe7fc640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadac0744e0 0x7fadac0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:12.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.802+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadc00b6020 con 0x7fadc806cb00 2024-04-25T15:43:12.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.802+0000 7fadcd939640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadac0744e0 0x7fadac0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:12.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.802+0000 7fadcd939640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadac0744e0 0x7fadac0769f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000c00 tx=0x7fadc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:12.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.806+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fadc806cf10 con 0x7fadc806cb00 2024-04-25T15:43:12.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.983+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadc80cf560 con 0x7fadc806cb00 2024-04-25T15:43:12.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.984+0000 7fadbe7fc640 1 -- 172.21.15.80:0/576410202 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fadc0080470 con 0x7fadc806cb00 2024-04-25T15:43:12.985 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:12.985 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:12.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadac0744e0 msgr2=0x7fadac0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadac0744e0 0x7fadac0769f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000c00 tx=0x7fadc4009040 comp rx=0 tx=0).stop 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 msgr2=0x7fadc8153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 0x7fadc8153430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fadc000e230 tx=0x7fadc0009750 comp rx=0 tx=0).stop 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 shutdown_connections 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadac0744e0 0x7fadac0769f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc806cb00 0x7fadc8153430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadc81f3da0 0x7fadc806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 --2- 172.21.15.80:0/576410202 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadb4005270 0x7fadc8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 >> 172.21.15.80:0/576410202 conn(0x7fadc80d2080 msgr2=0x7fadc80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 shutdown_connections 2024-04-25T15:43:12.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:12.986+0000 7fadcfb9d640 1 -- 172.21.15.80:0/576410202 wait complete. 2024-04-25T15:43:12.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:12.999 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:13.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.109+0000 7fe2c2b9d640 1 Processor -- start 2024-04-25T15:43:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.109+0000 7fe2c2b9d640 1 -- start start 2024-04-25T15:43:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c2b9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2bc161a80 0x7fe2bc0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c2b9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe2bc0ce940 0x7fe2bc0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c2b9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc0cf290 con 0x7fe2bc15de90 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c2b9d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe2bc0ce1f0 con 0x7fe2bc161a80 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c2b9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe2bc0d2e60 con 0x7fe2bc0ce940 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2bbfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe2bc15de90 0x7fe2bc0b6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41912/0 (socket says 172.21.15.80:41912) 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2bbfff640 1 -- 172.21.15.80:0/149010344 learned_addr learned my addr 172.21.15.80:0/149010344 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c0939640 1 --2- 172.21.15.80:0/149010344 >> v2:172.21.15.80:3300/0 conn(0x7fe2bc161a80 0x7fe2bc0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c113a640 1 --2- 172.21.15.80:0/149010344 >> v2:172.21.15.195:3300/0 conn(0x7fe2bc0ce940 0x7fe2bc0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c0939640 1 -- 172.21.15.80:0/149010344 >> v2:172.21.15.195:3300/0 conn(0x7fe2bc0ce940 msgr2=0x7fe2bc0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c0939640 1 --2- 172.21.15.80:0/149010344 >> v2:172.21.15.195:3300/0 conn(0x7fe2bc0ce940 0x7fe2bc0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c0939640 1 -- 172.21.15.80:0/149010344 >> v1:172.21.15.80:6789/0 conn(0x7fe2bc15de90 legacy=0x7fe2bc0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2c0939640 1 -- 172.21.15.80:0/149010344 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc0d25c0 con 0x7fe2bc161a80 2024-04-25T15:43:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.111+0000 7fe2bb7fe640 1 -- 172.21.15.80:0/149010344 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141677754 0 0) 0x7fe2b0001110 con 0x7fe2bc15de90 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.112+0000 7fe2c0939640 1 --2- 172.21.15.80:0/149010344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc161a80 0x7fe2bc0d1ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc08d060 tx=0x7fe2ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf24cdba761ea9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.112+0000 7fe2bb7fe640 1 -- 172.21.15.80:0/149010344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac037070 con 0x7fe2bc161a80 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.112+0000 7fe2bb7fe640 1 -- 172.21.15.80:0/149010344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac032440 con 0x7fe2bc161a80 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.112+0000 7fe2bb7fe640 1 -- 172.21.15.80:0/149010344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac02ae60 con 0x7fe2bc161a80 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/149010344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc161a80 msgr2=0x7fe2bc0d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/149010344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc161a80 0x7fe2bc0d1ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc08d060 tx=0x7fe2ac02a110 comp rx=0 tx=0).stop 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/149010344 shutdown_connections 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/149010344 >> v2:172.21.15.195:3300/0 conn(0x7fe2bc0ce940 0x7fe2bc0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/149010344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc161a80 0x7fe2bc0d1ec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/149010344 >> 172.21.15.80:0/149010344 conn(0x7fe2bc0b5510 msgr2=0x7fe2bc0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:13.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/149010344 shutdown_connections 2024-04-25T15:43:13.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.113+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/149010344 wait complete. 2024-04-25T15:43:13.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.114+0000 7fe2c2b9d640 1 Processor -- start 2024-04-25T15:43:13.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.115+0000 7fe2c2b9d640 1 -- start start 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c2b9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2bc0ce940 0x7fe2bc0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c2b9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 0x7fe2bc0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c2b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2bc161a80 0x7fe2bc0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c2b9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc0d2b80 con 0x7fe2bc15de90 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c2b9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc0d33e0 con 0x7fe2bc0ce940 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c2b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe2bc15e2a0 con 0x7fe2bc161a80 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 0x7fe2bc0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 0x7fe2bc0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60542/0 (socket says 172.21.15.80:60542) 2024-04-25T15:43:13.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 -- 172.21.15.80:0/843409005 learned_addr learned my addr 172.21.15.80:0/843409005 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c113a640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2bc161a80 0x7fe2bc0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2c0939640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2bc0ce940 0x7fe2bc0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 -- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2bc161a80 msgr2=0x7fe2bc0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2bc161a80 0x7fe2bc0cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 -- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2bc0ce940 msgr2=0x7fe2bc0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2bc0ce940 0x7fe2bc0c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.116+0000 7fe2bbfff640 1 -- 172.21.15.80:0/843409005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc0ca610 con 0x7fe2bc15de90 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.117+0000 7fe2bbfff640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 0x7fe2bc0cc940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c430 tx=0x7fe2b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.117+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00074e0 con 0x7fe2bc15de90 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.117+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b00047e0 con 0x7fe2bc15de90 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.117+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc0cbb80 con 0x7fe2bc15de90 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.117+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0004bd0 con 0x7fe2bc15de90 2024-04-25T15:43:13.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.117+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc0cc140 con 0x7fe2bc15de90 2024-04-25T15:43:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.118+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc06a100 con 0x7fe2bc15de90 2024-04-25T15:43:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.118+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe2b0011070 con 0x7fe2bc15de90 2024-04-25T15:43:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.119+0000 7fe2b97fa640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2a80744b0 0x7fe2a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.119+0000 7fe2c0939640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2a80744b0 0x7fe2a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.119+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe2b0095210 con 0x7fe2bc15de90 2024-04-25T15:43:13.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.119+0000 7fe2c0939640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2a80744b0 0x7fe2a80769c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac034000 tx=0x7fe2ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.124+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2bc0cf290 con 0x7fe2bc15de90 2024-04-25T15:43:13.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.298+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe2bc0d1ca0 con 0x7fe2bc15de90 2024-04-25T15:43:13.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.299+0000 7fe2b97fa640 1 -- 172.21.15.80:0/843409005 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe2b005f660 con 0x7fe2bc15de90 2024-04-25T15:43:13.300 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2a80744b0 msgr2=0x7fe2a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2a80744b0 0x7fe2a80769c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac034000 tx=0x7fe2ac02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 msgr2=0x7fe2bc0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 0x7fe2bc0cc940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c430 tx=0x7fe2b000c8f0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 shutdown_connections 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2a80744b0 0x7fe2a80769c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2bc161a80 0x7fe2bc0cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2bc15de90 0x7fe2bc0cc940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 --2- 172.21.15.80:0/843409005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2bc0ce940 0x7fe2bc0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 >> 172.21.15.80:0/843409005 conn(0x7fe2bc0b5510 msgr2=0x7fe2bc0b86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:13.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 shutdown_connections 2024-04-25T15:43:13.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.301+0000 7fe2c2b9d640 1 -- 172.21.15.80:0/843409005 wait complete. 2024-04-25T15:43:13.313 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:13.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.423+0000 7f5258aa1640 1 Processor -- start 2024-04-25T15:43:13.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.424+0000 7f5258aa1640 1 -- start start 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5258aa1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52540b2b80 0x7f525415e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5258aa1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540cee90 0x7f52540d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5258aa1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52540d08c0 0x7f5254071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5258aa1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f52540d0cd0 con 0x7f52540b2b80 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5258aa1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5254161b00 con 0x7f52540d08c0 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5258aa1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5254161dc0 con 0x7f52540cee90 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52540b2b80 0x7f525415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52540b2b80 0x7f525415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60558/0 (socket says 172.21.15.80:60558) 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 -- 172.21.15.80:0/1500871025 learned_addr learned my addr 172.21.15.80:0/1500871025 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5251d9b640 1 --2- 172.21.15.80:0/1500871025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540cee90 0x7f52540d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f5252d9d640 1 --2- 172.21.15.80:0/1500871025 >> v2:172.21.15.195:3300/0 conn(0x7f52540d08c0 0x7f5254071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 -- 172.21.15.80:0/1500871025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540cee90 msgr2=0x7f52540d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 --2- 172.21.15.80:0/1500871025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540cee90 0x7f52540d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 -- 172.21.15.80:0/1500871025 >> v2:172.21.15.195:3300/0 conn(0x7f52540d08c0 msgr2=0x7f5254071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:13.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 --2- 172.21.15.80:0/1500871025 >> v2:172.21.15.195:3300/0 conn(0x7f52540d08c0 0x7f5254071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.425+0000 7f525259c640 1 -- 172.21.15.80:0/1500871025 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52541620a0 con 0x7f52540b2b80 2024-04-25T15:43:13.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.426+0000 7f5252d9d640 1 --2- 172.21.15.80:0/1500871025 >> v2:172.21.15.195:3300/0 conn(0x7f52540d08c0 0x7f5254071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:13.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.427+0000 7f525259c640 1 --2- 172.21.15.80:0/1500871025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540b2b80 0x7f525415e060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52540d1510 tx=0x7f524402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23db702027cf7154 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.428+0000 7f525159a640 1 -- 172.21.15.80:0/1500871025 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244036070 con 0x7f52540b2b80 2024-04-25T15:43:13.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.428+0000 7f525159a640 1 -- 172.21.15.80:0/1500871025 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5244031600 con 0x7f52540b2b80 2024-04-25T15:43:13.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.428+0000 7f525159a640 1 -- 172.21.15.80:0/1500871025 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52440319d0 con 0x7f52540b2b80 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 -- 172.21.15.80:0/1500871025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540b2b80 msgr2=0x7f525415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1500871025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540b2b80 0x7f525415e060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52540d1510 tx=0x7f524402a610 comp rx=0 tx=0).stop 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 -- 172.21.15.80:0/1500871025 shutdown_connections 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1500871025 >> v2:172.21.15.195:3300/0 conn(0x7f52540d08c0 0x7f5254071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1500871025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540cee90 0x7f52540d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1500871025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540b2b80 0x7f525415e060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 -- 172.21.15.80:0/1500871025 >> 172.21.15.80:0/1500871025 conn(0x7f52540b54a0 msgr2=0x7f52540b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 -- 172.21.15.80:0/1500871025 shutdown_connections 2024-04-25T15:43:13.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.429+0000 7f5258aa1640 1 -- 172.21.15.80:0/1500871025 wait complete. 2024-04-25T15:43:13.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.431+0000 7f5258aa1640 1 Processor -- start 2024-04-25T15:43:13.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.431+0000 7f5258aa1640 1 -- start start 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5258aa1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540b2b80 0x7f525414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5258aa1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52540cee90 0x7f52540c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5258aa1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 0x7f52540c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5258aa1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5254162940 con 0x7f52540d08c0 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5258aa1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5254162660 con 0x7f52540cee90 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5258aa1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f52540cf2a0 con 0x7f52540b2b80 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 0x7f52540c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 0x7f52540c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60572/0 (socket says 172.21.15.80:60572) 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 -- 172.21.15.80:0/1083657499 learned_addr learned my addr 172.21.15.80:0/1083657499 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f525259c640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540b2b80 0x7f525414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5251d9b640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52540cee90 0x7f52540c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 -- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540b2b80 msgr2=0x7f525414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540b2b80 0x7f525414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 -- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52540cee90 msgr2=0x7f52540c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52540cee90 0x7f52540c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.432+0000 7f5252d9d640 1 -- 172.21.15.80:0/1083657499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52540cc3e0 con 0x7f52540d08c0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.433+0000 7f5252d9d640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 0x7f52540c7b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c5d0 tx=0x7f524c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.433+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c015070 con 0x7f52540d08c0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.433+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c004240 con 0x7f52540d08c0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.433+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c003610 con 0x7f52540d08c0 2024-04-25T15:43:13.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.433+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52540cc880 con 0x7f52540d08c0 2024-04-25T15:43:13.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.433+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52540cce40 con 0x7f52540d08c0 2024-04-25T15:43:13.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.434+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525406a100 con 0x7f52540d08c0 2024-04-25T15:43:13.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.435+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f524c0037b0 con 0x7f52540d08c0 2024-04-25T15:43:13.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.435+0000 7f5242ffd640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52340744e0 0x7f52340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.435+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f524c0952f0 con 0x7f52540d08c0 2024-04-25T15:43:13.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.435+0000 7f525259c640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52340744e0 0x7f52340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.436+0000 7f525259c640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52340744e0 0x7f52340769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5244033000 tx=0x7f5244009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.440+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f524c05f740 con 0x7f52540d08c0 2024-04-25T15:43:13.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.616+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f52540d1c50 con 0x7f52540d08c0 2024-04-25T15:43:13.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.617+0000 7f5242ffd640 1 -- 172.21.15.80:0/1083657499 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f524c05f040 con 0x7f52540d08c0 2024-04-25T15:43:13.618 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52340744e0 msgr2=0x7f52340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52340744e0 0x7f52340769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5244033000 tx=0x7f5244009000 comp rx=0 tx=0).stop 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 msgr2=0x7f52540c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 0x7f52540c7b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c5d0 tx=0x7f524c00ca90 comp rx=0 tx=0).stop 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 shutdown_connections 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52340744e0 0x7f52340769f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52540d08c0 0x7f52540c7b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52540cee90 0x7f52540c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 --2- 172.21.15.80:0/1083657499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52540b2b80 0x7f525414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 >> 172.21.15.80:0/1083657499 conn(0x7f52540b54a0 msgr2=0x7f525415b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:13.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 shutdown_connections 2024-04-25T15:43:13.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.619+0000 7f5258aa1640 1 -- 172.21.15.80:0/1083657499 wait complete. 2024-04-25T15:43:13.631 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:13.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.739+0000 7feab2467640 1 Processor -- start 2024-04-25T15:43:13.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.739+0000 7feab2467640 1 -- start start 2024-04-25T15:43:13.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab2467640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0cf930 0x7feaac160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab2467640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feaac0d1600 0x7feaac0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab2467640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaac0d1f50 con 0x7feaac0718d0 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab2467640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7feaac0cf4a0 con 0x7feaac0d1600 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab2467640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feaac0cfd40 con 0x7feaac0cf930 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab0a04640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feaac0718d0 0x7feaac071ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41926/0 (socket says 172.21.15.80:41926) 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feab0a04640 1 -- 172.21.15.80:0/3864457680 learned_addr learned my addr 172.21.15.80:0/3864457680 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feaab7fe640 1 --2- 172.21.15.80:0/3864457680 >> v2:172.21.15.195:3300/0 conn(0x7feaac0d1600 0x7feaac0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feaabfff640 1 --2- 172.21.15.80:0/3864457680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0cf930 0x7feaac160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feaaaffd640 1 -- 172.21.15.80:0/3864457680 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737821381 0 0) 0x7feaa4001490 con 0x7feaac0718d0 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.741+0000 7feaaaffd640 1 -- 172.21.15.80:0/3864457680 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea94003520 con 0x7feaac0718d0 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaabfff640 1 -- 172.21.15.80:0/3864457680 >> v2:172.21.15.195:3300/0 conn(0x7feaac0d1600 msgr2=0x7feaac0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaabfff640 1 --2- 172.21.15.80:0/3864457680 >> v2:172.21.15.195:3300/0 conn(0x7feaac0d1600 0x7feaac0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaaaffd640 1 -- 172.21.15.80:0/3864457680 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1851328638 0 0) 0x7fea94003520 con 0x7feaac0718d0 2024-04-25T15:43:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaabfff640 1 -- 172.21.15.80:0/3864457680 >> v1:172.21.15.80:6789/0 conn(0x7feaac0718d0 legacy=0x7feaac071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaabfff640 1 -- 172.21.15.80:0/3864457680 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac0ce890 con 0x7feaac0cf930 2024-04-25T15:43:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaab7fe640 1 --2- 172.21.15.80:0/3864457680 >> v2:172.21.15.195:3300/0 conn(0x7feaac0d1600 0x7feaac0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.742+0000 7feaabfff640 1 --2- 172.21.15.80:0/3864457680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0cf930 0x7feaac160120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0097a0 tx=0x7fea9c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffccc35bb92c651e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feaaaffd640 1 -- 172.21.15.80:0/3864457680 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c037070 con 0x7feaac0cf930 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feaaaffd640 1 -- 172.21.15.80:0/3864457680 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c02aba0 con 0x7feaac0cf930 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feaaaffd640 1 -- 172.21.15.80:0/3864457680 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4001bc0 con 0x7feaac0cf930 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 -- 172.21.15.80:0/3864457680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0cf930 msgr2=0x7feaac160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 --2- 172.21.15.80:0/3864457680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0cf930 0x7feaac160120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0097a0 tx=0x7fea9c02a110 comp rx=0 tx=0).stop 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 -- 172.21.15.80:0/3864457680 shutdown_connections 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 --2- 172.21.15.80:0/3864457680 >> v2:172.21.15.195:3300/0 conn(0x7feaac0d1600 0x7feaac0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 --2- 172.21.15.80:0/3864457680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0cf930 0x7feaac160120 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 -- 172.21.15.80:0/3864457680 >> 172.21.15.80:0/3864457680 conn(0x7feaac0d3a30 msgr2=0x7feaac0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 -- 172.21.15.80:0/3864457680 shutdown_connections 2024-04-25T15:43:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.743+0000 7feab2467640 1 -- 172.21.15.80:0/3864457680 wait complete. 2024-04-25T15:43:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.745+0000 7feab2467640 1 Processor -- start 2024-04-25T15:43:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.745+0000 7feab2467640 1 -- start start 2024-04-25T15:43:13.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 0x7feaac160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0cf930 0x7feaac151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0d1600 0x7feaac1f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feaac0cf130 con 0x7feaac0718d0 2024-04-25T15:43:13.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feaac0cee50 con 0x7feaac0cf930 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feaac160660 con 0x7feaac0d1600 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 0x7feaac160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 0x7feaac160860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60578/0 (socket says 172.21.15.80:60578) 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 -- 172.21.15.80:0/2164025228 learned_addr learned my addr 172.21.15.80:0/2164025228 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaab7fe640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0cf930 0x7feaac151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab0a04640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0d1600 0x7feaac1f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 -- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0d1600 msgr2=0x7feaac1f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0d1600 0x7feaac1f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 -- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0cf930 msgr2=0x7feaac151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0cf930 0x7feaac151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 -- 172.21.15.80:0/2164025228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac152460 con 0x7feaac0718d0 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaabfff640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 0x7feaac160860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02a700 tx=0x7fea9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c042020 con 0x7feaac0718d0 2024-04-25T15:43:13.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c003a40 con 0x7feaac0718d0 2024-04-25T15:43:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c037040 con 0x7feaac0718d0 2024-04-25T15:43:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.747+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaac161c50 con 0x7feaac0718d0 2024-04-25T15:43:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.748+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaac1613b0 con 0x7feaac0718d0 2024-04-25T15:43:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.749+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaac0d3e40 con 0x7feaac0718d0 2024-04-25T15:43:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.749+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fea9c045020 con 0x7feaac0718d0 2024-04-25T15:43:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.749+0000 7feaa8ff9640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea980744b0 0x7fea980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.749+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea9c0b5a40 con 0x7feaac0718d0 2024-04-25T15:43:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.749+0000 7feaab7fe640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea980744b0 0x7fea980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.750+0000 7feaab7fe640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea980744b0 0x7fea980769c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaac0d1d00 tx=0x7feaa0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.754+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feaac0d3e40 con 0x7feaac0718d0 2024-04-25T15:43:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.928+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feaac06a100 con 0x7feaac0718d0 2024-04-25T15:43:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.929+0000 7feaa8ff9640 1 -- 172.21.15.80:0/2164025228 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fea9c04c030 con 0x7feaac0718d0 2024-04-25T15:43:13.930 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea980744b0 msgr2=0x7fea980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea980744b0 0x7fea980769c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaac0d1d00 tx=0x7feaa0009190 comp rx=0 tx=0).stop 2024-04-25T15:43:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 msgr2=0x7feaac160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 0x7feaac160860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02a700 tx=0x7fea9c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 shutdown_connections 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea980744b0 0x7fea980769c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0d1600 0x7feaac1f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0cf930 0x7feaac151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 --2- 172.21.15.80:0/2164025228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feaac0718d0 0x7feaac160860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 >> 172.21.15.80:0/2164025228 conn(0x7feaac0d3a30 msgr2=0x7feaac0b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 shutdown_connections 2024-04-25T15:43:13.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:13.931+0000 7feab2467640 1 -- 172.21.15.80:0/2164025228 wait complete. 2024-04-25T15:43:13.943 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:14.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.054+0000 7f2c00972640 1 Processor -- start 2024-04-25T15:43:14.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.054+0000 7f2c00972640 1 -- start start 2024-04-25T15:43:14.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.055+0000 7f2c00972640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2bfc0b5490 0x7f2bfc160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.055+0000 7f2c00972640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 0x7f2bfc0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.055+0000 7f2c00972640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bfc0d57e0 con 0x7f2bfc0d2b80 2024-04-25T15:43:14.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.055+0000 7f2c00972640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2bfc1643f0 con 0x7f2bfc0b5490 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2c00972640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc1646d0 con 0x7f2bfc0d0b00 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bfad9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2bfc0d2b80 0x7f2bfc0b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41942/0 (socket says 172.21.15.80:41942) 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1566953922 learned_addr learned my addr 172.21.15.80:0/1566953922 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bfa59c640 1 --2- 172.21.15.80:0/1566953922 >> v2:172.21.15.195:3300/0 conn(0x7f2bfc0b5490 0x7f2bfc160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf1d9b640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 0x7f2bfc0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158595753 0 0) 0x7f2bfc0d57e0 con 0x7f2bfc0d2b80 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be8003520 con 0x7f2bfc0d2b80 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3811962345 0 0) 0x7f2be8003520 con 0x7f2bfc0d2b80 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 msgr2=0x7f2bfc0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 0x7f2bfc0d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 >> v2:172.21.15.195:3300/0 conn(0x7f2bfc0b5490 msgr2=0x7f2bfc160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 --2- 172.21.15.80:0/1566953922 >> v2:172.21.15.195:3300/0 conn(0x7f2bfc0b5490 0x7f2bfc160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc1649b0 con 0x7f2bfc0d2b80 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f2bf40019f0 con 0x7f2bfc0d2b80 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bfa59c640 1 --2- 172.21.15.80:0/1566953922 >> v2:172.21.15.195:3300/0 conn(0x7f2bfc0b5490 0x7f2bfc160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:14.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 >> v1:172.21.15.80:6789/0 conn(0x7f2bfc0d2b80 legacy=0x7f2bfc0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 0x7f2be80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8003f30 0x7f2be8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be8004d40 0x7f2be8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1643f0 con 0x7f2be8004d40 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1646d0 con 0x7f2be8003f30 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2be800ba10 con 0x7f2bfc0d0b00 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.056+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be8004d40 0x7f2be8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bf1d9b640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8003f30 0x7f2be8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfa59c640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 0x7f2be80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 msgr2=0x7f2be80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc0d0b00 0x7f2be80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8003f30 msgr2=0x7f2be8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8003f30 0x7f2be8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1566953922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be8003520 con 0x7f2be8004d40 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.057+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be8004d40 0x7f2be8005150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400a850 tx=0x7f2be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c336d12b7b00823 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:14.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400a4a0 con 0x7f2be8004d40 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf402f070 con 0x7f2be8004d40 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2bf9d9b640 1 -- 172.21.15.80:0/1566953922 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402bd20 con 0x7f2be8004d40 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2c00972640 1 -- 172.21.15.80:0/1566953922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be8004d40 msgr2=0x7f2be8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2c00972640 1 --2- 172.21.15.80:0/1566953922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be8004d40 0x7f2be8005150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400a850 tx=0x7f2be8005830 comp rx=0 tx=0).stop 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1566953922 reap_dead start 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2c00972640 1 -- 172.21.15.80:0/1566953922 shutdown_connections 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2c00972640 1 -- 172.21.15.80:0/1566953922 >> 172.21.15.80:0/1566953922 conn(0x7f2bfc06e650 msgr2=0x7f2bfc06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2c00972640 1 -- 172.21.15.80:0/1566953922 shutdown_connections 2024-04-25T15:43:14.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.058+0000 7f2c00972640 1 -- 172.21.15.80:0/1566953922 wait complete. 2024-04-25T15:43:14.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.060+0000 7f2c00972640 1 Processor -- start 2024-04-25T15:43:14.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.060+0000 7f2c00972640 1 -- start start 2024-04-25T15:43:14.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8004d40 0x7f2bfc0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc151210 0x7f2bfc0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 0x7f2bfc0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc0d2f90 con 0x7f2bfc0ae740 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc160840 con 0x7f2be8004d40 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc0b9360 con 0x7f2bfc151210 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 0x7f2bfc0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 0x7f2bfc0c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60598/0 (socket says 172.21.15.80:60598) 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1162921984 learned_addr learned my addr 172.21.15.80:0/1162921984 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bf1d9b640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc151210 0x7f2bfc0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfa59c640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8004d40 0x7f2bfc0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc151210 msgr2=0x7f2bfc0ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc151210 0x7f2bfc0ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8004d40 msgr2=0x7f2bfc0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8004d40 0x7f2bfc0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 -- 172.21.15.80:0/1162921984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc1f6f10 con 0x7f2bfc0ae740 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bfad9d640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 0x7f2bfc0c9980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2bf402b510 tx=0x7f2bfc164b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4044070 con 0x7f2bfc0ae740 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf4034470 con 0x7f2bfc0ae740 2024-04-25T15:43:14.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc0ac940 con 0x7f2bfc0ae740 2024-04-25T15:43:14.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.062+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400a4a0 con 0x7f2bfc0ae740 2024-04-25T15:43:14.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.063+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc0acf00 con 0x7f2bfc0ae740 2024-04-25T15:43:14.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.064+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc0aebc0 con 0x7f2bfc0ae740 2024-04-25T15:43:14.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.064+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2bf4047070 con 0x7f2bfc0ae740 2024-04-25T15:43:14.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.065+0000 7f2bf37fe640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bdc0744e0 0x7f2bdc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.065+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2bf40b5520 con 0x7f2bfc0ae740 2024-04-25T15:43:14.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.065+0000 7f2bfa59c640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bdc0744e0 0x7f2bdc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.065+0000 7f2bfa59c640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bdc0744e0 0x7f2bdc0769f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0d08c0 tx=0x7f2bec009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:14.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.069+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bf407f3e0 con 0x7f2bfc0ae740 2024-04-25T15:43:14.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.244+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2bfc06a100 con 0x7f2bfc0ae740 2024-04-25T15:43:14.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.244+0000 7f2bf37fe640 1 -- 172.21.15.80:0/1162921984 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f2bf40836e0 con 0x7f2bfc0ae740 2024-04-25T15:43:14.245 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:14.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bdc0744e0 msgr2=0x7f2bdc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bdc0744e0 0x7f2bdc0769f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0d08c0 tx=0x7f2bec009190 comp rx=0 tx=0).stop 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 msgr2=0x7f2bfc0c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 0x7f2bfc0c9980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2bf402b510 tx=0x7f2bfc164b80 comp rx=0 tx=0).stop 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 shutdown_connections 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bdc0744e0 0x7f2bdc0769f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bfc0ae740 0x7f2bfc0c9980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bfc151210 0x7f2bfc0ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 --2- 172.21.15.80:0/1162921984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2be8004d40 0x7f2bfc0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 >> 172.21.15.80:0/1162921984 conn(0x7f2bfc06e650 msgr2=0x7f2bfc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 shutdown_connections 2024-04-25T15:43:14.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.246+0000 7f2c00972640 1 -- 172.21.15.80:0/1162921984 wait complete. 2024-04-25T15:43:14.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:43:14.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.366+0000 7ffb17e42640 1 Processor -- start 2024-04-25T15:43:14.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.366+0000 7ffb17e42640 1 -- start start 2024-04-25T15:43:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb17e42640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffb100d2650 0x7ffb100d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb17e42640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb100b2f30 con 0x7ffb100b4b60 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb17e42640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb100b2c90 con 0x7ffb100b91c0 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb17e42640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1006eb60 con 0x7ffb100d2650 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb15bde640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffb100b4b60 0x7ffb1006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41944/0 (socket says 172.21.15.80:41944) 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb15bde640 1 -- 172.21.15.80:0/1904584312 learned_addr learned my addr 172.21.15.80:0/1904584312 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555844031 0 0) 0x7ffb100b2f30 con 0x7ffb100b4b60 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb163df640 1 --2- 172.21.15.80:0/1904584312 >> v2:172.21.15.195:3300/0 conn(0x7ffb100d2650 0x7ffb100d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffafc003520 con 0x7ffb100b4b60 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3585965340 0 0) 0x7ffafc003520 con 0x7ffb100b4b60 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 >> v2:172.21.15.195:3300/0 conn(0x7ffb100d2650 msgr2=0x7ffb100d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 --2- 172.21.15.80:0/1904584312 >> v2:172.21.15.195:3300/0 conn(0x7ffb100d2650 0x7ffb100d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 >> v1:172.21.15.195:6789/0 conn(0x7ffb100b91c0 legacy=0x7ffb100d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb100d10a0 con 0x7ffb100b4b60 2024-04-25T15:43:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7ffb0c0017f0 con 0x7ffb100b4b60 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 >> v1:172.21.15.80:6789/0 conn(0x7ffb100b4b60 legacy=0x7ffb1006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffafc0039b0 0x7ffafc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffafc004800 0x7ffafc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc005270 0x7ffafc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1006eb60 con 0x7ffafc0039b0 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc00c200 con 0x7ffafc005270 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc00c400 con 0x7ffafc004800 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.368+0000 7ffb15bde640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffafc0039b0 0x7ffafc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb153dd640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffafc004800 0x7ffafc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb163df640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc005270 0x7ffafc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb15bde640 1 -- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffafc004800 msgr2=0x7ffafc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb15bde640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffafc004800 0x7ffafc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb15bde640 1 -- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc005270 msgr2=0x7ffafc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb15bde640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc005270 0x7ffafc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb15bde640 1 -- 172.21.15.80:0/1904584312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc003520 con 0x7ffafc0039b0 2024-04-25T15:43:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb163df640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc005270 0x7ffafc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb163df640 1 -- 172.21.15.80:0/1904584312 reap_dead start 2024-04-25T15:43:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.369+0000 7ffb15bde640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffafc0039b0 0x7ffafc003e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb100d1810 tx=0x7ffafc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f9ba1bd06cd8b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c007d20 con 0x7ffafc0039b0 2024-04-25T15:43:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c007290 con 0x7ffafc0039b0 2024-04-25T15:43:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb14bdc640 1 -- 172.21.15.80:0/1904584312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0057a0 con 0x7ffafc0039b0 2024-04-25T15:43:14.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 -- 172.21.15.80:0/1904584312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffafc0039b0 msgr2=0x7ffafc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffafc0039b0 0x7ffafc003e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb100d1810 tx=0x7ffafc005830 comp rx=0 tx=0).stop 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 -- 172.21.15.80:0/1904584312 shutdown_connections 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 --2- 172.21.15.80:0/1904584312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffafc0039b0 0x7ffafc003e40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 -- 172.21.15.80:0/1904584312 >> 172.21.15.80:0/1904584312 conn(0x7ffb100d0450 msgr2=0x7ffb100d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 -- 172.21.15.80:0/1904584312 shutdown_connections 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.370+0000 7ffb17e42640 1 -- 172.21.15.80:0/1904584312 wait complete. 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.372+0000 7ffb17e42640 1 Processor -- start 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.372+0000 7ffb17e42640 1 -- start start 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.373+0000 7ffb17e42640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc0039b0 0x7ffb101e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.373+0000 7ffb17e42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb100a0a20 0x7ffb100a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.373+0000 7ffb17e42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 0x7ffb100cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.373+0000 7ffb17e42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1009d0e0 con 0x7ffb100cf050 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.373+0000 7ffb17e42640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1009cbe0 con 0x7ffafc0039b0 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.373+0000 7ffb17e42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1009d260 con 0x7ffb100a0a20 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 0x7ffb100cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 0x7ffb100cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60608/0 (socket says 172.21.15.80:60608) 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 -- 172.21.15.80:0/392417757 learned_addr learned my addr 172.21.15.80:0/392417757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb153dd640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb100a0a20 0x7ffb100a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb15bde640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc0039b0 0x7ffb101e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 -- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb100a0a20 msgr2=0x7ffb100a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb100a0a20 0x7ffb100a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 -- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc0039b0 msgr2=0x7ffb101e9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc0039b0 0x7ffb101e9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 -- 172.21.15.80:0/392417757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb100cf9a0 con 0x7ffb100cf050 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb15bde640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc0039b0 0x7ffb101e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb153dd640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb100a0a20 0x7ffb100a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb163df640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 0x7ffb100cf460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb100b8b70 tx=0x7ffb08010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08010e00 con 0x7ffb100cf050 2024-04-25T15:43:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08003990 con 0x7ffb100cf050 2024-04-25T15:43:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb101ea430 con 0x7ffb100cf050 2024-04-25T15:43:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08003d80 con 0x7ffb100cf050 2024-04-25T15:43:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.374+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb101ea9f0 con 0x7ffb100cf050 2024-04-25T15:43:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.375+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1006a100 con 0x7ffb100cf050 2024-04-25T15:43:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.376+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffb0801e020 con 0x7ffb100cf050 2024-04-25T15:43:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.376+0000 7ffb067fc640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffaf40744b0 0x7ffaf40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.376+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffb08095b90 con 0x7ffb100cf050 2024-04-25T15:43:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.376+0000 7ffb15bde640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffaf40744b0 0x7ffaf40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.377+0000 7ffb15bde640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffaf40744b0 0x7ffaf40769c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c001eb0 tx=0x7ffb0c02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.381+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb100cf9a0 con 0x7ffb100cf050 2024-04-25T15:43:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.567+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffb100a1530 con 0x7ffb100cf050 2024-04-25T15:43:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.568+0000 7ffb067fc640 1 -- 172.21.15.80:0/392417757 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ffb08060070 con 0x7ffb100cf050 2024-04-25T15:43:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:43:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffaf40744b0 msgr2=0x7ffaf40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffaf40744b0 0x7ffaf40769c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c001eb0 tx=0x7ffb0c02d000 comp rx=0 tx=0).stop 2024-04-25T15:43:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 msgr2=0x7ffb100cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 0x7ffb100cf460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb100b8b70 tx=0x7ffb08010590 comp rx=0 tx=0).stop 2024-04-25T15:43:14.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 shutdown_connections 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffaf40744b0 0x7ffaf40769c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb100cf050 0x7ffb100cf460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb100a0a20 0x7ffb100a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 --2- 172.21.15.80:0/392417757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffafc0039b0 0x7ffb101e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 >> 172.21.15.80:0/392417757 conn(0x7ffb100d0450 msgr2=0x7ffb100d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 shutdown_connections 2024-04-25T15:43:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:14.570+0000 7ffb17e42640 1 -- 172.21.15.80:0/392417757 wait complete. 2024-04-25T15:43:14.582 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi080.front.sepia.ceph.com... 2024-04-25T15:43:14.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:14.582 DEBUG:teuthology.orchestra.run.smithi080:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T15:43:14.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[41870]: fuse finished with error 0 and tester_r 0 2024-04-25T15:43:14.606 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:43:20.708 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:43:20.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:20.708 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T15:43:20.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.888+0000 7fd04ae84640 1 Processor -- start 2024-04-25T15:43:20.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.888+0000 7fd04ae84640 1 -- start start 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd04ae84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd04409bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd04ae84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0440cee60 0x7fd0440cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd04ae84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0440b3fe0 con 0x7fd0441604d0 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd04ae84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd0440ce6d0 con 0x7fd0440cee60 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd04ae84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd0440ce110 con 0x7fd0440d21f0 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0440cee60 0x7fd0440cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0440cee60 0x7fd0440cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52680/0 (socket says 172.21.15.80:52680) 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 -- 172.21.15.80:0/3314770141 learned_addr learned my addr 172.21.15.80:0/3314770141 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd043fff640 1 --2- 172.21.15.80:0/3314770141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd04409bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 -- 172.21.15.80:0/3314770141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 msgr2=0x7fd04409bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:20.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 --2- 172.21.15.80:0/3314770141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd04409bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 -- 172.21.15.80:0/3314770141 >> v1:172.21.15.80:6789/0 conn(0x7fd0441604d0 legacy=0x7fd0440d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd049421640 1 -- 172.21.15.80:0/3314770141 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0440ce3f0 con 0x7fd0440cee60 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.890+0000 7fd0437fe640 1 -- 172.21.15.80:0/3314770141 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925758165 0 0) 0x7fd0440b3fe0 con 0x7fd0441604d0 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.891+0000 7fd049421640 1 --2- 172.21.15.80:0/3314770141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0440cee60 0x7fd0440cf270 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009e50 tx=0x7fd03c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df007245b09e4f78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.891+0000 7fd0437fe640 1 -- 172.21.15.80:0/3314770141 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c036070 con 0x7fd0440cee60 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.891+0000 7fd0437fe640 1 -- 172.21.15.80:0/3314770141 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03c031600 con 0x7fd0440cee60 2024-04-25T15:43:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.891+0000 7fd0437fe640 1 -- 172.21.15.80:0/3314770141 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0319d0 con 0x7fd0440cee60 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 -- 172.21.15.80:0/3314770141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0440cee60 msgr2=0x7fd0440cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3314770141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0440cee60 0x7fd0440cf270 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009e50 tx=0x7fd03c02a710 comp rx=0 tx=0).stop 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 -- 172.21.15.80:0/3314770141 shutdown_connections 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3314770141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0440cee60 0x7fd0440cf270 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3314770141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd04409bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 -- 172.21.15.80:0/3314770141 >> 172.21.15.80:0/3314770141 conn(0x7fd0440b7620 msgr2=0x7fd0440b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 -- 172.21.15.80:0/3314770141 shutdown_connections 2024-04-25T15:43:20.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.892+0000 7fd04ae84640 1 -- 172.21.15.80:0/3314770141 wait complete. 2024-04-25T15:43:20.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.893+0000 7fd04ae84640 1 Processor -- start 2024-04-25T15:43:20.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.894+0000 7fd04ae84640 1 -- start start 2024-04-25T15:43:20.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd04ae84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440cee60 0x7fd0440c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd04ae84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd044159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd04ae84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 0x7fd04409e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd04ae84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440b3cf0 con 0x7fd0441604d0 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd04ae84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440b3b70 con 0x7fd0440cee60 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd04ae84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd0440cf7b0 con 0x7fd0440d21f0 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 0x7fd04409e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 0x7fd04409e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52682/0 (socket says 172.21.15.80:52682) 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 -- 172.21.15.80:0/3178948434 learned_addr learned my addr 172.21.15.80:0/3178948434 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd043fff640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd044159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd048c20640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440cee60 0x7fd0440c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 -- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 msgr2=0x7fd044159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd044159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:20.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 -- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440cee60 msgr2=0x7fd0440c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440cee60 0x7fd0440c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd049421640 1 -- 172.21.15.80:0/3178948434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04415ae30 con 0x7fd0441604d0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd048c20640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440cee60 0x7fd0440c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.895+0000 7fd043fff640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd044159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.896+0000 7fd049421640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 0x7fd04409e5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd03c034040 tx=0x7fd03c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.896+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c041020 con 0x7fd0441604d0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.896+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03c037040 con 0x7fd0441604d0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.896+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd044162cc0 con 0x7fd0441604d0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.896+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c036050 con 0x7fd0441604d0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.896+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0440c79d0 con 0x7fd0441604d0 2024-04-25T15:43:20.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.897+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04415aba0 con 0x7fd0441604d0 2024-04-25T15:43:20.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.898+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd03c007c30 con 0x7fd0441604d0 2024-04-25T15:43:20.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.898+0000 7fd0417fa640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd0280744b0 0x7fd0280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:20.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.898+0000 7fd048c20640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd0280744b0 0x7fd0280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:20.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.898+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd03c0b5d10 con 0x7fd0441604d0 2024-04-25T15:43:20.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.899+0000 7fd048c20640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd0280744b0 0x7fd0280769c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd038000f60 tx=0x7fd038009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:20.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:20.903+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd03c04b060 con 0x7fd0441604d0 2024-04-25T15:43:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.085+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd04406a100 con 0x7fd0441604d0 2024-04-25T15:43:21.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.086+0000 7fd0417fa640 1 -- 172.21.15.80:0/3178948434 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fd03c080280 con 0x7fd0441604d0 2024-04-25T15:43:21.087 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:21.088 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:21.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd0280744b0 msgr2=0x7fd0280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd0280744b0 0x7fd0280769c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd038000f60 tx=0x7fd038009040 comp rx=0 tx=0).stop 2024-04-25T15:43:21.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 msgr2=0x7fd04409e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 0x7fd04409e5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd03c034040 tx=0x7fd03c004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 shutdown_connections 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd0280744b0 0x7fd0280769c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0441604d0 0x7fd04409e5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0440d21f0 0x7fd044159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 --2- 172.21.15.80:0/3178948434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440cee60 0x7fd0440c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 >> 172.21.15.80:0/3178948434 conn(0x7fd0440b7620 msgr2=0x7fd0440684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 shutdown_connections 2024-04-25T15:43:21.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.088+0000 7fd04ae84640 1 -- 172.21.15.80:0/3178948434 wait complete. 2024-04-25T15:43:21.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:21.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.206+0000 7f53d6e84640 1 Processor -- start 2024-04-25T15:43:21.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.206+0000 7f53d6e84640 1 -- start start 2024-04-25T15:43:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d6e84640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53d00b7d60 0x7f53d016b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d6e84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d00d59d0 con 0x7f53d00d41b0 2024-04-25T15:43:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d6e84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d0163fb0 con 0x7f53d00b48d0 2024-04-25T15:43:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d6e84640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f53d0164270 con 0x7f53d00b7d60 2024-04-25T15:43:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d4c20640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f53d00d41b0 0x7f53d01602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48972/0 (socket says 172.21.15.80:48972) 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d4c20640 1 -- 172.21.15.80:0/2433385252 learned_addr learned my addr 172.21.15.80:0/2433385252 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53d5421640 1 --2- 172.21.15.80:0/2433385252 >> v2:172.21.15.195:3300/0 conn(0x7f53d00b7d60 0x7f53d016b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654730817 0 0) 0x7f53d00d59d0 con 0x7f53d00d41b0 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53b8003520 con 0x7f53d00d41b0 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 468702654 0 0) 0x7f53b8003520 con 0x7f53d00d41b0 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 >> v2:172.21.15.195:3300/0 conn(0x7f53d00b7d60 msgr2=0x7f53d016b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 --2- 172.21.15.80:0/2433385252 >> v2:172.21.15.195:3300/0 conn(0x7f53d00b7d60 0x7f53d016b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 >> v1:172.21.15.195:6789/0 conn(0x7f53d00b48d0 legacy=0x7f53d00b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d0164550 con 0x7f53d00d41b0 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f53c0001670 con 0x7f53d00d41b0 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.208+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 >> v1:172.21.15.80:6789/0 conn(0x7f53d00d41b0 legacy=0x7f53d01602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cf7fe640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b80039b0 0x7f53b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cf7fe640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b8004800 0x7f53b8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cf7fe640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b8005250 0x7f53b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0164270 con 0x7f53b80039b0 2024-04-25T15:43:21.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f53b800c1e0 con 0x7f53b8004800 2024-04-25T15:43:21.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f53b800c3e0 con 0x7f53b8005250 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d4c20640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b80039b0 0x7f53b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53cffff640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b8004800 0x7f53b8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d5421640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b8005250 0x7f53b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d4c20640 1 -- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b8005250 msgr2=0x7f53b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d4c20640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b8005250 0x7f53b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d4c20640 1 -- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b8004800 msgr2=0x7f53b8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d4c20640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b8004800 0x7f53b8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d4c20640 1 -- 172.21.15.80:0/2433385252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b8003520 con 0x7f53b80039b0 2024-04-25T15:43:21.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d5421640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b8005250 0x7f53b800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.209+0000 7f53d5421640 1 -- 172.21.15.80:0/2433385252 reap_dead start 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d4c20640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b80039b0 0x7f53b8003e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53c000c240 tx=0x7f53b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1208384f6b3149a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0007d10 con 0x7f53b80039b0 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c0005ad0 con 0x7f53b80039b0 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53cf7fe640 1 -- 172.21.15.80:0/2433385252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0007070 con 0x7f53b80039b0 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d6e84640 1 -- 172.21.15.80:0/2433385252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b80039b0 msgr2=0x7f53b8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d6e84640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b80039b0 0x7f53b8003e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53c000c240 tx=0x7f53b8005830 comp rx=0 tx=0).stop 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d6e84640 1 -- 172.21.15.80:0/2433385252 shutdown_connections 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d6e84640 1 --2- 172.21.15.80:0/2433385252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b80039b0 0x7f53b8003e20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d6e84640 1 -- 172.21.15.80:0/2433385252 >> 172.21.15.80:0/2433385252 conn(0x7f53d006e9f0 msgr2=0x7f53d00d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.210+0000 7f53d6e84640 1 -- 172.21.15.80:0/2433385252 shutdown_connections 2024-04-25T15:43:21.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.211+0000 7f53d6e84640 1 -- 172.21.15.80:0/2433385252 wait complete. 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.212+0000 7f53d6e84640 1 Processor -- start 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.212+0000 7f53d6e84640 1 -- start start 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b80039b0 0x7f53d014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d014daf0 0x7f53d01f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 0x7f53d00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53d00b4fd0 con 0x7f53d01f9a80 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0164b10 con 0x7f53d014daf0 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f53d00b5150 con 0x7f53b80039b0 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 0x7f53d00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 0x7f53d00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52688/0 (socket says 172.21.15.80:52688) 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 -- 172.21.15.80:0/156476121 learned_addr learned my addr 172.21.15.80:0/156476121 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d4c20640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b80039b0 0x7f53d014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53cffff640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d014daf0 0x7f53d01f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 -- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b80039b0 msgr2=0x7f53d014b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b80039b0 0x7f53d014b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 -- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d014daf0 msgr2=0x7f53d01f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d014daf0 0x7f53d01f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 -- 172.21.15.80:0/156476121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d01f9e90 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53cffff640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d014daf0 0x7f53d01f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d4c20640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b80039b0 0x7f53d014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d5421640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 0x7f53d00cb070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f53d0165070 tx=0x7f53c8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8010e00 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c8003990 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d014e5f0 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8003dc0 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.214+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d00ca870 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.216+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d014e360 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.216+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f53c8005d10 con 0x7f53d01f9a80 2024-04-25T15:43:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.216+0000 7f53cd7fa640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53bc0744b0 0x7f53bc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.217+0000 7f53d4c20640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53bc0744b0 0x7f53bc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.217+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f53c8095d40 con 0x7f53d01f9a80 2024-04-25T15:43:21.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.217+0000 7f53d4c20640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53bc0744b0 0x7f53bc0769c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53c0032000 tx=0x7f53c0034040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:21.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.221+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53c8025020 con 0x7f53d01f9a80 2024-04-25T15:43:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.404+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53d00ca660 con 0x7f53d01f9a80 2024-04-25T15:43:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.405+0000 7f53cd7fa640 1 -- 172.21.15.80:0/156476121 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f53d01f9e90 con 0x7f53d01f9a80 2024-04-25T15:43:21.406 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:21.406 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53bc0744b0 msgr2=0x7f53bc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53bc0744b0 0x7f53bc0769c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53c0032000 tx=0x7f53c0034040 comp rx=0 tx=0).stop 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 msgr2=0x7f53d00cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 0x7f53d00cb070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f53d0165070 tx=0x7f53c8010590 comp rx=0 tx=0).stop 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 shutdown_connections 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53bc0744b0 0x7f53bc0769c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d01f9a80 0x7f53d00cb070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d014daf0 0x7f53d01f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 --2- 172.21.15.80:0/156476121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53b80039b0 0x7f53d014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 >> 172.21.15.80:0/156476121 conn(0x7f53d006e9f0 msgr2=0x7f53d015f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 shutdown_connections 2024-04-25T15:43:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.407+0000 7f53d6e84640 1 -- 172.21.15.80:0/156476121 wait complete. 2024-04-25T15:43:21.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:43:21.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.528+0000 7fb5f60b8640 1 Processor -- start 2024-04-25T15:43:21.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.528+0000 7fb5f60b8640 1 -- start start 2024-04-25T15:43:21.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.529+0000 7fb5f60b8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5f00b5490 0x7fb5f0160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.529+0000 7fb5f60b8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb5f00d0b00 0x7fb5f00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.529+0000 7fb5f60b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5f60b8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f01643f0 con 0x7fb5f00b5490 2024-04-25T15:43:21.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5f60b8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f01646d0 con 0x7fb5f00d0b00 2024-04-25T15:43:21.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5f60b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f01649b0 con 0x7fb5f00d2b80 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5f00b5490 0x7fb5f0160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5f00b5490 0x7fb5f0160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52690/0 (socket says 172.21.15.80:52690) 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/3831659810 learned_addr learned my addr 172.21.15.80:0/3831659810 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5effff640 1 --2- 172.21.15.80:0/3831659810 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5eeffd640 1 --2- 172.21.15.80:0/3831659810 >> v2:172.21.15.195:3300/0 conn(0x7fb5f00d0b00 0x7fb5f00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/3831659810 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 msgr2=0x7fb5f00b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 --2- 172.21.15.80:0/3831659810 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/3831659810 >> v2:172.21.15.195:3300/0 conn(0x7fb5f00d0b00 msgr2=0x7fb5f00d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 --2- 172.21.15.80:0/3831659810 >> v2:172.21.15.195:3300/0 conn(0x7fb5f00d0b00 0x7fb5f00d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.530+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/3831659810 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f0164c90 con 0x7fb5f00b5490 2024-04-25T15:43:21.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.531+0000 7fb5ef7fe640 1 --2- 172.21.15.80:0/3831659810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00b5490 0x7fb5f0160300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0163ee0 tx=0x7fb5e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50e6f5f992dcd32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:21.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.531+0000 7fb5ee7fc640 1 -- 172.21.15.80:0/3831659810 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0037070 con 0x7fb5f00b5490 2024-04-25T15:43:21.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.531+0000 7fb5ee7fc640 1 -- 172.21.15.80:0/3831659810 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0032440 con 0x7fb5f00b5490 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.531+0000 7fb5ee7fc640 1 -- 172.21.15.80:0/3831659810 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0032810 con 0x7fb5f00b5490 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.531+0000 7fb5f60b8640 1 -- 172.21.15.80:0/3831659810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00b5490 msgr2=0x7fb5f0160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/3831659810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00b5490 0x7fb5f0160300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0163ee0 tx=0x7fb5e002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 -- 172.21.15.80:0/3831659810 shutdown_connections 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/3831659810 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/3831659810 >> v2:172.21.15.195:3300/0 conn(0x7fb5f00d0b00 0x7fb5f00d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/3831659810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00b5490 0x7fb5f0160300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 -- 172.21.15.80:0/3831659810 >> 172.21.15.80:0/3831659810 conn(0x7fb5f006e650 msgr2=0x7fb5f006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 -- 172.21.15.80:0/3831659810 shutdown_connections 2024-04-25T15:43:21.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.532+0000 7fb5f60b8640 1 -- 172.21.15.80:0/3831659810 wait complete. 2024-04-25T15:43:21.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.533+0000 7fb5f60b8640 1 Processor -- start 2024-04-25T15:43:21.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.534+0000 7fb5f60b8640 1 -- start start 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5f60b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f00d0b00 0x7fb5f00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5f60b8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5f60b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 0x7fb5f00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5f60b8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f00b9360 con 0x7fb5f00af130 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5f60b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f00d2f90 con 0x7fb5f00d0b00 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5f60b8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f00b94e0 con 0x7fb5f00d2b80 2024-04-25T15:43:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 0x7fb5f00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 0x7fb5f00aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52702/0 (socket says 172.21.15.80:52702) 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 -- 172.21.15.80:0/890774744 learned_addr learned my addr 172.21.15.80:0/890774744 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5eeffd640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5ef7fe640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f00d0b00 0x7fb5f00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 -- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 msgr2=0x7fb5f00ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 -- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f00d0b00 msgr2=0x7fb5f00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f00d0b00 0x7fb5f00aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 -- 172.21.15.80:0/890774744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f00af5d0 con 0x7fb5f00af130 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.535+0000 7fb5effff640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 0x7fb5f00aded0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8007e90 tx=0x7fb5e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.536+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8014420 con 0x7fb5f00af130 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.536+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8019070 con 0x7fb5f00af130 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.536+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f00ac8f0 con 0x7fb5f00af130 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.536+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8014800 con 0x7fb5f00af130 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.536+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f00aceb0 con 0x7fb5f00af130 2024-04-25T15:43:21.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.537+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f006a100 con 0x7fb5f00af130 2024-04-25T15:43:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.537+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb5e80149a0 con 0x7fb5f00af130 2024-04-25T15:43:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.538+0000 7fb5d7fff640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5dc0744b0 0x7fb5dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.538+0000 7fb5ef7fe640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5dc0744b0 0x7fb5dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.538+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb5e8095bc0 con 0x7fb5f00af130 2024-04-25T15:43:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.538+0000 7fb5ef7fe640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5dc0744b0 0x7fb5dc0769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0034000 tx=0x7fb5e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:21.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.542+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5e805f9c0 con 0x7fb5f00af130 2024-04-25T15:43:21.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:21.757+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb5f00d41d0 con 0x7fb5f00af130 2024-04-25T15:43:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.366+0000 7fb5d7fff640 1 -- 172.21.15.80:0/890774744 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fb5e8063cc0 con 0x7fb5f00af130 2024-04-25T15:43:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5dc0744b0 msgr2=0x7fb5dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5dc0744b0 0x7fb5dc0769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0034000 tx=0x7fb5e002e000 comp rx=0 tx=0).stop 2024-04-25T15:43:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 msgr2=0x7fb5f00aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 0x7fb5f00aded0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8007e90 tx=0x7fb5e800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 shutdown_connections 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5dc0744b0 0x7fb5dc0769c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00af130 0x7fb5f00aded0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5f00d2b80 0x7fb5f00ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 --2- 172.21.15.80:0/890774744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f00d0b00 0x7fb5f00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 >> 172.21.15.80:0/890774744 conn(0x7fb5f006e650 msgr2=0x7fb5f00ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 shutdown_connections 2024-04-25T15:43:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.369+0000 7fb5f60b8640 1 -- 172.21.15.80:0/890774744 wait complete. 2024-04-25T15:43:22.383 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-25T15:43:22.383 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:43:22.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.498+0000 7ff6c4c4a640 1 Processor -- start 2024-04-25T15:43:22.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.498+0000 7ff6c4c4a640 1 -- start start 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6c4c4a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6c4c4a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6c006db10 0x7ff6c00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6c4c4a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c006df20 con 0x7ff6c00b0ca0 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6c4c4a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff6c00d1620 con 0x7ff6c006db10 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6c4c4a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c00b5460 con 0x7ff6c015cc80 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6c006db10 0x7ff6c00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6c006db10 0x7ff6c00b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52710/0 (socket says 172.21.15.80:52710) 2024-04-25T15:43:22.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 -- 172.21.15.80:0/3336189255 learned_addr learned my addr 172.21.15.80:0/3336189255 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6be59c640 1 --2- 172.21.15.80:0/3336189255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 -- 172.21.15.80:0/3336189255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 msgr2=0x7ff6c006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 --2- 172.21.15.80:0/3336189255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 -- 172.21.15.80:0/3336189255 >> v1:172.21.15.195:6789/0 conn(0x7ff6c00b0ca0 legacy=0x7ff6c01608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.500+0000 7ff6bdd9b640 1 -- 172.21.15.80:0/3336189255 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c00b4850 con 0x7ff6c006db10 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.501+0000 7ff6bdd9b640 1 --2- 172.21.15.80:0/3336189255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c00b0760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400bb10 tx=0x7ff6b402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ed88559b7080a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.501+0000 7ff6bd59a640 1 -- 172.21.15.80:0/3336189255 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4032790 con 0x7ff6c006db10 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.501+0000 7ff6bd59a640 1 -- 172.21.15.80:0/3336189255 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b4038070 con 0x7ff6c006db10 2024-04-25T15:43:22.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.501+0000 7ff6bd59a640 1 -- 172.21.15.80:0/3336189255 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4032b50 con 0x7ff6c006db10 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/3336189255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 msgr2=0x7ff6c00b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/3336189255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c00b0760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400bb10 tx=0x7ff6b402c8d0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/3336189255 shutdown_connections 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/3336189255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c00b0760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/3336189255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/3336189255 >> 172.21.15.80:0/3336189255 conn(0x7ff6c00734b0 msgr2=0x7ff6c00738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/3336189255 shutdown_connections 2024-04-25T15:43:22.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.502+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/3336189255 wait complete. 2024-04-25T15:43:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.504+0000 7ff6c4c4a640 1 Processor -- start 2024-04-25T15:43:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.504+0000 7ff6c4c4a640 1 -- start start 2024-04-25T15:43:22.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6c4c4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6c4c4a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6c00b0ca0 0x7ff6c0149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6c4c4a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c0145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6c4c4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c00b50f0 con 0x7ff6c006db10 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6c4c4a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c00b4e10 con 0x7ff6c00b0ca0 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6c4c4a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c015d090 con 0x7ff6c015cc80 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c015f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52722/0 (socket says 172.21.15.80:52722) 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 -- 172.21.15.80:0/1896314591 learned_addr learned my addr 172.21.15.80:0/1896314591 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6bdd9b640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6c00b0ca0 0x7ff6c0149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6bed9d640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c0145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 -- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 msgr2=0x7ff6c0145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c0145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 -- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6c00b0ca0 msgr2=0x7ff6c0149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6c00b0ca0 0x7ff6c0149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6be59c640 1 -- 172.21.15.80:0/1896314591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c0143a10 con 0x7ff6c006db10 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.505+0000 7ff6bed9d640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c0145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.506+0000 7ff6be59c640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c015f4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0007e40 tx=0x7ff6b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.506+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0014620 con 0x7ff6c006db10 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.506+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b0019070 con 0x7ff6c006db10 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.506+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c00ce2a0 con 0x7ff6c006db10 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.506+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0014a00 con 0x7ff6c006db10 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.506+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c00ce540 con 0x7ff6c006db10 2024-04-25T15:43:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.507+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c0143be0 con 0x7ff6c006db10 2024-04-25T15:43:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.508+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff6b0014ba0 con 0x7ff6c006db10 2024-04-25T15:43:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.508+0000 7ff6aeffd640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6a00744b0 0x7ff6a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.508+0000 7ff6bdd9b640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6a00744b0 0x7ff6a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.508+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff6b0095cd0 con 0x7ff6c006db10 2024-04-25T15:43:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.509+0000 7ff6bdd9b640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6a00744b0 0x7ff6a00769c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4037000 tx=0x7ff6b4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:22.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.513+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff6b00601b0 con 0x7ff6c006db10 2024-04-25T15:43:22.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:22.728+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff6c006a100 con 0x7ff6c006db10 2024-04-25T15:43:23.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.372+0000 7ff6aeffd640 1 -- 172.21.15.80:0/1896314591 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7ff6b005fab0 con 0x7ff6c006db10 2024-04-25T15:43:23.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6a00744b0 msgr2=0x7ff6a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6a00744b0 0x7ff6a00769c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4037000 tx=0x7ff6b4032000 comp rx=0 tx=0).stop 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 msgr2=0x7ff6c015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c015f4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0007e40 tx=0x7ff6b000e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 shutdown_connections 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6a00744b0 0x7ff6a00769c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6c015cc80 0x7ff6c0145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6c00b0ca0 0x7ff6c0149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 --2- 172.21.15.80:0/1896314591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c006db10 0x7ff6c015f4d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 >> 172.21.15.80:0/1896314591 conn(0x7ff6c00734b0 msgr2=0x7ff6c00b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 shutdown_connections 2024-04-25T15:43:23.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.374+0000 7ff6c4c4a640 1 -- 172.21.15.80:0/1896314591 wait complete. 2024-04-25T15:43:23.387 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:43:23.387 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:23.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.495+0000 7f9a2b934640 1 Processor -- start 2024-04-25T15:43:23.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.495+0000 7f9a2b934640 1 -- start start 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a2b934640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a240b91b0 0x7f9a2406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a2b934640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a240b3ac0 0x7f9a240b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a2b934640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a240d1010 con 0x7f9a240d34a0 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a2b934640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9a2409cdf0 con 0x7f9a240b3ac0 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a2b934640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9a2409d0d0 con 0x7f9a240b91b0 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a29ed1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a240b3ac0 0x7f9a240b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a296d0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a240d34a0 0x7f9a2406e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48988/0 (socket says 172.21.15.80:48988) 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a296d0640 1 -- 172.21.15.80:0/839518221 learned_addr learned my addr 172.21.15.80:0/839518221 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a28ecf640 1 --2- 172.21.15.80:0/839518221 >> v2:172.21.15.195:3300/0 conn(0x7f9a240b91b0 0x7f9a2406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a29ed1640 1 -- 172.21.15.80:0/839518221 >> v2:172.21.15.195:3300/0 conn(0x7f9a240b91b0 msgr2=0x7f9a2406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a29ed1640 1 --2- 172.21.15.80:0/839518221 >> v2:172.21.15.195:3300/0 conn(0x7f9a240b91b0 0x7f9a2406da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a29ed1640 1 -- 172.21.15.80:0/839518221 >> v1:172.21.15.80:6789/0 conn(0x7f9a240d34a0 legacy=0x7f9a2406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a1bfff640 1 -- 172.21.15.80:0/839518221 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764842130 0 0) 0x7f9a240d1010 con 0x7f9a240d34a0 2024-04-25T15:43:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.497+0000 7f9a29ed1640 1 -- 172.21.15.80:0/839518221 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2406ec70 con 0x7f9a240b3ac0 2024-04-25T15:43:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.498+0000 7f9a29ed1640 1 --2- 172.21.15.80:0/839518221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a240b3ed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a240691b0 tx=0x7f9a1c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c80791dbb56471 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.498+0000 7f9a1bfff640 1 -- 172.21.15.80:0/839518221 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c037070 con 0x7f9a240b3ac0 2024-04-25T15:43:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.498+0000 7f9a1bfff640 1 -- 172.21.15.80:0/839518221 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c032440 con 0x7f9a240b3ac0 2024-04-25T15:43:23.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.498+0000 7f9a1bfff640 1 -- 172.21.15.80:0/839518221 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c032810 con 0x7f9a240b3ac0 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 -- 172.21.15.80:0/839518221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 msgr2=0x7f9a240b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 --2- 172.21.15.80:0/839518221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a240b3ed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a240691b0 tx=0x7f9a1c02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 -- 172.21.15.80:0/839518221 shutdown_connections 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 --2- 172.21.15.80:0/839518221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a240b3ed0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 --2- 172.21.15.80:0/839518221 >> v2:172.21.15.195:3300/0 conn(0x7f9a240b91b0 0x7f9a2406da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 -- 172.21.15.80:0/839518221 >> 172.21.15.80:0/839518221 conn(0x7f9a240d0450 msgr2=0x7f9a240d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 -- 172.21.15.80:0/839518221 shutdown_connections 2024-04-25T15:43:23.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.499+0000 7f9a2b934640 1 -- 172.21.15.80:0/839518221 wait complete. 2024-04-25T15:43:23.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.500+0000 7f9a2b934640 1 Processor -- start 2024-04-25T15:43:23.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.501+0000 7f9a2b934640 1 -- start start 2024-04-25T15:43:23.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a2b934640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a241e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a2b934640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a240b91b0 0x7f9a24149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a2b934640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a240d34a0 0x7f9a2415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a2b934640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240b4410 con 0x7f9a240b3ac0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a2b934640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2406d7b0 con 0x7f9a240d34a0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a2b934640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9a240b4590 con 0x7f9a240b91b0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a241e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a241e9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52744/0 (socket says 172.21.15.80:52744) 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 -- 172.21.15.80:0/95427568 learned_addr learned my addr 172.21.15.80:0/95427568 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a28ecf640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a240b91b0 0x7f9a24149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a29ed1640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a240d34a0 0x7f9a2415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 -- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a240b91b0 msgr2=0x7f9a24149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a240b91b0 0x7f9a24149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 -- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a240d34a0 msgr2=0x7f9a2415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a240d34a0 0x7f9a2415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 -- 172.21.15.80:0/95427568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a241ea750 con 0x7f9a240b3ac0 2024-04-25T15:43:23.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a296d0640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a241e9f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c750 tx=0x7f9a2000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.502+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000ce60 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.503+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2000a640 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.503+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a241eaa30 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.503+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000aa30 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.503+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a2414a280 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.504+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a240b0f50 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.504+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9a2000abd0 con 0x7f9a240b3ac0 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.505+0000 7f9a19ffb640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a080744b0 0x7f9a080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.505+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9a200952f0 con 0x7f9a240b3ac0 2024-04-25T15:43:23.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.505+0000 7f9a28ecf640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a080744b0 0x7f9a080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.505+0000 7f9a28ecf640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a080744b0 0x7f9a080769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a240d31a0 tx=0x7f9a14009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:23.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.509+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a2005f180 con 0x7f9a240b3ac0 2024-04-25T15:43:23.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.720+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a2406a100 con 0x7f9a240b3ac0 2024-04-25T15:43:23.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.721+0000 7f9a19ffb640 1 -- 172.21.15.80:0/95427568 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f9a20063480 con 0x7f9a240b3ac0 2024-04-25T15:43:23.722 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:23.722 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:23.722 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a080744b0 msgr2=0x7f9a080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a080744b0 0x7f9a080769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a240d31a0 tx=0x7f9a14009190 comp rx=0 tx=0).stop 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 msgr2=0x7f9a241e9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a241e9f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c750 tx=0x7f9a2000cc10 comp rx=0 tx=0).stop 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 shutdown_connections 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a080744b0 0x7f9a080769c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a240d34a0 0x7f9a2415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a240b91b0 0x7f9a24149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 --2- 172.21.15.80:0/95427568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a240b3ac0 0x7f9a241e9f90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 >> 172.21.15.80:0/95427568 conn(0x7f9a240d0450 msgr2=0x7f9a24071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:23.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 shutdown_connections 2024-04-25T15:43:23.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.723+0000 7f9a2b934640 1 -- 172.21.15.80:0/95427568 wait complete. 2024-04-25T15:43:23.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:23.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.840+0000 7f08a49b4640 1 Processor -- start 2024-04-25T15:43:23.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.840+0000 7f08a49b4640 1 -- start start 2024-04-25T15:43:23.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.841+0000 7f08a49b4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08a00d26d0 0x7f08a0162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.841+0000 7f08a49b4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a00d37e0 con 0x7f08a00ce810 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.841+0000 7f08a49b4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a00b8240 con 0x7f08a00d22c0 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.841+0000 7f08a49b4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f08a009cd00 con 0x7f08a00d26d0 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.841+0000 7f0897fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08a00d26d0 0x7f08a0162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f089ed9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f08a00ce810 0x7f08a00cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48994/0 (socket says 172.21.15.80:48994) 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f0897fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08a00d26d0 0x7f08a0162df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52748/0 (socket says 172.21.15.80:52748) 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f089ed9d640 1 -- 172.21.15.80:0/774322682 learned_addr learned my addr 172.21.15.80:0/774322682 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f0897fff640 1 -- 172.21.15.80:0/774322682 >> v1:172.21.15.195:6789/0 conn(0x7f08a00d22c0 legacy=0x7f08a01626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f0897fff640 1 -- 172.21.15.80:0/774322682 >> v1:172.21.15.80:6789/0 conn(0x7f08a00ce810 legacy=0x7f08a00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f0897fff640 1 -- 172.21.15.80:0/774322682 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00b91c0 con 0x7f08a00d26d0 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f089dd9b640 1 -- 172.21.15.80:0/774322682 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371294494 0 0) 0x7f08a00d37e0 con 0x7f08a00ce810 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.842+0000 7f0897fff640 1 --2- 172.21.15.80:0/774322682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00d26d0 0x7f08a0162df0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f08880097a0 tx=0x7f088802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4c0cfb82a33226 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f089dd9b640 1 -- 172.21.15.80:0/774322682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888037070 con 0x7f08a00d26d0 2024-04-25T15:43:23.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f089dd9b640 1 -- 172.21.15.80:0/774322682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088802adc0 con 0x7f08a00d26d0 2024-04-25T15:43:23.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f089dd9b640 1 -- 172.21.15.80:0/774322682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888032660 con 0x7f08a00d26d0 2024-04-25T15:43:23.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 -- 172.21.15.80:0/774322682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00d26d0 msgr2=0x7f08a0162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 --2- 172.21.15.80:0/774322682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00d26d0 0x7f08a0162df0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f08880097a0 tx=0x7f088802a0b0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 -- 172.21.15.80:0/774322682 shutdown_connections 2024-04-25T15:43:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 --2- 172.21.15.80:0/774322682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00d26d0 0x7f08a0162df0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 -- 172.21.15.80:0/774322682 >> 172.21.15.80:0/774322682 conn(0x7f08a00d0450 msgr2=0x7f08a00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 -- 172.21.15.80:0/774322682 shutdown_connections 2024-04-25T15:43:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.843+0000 7f08a49b4640 1 -- 172.21.15.80:0/774322682 wait complete. 2024-04-25T15:43:23.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.845+0000 7f08a49b4640 1 Processor -- start 2024-04-25T15:43:23.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.845+0000 7f08a49b4640 1 -- start start 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 0x7f08a009d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08a00d22c0 0x7f08a00c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08a00d26d0 0x7f08a00c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08a009d190 con 0x7f08a00ce810 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00cfe50 con 0x7f08a00d22c0 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f08a00d47e0 con 0x7f08a00d26d0 2024-04-25T15:43:23.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 0x7f08a009d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 0x7f08a009d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52764/0 (socket says 172.21.15.80:52764) 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 -- 172.21.15.80:0/127730266 learned_addr learned my addr 172.21.15.80:0/127730266 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f0897fff640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08a00d22c0 0x7f08a00c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089ed9d640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08a00d26d0 0x7f08a00c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 -- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08a00d26d0 msgr2=0x7f08a00c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08a00d26d0 0x7f08a00c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 -- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08a00d22c0 msgr2=0x7f08a00c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08a00d22c0 0x7f08a00c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 -- 172.21.15.80:0/127730266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00ca440 con 0x7f08a00ce810 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f089e59c640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 0x7f08a009d790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f089000b3e0 tx=0x7f089000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890015020 con 0x7f08a00ce810 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0890011850 con 0x7f08a00ce810 2024-04-25T15:43:23.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a00c7580 con 0x7f08a00ce810 2024-04-25T15:43:23.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.847+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890011c80 con 0x7f08a00ce810 2024-04-25T15:43:23.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.848+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a00c7820 con 0x7f08a00ce810 2024-04-25T15:43:23.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.848+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a006a100 con 0x7f08a00ce810 2024-04-25T15:43:23.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.849+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0890018020 con 0x7f08a00ce810 2024-04-25T15:43:23.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.850+0000 7f0896ffd640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08800744b0 0x7f08800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:23.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.850+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0890095170 con 0x7f08a00ce810 2024-04-25T15:43:23.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.850+0000 7f0897fff640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08800744b0 0x7f08800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:23.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.850+0000 7f0897fff640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08800744b0 0x7f08800769c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0888034000 tx=0x7f088802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:23.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:23.854+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08a00c7580 con 0x7f08a00ce810 2024-04-25T15:43:24.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.029+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08a00c7060 con 0x7f08a00ce810 2024-04-25T15:43:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.030+0000 7f0896ffd640 1 -- 172.21.15.80:0/127730266 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f0890011e20 con 0x7f08a00ce810 2024-04-25T15:43:24.032 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:24.032 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08800744b0 msgr2=0x7f08800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08800744b0 0x7f08800769c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0888034000 tx=0x7f088802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 msgr2=0x7f08a009d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 0x7f08a009d790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f089000b3e0 tx=0x7f089000b8a0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 shutdown_connections 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08800744b0 0x7f08800769c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08a00d26d0 0x7f08a00c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08a00d22c0 0x7f08a00c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 --2- 172.21.15.80:0/127730266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00ce810 0x7f08a009d790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 >> 172.21.15.80:0/127730266 conn(0x7f08a00d0450 msgr2=0x7f08a0072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 shutdown_connections 2024-04-25T15:43:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.033+0000 7f08a49b4640 1 -- 172.21.15.80:0/127730266 wait complete. 2024-04-25T15:43:24.045 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:43:24.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:43:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.151+0000 7fd53c46e640 1 Processor -- start 2024-04-25T15:43:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.151+0000 7fd53c46e640 1 -- start start 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53c46e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd5340cff30 0x7fd5340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53c46e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd5340b2a40 0x7fd53409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53c46e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5340b9350 con 0x7fd5340d2120 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53c46e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd5340cfb70 con 0x7fd5340b2a40 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53c46e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd5340cf890 con 0x7fd5340cff30 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd539a09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd5340b2a40 0x7fd53409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53aa0b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd5340d2120 0x7fd5340d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49000/0 (socket says 172.21.15.80:49000) 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53aa0b640 1 -- 172.21.15.80:0/661000327 learned_addr learned my addr 172.21.15.80:0/661000327 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd53a20a640 1 --2- 172.21.15.80:0/661000327 >> v2:172.21.15.195:3300/0 conn(0x7fd5340cff30 0x7fd5340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd539a09640 1 -- 172.21.15.80:0/661000327 >> v2:172.21.15.195:3300/0 conn(0x7fd5340cff30 msgr2=0x7fd5340b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd539a09640 1 --2- 172.21.15.80:0/661000327 >> v2:172.21.15.195:3300/0 conn(0x7fd5340cff30 0x7fd5340b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd539a09640 1 -- 172.21.15.80:0/661000327 >> v1:172.21.15.80:6789/0 conn(0x7fd5340d2120 legacy=0x7fd5340d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.153+0000 7fd539a09640 1 -- 172.21.15.80:0/661000327 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5340b9020 con 0x7fd5340b2a40 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.154+0000 7fd539a09640 1 --2- 172.21.15.80:0/661000327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340b2a40 0x7fd53409ce90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5340510d0 tx=0x7fd52402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eea531f984731ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.154+0000 7fd539208640 1 -- 172.21.15.80:0/661000327 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524037070 con 0x7fd5340b2a40 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.154+0000 7fd539208640 1 -- 172.21.15.80:0/661000327 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52402aca0 con 0x7fd5340b2a40 2024-04-25T15:43:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.154+0000 7fd539208640 1 -- 172.21.15.80:0/661000327 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524032660 con 0x7fd5340b2a40 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 -- 172.21.15.80:0/661000327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340b2a40 msgr2=0x7fd53409ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 --2- 172.21.15.80:0/661000327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340b2a40 0x7fd53409ce90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5340510d0 tx=0x7fd52402a010 comp rx=0 tx=0).stop 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 -- 172.21.15.80:0/661000327 shutdown_connections 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 --2- 172.21.15.80:0/661000327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340b2a40 0x7fd53409ce90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 --2- 172.21.15.80:0/661000327 >> v2:172.21.15.195:3300/0 conn(0x7fd5340cff30 0x7fd5340b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 -- 172.21.15.80:0/661000327 >> 172.21.15.80:0/661000327 conn(0x7fd5340d0450 msgr2=0x7fd5340d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 -- 172.21.15.80:0/661000327 shutdown_connections 2024-04-25T15:43:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.155+0000 7fd53c46e640 1 -- 172.21.15.80:0/661000327 wait complete. 2024-04-25T15:43:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.157+0000 7fd53c46e640 1 Processor -- start 2024-04-25T15:43:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.157+0000 7fd53c46e640 1 -- start start 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53c46e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5340b2a40 0x7fd53409e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53c46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 0x7fd5340a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53c46e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340d2120 0x7fd5340a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53c46e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340d10f0 con 0x7fd5340cff30 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53c46e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340d0f70 con 0x7fd5340d2120 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53c46e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd5340d2530 con 0x7fd5340b2a40 2024-04-25T15:43:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 0x7fd5340a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 0x7fd5340a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52794/0 (socket says 172.21.15.80:52794) 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 -- 172.21.15.80:0/3168360460 learned_addr learned my addr 172.21.15.80:0/3168360460 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53a20a640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5340b2a40 0x7fd53409e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd53aa0b640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340d2120 0x7fd5340a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 -- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5340b2a40 msgr2=0x7fd53409e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5340b2a40 0x7fd53409e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 -- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340d2120 msgr2=0x7fd5340a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340d2120 0x7fd5340a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 -- 172.21.15.80:0/3168360460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53414c060 con 0x7fd5340cff30 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.158+0000 7fd539a09640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 0x7fd5340a0ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd524000c00 tx=0x7fd5240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.159+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524037040 con 0x7fd5340cff30 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.159+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52402ae50 con 0x7fd5340cff30 2024-04-25T15:43:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.159+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53414c340 con 0x7fd5340cff30 2024-04-25T15:43:24.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.159+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524004490 con 0x7fd5340cff30 2024-04-25T15:43:24.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.159+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd53414c900 con 0x7fd5340cff30 2024-04-25T15:43:24.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.160+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53414cce0 con 0x7fd5340cff30 2024-04-25T15:43:24.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.160+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd52402ab60 con 0x7fd5340cff30 2024-04-25T15:43:24.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.161+0000 7fd52affd640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5180744b0 0x7fd5180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.161+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd5240b5ee0 con 0x7fd5340cff30 2024-04-25T15:43:24.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.161+0000 7fd53a20a640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5180744b0 0x7fd5180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.161+0000 7fd53a20a640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5180744b0 0x7fd5180769c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd530009ee0 tx=0x7fd53000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.166+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd53414cce0 con 0x7fd5340cff30 2024-04-25T15:43:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.339+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd53414be10 con 0x7fd5180744b0 2024-04-25T15:43:24.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.347+0000 7fd52affd640 1 -- 172.21.15.80:0/3168360460 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fd53414be10 con 0x7fd5180744b0 2024-04-25T15:43:24.352 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:24.355 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5180744b0 msgr2=0x7fd5180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5180744b0 0x7fd5180769c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd530009ee0 tx=0x7fd53000b040 comp rx=0 tx=0).stop 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 msgr2=0x7fd5340a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 0x7fd5340a0ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd524000c00 tx=0x7fd5240046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 shutdown_connections 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5180744b0 0x7fd5180769c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340d2120 0x7fd5340a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5340cff30 0x7fd5340a0ed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 --2- 172.21.15.80:0/3168360460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5340b2a40 0x7fd53409e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 >> 172.21.15.80:0/3168360460 conn(0x7fd5340d0450 msgr2=0x7fd53415d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 shutdown_connections 2024-04-25T15:43:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.351+0000 7fd53c46e640 1 -- 172.21.15.80:0/3168360460 wait complete. 2024-04-25T15:43:24.363 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-25T15:43:23.002210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2018232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362284+0000","last_change":"2024-04-25T15:43:00.262559+0000","last_active":"2024-04-25T15:43:07.362284+0000","last_peered":"2024-04-25T15:43:07.362284+0000","last_clean":"2024-04-25T15:43:07.362284+0000","last_became_active":"2024-04-25T15:43:00.260334+0000","last_became_peered":"2024-04-25T15:43:00.260334+0000","last_unstale":"2024-04-25T15:43:07.362284+0000","last_undegraded":"2024-04-25T15:43:07.362284+0000","last_fullsized":"2024-04-25T15:43:07.362284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:37.689363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360799+0000","last_change":"2024-04-25T15:43:01.287221+0000","last_active":"2024-04-25T15:43:07.360799+0000","last_peered":"2024-04-25T15:43:07.360799+0000","last_clean":"2024-04-25T15:43:07.360799+0000","last_became_active":"2024-04-25T15:43:01.286908+0000","last_became_peered":"2024-04-25T15:43:01.286908+0000","last_unstale":"2024-04-25T15:43:07.360799+0000","last_undegraded":"2024-04-25T15:43:07.360799+0000","last_fullsized":"2024-04-25T15:43:07.360799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359974+0000","last_change":"2024-04-25T15:43:05.318849+0000","last_active":"2024-04-25T15:43:07.359974+0000","last_peered":"2024-04-25T15:43:07.359974+0000","last_clean":"2024-04-25T15:43:07.359974+0000","last_became_active":"2024-04-25T15:43:05.318430+0000","last_became_peered":"2024-04-25T15:43:05.318430+0000","last_unstale":"2024-04-25T15:43:07.359974+0000","last_undegraded":"2024-04-25T15:43:07.359974+0000","last_fullsized":"2024-04-25T15:43:07.359974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361076+0000","last_change":"2024-04-25T15:43:00.271120+0000","last_active":"2024-04-25T15:43:07.361076+0000","last_peered":"2024-04-25T15:43:07.361076+0000","last_clean":"2024-04-25T15:43:07.361076+0000","last_became_active":"2024-04-25T15:43:00.270825+0000","last_became_peered":"2024-04-25T15:43:00.270825+0000","last_unstale":"2024-04-25T15:43:07.361076+0000","last_undegraded":"2024-04-25T15:43:07.361076+0000","last_fullsized":"2024-04-25T15:43:07.361076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362058+0000","last_change":"2024-04-25T15:43:01.301805+0000","last_active":"2024-04-25T15:43:07.362058+0000","last_peered":"2024-04-25T15:43:07.362058+0000","last_clean":"2024-04-25T15:43:07.362058+0000","last_became_active":"2024-04-25T15:43:01.301404+0000","last_became_peered":"2024-04-25T15:43:01.301404+0000","last_unstale":"2024-04-25T15:43:07.362058+0000","last_undegraded":"2024-04-25T15:43:07.362058+0000","last_fullsized":"2024-04-25T15:43:07.362058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303866+0000","last_change":"2024-04-25T15:43:05.327540+0000","last_active":"2024-04-25T15:43:06.303866+0000","last_peered":"2024-04-25T15:43:06.303866+0000","last_clean":"2024-04-25T15:43:06.303866+0000","last_became_active":"2024-04-25T15:43:05.326737+0000","last_became_peered":"2024-04-25T15:43:05.326737+0000","last_unstale":"2024-04-25T15:43:06.303866+0000","last_undegraded":"2024-04-25T15:43:06.303866+0000","last_fullsized":"2024-04-25T15:43:06.303866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:01.657357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305054+0000","last_change":"2024-04-25T15:43:00.269417+0000","last_active":"2024-04-25T15:43:06.305054+0000","last_peered":"2024-04-25T15:43:06.305054+0000","last_clean":"2024-04-25T15:43:06.305054+0000","last_became_active":"2024-04-25T15:43:00.268747+0000","last_became_peered":"2024-04-25T15:43:00.268747+0000","last_unstale":"2024-04-25T15:43:06.305054+0000","last_undegraded":"2024-04-25T15:43:06.305054+0000","last_fullsized":"2024-04-25T15:43:06.305054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:49.833413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515416+0000","last_change":"2024-04-25T15:43:01.293581+0000","last_active":"2024-04-25T15:43:06.515416+0000","last_peered":"2024-04-25T15:43:06.515416+0000","last_clean":"2024-04-25T15:43:06.515416+0000","last_became_active":"2024-04-25T15:43:01.292501+0000","last_became_peered":"2024-04-25T15:43:01.292501+0000","last_unstale":"2024-04-25T15:43:06.515416+0000","last_undegraded":"2024-04-25T15:43:06.515416+0000","last_fullsized":"2024-04-25T15:43:06.515416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305418+0000","last_change":"2024-04-25T15:43:05.332634+0000","last_active":"2024-04-25T15:43:06.305418+0000","last_peered":"2024-04-25T15:43:06.305418+0000","last_clean":"2024-04-25T15:43:06.305418+0000","last_became_active":"2024-04-25T15:43:05.332110+0000","last_became_peered":"2024-04-25T15:43:05.332110+0000","last_unstale":"2024-04-25T15:43:06.305418+0000","last_undegraded":"2024-04-25T15:43:06.305418+0000","last_fullsized":"2024-04-25T15:43:06.305418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304639+0000","last_change":"2024-04-25T15:43:00.270429+0000","last_active":"2024-04-25T15:43:06.304639+0000","last_peered":"2024-04-25T15:43:06.304639+0000","last_clean":"2024-04-25T15:43:06.304639+0000","last_became_active":"2024-04-25T15:43:00.270080+0000","last_became_peered":"2024-04-25T15:43:00.270080+0000","last_unstale":"2024-04-25T15:43:06.304639+0000","last_undegraded":"2024-04-25T15:43:06.304639+0000","last_fullsized":"2024-04-25T15:43:06.304639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515514+0000","last_change":"2024-04-25T15:43:01.294967+0000","last_active":"2024-04-25T15:43:06.515514+0000","last_peered":"2024-04-25T15:43:06.515514+0000","last_clean":"2024-04-25T15:43:06.515514+0000","last_became_active":"2024-04-25T15:43:01.294673+0000","last_became_peered":"2024-04-25T15:43:01.294673+0000","last_unstale":"2024-04-25T15:43:06.515514+0000","last_undegraded":"2024-04-25T15:43:06.515514+0000","last_fullsized":"2024-04-25T15:43:06.515514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303942+0000","last_change":"2024-04-25T15:43:05.330892+0000","last_active":"2024-04-25T15:43:06.303942+0000","last_peered":"2024-04-25T15:43:06.303942+0000","last_clean":"2024-04-25T15:43:06.303942+0000","last_became_active":"2024-04-25T15:43:05.330435+0000","last_became_peered":"2024-04-25T15:43:05.330435+0000","last_unstale":"2024-04-25T15:43:06.303942+0000","last_undegraded":"2024-04-25T15:43:06.303942+0000","last_fullsized":"2024-04-25T15:43:06.303942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:31.934838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173076+0000","last_change":"2024-04-25T15:43:01.297084+0000","last_active":"2024-04-25T15:43:07.173076+0000","last_peered":"2024-04-25T15:43:07.173076+0000","last_clean":"2024-04-25T15:43:07.173076+0000","last_became_active":"2024-04-25T15:43:01.296689+0000","last_became_peered":"2024-04-25T15:43:01.296689+0000","last_unstale":"2024-04-25T15:43:07.173076+0000","last_undegraded":"2024-04-25T15:43:07.173076+0000","last_fullsized":"2024-04-25T15:43:07.173076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304863+0000","last_change":"2024-04-25T15:43:00.267473+0000","last_active":"2024-04-25T15:43:06.304863+0000","last_peered":"2024-04-25T15:43:06.304863+0000","last_clean":"2024-04-25T15:43:06.304863+0000","last_became_active":"2024-04-25T15:43:00.264809+0000","last_became_peered":"2024-04-25T15:43:00.264809+0000","last_unstale":"2024-04-25T15:43:06.304863+0000","last_undegraded":"2024-04-25T15:43:06.304863+0000","last_fullsized":"2024-04-25T15:43:06.304863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.324082+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.323656+0000","last_became_peered":"2024-04-25T15:43:05.323656+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361446+0000","last_change":"2024-04-25T15:43:01.284806+0000","last_active":"2024-04-25T15:43:07.361446+0000","last_peered":"2024-04-25T15:43:07.361446+0000","last_clean":"2024-04-25T15:43:07.361446+0000","last_became_active":"2024-04-25T15:43:01.283772+0000","last_became_peered":"2024-04-25T15:43:01.283772+0000","last_unstale":"2024-04-25T15:43:07.361446+0000","last_undegraded":"2024-04-25T15:43:07.361446+0000","last_fullsized":"2024-04-25T15:43:07.361446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361739+0000","last_change":"2024-04-25T15:43:00.271683+0000","last_active":"2024-04-25T15:43:07.361739+0000","last_peered":"2024-04-25T15:43:07.361739+0000","last_clean":"2024-04-25T15:43:07.361739+0000","last_became_active":"2024-04-25T15:43:00.271031+0000","last_became_peered":"2024-04-25T15:43:00.271031+0000","last_unstale":"2024-04-25T15:43:07.361739+0000","last_undegraded":"2024-04-25T15:43:07.361739+0000","last_fullsized":"2024-04-25T15:43:07.361739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304365+0000","last_change":"2024-04-25T15:43:05.326922+0000","last_active":"2024-04-25T15:43:06.304365+0000","last_peered":"2024-04-25T15:43:06.304365+0000","last_clean":"2024-04-25T15:43:06.304365+0000","last_became_active":"2024-04-25T15:43:05.325427+0000","last_became_peered":"2024-04-25T15:43:05.325427+0000","last_unstale":"2024-04-25T15:43:06.304365+0000","last_undegraded":"2024-04-25T15:43:06.304365+0000","last_fullsized":"2024-04-25T15:43:06.304365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:58.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360745+0000","last_change":"2024-04-25T15:43:01.278582+0000","last_active":"2024-04-25T15:43:07.360745+0000","last_peered":"2024-04-25T15:43:07.360745+0000","last_clean":"2024-04-25T15:43:07.360745+0000","last_became_active":"2024-04-25T15:43:01.278262+0000","last_became_peered":"2024-04-25T15:43:01.278262+0000","last_unstale":"2024-04-25T15:43:07.360745+0000","last_undegraded":"2024-04-25T15:43:07.360745+0000","last_fullsized":"2024-04-25T15:43:07.360745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360634+0000","last_change":"2024-04-25T15:43:00.259534+0000","last_active":"2024-04-25T15:43:07.360634+0000","last_peered":"2024-04-25T15:43:07.360634+0000","last_clean":"2024-04-25T15:43:07.360634+0000","last_became_active":"2024-04-25T15:43:00.259226+0000","last_became_peered":"2024-04-25T15:43:00.259226+0000","last_unstale":"2024-04-25T15:43:07.360634+0000","last_undegraded":"2024-04-25T15:43:07.360634+0000","last_fullsized":"2024-04-25T15:43:07.360634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361329+0000","last_change":"2024-04-25T15:43:05.337344+0000","last_active":"2024-04-25T15:43:07.361329+0000","last_peered":"2024-04-25T15:43:07.361329+0000","last_clean":"2024-04-25T15:43:07.361329+0000","last_became_active":"2024-04-25T15:43:05.336683+0000","last_became_peered":"2024-04-25T15:43:05.336683+0000","last_unstale":"2024-04-25T15:43:07.361329+0000","last_undegraded":"2024-04-25T15:43:07.361329+0000","last_fullsized":"2024-04-25T15:43:07.361329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305043+0000","last_change":"2024-04-25T15:43:01.294128+0000","last_active":"2024-04-25T15:43:06.305043+0000","last_peered":"2024-04-25T15:43:06.305043+0000","last_clean":"2024-04-25T15:43:06.305043+0000","last_became_active":"2024-04-25T15:43:01.293722+0000","last_became_peered":"2024-04-25T15:43:01.293722+0000","last_unstale":"2024-04-25T15:43:06.305043+0000","last_undegraded":"2024-04-25T15:43:06.305043+0000","last_fullsized":"2024-04-25T15:43:06.305043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303483+0000","last_change":"2024-04-25T15:43:00.264522+0000","last_active":"2024-04-25T15:43:06.303483+0000","last_peered":"2024-04-25T15:43:06.303483+0000","last_clean":"2024-04-25T15:43:06.303483+0000","last_became_active":"2024-04-25T15:43:00.264219+0000","last_became_peered":"2024-04-25T15:43:00.264219+0000","last_unstale":"2024-04-25T15:43:06.303483+0000","last_undegraded":"2024-04-25T15:43:06.303483+0000","last_fullsized":"2024-04-25T15:43:06.303483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304418+0000","last_change":"2024-04-25T15:43:05.326280+0000","last_active":"2024-04-25T15:43:06.304418+0000","last_peered":"2024-04-25T15:43:06.304418+0000","last_clean":"2024-04-25T15:43:06.304418+0000","last_became_active":"2024-04-25T15:43:05.325812+0000","last_became_peered":"2024-04-25T15:43:05.325812+0000","last_unstale":"2024-04-25T15:43:06.304418+0000","last_undegraded":"2024-04-25T15:43:06.304418+0000","last_fullsized":"2024-04-25T15:43:06.304418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:42.664135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360353+0000","last_change":"2024-04-25T15:43:01.284195+0000","last_active":"2024-04-25T15:43:07.360353+0000","last_peered":"2024-04-25T15:43:07.360353+0000","last_clean":"2024-04-25T15:43:07.360353+0000","last_became_active":"2024-04-25T15:43:01.283818+0000","last_became_peered":"2024-04-25T15:43:01.283818+0000","last_unstale":"2024-04-25T15:43:07.360353+0000","last_undegraded":"2024-04-25T15:43:07.360353+0000","last_fullsized":"2024-04-25T15:43:07.360353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:38.284567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173875+0000","last_change":"2024-04-25T15:43:00.271369+0000","last_active":"2024-04-25T15:43:07.173875+0000","last_peered":"2024-04-25T15:43:07.173875+0000","last_clean":"2024-04-25T15:43:07.173875+0000","last_became_active":"2024-04-25T15:43:00.270954+0000","last_became_peered":"2024-04-25T15:43:00.270954+0000","last_unstale":"2024-04-25T15:43:07.173875+0000","last_undegraded":"2024-04-25T15:43:07.173875+0000","last_fullsized":"2024-04-25T15:43:07.173875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304636+0000","last_change":"2024-04-25T15:43:05.318710+0000","last_active":"2024-04-25T15:43:06.304636+0000","last_peered":"2024-04-25T15:43:06.304636+0000","last_clean":"2024-04-25T15:43:06.304636+0000","last_became_active":"2024-04-25T15:43:05.318244+0000","last_became_peered":"2024-04-25T15:43:05.318244+0000","last_unstale":"2024-04-25T15:43:06.304636+0000","last_undegraded":"2024-04-25T15:43:06.304636+0000","last_fullsized":"2024-04-25T15:43:06.304636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:59.114149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361273+0000","last_change":"2024-04-25T15:43:01.277350+0000","last_active":"2024-04-25T15:43:07.361273+0000","last_peered":"2024-04-25T15:43:07.361273+0000","last_clean":"2024-04-25T15:43:07.361273+0000","last_became_active":"2024-04-25T15:43:01.277042+0000","last_became_peered":"2024-04-25T15:43:01.277042+0000","last_unstale":"2024-04-25T15:43:07.361273+0000","last_undegraded":"2024-04-25T15:43:07.361273+0000","last_fullsized":"2024-04-25T15:43:07.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361047+0000","last_change":"2024-04-25T15:43:00.270292+0000","last_active":"2024-04-25T15:43:07.361047+0000","last_peered":"2024-04-25T15:43:07.361047+0000","last_clean":"2024-04-25T15:43:07.361047+0000","last_became_active":"2024-04-25T15:43:00.269920+0000","last_became_peered":"2024-04-25T15:43:00.269920+0000","last_unstale":"2024-04-25T15:43:07.361047+0000","last_undegraded":"2024-04-25T15:43:07.361047+0000","last_fullsized":"2024-04-25T15:43:07.361047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360289+0000","last_change":"2024-04-25T15:43:05.327625+0000","last_active":"2024-04-25T15:43:07.360289+0000","last_peered":"2024-04-25T15:43:07.360289+0000","last_clean":"2024-04-25T15:43:07.360289+0000","last_became_active":"2024-04-25T15:43:05.327068+0000","last_became_peered":"2024-04-25T15:43:05.327068+0000","last_unstale":"2024-04-25T15:43:07.360289+0000","last_undegraded":"2024-04-25T15:43:07.360289+0000","last_fullsized":"2024-04-25T15:43:07.360289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:06.933725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361783+0000","last_change":"2024-04-25T15:43:01.289525+0000","last_active":"2024-04-25T15:43:07.361783+0000","last_peered":"2024-04-25T15:43:07.361783+0000","last_clean":"2024-04-25T15:43:07.361783+0000","last_became_active":"2024-04-25T15:43:01.288948+0000","last_became_peered":"2024-04-25T15:43:01.288948+0000","last_unstale":"2024-04-25T15:43:07.361783+0000","last_undegraded":"2024-04-25T15:43:07.361783+0000","last_fullsized":"2024-04-25T15:43:07.361783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305175+0000","last_change":"2024-04-25T15:43:00.270648+0000","last_active":"2024-04-25T15:43:06.305175+0000","last_peered":"2024-04-25T15:43:06.305175+0000","last_clean":"2024-04-25T15:43:06.305175+0000","last_became_active":"2024-04-25T15:43:00.269383+0000","last_became_peered":"2024-04-25T15:43:00.269383+0000","last_unstale":"2024-04-25T15:43:06.305175+0000","last_undegraded":"2024-04-25T15:43:06.305175+0000","last_fullsized":"2024-04-25T15:43:06.305175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:57.288718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360617+0000","last_change":"2024-04-25T15:43:05.324673+0000","last_active":"2024-04-25T15:43:07.360617+0000","last_peered":"2024-04-25T15:43:07.360617+0000","last_clean":"2024-04-25T15:43:07.360617+0000","last_became_active":"2024-04-25T15:43:05.323620+0000","last_became_peered":"2024-04-25T15:43:05.323620+0000","last_unstale":"2024-04-25T15:43:07.360617+0000","last_undegraded":"2024-04-25T15:43:07.360617+0000","last_fullsized":"2024-04-25T15:43:07.360617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515849+0000","last_change":"2024-04-25T15:43:01.303220+0000","last_active":"2024-04-25T15:43:06.515849+0000","last_peered":"2024-04-25T15:43:06.515849+0000","last_clean":"2024-04-25T15:43:06.515849+0000","last_became_active":"2024-04-25T15:43:01.302322+0000","last_became_peered":"2024-04-25T15:43:01.302322+0000","last_unstale":"2024-04-25T15:43:06.515849+0000","last_undegraded":"2024-04-25T15:43:06.515849+0000","last_fullsized":"2024-04-25T15:43:06.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361861+0000","last_change":"2024-04-25T15:43:00.266400+0000","last_active":"2024-04-25T15:43:07.361861+0000","last_peered":"2024-04-25T15:43:07.361861+0000","last_clean":"2024-04-25T15:43:07.361861+0000","last_became_active":"2024-04-25T15:43:00.265691+0000","last_became_peered":"2024-04-25T15:43:00.265691+0000","last_unstale":"2024-04-25T15:43:07.361861+0000","last_undegraded":"2024-04-25T15:43:07.361861+0000","last_fullsized":"2024-04-25T15:43:07.361861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361515+0000","last_change":"2024-04-25T15:43:05.333242+0000","last_active":"2024-04-25T15:43:07.361515+0000","last_peered":"2024-04-25T15:43:07.361515+0000","last_clean":"2024-04-25T15:43:07.361515+0000","last_became_active":"2024-04-25T15:43:05.332499+0000","last_became_peered":"2024-04-25T15:43:05.332499+0000","last_unstale":"2024-04-25T15:43:07.361515+0000","last_undegraded":"2024-04-25T15:43:07.361515+0000","last_fullsized":"2024-04-25T15:43:07.361515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305390+0000","last_change":"2024-04-25T15:43:01.303850+0000","last_active":"2024-04-25T15:43:06.305390+0000","last_peered":"2024-04-25T15:43:06.305390+0000","last_clean":"2024-04-25T15:43:06.305390+0000","last_became_active":"2024-04-25T15:43:01.303351+0000","last_became_peered":"2024-04-25T15:43:01.303351+0000","last_unstale":"2024-04-25T15:43:06.305390+0000","last_undegraded":"2024-04-25T15:43:06.305390+0000","last_fullsized":"2024-04-25T15:43:06.305390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:55.857252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515505+0000","last_change":"2024-04-25T15:43:00.265989+0000","last_active":"2024-04-25T15:43:06.515505+0000","last_peered":"2024-04-25T15:43:06.515505+0000","last_clean":"2024-04-25T15:43:06.515505+0000","last_became_active":"2024-04-25T15:43:00.265654+0000","last_became_peered":"2024-04-25T15:43:00.265654+0000","last_unstale":"2024-04-25T15:43:06.515505+0000","last_undegraded":"2024-04-25T15:43:06.515505+0000","last_fullsized":"2024-04-25T15:43:06.515505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361721+0000","last_change":"2024-04-25T15:43:05.335093+0000","last_active":"2024-04-25T15:43:07.361721+0000","last_peered":"2024-04-25T15:43:07.361721+0000","last_clean":"2024-04-25T15:43:07.361721+0000","last_became_active":"2024-04-25T15:43:05.334657+0000","last_became_peered":"2024-04-25T15:43:05.334657+0000","last_unstale":"2024-04-25T15:43:07.361721+0000","last_undegraded":"2024-04-25T15:43:07.361721+0000","last_fullsized":"2024-04-25T15:43:07.361721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:08.225975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361261+0000","last_change":"2024-04-25T15:43:01.290703+0000","last_active":"2024-04-25T15:43:07.361261+0000","last_peered":"2024-04-25T15:43:07.361261+0000","last_clean":"2024-04-25T15:43:07.361261+0000","last_became_active":"2024-04-25T15:43:01.290172+0000","last_became_peered":"2024-04-25T15:43:01.290172+0000","last_unstale":"2024-04-25T15:43:07.361261+0000","last_undegraded":"2024-04-25T15:43:07.361261+0000","last_fullsized":"2024-04-25T15:43:07.361261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304850+0000","last_change":"2024-04-25T15:43:00.266600+0000","last_active":"2024-04-25T15:43:06.304850+0000","last_peered":"2024-04-25T15:43:06.304850+0000","last_clean":"2024-04-25T15:43:06.304850+0000","last_became_active":"2024-04-25T15:43:00.266272+0000","last_became_peered":"2024-04-25T15:43:00.266272+0000","last_unstale":"2024-04-25T15:43:06.304850+0000","last_undegraded":"2024-04-25T15:43:06.304850+0000","last_fullsized":"2024-04-25T15:43:06.304850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361502+0000","last_change":"2024-04-25T15:43:05.335202+0000","last_active":"2024-04-25T15:43:07.361502+0000","last_peered":"2024-04-25T15:43:07.361502+0000","last_clean":"2024-04-25T15:43:07.361502+0000","last_became_active":"2024-04-25T15:43:05.334737+0000","last_became_peered":"2024-04-25T15:43:05.334737+0000","last_unstale":"2024-04-25T15:43:07.361502+0000","last_undegraded":"2024-04-25T15:43:07.361502+0000","last_fullsized":"2024-04-25T15:43:07.361502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361707+0000","last_change":"2024-04-25T15:43:01.299152+0000","last_active":"2024-04-25T15:43:07.361707+0000","last_peered":"2024-04-25T15:43:07.361707+0000","last_clean":"2024-04-25T15:43:07.361707+0000","last_became_active":"2024-04-25T15:43:01.298809+0000","last_became_peered":"2024-04-25T15:43:01.298809+0000","last_unstale":"2024-04-25T15:43:07.361707+0000","last_undegraded":"2024-04-25T15:43:07.361707+0000","last_fullsized":"2024-04-25T15:43:07.361707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:50.837855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303629+0000","last_change":"2024-04-25T15:43:00.263841+0000","last_active":"2024-04-25T15:43:06.303629+0000","last_peered":"2024-04-25T15:43:06.303629+0000","last_clean":"2024-04-25T15:43:06.303629+0000","last_became_active":"2024-04-25T15:43:00.259513+0000","last_became_peered":"2024-04-25T15:43:00.259513+0000","last_unstale":"2024-04-25T15:43:06.303629+0000","last_undegraded":"2024-04-25T15:43:06.303629+0000","last_fullsized":"2024-04-25T15:43:06.303629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360219+0000","last_change":"2024-04-25T15:43:05.326603+0000","last_active":"2024-04-25T15:43:07.360219+0000","last_peered":"2024-04-25T15:43:07.360219+0000","last_clean":"2024-04-25T15:43:07.360219+0000","last_became_active":"2024-04-25T15:43:05.326181+0000","last_became_peered":"2024-04-25T15:43:05.326181+0000","last_unstale":"2024-04-25T15:43:07.360219+0000","last_undegraded":"2024-04-25T15:43:07.360219+0000","last_fullsized":"2024-04-25T15:43:07.360219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359858+0000","last_change":"2024-04-25T15:43:01.288148+0000","last_active":"2024-04-25T15:43:07.359858+0000","last_peered":"2024-04-25T15:43:07.359858+0000","last_clean":"2024-04-25T15:43:07.359858+0000","last_became_active":"2024-04-25T15:43:01.287837+0000","last_became_peered":"2024-04-25T15:43:01.287837+0000","last_unstale":"2024-04-25T15:43:07.359858+0000","last_undegraded":"2024-04-25T15:43:07.359858+0000","last_fullsized":"2024-04-25T15:43:07.359858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515397+0000","last_change":"2024-04-25T15:43:00.263967+0000","last_active":"2024-04-25T15:43:06.515397+0000","last_peered":"2024-04-25T15:43:06.515397+0000","last_clean":"2024-04-25T15:43:06.515397+0000","last_became_active":"2024-04-25T15:43:00.263603+0000","last_became_peered":"2024-04-25T15:43:00.263603+0000","last_unstale":"2024-04-25T15:43:06.515397+0000","last_undegraded":"2024-04-25T15:43:06.515397+0000","last_fullsized":"2024-04-25T15:43:06.515397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303747+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:43:06.303747+0000","last_peered":"2024-04-25T15:43:06.303747+0000","last_clean":"2024-04-25T15:43:06.303747+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:43:06.303747+0000","last_undegraded":"2024-04-25T15:43:06.303747+0000","last_fullsized":"2024-04-25T15:43:06.303747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173554+0000","last_change":"2024-04-25T15:43:05.325980+0000","last_active":"2024-04-25T15:43:07.173554+0000","last_peered":"2024-04-25T15:43:07.173554+0000","last_clean":"2024-04-25T15:43:07.173554+0000","last_became_active":"2024-04-25T15:43:05.325470+0000","last_became_peered":"2024-04-25T15:43:05.325470+0000","last_unstale":"2024-04-25T15:43:07.173554+0000","last_undegraded":"2024-04-25T15:43:07.173554+0000","last_fullsized":"2024-04-25T15:43:07.173554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304947+0000","last_change":"2024-04-25T15:43:01.291577+0000","last_active":"2024-04-25T15:43:06.304947+0000","last_peered":"2024-04-25T15:43:06.304947+0000","last_clean":"2024-04-25T15:43:06.304947+0000","last_became_active":"2024-04-25T15:43:01.290296+0000","last_became_peered":"2024-04-25T15:43:01.290296+0000","last_unstale":"2024-04-25T15:43:06.304947+0000","last_undegraded":"2024-04-25T15:43:06.304947+0000","last_fullsized":"2024-04-25T15:43:06.304947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:04.182446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305178+0000","last_change":"2024-04-25T15:43:00.263762+0000","last_active":"2024-04-25T15:43:06.305178+0000","last_peered":"2024-04-25T15:43:06.305178+0000","last_clean":"2024-04-25T15:43:06.305178+0000","last_became_active":"2024-04-25T15:43:00.263444+0000","last_became_peered":"2024-04-25T15:43:00.263444+0000","last_unstale":"2024-04-25T15:43:06.305178+0000","last_undegraded":"2024-04-25T15:43:06.305178+0000","last_fullsized":"2024-04-25T15:43:06.305178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173159+0000","last_change":"2024-04-25T15:43:05.322505+0000","last_active":"2024-04-25T15:43:07.173159+0000","last_peered":"2024-04-25T15:43:07.173159+0000","last_clean":"2024-04-25T15:43:07.173159+0000","last_became_active":"2024-04-25T15:43:05.321587+0000","last_became_peered":"2024-04-25T15:43:05.321587+0000","last_unstale":"2024-04-25T15:43:07.173159+0000","last_undegraded":"2024-04-25T15:43:07.173159+0000","last_fullsized":"2024-04-25T15:43:07.173159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515673+0000","last_change":"2024-04-25T15:43:01.300693+0000","last_active":"2024-04-25T15:43:06.515673+0000","last_peered":"2024-04-25T15:43:06.515673+0000","last_clean":"2024-04-25T15:43:06.515673+0000","last_became_active":"2024-04-25T15:43:01.300378+0000","last_became_peered":"2024-04-25T15:43:01.300378+0000","last_unstale":"2024-04-25T15:43:06.515673+0000","last_undegraded":"2024-04-25T15:43:06.515673+0000","last_fullsized":"2024-04-25T15:43:06.515673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360192+0000","last_change":"2024-04-25T15:43:00.267797+0000","last_active":"2024-04-25T15:43:07.360192+0000","last_peered":"2024-04-25T15:43:07.360192+0000","last_clean":"2024-04-25T15:43:07.360192+0000","last_became_active":"2024-04-25T15:43:00.267467+0000","last_became_peered":"2024-04-25T15:43:00.267467+0000","last_unstale":"2024-04-25T15:43:07.360192+0000","last_undegraded":"2024-04-25T15:43:07.360192+0000","last_fullsized":"2024-04-25T15:43:07.360192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360732+0000","last_change":"2024-04-25T15:43:05.325019+0000","last_active":"2024-04-25T15:43:07.360732+0000","last_peered":"2024-04-25T15:43:07.360732+0000","last_clean":"2024-04-25T15:43:07.360732+0000","last_became_active":"2024-04-25T15:43:05.324242+0000","last_became_peered":"2024-04-25T15:43:05.324242+0000","last_unstale":"2024-04-25T15:43:07.360732+0000","last_undegraded":"2024-04-25T15:43:07.360732+0000","last_fullsized":"2024-04-25T15:43:07.360732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305633+0000","last_change":"2024-04-25T15:43:01.295638+0000","last_active":"2024-04-25T15:43:06.305633+0000","last_peered":"2024-04-25T15:43:06.305633+0000","last_clean":"2024-04-25T15:43:06.305633+0000","last_became_active":"2024-04-25T15:43:01.295339+0000","last_became_peered":"2024-04-25T15:43:01.295339+0000","last_unstale":"2024-04-25T15:43:06.305633+0000","last_undegraded":"2024-04-25T15:43:06.305633+0000","last_fullsized":"2024-04-25T15:43:06.305633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:19.579163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305341+0000","last_change":"2024-04-25T15:43:00.267600+0000","last_active":"2024-04-25T15:43:06.305341+0000","last_peered":"2024-04-25T15:43:06.305341+0000","last_clean":"2024-04-25T15:43:06.305341+0000","last_became_active":"2024-04-25T15:43:00.267267+0000","last_became_peered":"2024-04-25T15:43:00.267267+0000","last_unstale":"2024-04-25T15:43:06.305341+0000","last_undegraded":"2024-04-25T15:43:06.305341+0000","last_fullsized":"2024-04-25T15:43:06.305341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515040+0000","last_change":"2024-04-25T15:43:05.320492+0000","last_active":"2024-04-25T15:43:06.515040+0000","last_peered":"2024-04-25T15:43:06.515040+0000","last_clean":"2024-04-25T15:43:06.515040+0000","last_became_active":"2024-04-25T15:43:05.319988+0000","last_became_peered":"2024-04-25T15:43:05.319988+0000","last_unstale":"2024-04-25T15:43:06.515040+0000","last_undegraded":"2024-04-25T15:43:06.515040+0000","last_fullsized":"2024-04-25T15:43:06.515040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:23.622692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305282+0000","last_change":"2024-04-25T15:43:01.298673+0000","last_active":"2024-04-25T15:43:06.305282+0000","last_peered":"2024-04-25T15:43:06.305282+0000","last_clean":"2024-04-25T15:43:06.305282+0000","last_became_active":"2024-04-25T15:43:01.296072+0000","last_became_peered":"2024-04-25T15:43:01.296072+0000","last_unstale":"2024-04-25T15:43:06.305282+0000","last_undegraded":"2024-04-25T15:43:06.305282+0000","last_fullsized":"2024-04-25T15:43:06.305282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304317+0000","last_change":"2024-04-25T15:43:00.265700+0000","last_active":"2024-04-25T15:43:06.304317+0000","last_peered":"2024-04-25T15:43:06.304317+0000","last_clean":"2024-04-25T15:43:06.304317+0000","last_became_active":"2024-04-25T15:43:00.265341+0000","last_became_peered":"2024-04-25T15:43:00.265341+0000","last_unstale":"2024-04-25T15:43:06.304317+0000","last_undegraded":"2024-04-25T15:43:06.304317+0000","last_fullsized":"2024-04-25T15:43:06.304317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304762+0000","last_change":"2024-04-25T15:43:05.325994+0000","last_active":"2024-04-25T15:43:06.304762+0000","last_peered":"2024-04-25T15:43:06.304762+0000","last_clean":"2024-04-25T15:43:06.304762+0000","last_became_active":"2024-04-25T15:43:05.325552+0000","last_became_peered":"2024-04-25T15:43:05.325552+0000","last_unstale":"2024-04-25T15:43:06.304762+0000","last_undegraded":"2024-04-25T15:43:06.304762+0000","last_fullsized":"2024-04-25T15:43:06.304762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:17.249622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303941+0000","last_change":"2024-04-25T15:43:01.297032+0000","last_active":"2024-04-25T15:43:06.303941+0000","last_peered":"2024-04-25T15:43:06.303941+0000","last_clean":"2024-04-25T15:43:06.303941+0000","last_became_active":"2024-04-25T15:43:01.296701+0000","last_became_peered":"2024-04-25T15:43:01.296701+0000","last_unstale":"2024-04-25T15:43:06.303941+0000","last_undegraded":"2024-04-25T15:43:06.303941+0000","last_fullsized":"2024-04-25T15:43:06.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304781+0000","last_change":"2024-04-25T15:43:00.265707+0000","last_active":"2024-04-25T15:43:06.304781+0000","last_peered":"2024-04-25T15:43:06.304781+0000","last_clean":"2024-04-25T15:43:06.304781+0000","last_became_active":"2024-04-25T15:43:00.265407+0000","last_became_peered":"2024-04-25T15:43:00.265407+0000","last_unstale":"2024-04-25T15:43:06.304781+0000","last_undegraded":"2024-04-25T15:43:06.304781+0000","last_fullsized":"2024-04-25T15:43:06.304781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360050+0000","last_change":"2024-04-25T15:43:05.320474+0000","last_active":"2024-04-25T15:43:07.360050+0000","last_peered":"2024-04-25T15:43:07.360050+0000","last_clean":"2024-04-25T15:43:07.360050+0000","last_became_active":"2024-04-25T15:43:05.320017+0000","last_became_peered":"2024-04-25T15:43:05.320017+0000","last_unstale":"2024-04-25T15:43:07.360050+0000","last_undegraded":"2024-04-25T15:43:07.360050+0000","last_fullsized":"2024-04-25T15:43:07.360050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173085+0000","last_change":"2024-04-25T15:43:01.294565+0000","last_active":"2024-04-25T15:43:07.173085+0000","last_peered":"2024-04-25T15:43:07.173085+0000","last_clean":"2024-04-25T15:43:07.173085+0000","last_became_active":"2024-04-25T15:43:01.294244+0000","last_became_peered":"2024-04-25T15:43:01.294244+0000","last_unstale":"2024-04-25T15:43:07.173085+0000","last_undegraded":"2024-04-25T15:43:07.173085+0000","last_fullsized":"2024-04-25T15:43:07.173085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173164+0000","last_change":"2024-04-25T15:43:00.266625+0000","last_active":"2024-04-25T15:43:07.173164+0000","last_peered":"2024-04-25T15:43:07.173164+0000","last_clean":"2024-04-25T15:43:07.173164+0000","last_became_active":"2024-04-25T15:43:00.266059+0000","last_became_peered":"2024-04-25T15:43:00.266059+0000","last_unstale":"2024-04-25T15:43:07.173164+0000","last_undegraded":"2024-04-25T15:43:07.173164+0000","last_fullsized":"2024-04-25T15:43:07.173164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361118+0000","last_change":"2024-04-25T15:43:05.327896+0000","last_active":"2024-04-25T15:43:07.361118+0000","last_peered":"2024-04-25T15:43:07.361118+0000","last_clean":"2024-04-25T15:43:07.361118+0000","last_became_active":"2024-04-25T15:43:05.327450+0000","last_became_peered":"2024-04-25T15:43:05.327450+0000","last_unstale":"2024-04-25T15:43:07.361118+0000","last_undegraded":"2024-04-25T15:43:07.361118+0000","last_fullsized":"2024-04-25T15:43:07.361118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:05.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304793+0000","last_change":"2024-04-25T15:43:01.298299+0000","last_active":"2024-04-25T15:43:06.304793+0000","last_peered":"2024-04-25T15:43:06.304793+0000","last_clean":"2024-04-25T15:43:06.304793+0000","last_became_active":"2024-04-25T15:43:01.295916+0000","last_became_peered":"2024-04-25T15:43:01.295916+0000","last_unstale":"2024-04-25T15:43:06.304793+0000","last_undegraded":"2024-04-25T15:43:06.304793+0000","last_fullsized":"2024-04-25T15:43:06.304793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515439+0000","last_change":"2024-04-25T15:43:00.271764+0000","last_active":"2024-04-25T15:43:06.515439+0000","last_peered":"2024-04-25T15:43:06.515439+0000","last_clean":"2024-04-25T15:43:06.515439+0000","last_became_active":"2024-04-25T15:43:00.271471+0000","last_became_peered":"2024-04-25T15:43:00.271471+0000","last_unstale":"2024-04-25T15:43:06.515439+0000","last_undegraded":"2024-04-25T15:43:06.515439+0000","last_fullsized":"2024-04-25T15:43:06.515439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362023+0000","last_change":"2024-04-25T15:43:05.324240+0000","last_active":"2024-04-25T15:43:07.362023+0000","last_peered":"2024-04-25T15:43:07.362023+0000","last_clean":"2024-04-25T15:43:07.362023+0000","last_became_active":"2024-04-25T15:43:05.323806+0000","last_became_peered":"2024-04-25T15:43:05.323806+0000","last_unstale":"2024-04-25T15:43:07.362023+0000","last_undegraded":"2024-04-25T15:43:07.362023+0000","last_fullsized":"2024-04-25T15:43:07.362023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:04.722313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360889+0000","last_change":"2024-04-25T15:43:01.294356+0000","last_active":"2024-04-25T15:43:07.360889+0000","last_peered":"2024-04-25T15:43:07.360889+0000","last_clean":"2024-04-25T15:43:07.360889+0000","last_became_active":"2024-04-25T15:43:01.294033+0000","last_became_peered":"2024-04-25T15:43:01.294033+0000","last_unstale":"2024-04-25T15:43:07.360889+0000","last_undegraded":"2024-04-25T15:43:07.360889+0000","last_fullsized":"2024-04-25T15:43:07.360889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360783+0000","last_change":"2024-04-25T15:43:00.261060+0000","last_active":"2024-04-25T15:43:07.360783+0000","last_peered":"2024-04-25T15:43:07.360783+0000","last_clean":"2024-04-25T15:43:07.360783+0000","last_became_active":"2024-04-25T15:43:00.258388+0000","last_became_peered":"2024-04-25T15:43:00.258388+0000","last_unstale":"2024-04-25T15:43:07.360783+0000","last_undegraded":"2024-04-25T15:43:07.360783+0000","last_fullsized":"2024-04-25T15:43:07.360783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515749+0000","last_change":"2024-04-25T15:43:05.325879+0000","last_active":"2024-04-25T15:43:06.515749+0000","last_peered":"2024-04-25T15:43:06.515749+0000","last_clean":"2024-04-25T15:43:06.515749+0000","last_became_active":"2024-04-25T15:43:05.325457+0000","last_became_peered":"2024-04-25T15:43:05.325457+0000","last_unstale":"2024-04-25T15:43:06.515749+0000","last_undegraded":"2024-04-25T15:43:06.515749+0000","last_fullsized":"2024-04-25T15:43:06.515749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304575+0000","last_change":"2024-04-25T15:43:01.281220+0000","last_active":"2024-04-25T15:43:06.304575+0000","last_peered":"2024-04-25T15:43:06.304575+0000","last_clean":"2024-04-25T15:43:06.304575+0000","last_became_active":"2024-04-25T15:43:01.280690+0000","last_became_peered":"2024-04-25T15:43:01.280690+0000","last_unstale":"2024-04-25T15:43:06.304575+0000","last_undegraded":"2024-04-25T15:43:06.304575+0000","last_fullsized":"2024-04-25T15:43:06.304575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:10.678852+0000","last_change":"2024-04-25T15:43:00.275195+0000","last_active":"2024-04-25T15:43:10.678852+0000","last_peered":"2024-04-25T15:43:10.678852+0000","last_clean":"2024-04-25T15:43:10.678852+0000","last_became_active":"2024-04-25T15:43:00.274890+0000","last_became_peered":"2024-04-25T15:43:00.274890+0000","last_unstale":"2024-04-25T15:43:10.678852+0000","last_undegraded":"2024-04-25T15:43:10.678852+0000","last_fullsized":"2024-04-25T15:43:10.678852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361677+0000","last_change":"2024-04-25T15:43:05.332218+0000","last_active":"2024-04-25T15:43:07.361677+0000","last_peered":"2024-04-25T15:43:07.361677+0000","last_clean":"2024-04-25T15:43:07.361677+0000","last_became_active":"2024-04-25T15:43:05.331327+0000","last_became_peered":"2024-04-25T15:43:05.331327+0000","last_unstale":"2024-04-25T15:43:07.361677+0000","last_undegraded":"2024-04-25T15:43:07.361677+0000","last_fullsized":"2024-04-25T15:43:07.361677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304852+0000","last_change":"2024-04-25T15:43:01.301873+0000","last_active":"2024-04-25T15:43:06.304852+0000","last_peered":"2024-04-25T15:43:06.304852+0000","last_clean":"2024-04-25T15:43:06.304852+0000","last_became_active":"2024-04-25T15:43:01.301515+0000","last_became_peered":"2024-04-25T15:43:01.301515+0000","last_unstale":"2024-04-25T15:43:06.304852+0000","last_undegraded":"2024-04-25T15:43:06.304852+0000","last_fullsized":"2024-04-25T15:43:06.304852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:56.239547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360072+0000","last_change":"2024-04-25T15:43:00.263472+0000","last_active":"2024-04-25T15:43:07.360072+0000","last_peered":"2024-04-25T15:43:07.360072+0000","last_clean":"2024-04-25T15:43:07.360072+0000","last_became_active":"2024-04-25T15:43:00.263063+0000","last_became_peered":"2024-04-25T15:43:00.263063+0000","last_unstale":"2024-04-25T15:43:07.360072+0000","last_undegraded":"2024-04-25T15:43:07.360072+0000","last_fullsized":"2024-04-25T15:43:07.360072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305069+0000","last_change":"2024-04-25T15:43:05.335662+0000","last_active":"2024-04-25T15:43:06.305069+0000","last_peered":"2024-04-25T15:43:06.305069+0000","last_clean":"2024-04-25T15:43:06.305069+0000","last_became_active":"2024-04-25T15:43:05.334883+0000","last_became_peered":"2024-04-25T15:43:05.334883+0000","last_unstale":"2024-04-25T15:43:06.305069+0000","last_undegraded":"2024-04-25T15:43:06.305069+0000","last_fullsized":"2024-04-25T15:43:06.305069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362170+0000","last_change":"2024-04-25T15:43:01.301400+0000","last_active":"2024-04-25T15:43:07.362170+0000","last_peered":"2024-04-25T15:43:07.362170+0000","last_clean":"2024-04-25T15:43:07.362170+0000","last_became_active":"2024-04-25T15:43:01.301067+0000","last_became_peered":"2024-04-25T15:43:01.301067+0000","last_unstale":"2024-04-25T15:43:07.362170+0000","last_undegraded":"2024-04-25T15:43:07.362170+0000","last_fullsized":"2024-04-25T15:43:07.362170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515580+0000","last_change":"2024-04-25T15:43:00.267119+0000","last_active":"2024-04-25T15:43:06.515580+0000","last_peered":"2024-04-25T15:43:06.515580+0000","last_clean":"2024-04-25T15:43:06.515580+0000","last_became_active":"2024-04-25T15:43:00.266760+0000","last_became_peered":"2024-04-25T15:43:00.266760+0000","last_unstale":"2024-04-25T15:43:06.515580+0000","last_undegraded":"2024-04-25T15:43:06.515580+0000","last_fullsized":"2024-04-25T15:43:06.515580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360595+0000","last_change":"2024-04-25T15:43:05.329155+0000","last_active":"2024-04-25T15:43:07.360595+0000","last_peered":"2024-04-25T15:43:07.360595+0000","last_clean":"2024-04-25T15:43:07.360595+0000","last_became_active":"2024-04-25T15:43:05.328650+0000","last_became_peered":"2024-04-25T15:43:05.328650+0000","last_unstale":"2024-04-25T15:43:07.360595+0000","last_undegraded":"2024-04-25T15:43:07.360595+0000","last_fullsized":"2024-04-25T15:43:07.360595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:14.129232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515527+0000","last_change":"2024-04-25T15:43:01.297332+0000","last_active":"2024-04-25T15:43:06.515527+0000","last_peered":"2024-04-25T15:43:06.515527+0000","last_clean":"2024-04-25T15:43:06.515527+0000","last_became_active":"2024-04-25T15:43:01.296726+0000","last_became_peered":"2024-04-25T15:43:01.296726+0000","last_unstale":"2024-04-25T15:43:06.515527+0000","last_undegraded":"2024-04-25T15:43:06.515527+0000","last_fullsized":"2024-04-25T15:43:06.515527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173728+0000","last_change":"2024-04-25T15:43:00.266633+0000","last_active":"2024-04-25T15:43:07.173728+0000","last_peered":"2024-04-25T15:43:07.173728+0000","last_clean":"2024-04-25T15:43:07.173728+0000","last_became_active":"2024-04-25T15:43:00.266221+0000","last_became_peered":"2024-04-25T15:43:00.266221+0000","last_unstale":"2024-04-25T15:43:07.173728+0000","last_undegraded":"2024-04-25T15:43:07.173728+0000","last_fullsized":"2024-04-25T15:43:07.173728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360149+0000","last_change":"2024-04-25T15:43:05.326763+0000","last_active":"2024-04-25T15:43:07.360149+0000","last_peered":"2024-04-25T15:43:07.360149+0000","last_clean":"2024-04-25T15:43:07.360149+0000","last_became_active":"2024-04-25T15:43:05.326387+0000","last_became_peered":"2024-04-25T15:43:05.326387+0000","last_unstale":"2024-04-25T15:43:07.360149+0000","last_undegraded":"2024-04-25T15:43:07.360149+0000","last_fullsized":"2024-04-25T15:43:07.360149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:43.920077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359880+0000","last_change":"2024-04-25T15:43:05.325423+0000","last_active":"2024-04-25T15:43:07.359880+0000","last_peered":"2024-04-25T15:43:07.359880+0000","last_clean":"2024-04-25T15:43:07.359880+0000","last_became_active":"2024-04-25T15:43:05.324948+0000","last_became_peered":"2024-04-25T15:43:05.324948+0000","last_unstale":"2024-04-25T15:43:07.359880+0000","last_undegraded":"2024-04-25T15:43:07.359880+0000","last_fullsized":"2024-04-25T15:43:07.359880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360431+0000","last_change":"2024-04-25T15:43:01.279748+0000","last_active":"2024-04-25T15:43:07.360431+0000","last_peered":"2024-04-25T15:43:07.360431+0000","last_clean":"2024-04-25T15:43:07.360431+0000","last_became_active":"2024-04-25T15:43:01.278850+0000","last_became_peered":"2024-04-25T15:43:01.278850+0000","last_unstale":"2024-04-25T15:43:07.360431+0000","last_undegraded":"2024-04-25T15:43:07.360431+0000","last_fullsized":"2024-04-25T15:43:07.360431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515195+0000","last_change":"2024-04-25T15:43:00.264122+0000","last_active":"2024-04-25T15:43:06.515195+0000","last_peered":"2024-04-25T15:43:06.515195+0000","last_clean":"2024-04-25T15:43:06.515195+0000","last_became_active":"2024-04-25T15:43:00.263813+0000","last_became_peered":"2024-04-25T15:43:00.263813+0000","last_unstale":"2024-04-25T15:43:06.515195+0000","last_undegraded":"2024-04-25T15:43:06.515195+0000","last_fullsized":"2024-04-25T15:43:06.515195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173731+0000","last_change":"2024-04-25T15:43:05.322215+0000","last_active":"2024-04-25T15:43:07.173731+0000","last_peered":"2024-04-25T15:43:07.173731+0000","last_clean":"2024-04-25T15:43:07.173731+0000","last_became_active":"2024-04-25T15:43:05.321735+0000","last_became_peered":"2024-04-25T15:43:05.321735+0000","last_unstale":"2024-04-25T15:43:07.173731+0000","last_undegraded":"2024-04-25T15:43:07.173731+0000","last_fullsized":"2024-04-25T15:43:07.173731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360649+0000","last_change":"2024-04-25T15:43:01.282374+0000","last_active":"2024-04-25T15:43:07.360649+0000","last_peered":"2024-04-25T15:43:07.360649+0000","last_clean":"2024-04-25T15:43:07.360649+0000","last_became_active":"2024-04-25T15:43:01.282048+0000","last_became_peered":"2024-04-25T15:43:01.282048+0000","last_unstale":"2024-04-25T15:43:07.360649+0000","last_undegraded":"2024-04-25T15:43:07.360649+0000","last_fullsized":"2024-04-25T15:43:07.360649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360467+0000","last_change":"2024-04-25T15:43:00.272805+0000","last_active":"2024-04-25T15:43:07.360467+0000","last_peered":"2024-04-25T15:43:07.360467+0000","last_clean":"2024-04-25T15:43:07.360467+0000","last_became_active":"2024-04-25T15:43:00.272566+0000","last_became_peered":"2024-04-25T15:43:00.272566+0000","last_unstale":"2024-04-25T15:43:07.360467+0000","last_undegraded":"2024-04-25T15:43:07.360467+0000","last_fullsized":"2024-04-25T15:43:07.360467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:29.718089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173285+0000","last_change":"2024-04-25T15:43:00.267609+0000","last_active":"2024-04-25T15:43:07.173285+0000","last_peered":"2024-04-25T15:43:07.173285+0000","last_clean":"2024-04-25T15:43:07.173285+0000","last_became_active":"2024-04-25T15:43:00.266867+0000","last_became_peered":"2024-04-25T15:43:00.266867+0000","last_unstale":"2024-04-25T15:43:07.173285+0000","last_undegraded":"2024-04-25T15:43:07.173285+0000","last_fullsized":"2024-04-25T15:43:07.173285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360778+0000","last_change":"2024-04-25T15:43:01.294246+0000","last_active":"2024-04-25T15:43:07.360778+0000","last_peered":"2024-04-25T15:43:07.360778+0000","last_clean":"2024-04-25T15:43:07.360778+0000","last_became_active":"2024-04-25T15:43:01.293930+0000","last_became_peered":"2024-04-25T15:43:01.293930+0000","last_unstale":"2024-04-25T15:43:07.360778+0000","last_undegraded":"2024-04-25T15:43:07.360778+0000","last_fullsized":"2024-04-25T15:43:07.360778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.321856+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.321309+0000","last_became_peered":"2024-04-25T15:43:05.321309+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:05.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361555+0000","last_change":"2024-04-25T15:43:00.273709+0000","last_active":"2024-04-25T15:43:07.361555+0000","last_peered":"2024-04-25T15:43:07.361555+0000","last_clean":"2024-04-25T15:43:07.361555+0000","last_became_active":"2024-04-25T15:43:00.273411+0000","last_became_peered":"2024-04-25T15:43:00.273411+0000","last_unstale":"2024-04-25T15:43:07.361555+0000","last_undegraded":"2024-04-25T15:43:07.361555+0000","last_fullsized":"2024-04-25T15:43:07.361555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.512229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304319+0000","last_change":"2024-04-25T15:43:01.290938+0000","last_active":"2024-04-25T15:43:06.304319+0000","last_peered":"2024-04-25T15:43:06.304319+0000","last_clean":"2024-04-25T15:43:06.304319+0000","last_became_active":"2024-04-25T15:43:01.290644+0000","last_became_peered":"2024-04-25T15:43:01.290644+0000","last_unstale":"2024-04-25T15:43:06.304319+0000","last_undegraded":"2024-04-25T15:43:06.304319+0000","last_fullsized":"2024-04-25T15:43:06.304319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:51.310158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360648+0000","last_change":"2024-04-25T15:43:05.325374+0000","last_active":"2024-04-25T15:43:07.360648+0000","last_peered":"2024-04-25T15:43:07.360648+0000","last_clean":"2024-04-25T15:43:07.360648+0000","last_became_active":"2024-04-25T15:43:05.324880+0000","last_became_peered":"2024-04-25T15:43:05.324880+0000","last_unstale":"2024-04-25T15:43:07.360648+0000","last_undegraded":"2024-04-25T15:43:07.360648+0000","last_fullsized":"2024-04-25T15:43:07.360648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:44.634102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.172990+0000","last_change":"2024-04-25T15:43:01.294802+0000","last_active":"2024-04-25T15:43:07.172990+0000","last_peered":"2024-04-25T15:43:07.172990+0000","last_clean":"2024-04-25T15:43:07.172990+0000","last_became_active":"2024-04-25T15:43:01.293680+0000","last_became_peered":"2024-04-25T15:43:01.293680+0000","last_unstale":"2024-04-25T15:43:07.172990+0000","last_undegraded":"2024-04-25T15:43:07.172990+0000","last_fullsized":"2024-04-25T15:43:07.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304824+0000","last_change":"2024-04-25T15:43:01.287546+0000","last_active":"2024-04-25T15:43:06.304824+0000","last_peered":"2024-04-25T15:43:06.304824+0000","last_clean":"2024-04-25T15:43:06.304824+0000","last_became_active":"2024-04-25T15:43:01.287193+0000","last_became_peered":"2024-04-25T15:43:01.287193+0000","last_unstale":"2024-04-25T15:43:06.304824+0000","last_undegraded":"2024-04-25T15:43:06.304824+0000","last_fullsized":"2024-04-25T15:43:06.304824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:58.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515392+0000","last_change":"2024-04-25T15:43:01.291635+0000","last_active":"2024-04-25T15:43:06.515392+0000","last_peered":"2024-04-25T15:43:06.515392+0000","last_clean":"2024-04-25T15:43:06.515392+0000","last_became_active":"2024-04-25T15:43:01.291222+0000","last_became_peered":"2024-04-25T15:43:01.291222+0000","last_unstale":"2024-04-25T15:43:06.515392+0000","last_undegraded":"2024-04-25T15:43:06.515392+0000","last_fullsized":"2024-04-25T15:43:06.515392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360670+0000","last_change":"2024-04-25T15:43:01.283764+0000","last_active":"2024-04-25T15:43:07.360670+0000","last_peered":"2024-04-25T15:43:07.360670+0000","last_clean":"2024-04-25T15:43:07.360670+0000","last_became_active":"2024-04-25T15:43:01.283409+0000","last_became_peered":"2024-04-25T15:43:01.283409+0000","last_unstale":"2024-04-25T15:43:07.360670+0000","last_undegraded":"2024-04-25T15:43:07.360670+0000","last_fullsized":"2024-04-25T15:43:07.360670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362184+0000","last_change":"2024-04-25T15:43:01.294089+0000","last_active":"2024-04-25T15:43:07.362184+0000","last_peered":"2024-04-25T15:43:07.362184+0000","last_clean":"2024-04-25T15:43:07.362184+0000","last_became_active":"2024-04-25T15:43:01.293753+0000","last_became_peered":"2024-04-25T15:43:01.293753+0000","last_unstale":"2024-04-25T15:43:07.362184+0000","last_undegraded":"2024-04-25T15:43:07.362184+0000","last_fullsized":"2024-04-25T15:43:07.362184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359861+0000","last_change":"2024-04-25T15:43:01.278680+0000","last_active":"2024-04-25T15:43:07.359861+0000","last_peered":"2024-04-25T15:43:07.359861+0000","last_clean":"2024-04-25T15:43:07.359861+0000","last_became_active":"2024-04-25T15:43:01.278347+0000","last_became_peered":"2024-04-25T15:43:01.278347+0000","last_unstale":"2024-04-25T15:43:07.359861+0000","last_undegraded":"2024-04-25T15:43:07.359861+0000","last_fullsized":"2024-04-25T15:43:07.359861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173725+0000","last_change":"2024-04-25T15:43:01.287386+0000","last_active":"2024-04-25T15:43:07.173725+0000","last_peered":"2024-04-25T15:43:07.173725+0000","last_clean":"2024-04-25T15:43:07.173725+0000","last_became_active":"2024-04-25T15:43:01.287049+0000","last_became_peered":"2024-04-25T15:43:01.287049+0000","last_unstale":"2024-04-25T15:43:07.173725+0000","last_undegraded":"2024-04-25T15:43:07.173725+0000","last_fullsized":"2024-04-25T15:43:07.173725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361171+0000","last_change":"2024-04-25T15:43:01.295000+0000","last_active":"2024-04-25T15:43:07.361171+0000","last_peered":"2024-04-25T15:43:07.361171+0000","last_clean":"2024-04-25T15:43:07.361171+0000","last_became_active":"2024-04-25T15:43:01.294605+0000","last_became_peered":"2024-04-25T15:43:01.294605+0000","last_unstale":"2024-04-25T15:43:07.361171+0000","last_undegraded":"2024-04-25T15:43:07.361171+0000","last_fullsized":"2024-04-25T15:43:07.361171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515111+0000","last_change":"2024-04-25T15:43:01.291742+0000","last_active":"2024-04-25T15:43:06.515111+0000","last_peered":"2024-04-25T15:43:06.515111+0000","last_clean":"2024-04-25T15:43:06.515111+0000","last_became_active":"2024-04-25T15:43:01.291354+0000","last_became_peered":"2024-04-25T15:43:01.291354+0000","last_unstale":"2024-04-25T15:43:06.515111+0000","last_undegraded":"2024-04-25T15:43:06.515111+0000","last_fullsized":"2024-04-25T15:43:06.515111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360284+0000","last_change":"2024-04-25T15:43:01.296211+0000","last_active":"2024-04-25T15:43:07.360284+0000","last_peered":"2024-04-25T15:43:07.360284+0000","last_clean":"2024-04-25T15:43:07.360284+0000","last_became_active":"2024-04-25T15:43:01.295195+0000","last_became_peered":"2024-04-25T15:43:01.295195+0000","last_unstale":"2024-04-25T15:43:07.360284+0000","last_undegraded":"2024-04-25T15:43:07.360284+0000","last_fullsized":"2024-04-25T15:43:07.360284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515314+0000","last_change":"2024-04-25T15:43:01.303436+0000","last_active":"2024-04-25T15:43:06.515314+0000","last_peered":"2024-04-25T15:43:06.515314+0000","last_clean":"2024-04-25T15:43:06.515314+0000","last_became_active":"2024-04-25T15:43:01.303068+0000","last_became_peered":"2024-04-25T15:43:01.303068+0000","last_unstale":"2024-04-25T15:43:06.515314+0000","last_undegraded":"2024-04-25T15:43:06.515314+0000","last_fullsized":"2024-04-25T15:43:06.515314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360519+0000","last_change":"2024-04-25T15:43:01.295585+0000","last_active":"2024-04-25T15:43:07.360519+0000","last_peered":"2024-04-25T15:43:07.360519+0000","last_clean":"2024-04-25T15:43:07.360519+0000","last_became_active":"2024-04-25T15:43:01.294821+0000","last_became_peered":"2024-04-25T15:43:01.294821+0000","last_unstale":"2024-04-25T15:43:07.360519+0000","last_undegraded":"2024-04-25T15:43:07.360519+0000","last_fullsized":"2024-04-25T15:43:07.360519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173483+0000","last_change":"2024-04-25T15:43:01.296022+0000","last_active":"2024-04-25T15:43:07.173483+0000","last_peered":"2024-04-25T15:43:07.173483+0000","last_clean":"2024-04-25T15:43:07.173483+0000","last_became_active":"2024-04-25T15:43:01.295477+0000","last_became_peered":"2024-04-25T15:43:01.295477+0000","last_unstale":"2024-04-25T15:43:07.173483+0000","last_undegraded":"2024-04-25T15:43:07.173483+0000","last_fullsized":"2024-04-25T15:43:07.173483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305121+0000","last_change":"2024-04-25T15:43:01.293363+0000","last_active":"2024-04-25T15:43:06.305121+0000","last_peered":"2024-04-25T15:43:06.305121+0000","last_clean":"2024-04-25T15:43:06.305121+0000","last_became_active":"2024-04-25T15:43:01.290509+0000","last_became_peered":"2024-04-25T15:43:01.290509+0000","last_unstale":"2024-04-25T15:43:06.305121+0000","last_undegraded":"2024-04-25T15:43:06.305121+0000","last_fullsized":"2024-04-25T15:43:06.305121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:44.264051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305240+0000","last_change":"2024-04-25T15:43:01.289526+0000","last_active":"2024-04-25T15:43:06.305240+0000","last_peered":"2024-04-25T15:43:06.305240+0000","last_clean":"2024-04-25T15:43:06.305240+0000","last_became_active":"2024-04-25T15:43:01.289019+0000","last_became_peered":"2024-04-25T15:43:01.289019+0000","last_unstale":"2024-04-25T15:43:06.305240+0000","last_undegraded":"2024-04-25T15:43:06.305240+0000","last_fullsized":"2024-04-25T15:43:06.305240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515937+0000","last_change":"2024-04-25T15:43:01.301402+0000","last_active":"2024-04-25T15:43:06.515937+0000","last_peered":"2024-04-25T15:43:06.515937+0000","last_clean":"2024-04-25T15:43:06.515937+0000","last_became_active":"2024-04-25T15:43:01.301026+0000","last_became_peered":"2024-04-25T15:43:01.301026+0000","last_unstale":"2024-04-25T15:43:06.515937+0000","last_undegraded":"2024-04-25T15:43:06.515937+0000","last_fullsized":"2024-04-25T15:43:06.515937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515052+0000","last_change":"2024-04-25T15:43:01.297919+0000","last_active":"2024-04-25T15:43:06.515052+0000","last_peered":"2024-04-25T15:43:06.515052+0000","last_clean":"2024-04-25T15:43:06.515052+0000","last_became_active":"2024-04-25T15:43:01.295658+0000","last_became_peered":"2024-04-25T15:43:01.295658+0000","last_unstale":"2024-04-25T15:43:06.515052+0000","last_undegraded":"2024-04-25T15:43:06.515052+0000","last_fullsized":"2024-04-25T15:43:06.515052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360534+0000","last_change":"2024-04-25T15:43:01.294743+0000","last_active":"2024-04-25T15:43:07.360534+0000","last_peered":"2024-04-25T15:43:07.360534+0000","last_clean":"2024-04-25T15:43:07.360534+0000","last_became_active":"2024-04-25T15:43:01.294420+0000","last_became_peered":"2024-04-25T15:43:01.294420+0000","last_unstale":"2024-04-25T15:43:07.360534+0000","last_undegraded":"2024-04-25T15:43:07.360534+0000","last_fullsized":"2024-04-25T15:43:07.360534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360776+0000","last_change":"2024-04-25T15:43:01.283558+0000","last_active":"2024-04-25T15:43:07.360776+0000","last_peered":"2024-04-25T15:43:07.360776+0000","last_clean":"2024-04-25T15:43:07.360776+0000","last_became_active":"2024-04-25T15:43:01.283203+0000","last_became_peered":"2024-04-25T15:43:01.283203+0000","last_unstale":"2024-04-25T15:43:07.360776+0000","last_undegraded":"2024-04-25T15:43:07.360776+0000","last_fullsized":"2024-04-25T15:43:07.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:01.569378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360283+0000","last_change":"2024-04-25T15:43:01.287196+0000","last_active":"2024-04-25T15:43:07.360283+0000","last_peered":"2024-04-25T15:43:07.360283+0000","last_clean":"2024-04-25T15:43:07.360283+0000","last_became_active":"2024-04-25T15:43:01.286881+0000","last_became_peered":"2024-04-25T15:43:01.286881+0000","last_unstale":"2024-04-25T15:43:07.360283+0000","last_undegraded":"2024-04-25T15:43:07.360283+0000","last_fullsized":"2024-04-25T15:43:07.360283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304665+0000","last_change":"2024-04-25T15:43:01.294284+0000","last_active":"2024-04-25T15:43:06.304665+0000","last_peered":"2024-04-25T15:43:06.304665+0000","last_clean":"2024-04-25T15:43:06.304665+0000","last_became_active":"2024-04-25T15:43:01.293046+0000","last_became_peered":"2024-04-25T15:43:01.293046+0000","last_unstale":"2024-04-25T15:43:06.304665+0000","last_undegraded":"2024-04-25T15:43:06.304665+0000","last_fullsized":"2024-04-25T15:43:06.304665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:43.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173401+0000","last_change":"2024-04-25T15:43:01.289095+0000","last_active":"2024-04-25T15:43:07.173401+0000","last_peered":"2024-04-25T15:43:07.173401+0000","last_clean":"2024-04-25T15:43:07.173401+0000","last_became_active":"2024-04-25T15:43:01.288193+0000","last_became_peered":"2024-04-25T15:43:01.288193+0000","last_unstale":"2024-04-25T15:43:07.173401+0000","last_undegraded":"2024-04-25T15:43:07.173401+0000","last_fullsized":"2024-04-25T15:43:07.173401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173606+0000","last_change":"2024-04-25T15:43:01.292901+0000","last_active":"2024-04-25T15:43:07.173606+0000","last_peered":"2024-04-25T15:43:07.173606+0000","last_clean":"2024-04-25T15:43:07.173606+0000","last_became_active":"2024-04-25T15:43:01.292459+0000","last_became_peered":"2024-04-25T15:43:01.292459+0000","last_unstale":"2024-04-25T15:43:07.173606+0000","last_undegraded":"2024-04-25T15:43:07.173606+0000","last_fullsized":"2024-04-25T15:43:07.173606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305631+0000","last_change":"2024-04-25T15:43:01.289823+0000","last_active":"2024-04-25T15:43:06.305631+0000","last_peered":"2024-04-25T15:43:06.305631+0000","last_clean":"2024-04-25T15:43:06.305631+0000","last_became_active":"2024-04-25T15:43:01.289511+0000","last_became_peered":"2024-04-25T15:43:01.289511+0000","last_unstale":"2024-04-25T15:43:06.305631+0000","last_undegraded":"2024-04-25T15:43:06.305631+0000","last_fullsized":"2024-04-25T15:43:06.305631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:23.025567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360402+0000","last_change":"2024-04-25T15:43:01.288077+0000","last_active":"2024-04-25T15:43:07.360402+0000","last_peered":"2024-04-25T15:43:07.360402+0000","last_clean":"2024-04-25T15:43:07.360402+0000","last_became_active":"2024-04-25T15:43:01.287776+0000","last_became_peered":"2024-04-25T15:43:01.287776+0000","last_unstale":"2024-04-25T15:43:07.360402+0000","last_undegraded":"2024-04-25T15:43:07.360402+0000","last_fullsized":"2024-04-25T15:43:07.360402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303801+0000","last_change":"2024-04-25T15:43:01.285211+0000","last_active":"2024-04-25T15:43:06.303801+0000","last_peered":"2024-04-25T15:43:06.303801+0000","last_clean":"2024-04-25T15:43:06.303801+0000","last_became_active":"2024-04-25T15:43:01.284874+0000","last_became_peered":"2024-04-25T15:43:01.284874+0000","last_unstale":"2024-04-25T15:43:06.303801+0000","last_undegraded":"2024-04-25T15:43:06.303801+0000","last_fullsized":"2024-04-25T15:43:06.303801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515218+0000","last_change":"2024-04-25T15:43:01.298601+0000","last_active":"2024-04-25T15:43:06.515218+0000","last_peered":"2024-04-25T15:43:06.515218+0000","last_clean":"2024-04-25T15:43:06.515218+0000","last_became_active":"2024-04-25T15:43:01.298301+0000","last_became_peered":"2024-04-25T15:43:01.298301+0000","last_unstale":"2024-04-25T15:43:06.515218+0000","last_undegraded":"2024-04-25T15:43:06.515218+0000","last_fullsized":"2024-04-25T15:43:06.515218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304229+0000","last_change":"2024-04-25T15:43:01.285864+0000","last_active":"2024-04-25T15:43:06.304229+0000","last_peered":"2024-04-25T15:43:06.304229+0000","last_clean":"2024-04-25T15:43:06.304229+0000","last_became_active":"2024-04-25T15:43:01.285575+0000","last_became_peered":"2024-04-25T15:43:01.285575+0000","last_unstale":"2024-04-25T15:43:06.304229+0000","last_undegraded":"2024-04-25T15:43:06.304229+0000","last_fullsized":"2024-04-25T15:43:06.304229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515349+0000","last_change":"2024-04-25T15:43:01.303192+0000","last_active":"2024-04-25T15:43:06.515349+0000","last_peered":"2024-04-25T15:43:06.515349+0000","last_clean":"2024-04-25T15:43:06.515349+0000","last_became_active":"2024-04-25T15:43:01.302882+0000","last_became_peered":"2024-04-25T15:43:01.302882+0000","last_unstale":"2024-04-25T15:43:06.515349+0000","last_undegraded":"2024-04-25T15:43:06.515349+0000","last_fullsized":"2024-04-25T15:43:06.515349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359780+0000","last_change":"2024-04-25T15:43:01.290113+0000","last_active":"2024-04-25T15:43:07.359780+0000","last_peered":"2024-04-25T15:43:07.359780+0000","last_clean":"2024-04-25T15:43:07.359780+0000","last_became_active":"2024-04-25T15:43:01.289784+0000","last_became_peered":"2024-04-25T15:43:01.289784+0000","last_unstale":"2024-04-25T15:43:07.359780+0000","last_undegraded":"2024-04-25T15:43:07.359780+0000","last_fullsized":"2024-04-25T15:43:07.359780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:58.293161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360941+0000","last_change":"2024-04-25T15:43:01.285205+0000","last_active":"2024-04-25T15:43:07.360941+0000","last_peered":"2024-04-25T15:43:07.360941+0000","last_clean":"2024-04-25T15:43:07.360941+0000","last_became_active":"2024-04-25T15:43:01.284834+0000","last_became_peered":"2024-04-25T15:43:01.284834+0000","last_unstale":"2024-04-25T15:43:07.360941+0000","last_undegraded":"2024-04-25T15:43:07.360941+0000","last_fullsized":"2024-04-25T15:43:07.360941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305525+0000","last_change":"2024-04-25T15:43:01.299431+0000","last_active":"2024-04-25T15:43:06.305525+0000","last_peered":"2024-04-25T15:43:06.305525+0000","last_clean":"2024-04-25T15:43:06.305525+0000","last_became_active":"2024-04-25T15:43:01.298478+0000","last_became_peered":"2024-04-25T15:43:01.298478+0000","last_unstale":"2024-04-25T15:43:06.305525+0000","last_undegraded":"2024-04-25T15:43:06.305525+0000","last_fullsized":"2024-04-25T15:43:06.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":103617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":103653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:43:24.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:43:24.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.509+0000 7f2ce1585640 1 Processor -- start 2024-04-25T15:43:24.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.509+0000 7f2ce1585640 1 -- start start 2024-04-25T15:43:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2ce1585640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0b7d60 0x7f2cdc16b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2ce1585640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc0d59d0 con 0x7f2cdc0b48d0 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2ce1585640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc163fb0 con 0x7f2cdc0d41b0 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2ce1585640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2cdc164270 con 0x7f2cdc0b7d60 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cda7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2cdc0b48d0 0x7f2cdc0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41746/0 (socket says 172.21.15.80:41746) 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cda7fc640 1 -- 172.21.15.80:0/1969581343 learned_addr learned my addr 172.21.15.80:0/1969581343 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cdb7fe640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0b7d60 0x7f2cdc16b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197952778 0 0) 0x7f2cdc0d59d0 con 0x7f2cdc0b48d0 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc4003520 con 0x7f2cdc0b48d0 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3893057219 0 0) 0x7f2cc4003520 con 0x7f2cdc0b48d0 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0b7d60 msgr2=0x7f2cdc16b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0b7d60 0x7f2cdc16b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 >> v1:172.21.15.195:6789/0 conn(0x7f2cdc0d41b0 legacy=0x7f2cdc1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc164550 con 0x7f2cdc0b48d0 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f2cd0001670 con 0x7f2cdc0b48d0 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 >> v1:172.21.15.80:6789/0 conn(0x7f2cdc0b48d0 legacy=0x7f2cdc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc40039e0 0x7f2cc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cc4005150 0x7f2cc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc164270 con 0x7f2cc4004800 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc400bf00 con 0x7f2cc40039e0 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.511+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc400c080 con 0x7f2cc4005150 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cdaffd640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc40039e0 0x7f2cc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cdb7fe640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cc4005150 0x7f2cc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 -- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cc4005150 msgr2=0x7f2cc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cc4005150 0x7f2cc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 -- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc40039e0 msgr2=0x7f2cc4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc40039e0 0x7f2cc4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 -- 172.21.15.80:0/1969581343 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc4003520 con 0x7f2cc4004800 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cdaffd640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc40039e0 0x7f2cc4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.512+0000 7f2cda7fc640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c210 tx=0x7f2cc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40acfc4f37599ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0007d30 con 0x7f2cc4004800 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd0005af0 con 0x7f2cc4004800 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/1969581343 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0007070 con 0x7f2cc4004800 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2ce1585640 1 -- 172.21.15.80:0/1969581343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4004800 msgr2=0x7f2cc4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2ce1585640 1 --2- 172.21.15.80:0/1969581343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c210 tx=0x7f2cc4005830 comp rx=0 tx=0).stop 2024-04-25T15:43:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2cdb7fe640 1 -- 172.21.15.80:0/1969581343 reap_dead start 2024-04-25T15:43:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2ce1585640 1 -- 172.21.15.80:0/1969581343 shutdown_connections 2024-04-25T15:43:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2ce1585640 1 -- 172.21.15.80:0/1969581343 >> 172.21.15.80:0/1969581343 conn(0x7f2cdc06e9f0 msgr2=0x7f2cdc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2ce1585640 1 -- 172.21.15.80:0/1969581343 shutdown_connections 2024-04-25T15:43:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.513+0000 7f2ce1585640 1 -- 172.21.15.80:0/1969581343 wait complete. 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.515+0000 7f2ce1585640 1 Processor -- start 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.515+0000 7f2ce1585640 1 -- start start 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4004800 0x7f2cdc15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0cdc60 0x7f2cdc0ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 0x7f2cdc162730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc0b4fd0 con 0x7f2cdc162320 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc164b10 con 0x7f2cc4004800 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2cdc0b5150 con 0x7f2cdc0cdc60 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 0x7f2cdc162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 0x7f2cdc162730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43924/0 (socket says 172.21.15.80:43924) 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 -- 172.21.15.80:0/4198722903 learned_addr learned my addr 172.21.15.80:0/4198722903 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdaffd640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4004800 0x7f2cdc15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cda7fc640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0cdc60 0x7f2cdc0ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 -- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0cdc60 msgr2=0x7f2cdc0ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0cdc60 0x7f2cdc0ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 -- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4004800 msgr2=0x7f2cdc15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4004800 0x7f2cdc15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 -- 172.21.15.80:0/4198722903 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc0cc4a0 con 0x7f2cdc162320 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cda7fc640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0cdc60 0x7f2cdc0ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdaffd640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4004800 0x7f2cdc15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cdb7fe640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 0x7f2cdc162730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4004780 tx=0x7f2cd400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4015430 con 0x7f2cdc162320 2024-04-25T15:43:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd401d070 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cdc1634c0 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4015810 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.517+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cdc0ca3b0 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.518+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cdc06a100 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.519+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2cd40159b0 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.519+0000 7f2cc37fe640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2cc80744b0 0x7f2cc80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.519+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2cd4095f90 con 0x7f2cdc162320 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.519+0000 7f2cdaffd640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2cc80744b0 0x7f2cc80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.520+0000 7f2cdaffd640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2cc80744b0 0x7f2cc80769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc005580 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.524+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2cd4010040 con 0x7f2cdc162320 2024-04-25T15:43:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.698+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2cdc0d3070 con 0x7f2cc80744b0 2024-04-25T15:43:24.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.706+0000 7f2cc37fe640 1 -- 172.21.15.80:0/4198722903 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f2cdc0d3070 con 0x7f2cc80744b0 2024-04-25T15:43:24.711 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:43:24.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.709+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2cc80744b0 msgr2=0x7f2cc80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.709+0000 7f2ce1585640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2cc80744b0 0x7f2cc80769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc005580 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2024-04-25T15:43:24.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.709+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 msgr2=0x7f2cdc162730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.709+0000 7f2ce1585640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 0x7f2cdc162730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4004780 tx=0x7f2cd400f580 comp rx=0 tx=0).stop 2024-04-25T15:43:24.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 shutdown_connections 2024-04-25T15:43:24.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2cc80744b0 0x7f2cc80769c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cdc162320 0x7f2cdc162730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cdc0cdc60 0x7f2cdc0ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 --2- 172.21.15.80:0/4198722903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4004800 0x7f2cdc15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 >> 172.21.15.80:0/4198722903 conn(0x7f2cdc06e9f0 msgr2=0x7f2cdc0bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 shutdown_connections 2024-04-25T15:43:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.710+0000 7f2ce1585640 1 -- 172.21.15.80:0/4198722903 wait complete. 2024-04-25T15:43:24.722 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-25T15:43:23.002210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2018232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362284+0000","last_change":"2024-04-25T15:43:00.262559+0000","last_active":"2024-04-25T15:43:07.362284+0000","last_peered":"2024-04-25T15:43:07.362284+0000","last_clean":"2024-04-25T15:43:07.362284+0000","last_became_active":"2024-04-25T15:43:00.260334+0000","last_became_peered":"2024-04-25T15:43:00.260334+0000","last_unstale":"2024-04-25T15:43:07.362284+0000","last_undegraded":"2024-04-25T15:43:07.362284+0000","last_fullsized":"2024-04-25T15:43:07.362284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:37.689363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360799+0000","last_change":"2024-04-25T15:43:01.287221+0000","last_active":"2024-04-25T15:43:07.360799+0000","last_peered":"2024-04-25T15:43:07.360799+0000","last_clean":"2024-04-25T15:43:07.360799+0000","last_became_active":"2024-04-25T15:43:01.286908+0000","last_became_peered":"2024-04-25T15:43:01.286908+0000","last_unstale":"2024-04-25T15:43:07.360799+0000","last_undegraded":"2024-04-25T15:43:07.360799+0000","last_fullsized":"2024-04-25T15:43:07.360799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359974+0000","last_change":"2024-04-25T15:43:05.318849+0000","last_active":"2024-04-25T15:43:07.359974+0000","last_peered":"2024-04-25T15:43:07.359974+0000","last_clean":"2024-04-25T15:43:07.359974+0000","last_became_active":"2024-04-25T15:43:05.318430+0000","last_became_peered":"2024-04-25T15:43:05.318430+0000","last_unstale":"2024-04-25T15:43:07.359974+0000","last_undegraded":"2024-04-25T15:43:07.359974+0000","last_fullsized":"2024-04-25T15:43:07.359974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361076+0000","last_change":"2024-04-25T15:43:00.271120+0000","last_active":"2024-04-25T15:43:07.361076+0000","last_peered":"2024-04-25T15:43:07.361076+0000","last_clean":"2024-04-25T15:43:07.361076+0000","last_became_active":"2024-04-25T15:43:00.270825+0000","last_became_peered":"2024-04-25T15:43:00.270825+0000","last_unstale":"2024-04-25T15:43:07.361076+0000","last_undegraded":"2024-04-25T15:43:07.361076+0000","last_fullsized":"2024-04-25T15:43:07.361076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362058+0000","last_change":"2024-04-25T15:43:01.301805+0000","last_active":"2024-04-25T15:43:07.362058+0000","last_peered":"2024-04-25T15:43:07.362058+0000","last_clean":"2024-04-25T15:43:07.362058+0000","last_became_active":"2024-04-25T15:43:01.301404+0000","last_became_peered":"2024-04-25T15:43:01.301404+0000","last_unstale":"2024-04-25T15:43:07.362058+0000","last_undegraded":"2024-04-25T15:43:07.362058+0000","last_fullsized":"2024-04-25T15:43:07.362058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303866+0000","last_change":"2024-04-25T15:43:05.327540+0000","last_active":"2024-04-25T15:43:06.303866+0000","last_peered":"2024-04-25T15:43:06.303866+0000","last_clean":"2024-04-25T15:43:06.303866+0000","last_became_active":"2024-04-25T15:43:05.326737+0000","last_became_peered":"2024-04-25T15:43:05.326737+0000","last_unstale":"2024-04-25T15:43:06.303866+0000","last_undegraded":"2024-04-25T15:43:06.303866+0000","last_fullsized":"2024-04-25T15:43:06.303866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:01.657357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305054+0000","last_change":"2024-04-25T15:43:00.269417+0000","last_active":"2024-04-25T15:43:06.305054+0000","last_peered":"2024-04-25T15:43:06.305054+0000","last_clean":"2024-04-25T15:43:06.305054+0000","last_became_active":"2024-04-25T15:43:00.268747+0000","last_became_peered":"2024-04-25T15:43:00.268747+0000","last_unstale":"2024-04-25T15:43:06.305054+0000","last_undegraded":"2024-04-25T15:43:06.305054+0000","last_fullsized":"2024-04-25T15:43:06.305054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:49.833413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515416+0000","last_change":"2024-04-25T15:43:01.293581+0000","last_active":"2024-04-25T15:43:06.515416+0000","last_peered":"2024-04-25T15:43:06.515416+0000","last_clean":"2024-04-25T15:43:06.515416+0000","last_became_active":"2024-04-25T15:43:01.292501+0000","last_became_peered":"2024-04-25T15:43:01.292501+0000","last_unstale":"2024-04-25T15:43:06.515416+0000","last_undegraded":"2024-04-25T15:43:06.515416+0000","last_fullsized":"2024-04-25T15:43:06.515416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305418+0000","last_change":"2024-04-25T15:43:05.332634+0000","last_active":"2024-04-25T15:43:06.305418+0000","last_peered":"2024-04-25T15:43:06.305418+0000","last_clean":"2024-04-25T15:43:06.305418+0000","last_became_active":"2024-04-25T15:43:05.332110+0000","last_became_peered":"2024-04-25T15:43:05.332110+0000","last_unstale":"2024-04-25T15:43:06.305418+0000","last_undegraded":"2024-04-25T15:43:06.305418+0000","last_fullsized":"2024-04-25T15:43:06.305418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304639+0000","last_change":"2024-04-25T15:43:00.270429+0000","last_active":"2024-04-25T15:43:06.304639+0000","last_peered":"2024-04-25T15:43:06.304639+0000","last_clean":"2024-04-25T15:43:06.304639+0000","last_became_active":"2024-04-25T15:43:00.270080+0000","last_became_peered":"2024-04-25T15:43:00.270080+0000","last_unstale":"2024-04-25T15:43:06.304639+0000","last_undegraded":"2024-04-25T15:43:06.304639+0000","last_fullsized":"2024-04-25T15:43:06.304639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515514+0000","last_change":"2024-04-25T15:43:01.294967+0000","last_active":"2024-04-25T15:43:06.515514+0000","last_peered":"2024-04-25T15:43:06.515514+0000","last_clean":"2024-04-25T15:43:06.515514+0000","last_became_active":"2024-04-25T15:43:01.294673+0000","last_became_peered":"2024-04-25T15:43:01.294673+0000","last_unstale":"2024-04-25T15:43:06.515514+0000","last_undegraded":"2024-04-25T15:43:06.515514+0000","last_fullsized":"2024-04-25T15:43:06.515514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303942+0000","last_change":"2024-04-25T15:43:05.330892+0000","last_active":"2024-04-25T15:43:06.303942+0000","last_peered":"2024-04-25T15:43:06.303942+0000","last_clean":"2024-04-25T15:43:06.303942+0000","last_became_active":"2024-04-25T15:43:05.330435+0000","last_became_peered":"2024-04-25T15:43:05.330435+0000","last_unstale":"2024-04-25T15:43:06.303942+0000","last_undegraded":"2024-04-25T15:43:06.303942+0000","last_fullsized":"2024-04-25T15:43:06.303942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:31.934838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173076+0000","last_change":"2024-04-25T15:43:01.297084+0000","last_active":"2024-04-25T15:43:07.173076+0000","last_peered":"2024-04-25T15:43:07.173076+0000","last_clean":"2024-04-25T15:43:07.173076+0000","last_became_active":"2024-04-25T15:43:01.296689+0000","last_became_peered":"2024-04-25T15:43:01.296689+0000","last_unstale":"2024-04-25T15:43:07.173076+0000","last_undegraded":"2024-04-25T15:43:07.173076+0000","last_fullsized":"2024-04-25T15:43:07.173076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304863+0000","last_change":"2024-04-25T15:43:00.267473+0000","last_active":"2024-04-25T15:43:06.304863+0000","last_peered":"2024-04-25T15:43:06.304863+0000","last_clean":"2024-04-25T15:43:06.304863+0000","last_became_active":"2024-04-25T15:43:00.264809+0000","last_became_peered":"2024-04-25T15:43:00.264809+0000","last_unstale":"2024-04-25T15:43:06.304863+0000","last_undegraded":"2024-04-25T15:43:06.304863+0000","last_fullsized":"2024-04-25T15:43:06.304863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.324082+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.323656+0000","last_became_peered":"2024-04-25T15:43:05.323656+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361446+0000","last_change":"2024-04-25T15:43:01.284806+0000","last_active":"2024-04-25T15:43:07.361446+0000","last_peered":"2024-04-25T15:43:07.361446+0000","last_clean":"2024-04-25T15:43:07.361446+0000","last_became_active":"2024-04-25T15:43:01.283772+0000","last_became_peered":"2024-04-25T15:43:01.283772+0000","last_unstale":"2024-04-25T15:43:07.361446+0000","last_undegraded":"2024-04-25T15:43:07.361446+0000","last_fullsized":"2024-04-25T15:43:07.361446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361739+0000","last_change":"2024-04-25T15:43:00.271683+0000","last_active":"2024-04-25T15:43:07.361739+0000","last_peered":"2024-04-25T15:43:07.361739+0000","last_clean":"2024-04-25T15:43:07.361739+0000","last_became_active":"2024-04-25T15:43:00.271031+0000","last_became_peered":"2024-04-25T15:43:00.271031+0000","last_unstale":"2024-04-25T15:43:07.361739+0000","last_undegraded":"2024-04-25T15:43:07.361739+0000","last_fullsized":"2024-04-25T15:43:07.361739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304365+0000","last_change":"2024-04-25T15:43:05.326922+0000","last_active":"2024-04-25T15:43:06.304365+0000","last_peered":"2024-04-25T15:43:06.304365+0000","last_clean":"2024-04-25T15:43:06.304365+0000","last_became_active":"2024-04-25T15:43:05.325427+0000","last_became_peered":"2024-04-25T15:43:05.325427+0000","last_unstale":"2024-04-25T15:43:06.304365+0000","last_undegraded":"2024-04-25T15:43:06.304365+0000","last_fullsized":"2024-04-25T15:43:06.304365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:58.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360745+0000","last_change":"2024-04-25T15:43:01.278582+0000","last_active":"2024-04-25T15:43:07.360745+0000","last_peered":"2024-04-25T15:43:07.360745+0000","last_clean":"2024-04-25T15:43:07.360745+0000","last_became_active":"2024-04-25T15:43:01.278262+0000","last_became_peered":"2024-04-25T15:43:01.278262+0000","last_unstale":"2024-04-25T15:43:07.360745+0000","last_undegraded":"2024-04-25T15:43:07.360745+0000","last_fullsized":"2024-04-25T15:43:07.360745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360634+0000","last_change":"2024-04-25T15:43:00.259534+0000","last_active":"2024-04-25T15:43:07.360634+0000","last_peered":"2024-04-25T15:43:07.360634+0000","last_clean":"2024-04-25T15:43:07.360634+0000","last_became_active":"2024-04-25T15:43:00.259226+0000","last_became_peered":"2024-04-25T15:43:00.259226+0000","last_unstale":"2024-04-25T15:43:07.360634+0000","last_undegraded":"2024-04-25T15:43:07.360634+0000","last_fullsized":"2024-04-25T15:43:07.360634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361329+0000","last_change":"2024-04-25T15:43:05.337344+0000","last_active":"2024-04-25T15:43:07.361329+0000","last_peered":"2024-04-25T15:43:07.361329+0000","last_clean":"2024-04-25T15:43:07.361329+0000","last_became_active":"2024-04-25T15:43:05.336683+0000","last_became_peered":"2024-04-25T15:43:05.336683+0000","last_unstale":"2024-04-25T15:43:07.361329+0000","last_undegraded":"2024-04-25T15:43:07.361329+0000","last_fullsized":"2024-04-25T15:43:07.361329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305043+0000","last_change":"2024-04-25T15:43:01.294128+0000","last_active":"2024-04-25T15:43:06.305043+0000","last_peered":"2024-04-25T15:43:06.305043+0000","last_clean":"2024-04-25T15:43:06.305043+0000","last_became_active":"2024-04-25T15:43:01.293722+0000","last_became_peered":"2024-04-25T15:43:01.293722+0000","last_unstale":"2024-04-25T15:43:06.305043+0000","last_undegraded":"2024-04-25T15:43:06.305043+0000","last_fullsized":"2024-04-25T15:43:06.305043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303483+0000","last_change":"2024-04-25T15:43:00.264522+0000","last_active":"2024-04-25T15:43:06.303483+0000","last_peered":"2024-04-25T15:43:06.303483+0000","last_clean":"2024-04-25T15:43:06.303483+0000","last_became_active":"2024-04-25T15:43:00.264219+0000","last_became_peered":"2024-04-25T15:43:00.264219+0000","last_unstale":"2024-04-25T15:43:06.303483+0000","last_undegraded":"2024-04-25T15:43:06.303483+0000","last_fullsized":"2024-04-25T15:43:06.303483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304418+0000","last_change":"2024-04-25T15:43:05.326280+0000","last_active":"2024-04-25T15:43:06.304418+0000","last_peered":"2024-04-25T15:43:06.304418+0000","last_clean":"2024-04-25T15:43:06.304418+0000","last_became_active":"2024-04-25T15:43:05.325812+0000","last_became_peered":"2024-04-25T15:43:05.325812+0000","last_unstale":"2024-04-25T15:43:06.304418+0000","last_undegraded":"2024-04-25T15:43:06.304418+0000","last_fullsized":"2024-04-25T15:43:06.304418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:42.664135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360353+0000","last_change":"2024-04-25T15:43:01.284195+0000","last_active":"2024-04-25T15:43:07.360353+0000","last_peered":"2024-04-25T15:43:07.360353+0000","last_clean":"2024-04-25T15:43:07.360353+0000","last_became_active":"2024-04-25T15:43:01.283818+0000","last_became_peered":"2024-04-25T15:43:01.283818+0000","last_unstale":"2024-04-25T15:43:07.360353+0000","last_undegraded":"2024-04-25T15:43:07.360353+0000","last_fullsized":"2024-04-25T15:43:07.360353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:38.284567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173875+0000","last_change":"2024-04-25T15:43:00.271369+0000","last_active":"2024-04-25T15:43:07.173875+0000","last_peered":"2024-04-25T15:43:07.173875+0000","last_clean":"2024-04-25T15:43:07.173875+0000","last_became_active":"2024-04-25T15:43:00.270954+0000","last_became_peered":"2024-04-25T15:43:00.270954+0000","last_unstale":"2024-04-25T15:43:07.173875+0000","last_undegraded":"2024-04-25T15:43:07.173875+0000","last_fullsized":"2024-04-25T15:43:07.173875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304636+0000","last_change":"2024-04-25T15:43:05.318710+0000","last_active":"2024-04-25T15:43:06.304636+0000","last_peered":"2024-04-25T15:43:06.304636+0000","last_clean":"2024-04-25T15:43:06.304636+0000","last_became_active":"2024-04-25T15:43:05.318244+0000","last_became_peered":"2024-04-25T15:43:05.318244+0000","last_unstale":"2024-04-25T15:43:06.304636+0000","last_undegraded":"2024-04-25T15:43:06.304636+0000","last_fullsized":"2024-04-25T15:43:06.304636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:59.114149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361273+0000","last_change":"2024-04-25T15:43:01.277350+0000","last_active":"2024-04-25T15:43:07.361273+0000","last_peered":"2024-04-25T15:43:07.361273+0000","last_clean":"2024-04-25T15:43:07.361273+0000","last_became_active":"2024-04-25T15:43:01.277042+0000","last_became_peered":"2024-04-25T15:43:01.277042+0000","last_unstale":"2024-04-25T15:43:07.361273+0000","last_undegraded":"2024-04-25T15:43:07.361273+0000","last_fullsized":"2024-04-25T15:43:07.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361047+0000","last_change":"2024-04-25T15:43:00.270292+0000","last_active":"2024-04-25T15:43:07.361047+0000","last_peered":"2024-04-25T15:43:07.361047+0000","last_clean":"2024-04-25T15:43:07.361047+0000","last_became_active":"2024-04-25T15:43:00.269920+0000","last_became_peered":"2024-04-25T15:43:00.269920+0000","last_unstale":"2024-04-25T15:43:07.361047+0000","last_undegraded":"2024-04-25T15:43:07.361047+0000","last_fullsized":"2024-04-25T15:43:07.361047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360289+0000","last_change":"2024-04-25T15:43:05.327625+0000","last_active":"2024-04-25T15:43:07.360289+0000","last_peered":"2024-04-25T15:43:07.360289+0000","last_clean":"2024-04-25T15:43:07.360289+0000","last_became_active":"2024-04-25T15:43:05.327068+0000","last_became_peered":"2024-04-25T15:43:05.327068+0000","last_unstale":"2024-04-25T15:43:07.360289+0000","last_undegraded":"2024-04-25T15:43:07.360289+0000","last_fullsized":"2024-04-25T15:43:07.360289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:06.933725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361783+0000","last_change":"2024-04-25T15:43:01.289525+0000","last_active":"2024-04-25T15:43:07.361783+0000","last_peered":"2024-04-25T15:43:07.361783+0000","last_clean":"2024-04-25T15:43:07.361783+0000","last_became_active":"2024-04-25T15:43:01.288948+0000","last_became_peered":"2024-04-25T15:43:01.288948+0000","last_unstale":"2024-04-25T15:43:07.361783+0000","last_undegraded":"2024-04-25T15:43:07.361783+0000","last_fullsized":"2024-04-25T15:43:07.361783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305175+0000","last_change":"2024-04-25T15:43:00.270648+0000","last_active":"2024-04-25T15:43:06.305175+0000","last_peered":"2024-04-25T15:43:06.305175+0000","last_clean":"2024-04-25T15:43:06.305175+0000","last_became_active":"2024-04-25T15:43:00.269383+0000","last_became_peered":"2024-04-25T15:43:00.269383+0000","last_unstale":"2024-04-25T15:43:06.305175+0000","last_undegraded":"2024-04-25T15:43:06.305175+0000","last_fullsized":"2024-04-25T15:43:06.305175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:57.288718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360617+0000","last_change":"2024-04-25T15:43:05.324673+0000","last_active":"2024-04-25T15:43:07.360617+0000","last_peered":"2024-04-25T15:43:07.360617+0000","last_clean":"2024-04-25T15:43:07.360617+0000","last_became_active":"2024-04-25T15:43:05.323620+0000","last_became_peered":"2024-04-25T15:43:05.323620+0000","last_unstale":"2024-04-25T15:43:07.360617+0000","last_undegraded":"2024-04-25T15:43:07.360617+0000","last_fullsized":"2024-04-25T15:43:07.360617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515849+0000","last_change":"2024-04-25T15:43:01.303220+0000","last_active":"2024-04-25T15:43:06.515849+0000","last_peered":"2024-04-25T15:43:06.515849+0000","last_clean":"2024-04-25T15:43:06.515849+0000","last_became_active":"2024-04-25T15:43:01.302322+0000","last_became_peered":"2024-04-25T15:43:01.302322+0000","last_unstale":"2024-04-25T15:43:06.515849+0000","last_undegraded":"2024-04-25T15:43:06.515849+0000","last_fullsized":"2024-04-25T15:43:06.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361861+0000","last_change":"2024-04-25T15:43:00.266400+0000","last_active":"2024-04-25T15:43:07.361861+0000","last_peered":"2024-04-25T15:43:07.361861+0000","last_clean":"2024-04-25T15:43:07.361861+0000","last_became_active":"2024-04-25T15:43:00.265691+0000","last_became_peered":"2024-04-25T15:43:00.265691+0000","last_unstale":"2024-04-25T15:43:07.361861+0000","last_undegraded":"2024-04-25T15:43:07.361861+0000","last_fullsized":"2024-04-25T15:43:07.361861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361515+0000","last_change":"2024-04-25T15:43:05.333242+0000","last_active":"2024-04-25T15:43:07.361515+0000","last_peered":"2024-04-25T15:43:07.361515+0000","last_clean":"2024-04-25T15:43:07.361515+0000","last_became_active":"2024-04-25T15:43:05.332499+0000","last_became_peered":"2024-04-25T15:43:05.332499+0000","last_unstale":"2024-04-25T15:43:07.361515+0000","last_undegraded":"2024-04-25T15:43:07.361515+0000","last_fullsized":"2024-04-25T15:43:07.361515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305390+0000","last_change":"2024-04-25T15:43:01.303850+0000","last_active":"2024-04-25T15:43:06.305390+0000","last_peered":"2024-04-25T15:43:06.305390+0000","last_clean":"2024-04-25T15:43:06.305390+0000","last_became_active":"2024-04-25T15:43:01.303351+0000","last_became_peered":"2024-04-25T15:43:01.303351+0000","last_unstale":"2024-04-25T15:43:06.305390+0000","last_undegraded":"2024-04-25T15:43:06.305390+0000","last_fullsized":"2024-04-25T15:43:06.305390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:55.857252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515505+0000","last_change":"2024-04-25T15:43:00.265989+0000","last_active":"2024-04-25T15:43:06.515505+0000","last_peered":"2024-04-25T15:43:06.515505+0000","last_clean":"2024-04-25T15:43:06.515505+0000","last_became_active":"2024-04-25T15:43:00.265654+0000","last_became_peered":"2024-04-25T15:43:00.265654+0000","last_unstale":"2024-04-25T15:43:06.515505+0000","last_undegraded":"2024-04-25T15:43:06.515505+0000","last_fullsized":"2024-04-25T15:43:06.515505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361721+0000","last_change":"2024-04-25T15:43:05.335093+0000","last_active":"2024-04-25T15:43:07.361721+0000","last_peered":"2024-04-25T15:43:07.361721+0000","last_clean":"2024-04-25T15:43:07.361721+0000","last_became_active":"2024-04-25T15:43:05.334657+0000","last_became_peered":"2024-04-25T15:43:05.334657+0000","last_unstale":"2024-04-25T15:43:07.361721+0000","last_undegraded":"2024-04-25T15:43:07.361721+0000","last_fullsized":"2024-04-25T15:43:07.361721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:08.225975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361261+0000","last_change":"2024-04-25T15:43:01.290703+0000","last_active":"2024-04-25T15:43:07.361261+0000","last_peered":"2024-04-25T15:43:07.361261+0000","last_clean":"2024-04-25T15:43:07.361261+0000","last_became_active":"2024-04-25T15:43:01.290172+0000","last_became_peered":"2024-04-25T15:43:01.290172+0000","last_unstale":"2024-04-25T15:43:07.361261+0000","last_undegraded":"2024-04-25T15:43:07.361261+0000","last_fullsized":"2024-04-25T15:43:07.361261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304850+0000","last_change":"2024-04-25T15:43:00.266600+0000","last_active":"2024-04-25T15:43:06.304850+0000","last_peered":"2024-04-25T15:43:06.304850+0000","last_clean":"2024-04-25T15:43:06.304850+0000","last_became_active":"2024-04-25T15:43:00.266272+0000","last_became_peered":"2024-04-25T15:43:00.266272+0000","last_unstale":"2024-04-25T15:43:06.304850+0000","last_undegraded":"2024-04-25T15:43:06.304850+0000","last_fullsized":"2024-04-25T15:43:06.304850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361502+0000","last_change":"2024-04-25T15:43:05.335202+0000","last_active":"2024-04-25T15:43:07.361502+0000","last_peered":"2024-04-25T15:43:07.361502+0000","last_clean":"2024-04-25T15:43:07.361502+0000","last_became_active":"2024-04-25T15:43:05.334737+0000","last_became_peered":"2024-04-25T15:43:05.334737+0000","last_unstale":"2024-04-25T15:43:07.361502+0000","last_undegraded":"2024-04-25T15:43:07.361502+0000","last_fullsized":"2024-04-25T15:43:07.361502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361707+0000","last_change":"2024-04-25T15:43:01.299152+0000","last_active":"2024-04-25T15:43:07.361707+0000","last_peered":"2024-04-25T15:43:07.361707+0000","last_clean":"2024-04-25T15:43:07.361707+0000","last_became_active":"2024-04-25T15:43:01.298809+0000","last_became_peered":"2024-04-25T15:43:01.298809+0000","last_unstale":"2024-04-25T15:43:07.361707+0000","last_undegraded":"2024-04-25T15:43:07.361707+0000","last_fullsized":"2024-04-25T15:43:07.361707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:50.837855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303629+0000","last_change":"2024-04-25T15:43:00.263841+0000","last_active":"2024-04-25T15:43:06.303629+0000","last_peered":"2024-04-25T15:43:06.303629+0000","last_clean":"2024-04-25T15:43:06.303629+0000","last_became_active":"2024-04-25T15:43:00.259513+0000","last_became_peered":"2024-04-25T15:43:00.259513+0000","last_unstale":"2024-04-25T15:43:06.303629+0000","last_undegraded":"2024-04-25T15:43:06.303629+0000","last_fullsized":"2024-04-25T15:43:06.303629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360219+0000","last_change":"2024-04-25T15:43:05.326603+0000","last_active":"2024-04-25T15:43:07.360219+0000","last_peered":"2024-04-25T15:43:07.360219+0000","last_clean":"2024-04-25T15:43:07.360219+0000","last_became_active":"2024-04-25T15:43:05.326181+0000","last_became_peered":"2024-04-25T15:43:05.326181+0000","last_unstale":"2024-04-25T15:43:07.360219+0000","last_undegraded":"2024-04-25T15:43:07.360219+0000","last_fullsized":"2024-04-25T15:43:07.360219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359858+0000","last_change":"2024-04-25T15:43:01.288148+0000","last_active":"2024-04-25T15:43:07.359858+0000","last_peered":"2024-04-25T15:43:07.359858+0000","last_clean":"2024-04-25T15:43:07.359858+0000","last_became_active":"2024-04-25T15:43:01.287837+0000","last_became_peered":"2024-04-25T15:43:01.287837+0000","last_unstale":"2024-04-25T15:43:07.359858+0000","last_undegraded":"2024-04-25T15:43:07.359858+0000","last_fullsized":"2024-04-25T15:43:07.359858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515397+0000","last_change":"2024-04-25T15:43:00.263967+0000","last_active":"2024-04-25T15:43:06.515397+0000","last_peered":"2024-04-25T15:43:06.515397+0000","last_clean":"2024-04-25T15:43:06.515397+0000","last_became_active":"2024-04-25T15:43:00.263603+0000","last_became_peered":"2024-04-25T15:43:00.263603+0000","last_unstale":"2024-04-25T15:43:06.515397+0000","last_undegraded":"2024-04-25T15:43:06.515397+0000","last_fullsized":"2024-04-25T15:43:06.515397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303747+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:43:06.303747+0000","last_peered":"2024-04-25T15:43:06.303747+0000","last_clean":"2024-04-25T15:43:06.303747+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:43:06.303747+0000","last_undegraded":"2024-04-25T15:43:06.303747+0000","last_fullsized":"2024-04-25T15:43:06.303747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173554+0000","last_change":"2024-04-25T15:43:05.325980+0000","last_active":"2024-04-25T15:43:07.173554+0000","last_peered":"2024-04-25T15:43:07.173554+0000","last_clean":"2024-04-25T15:43:07.173554+0000","last_became_active":"2024-04-25T15:43:05.325470+0000","last_became_peered":"2024-04-25T15:43:05.325470+0000","last_unstale":"2024-04-25T15:43:07.173554+0000","last_undegraded":"2024-04-25T15:43:07.173554+0000","last_fullsized":"2024-04-25T15:43:07.173554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304947+0000","last_change":"2024-04-25T15:43:01.291577+0000","last_active":"2024-04-25T15:43:06.304947+0000","last_peered":"2024-04-25T15:43:06.304947+0000","last_clean":"2024-04-25T15:43:06.304947+0000","last_became_active":"2024-04-25T15:43:01.290296+0000","last_became_peered":"2024-04-25T15:43:01.290296+0000","last_unstale":"2024-04-25T15:43:06.304947+0000","last_undegraded":"2024-04-25T15:43:06.304947+0000","last_fullsized":"2024-04-25T15:43:06.304947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:04.182446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305178+0000","last_change":"2024-04-25T15:43:00.263762+0000","last_active":"2024-04-25T15:43:06.305178+0000","last_peered":"2024-04-25T15:43:06.305178+0000","last_clean":"2024-04-25T15:43:06.305178+0000","last_became_active":"2024-04-25T15:43:00.263444+0000","last_became_peered":"2024-04-25T15:43:00.263444+0000","last_unstale":"2024-04-25T15:43:06.305178+0000","last_undegraded":"2024-04-25T15:43:06.305178+0000","last_fullsized":"2024-04-25T15:43:06.305178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173159+0000","last_change":"2024-04-25T15:43:05.322505+0000","last_active":"2024-04-25T15:43:07.173159+0000","last_peered":"2024-04-25T15:43:07.173159+0000","last_clean":"2024-04-25T15:43:07.173159+0000","last_became_active":"2024-04-25T15:43:05.321587+0000","last_became_peered":"2024-04-25T15:43:05.321587+0000","last_unstale":"2024-04-25T15:43:07.173159+0000","last_undegraded":"2024-04-25T15:43:07.173159+0000","last_fullsized":"2024-04-25T15:43:07.173159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515673+0000","last_change":"2024-04-25T15:43:01.300693+0000","last_active":"2024-04-25T15:43:06.515673+0000","last_peered":"2024-04-25T15:43:06.515673+0000","last_clean":"2024-04-25T15:43:06.515673+0000","last_became_active":"2024-04-25T15:43:01.300378+0000","last_became_peered":"2024-04-25T15:43:01.300378+0000","last_unstale":"2024-04-25T15:43:06.515673+0000","last_undegraded":"2024-04-25T15:43:06.515673+0000","last_fullsized":"2024-04-25T15:43:06.515673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360192+0000","last_change":"2024-04-25T15:43:00.267797+0000","last_active":"2024-04-25T15:43:07.360192+0000","last_peered":"2024-04-25T15:43:07.360192+0000","last_clean":"2024-04-25T15:43:07.360192+0000","last_became_active":"2024-04-25T15:43:00.267467+0000","last_became_peered":"2024-04-25T15:43:00.267467+0000","last_unstale":"2024-04-25T15:43:07.360192+0000","last_undegraded":"2024-04-25T15:43:07.360192+0000","last_fullsized":"2024-04-25T15:43:07.360192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360732+0000","last_change":"2024-04-25T15:43:05.325019+0000","last_active":"2024-04-25T15:43:07.360732+0000","last_peered":"2024-04-25T15:43:07.360732+0000","last_clean":"2024-04-25T15:43:07.360732+0000","last_became_active":"2024-04-25T15:43:05.324242+0000","last_became_peered":"2024-04-25T15:43:05.324242+0000","last_unstale":"2024-04-25T15:43:07.360732+0000","last_undegraded":"2024-04-25T15:43:07.360732+0000","last_fullsized":"2024-04-25T15:43:07.360732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305633+0000","last_change":"2024-04-25T15:43:01.295638+0000","last_active":"2024-04-25T15:43:06.305633+0000","last_peered":"2024-04-25T15:43:06.305633+0000","last_clean":"2024-04-25T15:43:06.305633+0000","last_became_active":"2024-04-25T15:43:01.295339+0000","last_became_peered":"2024-04-25T15:43:01.295339+0000","last_unstale":"2024-04-25T15:43:06.305633+0000","last_undegraded":"2024-04-25T15:43:06.305633+0000","last_fullsized":"2024-04-25T15:43:06.305633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:19.579163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305341+0000","last_change":"2024-04-25T15:43:00.267600+0000","last_active":"2024-04-25T15:43:06.305341+0000","last_peered":"2024-04-25T15:43:06.305341+0000","last_clean":"2024-04-25T15:43:06.305341+0000","last_became_active":"2024-04-25T15:43:00.267267+0000","last_became_peered":"2024-04-25T15:43:00.267267+0000","last_unstale":"2024-04-25T15:43:06.305341+0000","last_undegraded":"2024-04-25T15:43:06.305341+0000","last_fullsized":"2024-04-25T15:43:06.305341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515040+0000","last_change":"2024-04-25T15:43:05.320492+0000","last_active":"2024-04-25T15:43:06.515040+0000","last_peered":"2024-04-25T15:43:06.515040+0000","last_clean":"2024-04-25T15:43:06.515040+0000","last_became_active":"2024-04-25T15:43:05.319988+0000","last_became_peered":"2024-04-25T15:43:05.319988+0000","last_unstale":"2024-04-25T15:43:06.515040+0000","last_undegraded":"2024-04-25T15:43:06.515040+0000","last_fullsized":"2024-04-25T15:43:06.515040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:23.622692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305282+0000","last_change":"2024-04-25T15:43:01.298673+0000","last_active":"2024-04-25T15:43:06.305282+0000","last_peered":"2024-04-25T15:43:06.305282+0000","last_clean":"2024-04-25T15:43:06.305282+0000","last_became_active":"2024-04-25T15:43:01.296072+0000","last_became_peered":"2024-04-25T15:43:01.296072+0000","last_unstale":"2024-04-25T15:43:06.305282+0000","last_undegraded":"2024-04-25T15:43:06.305282+0000","last_fullsized":"2024-04-25T15:43:06.305282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304317+0000","last_change":"2024-04-25T15:43:00.265700+0000","last_active":"2024-04-25T15:43:06.304317+0000","last_peered":"2024-04-25T15:43:06.304317+0000","last_clean":"2024-04-25T15:43:06.304317+0000","last_became_active":"2024-04-25T15:43:00.265341+0000","last_became_peered":"2024-04-25T15:43:00.265341+0000","last_unstale":"2024-04-25T15:43:06.304317+0000","last_undegraded":"2024-04-25T15:43:06.304317+0000","last_fullsized":"2024-04-25T15:43:06.304317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304762+0000","last_change":"2024-04-25T15:43:05.325994+0000","last_active":"2024-04-25T15:43:06.304762+0000","last_peered":"2024-04-25T15:43:06.304762+0000","last_clean":"2024-04-25T15:43:06.304762+0000","last_became_active":"2024-04-25T15:43:05.325552+0000","last_became_peered":"2024-04-25T15:43:05.325552+0000","last_unstale":"2024-04-25T15:43:06.304762+0000","last_undegraded":"2024-04-25T15:43:06.304762+0000","last_fullsized":"2024-04-25T15:43:06.304762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:17.249622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303941+0000","last_change":"2024-04-25T15:43:01.297032+0000","last_active":"2024-04-25T15:43:06.303941+0000","last_peered":"2024-04-25T15:43:06.303941+0000","last_clean":"2024-04-25T15:43:06.303941+0000","last_became_active":"2024-04-25T15:43:01.296701+0000","last_became_peered":"2024-04-25T15:43:01.296701+0000","last_unstale":"2024-04-25T15:43:06.303941+0000","last_undegraded":"2024-04-25T15:43:06.303941+0000","last_fullsized":"2024-04-25T15:43:06.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304781+0000","last_change":"2024-04-25T15:43:00.265707+0000","last_active":"2024-04-25T15:43:06.304781+0000","last_peered":"2024-04-25T15:43:06.304781+0000","last_clean":"2024-04-25T15:43:06.304781+0000","last_became_active":"2024-04-25T15:43:00.265407+0000","last_became_peered":"2024-04-25T15:43:00.265407+0000","last_unstale":"2024-04-25T15:43:06.304781+0000","last_undegraded":"2024-04-25T15:43:06.304781+0000","last_fullsized":"2024-04-25T15:43:06.304781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360050+0000","last_change":"2024-04-25T15:43:05.320474+0000","last_active":"2024-04-25T15:43:07.360050+0000","last_peered":"2024-04-25T15:43:07.360050+0000","last_clean":"2024-04-25T15:43:07.360050+0000","last_became_active":"2024-04-25T15:43:05.320017+0000","last_became_peered":"2024-04-25T15:43:05.320017+0000","last_unstale":"2024-04-25T15:43:07.360050+0000","last_undegraded":"2024-04-25T15:43:07.360050+0000","last_fullsized":"2024-04-25T15:43:07.360050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173085+0000","last_change":"2024-04-25T15:43:01.294565+0000","last_active":"2024-04-25T15:43:07.173085+0000","last_peered":"2024-04-25T15:43:07.173085+0000","last_clean":"2024-04-25T15:43:07.173085+0000","last_became_active":"2024-04-25T15:43:01.294244+0000","last_became_peered":"2024-04-25T15:43:01.294244+0000","last_unstale":"2024-04-25T15:43:07.173085+0000","last_undegraded":"2024-04-25T15:43:07.173085+0000","last_fullsized":"2024-04-25T15:43:07.173085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173164+0000","last_change":"2024-04-25T15:43:00.266625+0000","last_active":"2024-04-25T15:43:07.173164+0000","last_peered":"2024-04-25T15:43:07.173164+0000","last_clean":"2024-04-25T15:43:07.173164+0000","last_became_active":"2024-04-25T15:43:00.266059+0000","last_became_peered":"2024-04-25T15:43:00.266059+0000","last_unstale":"2024-04-25T15:43:07.173164+0000","last_undegraded":"2024-04-25T15:43:07.173164+0000","last_fullsized":"2024-04-25T15:43:07.173164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361118+0000","last_change":"2024-04-25T15:43:05.327896+0000","last_active":"2024-04-25T15:43:07.361118+0000","last_peered":"2024-04-25T15:43:07.361118+0000","last_clean":"2024-04-25T15:43:07.361118+0000","last_became_active":"2024-04-25T15:43:05.327450+0000","last_became_peered":"2024-04-25T15:43:05.327450+0000","last_unstale":"2024-04-25T15:43:07.361118+0000","last_undegraded":"2024-04-25T15:43:07.361118+0000","last_fullsized":"2024-04-25T15:43:07.361118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:05.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304793+0000","last_change":"2024-04-25T15:43:01.298299+0000","last_active":"2024-04-25T15:43:06.304793+0000","last_peered":"2024-04-25T15:43:06.304793+0000","last_clean":"2024-04-25T15:43:06.304793+0000","last_became_active":"2024-04-25T15:43:01.295916+0000","last_became_peered":"2024-04-25T15:43:01.295916+0000","last_unstale":"2024-04-25T15:43:06.304793+0000","last_undegraded":"2024-04-25T15:43:06.304793+0000","last_fullsized":"2024-04-25T15:43:06.304793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515439+0000","last_change":"2024-04-25T15:43:00.271764+0000","last_active":"2024-04-25T15:43:06.515439+0000","last_peered":"2024-04-25T15:43:06.515439+0000","last_clean":"2024-04-25T15:43:06.515439+0000","last_became_active":"2024-04-25T15:43:00.271471+0000","last_became_peered":"2024-04-25T15:43:00.271471+0000","last_unstale":"2024-04-25T15:43:06.515439+0000","last_undegraded":"2024-04-25T15:43:06.515439+0000","last_fullsized":"2024-04-25T15:43:06.515439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362023+0000","last_change":"2024-04-25T15:43:05.324240+0000","last_active":"2024-04-25T15:43:07.362023+0000","last_peered":"2024-04-25T15:43:07.362023+0000","last_clean":"2024-04-25T15:43:07.362023+0000","last_became_active":"2024-04-25T15:43:05.323806+0000","last_became_peered":"2024-04-25T15:43:05.323806+0000","last_unstale":"2024-04-25T15:43:07.362023+0000","last_undegraded":"2024-04-25T15:43:07.362023+0000","last_fullsized":"2024-04-25T15:43:07.362023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:04.722313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360889+0000","last_change":"2024-04-25T15:43:01.294356+0000","last_active":"2024-04-25T15:43:07.360889+0000","last_peered":"2024-04-25T15:43:07.360889+0000","last_clean":"2024-04-25T15:43:07.360889+0000","last_became_active":"2024-04-25T15:43:01.294033+0000","last_became_peered":"2024-04-25T15:43:01.294033+0000","last_unstale":"2024-04-25T15:43:07.360889+0000","last_undegraded":"2024-04-25T15:43:07.360889+0000","last_fullsized":"2024-04-25T15:43:07.360889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360783+0000","last_change":"2024-04-25T15:43:00.261060+0000","last_active":"2024-04-25T15:43:07.360783+0000","last_peered":"2024-04-25T15:43:07.360783+0000","last_clean":"2024-04-25T15:43:07.360783+0000","last_became_active":"2024-04-25T15:43:00.258388+0000","last_became_peered":"2024-04-25T15:43:00.258388+0000","last_unstale":"2024-04-25T15:43:07.360783+0000","last_undegraded":"2024-04-25T15:43:07.360783+0000","last_fullsized":"2024-04-25T15:43:07.360783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515749+0000","last_change":"2024-04-25T15:43:05.325879+0000","last_active":"2024-04-25T15:43:06.515749+0000","last_peered":"2024-04-25T15:43:06.515749+0000","last_clean":"2024-04-25T15:43:06.515749+0000","last_became_active":"2024-04-25T15:43:05.325457+0000","last_became_peered":"2024-04-25T15:43:05.325457+0000","last_unstale":"2024-04-25T15:43:06.515749+0000","last_undegraded":"2024-04-25T15:43:06.515749+0000","last_fullsized":"2024-04-25T15:43:06.515749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304575+0000","last_change":"2024-04-25T15:43:01.281220+0000","last_active":"2024-04-25T15:43:06.304575+0000","last_peered":"2024-04-25T15:43:06.304575+0000","last_clean":"2024-04-25T15:43:06.304575+0000","last_became_active":"2024-04-25T15:43:01.280690+0000","last_became_peered":"2024-04-25T15:43:01.280690+0000","last_unstale":"2024-04-25T15:43:06.304575+0000","last_undegraded":"2024-04-25T15:43:06.304575+0000","last_fullsized":"2024-04-25T15:43:06.304575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:10.678852+0000","last_change":"2024-04-25T15:43:00.275195+0000","last_active":"2024-04-25T15:43:10.678852+0000","last_peered":"2024-04-25T15:43:10.678852+0000","last_clean":"2024-04-25T15:43:10.678852+0000","last_became_active":"2024-04-25T15:43:00.274890+0000","last_became_peered":"2024-04-25T15:43:00.274890+0000","last_unstale":"2024-04-25T15:43:10.678852+0000","last_undegraded":"2024-04-25T15:43:10.678852+0000","last_fullsized":"2024-04-25T15:43:10.678852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361677+0000","last_change":"2024-04-25T15:43:05.332218+0000","last_active":"2024-04-25T15:43:07.361677+0000","last_peered":"2024-04-25T15:43:07.361677+0000","last_clean":"2024-04-25T15:43:07.361677+0000","last_became_active":"2024-04-25T15:43:05.331327+0000","last_became_peered":"2024-04-25T15:43:05.331327+0000","last_unstale":"2024-04-25T15:43:07.361677+0000","last_undegraded":"2024-04-25T15:43:07.361677+0000","last_fullsized":"2024-04-25T15:43:07.361677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304852+0000","last_change":"2024-04-25T15:43:01.301873+0000","last_active":"2024-04-25T15:43:06.304852+0000","last_peered":"2024-04-25T15:43:06.304852+0000","last_clean":"2024-04-25T15:43:06.304852+0000","last_became_active":"2024-04-25T15:43:01.301515+0000","last_became_peered":"2024-04-25T15:43:01.301515+0000","last_unstale":"2024-04-25T15:43:06.304852+0000","last_undegraded":"2024-04-25T15:43:06.304852+0000","last_fullsized":"2024-04-25T15:43:06.304852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:56.239547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360072+0000","last_change":"2024-04-25T15:43:00.263472+0000","last_active":"2024-04-25T15:43:07.360072+0000","last_peered":"2024-04-25T15:43:07.360072+0000","last_clean":"2024-04-25T15:43:07.360072+0000","last_became_active":"2024-04-25T15:43:00.263063+0000","last_became_peered":"2024-04-25T15:43:00.263063+0000","last_unstale":"2024-04-25T15:43:07.360072+0000","last_undegraded":"2024-04-25T15:43:07.360072+0000","last_fullsized":"2024-04-25T15:43:07.360072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305069+0000","last_change":"2024-04-25T15:43:05.335662+0000","last_active":"2024-04-25T15:43:06.305069+0000","last_peered":"2024-04-25T15:43:06.305069+0000","last_clean":"2024-04-25T15:43:06.305069+0000","last_became_active":"2024-04-25T15:43:05.334883+0000","last_became_peered":"2024-04-25T15:43:05.334883+0000","last_unstale":"2024-04-25T15:43:06.305069+0000","last_undegraded":"2024-04-25T15:43:06.305069+0000","last_fullsized":"2024-04-25T15:43:06.305069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362170+0000","last_change":"2024-04-25T15:43:01.301400+0000","last_active":"2024-04-25T15:43:07.362170+0000","last_peered":"2024-04-25T15:43:07.362170+0000","last_clean":"2024-04-25T15:43:07.362170+0000","last_became_active":"2024-04-25T15:43:01.301067+0000","last_became_peered":"2024-04-25T15:43:01.301067+0000","last_unstale":"2024-04-25T15:43:07.362170+0000","last_undegraded":"2024-04-25T15:43:07.362170+0000","last_fullsized":"2024-04-25T15:43:07.362170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515580+0000","last_change":"2024-04-25T15:43:00.267119+0000","last_active":"2024-04-25T15:43:06.515580+0000","last_peered":"2024-04-25T15:43:06.515580+0000","last_clean":"2024-04-25T15:43:06.515580+0000","last_became_active":"2024-04-25T15:43:00.266760+0000","last_became_peered":"2024-04-25T15:43:00.266760+0000","last_unstale":"2024-04-25T15:43:06.515580+0000","last_undegraded":"2024-04-25T15:43:06.515580+0000","last_fullsized":"2024-04-25T15:43:06.515580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360595+0000","last_change":"2024-04-25T15:43:05.329155+0000","last_active":"2024-04-25T15:43:07.360595+0000","last_peered":"2024-04-25T15:43:07.360595+0000","last_clean":"2024-04-25T15:43:07.360595+0000","last_became_active":"2024-04-25T15:43:05.328650+0000","last_became_peered":"2024-04-25T15:43:05.328650+0000","last_unstale":"2024-04-25T15:43:07.360595+0000","last_undegraded":"2024-04-25T15:43:07.360595+0000","last_fullsized":"2024-04-25T15:43:07.360595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:14.129232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515527+0000","last_change":"2024-04-25T15:43:01.297332+0000","last_active":"2024-04-25T15:43:06.515527+0000","last_peered":"2024-04-25T15:43:06.515527+0000","last_clean":"2024-04-25T15:43:06.515527+0000","last_became_active":"2024-04-25T15:43:01.296726+0000","last_became_peered":"2024-04-25T15:43:01.296726+0000","last_unstale":"2024-04-25T15:43:06.515527+0000","last_undegraded":"2024-04-25T15:43:06.515527+0000","last_fullsized":"2024-04-25T15:43:06.515527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173728+0000","last_change":"2024-04-25T15:43:00.266633+0000","last_active":"2024-04-25T15:43:07.173728+0000","last_peered":"2024-04-25T15:43:07.173728+0000","last_clean":"2024-04-25T15:43:07.173728+0000","last_became_active":"2024-04-25T15:43:00.266221+0000","last_became_peered":"2024-04-25T15:43:00.266221+0000","last_unstale":"2024-04-25T15:43:07.173728+0000","last_undegraded":"2024-04-25T15:43:07.173728+0000","last_fullsized":"2024-04-25T15:43:07.173728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360149+0000","last_change":"2024-04-25T15:43:05.326763+0000","last_active":"2024-04-25T15:43:07.360149+0000","last_peered":"2024-04-25T15:43:07.360149+0000","last_clean":"2024-04-25T15:43:07.360149+0000","last_became_active":"2024-04-25T15:43:05.326387+0000","last_became_peered":"2024-04-25T15:43:05.326387+0000","last_unstale":"2024-04-25T15:43:07.360149+0000","last_undegraded":"2024-04-25T15:43:07.360149+0000","last_fullsized":"2024-04-25T15:43:07.360149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:43.920077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359880+0000","last_change":"2024-04-25T15:43:05.325423+0000","last_active":"2024-04-25T15:43:07.359880+0000","last_peered":"2024-04-25T15:43:07.359880+0000","last_clean":"2024-04-25T15:43:07.359880+0000","last_became_active":"2024-04-25T15:43:05.324948+0000","last_became_peered":"2024-04-25T15:43:05.324948+0000","last_unstale":"2024-04-25T15:43:07.359880+0000","last_undegraded":"2024-04-25T15:43:07.359880+0000","last_fullsized":"2024-04-25T15:43:07.359880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360431+0000","last_change":"2024-04-25T15:43:01.279748+0000","last_active":"2024-04-25T15:43:07.360431+0000","last_peered":"2024-04-25T15:43:07.360431+0000","last_clean":"2024-04-25T15:43:07.360431+0000","last_became_active":"2024-04-25T15:43:01.278850+0000","last_became_peered":"2024-04-25T15:43:01.278850+0000","last_unstale":"2024-04-25T15:43:07.360431+0000","last_undegraded":"2024-04-25T15:43:07.360431+0000","last_fullsized":"2024-04-25T15:43:07.360431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515195+0000","last_change":"2024-04-25T15:43:00.264122+0000","last_active":"2024-04-25T15:43:06.515195+0000","last_peered":"2024-04-25T15:43:06.515195+0000","last_clean":"2024-04-25T15:43:06.515195+0000","last_became_active":"2024-04-25T15:43:00.263813+0000","last_became_peered":"2024-04-25T15:43:00.263813+0000","last_unstale":"2024-04-25T15:43:06.515195+0000","last_undegraded":"2024-04-25T15:43:06.515195+0000","last_fullsized":"2024-04-25T15:43:06.515195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173731+0000","last_change":"2024-04-25T15:43:05.322215+0000","last_active":"2024-04-25T15:43:07.173731+0000","last_peered":"2024-04-25T15:43:07.173731+0000","last_clean":"2024-04-25T15:43:07.173731+0000","last_became_active":"2024-04-25T15:43:05.321735+0000","last_became_peered":"2024-04-25T15:43:05.321735+0000","last_unstale":"2024-04-25T15:43:07.173731+0000","last_undegraded":"2024-04-25T15:43:07.173731+0000","last_fullsized":"2024-04-25T15:43:07.173731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360649+0000","last_change":"2024-04-25T15:43:01.282374+0000","last_active":"2024-04-25T15:43:07.360649+0000","last_peered":"2024-04-25T15:43:07.360649+0000","last_clean":"2024-04-25T15:43:07.360649+0000","last_became_active":"2024-04-25T15:43:01.282048+0000","last_became_peered":"2024-04-25T15:43:01.282048+0000","last_unstale":"2024-04-25T15:43:07.360649+0000","last_undegraded":"2024-04-25T15:43:07.360649+0000","last_fullsized":"2024-04-25T15:43:07.360649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360467+0000","last_change":"2024-04-25T15:43:00.272805+0000","last_active":"2024-04-25T15:43:07.360467+0000","last_peered":"2024-04-25T15:43:07.360467+0000","last_clean":"2024-04-25T15:43:07.360467+0000","last_became_active":"2024-04-25T15:43:00.272566+0000","last_became_peered":"2024-04-25T15:43:00.272566+0000","last_unstale":"2024-04-25T15:43:07.360467+0000","last_undegraded":"2024-04-25T15:43:07.360467+0000","last_fullsized":"2024-04-25T15:43:07.360467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:29.718089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173285+0000","last_change":"2024-04-25T15:43:00.267609+0000","last_active":"2024-04-25T15:43:07.173285+0000","last_peered":"2024-04-25T15:43:07.173285+0000","last_clean":"2024-04-25T15:43:07.173285+0000","last_became_active":"2024-04-25T15:43:00.266867+0000","last_became_peered":"2024-04-25T15:43:00.266867+0000","last_unstale":"2024-04-25T15:43:07.173285+0000","last_undegraded":"2024-04-25T15:43:07.173285+0000","last_fullsized":"2024-04-25T15:43:07.173285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360778+0000","last_change":"2024-04-25T15:43:01.294246+0000","last_active":"2024-04-25T15:43:07.360778+0000","last_peered":"2024-04-25T15:43:07.360778+0000","last_clean":"2024-04-25T15:43:07.360778+0000","last_became_active":"2024-04-25T15:43:01.293930+0000","last_became_peered":"2024-04-25T15:43:01.293930+0000","last_unstale":"2024-04-25T15:43:07.360778+0000","last_undegraded":"2024-04-25T15:43:07.360778+0000","last_fullsized":"2024-04-25T15:43:07.360778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.321856+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.321309+0000","last_became_peered":"2024-04-25T15:43:05.321309+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:05.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361555+0000","last_change":"2024-04-25T15:43:00.273709+0000","last_active":"2024-04-25T15:43:07.361555+0000","last_peered":"2024-04-25T15:43:07.361555+0000","last_clean":"2024-04-25T15:43:07.361555+0000","last_became_active":"2024-04-25T15:43:00.273411+0000","last_became_peered":"2024-04-25T15:43:00.273411+0000","last_unstale":"2024-04-25T15:43:07.361555+0000","last_undegraded":"2024-04-25T15:43:07.361555+0000","last_fullsized":"2024-04-25T15:43:07.361555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.512229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304319+0000","last_change":"2024-04-25T15:43:01.290938+0000","last_active":"2024-04-25T15:43:06.304319+0000","last_peered":"2024-04-25T15:43:06.304319+0000","last_clean":"2024-04-25T15:43:06.304319+0000","last_became_active":"2024-04-25T15:43:01.290644+0000","last_became_peered":"2024-04-25T15:43:01.290644+0000","last_unstale":"2024-04-25T15:43:06.304319+0000","last_undegraded":"2024-04-25T15:43:06.304319+0000","last_fullsized":"2024-04-25T15:43:06.304319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:51.310158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360648+0000","last_change":"2024-04-25T15:43:05.325374+0000","last_active":"2024-04-25T15:43:07.360648+0000","last_peered":"2024-04-25T15:43:07.360648+0000","last_clean":"2024-04-25T15:43:07.360648+0000","last_became_active":"2024-04-25T15:43:05.324880+0000","last_became_peered":"2024-04-25T15:43:05.324880+0000","last_unstale":"2024-04-25T15:43:07.360648+0000","last_undegraded":"2024-04-25T15:43:07.360648+0000","last_fullsized":"2024-04-25T15:43:07.360648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:44.634102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.172990+0000","last_change":"2024-04-25T15:43:01.294802+0000","last_active":"2024-04-25T15:43:07.172990+0000","last_peered":"2024-04-25T15:43:07.172990+0000","last_clean":"2024-04-25T15:43:07.172990+0000","last_became_active":"2024-04-25T15:43:01.293680+0000","last_became_peered":"2024-04-25T15:43:01.293680+0000","last_unstale":"2024-04-25T15:43:07.172990+0000","last_undegraded":"2024-04-25T15:43:07.172990+0000","last_fullsized":"2024-04-25T15:43:07.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304824+0000","last_change":"2024-04-25T15:43:01.287546+0000","last_active":"2024-04-25T15:43:06.304824+0000","last_peered":"2024-04-25T15:43:06.304824+0000","last_clean":"2024-04-25T15:43:06.304824+0000","last_became_active":"2024-04-25T15:43:01.287193+0000","last_became_peered":"2024-04-25T15:43:01.287193+0000","last_unstale":"2024-04-25T15:43:06.304824+0000","last_undegraded":"2024-04-25T15:43:06.304824+0000","last_fullsized":"2024-04-25T15:43:06.304824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:58.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515392+0000","last_change":"2024-04-25T15:43:01.291635+0000","last_active":"2024-04-25T15:43:06.515392+0000","last_peered":"2024-04-25T15:43:06.515392+0000","last_clean":"2024-04-25T15:43:06.515392+0000","last_became_active":"2024-04-25T15:43:01.291222+0000","last_became_peered":"2024-04-25T15:43:01.291222+0000","last_unstale":"2024-04-25T15:43:06.515392+0000","last_undegraded":"2024-04-25T15:43:06.515392+0000","last_fullsized":"2024-04-25T15:43:06.515392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360670+0000","last_change":"2024-04-25T15:43:01.283764+0000","last_active":"2024-04-25T15:43:07.360670+0000","last_peered":"2024-04-25T15:43:07.360670+0000","last_clean":"2024-04-25T15:43:07.360670+0000","last_became_active":"2024-04-25T15:43:01.283409+0000","last_became_peered":"2024-04-25T15:43:01.283409+0000","last_unstale":"2024-04-25T15:43:07.360670+0000","last_undegraded":"2024-04-25T15:43:07.360670+0000","last_fullsized":"2024-04-25T15:43:07.360670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362184+0000","last_change":"2024-04-25T15:43:01.294089+0000","last_active":"2024-04-25T15:43:07.362184+0000","last_peered":"2024-04-25T15:43:07.362184+0000","last_clean":"2024-04-25T15:43:07.362184+0000","last_became_active":"2024-04-25T15:43:01.293753+0000","last_became_peered":"2024-04-25T15:43:01.293753+0000","last_unstale":"2024-04-25T15:43:07.362184+0000","last_undegraded":"2024-04-25T15:43:07.362184+0000","last_fullsized":"2024-04-25T15:43:07.362184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359861+0000","last_change":"2024-04-25T15:43:01.278680+0000","last_active":"2024-04-25T15:43:07.359861+0000","last_peered":"2024-04-25T15:43:07.359861+0000","last_clean":"2024-04-25T15:43:07.359861+0000","last_became_active":"2024-04-25T15:43:01.278347+0000","last_became_peered":"2024-04-25T15:43:01.278347+0000","last_unstale":"2024-04-25T15:43:07.359861+0000","last_undegraded":"2024-04-25T15:43:07.359861+0000","last_fullsized":"2024-04-25T15:43:07.359861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173725+0000","last_change":"2024-04-25T15:43:01.287386+0000","last_active":"2024-04-25T15:43:07.173725+0000","last_peered":"2024-04-25T15:43:07.173725+0000","last_clean":"2024-04-25T15:43:07.173725+0000","last_became_active":"2024-04-25T15:43:01.287049+0000","last_became_peered":"2024-04-25T15:43:01.287049+0000","last_unstale":"2024-04-25T15:43:07.173725+0000","last_undegraded":"2024-04-25T15:43:07.173725+0000","last_fullsized":"2024-04-25T15:43:07.173725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361171+0000","last_change":"2024-04-25T15:43:01.295000+0000","last_active":"2024-04-25T15:43:07.361171+0000","last_peered":"2024-04-25T15:43:07.361171+0000","last_clean":"2024-04-25T15:43:07.361171+0000","last_became_active":"2024-04-25T15:43:01.294605+0000","last_became_peered":"2024-04-25T15:43:01.294605+0000","last_unstale":"2024-04-25T15:43:07.361171+0000","last_undegraded":"2024-04-25T15:43:07.361171+0000","last_fullsized":"2024-04-25T15:43:07.361171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515111+0000","last_change":"2024-04-25T15:43:01.291742+0000","last_active":"2024-04-25T15:43:06.515111+0000","last_peered":"2024-04-25T15:43:06.515111+0000","last_clean":"2024-04-25T15:43:06.515111+0000","last_became_active":"2024-04-25T15:43:01.291354+0000","last_became_peered":"2024-04-25T15:43:01.291354+0000","last_unstale":"2024-04-25T15:43:06.515111+0000","last_undegraded":"2024-04-25T15:43:06.515111+0000","last_fullsized":"2024-04-25T15:43:06.515111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360284+0000","last_change":"2024-04-25T15:43:01.296211+0000","last_active":"2024-04-25T15:43:07.360284+0000","last_peered":"2024-04-25T15:43:07.360284+0000","last_clean":"2024-04-25T15:43:07.360284+0000","last_became_active":"2024-04-25T15:43:01.295195+0000","last_became_peered":"2024-04-25T15:43:01.295195+0000","last_unstale":"2024-04-25T15:43:07.360284+0000","last_undegraded":"2024-04-25T15:43:07.360284+0000","last_fullsized":"2024-04-25T15:43:07.360284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515314+0000","last_change":"2024-04-25T15:43:01.303436+0000","last_active":"2024-04-25T15:43:06.515314+0000","last_peered":"2024-04-25T15:43:06.515314+0000","last_clean":"2024-04-25T15:43:06.515314+0000","last_became_active":"2024-04-25T15:43:01.303068+0000","last_became_peered":"2024-04-25T15:43:01.303068+0000","last_unstale":"2024-04-25T15:43:06.515314+0000","last_undegraded":"2024-04-25T15:43:06.515314+0000","last_fullsized":"2024-04-25T15:43:06.515314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360519+0000","last_change":"2024-04-25T15:43:01.295585+0000","last_active":"2024-04-25T15:43:07.360519+0000","last_peered":"2024-04-25T15:43:07.360519+0000","last_clean":"2024-04-25T15:43:07.360519+0000","last_became_active":"2024-04-25T15:43:01.294821+0000","last_became_peered":"2024-04-25T15:43:01.294821+0000","last_unstale":"2024-04-25T15:43:07.360519+0000","last_undegraded":"2024-04-25T15:43:07.360519+0000","last_fullsized":"2024-04-25T15:43:07.360519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173483+0000","last_change":"2024-04-25T15:43:01.296022+0000","last_active":"2024-04-25T15:43:07.173483+0000","last_peered":"2024-04-25T15:43:07.173483+0000","last_clean":"2024-04-25T15:43:07.173483+0000","last_became_active":"2024-04-25T15:43:01.295477+0000","last_became_peered":"2024-04-25T15:43:01.295477+0000","last_unstale":"2024-04-25T15:43:07.173483+0000","last_undegraded":"2024-04-25T15:43:07.173483+0000","last_fullsized":"2024-04-25T15:43:07.173483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305121+0000","last_change":"2024-04-25T15:43:01.293363+0000","last_active":"2024-04-25T15:43:06.305121+0000","last_peered":"2024-04-25T15:43:06.305121+0000","last_clean":"2024-04-25T15:43:06.305121+0000","last_became_active":"2024-04-25T15:43:01.290509+0000","last_became_peered":"2024-04-25T15:43:01.290509+0000","last_unstale":"2024-04-25T15:43:06.305121+0000","last_undegraded":"2024-04-25T15:43:06.305121+0000","last_fullsized":"2024-04-25T15:43:06.305121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:44.264051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305240+0000","last_change":"2024-04-25T15:43:01.289526+0000","last_active":"2024-04-25T15:43:06.305240+0000","last_peered":"2024-04-25T15:43:06.305240+0000","last_clean":"2024-04-25T15:43:06.305240+0000","last_became_active":"2024-04-25T15:43:01.289019+0000","last_became_peered":"2024-04-25T15:43:01.289019+0000","last_unstale":"2024-04-25T15:43:06.305240+0000","last_undegraded":"2024-04-25T15:43:06.305240+0000","last_fullsized":"2024-04-25T15:43:06.305240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515937+0000","last_change":"2024-04-25T15:43:01.301402+0000","last_active":"2024-04-25T15:43:06.515937+0000","last_peered":"2024-04-25T15:43:06.515937+0000","last_clean":"2024-04-25T15:43:06.515937+0000","last_became_active":"2024-04-25T15:43:01.301026+0000","last_became_peered":"2024-04-25T15:43:01.301026+0000","last_unstale":"2024-04-25T15:43:06.515937+0000","last_undegraded":"2024-04-25T15:43:06.515937+0000","last_fullsized":"2024-04-25T15:43:06.515937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515052+0000","last_change":"2024-04-25T15:43:01.297919+0000","last_active":"2024-04-25T15:43:06.515052+0000","last_peered":"2024-04-25T15:43:06.515052+0000","last_clean":"2024-04-25T15:43:06.515052+0000","last_became_active":"2024-04-25T15:43:01.295658+0000","last_became_peered":"2024-04-25T15:43:01.295658+0000","last_unstale":"2024-04-25T15:43:06.515052+0000","last_undegraded":"2024-04-25T15:43:06.515052+0000","last_fullsized":"2024-04-25T15:43:06.515052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360534+0000","last_change":"2024-04-25T15:43:01.294743+0000","last_active":"2024-04-25T15:43:07.360534+0000","last_peered":"2024-04-25T15:43:07.360534+0000","last_clean":"2024-04-25T15:43:07.360534+0000","last_became_active":"2024-04-25T15:43:01.294420+0000","last_became_peered":"2024-04-25T15:43:01.294420+0000","last_unstale":"2024-04-25T15:43:07.360534+0000","last_undegraded":"2024-04-25T15:43:07.360534+0000","last_fullsized":"2024-04-25T15:43:07.360534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360776+0000","last_change":"2024-04-25T15:43:01.283558+0000","last_active":"2024-04-25T15:43:07.360776+0000","last_peered":"2024-04-25T15:43:07.360776+0000","last_clean":"2024-04-25T15:43:07.360776+0000","last_became_active":"2024-04-25T15:43:01.283203+0000","last_became_peered":"2024-04-25T15:43:01.283203+0000","last_unstale":"2024-04-25T15:43:07.360776+0000","last_undegraded":"2024-04-25T15:43:07.360776+0000","last_fullsized":"2024-04-25T15:43:07.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:01.569378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360283+0000","last_change":"2024-04-25T15:43:01.287196+0000","last_active":"2024-04-25T15:43:07.360283+0000","last_peered":"2024-04-25T15:43:07.360283+0000","last_clean":"2024-04-25T15:43:07.360283+0000","last_became_active":"2024-04-25T15:43:01.286881+0000","last_became_peered":"2024-04-25T15:43:01.286881+0000","last_unstale":"2024-04-25T15:43:07.360283+0000","last_undegraded":"2024-04-25T15:43:07.360283+0000","last_fullsized":"2024-04-25T15:43:07.360283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304665+0000","last_change":"2024-04-25T15:43:01.294284+0000","last_active":"2024-04-25T15:43:06.304665+0000","last_peered":"2024-04-25T15:43:06.304665+0000","last_clean":"2024-04-25T15:43:06.304665+0000","last_became_active":"2024-04-25T15:43:01.293046+0000","last_became_peered":"2024-04-25T15:43:01.293046+0000","last_unstale":"2024-04-25T15:43:06.304665+0000","last_undegraded":"2024-04-25T15:43:06.304665+0000","last_fullsized":"2024-04-25T15:43:06.304665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:43.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173401+0000","last_change":"2024-04-25T15:43:01.289095+0000","last_active":"2024-04-25T15:43:07.173401+0000","last_peered":"2024-04-25T15:43:07.173401+0000","last_clean":"2024-04-25T15:43:07.173401+0000","last_became_active":"2024-04-25T15:43:01.288193+0000","last_became_peered":"2024-04-25T15:43:01.288193+0000","last_unstale":"2024-04-25T15:43:07.173401+0000","last_undegraded":"2024-04-25T15:43:07.173401+0000","last_fullsized":"2024-04-25T15:43:07.173401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173606+0000","last_change":"2024-04-25T15:43:01.292901+0000","last_active":"2024-04-25T15:43:07.173606+0000","last_peered":"2024-04-25T15:43:07.173606+0000","last_clean":"2024-04-25T15:43:07.173606+0000","last_became_active":"2024-04-25T15:43:01.292459+0000","last_became_peered":"2024-04-25T15:43:01.292459+0000","last_unstale":"2024-04-25T15:43:07.173606+0000","last_undegraded":"2024-04-25T15:43:07.173606+0000","last_fullsized":"2024-04-25T15:43:07.173606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305631+0000","last_change":"2024-04-25T15:43:01.289823+0000","last_active":"2024-04-25T15:43:06.305631+0000","last_peered":"2024-04-25T15:43:06.305631+0000","last_clean":"2024-04-25T15:43:06.305631+0000","last_became_active":"2024-04-25T15:43:01.289511+0000","last_became_peered":"2024-04-25T15:43:01.289511+0000","last_unstale":"2024-04-25T15:43:06.305631+0000","last_undegraded":"2024-04-25T15:43:06.305631+0000","last_fullsized":"2024-04-25T15:43:06.305631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:23.025567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360402+0000","last_change":"2024-04-25T15:43:01.288077+0000","last_active":"2024-04-25T15:43:07.360402+0000","last_peered":"2024-04-25T15:43:07.360402+0000","last_clean":"2024-04-25T15:43:07.360402+0000","last_became_active":"2024-04-25T15:43:01.287776+0000","last_became_peered":"2024-04-25T15:43:01.287776+0000","last_unstale":"2024-04-25T15:43:07.360402+0000","last_undegraded":"2024-04-25T15:43:07.360402+0000","last_fullsized":"2024-04-25T15:43:07.360402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303801+0000","last_change":"2024-04-25T15:43:01.285211+0000","last_active":"2024-04-25T15:43:06.303801+0000","last_peered":"2024-04-25T15:43:06.303801+0000","last_clean":"2024-04-25T15:43:06.303801+0000","last_became_active":"2024-04-25T15:43:01.284874+0000","last_became_peered":"2024-04-25T15:43:01.284874+0000","last_unstale":"2024-04-25T15:43:06.303801+0000","last_undegraded":"2024-04-25T15:43:06.303801+0000","last_fullsized":"2024-04-25T15:43:06.303801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515218+0000","last_change":"2024-04-25T15:43:01.298601+0000","last_active":"2024-04-25T15:43:06.515218+0000","last_peered":"2024-04-25T15:43:06.515218+0000","last_clean":"2024-04-25T15:43:06.515218+0000","last_became_active":"2024-04-25T15:43:01.298301+0000","last_became_peered":"2024-04-25T15:43:01.298301+0000","last_unstale":"2024-04-25T15:43:06.515218+0000","last_undegraded":"2024-04-25T15:43:06.515218+0000","last_fullsized":"2024-04-25T15:43:06.515218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304229+0000","last_change":"2024-04-25T15:43:01.285864+0000","last_active":"2024-04-25T15:43:06.304229+0000","last_peered":"2024-04-25T15:43:06.304229+0000","last_clean":"2024-04-25T15:43:06.304229+0000","last_became_active":"2024-04-25T15:43:01.285575+0000","last_became_peered":"2024-04-25T15:43:01.285575+0000","last_unstale":"2024-04-25T15:43:06.304229+0000","last_undegraded":"2024-04-25T15:43:06.304229+0000","last_fullsized":"2024-04-25T15:43:06.304229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515349+0000","last_change":"2024-04-25T15:43:01.303192+0000","last_active":"2024-04-25T15:43:06.515349+0000","last_peered":"2024-04-25T15:43:06.515349+0000","last_clean":"2024-04-25T15:43:06.515349+0000","last_became_active":"2024-04-25T15:43:01.302882+0000","last_became_peered":"2024-04-25T15:43:01.302882+0000","last_unstale":"2024-04-25T15:43:06.515349+0000","last_undegraded":"2024-04-25T15:43:06.515349+0000","last_fullsized":"2024-04-25T15:43:06.515349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359780+0000","last_change":"2024-04-25T15:43:01.290113+0000","last_active":"2024-04-25T15:43:07.359780+0000","last_peered":"2024-04-25T15:43:07.359780+0000","last_clean":"2024-04-25T15:43:07.359780+0000","last_became_active":"2024-04-25T15:43:01.289784+0000","last_became_peered":"2024-04-25T15:43:01.289784+0000","last_unstale":"2024-04-25T15:43:07.359780+0000","last_undegraded":"2024-04-25T15:43:07.359780+0000","last_fullsized":"2024-04-25T15:43:07.359780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:58.293161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360941+0000","last_change":"2024-04-25T15:43:01.285205+0000","last_active":"2024-04-25T15:43:07.360941+0000","last_peered":"2024-04-25T15:43:07.360941+0000","last_clean":"2024-04-25T15:43:07.360941+0000","last_became_active":"2024-04-25T15:43:01.284834+0000","last_became_peered":"2024-04-25T15:43:01.284834+0000","last_unstale":"2024-04-25T15:43:07.360941+0000","last_undegraded":"2024-04-25T15:43:07.360941+0000","last_fullsized":"2024-04-25T15:43:07.360941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305525+0000","last_change":"2024-04-25T15:43:01.299431+0000","last_active":"2024-04-25T15:43:06.305525+0000","last_peered":"2024-04-25T15:43:06.305525+0000","last_clean":"2024-04-25T15:43:06.305525+0000","last_became_active":"2024-04-25T15:43:01.298478+0000","last_became_peered":"2024-04-25T15:43:01.298478+0000","last_unstale":"2024-04-25T15:43:06.305525+0000","last_undegraded":"2024-04-25T15:43:06.305525+0000","last_fullsized":"2024-04-25T15:43:06.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":103617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":103653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:43:24.726 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:43:24.727 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T15:43:24.727 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T15:43:24.727 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T15:43:24.727 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T15:43:24.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.868+0000 7ff9a38d8640 1 Processor -- start 2024-04-25T15:43:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.869+0000 7ff9a38d8640 1 -- start start 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a38d8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff99c071950 0x7ff99c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a38d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 0x7ff99c0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a38d8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c1624d0 con 0x7ff99c0b74c0 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a38d8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff99c072aa0 con 0x7ff99c071950 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a38d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff99c1627b0 con 0x7ff99c161c80 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a1e75640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff99c0b74c0 0x7ff99c0d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41750/0 (socket says 172.21.15.80:41750) 2024-04-25T15:43:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a1e75640 1 -- 172.21.15.80:0/3157246043 learned_addr learned my addr 172.21.15.80:0/3157246043 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a1674640 1 --2- 172.21.15.80:0/3157246043 >> v2:172.21.15.195:3300/0 conn(0x7ff99c071950 0x7ff99c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 0x7ff99c0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994178944 0 0) 0x7ff99c1624d0 con 0x7ff99c0b74c0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.870+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff988003520 con 0x7ff99c0b74c0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753185454 0 0) 0x7ff988003520 con 0x7ff99c0b74c0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 msgr2=0x7ff99c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 0x7ff99c0b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 >> v2:172.21.15.195:3300/0 conn(0x7ff99c071950 msgr2=0x7ff99c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 --2- 172.21.15.80:0/3157246043 >> v2:172.21.15.195:3300/0 conn(0x7ff99c071950 0x7ff99c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c162a90 con 0x7ff99c0b74c0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7ff994001670 con 0x7ff99c0b74c0 2024-04-25T15:43:24.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 >> v1:172.21.15.80:6789/0 conn(0x7ff99c0b74c0 legacy=0x7ff99c0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 0x7ff9880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff988003f30 0x7ff988004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988004d40 0x7ff988005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1627b0 con 0x7ff988003f30 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff98800ba70 con 0x7ff988004d40 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff98800bc40 con 0x7ff99c161c80 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff988003f30 0x7ff988004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a1674640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 0x7ff9880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a1e75640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988004d40 0x7ff988005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a0e73640 1 -- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 msgr2=0x7ff9880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c161c80 0x7ff9880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a0e73640 1 -- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988004d40 msgr2=0x7ff988005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988004d40 0x7ff988005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a0e73640 1 -- 172.21.15.80:0/3157246043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff988003520 con 0x7ff988003f30 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.871+0000 7ff9a1e75640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988004d40 0x7ff988005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.872+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff988003f30 0x7ff988004800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009ab0 tx=0x7ff988005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65567d930d4435af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.872+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c036070 con 0x7ff988003f30 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.872+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98c005990 con 0x7ff988003f30 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.872+0000 7ff993fff640 1 -- 172.21.15.80:0/3157246043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c009680 con 0x7ff988003f30 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a38d8640 1 -- 172.21.15.80:0/3157246043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff988003f30 msgr2=0x7ff988004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/3157246043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff988003f30 0x7ff988004800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009ab0 tx=0x7ff988005830 comp rx=0 tx=0).stop 2024-04-25T15:43:24.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a1e75640 1 -- 172.21.15.80:0/3157246043 reap_dead start 2024-04-25T15:43:24.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a38d8640 1 -- 172.21.15.80:0/3157246043 shutdown_connections 2024-04-25T15:43:24.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a38d8640 1 -- 172.21.15.80:0/3157246043 >> 172.21.15.80:0/3157246043 conn(0x7ff99c0d3ea0 msgr2=0x7ff99c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:24.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a38d8640 1 -- 172.21.15.80:0/3157246043 shutdown_connections 2024-04-25T15:43:24.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.873+0000 7ff9a38d8640 1 -- 172.21.15.80:0/3157246043 wait complete. 2024-04-25T15:43:24.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.874+0000 7ff9a38d8640 1 Processor -- start 2024-04-25T15:43:24.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.875+0000 7ff9a38d8640 1 -- start start 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988003f30 0x7ff99c160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 0x7ff99c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c0ccd30 0x7ff99c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c162210 con 0x7ff99c06d860 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c162090 con 0x7ff988003f30 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff99c0d31a0 con 0x7ff99c0ccd30 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 0x7ff99c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 0x7ff99c06dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43952/0 (socket says 172.21.15.80:43952) 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 -- 172.21.15.80:0/2750435801 learned_addr learned my addr 172.21.15.80:0/2750435801 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a1e75640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c0ccd30 0x7ff99c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a1674640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988003f30 0x7ff99c160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 -- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c0ccd30 msgr2=0x7ff99c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c0ccd30 0x7ff99c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 -- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988003f30 msgr2=0x7ff99c160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:24.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988003f30 0x7ff99c160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 -- 172.21.15.80:0/2750435801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c06e5e0 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a1674640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988003f30 0x7ff99c160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a0e73640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 0x7ff99c06dc70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009bd0 tx=0x7ff98c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c040020 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98c037040 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c0cd680 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.876+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c036030 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.877+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c1e7ed0 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.878+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c0b79b0 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.878+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff98c043020 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.879+0000 7ff991ffb640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9800744e0 0x7ff9800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.879+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff98c0b5810 con 0x7ff99c06d860 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.879+0000 7ff9a1674640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9800744e0 0x7ff9800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:24.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.879+0000 7ff9a1674640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9800744e0 0x7ff9800769f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0d15f0 tx=0x7ff99800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:24.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:24.883+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff99c0b79b0 con 0x7ff99c06d860 2024-04-25T15:43:25.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.112+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff99c0d2fc0 con 0x7ff99c06d860 2024-04-25T15:43:25.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.115+0000 7ff991ffb640 1 -- 172.21.15.80:0/2750435801 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186740 (secure 0 0 0) 0x7ff99c0d2fc0 con 0x7ff99c06d860 2024-04-25T15:43:25.119 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:25.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9800744e0 msgr2=0x7ff9800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9800744e0 0x7ff9800769f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0d15f0 tx=0x7ff99800b040 comp rx=0 tx=0).stop 2024-04-25T15:43:25.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 msgr2=0x7ff99c06dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 0x7ff99c06dc70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009bd0 tx=0x7ff98c004730 comp rx=0 tx=0).stop 2024-04-25T15:43:25.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 shutdown_connections 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9800744e0 0x7ff9800769f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff99c0ccd30 0x7ff99c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff99c06d860 0x7ff99c06dc70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 --2- 172.21.15.80:0/2750435801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff988003f30 0x7ff99c160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 >> 172.21.15.80:0/2750435801 conn(0x7ff99c0d3ea0 msgr2=0x7ff99c0b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 shutdown_connections 2024-04-25T15:43:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.118+0000 7ff9a38d8640 1 -- 172.21.15.80:0/2750435801 wait complete. 2024-04-25T15:43:25.131 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":824495164},{"type":"v1","addr":"172.21.15.80:6833","nonce":824495164}]},"active_addr":"172.21.15.80:6833/824495164","active_change":"2024-04-25T15:42:40.988031+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3271516749}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3437313891}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1394150105}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1950856951}]}]} 2024-04-25T15:43:25.137 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T15:43:25.137 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T15:43:25.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:25.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.243+0000 7f02604e2640 1 Processor -- start 2024-04-25T15:43:25.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.243+0000 7f02604e2640 1 -- start start 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.244+0000 7f02604e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02580d41b0 0x7f02580b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.244+0000 7f02604e2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f02580b7d60 0x7f02580d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.244+0000 7f02604e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0258163fb0 con 0x7f02581602a0 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.244+0000 7f02604e2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0258164270 con 0x7f02580b7d60 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.244+0000 7f02604e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0258164550 con 0x7f02580d41b0 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025da7d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f02581602a0 0x7f02580b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41754/0 (socket says 172.21.15.80:41754) 2024-04-25T15:43:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025da7d640 1 -- 172.21.15.80:0/1898730793 learned_addr learned my addr 172.21.15.80:0/1898730793 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025e27e640 1 --2- 172.21.15.80:0/1898730793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02580d41b0 0x7f02580b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025ea7f640 1 --2- 172.21.15.80:0/1898730793 >> v2:172.21.15.195:3300/0 conn(0x7f02580b7d60 0x7f02580d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025d27c640 1 -- 172.21.15.80:0/1898730793 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147571341 0 0) 0x7f0258163fb0 con 0x7f02581602a0 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025d27c640 1 -- 172.21.15.80:0/1898730793 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0244003520 con 0x7f02581602a0 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025e27e640 1 -- 172.21.15.80:0/1898730793 >> v2:172.21.15.195:3300/0 conn(0x7f02580b7d60 msgr2=0x7f02580d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025e27e640 1 --2- 172.21.15.80:0/1898730793 >> v2:172.21.15.195:3300/0 conn(0x7f02580b7d60 0x7f02580d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025d27c640 1 -- 172.21.15.80:0/1898730793 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3017547369 0 0) 0x7f0244003520 con 0x7f02581602a0 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025e27e640 1 -- 172.21.15.80:0/1898730793 >> v1:172.21.15.80:6789/0 conn(0x7f02581602a0 legacy=0x7f02580b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.245+0000 7f025e27e640 1 -- 172.21.15.80:0/1898730793 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0258164830 con 0x7f02580d41b0 2024-04-25T15:43:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.246+0000 7f025e27e640 1 --2- 172.21.15.80:0/1898730793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02580d41b0 0x7f02580b48d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02540097a0 tx=0x7f025402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3970b894490a16a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.246+0000 7f025d27c640 1 -- 172.21.15.80:0/1898730793 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254037070 con 0x7f02580d41b0 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.246+0000 7f025d27c640 1 -- 172.21.15.80:0/1898730793 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025402aba0 con 0x7f02580d41b0 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.246+0000 7f025d27c640 1 -- 172.21.15.80:0/1898730793 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248001670 con 0x7f02580d41b0 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 -- 172.21.15.80:0/1898730793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02580d41b0 msgr2=0x7f02580b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 --2- 172.21.15.80:0/1898730793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02580d41b0 0x7f02580b48d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02540097a0 tx=0x7f025402a110 comp rx=0 tx=0).stop 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 -- 172.21.15.80:0/1898730793 shutdown_connections 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 --2- 172.21.15.80:0/1898730793 >> v2:172.21.15.195:3300/0 conn(0x7f02580b7d60 0x7f02580d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 --2- 172.21.15.80:0/1898730793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02580d41b0 0x7f02580b48d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 -- 172.21.15.80:0/1898730793 >> 172.21.15.80:0/1898730793 conn(0x7f025806e9f0 msgr2=0x7f02580d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 -- 172.21.15.80:0/1898730793 shutdown_connections 2024-04-25T15:43:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.247+0000 7f02604e2640 1 -- 172.21.15.80:0/1898730793 wait complete. 2024-04-25T15:43:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.249+0000 7f02604e2640 1 Processor -- start 2024-04-25T15:43:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.249+0000 7f02604e2640 1 -- start start 2024-04-25T15:43:25.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f02604e2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02580d41b0 0x7f02580ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f02604e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02581602a0 0x7f025814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f02604e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 0x7f025814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f02604e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02580b5150 con 0x7f02580cd7c0 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f02604e2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f02580b4fd0 con 0x7f02580d41b0 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f02604e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02580b9220 con 0x7f02581602a0 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 0x7f025814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 0x7f025814fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43964/0 (socket says 172.21.15.80:43964) 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 -- 172.21.15.80:0/3950794154 learned_addr learned my addr 172.21.15.80:0/3950794154 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025da7d640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02581602a0 0x7f025814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025e27e640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02580d41b0 0x7f02580ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 -- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02581602a0 msgr2=0x7f025814f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02581602a0 0x7f025814f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 -- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02580d41b0 msgr2=0x7f02580ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02580d41b0 0x7f02580ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 -- 172.21.15.80:0/3950794154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02580cdfa0 con 0x7f02580cd7c0 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025e27e640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02580d41b0 0x7f02580ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025da7d640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02581602a0 0x7f025814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.250+0000 7f025ea7f640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 0x7f025814fe70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f025000efc0 tx=0x7f025000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.251+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250018020 con 0x7f02580cd7c0 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.251+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0250014480 con 0x7f02580cd7c0 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.251+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02580ce280 con 0x7f02580cd7c0 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.251+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250009e60 con 0x7f02580cd7c0 2024-04-25T15:43:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.251+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02580ce840 con 0x7f02580cd7c0 2024-04-25T15:43:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.252+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f025806a100 con 0x7f02580cd7c0 2024-04-25T15:43:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.252+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0250005d10 con 0x7f02580cd7c0 2024-04-25T15:43:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.253+0000 7f024effd640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f023c0744b0 0x7f023c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.253+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0250096220 con 0x7f02580cd7c0 2024-04-25T15:43:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.253+0000 7f025e27e640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f023c0744b0 0x7f023c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.253+0000 7f025e27e640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f023c0744b0 0x7f023c0769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f025402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:25.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.258+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0250022030 con 0x7f02580cd7c0 2024-04-25T15:43:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.438+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02580cd5a0 con 0x7f02580cd7c0 2024-04-25T15:43:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.439+0000 7f024effd640 1 -- 172.21.15.80:0/3950794154 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f0250010040 con 0x7f02580cd7c0 2024-04-25T15:43:25.441 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:25.441 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f023c0744b0 msgr2=0x7f023c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f023c0744b0 0x7f023c0769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f025402e000 comp rx=0 tx=0).stop 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 msgr2=0x7f025814fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 0x7f025814fe70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f025000efc0 tx=0x7f025000c490 comp rx=0 tx=0).stop 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 shutdown_connections 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f023c0744b0 0x7f023c0769c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02580cd7c0 0x7f025814fe70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02581602a0 0x7f025814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 --2- 172.21.15.80:0/3950794154 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02580d41b0 0x7f02580ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 >> 172.21.15.80:0/3950794154 conn(0x7f025806e9f0 msgr2=0x7f025815f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.441+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 shutdown_connections 2024-04-25T15:43:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.442+0000 7f02604e2640 1 -- 172.21.15.80:0/3950794154 wait complete. 2024-04-25T15:43:25.454 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T15:43:25.454 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.560+0000 7fe4e36f2640 1 Processor -- start 2024-04-25T15:43:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.560+0000 7fe4e36f2640 1 -- start start 2024-04-25T15:43:25.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.561+0000 7fe4e36f2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe4dc0d41b0 0x7fe4dc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.561+0000 7fe4e36f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc0b7d60 0x7fe4dc0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e36f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4dc163fb0 con 0x7fe4dc1602a0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e36f2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe4dc164270 con 0x7fe4dc0d41b0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e36f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4dc164550 con 0x7fe4dc0b7d60 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e0c8d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe4dc1602a0 0x7fe4dc0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41770/0 (socket says 172.21.15.80:41770) 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e0c8d640 1 -- 172.21.15.80:0/1012022577 learned_addr learned my addr 172.21.15.80:0/1012022577 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e148e640 1 --2- 172.21.15.80:0/1012022577 >> v2:172.21.15.195:3300/0 conn(0x7fe4dc0d41b0 0x7fe4dc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790516195 0 0) 0x7fe4dc163fb0 con 0x7fe4dc1602a0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e1c8f640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc0b7d60 0x7fe4dc0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4c8003520 con 0x7fe4dc1602a0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 975776958 0 0) 0x7fe4c8003520 con 0x7fe4dc1602a0 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc0b7d60 msgr2=0x7fe4dc0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc0b7d60 0x7fe4dc0d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 >> v2:172.21.15.195:3300/0 conn(0x7fe4dc0d41b0 msgr2=0x7fe4dc0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 --2- 172.21.15.80:0/1012022577 >> v2:172.21.15.195:3300/0 conn(0x7fe4dc0d41b0 0x7fe4dc0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc164830 con 0x7fe4dc1602a0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe4cc001670 con 0x7fe4dc1602a0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 >> v1:172.21.15.80:6789/0 conn(0x7fe4dc1602a0 legacy=0x7fe4dc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c80039b0 0x7fe4c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c8004340 0x7fe4c8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c8004ed0 0x7fe4c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc164270 con 0x7fe4c8004ed0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc164550 con 0x7fe4c8004340 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c800bf00 con 0x7fe4c80039b0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e1c8f640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c8004ed0 0x7fe4c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.562+0000 7fe4e0c8d640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c8004340 0x7fe4c8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e148e640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c80039b0 0x7fe4c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e1c8f640 1 -- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c80039b0 msgr2=0x7fe4c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e1c8f640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c80039b0 0x7fe4c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e1c8f640 1 -- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c8004340 msgr2=0x7fe4c8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e1c8f640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c8004340 0x7fe4c8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e1c8f640 1 -- 172.21.15.80:0/1012022577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c8003520 con 0x7fe4c8004ed0 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e0c8d640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c8004340 0x7fe4c8004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e148e640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c80039b0 0x7fe4c8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.563+0000 7fe4e1c8f640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c8004ed0 0x7fe4c800b9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fc0 tx=0x7fe4c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488233b51619e24b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4034020 con 0x7fe4c8004ed0 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d40305f0 con 0x7fe4c8004ed0 2024-04-25T15:43:25.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4d3fff640 1 -- 172.21.15.80:0/1012022577 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4009c10 con 0x7fe4c8004ed0 2024-04-25T15:43:25.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e36f2640 1 -- 172.21.15.80:0/1012022577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c8004ed0 msgr2=0x7fe4c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/1012022577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c8004ed0 0x7fe4c800b9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fc0 tx=0x7fe4c8005830 comp rx=0 tx=0).stop 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e1c8f640 1 -- 172.21.15.80:0/1012022577 reap_dead start 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e36f2640 1 -- 172.21.15.80:0/1012022577 shutdown_connections 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e36f2640 1 -- 172.21.15.80:0/1012022577 >> 172.21.15.80:0/1012022577 conn(0x7fe4dc06e9f0 msgr2=0x7fe4dc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e36f2640 1 -- 172.21.15.80:0/1012022577 shutdown_connections 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.564+0000 7fe4e36f2640 1 -- 172.21.15.80:0/1012022577 wait complete. 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.566+0000 7fe4e36f2640 1 Processor -- start 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.566+0000 7fe4e36f2640 1 -- start start 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.567+0000 7fe4e36f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 0x7fe4dc15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.567+0000 7fe4e36f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc1f6860 0x7fe4dc0d5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.567+0000 7fe4e36f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4dc0d5d90 0x7fe4dc1f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.567+0000 7fe4e36f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc0b5150 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.567+0000 7fe4e36f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc0b4fd0 con 0x7fe4dc0d5d90 2024-04-25T15:43:25.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.567+0000 7fe4e36f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4dc0b9220 con 0x7fe4dc1f6860 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 0x7fe4dc15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 0x7fe4dc15c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43980/0 (socket says 172.21.15.80:43980) 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 -- 172.21.15.80:0/2353463535 learned_addr learned my addr 172.21.15.80:0/2353463535 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e0c8d640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc1f6860 0x7fe4dc0d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e1c8f640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4dc0d5d90 0x7fe4dc1f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 -- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc1f6860 msgr2=0x7fe4dc0d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc1f6860 0x7fe4dc0d5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 -- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4dc0d5d90 msgr2=0x7fe4dc1f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4dc0d5d90 0x7fe4dc1f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 -- 172.21.15.80:0/2353463535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc0cd060 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e148e640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 0x7fe4dc15c260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80115d0 tx=0x7fe4d8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8015870 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d8015a10 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc0d61a0 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8015de0 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.568+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc1f7960 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.569+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4dc06a100 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.570+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe4d800f480 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.570+0000 7fe4d1ffb640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4c00744b0 0x7fe4c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.571+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe4d8095e30 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.571+0000 7fe4e0c8d640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4c00744b0 0x7fe4c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.571+0000 7fe4e0c8d640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4c00744b0 0x7fe4c00769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc000fb0 tx=0x7fe4cc001e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:25.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.575+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4dc0d61a0 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.750+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4dc0d3070 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.751+0000 7fe4d1ffb640 1 -- 172.21.15.80:0/2353463535 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fe4dc0cd060 con 0x7fe4dc0ccc50 2024-04-25T15:43:25.752 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:25.752 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:25.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4c00744b0 msgr2=0x7fe4c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4c00744b0 0x7fe4c00769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc000fb0 tx=0x7fe4cc001e70 comp rx=0 tx=0).stop 2024-04-25T15:43:25.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 msgr2=0x7fe4dc15c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 0x7fe4dc15c260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80115d0 tx=0x7fe4d8011a90 comp rx=0 tx=0).stop 2024-04-25T15:43:25.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 shutdown_connections 2024-04-25T15:43:25.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4c00744b0 0x7fe4c00769c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4dc0d5d90 0x7fe4dc1f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4dc1f6860 0x7fe4dc0d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 --2- 172.21.15.80:0/2353463535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc0ccc50 0x7fe4dc15c260 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 >> 172.21.15.80:0/2353463535 conn(0x7fe4dc06e9f0 msgr2=0x7fe4dc15cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:25.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 shutdown_connections 2024-04-25T15:43:25.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.753+0000 7fe4e36f2640 1 -- 172.21.15.80:0/2353463535 wait complete. 2024-04-25T15:43:25.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T15:43:25.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T15:43:25.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T15:43:25.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T15:43:25.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T15:43:25.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T15:43:25.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T15:43:25.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T15:43:25.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7f746a07e640 1 Processor -- start 2024-04-25T15:43:25.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7f746a07e640 1 -- start start 2024-04-25T15:43:25.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7f4550482640 1 Processor -- start 2024-04-25T15:43:25.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7f4550482640 1 -- start start 2024-04-25T15:43:25.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7f4cbad1f640 1 Processor -- start 2024-04-25T15:43:25.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f41496d2640 1 Processor -- start 2024-04-25T15:43:25.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7fd2c5add640 1 Processor -- start 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7fd2c5add640 1 -- start start 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2c5add640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd2b8006aa0 0x7fd2b80e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2c5add640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b80071d0 con 0x7fd2b80e09e0 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2c5add640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b80074b0 con 0x7fd2b80340c0 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2c5add640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b80344d0 con 0x7fd2b8006aa0 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2bffff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd2b8006aa0 0x7fd2b80e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2bffff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd2b8006aa0 0x7fd2b80e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50322/0 (socket says 172.21.15.80:50322) 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fd2bffff640 1 -- 172.21.15.80:0/1503434113 learned_addr learned my addr 172.21.15.80:0/1503434113 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.978+0000 7f4cbad1f640 1 -- start start 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cbad1f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4cac053e10 0x7f4cac0e3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cbad1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4cac033d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cb8abb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4cac053e10 0x7f4cac0e3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cb92bc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4cac055840 0x7f4cac0e0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41772/0 (socket says 172.21.15.80:41772) 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cb8abb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4cac053e10 0x7f4cac0e3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50300/0 (socket says 172.21.15.80:50300) 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f746a07e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f745c047db0 0x7f745c0e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f746a07e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c034060 0x7f745c0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f746a07e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745c006130 con 0x7f745c048300 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f746a07e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f745c04f690 con 0x7f745c047db0 2024-04-25T15:43:25.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f746a07e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f745c04ffa0 con 0x7f745c034060 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f746907c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f745c047db0 0x7f745c0e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f746907c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f745c047db0 0x7f745c0e7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43984/0 (socket says 172.21.15.80:43984) 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f746907c640 1 -- 172.21.15.80:0/1601483289 learned_addr learned my addr 172.21.15.80:0/1601483289 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.979+0000 7fc0fb302640 1 Processor -- start 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4550482640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45400e5150 0x7f45400e5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4550482640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4540006490 0x7f45400068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4550482640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4540051d90 con 0x7f454003a4b0 2024-04-25T15:43:25.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4550482640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f45400e5aa0 con 0x7f45400e5150 2024-04-25T15:43:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f454e21e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45400e5150 0x7f45400e5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f454e21e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45400e5150 0x7f45400e5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50312/0 (socket says 172.21.15.80:50312) 2024-04-25T15:43:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f454e21e640 1 -- 172.21.15.80:0/871675749 learned_addr learned my addr 172.21.15.80:0/871675749 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.979+0000 7f19cde27640 1 Processor -- start 2024-04-25T15:43:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4cac033d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4cac033d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50184/0 (socket says 172.21.15.80:50184) 2024-04-25T15:43:25.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4550482640 1 -- 172.21.15.80:0/871675749 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4540007200 con 0x7f4540006490 2024-04-25T15:43:25.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cb92bc640 1 -- 172.21.15.80:0/2534841867 learned_addr learned my addr 172.21.15.80:0/2534841867 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:25.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.979+0000 7fc0fb302640 1 -- start start 2024-04-25T15:43:25.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac0342d0 con 0x7f4cac055840 2024-04-25T15:43:25.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4cac0e3880 con 0x7f4cac053e10 2024-04-25T15:43:25.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4cac050490 con 0x7f4cac033980 2024-04-25T15:43:25.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fc0fb302640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc0ec047db0 0x7fc0ec0e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f746987d640 1 --2- 172.21.15.80:0/1601483289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c034060 0x7f745c0065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f746907c640 1 -- 172.21.15.80:0/1601483289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c034060 msgr2=0x7f745c0065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f746907c640 1 --2- 172.21.15.80:0/1601483289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c034060 0x7f745c0065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fc0fb302640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0ec048300 0x7fc0ec033950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fc0fb302640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec006130 con 0x7fc0ec033e90 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fc0fb302640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ec04f690 con 0x7fc0ec048300 2024-04-25T15:43:25.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.981+0000 7fc0fb302640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ec0342a0 con 0x7fc0ec047db0 2024-04-25T15:43:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f746907c640 1 -- 172.21.15.80:0/1601483289 >> v1:172.21.15.80:6789/0 conn(0x7f745c048300 legacy=0x7f745c033950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.979+0000 7f19cde27640 1 -- start start 2024-04-25T15:43:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19cde27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c8160520 0x7f19c80d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19cde27640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f19c80d12d0 0x7f19c80d5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19cde27640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19c80d61e0 0x7f19c80d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19cde27640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f19c80b9d90 con 0x7f19c80d12d0 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19cde27640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f19c8160930 con 0x7f19c80d61e0 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19cde27640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19c80d65f0 con 0x7f19c8160520 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454da1d640 1 --2- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4540006490 0x7f45400068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454d21c640 1 -- 172.21.15.80:0/871675749 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119281547 0 0) 0x7f4548050cb0 con 0x7f454003a4b0 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454d21c640 1 -- 172.21.15.80:0/871675749 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4534003520 con 0x7f454003a4b0 2024-04-25T15:43:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.979+0000 7f21e5750640 1 Processor -- start 2024-04-25T15:43:25.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7fc0f9aff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0ec048300 0x7fc0ec033950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7fc0f9aff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0ec048300 0x7fc0ec033950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43994/0 (socket says 172.21.15.80:43994) 2024-04-25T15:43:25.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7fc0f9aff640 1 -- 172.21.15.80:0/3360320098 learned_addr learned my addr 172.21.15.80:0/3360320098 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.979+0000 7f21e5750640 1 -- start start 2024-04-25T15:43:25.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21e5750640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f21e00cf560 0x7f21e00c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19c6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f19c80d12d0 0x7f19c80d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454e21e640 1 -- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4540006490 msgr2=0x7f45400068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454e21e640 1 --2- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4540006490 0x7f45400068a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454e21e640 1 -- 172.21.15.80:0/871675749 >> v1:172.21.15.80:6789/0 conn(0x7f454003a4b0 legacy=0x7f454003a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f454e21e640 1 -- 172.21.15.80:0/871675749 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45400074e0 con 0x7f45400e5150 2024-04-25T15:43:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21e5750640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e00c73a0 con 0x7f21e0159d20 2024-04-25T15:43:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.980+0000 7f41496d2640 1 -- start start 2024-04-25T15:43:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19c6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f19c80d12d0 0x7f19c80d5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43998/0 (socket says 172.21.15.80:43998) 2024-04-25T15:43:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19c6ffd640 1 -- 172.21.15.80:0/820646372 learned_addr learned my addr 172.21.15.80:0/820646372 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:25.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f41496d2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f413c048630 0x7f413c0ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:25.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f41496d2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413c050240 con 0x7f413c048100 2024-04-25T15:43:25.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f41496d2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413c050520 con 0x7f413c006aa0 2024-04-25T15:43:25.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f41496d2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f413c006580 con 0x7f413c048630 2024-04-25T15:43:25.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21e5750640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e006ccd0 con 0x7f21e00c8080 2024-04-25T15:43:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19c77fe640 1 --2- 172.21.15.80:0/820646372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c8160520 0x7f19c80d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21e5750640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f21e00cfcb0 con 0x7f21e00cf560 2024-04-25T15:43:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f19c7fff640 1 --2- 172.21.15.80:0/820646372 >> v2:172.21.15.195:3300/0 conn(0x7f19c80d61e0 0x7f19c80d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21dffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f21e0159d20 0x7f21e006c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41792/0 (socket says 172.21.15.80:41792) 2024-04-25T15:43:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21dffff640 1 -- 172.21.15.80:0/2370805927 learned_addr learned my addr 172.21.15.80:0/2370805927 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f21df7fe640 1 --2- 172.21.15.80:0/2370805927 >> v2:172.21.15.80:3300/0 conn(0x7f21e00cf560 0x7f21e00c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7fc0fa300640 1 --2- 172.21.15.80:0/3360320098 >> v2:172.21.15.195:3300/0 conn(0x7fc0ec047db0 0x7fc0ec0e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f19c6ffd640 1 -- 172.21.15.80:0/820646372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c8160520 msgr2=0x7f19c80d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f41437fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f413c048630 0x7f413c0ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:25.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f19c6ffd640 1 --2- 172.21.15.80:0/820646372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c8160520 0x7f19c80d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:25.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f41437fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f413c048630 0x7f413c0ebdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44014/0 (socket says 172.21.15.80:44014) 2024-04-25T15:43:25.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f19c6ffd640 1 -- 172.21.15.80:0/820646372 >> v2:172.21.15.195:3300/0 conn(0x7f19c80d61e0 msgr2=0x7f19c80d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7fd2bffff640 1 -- 172.21.15.80:0/1503434113 >> v1:172.21.15.195:6789/0 conn(0x7fd2b80340c0 legacy=0x7fd2b80dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:25.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7fd2bffff640 1 -- 172.21.15.80:0/1503434113 >> v1:172.21.15.80:6789/0 conn(0x7fd2b80e09e0 legacy=0x7fd2b804fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:25.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7fd2bffff640 1 -- 172.21.15.80:0/1503434113 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b8007790 con 0x7fd2b8006aa0 2024-04-25T15:43:25.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f746907c640 1 -- 172.21.15.80:0/1601483289 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c050280 con 0x7f745c047db0 2024-04-25T15:43:25.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321670659 0 0) 0x7f4ca8001110 con 0x7f4cac055840 2024-04-25T15:43:26.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.982+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca4005730 con 0x7f4cac055840 2024-04-25T15:43:26.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f21df7fe640 1 -- 172.21.15.80:0/2370805927 >> v1:172.21.15.195:6789/0 conn(0x7f21e00c8080 legacy=0x7f21e015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f21df7fe640 1 -- 172.21.15.80:0/2370805927 >> v1:172.21.15.80:6789/0 conn(0x7f21e0159d20 legacy=0x7f21e006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f41437fe640 1 -- 172.21.15.80:0/1598274481 learned_addr learned my addr 172.21.15.80:0/1598274481 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f454e21e640 1 --2- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f45400e5560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4538009870 tx=0x7f453802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1251bed0a0462e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 119747338 0 0) 0x7f4ca4005730 con 0x7f4cac055840 2024-04-25T15:43:26.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 msgr2=0x7f4cac033d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4cac033d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 >> v2:172.21.15.195:3300/0 conn(0x7f4cac053e10 msgr2=0x7f4cac0e3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 --2- 172.21.15.80:0/2534841867 >> v2:172.21.15.195:3300/0 conn(0x7f4cac053e10 0x7f4cac0e3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac0e3550 con 0x7f4cac055840 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f4ca8001840 con 0x7f4cac055840 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 >> v1:172.21.15.80:6789/0 conn(0x7f4cac055840 legacy=0x7f4cac0e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb37fe640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4ca4005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb37fe640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ca4006100 0x7f4ca4006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb37fe640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca4006f50 0x7f4ca4007360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7fc0f9aff640 1 -- 172.21.15.80:0/3360320098 >> v2:172.21.15.195:3300/0 conn(0x7fc0ec047db0 msgr2=0x7fc0ec0e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7fc0f9aff640 1 --2- 172.21.15.80:0/3360320098 >> v2:172.21.15.195:3300/0 conn(0x7fc0ec047db0 0x7fc0ec0e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7fc0f9aff640 1 -- 172.21.15.80:0/3360320098 >> v1:172.21.15.80:6789/0 conn(0x7fc0ec033e90 legacy=0x7fc0ec0531e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:43:26.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7fc0f9aff640 1 -- 172.21.15.80:0/3360320098 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec04ffa0 con 0x7fc0ec048300 2024-04-25T15:43:26.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f19c6ffd640 1 --2- 172.21.15.80:0/820646372 >> v2:172.21.15.195:3300/0 conn(0x7f19c80d61e0 0x7f19c80d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f19c6ffd640 1 -- 172.21.15.80:0/820646372 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c80d1ac0 con 0x7f19c80d12d0 2024-04-25T15:43:26.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f19c7fff640 1 --2- 172.21.15.80:0/820646372 >> v2:172.21.15.195:3300/0 conn(0x7f19c80d61e0 0x7f19c80d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:26.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f21df7fe640 1 -- 172.21.15.80:0/2370805927 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e00cff90 con 0x7f21e00cf560 2024-04-25T15:43:26.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7fd2bffff640 1 --2- 172.21.15.80:0/1503434113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b8006aa0 0x7fd2b80e04a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40091e0 tx=0x7fd2b402e750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49aedc19c72dfe0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0e3880 con 0x7f4ca4006100 2024-04-25T15:43:26.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac050490 con 0x7f4ca4006f50 2024-04-25T15:43:26.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca400bc10 con 0x7f4cac033980 2024-04-25T15:43:26.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4ca4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f454d21c640 1 -- 172.21.15.80:0/871675749 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538037070 con 0x7f45400e5150 2024-04-25T15:43:26.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f454d21c640 1 -- 172.21.15.80:0/871675749 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538032440 con 0x7f45400e5150 2024-04-25T15:43:26.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f454d21c640 1 -- 172.21.15.80:0/871675749 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538032830 con 0x7f45400e5150 2024-04-25T15:43:26.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f746907c640 1 --2- 172.21.15.80:0/1601483289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c047db0 0x7f745c0e7d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f745c00d9b0 tx=0x7f745402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6555ec764314afb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7fc0f9aff640 1 --2- 172.21.15.80:0/3360320098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec048300 0x7fc0ec033950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40520f0 tx=0x7fc0f40a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fa34a01744d656 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb3fff640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ca4006100 0x7f4ca4006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb92bc640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca4006f50 0x7f4ca4007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f19c6ffd640 1 --2- 172.21.15.80:0/820646372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c80d12d0 0x7f19c80d5ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19c808e7b0 tx=0x7f19c002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d460df9ef9c7da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7fd2bf7fe640 1 -- 172.21.15.80:0/1503434113 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b403a070 con 0x7fd2b8006aa0 2024-04-25T15:43:26.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f41437fe640 1 -- 172.21.15.80:0/1598274481 >> v1:172.21.15.195:6789/0 conn(0x7f413c006aa0 legacy=0x7f413c006eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7fd2bf7fe640 1 -- 172.21.15.80:0/1503434113 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b4033710 con 0x7fd2b8006aa0 2024-04-25T15:43:26.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7fd2bf7fe640 1 -- 172.21.15.80:0/1503434113 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4033ae0 con 0x7fd2b8006aa0 2024-04-25T15:43:26.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca4006f50 msgr2=0x7f4ca4007360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca4006f50 0x7f4ca4007360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2534841867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ca4006100 msgr2=0x7f4ca4006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ca4006100 0x7f4ca4006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2534841867 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca4005730 con 0x7f4cac033980 2024-04-25T15:43:26.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f41437fe640 1 -- 172.21.15.80:0/1598274481 >> v1:172.21.15.80:6789/0 conn(0x7f413c048100 legacy=0x7f413c0eb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.983+0000 7f41437fe640 1 -- 172.21.15.80:0/1598274481 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c0ec4b0 con 0x7f413c048630 2024-04-25T15:43:26.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7f21df7fe640 1 --2- 172.21.15.80:0/2370805927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e00c7b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21d400aba0 tx=0x7f21d402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1b74ecd6c87663 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.984+0000 7fc0f92fe640 1 -- 172.21.15.80:0/3360320098 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40b4070 con 0x7fc0ec048300 2024-04-25T15:43:26.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7fc0f92fe640 1 -- 172.21.15.80:0/3360320098 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f40a7c00 con 0x7fc0ec048300 2024-04-25T15:43:26.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f19c67fc640 1 -- 172.21.15.80:0/820646372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0036070 con 0x7f19c80d12d0 2024-04-25T15:43:26.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f21deffd640 1 -- 172.21.15.80:0/2370805927 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d400b040 con 0x7f21e00cf560 2024-04-25T15:43:26.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f19c67fc640 1 -- 172.21.15.80:0/820646372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c0031600 con 0x7f19c80d12d0 2024-04-25T15:43:26.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f745bfff640 1 -- 172.21.15.80:0/1601483289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454037070 con 0x7f745c047db0 2024-04-25T15:43:26.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 -- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 msgr2=0x7f45400e5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 --2- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f45400e5560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4538009870 tx=0x7f453802a290 comp rx=0 tx=0).stop 2024-04-25T15:43:26.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f745bfff640 1 -- 172.21.15.80:0/1601483289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454032440 con 0x7f745c047db0 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 -- 172.21.15.80:0/871675749 shutdown_connections 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 --2- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4540006490 0x7f45400068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 --2- 172.21.15.80:0/871675749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f45400e5560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 -- 172.21.15.80:0/871675749 >> 172.21.15.80:0/871675749 conn(0x7f454000aa70 msgr2=0x7f454000ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 -- 172.21.15.80:0/871675749 shutdown_connections 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f4550482640 1 -- 172.21.15.80:0/871675749 wait complete. 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f21deffd640 1 -- 172.21.15.80:0/2370805927 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d4032600 con 0x7f21e00cf560 2024-04-25T15:43:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7f21deffd640 1 -- 172.21.15.80:0/2370805927 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d40329d0 con 0x7f21e00cf560 2024-04-25T15:43:26.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f745bfff640 1 -- 172.21.15.80:0/1601483289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454032810 con 0x7f745c047db0 2024-04-25T15:43:26.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f41437fe640 1 --2- 172.21.15.80:0/1598274481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c048630 0x7f413c0ebdb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41440520f0 tx=0x7f41440a7090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b6c69ca679dfbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0f92fe640 1 -- 172.21.15.80:0/3360320098 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40af640 con 0x7fc0ec048300 2024-04-25T15:43:26.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0fb302640 1 -- 172.21.15.80:0/3360320098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec048300 msgr2=0x7fc0ec033950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0fb302640 1 --2- 172.21.15.80:0/3360320098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec048300 0x7fc0ec033950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40520f0 tx=0x7fc0f40a7040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f21e5750640 1 -- 172.21.15.80:0/2370805927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 msgr2=0x7f21e00c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f21e5750640 1 --2- 172.21.15.80:0/2370805927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e00c7b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21d400aba0 tx=0x7f21d402b7b0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7fd2c5add640 1 -- 172.21.15.80:0/1503434113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b8006aa0 msgr2=0x7fd2b80e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.985+0000 7fd2c5add640 1 --2- 172.21.15.80:0/1503434113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b8006aa0 0x7fd2b80e04a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40091e0 tx=0x7fd2b402e750 comp rx=0 tx=0).stop 2024-04-25T15:43:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4142ffd640 1 -- 172.21.15.80:0/1598274481 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440b4070 con 0x7f413c048630 2024-04-25T15:43:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19c67fc640 1 -- 172.21.15.80:0/820646372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c00319d0 con 0x7f19c80d12d0 2024-04-25T15:43:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 -- 172.21.15.80:0/820646372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c80d12d0 msgr2=0x7f19c80d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 --2- 172.21.15.80:0/820646372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c80d12d0 0x7f19c80d5ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19c808e7b0 tx=0x7f19c002a6a0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0fb302640 1 -- 172.21.15.80:0/3360320098 shutdown_connections 2024-04-25T15:43:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4142ffd640 1 -- 172.21.15.80:0/1598274481 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41440a7c50 con 0x7f413c048630 2024-04-25T15:43:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4ca4005bc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40514f0 tx=0x7f4ca4007a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb911e5e1a804278 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40b4070 con 0x7f4cac033980 2024-04-25T15:43:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4142ffd640 1 -- 172.21.15.80:0/1598274481 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440af640 con 0x7f413c048630 2024-04-25T15:43:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb40a7c00 con 0x7f4cac033980 2024-04-25T15:43:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f4cb37fe640 1 -- 172.21.15.80:0/2534841867 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4063ff0 con 0x7f4cac033980 2024-04-25T15:43:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0fb302640 1 --2- 172.21.15.80:0/3360320098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec048300 0x7fc0ec033950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0fb302640 1 --2- 172.21.15.80:0/3360320098 >> v2:172.21.15.195:3300/0 conn(0x7fc0ec047db0 0x7fc0ec0e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f746a07e640 1 -- 172.21.15.80:0/1601483289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c047db0 msgr2=0x7f745c0e7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f746a07e640 1 --2- 172.21.15.80:0/1601483289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c047db0 0x7f745c0e7d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f745c00d9b0 tx=0x7f745402a210 comp rx=0 tx=0).stop 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fc0fb302640 1 -- 172.21.15.80:0/3360320098 >> 172.21.15.80:0/3360320098 conn(0x7fc0ec054cf0 msgr2=0x7fc0ec055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 -- 172.21.15.80:0/820646372 shutdown_connections 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 --2- 172.21.15.80:0/820646372 >> v2:172.21.15.195:3300/0 conn(0x7f19c80d61e0 0x7f19c80d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 --2- 172.21.15.80:0/820646372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c80d12d0 0x7f19c80d5ca0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 --2- 172.21.15.80:0/820646372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c8160520 0x7f19c80d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f19cde27640 1 -- 172.21.15.80:0/820646372 >> 172.21.15.80:0/820646372 conn(0x7f19c806e610 msgr2=0x7f19c806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7fc0fb302640 1 -- 172.21.15.80:0/3360320098 shutdown_connections 2024-04-25T15:43:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7f21e5750640 1 -- 172.21.15.80:0/2370805927 shutdown_connections 2024-04-25T15:43:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f21e5750640 1 --2- 172.21.15.80:0/2370805927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e00c7b40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f21e5750640 1 -- 172.21.15.80:0/2370805927 >> 172.21.15.80:0/2370805927 conn(0x7f21e00d2320 msgr2=0x7f21e00ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f21e5750640 1 -- 172.21.15.80:0/2370805927 shutdown_connections 2024-04-25T15:43:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f21e5750640 1 -- 172.21.15.80:0/2370805927 wait complete. 2024-04-25T15:43:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f41496d2640 1 -- 172.21.15.80:0/1598274481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c048630 msgr2=0x7f413c0ebdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 msgr2=0x7f4ca4005bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f4cbad1f640 1 --2- 172.21.15.80:0/2534841867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac033980 0x7f4ca4005bc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40514f0 tx=0x7f4ca4007a40 comp rx=0 tx=0).stop 2024-04-25T15:43:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fd2c5add640 1 -- 172.21.15.80:0/1503434113 shutdown_connections 2024-04-25T15:43:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fd2c5add640 1 --2- 172.21.15.80:0/1503434113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b8006aa0 0x7fd2b80e04a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.986+0000 7fd2c5add640 1 -- 172.21.15.80:0/1503434113 >> 172.21.15.80:0/1503434113 conn(0x7fd2b8054cf0 msgr2=0x7fd2b8055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f4cb92bc640 1 -- 172.21.15.80:0/2534841867 reap_dead start 2024-04-25T15:43:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7fd2c5add640 1 -- 172.21.15.80:0/1503434113 shutdown_connections 2024-04-25T15:43:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7fd2c5add640 1 -- 172.21.15.80:0/1503434113 wait complete. 2024-04-25T15:43:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f19cde27640 1 -- 172.21.15.80:0/820646372 shutdown_connections 2024-04-25T15:43:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f19cde27640 1 -- 172.21.15.80:0/820646372 wait complete. 2024-04-25T15:43:26.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 shutdown_connections 2024-04-25T15:43:26.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 >> 172.21.15.80:0/2534841867 conn(0x7f4cac054d20 msgr2=0x7f4cac055130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7f41496d2640 1 --2- 172.21.15.80:0/1598274481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c048630 0x7f413c0ebdb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41440520f0 tx=0x7f41440a7090 comp rx=0 tx=0).stop 2024-04-25T15:43:26.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 shutdown_connections 2024-04-25T15:43:26.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f746a07e640 1 -- 172.21.15.80:0/1601483289 shutdown_connections 2024-04-25T15:43:26.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f746a07e640 1 --2- 172.21.15.80:0/1601483289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c034060 0x7f745c0065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f746a07e640 1 --2- 172.21.15.80:0/1601483289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c047db0 0x7f745c0e7d50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f746a07e640 1 -- 172.21.15.80:0/1601483289 >> 172.21.15.80:0/1601483289 conn(0x7f745c054cf0 msgr2=0x7f745c055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.987+0000 7fc0fb302640 1 -- 172.21.15.80:0/3360320098 wait complete. 2024-04-25T15:43:26.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f41496d2640 1 -- 172.21.15.80:0/1598274481 shutdown_connections 2024-04-25T15:43:26.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f41496d2640 1 --2- 172.21.15.80:0/1598274481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c048630 0x7f413c0ebdb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f41496d2640 1 -- 172.21.15.80:0/1598274481 >> 172.21.15.80:0/1598274481 conn(0x7f413c055140 msgr2=0x7f413c055550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f41496d2640 1 -- 172.21.15.80:0/1598274481 shutdown_connections 2024-04-25T15:43:26.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2534841867 wait complete. 2024-04-25T15:43:26.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f4550482640 1 Processor -- start 2024-04-25T15:43:26.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f41496d2640 1 -- 172.21.15.80:0/1598274481 wait complete. 2024-04-25T15:43:26.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.988+0000 7f4550482640 1 -- start start 2024-04-25T15:43:26.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.989+0000 7f746a07e640 1 -- 172.21.15.80:0/1601483289 shutdown_connections 2024-04-25T15:43:26.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.989+0000 7fd2c5add640 1 Processor -- start 2024-04-25T15:43:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7fc0fb302640 1 Processor -- start 2024-04-25T15:43:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7fd2c5add640 1 -- start start 2024-04-25T15:43:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.989+0000 7f746a07e640 1 -- 172.21.15.80:0/1601483289 wait complete. 2024-04-25T15:43:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.989+0000 7f21e5750640 1 Processor -- start 2024-04-25T15:43:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7f19cde27640 1 Processor -- start 2024-04-25T15:43:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7f21e5750640 1 -- start start 2024-04-25T15:43:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7f4cbad1f640 1 Processor -- start 2024-04-25T15:43:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4550482640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4540006490 0x7f454004b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4550482640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f454003a4b0 0x7f4540179830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f454e21e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4540006490 0x7f454004b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f454e21e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4540006490 0x7f454004b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44030/0 (socket says 172.21.15.80:44030) 2024-04-25T15:43:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4550482640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f4540049b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f41496d2640 1 Processor -- start 2024-04-25T15:43:26.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4550482640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f45400e4e30 con 0x7f4540006490 2024-04-25T15:43:26.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4550482640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4540007aa0 con 0x7f45400e5150 2024-04-25T15:43:26.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4550482640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4540006de0 con 0x7f454003a4b0 2024-04-25T15:43:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f454e21e640 1 -- 172.21.15.80:0/3568111241 learned_addr learned my addr 172.21.15.80:0/3568111241 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f454ea1f640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f4540049b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f454da1d640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f454003a4b0 0x7f4540179830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.991+0000 7f4cbad1f640 1 -- start start 2024-04-25T15:43:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f41496d2640 1 -- start start 2024-04-25T15:43:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7f19cde27640 1 -- start start 2024-04-25T15:43:26.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.990+0000 7fc0fb302640 1 -- start start 2024-04-25T15:43:26.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f21e5750640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21e00c8080 0x7f21e00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f21e5750640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f746a07e640 1 Processor -- start 2024-04-25T15:43:26.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f746a07e640 1 -- start start 2024-04-25T15:43:26.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f21dffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21e00c8080 0x7f21e00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fd2c5add640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2b8006aa0 0x7fd2b80dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f19cde27640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c80d12d0 0x7f19c8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f19cde27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c80d61e0 0x7f19c81f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fd2c5add640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80340c0 0x7fd2b8049090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fc0fb302640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec033e90 0x7fc0ec0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fc0fb302640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0ec047db0 0x7fc0ec0e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fc0fb302640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0ec048300 0x7fc0ec0cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fc0fb302640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec050840 con 0x7fc0ec033e90 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fc0fb302640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec050560 con 0x7fc0ec047db0 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7fc0fb302640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ec0509c0 con 0x7fc0ec048300 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fc0f9aff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0ec047db0 0x7fc0ec0e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19cde27640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c8160520 0x7f19c81fa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2c5add640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b80e09e0 0x7fd2b804d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fc0fa300640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec033e90 0x7fc0ec0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2c5add640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b800c450 con 0x7fd2b80340c0 2024-04-25T15:43:26.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2c5add640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b800c2d0 con 0x7fd2b80e09e0 2024-04-25T15:43:26.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2c5add640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b8050110 con 0x7fd2b8006aa0 2024-04-25T15:43:26.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19c6ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c80d61e0 0x7f19c81f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19c6ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c80d61e0 0x7f19c81f9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50248/0 (socket says 172.21.15.80:50248) 2024-04-25T15:43:26.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19c6ffd640 1 -- 172.21.15.80:0/3222032724 learned_addr learned my addr 172.21.15.80:0/3222032724 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80b9a20 con 0x7f19c8160520 2024-04-25T15:43:26.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2bffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80340c0 0x7fd2b8049090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2bffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80340c0 0x7fd2b8049090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44050/0 (socket says 172.21.15.80:44050) 2024-04-25T15:43:26.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80b9740 con 0x7f19c80d12d0 2024-04-25T15:43:26.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2bffff640 1 -- 172.21.15.80:0/3905708102 learned_addr learned my addr 172.21.15.80:0/3905708102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cbad1f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac033980 0x7f4cac0da180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19c80d56e0 con 0x7f19c80d61e0 2024-04-25T15:43:26.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454ea1f640 1 -- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f454003a4b0 msgr2=0x7f4540179830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454ea1f640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f454003a4b0 0x7f4540179830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454ea1f640 1 -- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4540006490 msgr2=0x7f454004b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cbad1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cac04cdc0 0x7f4cac04d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fc0fa300640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec033e90 0x7fc0ec0ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44046/0 (socket says 172.21.15.80:44046) 2024-04-25T15:43:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fc0fa300640 1 -- 172.21.15.80:0/2230158282 learned_addr learned my addr 172.21.15.80:0/2230158282 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44044/0 (socket says 172.21.15.80:44044) 2024-04-25T15:43:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.992+0000 7f21dffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21e00c8080 0x7f21e00b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50232/0 (socket says 172.21.15.80:50232) 2024-04-25T15:43:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f19c7fff640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c8160520 0x7f19c81fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fc0fab01640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0ec048300 0x7fc0ec0cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e5750640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21e0159d20 0x7f21e01e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454ea1f640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4540006490 0x7f454004b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454ea1f640 1 -- 172.21.15.80:0/3568111241 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454004a740 con 0x7f45400e5150 2024-04-25T15:43:26.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454e21e640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4540006490 0x7f454004b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:26.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e5750640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21e00c8490 con 0x7f21e00cf560 2024-04-25T15:43:26.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e5750640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f21e00c7620 con 0x7f21e0159d20 2024-04-25T15:43:26.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e5750640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f21e00cf970 con 0x7f21e00c8080 2024-04-25T15:43:26.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e4f4f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21e0159d20 0x7f21e01e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e4f4f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21e0159d20 0x7f21e01e64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50424/0 (socket says 172.21.15.80:50424) 2024-04-25T15:43:26.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f21e4f4f640 1 -- 172.21.15.80:0/2227193910 learned_addr learned my addr 172.21.15.80:0/2227193910 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f454ea1f640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f4540049b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f454806b8a0 tx=0x7f454806eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cb8abb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac033980 0x7f4cac0da180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cb8abb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac033980 0x7f4cac0da180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50406/0 (socket says 172.21.15.80:50406) 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cbad1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac0498b0 0x7f4cac049cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cbad1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0e4250 con 0x7f4cac04cdc0 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cbad1f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac050a10 con 0x7f4cac033980 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7f4cbad1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4cac050cf0 con 0x7f4cac0498b0 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2778660736 learned_addr learned my addr 172.21.15.80:0/2778660736 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454806ec50 con 0x7f45400e5150 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f19c6ffd640 1 -- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c80d12d0 msgr2=0x7f19c8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f19c6ffd640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c80d12d0 0x7f19c8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f19c6ffd640 1 -- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c8160520 msgr2=0x7f19c81fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f19c6ffd640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19c8160520 0x7f19c81fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f19c6ffd640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c8159140 con 0x7f19c80d61e0 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fc0f9aff640 1 -- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0ec048300 msgr2=0x7fc0ec0cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fc0f9aff640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0ec048300 0x7fc0ec0cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fc0f9aff640 1 -- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec033e90 msgr2=0x7fc0ec0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fc0f9aff640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ec033e90 0x7fc0ec0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fc0f9aff640 1 -- 172.21.15.80:0/2230158282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec0e3530 con 0x7fc0ec047db0 2024-04-25T15:43:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb92bc640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac0498b0 0x7f4cac049cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb3fff640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cac04cdc0 0x7f4cac04d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4550482640 1 -- 172.21.15.80:0/3568111241 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454004aa20 con 0x7f45400e5150 2024-04-25T15:43:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4550482640 1 -- 172.21.15.80:0/3568111241 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454004afe0 con 0x7f45400e5150 2024-04-25T15:43:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f19c6ffd640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c80d61e0 0x7f19c81f9e30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009f40 tx=0x7f19c0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2c52dc640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b80e09e0 0x7fd2b804d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.993+0000 7fd2c4adb640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2b8006aa0 0x7fd2b80dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fd2bffff640 1 -- 172.21.15.80:0/3905708102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2b8006aa0 msgr2=0x7fd2b80dbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fd2bffff640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2b8006aa0 0x7fd2b80dbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fd2bffff640 1 -- 172.21.15.80:0/3905708102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b80e09e0 msgr2=0x7fd2b804d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fd2bffff640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2b80e09e0 0x7fd2b804d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fd2bffff640 1 -- 172.21.15.80:0/3905708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b804b9e0 con 0x7fd2b80340c0 2024-04-25T15:43:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548090070 con 0x7f45400e5150 2024-04-25T15:43:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548069260 con 0x7f45400e5150 2024-04-25T15:43:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2778660736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac0498b0 msgr2=0x7f4cac049cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac0498b0 0x7f4cac049cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cac04cdc0 msgr2=0x7f4cac04d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fc0f9aff640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0ec047db0 0x7fc0ec0e2ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40519b0 tx=0x7fc0f40757c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f746a07e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f745c047db0 0x7f745c04eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f746a07e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c048300 0x7f745c0e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f746a07e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c04b320 0x7f745c0393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f746a07e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0509c0 con 0x7f745c04b320 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f746a07e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f745c050840 con 0x7f745c047db0 2024-04-25T15:43:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f746a07e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f745c006b20 con 0x7f745c048300 2024-04-25T15:43:26.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7fd2bffff640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80340c0 0x7fd2b8049090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40091e0 tx=0x7fd2b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cac04cdc0 0x7f4cac04d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f4cb8abb640 1 -- 172.21.15.80:0/2778660736 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac04a200 con 0x7f4cac033980 2024-04-25T15:43:26.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f21e4f4f640 1 -- 172.21.15.80:0/2227193910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21e00c8080 msgr2=0x7f21e00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f21e4f4f640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21e00c8080 0x7f21e00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f21e4f4f640 1 -- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 msgr2=0x7f21e015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f21e4f4f640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e00cf560 0x7f21e015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f21e4f4f640 1 -- 172.21.15.80:0/2227193910 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e015a260 con 0x7f21e0159d20 2024-04-25T15:43:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f4cb3fff640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cac04cdc0 0x7f4cac04d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f21e4f4f640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21e0159d20 0x7f21e01e64c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21d000c3f0 tx=0x7f21d000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746987d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c04b320 0x7f745c0393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746987d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c04b320 0x7f745c0393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44076/0 (socket says 172.21.15.80:44076) 2024-04-25T15:43:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746987d640 1 -- 172.21.15.80:0/2235905384 learned_addr learned my addr 172.21.15.80:0/2235905384 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40bc070 con 0x7fc0ec047db0 2024-04-25T15:43:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f41496d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c006aa0 0x7f413c17f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f41496d2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f413c048100 0x7f413c04b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f41496d2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f413c048630 0x7f413c048c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f41496d2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f413c050980 con 0x7f413c006aa0 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f41496d2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f413c050800 con 0x7f413c048630 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.994+0000 7f41496d2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f413c0075c0 con 0x7f413c048100 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746907c640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f745c047db0 0x7f745c04eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4049070 con 0x7fd2b80340c0 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0017070 con 0x7f21e0159d20 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00052d0 con 0x7f21e0159d20 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f21e5750640 1 -- 172.21.15.80:0/2227193910 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e015a540 con 0x7f21e0159d20 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f21e5750640 1 -- 172.21.15.80:0/2227193910 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e015ab00 con 0x7f21e0159d20 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c006aa0 0x7f413c17f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c006aa0 0x7f413c17f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44084/0 (socket says 172.21.15.80:44084) 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 -- 172.21.15.80:0/3309414403 learned_addr learned my addr 172.21.15.80:0/3309414403 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 -- 172.21.15.80:0/3309414403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f413c048100 msgr2=0x7f413c04b510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f413c048100 0x7f413c04b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 -- 172.21.15.80:0/3309414403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f413c048630 msgr2=0x7f413c048c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f413c048630 0x7f413c048c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f4143fff640 1 -- 172.21.15.80:0/3309414403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c0e6550 con 0x7f413c006aa0 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b40131e0 con 0x7fd2b80340c0 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fd2c5add640 1 -- 172.21.15.80:0/3905708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b816a0d0 con 0x7fd2b80340c0 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fd2c5add640 1 -- 172.21.15.80:0/3905708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b816a370 con 0x7fd2b80340c0 2024-04-25T15:43:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f4cb8abb640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac033980 0x7f4cac0da180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40512d0 tx=0x7f4cb406a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec0d06c0 con 0x7fc0ec047db0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ec0cf250 con 0x7fc0ec047db0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f40b8610 con 0x7fc0ec047db0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0041020 con 0x7f19c80d61e0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c815ac10 con 0x7f19c80d61e0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c815b1d0 con 0x7f19c80d61e0 2024-04-25T15:43:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c0008790 con 0x7f19c80d61e0 2024-04-25T15:43:26.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746887b640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c048300 0x7f745c0e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746907c640 1 -- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c048300 msgr2=0x7f745c0e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746907c640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f745c048300 0x7f745c0e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746907c640 1 -- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c04b320 msgr2=0x7f745c0393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746907c640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f745c04b320 0x7f745c0393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f746907c640 1 -- 172.21.15.80:0/2235905384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c049d80 con 0x7f745c047db0 2024-04-25T15:43:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7f746907c640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f745c047db0 0x7f745c04eb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f745c055c50 tx=0x7f74540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.995+0000 7f4550482640 1 -- 172.21.15.80:0/3568111241 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4530001030 con 0x7f45400e5150 2024-04-25T15:43:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0003810 con 0x7f21e0159d20 2024-04-25T15:43:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f4143fff640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c006aa0 0x7f413c17f640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f413800b3f0 tx=0x7f413800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138015020 con 0x7f413c006aa0 2024-04-25T15:43:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4138011830 con 0x7f413c006aa0 2024-04-25T15:43:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138011c00 con 0x7f413c006aa0 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40be020 con 0x7f4cac033980 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb40ba440 con 0x7f4cac033980 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40b4040 con 0x7f4cac033980 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac0da6c0 con 0x7f4cac033980 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac04c2e0 con 0x7f4cac033980 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454041070 con 0x7f745c047db0 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c04c9e0 con 0x7f745c047db0 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c04a560 con 0x7f745c047db0 2024-04-25T15:43:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745403c870 con 0x7f745c047db0 2024-04-25T15:43:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454037040 con 0x7f745c047db0 2024-04-25T15:43:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40b4040 con 0x7fc0ec047db0 2024-04-25T15:43:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0036040 con 0x7f19c80d61e0 2024-04-25T15:43:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19a8001030 con 0x7f19c80d61e0 2024-04-25T15:43:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f19c0044020 con 0x7f19c80d61e0 2024-04-25T15:43:26.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.996+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b403a040 con 0x7fd2b80340c0 2024-04-25T15:43:26.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc0f40bf070 con 0x7fc0ec047db0 2024-04-25T15:43:26.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.998+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd298001030 con 0x7fd2b80340c0 2024-04-25T15:43:26.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f21d001a070 con 0x7f21e0159d20 2024-04-25T15:43:26.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f454808c9a0 con 0x7f45400e5150 2024-04-25T15:43:26.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.997+0000 7f453effd640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f452c0744b0 0x7f452c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f19affff640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19b4074580 0x7f19b4076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c94001030 con 0x7f4cac033980 2024-04-25T15:43:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21c0001030 con 0x7f21e0159d20 2024-04-25T15:43:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f454e21e640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f452c0744b0 0x7f452c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7fc0eaffd640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0d80744b0 0x7fc0d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7fc0fa300640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0d80744b0 0x7fc0d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f21dcff9640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21cc0745b0 0x7f21cc076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc0f4132510 con 0x7fc0ec047db0 2024-04-25T15:43:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0dc001030 con 0x7fc0ec047db0 2024-04-25T15:43:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f21d0094700 con 0x7f21e0159d20 2024-04-25T15:43:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f21dcff9640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7f21cc07dd80 0x7f21cc080210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 --> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21d00052d0 con 0x7f21cc07dd80 2024-04-25T15:43:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21d009b050 con 0x7f21e0159d20 2024-04-25T15:43:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f41496d2640 1 -- 172.21.15.80:0/3309414403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c0e6830 con 0x7f413c006aa0 2024-04-25T15:43:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:25.999+0000 7f41496d2640 1 -- 172.21.15.80:0/3309414403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c04aff0 con 0x7f413c006aa0 2024-04-25T15:43:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f454e21e640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f452c0744b0 0x7f452c0769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f453802a2d0 tx=0x7f453802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4548111480 con 0x7f45400e5150 2024-04-25T15:43:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f453effd640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7f452c07dbf0 0x7f452c080080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 --> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f452c080750 con 0x7f452c07dbf0 2024-04-25T15:43:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4548118050 con 0x7f45400e5150 2024-04-25T15:43:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7454044070 con 0x7f745c047db0 2024-04-25T15:43:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f413c0059c0 con 0x7f413c006aa0 2024-04-25T15:43:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f19c00b61f0 con 0x7f19c80d61e0 2024-04-25T15:43:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f19c77fe640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19b4074580 0x7f19b4076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f19affff640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7f19b407dd50 0x7f19b40801e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19c0033ec0 con 0x7f19b407dd50 2024-04-25T15:43:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19c00bd050 con 0x7f19c80d61e0 2024-04-25T15:43:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f21df7fe640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7f21cc07dd80 0x7f21cc080210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f19c7fff640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7f19b407dd50 0x7f19b40801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f7459ffb640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74480745b0 0x7f7448076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7fc0eaffd640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fc0d807dbf0 0x7fc0d8080080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.000+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4cb40b83f0 con 0x7f4cac033980 2024-04-25T15:43:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 --> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0f40bce70 con 0x7fc0d807dbf0 2024-04-25T15:43:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc0f40c6020 con 0x7fc0ec047db0 2024-04-25T15:43:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd2b404c070 con 0x7fd2b80340c0 2024-04-25T15:43:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f21dffff640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21cc0745b0 0x7f21cc076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f21df7fe640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7f21cc07dd80 0x7f21cc080210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f74540b5e20 con 0x7f745c047db0 2024-04-25T15:43:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f4cb17fa640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c98074580 0x7f4c98076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4cb41318b0 con 0x7f4cac033980 2024-04-25T15:43:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f4cb17fa640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f4c9807dcc0 0x7f4c98080150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7fc0fab01640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fc0d807dbf0 0x7fc0d8080080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 --> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cb40abec0 con 0x7f4c9807dcc0 2024-04-25T15:43:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.001+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4cb40f7e00 con 0x7f4cac033980 2024-04-25T15:43:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f746a07e640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f7444001650 0x7f7444003b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f746887b640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74480745b0 0x7f7448076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 --> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7444006c00 con 0x7f7444001650 2024-04-25T15:43:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f19c7fff640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7f19b407dd50 0x7f19b40801e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f21dffff640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21cc0745b0 0x7f21cc076ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21d80012e0 tx=0x7f21d80061f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7fc0fa300640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0d80744b0 0x7fc0d80769c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0006fd0 tx=0x7fc0f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7fc0fab01640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fc0d807dbf0 0x7fc0d8080080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f19c77fe640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19b4074580 0x7f19b4076a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19b8006fd0 tx=0x7f19b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7fd2bd7fa640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2a4074580 0x7fd2a4076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd2b40bdb60 con 0x7fd2b80340c0 2024-04-25T15:43:26.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7fd2bd7fa640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7fd2a407dd40 0x7fd2a40801d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7fd2c4adb640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2a4074580 0x7fd2a4076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f454da1d640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7f452c07dbf0 0x7f452c080080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f746887b640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74480745b0 0x7f7448076ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f745c033910 tx=0x7f7460008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== osd.0 v2:172.21.15.80:6808/4108878667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21d00052d0 con 0x7f21cc07dd80 2024-04-25T15:43:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2b4033710 con 0x7fd2a407dd40 2024-04-25T15:43:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4cb92bc640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f4c9807dcc0 0x7f4c98080150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4cb3fff640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c98074580 0x7f4c98076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7fd2c52dc640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7fd2a407dd40 0x7fd2a40801d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f746987d640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f7444001650 0x7f7444003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== osd.7 v2:172.21.15.195:6816/1930343330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19c0033ec0 con 0x7f19b407dd50 2024-04-25T15:43:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.002+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4138018020 con 0x7f413c006aa0 2024-04-25T15:43:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2b40c22a0 con 0x7fd2b80340c0 2024-04-25T15:43:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7fd2c4adb640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2a4074580 0x7fd2a4076a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac000f60 tx=0x7fd2ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4cb92bc640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f4c9807dcc0 0x7f4c98080150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== osd.5 v2:172.21.15.195:6800/1786051066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0f40bce70 con 0x7fc0d807dbf0 2024-04-25T15:43:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7fd2c52dc640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7fd2a407dd40 0x7fd2a40801d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4cb3fff640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c98074580 0x7f4c98076a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000d440 tx=0x7f4ca0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4140ff9640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4128074580 0x7f4128076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4138095150 con 0x7f413c006aa0 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4140ff9640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f412807dd40 0x7f41280801d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 --> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f413800de50 con 0x7f412807dd40 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.003+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f413809c050 con 0x7f413c006aa0 2024-04-25T15:43:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.004+0000 7f41437fe640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4128074580 0x7f4128076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.004+0000 7f41437fe640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4128074580 0x7f4128076a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f413c0513b0 tx=0x7f41440ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.004+0000 7f454da1d640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7f452c07dbf0 0x7f452c080080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.004+0000 7f4148ed1640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f412807dd40 0x7f41280801d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.004+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== osd.3 v2:172.21.15.80:6809/3224498559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cb40abec0 con 0x7f4c9807dcc0 2024-04-25T15:43:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.005+0000 7f746987d640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f7444001650 0x7f7444003b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.005+0000 7f4148ed1640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f412807dd40 0x7f41280801d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.005+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== osd.6 v2:172.21.15.195:6824/3079831018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f452c080750 con 0x7f452c07dbf0 2024-04-25T15:43:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.005+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== osd.2 v2:172.21.15.80:6800/1881939009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2b4033710 con 0x7fd2a407dd40 2024-04-25T15:43:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.006+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== osd.1 v2:172.21.15.80:6824/70437144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f413800de50 con 0x7f412807dd40 2024-04-25T15:43:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.007+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== osd.4 v2:172.21.15.195:6808/2711684180 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7444006c00 con 0x7f7444001650 2024-04-25T15:43:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.032+0000 7f4550482640 1 -- 172.21.15.80:0/3568111241 --> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4530002dd0 con 0x7f452c07dbf0 2024-04-25T15:43:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.033+0000 7f453effd640 1 -- 172.21.15.80:0/3568111241 <== osd.6 v2:172.21.15.195:6824/3079831018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4530002dd0 con 0x7f452c07dbf0 2024-04-25T15:43:26.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 --> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21c0002dd0 con 0x7f21cc07dd80 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7f452c07dbf0 msgr2=0x7f452c080080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7f452c07dbf0 0x7f452c080080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f452c0744b0 msgr2=0x7f452c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f452c0744b0 0x7f452c0769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f453802a2d0 tx=0x7f453802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 msgr2=0x7f4540049b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f21dcff9640 1 -- 172.21.15.80:0/2227193910 <== osd.0 v2:172.21.15.80:6808/4108878667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f21c0002dd0 con 0x7f21cc07dd80 2024-04-25T15:43:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 --2- 172.21.15.80:0/3568111241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45400e5150 0x7f4540049b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f454806b8a0 tx=0x7f454806eb20 comp rx=0 tx=0).stop 2024-04-25T15:43:26.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f454ea1f640 1 -- 172.21.15.80:0/3568111241 reap_dead start 2024-04-25T15:43:26.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 shutdown_connections 2024-04-25T15:43:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.034+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 >> 172.21.15.80:0/3568111241 conn(0x7f454000aa70 msgr2=0x7f45400544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 shutdown_connections 2024-04-25T15:43:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f453cff9640 1 -- 172.21.15.80:0/3568111241 wait complete. 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7f21cc07dd80 msgr2=0x7f21cc080210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7f21cc07dd80 0x7f21cc080210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21cc0745b0 msgr2=0x7f21cc076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21cc0745b0 0x7f21cc076ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21d80012e0 tx=0x7f21d80061f0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21e0159d20 msgr2=0x7f21e01e64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 --2- 172.21.15.80:0/2227193910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21e0159d20 0x7f21e01e64c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21d000c3f0 tx=0x7f21d000c8b0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21e4f4f640 1 -- 172.21.15.80:0/2227193910 reap_dead start 2024-04-25T15:43:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 shutdown_connections 2024-04-25T15:43:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 >> 172.21.15.80:0/2227193910 conn(0x7f21e00d2320 msgr2=0x7f21e006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 shutdown_connections 2024-04-25T15:43:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.035+0000 7f21c67fc640 1 -- 172.21.15.80:0/2227193910 wait complete. 2024-04-25T15:43:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.036+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 --> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19a8002dd0 con 0x7f19b407dd50 2024-04-25T15:43:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.037+0000 7f19affff640 1 -- 172.21.15.80:0/3222032724 <== osd.7 v2:172.21.15.195:6816/1930343330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f19a8002dd0 con 0x7f19b407dd50 2024-04-25T15:43:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.037+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 --> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c94002dd0 con 0x7f4c9807dcc0 2024-04-25T15:43:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.037+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 --> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7444005c90 con 0x7f7444001650 2024-04-25T15:43:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f4cb17fa640 1 -- 172.21.15.80:0/2778660736 <== osd.3 v2:172.21.15.80:6809/3224498559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c94002dd0 con 0x7f4c9807dcc0 2024-04-25T15:43:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7f19b407dd50 msgr2=0x7f19b40801e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7f19b407dd50 0x7f19b40801e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19b4074580 msgr2=0x7f19b4076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19b4074580 0x7f19b4076a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19b8006fd0 tx=0x7f19b8008040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c80d61e0 msgr2=0x7f19c81f9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 --2- 172.21.15.80:0/3222032724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19c80d61e0 0x7f19c81f9e30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009f40 tx=0x7f19c0004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f7459ffb640 1 -- 172.21.15.80:0/2235905384 <== osd.4 v2:172.21.15.195:6808/2711684180 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7444005c90 con 0x7f7444001650 2024-04-25T15:43:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19c7fff640 1 -- 172.21.15.80:0/3222032724 reap_dead start 2024-04-25T15:43:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd298002dd0 con 0x7fd2a407dd40 2024-04-25T15:43:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 --> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0dc002d50 con 0x7fc0d807dbf0 2024-04-25T15:43:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 shutdown_connections 2024-04-25T15:43:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 >> 172.21.15.80:0/3222032724 conn(0x7f19c806e610 msgr2=0x7f19c80d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f4c9807dcc0 msgr2=0x7f4c98080150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 shutdown_connections 2024-04-25T15:43:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f19cde27640 1 -- 172.21.15.80:0/3222032724 wait complete. 2024-04-25T15:43:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.038+0000 7f4cbad1f640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f4c9807dcc0 0x7f4c98080150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7fd2bd7fa640 1 -- 172.21.15.80:0/3905708102 <== osd.2 v2:172.21.15.80:6800/1881939009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd298002dd0 con 0x7fd2a407dd40 2024-04-25T15:43:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c98074580 msgr2=0x7f4c98076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c98074580 0x7f4c98076a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000d440 tx=0x7f4ca0008040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac033980 msgr2=0x7f4cac0da180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 --2- 172.21.15.80:0/2778660736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac033980 0x7f4cac0da180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40512d0 tx=0x7f4cb406a560 comp rx=0 tx=0).stop 2024-04-25T15:43:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cb92bc640 1 -- 172.21.15.80:0/2778660736 reap_dead start 2024-04-25T15:43:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7fc0eaffd640 1 -- 172.21.15.80:0/2230158282 <== osd.5 v2:172.21.15.195:6800/1786051066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc0dc002d50 con 0x7fc0d807dbf0 2024-04-25T15:43:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f7444001650 msgr2=0x7f7444003b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f7444001650 0x7f7444003b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74480745b0 msgr2=0x7f7448076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74480745b0 0x7f7448076ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f745c033910 tx=0x7f7460008040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 shutdown_connections 2024-04-25T15:43:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 >> 172.21.15.80:0/2778660736 conn(0x7f4cac054d20 msgr2=0x7f4cac007210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f745c047db0 msgr2=0x7f745c04eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 --2- 172.21.15.80:0/2235905384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f745c047db0 0x7f745c04eb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f745c055c50 tx=0x7f74540046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746987d640 1 -- 172.21.15.80:0/2235905384 reap_dead start 2024-04-25T15:43:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 shutdown_connections 2024-04-25T15:43:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f4cbad1f640 1 -- 172.21.15.80:0/2778660736 wait complete. 2024-04-25T15:43:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.039+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 shutdown_connections 2024-04-25T15:43:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 >> 172.21.15.80:0/2235905384 conn(0x7f745c054cf0 msgr2=0x7f745c034910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fc0d807dbf0 msgr2=0x7fc0d8080080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fc0d807dbf0 0x7fc0d8080080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 shutdown_connections 2024-04-25T15:43:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7f746a07e640 1 -- 172.21.15.80:0/2235905384 wait complete. 2024-04-25T15:43:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0d80744b0 msgr2=0x7fc0d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0d80744b0 0x7fc0d80769c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0006fd0 tx=0x7fc0f0008040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 --> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f413c0e91d0 con 0x7f412807dd40 2024-04-25T15:43:26.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0ec047db0 msgr2=0x7fc0ec0e2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 --2- 172.21.15.80:0/2230158282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0ec047db0 0x7fc0ec0e2ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40519b0 tx=0x7fc0f40757c0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fab01640 1 -- 172.21.15.80:0/2230158282 reap_dead start 2024-04-25T15:43:26.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7fd2a407dd40 msgr2=0x7fd2a40801d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fd2aaffd640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7fd2a407dd40 0x7fd2a40801d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 shutdown_connections 2024-04-25T15:43:26.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 >> 172.21.15.80:0/2230158282 conn(0x7fc0ec054cf0 msgr2=0x7fc0ec0474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2a4074580 msgr2=0x7fd2a4076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.040+0000 7fd2aaffd640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2a4074580 0x7fd2a4076a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac000f60 tx=0x7fd2ac009040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80340c0 msgr2=0x7fd2b8049090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2aaffd640 1 --2- 172.21.15.80:0/3905708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b80340c0 0x7fd2b8049090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40091e0 tx=0x7fd2b40046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2c52dc640 1 -- 172.21.15.80:0/3905708102 reap_dead start 2024-04-25T15:43:26.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7f4140ff9640 1 -- 172.21.15.80:0/3309414403 <== osd.1 v2:172.21.15.80:6824/70437144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f413c0e91d0 con 0x7f412807dd40 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f412807dd40 msgr2=0x7f41280801d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7f412e7fc640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f412807dd40 0x7f41280801d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 shutdown_connections 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 >> 172.21.15.80:0/3905708102 conn(0x7fd2b8054cf0 msgr2=0x7fd2b8036040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 shutdown_connections 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fd2aaffd640 1 -- 172.21.15.80:0/3905708102 wait complete. 2024-04-25T15:43:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 shutdown_connections 2024-04-25T15:43:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.041+0000 7fc0fb302640 1 -- 172.21.15.80:0/2230158282 wait complete. 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.042+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4128074580 msgr2=0x7f4128076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.042+0000 7f412e7fc640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4128074580 0x7f4128076a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f413c0513b0 tx=0x7f41440ab000 comp rx=0 tx=0).stop 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.042+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c006aa0 msgr2=0x7f413c17f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.042+0000 7f412e7fc640 1 --2- 172.21.15.80:0/3309414403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f413c006aa0 0x7f413c17f640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f413800b3f0 tx=0x7f413800b8b0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.042+0000 7f4148ed1640 1 -- 172.21.15.80:0/3309414403 reap_dead start 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.043+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 shutdown_connections 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.043+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 >> 172.21.15.80:0/3309414403 conn(0x7f413c055140 msgr2=0x7f413c0e7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.043+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 shutdown_connections 2024-04-25T15:43:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.043+0000 7f412e7fc640 1 -- 172.21.15.80:0/3309414403 wait complete. 2024-04-25T15:43:26.104 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:26.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:43:26.105 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:26.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:43:26.106 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-25T15:43:26.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:43:26.107 INFO:teuthology.orchestra.run.smithi080.stdout:60129542155 2024-04-25T15:43:26.107 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:43:26.108 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-25T15:43:26.108 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-25T15:43:26.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:43:26.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:43:26.109 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:26.110 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:43:26.111 INFO:teuthology.orchestra.run.smithi080.stdout:60129542156 2024-04-25T15:43:26.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:43:26.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.351+0000 7f96af0d1640 1 Processor -- start 2024-04-25T15:43:26.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.351+0000 7f96af0d1640 1 -- start start 2024-04-25T15:43:26.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7f96af0d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f96a0105640 0x7f96a0006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7f96af0d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105a50 0x7f96a00067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7f96af0d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a0053b00 con 0x7f96a0050470 2024-04-25T15:43:26.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7f96af0d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f96a0053de0 con 0x7f96a0105640 2024-04-25T15:43:26.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7f96af0d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f96a00540c0 con 0x7f96a0105a50 2024-04-25T15:43:26.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7fe0e4d63640 1 Processor -- start 2024-04-25T15:43:26.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f96ad66e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105a50 0x7f96a00067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f96ad66e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105a50 0x7f96a00067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50310/0 (socket says 172.21.15.80:50310) 2024-04-25T15:43:26.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7fe0e4d63640 1 -- start start 2024-04-25T15:43:26.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f96ad66e640 1 -- 172.21.15.80:0/1228950217 learned_addr learned my addr 172.21.15.80:0/1228950217 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f96ace6d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f96a0050470 0x7f96a0104f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45016/0 (socket says 172.21.15.80:45016) 2024-04-25T15:43:26.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f96a7fff640 1 --2- 172.21.15.80:0/1228950217 >> v2:172.21.15.195:3300/0 conn(0x7f96a0105640 0x7f96a0006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f597b59e640 1 Processor -- start 2024-04-25T15:43:26.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.355+0000 7f597b59e640 1 -- start start 2024-04-25T15:43:26.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f96a77fe640 1 -- 172.21.15.80:0/1228950217 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119624998 0 0) 0x7f96a0053b00 con 0x7f96a0050470 2024-04-25T15:43:26.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f96a77fe640 1 -- 172.21.15.80:0/1228950217 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9698003520 con 0x7f96a0050470 2024-04-25T15:43:26.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f6db097c640 1 Processor -- start 2024-04-25T15:43:26.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f6db097c640 1 -- start start 2024-04-25T15:43:26.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7fb50e97d640 1 Processor -- start 2024-04-25T15:43:26.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7fb50e97d640 1 -- start start 2024-04-25T15:43:26.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f96a7fff640 1 -- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105a50 msgr2=0x7f96a00067b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f96a7fff640 1 --2- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105a50 0x7f96a00067b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f96a7fff640 1 -- 172.21.15.80:0/1228950217 >> v1:172.21.15.195:6789/0 conn(0x7f96a0050470 legacy=0x7f96a0104f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.356+0000 7f96a7fff640 1 -- 172.21.15.80:0/1228950217 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00543a0 con 0x7f96a0105640 2024-04-25T15:43:26.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7fe0e4d63640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0d804fb40 0x7fe0d804ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7fe0e4d63640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8053680 0x7fe0d8053a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7fe0e4d63640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d8050490 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7fe0e4d63640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d803b510 con 0x7fe0d804fb40 2024-04-25T15:43:26.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7fe0e4d63640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d803b230 con 0x7fe0d8053680 2024-04-25T15:43:26.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f96a7fff640 1 --2- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105640 0x7f96a0006270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097a0 tx=0x7f969c02a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a71bdce290187993 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f0fe2268640 1 Processor -- start 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7efddcb8c640 1 Processor -- start 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.354+0000 7efddcb8c640 1 -- start start 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efddcb8c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efdd0050690 0x7efdd00533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efddcb8c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd0053ac0 con 0x7efdd00df6d0 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efddcb8c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd0053da0 con 0x7efdd00e3340 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efddcb8c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7efdd00074f0 con 0x7efdd0050690 2024-04-25T15:43:26.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efdd7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efdd00df6d0 0x7efdd00dfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41808/0 (socket says 172.21.15.80:41808) 2024-04-25T15:43:26.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efdd7fff640 1 -- 172.21.15.80:0/2705594200 learned_addr learned my addr 172.21.15.80:0/2705594200 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:26.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028269832 0 0) 0x7efdd0053ac0 con 0x7efdd00df6d0 2024-04-25T15:43:26.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc8003520 con 0x7efdd00df6d0 2024-04-25T15:43:26.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.357+0000 7efdd6ffd640 1 --2- 172.21.15.80:0/2705594200 >> v2:172.21.15.80:3300/0 conn(0x7efdd0050690 0x7efdd00533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f3073fff640 1 Processor -- start 2024-04-25T15:43:26.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fe0df7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0d80e7ed0 0x7fe0d80341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41818/0 (socket says 172.21.15.80:41818) 2024-04-25T15:43:26.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fe0df7fe640 1 -- 172.21.15.80:0/2130573853 learned_addr learned my addr 172.21.15.80:0/2130573853 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:26.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281382687 0 0) 0x7efdc8003520 con 0x7efdd00df6d0 2024-04-25T15:43:26.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 >> v2:172.21.15.80:3300/0 conn(0x7efdd0050690 msgr2=0x7efdd00533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f0fe2268640 1 -- start start 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f6db097c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dac159d20 0x7f6dac0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597b59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f597c0cfc20 0x7f597c0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f597c164550 0x7f597c06f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597b59e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597c0702e0 con 0x7f597c06fed0 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597ad9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f597c06fed0 0x7f597c167fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45042/0 (socket says 172.21.15.80:45042) 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597ad9d640 1 -- 172.21.15.80:0/4289299190 learned_addr learned my addr 172.21.15.80:0/4289299190 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597a59c640 1 --2- 172.21.15.80:0/4289299190 >> v2:172.21.15.195:3300/0 conn(0x7f597c0cfc20 0x7f597c0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f597c0d0c30 con 0x7f597c164550 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f597c06d5d0 con 0x7f597c0cfc20 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fe0dffff640 1 --2- 172.21.15.80:0/2130573853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8053680 0x7fe0d8053a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fb50e97d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 0x7fb5000e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fb50e97d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb500048300 0x7fb500033950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fb50e97d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb500033e90 0x7fb5000531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fb50e97d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb50004f690 con 0x7fb500033e90 2024-04-25T15:43:26.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fb50e97d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb500006130 con 0x7fb500048300 2024-04-25T15:43:26.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f96a77fe640 1 -- 172.21.15.80:0/1228950217 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c037070 con 0x7f96a0105640 2024-04-25T15:43:26.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f96a77fe640 1 -- 172.21.15.80:0/1228950217 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c02ae40 con 0x7f96a0105640 2024-04-25T15:43:26.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6db097c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac06c5c0 0x7f6dac0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7fb50e97d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000342a0 con 0x7fb500047db0 2024-04-25T15:43:26.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6db097c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6dac06c9d0 0x7f6dac0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 --2- 172.21.15.80:0/2705594200 >> v2:172.21.15.80:3300/0 conn(0x7efdd0050690 0x7efdd00533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 0x7fb5000e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 0x7fb5000e7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50336/0 (socket says 172.21.15.80:50336) 2024-04-25T15:43:26.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 -- 172.21.15.80:0/1968165723 learned_addr learned my addr 172.21.15.80:0/1968165723 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f597959a640 1 -- 172.21.15.80:0/4289299190 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491231250 0 0) 0x7f5974001490 con 0x7f597c06fed0 2024-04-25T15:43:26.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f597959a640 1 -- 172.21.15.80:0/4289299190 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5964003520 con 0x7f597c06fed0 2024-04-25T15:43:26.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6db097c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6dac0c73a0 con 0x7f6dac159d20 2024-04-25T15:43:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f597a59c640 1 -- 172.21.15.80:0/4289299190 >> v2:172.21.15.80:3300/0 conn(0x7f597c164550 msgr2=0x7f597c06f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6dab59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6dac06c9d0 0x7f6dac0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6dab59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6dac06c9d0 0x7f6dac0c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50488/0 (socket says 172.21.15.80:50488) 2024-04-25T15:43:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6dab59e640 1 -- 172.21.15.80:0/99409114 learned_addr learned my addr 172.21.15.80:0/99409114 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6dac0cfcb0 con 0x7f6dac06c9d0 2024-04-25T15:43:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb5077fe640 1 --2- 172.21.15.80:0/1968165723 >> v2:172.21.15.195:3300/0 conn(0x7fb500048300 0x7fb500033950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6dac0cff90 con 0x7f6dac06c5c0 2024-04-25T15:43:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 >> v1:172.21.15.195:6789/0 conn(0x7efdd00e3340 legacy=0x7efdd004ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f6daa59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac06c5c0 0x7f6dac0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd0054080 con 0x7efdd00df6d0 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd6ffd640 1 --2- 172.21.15.80:0/2705594200 >> v2:172.21.15.80:3300/0 conn(0x7efdd0050690 0x7efdd00533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7efdd8076a50 con 0x7efdd00df6d0 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 >> v1:172.21.15.80:6789/0 conn(0x7efdd00df6d0 legacy=0x7efdd00dfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc80039b0 0x7efdc8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc8004800 0x7efdc8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7efdd67fc640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80051a0 0x7efdc80141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efdd00074f0 con 0x7efdc8004800 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8014900 con 0x7efdc80039b0 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efdc8014b00 con 0x7efdc80051a0 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7efdd7fff640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80051a0 0x7efdc80141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7efdd77fe640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc80039b0 0x7efdc8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f597a59c640 1 --2- 172.21.15.80:0/4289299190 >> v2:172.21.15.80:3300/0 conn(0x7f597c164550 0x7f597c06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f597a59c640 1 -- 172.21.15.80:0/4289299190 >> v1:172.21.15.195:6789/0 conn(0x7f597c06fed0 legacy=0x7f597c167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7f597a59c640 1 -- 172.21.15.80:0/4289299190 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c0c7310 con 0x7f597c0cfc20 2024-04-25T15:43:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fe0deffd640 1 --2- 172.21.15.80:0/2130573853 >> v2:172.21.15.80:3300/0 conn(0x7fe0d804fb40 0x7fe0d804ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f96af0d1640 1 -- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105640 msgr2=0x7f96a0006270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f96af0d1640 1 --2- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105640 0x7f96a0006270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097a0 tx=0x7f969c02a0f0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f6daad9d640 1 --2- 172.21.15.80:0/99409114 >> v2:172.21.15.80:3300/0 conn(0x7f6dac159d20 0x7f6dac0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7efdd7fff640 1 -- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc80039b0 msgr2=0x7efdc8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 -- 172.21.15.80:0/1968165723 >> v2:172.21.15.195:3300/0 conn(0x7fb500048300 msgr2=0x7fb500033950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 --2- 172.21.15.80:0/1968165723 >> v2:172.21.15.195:3300/0 conn(0x7fb500048300 0x7fb500033950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 -- 172.21.15.80:0/1968165723 >> v2:172.21.15.80:3300/0 conn(0x7fb500033e90 msgr2=0x7fb5000531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 --2- 172.21.15.80:0/1968165723 >> v2:172.21.15.80:3300/0 conn(0x7fb500033e90 0x7fb5000531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.359+0000 7fb507fff640 1 -- 172.21.15.80:0/1968165723 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50004ffa0 con 0x7fb500047db0 2024-04-25T15:43:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7fe0dffff640 1 -- 172.21.15.80:0/2130573853 >> v2:172.21.15.80:3300/0 conn(0x7fe0d804fb40 msgr2=0x7fe0d804ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7fe0dffff640 1 --2- 172.21.15.80:0/2130573853 >> v2:172.21.15.80:3300/0 conn(0x7fe0d804fb40 0x7fe0d804ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7fe0dffff640 1 -- 172.21.15.80:0/2130573853 >> v1:172.21.15.80:6789/0 conn(0x7fe0d80e7ed0 legacy=0x7fe0d80341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7fe0dffff640 1 -- 172.21.15.80:0/2130573853 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d8054fe0 con 0x7fe0d8053680 2024-04-25T15:43:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7efdd7fff640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc80039b0 0x7efdc8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.358+0000 7f3073fff640 1 -- start start 2024-04-25T15:43:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7efdd7fff640 1 -- 172.21.15.80:0/2705594200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc8004800 msgr2=0x7efdc8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7efdd7fff640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc8004800 0x7efdc8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7efdd7fff640 1 -- 172.21.15.80:0/2705594200 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc8003520 con 0x7efdc80051a0 2024-04-25T15:43:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f3073fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30740700a0 0x7f30740c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f3073fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3074164550 0x7f307406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f3073fff640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30740c7310 con 0x7f30740cfc20 2024-04-25T15:43:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f3073fff640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f30740d0c30 con 0x7f3074164550 2024-04-25T15:43:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f3073fff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f30740c75f0 con 0x7f30740700a0 2024-04-25T15:43:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7fb507fff640 1 --2- 172.21.15.80:0/1968165723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 0x7fb5000e7d50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb500034450 tx=0x7fb4fc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd03493e11719ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3074164550 0x7f307406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3074164550 0x7f307406c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44180/0 (socket says 172.21.15.80:44180) 2024-04-25T15:43:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7efdd7fff640 1 -- 172.21.15.80:0/2705594200 reap_dead start 2024-04-25T15:43:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f96af0d1640 1 -- 172.21.15.80:0/1228950217 shutdown_connections 2024-04-25T15:43:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f96af0d1640 1 --2- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105a50 0x7f96a00067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7efdd7fff640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80051a0 0x7efdc80141d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdd8064160 tx=0x7efdc8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=815c4d3c20365794 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f96af0d1640 1 --2- 172.21.15.80:0/1228950217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105640 0x7f96a0006270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f96af0d1640 1 -- 172.21.15.80:0/1228950217 >> 172.21.15.80:0/1228950217 conn(0x7f96a0054d20 msgr2=0x7f96a0055130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 -- 172.21.15.80:0/1712904058 learned_addr learned my addr 172.21.15.80:0/1712904058 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30727fc640 1 --2- 172.21.15.80:0/1712904058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30740700a0 0x7f30740c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f6dab59e640 1 -- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac06c5c0 msgr2=0x7f6dac0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f6dab59e640 1 --2- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac06c5c0 0x7f6dac0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f6dab59e640 1 -- 172.21.15.80:0/99409114 >> v2:172.21.15.80:3300/0 conn(0x7f6dac159d20 msgr2=0x7f6dac0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f0fe2268640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0fdc06cfb0 0x7f0fdc168990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f0fe2268640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0fdc0c50c0 0x7f0fdc0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f0fe2268640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fdc06d3c0 con 0x7f0fdc164720 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f0fe2268640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0fdc06c660 con 0x7f0fdc06cfb0 2024-04-25T15:43:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.360+0000 7f0fe2268640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0fdc06c940 con 0x7f0fdc0c50c0 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f0fe1266640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0fdc06cfb0 0x7f0fdc168990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f0fe0a65640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0fdc0c50c0 0x7f0fdc0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f0fe0a65640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0fdc0c50c0 0x7f0fdc0c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50496/0 (socket says 172.21.15.80:50496) 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f0fe0a65640 1 -- 172.21.15.80:0/949095409 learned_addr learned my addr 172.21.15.80:0/949095409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f6dab59e640 1 --2- 172.21.15.80:0/99409114 >> v2:172.21.15.80:3300/0 conn(0x7f6dac159d20 0x7f6dac0cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f6dab59e640 1 -- 172.21.15.80:0/99409114 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac0d0270 con 0x7f6dac06c9d0 2024-04-25T15:43:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 -- 172.21.15.80:0/1712904058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30740700a0 msgr2=0x7f30740c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f96af0d1640 1 -- 172.21.15.80:0/1228950217 shutdown_connections 2024-04-25T15:43:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f96af0d1640 1 -- 172.21.15.80:0/1228950217 wait complete. 2024-04-25T15:43:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f597a59c640 1 --2- 172.21.15.80:0/4289299190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c0cfc20 0x7f597c0c6ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f597c071830 tx=0x7f596c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eea26dd619347f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 --2- 172.21.15.80:0/1712904058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30740700a0 0x7f30740c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 -- 172.21.15.80:0/1712904058 >> v1:172.21.15.80:6789/0 conn(0x7f30740cfc20 legacy=0x7f307406f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7f30737fe640 1 -- 172.21.15.80:0/1712904058 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30740c78d0 con 0x7f3074164550 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f0fe0a65640 1 -- 172.21.15.80:0/949095409 >> v2:172.21.15.80:3300/0 conn(0x7f0fdc06cfb0 msgr2=0x7f0fdc168990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f0fe0a65640 1 --2- 172.21.15.80:0/949095409 >> v2:172.21.15.80:3300/0 conn(0x7f0fdc06cfb0 0x7f0fdc168990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f0fe0a65640 1 -- 172.21.15.80:0/949095409 >> v1:172.21.15.80:6789/0 conn(0x7f0fdc164720 legacy=0x7f0fdc164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f0fe0a65640 1 -- 172.21.15.80:0/949095409 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc06cc20 con 0x7f0fdc0c50c0 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd806a160 con 0x7efdc80051a0 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd806e350 con 0x7efdc80051a0 2024-04-25T15:43:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7efdd67fc640 1 -- 172.21.15.80:0/2705594200 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd806c800 con 0x7efdc80051a0 2024-04-25T15:43:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7fb506ffd640 1 -- 172.21.15.80:0/1968165723 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc037070 con 0x7fb500047db0 2024-04-25T15:43:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7fb506ffd640 1 -- 172.21.15.80:0/1968165723 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc032440 con 0x7fb500047db0 2024-04-25T15:43:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.361+0000 7fe0dffff640 1 --2- 172.21.15.80:0/2130573853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8053680 0x7fe0d8053a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0066010 tx=0x7fe0e00a6f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc82407fe4ab97ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7fe0de7fc640 1 -- 172.21.15.80:0/2130573853 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00b4070 con 0x7fe0d8053680 2024-04-25T15:43:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f6dab59e640 1 --2- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0c8080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0cf100 tx=0x7f6da402a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb58e0b782b29f16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7fb506ffd640 1 -- 172.21.15.80:0/1968165723 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0327f0 con 0x7fb500047db0 2024-04-25T15:43:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7fe0de7fc640 1 -- 172.21.15.80:0/2130573853 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e00a7b40 con 0x7fe0d8053680 2024-04-25T15:43:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7fe0de7fc640 1 -- 172.21.15.80:0/2130573853 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00af440 con 0x7fe0d8053680 2024-04-25T15:43:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f6da9d9b640 1 -- 172.21.15.80:0/99409114 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4036070 con 0x7f6dac06c9d0 2024-04-25T15:43:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f6da9d9b640 1 -- 172.21.15.80:0/99409114 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da4031600 con 0x7f6dac06c9d0 2024-04-25T15:43:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f0fe1266640 1 --2- 172.21.15.80:0/949095409 >> v2:172.21.15.80:3300/0 conn(0x7f0fdc06cfb0 0x7f0fdc168990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f6da9d9b640 1 -- 172.21.15.80:0/99409114 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40319b0 con 0x7f6dac06c9d0 2024-04-25T15:43:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f597959a640 1 -- 172.21.15.80:0/4289299190 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c037070 con 0x7f597c0cfc20 2024-04-25T15:43:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f597959a640 1 -- 172.21.15.80:0/4289299190 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596c032440 con 0x7f597c0cfc20 2024-04-25T15:43:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f597959a640 1 -- 172.21.15.80:0/4289299190 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c02ae60 con 0x7f597c0cfc20 2024-04-25T15:43:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 -- 172.21.15.80:0/1968165723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 msgr2=0x7fb5000e7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 --2- 172.21.15.80:0/1968165723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 0x7fb5000e7d50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb500034450 tx=0x7fb4fc02a210 comp rx=0 tx=0).stop 2024-04-25T15:43:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.362+0000 7f30737fe640 1 --2- 172.21.15.80:0/1712904058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3074164550 0x7f307406c5c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3064009870 tx=0x7f306402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6125a0285a6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 -- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80051a0 msgr2=0x7efdc80141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f3071ffb640 1 -- 172.21.15.80:0/1712904058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064037070 con 0x7f3074164550 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f0fe0a65640 1 --2- 172.21.15.80:0/949095409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc0c54d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0c8c20 tx=0x7f0fcc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909706f9943c107a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 -- 172.21.15.80:0/1968165723 shutdown_connections 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 --2- 172.21.15.80:0/1968165723 >> v2:172.21.15.80:3300/0 conn(0x7fb500033e90 0x7fb5000531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 --2- 172.21.15.80:0/1968165723 >> v2:172.21.15.195:3300/0 conn(0x7fb500048300 0x7fb500033950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 --2- 172.21.15.80:0/1968165723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500047db0 0x7fb5000e7d50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 -- 172.21.15.80:0/1968165723 >> 172.21.15.80:0/1968165723 conn(0x7fb500054cf0 msgr2=0x7fb500055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f3071ffb640 1 -- 172.21.15.80:0/1712904058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3064032440 con 0x7f3074164550 2024-04-25T15:43:26.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 -- 172.21.15.80:0/1968165723 shutdown_connections 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80051a0 0x7efdc80141d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdd8064160 tx=0x7efdc8005830 comp rx=0 tx=0).stop 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 -- 172.21.15.80:0/2705594200 shutdown_connections 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 --2- 172.21.15.80:0/2705594200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc80051a0 0x7efdc80141d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 -- 172.21.15.80:0/2705594200 >> 172.21.15.80:0/2705594200 conn(0x7efdd0055140 msgr2=0x7efdd0055550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f0fd3fff640 1 -- 172.21.15.80:0/949095409 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc037070 con 0x7f0fdc0c50c0 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f0fd3fff640 1 -- 172.21.15.80:0/949095409 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fcc02ae30 con 0x7f0fdc0c50c0 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f0fd3fff640 1 -- 172.21.15.80:0/949095409 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc032640 con 0x7f0fdc0c50c0 2024-04-25T15:43:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f3071ffb640 1 -- 172.21.15.80:0/1712904058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064032810 con 0x7f3074164550 2024-04-25T15:43:26.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c0cfc20 msgr2=0x7f597c0c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f597b59e640 1 --2- 172.21.15.80:0/4289299190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c0cfc20 0x7f597c0c6ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f597c071830 tx=0x7f596c02a110 comp rx=0 tx=0).stop 2024-04-25T15:43:26.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 shutdown_connections 2024-04-25T15:43:26.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f597b59e640 1 --2- 172.21.15.80:0/4289299190 >> v2:172.21.15.80:3300/0 conn(0x7f597c164550 0x7f597c06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f597b59e640 1 --2- 172.21.15.80:0/4289299190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c0cfc20 0x7f597c0c6ca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 >> 172.21.15.80:0/4289299190 conn(0x7f597c0d2320 msgr2=0x7f597c0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 -- 172.21.15.80:0/2705594200 shutdown_connections 2024-04-25T15:43:26.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7efddcb8c640 1 -- 172.21.15.80:0/2705594200 wait complete. 2024-04-25T15:43:26.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.363+0000 7fb50e97d640 1 -- 172.21.15.80:0/1968165723 wait complete. 2024-04-25T15:43:26.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 -- 172.21.15.80:0/2130573853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8053680 msgr2=0x7fe0d8053a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/2130573853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8053680 0x7fe0d8053a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0066010 tx=0x7fe0e00a6f60 comp rx=0 tx=0).stop 2024-04-25T15:43:26.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 shutdown_connections 2024-04-25T15:43:26.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c9d0 msgr2=0x7f6dac0c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 -- 172.21.15.80:0/2130573853 shutdown_connections 2024-04-25T15:43:26.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/2130573853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8053680 0x7fe0d8053a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/2130573853 >> v2:172.21.15.80:3300/0 conn(0x7fe0d804fb40 0x7fe0d804ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 -- 172.21.15.80:0/2130573853 >> 172.21.15.80:0/2130573853 conn(0x7fe0d800aa70 msgr2=0x7fe0d800ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 -- 172.21.15.80:0/1712904058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3074164550 msgr2=0x7f307406c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 --2- 172.21.15.80:0/1712904058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3074164550 0x7f307406c5c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3064009870 tx=0x7f306402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 -- 172.21.15.80:0/2130573853 shutdown_connections 2024-04-25T15:43:26.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 --2- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0c8080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0cf100 tx=0x7f6da402a6b0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f96af0d1640 1 Processor -- start 2024-04-25T15:43:26.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 -- 172.21.15.80:0/1712904058 shutdown_connections 2024-04-25T15:43:26.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 --2- 172.21.15.80:0/1712904058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3074164550 0x7f307406c5c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 --2- 172.21.15.80:0/1712904058 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30740700a0 0x7f30740c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 -- 172.21.15.80:0/1712904058 >> 172.21.15.80:0/1712904058 conn(0x7f30740d2320 msgr2=0x7f30740ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f96af0d1640 1 -- start start 2024-04-25T15:43:26.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 -- 172.21.15.80:0/1712904058 shutdown_connections 2024-04-25T15:43:26.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 shutdown_connections 2024-04-25T15:43:26.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f0fe2268640 1 -- 172.21.15.80:0/949095409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc0c50c0 msgr2=0x7f0fdc0c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f0fe2268640 1 --2- 172.21.15.80:0/949095409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc0c54d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0c8c20 tx=0x7f0fcc02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 --2- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0c8080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 --2- 172.21.15.80:0/99409114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac06c5c0 0x7f6dac0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 --2- 172.21.15.80:0/99409114 >> v2:172.21.15.80:3300/0 conn(0x7f6dac159d20 0x7f6dac0cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 >> 172.21.15.80:0/99409114 conn(0x7f6dac0d2320 msgr2=0x7f6dac0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.365+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 shutdown_connections 2024-04-25T15:43:26.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.365+0000 7f6db097c640 1 -- 172.21.15.80:0/99409114 wait complete. 2024-04-25T15:43:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f3073fff640 1 -- 172.21.15.80:0/1712904058 wait complete. 2024-04-25T15:43:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7f597b59e640 1 -- 172.21.15.80:0/4289299190 wait complete. 2024-04-25T15:43:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.364+0000 7fe0e4d63640 1 -- 172.21.15.80:0/2130573853 wait complete. 2024-04-25T15:43:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.365+0000 7f0fe2268640 1 -- 172.21.15.80:0/949095409 shutdown_connections 2024-04-25T15:43:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.365+0000 7f0fe2268640 1 --2- 172.21.15.80:0/949095409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc0c54d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.365+0000 7f0fe2268640 1 --2- 172.21.15.80:0/949095409 >> v2:172.21.15.80:3300/0 conn(0x7f0fdc06cfb0 0x7f0fdc168990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.365+0000 7f0fe2268640 1 -- 172.21.15.80:0/949095409 >> 172.21.15.80:0/949095409 conn(0x7f0fdc09b410 msgr2=0x7f0fdc0b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.366+0000 7fb50e97d640 1 Processor -- start 2024-04-25T15:43:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.366+0000 7fb50e97d640 1 -- start start 2024-04-25T15:43:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.366+0000 7efddcb8c640 1 Processor -- start 2024-04-25T15:43:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.366+0000 7f0fe2268640 1 -- 172.21.15.80:0/949095409 shutdown_connections 2024-04-25T15:43:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.366+0000 7f0fe2268640 1 -- 172.21.15.80:0/949095409 wait complete. 2024-04-25T15:43:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.366+0000 7efddcb8c640 1 -- start start 2024-04-25T15:43:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.367+0000 7f96af0d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 0x7f96a01031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.367+0000 7f597b59e640 1 Processor -- start 2024-04-25T15:43:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.367+0000 7f597b59e640 1 -- start start 2024-04-25T15:43:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f3073fff640 1 Processor -- start 2024-04-25T15:43:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f96ace6d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 0x7f96a01031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f96ace6d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 0x7f96a01031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44192/0 (socket says 172.21.15.80:44192) 2024-04-25T15:43:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f96ace6d640 1 -- 172.21.15.80:0/2457385013 learned_addr learned my addr 172.21.15.80:0/2457385013 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105640 0x7f96a004e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efddcb8c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 0x7efdd01784b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7fb50e97d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500033e90 0x7fb5000d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f6db097c640 1 Processor -- start 2024-04-25T15:43:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7fe0e4d63640 1 Processor -- start 2024-04-25T15:43:26.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f6db097c640 1 -- start start 2024-04-25T15:43:26.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7fb50e97d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 0x7fb5000d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efddcb8c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdd0048150 0x7efdd00ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efddcb8c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdd00cf2e0 0x7efdd0048c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105a50 0x7f96a00f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7fb50e97d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb500048300 0x7fb5000d4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efddcb8c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0050ce0 con 0x7efdc80051a0 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efddcb8c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0054640 con 0x7efdd00cf2e0 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efddcb8c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efdd0054b60 con 0x7efdd0048150 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 0x7efdd01784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 0x7efdd01784b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44206/0 (socket says 172.21.15.80:44206) 2024-04-25T15:43:26.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7fb507fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500033e90 0x7fb5000d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7efdd77fe640 1 -- 172.21.15.80:0/3621476133 learned_addr learned my addr 172.21.15.80:0/3621476133 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb5077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 0x7fb5000d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb5077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 0x7fb5000d5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44214/0 (socket says 172.21.15.80:44214) 2024-04-25T15:43:26.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb507fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500033e90 0x7fb5000d5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50384/0 (socket says 172.21.15.80:50384) 2024-04-25T15:43:26.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb5077fe640 1 -- 172.21.15.80:0/3612413259 learned_addr learned my addr 172.21.15.80:0/3612413259 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd7fff640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdd00cf2e0 0x7efdd0048c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb50cf1a640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb500048300 0x7fb5000d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb50e97d640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb500050840 con 0x7fb500047db0 2024-04-25T15:43:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb50e97d640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb500050560 con 0x7fb500048300 2024-04-25T15:43:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb50e97d640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000509c0 con 0x7fb500033e90 2024-04-25T15:43:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f96ad66e640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105a50 0x7f96a00f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f96a7fff640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105640 0x7f96a004e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f96a004feb0 con 0x7f96a0050470 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd77fe640 1 -- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdd0048150 msgr2=0x7efdd00ceda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd77fe640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdd0048150 0x7efdd00ceda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd77fe640 1 -- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdd00cf2e0 msgr2=0x7efdd0048c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd77fe640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdd00cf2e0 0x7efdd0048c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd77fe640 1 -- 172.21.15.80:0/3621476133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd00cf6f0 con 0x7efdc80051a0 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0050880 con 0x7f96a0105a50 2024-04-25T15:43:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f96a0050030 con 0x7f96a0105640 2024-04-25T15:43:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f0fe2268640 1 Processor -- start 2024-04-25T15:43:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7f0fe2268640 1 -- start start 2024-04-25T15:43:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7efdd77fe640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 0x7efdd01784b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efdc400f5a0 tx=0x7efdc400fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.369+0000 7fb5077fe640 1 -- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500033e90 msgr2=0x7fb5000d5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f597c06fed0 0x7f597c14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc40052e0 con 0x7efdc80051a0 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc4018070 con 0x7efdc80051a0 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4003810 con 0x7efdc80051a0 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7fb5077fe640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500033e90 0x7fb5000d5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7fb5077fe640 1 -- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb500048300 msgr2=0x7fb5000d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7fb5077fe640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb500048300 0x7fb5000d4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7fb5077fe640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5000d36a0 con 0x7fb500047db0 2024-04-25T15:43:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597b59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f597c0cfc20 0x7f597c14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f96ace6d640 1 -- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105640 msgr2=0x7f96a004e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f96ace6d640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105640 0x7f96a004e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f96ace6d640 1 -- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105a50 msgr2=0x7f96a00f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f96ace6d640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105a50 0x7f96a00f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd00dffc0 con 0x7efdc80051a0 2024-04-25T15:43:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd004cb80 con 0x7efdc80051a0 2024-04-25T15:43:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f96ace6d640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01036e0 con 0x7f96a0050470 2024-04-25T15:43:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f96a7fff640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105640 0x7f96a004e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.368+0000 7f3073fff640 1 -- start start 2024-04-25T15:43:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3073fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30740cfc20 0x7f307409c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3073fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 0x7f30740b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3073fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3074156b30 0x7f30740b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3073fff640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f30740c83b0 con 0x7f30740cfc20 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3073fff640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f30740c7e90 con 0x7f3074156b30 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3073fff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f30740c8530 con 0x7f3074164550 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f597c06fed0 0x7f597c14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f597c06fed0 0x7f597c14c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44230/0 (socket says 172.21.15.80:44230) 2024-04-25T15:43:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597b59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c164550 0x7f597c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f30727fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 0x7f30740b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f30727fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 0x7f30740b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50396/0 (socket says 172.21.15.80:50396) 2024-04-25T15:43:26.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f30727fc640 1 -- 172.21.15.80:0/2363602012 learned_addr learned my addr 172.21.15.80:0/2363602012 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597b59e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f597c0c7bb0 con 0x7f597c06fed0 2024-04-25T15:43:26.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f30737fe640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3074156b30 0x7f30740b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f3072ffd640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30740cfc20 0x7f307409c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f6db097c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c5c0 0x7f6dac1f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597b59e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f597c0c78d0 con 0x7f597c164550 2024-04-25T15:43:26.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6db097c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597b59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f597c0c7e90 con 0x7f597c0cfc20 2024-04-25T15:43:26.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597a59c640 1 -- 172.21.15.80:0/775584963 learned_addr learned my addr 172.21.15.80:0/775584963 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7f597ad9d640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c164550 0x7f597c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f5979d9b640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f597c0cfc20 0x7f597c14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6daa59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f30727fc640 1 -- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3074156b30 msgr2=0x7f30740b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f30727fc640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3074156b30 0x7f30740b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f30727fc640 1 -- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30740cfc20 msgr2=0x7f307409c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f30737fe640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3074156b30 0x7f30740b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:26.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6daa59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44250/0 (socket says 172.21.15.80:44250) 2024-04-25T15:43:26.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6daa59c640 1 -- 172.21.15.80:0/2269975186 learned_addr learned my addr 172.21.15.80:0/2269975186 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac159d20 0x7f6dac0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6daad9d640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c5c0 0x7f6dac1f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac071590 con 0x7f6dac06c9d0 2024-04-25T15:43:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6dab59e640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac159d20 0x7f6dac0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f96ace6d640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 0x7f96a01031a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f969400c830 tx=0x7f969400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7fe0e4d63640 1 -- start start 2024-04-25T15:43:26.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f0fe2268640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc06cfb0 0x7f0fdc0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac071410 con 0x7f6dac06c5c0 2024-04-25T15:43:26.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f0fe2268640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc2007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe2268640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0fdc164720 0x7f0fdc0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694017070 con 0x7f96a0050470 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9694006270 con 0x7f96a0050470 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969400ce20 con 0x7f96a0050470 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f597ad9d640 1 -- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f597c0cfc20 msgr2=0x7f597c14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f597ad9d640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f597c0cfc20 0x7f597c14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f597ad9d640 1 -- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f597c06fed0 msgr2=0x7f597c14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f597ad9d640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f597c06fed0 0x7f597c14c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f597ad9d640 1 -- 172.21.15.80:0/775584963 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c0b6ff0 con 0x7f597c164550 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.371+0000 7f5979d9b640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f597c0cfc20 0x7f597c14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:26.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f597ad9d640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c164550 0x7f597c14f140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f597400ca70 tx=0x7f597400cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1266640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc06cfb0 0x7f0fdc0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe2268640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc06d7c0 con 0x7f0fdc0c50c0 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe2268640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc06d640 con 0x7f0fdc06cfb0 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe2268640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0fdc0b3690 con 0x7f0fdc164720 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1266640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc06cfb0 0x7f0fdc0d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50554/0 (socket says 172.21.15.80:50554) 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1266640 1 -- 172.21.15.80:0/4073560504 learned_addr learned my addr 172.21.15.80:0/4073560504 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe0a65640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc2007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1a67640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0fdc164720 0x7f0fdc0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6dac15fc90 con 0x7f6dac159d20 2024-04-25T15:43:26.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1a67640 1 -- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc06cfb0 msgr2=0x7f0fdc0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1a67640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc06cfb0 0x7f0fdc0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1a67640 1 -- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fdc0c50c0 msgr2=0x7f0fdc2007c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1a67640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc2007c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f0fe1a67640 1 -- 172.21.15.80:0/4073560504 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc0d17f0 con 0x7f0fdc164720 2024-04-25T15:43:26.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a0103bf0 con 0x7f96a0050470 2024-04-25T15:43:26.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a004c020 con 0x7f96a0050470 2024-04-25T15:43:26.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f0fe1a67640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0fdc164720 0x7f0fdc0cfae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400caf0 tx=0x7f0fd40020a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.372+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd00059c0 con 0x7efdc80051a0 2024-04-25T15:43:26.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efdc40039b0 con 0x7efdc80051a0 2024-04-25T15:43:26.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6daa59c640 1 -- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac159d20 msgr2=0x7f6dac0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7fe0e4d63640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d804fb40 0x7fe0d80ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6daa59c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac159d20 0x7f6dac0af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7fe0e4d63640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d8053680 0x7fe0d804e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7fe0e4d63640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 0x7fe0d804ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6daa59c640 1 -- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c5c0 msgr2=0x7f6dac1f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7fe0e4d63640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8050830 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7fe0e4d63640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8053160 con 0x7fe0d8053680 2024-04-25T15:43:26.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6daa59c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c5c0 0x7f6dac1f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7fe0e4d63640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d80348e0 con 0x7fe0d804fb40 2024-04-25T15:43:26.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7efdc3fff640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efdbc0744b0 0x7efdbc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6daa59c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac1f2170 con 0x7f6dac06c9d0 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974017070 con 0x7f597c164550 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597400ab10 con 0x7f597c164550 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974012400 con 0x7f597c164550 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597c14d000 con 0x7f597c164550 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597c14eb60 con 0x7f597c164550 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6dab59e640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac159d20 0x7f6dac0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:26.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f6daad9d640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c5c0 0x7f6dac1f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:26.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.373+0000 7f30727fc640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30740cfc20 0x7f307409c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f30727fc640 1 -- 172.21.15.80:0/2363602012 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074143850 con 0x7f3074164550 2024-04-25T15:43:26.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f3072ffd640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30740cfc20 0x7f307409c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:26.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4017070 con 0x7f0fdc164720 2024-04-25T15:43:26.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd4003da0 con 0x7f0fdc164720 2024-04-25T15:43:26.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 0x7fe0d804ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 0x7fe0d804ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44268/0 (socket says 172.21.15.80:44268) 2024-04-25T15:43:26.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 -- 172.21.15.80:0/692130823 learned_addr learned my addr 172.21.15.80:0/692130823 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:26.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4017070 con 0x7f0fdc164720 2024-04-25T15:43:26.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597c09cae0 con 0x7f597c164550 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f6daa59c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0b4380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00ec10 tx=0x7f6d9c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f30727fc640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 0x7f30740b6390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f306800d5c0 tx=0x7f306800da80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30680125f0 con 0x7f3074164550 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3068019070 con 0x7f3074164550 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30680129d0 con 0x7f3074164550 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f3073fff640 1 -- 172.21.15.80:0/2363602012 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3074142fb0 con 0x7f3074164550 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7f3073fff640 1 -- 172.21.15.80:0/2363602012 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3074143570 con 0x7f3074164550 2024-04-25T15:43:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7efdd6ffd640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efdbc0744b0 0x7efdbc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7efdd6ffd640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efdbc0744b0 0x7efdbc0769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004790 tx=0x7efdcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efdc405b5e0 con 0x7efdc80051a0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.370+0000 7fb5077fe640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 0x7fb5000d5bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d5a0 tx=0x7fb4f400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40125f0 con 0x7fb500047db0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f4019070 con 0x7fb500047db0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fb50e97d640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5000d3980 con 0x7fb500047db0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fb50e97d640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5000d3f40 con 0x7fb500047db0 2024-04-25T15:43:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 -- 172.21.15.80:0/692130823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d804fb40 msgr2=0x7fe0d80ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d804fb40 0x7fe0d80ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 -- 172.21.15.80:0/692130823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d8053680 msgr2=0x7fe0d804e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d8053680 0x7fe0d804e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.374+0000 7fe0dffff640 1 -- 172.21.15.80:0/692130823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d804af60 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7fe0dffff640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 0x7fe0d804ec80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0e006ae80 tx=0x7fe0e00757c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40129d0 con 0x7fb500047db0 2024-04-25T15:43:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7f3073fff640 1 -- 172.21.15.80:0/2363602012 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3074142d20 con 0x7f3074164550 2024-04-25T15:43:26.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fdc2037e0 con 0x7f0fdc164720 2024-04-25T15:43:26.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e0005290 con 0x7fb500047db0 2024-04-25T15:43:26.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fdc0d09a0 con 0x7f0fdc164720 2024-04-25T15:43:26.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f597401a070 con 0x7f597c164550 2024-04-25T15:43:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7f9692ffd640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a00055a0 con 0x7f96a0050470 2024-04-25T15:43:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7f596affd640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f595c074580 0x7f595c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5974095020 con 0x7f597c164550 2024-04-25T15:43:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00bc070 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e00b8610 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d8049ec0 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c017070 con 0x7f6dac06c9d0 2024-04-25T15:43:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00ed00 con 0x7f6dac06c9d0 2024-04-25T15:43:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00ce70 con 0x7f6dac06c9d0 2024-04-25T15:43:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac1f2450 con 0x7f6dac06c9d0 2024-04-25T15:43:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.375+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac1f2a10 con 0x7f6dac06c9d0 2024-04-25T15:43:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00b4040 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.376+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d804a480 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.377+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f969401a070 con 0x7f96a0050470 2024-04-25T15:43:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.377+0000 7f597a59c640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f595c074580 0x7f595c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.377+0000 7f597a59c640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f595c074580 0x7f595c076a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f596c009560 tx=0x7f596c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.377+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac0507e0 con 0x7f6dac06c9d0 2024-04-25T15:43:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.377+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fdc0d19c0 con 0x7f0fdc164720 2024-04-25T15:43:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3068012b70 con 0x7f3074164550 2024-04-25T15:43:26.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f96a57fa640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f968c0745b0 0x7f968c076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9694094810 con 0x7f96a0050470 2024-04-25T15:43:26.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f96a7fff640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f968c0745b0 0x7f968c076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f305b7fe640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f30600744b0 0x7f30600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0fd401a070 con 0x7f0fdc164720 2024-04-25T15:43:26.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3068096260 con 0x7f3074164550 2024-04-25T15:43:26.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f3072ffd640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f30600744b0 0x7f30600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.378+0000 7f96a7fff640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f968c0745b0 0x7f968c076ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f969c034000 tx=0x7f969c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.379+0000 7f0fd1ffb640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0fc00748e0 0x7f0fc0076df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.379+0000 7f3072ffd640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f30600744b0 0x7f30600769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f306c0012e0 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.379+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0fd4003ba0 con 0x7f0fdc164720 2024-04-25T15:43:26.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.379+0000 7f0fe1266640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0fc00748e0 0x7f0fc0076df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.379+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d8049c30 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.379+0000 7f0fe1266640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0fc00748e0 0x7f0fc0076df0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80095e0 tx=0x7f0fd8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.382+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efdd00cf6f0 con 0x7efdc80051a0 2024-04-25T15:43:26.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.384+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb4f4012b70 con 0x7fb500047db0 2024-04-25T15:43:26.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.384+0000 7fb504ff9640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4ec074530 0x7fb4ec076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.384+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6d9c01a070 con 0x7f6dac06c9d0 2024-04-25T15:43:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.385+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe0e00bf070 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.385+0000 7fb507fff640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4ec074530 0x7fb4ec076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.385+0000 7f6d937fe640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d98074500 0x7f6d98076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.385+0000 7fe0cbfff640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0c4074530 0x7fe0c4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.385+0000 7fe0df7fe640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0c4074530 0x7fe0c4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.385+0000 7f6daad9d640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d98074500 0x7f6d98076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.386+0000 7fb507fff640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4ec074530 0x7fb4ec076a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc034000 tx=0x7fb4fc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.386+0000 7f6daad9d640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d98074500 0x7f6d98076a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6da0006fd0 tx=0x7f6da000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.386+0000 7fe0df7fe640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0c4074530 0x7fe0c4076a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8008200 tx=0x7fe0d4007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.387+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f597c09cae0 con 0x7f597c164550 2024-04-25T15:43:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.388+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3068060140 con 0x7f3074164550 2024-04-25T15:43:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.390+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb4f4012e60 con 0x7fb500047db0 2024-04-25T15:43:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.390+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f969405ed60 con 0x7f96a0050470 2024-04-25T15:43:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.390+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d9c05bc90 con 0x7f6dac06c9d0 2024-04-25T15:43:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.391+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe0e00a7ae0 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.393+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0fdc06d3c0 con 0x7f0fdc164720 2024-04-25T15:43:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.401+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4f4060830 con 0x7fb500047db0 2024-04-25T15:43:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.415+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d9c060100 con 0x7f6dac06c9d0 2024-04-25T15:43:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.425+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0e00fcbb0 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.785+0000 7f3073fff640 1 -- 172.21.15.80:0/2363602012 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f307406dd70 con 0x7f3074164550 2024-04-25T15:43:26.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.786+0000 7f305b7fe640 1 -- 172.21.15.80:0/2363602012 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f307406dd70 con 0x7f3074164550 2024-04-25T15:43:26.787 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:26.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 -- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f30600744b0 msgr2=0x7f30600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f30600744b0 0x7f30600769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f306c0012e0 tx=0x7f306c009040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 -- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 msgr2=0x7f30740b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 0x7f30740b6390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f306800d5c0 tx=0x7f306800da80 comp rx=0 tx=0).stop 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 -- 172.21.15.80:0/2363602012 shutdown_connections 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f30600744b0 0x7f30600769c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3074156b30 0x7f30740b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3074164550 0x7f30740b6390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 --2- 172.21.15.80:0/2363602012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30740cfc20 0x7f307409c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.789+0000 7f30597fa640 1 -- 172.21.15.80:0/2363602012 >> 172.21.15.80:0/2363602012 conn(0x7f30740d2320 msgr2=0x7f30740b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.790+0000 7f30597fa640 1 -- 172.21.15.80:0/2363602012 shutdown_connections 2024-04-25T15:43:26.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.790+0000 7f30597fa640 1 -- 172.21.15.80:0/2363602012 wait complete. 2024-04-25T15:43:26.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.796+0000 7f9692ffd640 1 -- 172.21.15.80:0/2457385013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f96a00f9cc0 con 0x7f96a0050470 2024-04-25T15:43:26.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.797+0000 7f96a57fa640 1 -- 172.21.15.80:0/2457385013 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f969405e660 con 0x7f96a0050470 2024-04-25T15:43:26.798 INFO:teuthology.orchestra.run.smithi080.stdout:60129542153 2024-04-25T15:43:26.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.801+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f968c0745b0 msgr2=0x7f968c076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.801+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f968c0745b0 0x7f968c076ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f969c034000 tx=0x7f969c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:26.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.801+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 msgr2=0x7f96a01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.801+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 0x7f96a01031a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f969400c830 tx=0x7f969400ccf0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 shutdown_connections 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f968c0745b0 0x7f968c076ac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a0105a50 0x7f96a00f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a0105640 0x7f96a004e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 --2- 172.21.15.80:0/2457385013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96a0050470 0x7f96a01031a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 >> 172.21.15.80:0/2457385013 conn(0x7f96a0054d20 msgr2=0x7f96a0055130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 shutdown_connections 2024-04-25T15:43:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.803+0000 7f96af0d1640 1 -- 172.21.15.80:0/2457385013 wait complete. 2024-04-25T15:43:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.806+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0fdc0507b0 con 0x7f0fdc164720 2024-04-25T15:43:26.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2024-04-25T15:43:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.807+0000 7f0fd1ffb640 1 -- 172.21.15.80:0/4073560504 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0fd405e4b0 con 0x7f0fdc164720 2024-04-25T15:43:26.808 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-25T15:43:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.807+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efdd00de7f0 con 0x7efdc80051a0 2024-04-25T15:43:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.808+0000 7efdc3fff640 1 -- 172.21.15.80:0/3621476133 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efdc405f6f0 con 0x7efdc80051a0 2024-04-25T15:43:26.809 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-04-25T15:43:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0fc00748e0 msgr2=0x7f0fc0076df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0fc00748e0 0x7f0fc0076df0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80095e0 tx=0x7f0fd8009190 comp rx=0 tx=0).stop 2024-04-25T15:43:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0fdc164720 msgr2=0x7f0fdc0cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0fdc164720 0x7f0fdc0cfae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400caf0 tx=0x7f0fd40020a0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 shutdown_connections 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0fc00748e0 0x7f0fc0076df0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0fdc164720 0x7f0fdc0cfae0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fdc0c50c0 0x7f0fdc2007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 --2- 172.21.15.80:0/4073560504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fdc06cfb0 0x7f0fdc0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 >> 172.21.15.80:0/4073560504 conn(0x7f0fdc09b410 msgr2=0x7f0fdc0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 shutdown_connections 2024-04-25T15:43:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.810+0000 7f0fe2268640 1 -- 172.21.15.80:0/4073560504 wait complete. 2024-04-25T15:43:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.812+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efdbc0744b0 msgr2=0x7efdbc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.812+0000 7efddcb8c640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efdbc0744b0 0x7efdbc0769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004790 tx=0x7efdcc008040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.812+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 msgr2=0x7efdd01784b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.812+0000 7efddcb8c640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 0x7efdd01784b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efdc400f5a0 tx=0x7efdc400fa60 comp rx=0 tx=0).stop 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 shutdown_connections 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efdbc0744b0 0x7efdbc0769c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdd00cf2e0 0x7efdd0048c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdd0048150 0x7efdd00ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 --2- 172.21.15.80:0/3621476133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc80051a0 0x7efdd01784b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 >> 172.21.15.80:0/3621476133 conn(0x7efdd0055140 msgr2=0x7efdd00d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 shutdown_connections 2024-04-25T15:43:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7efddcb8c640 1 -- 172.21.15.80:0/3621476133 wait complete. 2024-04-25T15:43:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.813+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f597c0b6d80 con 0x7f597c164550 2024-04-25T15:43:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.814+0000 7f596affd640 1 -- 172.21.15.80:0/775584963 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f597c0702e0 con 0x7f597c164550 2024-04-25T15:43:26.815 INFO:teuthology.orchestra.run.smithi080.stdout:60129542153 2024-04-25T15:43:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.817+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb4e0005850 con 0x7fb500047db0 2024-04-25T15:43:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.817+0000 7fb504ff9640 1 -- 172.21.15.80:0/3612413259 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4f4060130 con 0x7fb500047db0 2024-04-25T15:43:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.817+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f595c074580 msgr2=0x7f595c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.817+0000 7f597b59e640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f595c074580 0x7f595c076a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f596c009560 tx=0x7f596c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:26.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.817+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c164550 msgr2=0x7f597c14f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.817+0000 7f597b59e640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c164550 0x7f597c14f140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f597400ca70 tx=0x7f597400cf30 comp rx=0 tx=0).stop 2024-04-25T15:43:26.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 shutdown_connections 2024-04-25T15:43:26.819 INFO:teuthology.orchestra.run.smithi080.stdout:60129542153 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f595c074580 0x7f595c076a90 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f596c009560 tx=0x7f596c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f597c164550 0x7f597c14f140 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f597c0cfc20 0x7f597c14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 --2- 172.21.15.80:0/775584963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f597c06fed0 0x7f597c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 >> 172.21.15.80:0/775584963 conn(0x7f597c0d2320 msgr2=0x7f597c073300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 shutdown_connections 2024-04-25T15:43:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.818+0000 7f597b59e640 1 -- 172.21.15.80:0/775584963 wait complete. 2024-04-25T15:43:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4ec074530 msgr2=0x7fb4ec076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4ec074530 0x7fb4ec076a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc034000 tx=0x7fb4fc02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 msgr2=0x7fb5000d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 0x7fb5000d5bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d5a0 tx=0x7fb4f400da60 comp rx=0 tx=0).stop 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 shutdown_connections 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4ec074530 0x7fb4ec076a40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb500048300 0x7fb5000d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb500047db0 0x7fb5000d5bd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 --2- 172.21.15.80:0/3612413259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb500033e90 0x7fb5000d5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.820+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 >> 172.21.15.80:0/3612413259 conn(0x7fb500054cf0 msgr2=0x7fb500053330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.821+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 shutdown_connections 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.821+0000 7fb4f27fc640 1 -- 172.21.15.80:0/3612413259 wait complete. 2024-04-25T15:43:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.821+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6dac06fe20 con 0x7f6dac06c9d0 2024-04-25T15:43:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.822+0000 7f6d937fe640 1 -- 172.21.15.80:0/2269975186 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d9c05fa00 con 0x7f6dac06c9d0 2024-04-25T15:43:26.823 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-04-25T15:43:26.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2024-04-25T15:43:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d98074500 msgr2=0x7f6d98076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d98074500 0x7f6d98076a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6da0006fd0 tx=0x7f6da000d040 comp rx=0 tx=0).stop 2024-04-25T15:43:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 msgr2=0x7f6dac0b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0b4380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00ec10 tx=0x7f6d9c00c520 comp rx=0 tx=0).stop 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 shutdown_connections 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d98074500 0x7f6d98076a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6dac159d20 0x7f6dac0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dac06c9d0 0x7f6dac0b4380 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 --2- 172.21.15.80:0/2269975186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac06c5c0 0x7f6dac1f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 >> 172.21.15.80:0/2269975186 conn(0x7f6dac0d2320 msgr2=0x7f6dac1521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 shutdown_connections 2024-04-25T15:43:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.826+0000 7f6db097c640 1 -- 172.21.15.80:0/2269975186 wait complete. 2024-04-25T15:43:26.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-25T15:43:26.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-25T15:43:26.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-04-25T15:43:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.838+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe0d80059c0 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.838+0000 7fe0cbfff640 1 -- 172.21.15.80:0/692130823 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0e00fc4b0 con 0x7fe0d80e7ed0 2024-04-25T15:43:26.840 INFO:teuthology.orchestra.run.smithi080.stdout:60129542155 2024-04-25T15:43:26.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0c4074530 msgr2=0x7fe0c4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0c4074530 0x7fe0c4076a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8008200 tx=0x7fe0d4007a40 comp rx=0 tx=0).stop 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 msgr2=0x7fe0d804ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 0x7fe0d804ec80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0e006ae80 tx=0x7fe0e00757c0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 shutdown_connections 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0c4074530 0x7fe0c4076a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0d80e7ed0 0x7fe0d804ec80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d8053680 0x7fe0d804e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 --2- 172.21.15.80:0/692130823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d804fb40 0x7fe0d80ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.841+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 >> 172.21.15.80:0/692130823 conn(0x7fe0d800aa70 msgr2=0x7fe0d80e70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.842+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 shutdown_connections 2024-04-25T15:43:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:26.842+0000 7fe0e4d63640 1 -- 172.21.15.80:0/692130823 wait complete. 2024-04-25T15:43:26.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-25T15:43:26.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.1 2024-04-25T15:43:27.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:43:27.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:43:27.830 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:43:27.835 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:43:27.840 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:43:27.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:43:27.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:43:27.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:43:27.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.983+0000 7f9b4ca92640 1 Processor -- start 2024-04-25T15:43:27.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.983+0000 7f9b4ca92640 1 -- start start 2024-04-25T15:43:27.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.987+0000 7f9b4ca92640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b480af310 0x7f9b48164550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:27.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b4ca92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48070b30 0x7f9b4806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:27.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b4ca92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b48071260 con 0x7f9b48168ad0 2024-04-25T15:43:27.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b4ca92640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9b480b6100 con 0x7f9b480af310 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b4ca92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9b480b63e0 con 0x7f9b48070b30 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b45d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9b48168ad0 0x7f9b48070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41846/0 (socket says 172.21.15.80:41846) 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b45d9b640 1 -- 172.21.15.80:0/3301110195 learned_addr learned my addr 172.21.15.80:0/3301110195 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b46d9d640 1 --2- 172.21.15.80:0/3301110195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48070b30 0x7f9b4806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.988+0000 7f9b4659c640 1 --2- 172.21.15.80:0/3301110195 >> v2:172.21.15.80:3300/0 conn(0x7f9b480af310 0x7f9b48164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.989+0000 7f9b4659c640 1 -- 172.21.15.80:0/3301110195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48070b30 msgr2=0x7f9b4806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.989+0000 7f9b4659c640 1 --2- 172.21.15.80:0/3301110195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48070b30 0x7f9b4806d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.989+0000 7f9b4659c640 1 -- 172.21.15.80:0/3301110195 >> v1:172.21.15.80:6789/0 conn(0x7f9b48168ad0 legacy=0x7f9b48070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.989+0000 7f9b4659c640 1 -- 172.21.15.80:0/3301110195 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4806c5c0 con 0x7f9b480af310 2024-04-25T15:43:27.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.997+0000 7f9b4659c640 1 --2- 172.21.15.80:0/3301110195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b480af310 0x7f9b48164550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0097a0 tx=0x7f9b3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a6e77a6cb404b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.997+0000 7f9b4559a640 1 -- 172.21.15.80:0/3301110195 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c037070 con 0x7f9b480af310 2024-04-25T15:43:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.997+0000 7f9b4559a640 1 -- 172.21.15.80:0/3301110195 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c032440 con 0x7f9b480af310 2024-04-25T15:43:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.999+0000 7f9b4ca92640 1 -- 172.21.15.80:0/3301110195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b480af310 msgr2=0x7f9b48164550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:27.999+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/3301110195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b480af310 0x7f9b48164550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0097a0 tx=0x7f9b3c02a180 comp rx=0 tx=0).stop 2024-04-25T15:43:28.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.000+0000 7f9b4ca92640 1 -- 172.21.15.80:0/3301110195 shutdown_connections 2024-04-25T15:43:28.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.000+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/3301110195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48070b30 0x7f9b4806d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.000+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/3301110195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b480af310 0x7f9b48164550 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.000+0000 7f9b4ca92640 1 -- 172.21.15.80:0/3301110195 >> 172.21.15.80:0/3301110195 conn(0x7f9b480d19d0 msgr2=0x7f9b480d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.000+0000 7f9b4ca92640 1 -- 172.21.15.80:0/3301110195 shutdown_connections 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.000+0000 7f9b4ca92640 1 -- 172.21.15.80:0/3301110195 wait complete. 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.003+0000 7f9b4ca92640 1 Processor -- start 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.003+0000 7f9b4ca92640 1 -- start start 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.005+0000 7f9b4ca92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b480af310 0x7f9b4815f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.005+0000 7f9b4ca92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48168ad0 0x7f9b4814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.005+0000 7f9b4ca92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 0x7f9b4814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 0x7f9b4814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 0x7f9b4814b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44282/0 (socket says 172.21.15.80:44282) 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 -- 172.21.15.80:0/2062984534 learned_addr learned my addr 172.21.15.80:0/2062984534 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48168ee0 con 0x7f9b4815f840 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4806cb80 con 0x7f9b480af310 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9b48169060 con 0x7f9b48168ad0 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 -- 172.21.15.80:0/2062984534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48168ad0 msgr2=0x7f9b4814b4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48168ad0 0x7f9b4814b4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 -- 172.21.15.80:0/2062984534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b480af310 msgr2=0x7f9b4815f300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b480af310 0x7f9b4815f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.006+0000 7f9b46d9d640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b480d0290 con 0x7f9b4815f840 2024-04-25T15:43:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.007+0000 7f9b46d9d640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 0x7f9b4814b9e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009f60 tx=0x7f9b40009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.010+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40018020 con 0x7f9b4815f840 2024-04-25T15:43:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.010+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4814a9c0 con 0x7f9b4815f840 2024-04-25T15:43:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.012+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4000bd00 con 0x7f9b4815f840 2024-04-25T15:43:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.013+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4814af80 con 0x7f9b4815f840 2024-04-25T15:43:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.014+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40014640 con 0x7f9b4815f840 2024-04-25T15:43:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.015+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9b4001b020 con 0x7f9b4815f840 2024-04-25T15:43:28.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.016+0000 7f9b36ffd640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b280745e0 0x7f9b28076af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.016+0000 7f9b4659c640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b280745e0 0x7f9b28076af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.016+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9b400950d0 con 0x7f9b4815f840 2024-04-25T15:43:28.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.018+0000 7f9b34ff9640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4806a100 con 0x7f9b4815f840 2024-04-25T15:43:28.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.024+0000 7f9b4659c640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b280745e0 0x7f9b28076af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c034000 tx=0x7f9b3c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.028+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b4005f630 con 0x7f9b4815f840 2024-04-25T15:43:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.045+0000 7f43b359e640 1 Processor -- start 2024-04-25T15:43:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.045+0000 7f43b359e640 1 -- start start 2024-04-25T15:43:28.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.047+0000 7f277acab640 1 Processor -- start 2024-04-25T15:43:28.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.048+0000 7f277acab640 1 -- start start 2024-04-25T15:43:28.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.048+0000 7f43b359e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43b40cfa90 0x7f43b4161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.048+0000 7f43b259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43b40cfa90 0x7f43b4161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.048+0000 7f43b259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43b40cfa90 0x7f43b4161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44284/0 (socket says 172.21.15.80:44284) 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.048+0000 7f43b259c640 1 -- 172.21.15.80:0/392962177 learned_addr learned my addr 172.21.15.80:0/392962177 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.048+0000 7f43b359e640 1 --2- 172.21.15.80:0/392962177 >> v2:172.21.15.195:3300/0 conn(0x7f43b4161fa0 0x7f43b41623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.049+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b40702f0 con 0x7f43b415e470 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.049+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f43b41628f0 con 0x7f43b40cfa90 2024-04-25T15:43:28.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.049+0000 7f7be72e4640 1 Processor -- start 2024-04-25T15:43:28.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.049+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43b4070f00 con 0x7f43b4161fa0 2024-04-25T15:43:28.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f43b1d9b640 1 --2- 172.21.15.80:0/392962177 >> v2:172.21.15.195:3300/0 conn(0x7f43b4161fa0 0x7f43b41623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f277acab640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f276c0e12c0 0x7f276c04f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f277acab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f276c04fee0 0x7f276c053ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f277acab640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c053030 con 0x7f276c006090 2024-04-25T15:43:28.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f277acab640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f276c04f6c0 con 0x7f276c04fee0 2024-04-25T15:43:28.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f277acab640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0532d0 con 0x7f276c0e12c0 2024-04-25T15:43:28.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.049+0000 7f7be72e4640 1 -- start start 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f276c04fee0 0x7f276c053ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f276c04fee0 0x7f276c053ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44294/0 (socket says 172.21.15.80:44294) 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 -- 172.21.15.80:0/2188195696 learned_addr learned my addr 172.21.15.80:0/2188195696 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f27794a8640 1 --2- 172.21.15.80:0/2188195696 >> v2:172.21.15.195:3300/0 conn(0x7f276c0e12c0 0x7f276c04f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 -- 172.21.15.80:0/2188195696 >> v2:172.21.15.195:3300/0 conn(0x7f276c0e12c0 msgr2=0x7f276c04f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f7be72e4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 0x7f7bd80e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f7be72e4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd8050460 con 0x7f7bd8033950 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f7be72e4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd80e3520 con 0x7f7bd8053de0 2024-04-25T15:43:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f7be72e4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd80e3850 con 0x7f7bd80e0350 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 --2- 172.21.15.80:0/2188195696 >> v2:172.21.15.195:3300/0 conn(0x7f276c0e12c0 0x7f276c04f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 -- 172.21.15.80:0/2188195696 >> v1:172.21.15.80:6789/0 conn(0x7f276c006090 legacy=0x7f276c0e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.051+0000 7f277a4aa640 1 -- 172.21.15.80:0/2188195696 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0535b0 con 0x7f276c04fee0 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f43b259c640 1 -- 172.21.15.80:0/392962177 >> v2:172.21.15.195:3300/0 conn(0x7f43b4161fa0 msgr2=0x7f43b41623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f43b259c640 1 --2- 172.21.15.80:0/392962177 >> v2:172.21.15.195:3300/0 conn(0x7f43b4161fa0 0x7f43b41623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f43b259c640 1 -- 172.21.15.80:0/392962177 >> v1:172.21.15.195:6789/0 conn(0x7f43b415e470 legacy=0x7f43b415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.050+0000 7f43b259c640 1 -- 172.21.15.80:0/392962177 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b40705d0 con 0x7f43b40cfa90 2024-04-25T15:43:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.052+0000 7f7be62e2640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7bd8053de0 0x7f7bd80e3ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45060/0 (socket says 172.21.15.80:45060) 2024-04-25T15:43:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.052+0000 7f7be5ae1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7bd8033950 0x7f7bd8033d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41872/0 (socket says 172.21.15.80:41872) 2024-04-25T15:43:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.052+0000 7f7be5ae1640 1 -- 172.21.15.80:0/3998055130 learned_addr learned my addr 172.21.15.80:0/3998055130 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.052+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 0x7f7bd80e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.052+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054649173 0 0) 0x7f7bd80e3520 con 0x7f7bd8053de0 2024-04-25T15:43:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.052+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc003520 con 0x7f7bd8053de0 2024-04-25T15:43:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2108537398 0 0) 0x7f7bd8050460 con 0x7f7bd8033950 2024-04-25T15:43:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd80e3520 con 0x7f7bd8033950 2024-04-25T15:43:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1983825107 0 0) 0x7f7bcc003520 con 0x7f7bd8053de0 2024-04-25T15:43:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f43b259c640 1 --2- 172.21.15.80:0/392962177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b40cfa90 0x7f43b4161a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43b409faa0 tx=0x7f43a402a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c599abbec1d717 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 msgr2=0x7f7bd80e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 0x7f7bd80e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 >> v1:172.21.15.80:6789/0 conn(0x7f7bd8033950 legacy=0x7f7bd8033d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd8050700 con 0x7f7bd8053de0 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f7bd0001690 con 0x7f7bd8053de0 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 >> v1:172.21.15.195:6789/0 conn(0x7f7bd8053de0 legacy=0x7f7bd80e3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f43b159a640 1 -- 172.21.15.80:0/392962177 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4036070 con 0x7f43b40cfa90 2024-04-25T15:43:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 0x7f7bcc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bcc004110 0x7f7bcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f43b159a640 1 -- 172.21.15.80:0/392962177 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4031600 con 0x7f43b40cfa90 2024-04-25T15:43:28.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be62e2640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 0x7f7bcc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.053+0000 7f7be52e0640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bcc004e90 0x7f7bcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd80e3850 con 0x7f7bcc004110 2024-04-25T15:43:28.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f72b7e20640 1 Processor -- start 2024-04-25T15:43:28.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc00bf00 con 0x7f7bcc004e90 2024-04-25T15:43:28.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc00c080 con 0x7f7bd80e0350 2024-04-25T15:43:28.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be5ae1640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bcc004110 0x7f7bcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f3d5709e640 1 Processor -- start 2024-04-25T15:43:28.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bcc004e90 0x7f7bcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f3d5709e640 1 -- start start 2024-04-25T15:43:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f72b7e20640 1 -- start start 2024-04-25T15:43:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be6ae3640 1 -- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 msgr2=0x7f7bcc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80e0350 0x7f7bcc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f7be6ae3640 1 -- 172.21.15.80:0/3998055130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bcc004110 msgr2=0x7f7bcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.054+0000 7f43b159a640 1 -- 172.21.15.80:0/392962177 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4031a10 con 0x7f43b40cfa90 2024-04-25T15:43:28.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b40cfa90 msgr2=0x7f43b4161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 --2- 172.21.15.80:0/392962177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b40cfa90 0x7f43b4161a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43b409faa0 tx=0x7f43a402a4a0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f277a4aa640 1 --2- 172.21.15.80:0/2188195696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c04fee0 0x7f276c053ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f27740520f0 tx=0x7f27740a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f45038f1ac63a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 shutdown_connections 2024-04-25T15:43:28.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 --2- 172.21.15.80:0/392962177 >> v2:172.21.15.195:3300/0 conn(0x7f43b4161fa0 0x7f43b41623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 --2- 172.21.15.80:0/392962177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b40cfa90 0x7f43b4161a60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 >> 172.21.15.80:0/392962177 conn(0x7f43b40d1ee0 msgr2=0x7f43b40ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 shutdown_connections 2024-04-25T15:43:28.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bcc004110 0x7f7bcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f43b359e640 1 -- 172.21.15.80:0/392962177 wait complete. 2024-04-25T15:43:28.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f7be6ae3640 1 -- 172.21.15.80:0/3998055130 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc003520 con 0x7f7bcc004e90 2024-04-25T15:43:28.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.055+0000 7f2778ca7640 1 -- 172.21.15.80:0/2188195696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740b4070 con 0x7f276c04fee0 2024-04-25T15:43:28.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.056+0000 7f2778ca7640 1 -- 172.21.15.80:0/2188195696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27740a7c30 con 0x7f276c04fee0 2024-04-25T15:43:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.056+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bcc004e90 0x7f7bcc00b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7be00514f0 tx=0x7f7bcc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6224b2ab2648a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.056+0000 7f72b7e20640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b00b2c90 0x7f72b0161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.056+0000 7f3d5609c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3d48052420 0x7f3d48049b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41890/0 (socket says 172.21.15.80:41890) 2024-04-25T15:43:28.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.056+0000 7f3d5609c640 1 -- 172.21.15.80:0/3014583900 learned_addr learned my addr 172.21.15.80:0/3014583900 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:28.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b7e20640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b00ce680 con 0x7f72b00cf6c0 2024-04-25T15:43:28.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3014583900 >> v2:172.21.15.80:3300/0 conn(0x7f3d48035fd0 0x7f3d48055f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b5bbc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f72b00cf6c0 0x7f72b0160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41884/0 (socket says 172.21.15.80:41884) 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b5bbc640 1 -- 172.21.15.80:0/2110160125 learned_addr learned my addr 172.21.15.80:0/2110160125 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b63bd640 1 --1- 172.21.15.80:0/2110160125 >> v1:172.21.15.195:6789/0 conn(0x7f72b00718b0 0x7f72b0071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45076/0 (socket says 172.21.15.80:45076) 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b53bb640 1 --2- 172.21.15.80:0/2110160125 >> v2:172.21.15.80:3300/0 conn(0x7f72b00b2c90 0x7f72b0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b7e20640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b00b30a0 con 0x7f72b00718b0 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f277acab640 1 -- 172.21.15.80:0/2188195696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c04fee0 msgr2=0x7f276c053ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f277acab640 1 --2- 172.21.15.80:0/2188195696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c04fee0 0x7f276c053ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f27740520f0 tx=0x7f27740a7070 comp rx=0 tx=0).stop 2024-04-25T15:43:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f72b7e20640 1 -- 172.21.15.80:0/2110160125 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00ce920 con 0x7f72b00b2c90 2024-04-25T15:43:28.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5589b640 1 --2- 172.21.15.80:0/3014583900 >> v2:172.21.15.80:3300/0 conn(0x7f3d48035fd0 0x7f3d48055f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3014583900 >> v2:172.21.15.195:3300/0 conn(0x7f3d4804a210 0x7f3d480eb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d48051f70 con 0x7f3d48052420 2024-04-25T15:43:28.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4803a1d0 con 0x7f3d48035fd0 2024-04-25T15:43:28.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3d48056a50 con 0x7f3d4804a210 2024-04-25T15:43:28.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f3d5689d640 1 --2- 172.21.15.80:0/3014583900 >> v2:172.21.15.195:3300/0 conn(0x7f3d4804a210 0x7f3d480eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f7be5ae1640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bcc004110 0x7f7bcc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:28.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be00b7070 con 0x7f7bcc004e90 2024-04-25T15:43:28.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.057+0000 7f7be52e0640 1 -- 172.21.15.80:0/3998055130 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be00b2410 con 0x7f7bcc004e90 2024-04-25T15:43:28.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f72b53bb640 1 -- 172.21.15.80:0/2110160125 >> v1:172.21.15.195:6789/0 conn(0x7f72b00718b0 legacy=0x7f72b0071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f3d5589b640 1 -- 172.21.15.80:0/3014583900 >> v2:172.21.15.195:3300/0 conn(0x7f3d4804a210 msgr2=0x7f3d480eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f3d5589b640 1 --2- 172.21.15.80:0/3014583900 >> v2:172.21.15.195:3300/0 conn(0x7f3d4804a210 0x7f3d480eb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f3d5589b640 1 -- 172.21.15.80:0/3014583900 >> v1:172.21.15.80:6789/0 conn(0x7f3d48052420 legacy=0x7f3d48049b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f3d5589b640 1 -- 172.21.15.80:0/3014583900 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d48039ef0 con 0x7f3d48035fd0 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f277acab640 1 -- 172.21.15.80:0/2188195696 shutdown_connections 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f277acab640 1 --2- 172.21.15.80:0/2188195696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c04fee0 0x7f276c053ad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f277acab640 1 --2- 172.21.15.80:0/2188195696 >> v2:172.21.15.195:3300/0 conn(0x7f276c0e12c0 0x7f276c04f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f277acab640 1 -- 172.21.15.80:0/2188195696 >> 172.21.15.80:0/2188195696 conn(0x7f276c054cf0 msgr2=0x7f276c055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f277acab640 1 -- 172.21.15.80:0/2188195696 shutdown_connections 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f72b4bba640 1 -- 172.21.15.80:0/2110160125 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982619180 0 0) 0x7f72b00b30a0 con 0x7f72b00718b0 2024-04-25T15:43:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f72b53bb640 1 -- 172.21.15.80:0/2110160125 >> v1:172.21.15.80:6789/0 conn(0x7f72b00cf6c0 legacy=0x7f72b0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f43b359e640 1 Processor -- start 2024-04-25T15:43:28.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f7be72e4640 1 -- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bcc004e90 msgr2=0x7f7bcc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f7be72e4640 1 --2- 172.21.15.80:0/3998055130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bcc004e90 0x7f7bcc00b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7be00514f0 tx=0x7f7bcc005830 comp rx=0 tx=0).stop 2024-04-25T15:43:28.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f72b53bb640 1 -- 172.21.15.80:0/2110160125 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00cec00 con 0x7f72b00b2c90 2024-04-25T15:43:28.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.058+0000 7f277acab640 1 -- 172.21.15.80:0/2188195696 wait complete. 2024-04-25T15:43:28.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f43b359e640 1 -- start start 2024-04-25T15:43:28.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f7be6ae3640 1 -- 172.21.15.80:0/3998055130 reap_dead start 2024-04-25T15:43:28.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f3d5589b640 1 --2- 172.21.15.80:0/3014583900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d48035fd0 0x7f3d48055f60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d480e5d50 tx=0x7f3d4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3634ac589fcf98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f3d5509a640 1 -- 172.21.15.80:0/3014583900 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c037070 con 0x7f3d48035fd0 2024-04-25T15:43:28.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f7be72e4640 1 -- 172.21.15.80:0/3998055130 shutdown_connections 2024-04-25T15:43:28.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f7be72e4640 1 -- 172.21.15.80:0/3998055130 >> 172.21.15.80:0/3998055130 conn(0x7f7bd8054cf0 msgr2=0x7f7bd8055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f3d5509a640 1 -- 172.21.15.80:0/3014583900 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c032440 con 0x7f3d48035fd0 2024-04-25T15:43:28.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f3d5509a640 1 -- 172.21.15.80:0/3014583900 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c032810 con 0x7f3d48035fd0 2024-04-25T15:43:28.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f3d8cb5e640 1 Processor -- start 2024-04-25T15:43:28.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f3d8cb5e640 1 -- start start 2024-04-25T15:43:28.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f72b53bb640 1 --2- 172.21.15.80:0/2110160125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00b2c90 0x7f72b0161230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0097a0 tx=0x7f72ac02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84072ed8570e6568 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.059+0000 7f7be72e4640 1 -- 172.21.15.80:0/3998055130 shutdown_connections 2024-04-25T15:43:28.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f72b4bba640 1 -- 172.21.15.80:0/2110160125 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac037070 con 0x7f72b00b2c90 2024-04-25T15:43:28.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f72b4bba640 1 -- 172.21.15.80:0/2110160125 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac02ad30 con 0x7f72b00b2c90 2024-04-25T15:43:28.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f72b4bba640 1 -- 172.21.15.80:0/2110160125 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac032660 con 0x7f72b00b2c90 2024-04-25T15:43:28.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d48035fd0 msgr2=0x7f3d48055f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3014583900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d48035fd0 0x7f3d48055f60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d480e5d50 tx=0x7f3d4c02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.060+0000 7f7be72e4640 1 -- 172.21.15.80:0/3998055130 wait complete. 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f277acab640 1 Processor -- start 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 shutdown_connections 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3014583900 >> v2:172.21.15.195:3300/0 conn(0x7f3d4804a210 0x7f3d480eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3014583900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d48035fd0 0x7f3d48055f60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 >> 172.21.15.80:0/3014583900 conn(0x7f3d4800c3f0 msgr2=0x7f3d4800c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 shutdown_connections 2024-04-25T15:43:28.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f3d5709e640 1 -- 172.21.15.80:0/3014583900 wait complete. 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f277acab640 1 -- start start 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f3d8cb5e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d880d12e0 0x7f3d880d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f3d8cb5e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880b7de0 0x7f3d880ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f3d8cb5e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d880b9620 con 0x7f3d881604b0 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f3d8cb5e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3d880d16f0 con 0x7f3d880d12e0 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f3d8cb5e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d880d1c10 con 0x7f3d880b7de0 2024-04-25T15:43:28.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f3d8659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d880d12e0 0x7f3d880d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d86d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880b7de0 0x7f3d880ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d8659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d880d12e0 0x7f3d880d4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44332/0 (socket says 172.21.15.80:44332) 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d8659c640 1 -- 172.21.15.80:0/2576204029 learned_addr learned my addr 172.21.15.80:0/2576204029 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f43b359e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b40cfa90 0x7f43b41489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f43b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 0x7f43b41e7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.061+0000 7f43b359e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161fa0 0x7f43b40b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 0x7f43b41e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b359e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40cfea0 con 0x7f43b415e470 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b359e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43b4070b90 con 0x7f43b40cfa90 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b359e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43b415bd40 con 0x7f43b4161fa0 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 0x7f43b41e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44322/0 (socket says 172.21.15.80:44322) 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 -- 172.21.15.80:0/3402730934 learned_addr learned my addr 172.21.15.80:0/3402730934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b259c640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b40cfa90 0x7f43b41489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b2d9d640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161fa0 0x7f43b40b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 -- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161fa0 msgr2=0x7f43b40b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161fa0 0x7f43b40b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 -- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b40cfa90 msgr2=0x7f43b41489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b40cfa90 0x7f43b41489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f43b1d9b640 1 -- 172.21.15.80:0/3402730934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b41e8400 con 0x7f43b415e470 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f43b1d9b640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 0x7f43b41e7780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43a800d620 tx=0x7f43a800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 -- 172.21.15.80:0/2110160125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00b2c90 msgr2=0x7f72b0161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 --2- 172.21.15.80:0/2110160125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00b2c90 0x7f72b0161230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0097a0 tx=0x7f72ac02a0a0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 -- 172.21.15.80:0/2110160125 shutdown_connections 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 --2- 172.21.15.80:0/2110160125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00b2c90 0x7f72b0161230 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 -- 172.21.15.80:0/2110160125 >> 172.21.15.80:0/2110160125 conn(0x7f72b00d3a30 msgr2=0x7f72b00d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 -- 172.21.15.80:0/2110160125 shutdown_connections 2024-04-25T15:43:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.062+0000 7f72b7e20640 1 -- 172.21.15.80:0/2110160125 wait complete. 2024-04-25T15:43:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f7be72e4640 1 Processor -- start 2024-04-25T15:43:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a800b620 con 0x7f43b415e470 2024-04-25T15:43:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f277acab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c006090 0x7f276c179e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f277acab640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 0x7f276c17a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f277acab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c0e12c0 0x7f276c04e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f277acab640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f276c04f340 con 0x7f276c006090 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f277acab640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0344c0 con 0x7f276c04fee0 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f277acab640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0502f0 con 0x7f276c0e12c0 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d8659c640 1 -- 172.21.15.80:0/2576204029 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880b7de0 msgr2=0x7f3d880ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d8659c640 1 --2- 172.21.15.80:0/2576204029 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880b7de0 0x7f3d880ba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d8659c640 1 -- 172.21.15.80:0/2576204029 >> v1:172.21.15.195:6789/0 conn(0x7f3d881604b0 legacy=0x7f3d880b76d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:43:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.063+0000 7f3d8659c640 1 -- 172.21.15.80:0/2576204029 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d880d1930 con 0x7f3d880d12e0 2024-04-25T15:43:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f7be72e4640 1 -- start start 2024-04-25T15:43:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8019070 con 0x7f43b415e470 2024-04-25T15:43:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b414b5b0 con 0x7f43b415e470 2024-04-25T15:43:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b414bb70 con 0x7f43b415e470 2024-04-25T15:43:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f3d5709e640 1 Processor -- start 2024-04-25T15:43:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.064+0000 7f27794a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 0x7f276c17a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f27794a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 0x7f276c17a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50624/0 (socket says 172.21.15.80:50624) 2024-04-25T15:43:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f3d5709e640 1 -- start start 2024-04-25T15:43:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f2779ca9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c006090 0x7f276c179e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f27794a8640 1 -- 172.21.15.80:0/1267458677 learned_addr learned my addr 172.21.15.80:0/1267458677 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f3d8659c640 1 --2- 172.21.15.80:0/2576204029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880d12e0 0x7f3d880d4230 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d780098a0 tx=0x7f3d7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4062ef3abd055f0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f2779ca9640 1 -- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c0e12c0 msgr2=0x7f276c04e0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f2779ca9640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c0e12c0 0x7f276c04e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f2779ca9640 1 -- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 msgr2=0x7f276c17a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f2779ca9640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 0x7f276c17a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f2779ca9640 1 -- 172.21.15.80:0/1267458677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c04d040 con 0x7f276c006090 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f27794a8640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 0x7f276c17a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f2779ca9640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c006090 0x7f276c179e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f277000b410 tx=0x7f277000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.065+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a800b9e0 con 0x7f43b415e470 2024-04-25T15:43:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be72e4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 0x7f7bd8034770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b40507e0 con 0x7f43b415e470 2024-04-25T15:43:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be72e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bd8034cb0 0x7f7bd804d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be72e4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd804d970 0x7f7bd804bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be72e4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8055810 con 0x7f7bd8034cb0 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be72e4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8050cc0 con 0x7f7bd804d970 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be72e4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd8055990 con 0x7f7bd80d0140 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be62e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 0x7f7bd8034770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be62e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 0x7f7bd8034770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50478/0 (socket says 172.21.15.80:50478) 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be62e2640 1 -- 172.21.15.80:0/116122159 learned_addr learned my addr 172.21.15.80:0/116122159 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.066+0000 7f7be5ae1640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bd8034cb0 0x7f7bd804d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd804d970 0x7f7bd804bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f72b7e20640 1 Processor -- start 2024-04-25T15:43:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f3d8559a640 1 -- 172.21.15.80:0/2576204029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78037070 con 0x7f3d880d12e0 2024-04-25T15:43:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f72b7e20640 1 -- start start 2024-04-25T15:43:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be62e2640 1 -- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd804d970 msgr2=0x7f7bd804bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be62e2640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd804d970 0x7f7bd804bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be62e2640 1 -- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bd8034cb0 msgr2=0x7f7bd804d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be62e2640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bd8034cb0 0x7f7bd804d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be62e2640 1 -- 172.21.15.80:0/116122159 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd804dd80 con 0x7f7bd80d0140 2024-04-25T15:43:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f7be6ae3640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd804d970 0x7f7bd804bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f3d5709e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 0x7f3d48173eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770015020 con 0x7f276c006090 2024-04-25T15:43:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f3d5709e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d4804a210 0x7f3d480e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f3d8559a640 1 -- 172.21.15.80:0/2576204029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78032440 con 0x7f3d880d12e0 2024-04-25T15:43:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f3d8559a640 1 -- 172.21.15.80:0/2576204029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78032810 con 0x7f3d880d12e0 2024-04-25T15:43:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f3d5709e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48052420 0x7f3d480ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c04d320 con 0x7f276c006090 2024-04-25T15:43:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c04d8e0 con 0x7f276c006090 2024-04-25T15:43:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f43a800bb80 con 0x7f43b415e470 2024-04-25T15:43:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.067+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2770011830 con 0x7f276c006090 2024-04-25T15:43:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f3d5709e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4804a620 con 0x7f3d4804a210 2024-04-25T15:43:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f3d5709e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d480536d0 con 0x7f3d48052420 2024-04-25T15:43:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f3d5709e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4804a7a0 con 0x7f3d48035fd0 2024-04-25T15:43:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f43a2ffd640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4394074580 0x7f4394076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f43b259c640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4394074580 0x7f4394076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f43a80958e0 con 0x7f43b415e470 2024-04-25T15:43:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.068+0000 7f7be62e2640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 0x7f7bd8034770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0007630 tx=0x7f7bd0004bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000f7b0 con 0x7f7bd80d0140 2024-04-25T15:43:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd0018070 con 0x7f7bd80d0140 2024-04-25T15:43:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000fbb0 con 0x7f7bd80d0140 2024-04-25T15:43:28.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f43b259c640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4394074580 0x7f4394076a90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43a4033000 tx=0x7f43a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd8035230 con 0x7f7bd80d0140 2024-04-25T15:43:28.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd80357f0 con 0x7f7bd80d0140 2024-04-25T15:43:28.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/2576204029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880d12e0 msgr2=0x7f3d880d4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f72b7e20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 0x7f72b015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f72b7e20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b00b2c90 0x7f72b0157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/2576204029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880d12e0 0x7f3d880d4230 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d780098a0 tx=0x7f3d7802a270 comp rx=0 tx=0).stop 2024-04-25T15:43:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f72b7e20640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b00cf6c0 0x7f72b015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f72b7e20640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d1600 con 0x7f72b00718b0 2024-04-25T15:43:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f72b7e20640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00cf1c0 con 0x7f72b00cf6c0 2024-04-25T15:43:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f72b7e20640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72b00d1780 con 0x7f72b00b2c90 2024-04-25T15:43:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 0x7f3d48173eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 0x7f3d48173eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50488/0 (socket says 172.21.15.80:50488) 2024-04-25T15:43:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 -- 172.21.15.80:0/3290480077 learned_addr learned my addr 172.21.15.80:0/3290480077 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5589b640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d4804a210 0x7f3d480e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.069+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275c005290 con 0x7f276c006090 2024-04-25T15:43:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/2576204029 shutdown_connections 2024-04-25T15:43:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/2576204029 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880b7de0 0x7f3d880ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/2576204029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880d12e0 0x7f3d880d4230 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/2576204029 >> 172.21.15.80:0/2576204029 conn(0x7f3d8806e7c0 msgr2=0x7f3d8806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770011be0 con 0x7f276c006090 2024-04-25T15:43:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/2576204029 shutdown_connections 2024-04-25T15:43:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/2576204029 wait complete. 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5689d640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48052420 0x7f3d480ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 -- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48052420 msgr2=0x7f3d480ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48052420 0x7f3d480ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 -- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d4804a210 msgr2=0x7f3d480e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d4804a210 0x7f3d480e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.070+0000 7f3d5609c640 1 -- 172.21.15.80:0/3290480077 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d480eb4d0 con 0x7f3d48035fd0 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f3d5609c640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 0x7f3d48173eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c4b0 tx=0x7f3d4000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40017070 con 0x7f3d48035fd0 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40005ce0 con 0x7f3d48035fd0 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40007270 con 0x7f3d48035fd0 2024-04-25T15:43:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d480eb7b0 con 0x7f3d48035fd0 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d481743f0 con 0x7f3d48035fd0 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f72b5bbc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 0x7f72b015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f72b5bbc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 0x7f72b015a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44364/0 (socket says 172.21.15.80:44364) 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.071+0000 7f72b5bbc640 1 -- 172.21.15.80:0/4221728022 learned_addr learned my addr 172.21.15.80:0/4221728022 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f72b5bbc640 1 -- 172.21.15.80:0/4221728022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b00b2c90 msgr2=0x7f72b0157000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f72b5bbc640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b00b2c90 0x7f72b0157000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f72b5bbc640 1 -- 172.21.15.80:0/4221728022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b00cf6c0 msgr2=0x7f72b015b690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f72b5bbc640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b00cf6c0 0x7f72b015b690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f72b5bbc640 1 -- 172.21.15.80:0/4221728022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b0157540 con 0x7f72b00718b0 2024-04-25T15:43:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d480059c0 con 0x7f3d48035fd0 2024-04-25T15:43:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f72b5bbc640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 0x7f72b015a570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c550 tx=0x7f72a000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7bd000fd50 con 0x7f7bd80d0140 2024-04-25T15:43:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.072+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd8005570 con 0x7f7bd80d0140 2024-04-25T15:43:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.073+0000 7f7bd6ffd640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7bc4074580 0x7f7bc4076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.073+0000 7f7be5ae1640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7bc4074580 0x7f7bc4076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f3d8cb5e640 1 Processor -- start 2024-04-25T15:43:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7bd0095490 con 0x7f7bd80d0140 2024-04-25T15:43:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f3d8cb5e640 1 -- start start 2024-04-25T15:43:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d4001a070 con 0x7f3d48035fd0 2024-04-25T15:43:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f3d46ffd640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d340744b0 0x7f3d340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3d40094c90 con 0x7f3d48035fd0 2024-04-25T15:43:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.074+0000 7f3d5589b640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d340744b0 0x7f3d340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.075+0000 7f7be5ae1640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7bc4074580 0x7f7bc4076a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80010e0 tx=0x7f7bdc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.075+0000 7f3d5589b640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d340744b0 0x7f3d340769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c034000 tx=0x7f3d4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.076+0000 7f3d8cb5e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880d12e0 0x7f3d88158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.076+0000 7f3d8cb5e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881604b0 0x7f3d881f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.076+0000 7f3d8659c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880d12e0 0x7f3d88158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.076+0000 7f3d8659c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880d12e0 0x7f3d88158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:50500/0 (socket says 172.21.15.80:50500) 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.076+0000 7f3d8659c640 1 -- 172.21.15.80:0/1705559901 learned_addr learned my addr 172.21.15.80:0/1705559901 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.076+0000 7f3d85d9b640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881604b0 0x7f3d881f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880ca2a0 0x7f3d880ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880b9e60 con 0x7f3d880ca2a0 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880b9b80 con 0x7f3d881604b0 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d881608c0 con 0x7f3d880d12e0 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880ca2a0 0x7f3d880ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 -- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880d12e0 msgr2=0x7f3d88158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880d12e0 0x7f3d88158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 -- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881604b0 msgr2=0x7f3d881f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881604b0 0x7f3d881f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d880cabf0 con 0x7f3d880ca2a0 2024-04-25T15:43:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.077+0000 7f3d86d9d640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880ca2a0 0x7f3d880ca6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000eba0 tx=0x7f3d8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.079+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d4005ec00 con 0x7f3d48035fd0 2024-04-25T15:43:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.078+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43a805fd10 con 0x7f43b415e470 2024-04-25T15:43:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.079+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0018070 con 0x7f72b00718b0 2024-04-25T15:43:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.079+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a00074e0 con 0x7f72b00718b0 2024-04-25T15:43:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.079+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b015bbd0 con 0x7f72b00718b0 2024-04-25T15:43:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.079+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b0163450 con 0x7f72b00718b0 2024-04-25T15:43:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.079+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80018020 con 0x7f3d880ca2a0 2024-04-25T15:43:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.080+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0007690 con 0x7f72b00718b0 2024-04-25T15:43:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.080+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2770018020 con 0x7f276c006090 2024-04-25T15:43:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.081+0000 7f276a7fc640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27580744e0 0x7f27580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.081+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f27700958b0 con 0x7f276c006090 2024-04-25T15:43:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.081+0000 7f27794a8640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27580744e0 0x7f27580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.082+0000 7f27794a8640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27580744e0 0x7f27580769f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f276c0342f0 tx=0x7f2764009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.080+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d881f7410 con 0x7f3d880ca2a0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.080+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d881f79d0 con 0x7f3d880ca2a0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.080+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8000cd20 con 0x7f3d880ca2a0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.080+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80014680 con 0x7f3d880ca2a0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.081+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c00daa0 con 0x7f3d880ca2a0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.082+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b00d02d0 con 0x7f72b00718b0 2024-04-25T15:43:28.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.083+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7bd804dd80 con 0x7f7bd80d0140 2024-04-25T15:43:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.091+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72a001b070 con 0x7f72b00718b0 2024-04-25T15:43:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.092+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f277001f020 con 0x7f276c006090 2024-04-25T15:43:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.092+0000 7f72a67fc640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7294074500 0x7f7294076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.092+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f72a0094db0 con 0x7f72b00718b0 2024-04-25T15:43:28.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.093+0000 7f72b53bb640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7294074500 0x7f7294076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.094+0000 7f72b53bb640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7294074500 0x7f7294076a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72ac034000 tx=0x7f72ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.095+0000 7fac7cc14640 1 Processor -- start 2024-04-25T15:43:28.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.095+0000 7fac7cc14640 1 -- start start 2024-04-25T15:43:28.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.096+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d80005d10 con 0x7f3d880ca2a0 2024-04-25T15:43:28.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.096+0000 7f3d76ffd640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d680744b0 0x7f3d680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.096+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3d80096580 con 0x7f3d880ca2a0 2024-04-25T15:43:28.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.097+0000 7fac7cc14640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fac780b3860 0x7fac7806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.097+0000 7fac7cc14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac7806c9a0 0x7fac78160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.097+0000 7fac7cc14640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac780b1690 con 0x7fac780b6f80 2024-04-25T15:43:28.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.097+0000 7fac7cc14640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fac780b1440 con 0x7fac780b3860 2024-04-25T15:43:28.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.097+0000 7fac7cc14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fac780b33d0 con 0x7fac7806c9a0 2024-04-25T15:43:28.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.097+0000 7f3d8659c640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d680744b0 0x7f3d680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac7659c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fac780b3860 0x7fac7806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac76d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fac780b6f80 0x7fac780b7390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41892/0 (socket says 172.21.15.80:41892) 2024-04-25T15:43:28.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac76d9d640 1 -- 172.21.15.80:0/3269499565 learned_addr learned my addr 172.21.15.80:0/3269499565 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:28.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac75d9b640 1 --2- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac7806c9a0 0x7fac78160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.099+0000 7f3d8659c640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d680744b0 0x7f3d680769c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d780090b0 tx=0x7f3d7802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac7659c640 1 -- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac7806c9a0 msgr2=0x7fac78160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac7659c640 1 --2- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac7806c9a0 0x7fac78160410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac7659c640 1 -- 172.21.15.80:0/3269499565 >> v1:172.21.15.80:6789/0 conn(0x7fac780b6f80 legacy=0x7fac780b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.098+0000 7fac7659c640 1 -- 172.21.15.80:0/3269499565 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac780b1970 con 0x7fac780b3860 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.100+0000 7fac7659c640 1 --2- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 0x7fac7806ced0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac70009d90 tx=0x7fac7002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9fe97fd0bab91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.100+0000 7fac7559a640 1 -- 172.21.15.80:0/3269499565 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70007740 con 0x7fac780b3860 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.100+0000 7fac7559a640 1 -- 172.21.15.80:0/3269499565 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac700078e0 con 0x7fac780b3860 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.100+0000 7fac7559a640 1 -- 172.21.15.80:0/3269499565 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70007740 con 0x7fac780b3860 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.101+0000 7fac7cc14640 1 -- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 msgr2=0x7fac7806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.101+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 0x7fac7806ced0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac70009d90 tx=0x7fac7002a660 comp rx=0 tx=0).stop 2024-04-25T15:43:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.101+0000 7fac7cc14640 1 -- 172.21.15.80:0/3269499565 shutdown_connections 2024-04-25T15:43:28.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.101+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac7806c9a0 0x7fac78160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.101+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3269499565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 0x7fac7806ced0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.101+0000 7fac7cc14640 1 -- 172.21.15.80:0/3269499565 >> 172.21.15.80:0/3269499565 conn(0x7fac78073ec0 msgr2=0x7fac7809b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.102+0000 7fac7cc14640 1 -- 172.21.15.80:0/3269499565 shutdown_connections 2024-04-25T15:43:28.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.102+0000 7fac7cc14640 1 -- 172.21.15.80:0/3269499565 wait complete. 2024-04-25T15:43:28.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.103+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f72b00d02d0 con 0x7f72b00718b0 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.106+0000 7fac7cc14640 1 Processor -- start 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.106+0000 7fac7cc14640 1 -- start start 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.109+0000 7fac7cc14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 0x7fac78153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.109+0000 7fac7659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 0x7fac78153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.109+0000 7fac7659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 0x7fac78153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44372/0 (socket says 172.21.15.80:44372) 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.109+0000 7fac7659c640 1 -- 172.21.15.80:0/3543072011 learned_addr learned my addr 172.21.15.80:0/3543072011 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.109+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 0x7fac781f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.109+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac780b6f80 0x7fac781faa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fac780d2040 con 0x7fac7806c9a0 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fac780d1ec0 con 0x7fac780b3860 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fac780d21c0 con 0x7fac780b6f80 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7659c640 1 -- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac780b6f80 msgr2=0x7fac781faa10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7659c640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac780b6f80 0x7fac781faa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7659c640 1 -- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 msgr2=0x7fac781f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7659c640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 0x7fac781f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.110+0000 7fac7659c640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac781544e0 con 0x7fac7806c9a0 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.111+0000 7fac7659c640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 0x7fac78153fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac70000f80 tx=0x7fac70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.113+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d80022030 con 0x7f3d880ca2a0 2024-04-25T15:43:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.113+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7003f070 con 0x7fac7806c9a0 2024-04-25T15:43:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.113+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7809fa10 con 0x7fac7806c9a0 2024-04-25T15:43:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.113+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7809ffd0 con 0x7fac7806c9a0 2024-04-25T15:43:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.113+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac70031dd0 con 0x7fac7806c9a0 2024-04-25T15:43:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.113+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70007740 con 0x7fac7806c9a0 2024-04-25T15:43:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.116+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fac7004e020 con 0x7fac7806c9a0 2024-04-25T15:43:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.116+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c005290 con 0x7fac7806c9a0 2024-04-25T15:43:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.117+0000 7fac66ffd640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fac600746c0 0x7fac60076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.117+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac700bebc0 con 0x7fac7806c9a0 2024-04-25T15:43:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.118+0000 7fac75d9b640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fac600746c0 0x7fac60076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.119+0000 7fac75d9b640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fac600746c0 0x7fac60076bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac780b0e90 tx=0x7fac6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.127+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac70088ff0 con 0x7fac7806c9a0 2024-04-25T15:43:28.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.426+0000 7f9b34ff9640 1 -- 172.21.15.80:0/2062984534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9b480b0e50 con 0x7f9b4815f840 2024-04-25T15:43:28.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.426+0000 7f9b36ffd640 1 -- 172.21.15.80:0/2062984534 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b4005ef30 con 0x7f9b4815f840 2024-04-25T15:43:28.427 INFO:teuthology.orchestra.run.smithi080.stdout:60129542155 2024-04-25T15:43:28.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.429+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b280745e0 msgr2=0x7f9b28076af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b280745e0 0x7f9b28076af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c034000 tx=0x7f9b3c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:28.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 msgr2=0x7f9b4814b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 0x7f9b4814b9e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009f60 tx=0x7f9b40009f90 comp rx=0 tx=0).stop 2024-04-25T15:43:28.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 shutdown_connections 2024-04-25T15:43:28.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9b280745e0 0x7f9b28076af0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c034000 tx=0x7f9b3c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:28.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b4815f840 0x7f9b4814b9e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b48168ad0 0x7f9b4814b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 --2- 172.21.15.80:0/2062984534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b480af310 0x7f9b4815f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.430+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 >> 172.21.15.80:0/2062984534 conn(0x7f9b480d19d0 msgr2=0x7f9b480b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.431+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 shutdown_connections 2024-04-25T15:43:28.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.431+0000 7f9b4ca92640 1 -- 172.21.15.80:0/2062984534 wait complete. 2024-04-25T15:43:28.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2024-04-25T15:43:28.449 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.469+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f43b41e8150 con 0x7f43b415e470 2024-04-25T15:43:28.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.469+0000 7f43a2ffd640 1 -- 172.21.15.80:0/3402730934 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43a805f610 con 0x7f43b415e470 2024-04-25T15:43:28.470 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4394074580 msgr2=0x7f4394076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4394074580 0x7f4394076a90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43a4033000 tx=0x7f43a4008030 comp rx=0 tx=0).stop 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 msgr2=0x7f43b41e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 0x7f43b41e7780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43a800d620 tx=0x7f43a800dae0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 shutdown_connections 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4394074580 0x7f4394076a90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161fa0 0x7f43b40b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b415e470 0x7f43b41e7780 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 --2- 172.21.15.80:0/3402730934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b40cfa90 0x7f43b41489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 >> 172.21.15.80:0/3402730934 conn(0x7f43b40d1ee0 msgr2=0x7f43b4160500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 shutdown_connections 2024-04-25T15:43:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.471+0000 7f43b359e640 1 -- 172.21.15.80:0/3402730934 wait complete. 2024-04-25T15:43:28.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-04-25T15:43:28.484 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.484+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3d48056580 con 0x7f3d48035fd0 2024-04-25T15:43:28.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.484+0000 7f3d46ffd640 1 -- 172.21.15.80:0/3290480077 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d40062f00 con 0x7f3d48035fd0 2024-04-25T15:43:28.485 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d340744b0 msgr2=0x7f3d340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d340744b0 0x7f3d340769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c034000 tx=0x7f3d4c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 msgr2=0x7f3d48173eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 0x7f3d48173eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c4b0 tx=0x7f3d4000c970 comp rx=0 tx=0).stop 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 shutdown_connections 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d340744b0 0x7f3d340769c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48052420 0x7f3d480ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d4804a210 0x7f3d480e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 --2- 172.21.15.80:0/3290480077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48035fd0 0x7f3d48173eb0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c4b0 tx=0x7f3d4000c970 comp rx=0 tx=0).stop 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 >> 172.21.15.80:0/3290480077 conn(0x7f3d4800c3f0 msgr2=0x7f3d48009c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 shutdown_connections 2024-04-25T15:43:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.487+0000 7f3d5709e640 1 -- 172.21.15.80:0/3290480077 wait complete. 2024-04-25T15:43:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.500+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7bd8053640 con 0x7f7bd80d0140 2024-04-25T15:43:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.500+0000 7f7bd6ffd640 1 -- 172.21.15.80:0/116122159 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7bd005f9e0 con 0x7f7bd80d0140 2024-04-25T15:43:28.501 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:28.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-04-25T15:43:28.506 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7bc4074580 msgr2=0x7f7bc4076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7bc4074580 0x7f7bc4076a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80010e0 tx=0x7f7bdc009040 comp rx=0 tx=0).stop 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 msgr2=0x7f7bd8034770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 0x7f7bd8034770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0007630 tx=0x7f7bd0004bb0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 shutdown_connections 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7bc4074580 0x7f7bc4076a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd804d970 0x7f7bd804bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bd8034cb0 0x7f7bd804d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 --2- 172.21.15.80:0/116122159 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bd80d0140 0x7f7bd8034770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 >> 172.21.15.80:0/116122159 conn(0x7f7bd8054cf0 msgr2=0x7f7bd80de880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 shutdown_connections 2024-04-25T15:43:28.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.504+0000 7f7be72e4640 1 -- 172.21.15.80:0/116122159 wait complete. 2024-04-25T15:43:28.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.512+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f72b006a100 con 0x7f72b00718b0 2024-04-25T15:43:28.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.512+0000 7f72a67fc640 1 -- 172.21.15.80:0/4221728022 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72b0157540 con 0x7f72b00718b0 2024-04-25T15:43:28.513 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-04-25T15:43:28.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7294074500 msgr2=0x7f7294076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7294074500 0x7f7294076a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72ac034000 tx=0x7f72ac02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:28.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 msgr2=0x7f72b015a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 0x7f72b015a570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c550 tx=0x7f72a000ca10 comp rx=0 tx=0).stop 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 shutdown_connections 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7294074500 0x7f7294076a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b00cf6c0 0x7f72b015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b00b2c90 0x7f72b0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 --2- 172.21.15.80:0/4221728022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b00718b0 0x7f72b015a570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 >> 172.21.15.80:0/4221728022 conn(0x7f72b00d3a30 msgr2=0x7f72b015eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 shutdown_connections 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.514+0000 7f72b7e20640 1 -- 172.21.15.80:0/4221728022 wait complete. 2024-04-25T15:43:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.516+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f275c005850 con 0x7f276c006090 2024-04-25T15:43:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.516+0000 7f276a7fc640 1 -- 172.21.15.80:0/1267458677 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2770093e20 con 0x7f276c006090 2024-04-25T15:43:28.517 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-25T15:43:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27580744e0 msgr2=0x7f27580769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27580744e0 0x7f27580769f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f276c0342f0 tx=0x7f2764009190 comp rx=0 tx=0).stop 2024-04-25T15:43:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c006090 msgr2=0x7f276c179e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c006090 0x7f276c179e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f277000b410 tx=0x7f277000b8d0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 shutdown_connections 2024-04-25T15:43:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27580744e0 0x7f27580769f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c0e12c0 0x7f276c04e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c04fee0 0x7f276c17a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 --2- 172.21.15.80:0/1267458677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f276c006090 0x7f276c179e20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 >> 172.21.15.80:0/1267458677 conn(0x7f276c054cf0 msgr2=0x7f276c0e1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-04-25T15:43:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 shutdown_connections 2024-04-25T15:43:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.519+0000 7f277acab640 1 -- 172.21.15.80:0/1267458677 wait complete. 2024-04-25T15:43:28.522 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-04-25T15:43:28.527 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.532+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fac5c005580 con 0x7fac7806c9a0 2024-04-25T15:43:28.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.532+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3d6c00e060 con 0x7f3d880ca2a0 2024-04-25T15:43:28.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.532+0000 7fac66ffd640 1 -- 172.21.15.80:0/3543072011 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac700888f0 con 0x7fac7806c9a0 2024-04-25T15:43:28.533 INFO:teuthology.orchestra.run.smithi080.stdout:60129542156 2024-04-25T15:43:28.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.532+0000 7f3d76ffd640 1 -- 172.21.15.80:0/1705559901 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d880cabf0 con 0x7f3d880ca2a0 2024-04-25T15:43:28.534 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.534+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fac600746c0 msgr2=0x7fac60076bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.534+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fac600746c0 0x7fac60076bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac780b0e90 tx=0x7fac6c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.534+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 msgr2=0x7fac78153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.534+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 0x7fac78153fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac70000f80 tx=0x7fac70004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 shutdown_connections 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fac600746c0 0x7fac60076bd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fac780b6f80 0x7fac781faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac780b3860 0x7fac781f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 --2- 172.21.15.80:0/3543072011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac7806c9a0 0x7fac78153fa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 >> 172.21.15.80:0/3543072011 conn(0x7fac78073ec0 msgr2=0x7fac780ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 shutdown_connections 2024-04-25T15:43:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.535+0000 7fac7cc14640 1 -- 172.21.15.80:0/3543072011 wait complete. 2024-04-25T15:43:28.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-25T15:43:28.538 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d680744b0 msgr2=0x7f3d680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d680744b0 0x7f3d680769c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d780090b0 tx=0x7f3d7802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880ca2a0 msgr2=0x7f3d880ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880ca2a0 0x7f3d880ca6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000eba0 tx=0x7f3d8000c490 comp rx=0 tx=0).stop 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 shutdown_connections 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d680744b0 0x7f3d680769c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d880ca2a0 0x7f3d880ca6b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881604b0 0x7f3d881f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 --2- 172.21.15.80:0/1705559901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d880d12e0 0x7f3d88158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 >> 172.21.15.80:0/1705559901 conn(0x7f3d8806e7c0 msgr2=0x7f3d88161960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 shutdown_connections 2024-04-25T15:43:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.536+0000 7f3d8cb5e640 1 -- 172.21.15.80:0/1705559901 wait complete. 2024-04-25T15:43:28.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.1 2024-04-25T15:43:28.547 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-25T15:43:28.548 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:28.548 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:43:28.548 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:43:28.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.694+0000 7f6482f9e640 1 Processor -- start 2024-04-25T15:43:28.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.694+0000 7f6482f9e640 1 -- start start 2024-04-25T15:43:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6482f9e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f647c0d12e0 0x7f647c0d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6482f9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f647c1604b0 0x7f647c0b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6482f9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c0b7c10 0x7f647c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6482f9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f647c0d16f0 con 0x7f647c1604b0 2024-04-25T15:43:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6482f9e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f647c0d1c10 con 0x7f647c0d12e0 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6482f9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0b9620 con 0x7f647c0b7c10 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f647c1604b0 0x7f647c0b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f647c1604b0 0x7f647c0b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44384/0 (socket says 172.21.15.80:44384) 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 -- 172.21.15.80:0/2472055423 learned_addr learned my addr 172.21.15.80:0/2472055423 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f6480d3a640 1 --2- 172.21.15.80:0/2472055423 >> v2:172.21.15.195:3300/0 conn(0x7f647c0d12e0 0x7f647c0d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f648153b640 1 --2- 172.21.15.80:0/2472055423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c0b7c10 0x7f647c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 -- 172.21.15.80:0/2472055423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c0b7c10 msgr2=0x7f647c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 --2- 172.21.15.80:0/2472055423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c0b7c10 0x7f647c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 -- 172.21.15.80:0/2472055423 >> v2:172.21.15.195:3300/0 conn(0x7f647c0d12e0 msgr2=0x7f647c0d4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 --2- 172.21.15.80:0/2472055423 >> v2:172.21.15.195:3300/0 conn(0x7f647c0d12e0 0x7f647c0d4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.696+0000 7f647bfff640 1 -- 172.21.15.80:0/2472055423 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0b8020 con 0x7f647c1604b0 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.697+0000 7f647bfff640 1 --2- 172.21.15.80:0/2472055423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c1604b0 0x7f647c0b76d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f647c0d12b0 tx=0x7f647002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869ea56e9885b312 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.697+0000 7f647b7fe640 1 -- 172.21.15.80:0/2472055423 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470037070 con 0x7f647c1604b0 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.697+0000 7f647b7fe640 1 -- 172.21.15.80:0/2472055423 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6470032440 con 0x7f647c1604b0 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.697+0000 7f647b7fe640 1 -- 172.21.15.80:0/2472055423 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470032810 con 0x7f647c1604b0 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 -- 172.21.15.80:0/2472055423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c1604b0 msgr2=0x7f647c0b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2472055423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c1604b0 0x7f647c0b76d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f647c0d12b0 tx=0x7f647002a210 comp rx=0 tx=0).stop 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 -- 172.21.15.80:0/2472055423 shutdown_connections 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2472055423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c0b7c10 0x7f647c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2472055423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c1604b0 0x7f647c0b76d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2472055423 >> v2:172.21.15.195:3300/0 conn(0x7f647c0d12e0 0x7f647c0d4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 -- 172.21.15.80:0/2472055423 >> 172.21.15.80:0/2472055423 conn(0x7f647c06e7c0 msgr2=0x7f647c06ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 -- 172.21.15.80:0/2472055423 shutdown_connections 2024-04-25T15:43:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.698+0000 7f6482f9e640 1 -- 172.21.15.80:0/2472055423 wait complete. 2024-04-25T15:43:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.699+0000 7f6482f9e640 1 Processor -- start 2024-04-25T15:43:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.700+0000 7f6482f9e640 1 -- start start 2024-04-25T15:43:28.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6482f9e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c0b7c10 0x7f647c1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6482f9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 0x7f647c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6482f9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c1604b0 0x7f647c147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6482f9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b9b80 con 0x7f647c0d12e0 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6482f9e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b98a0 con 0x7f647c0b7c10 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6482f9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0b9e60 con 0x7f647c1604b0 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 0x7f647c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 0x7f647c15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44400/0 (socket says 172.21.15.80:44400) 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 -- 172.21.15.80:0/2342167858 learned_addr learned my addr 172.21.15.80:0/2342167858 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f6480d3a640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c0b7c10 0x7f647c1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f648153b640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c1604b0 0x7f647c147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 -- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c1604b0 msgr2=0x7f647c147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c1604b0 0x7f647c147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 -- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c0b7c10 msgr2=0x7f647c1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c0b7c10 0x7f647c1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.701+0000 7f647bfff640 1 -- 172.21.15.80:0/2342167858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c159c00 con 0x7f647c0d12e0 2024-04-25T15:43:28.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.702+0000 7f647bfff640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 0x7f647c15a1d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6470000c00 tx=0x7f64700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.702+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470041020 con 0x7f647c0d12e0 2024-04-25T15:43:28.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.702+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647003d620 con 0x7f647c0d12e0 2024-04-25T15:43:28.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.702+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c157d80 con 0x7f647c0d12e0 2024-04-25T15:43:28.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.702+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470037040 con 0x7f647c0d12e0 2024-04-25T15:43:28.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.702+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c159ee0 con 0x7f647c0d12e0 2024-04-25T15:43:28.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.703+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c155e20 con 0x7f647c0d12e0 2024-04-25T15:43:28.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.703+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6470044020 con 0x7f647c0d12e0 2024-04-25T15:43:28.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.704+0000 7f64797fa640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64680744b0 0x7f64680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:28.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.704+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f64700b5c70 con 0x7f647c0d12e0 2024-04-25T15:43:28.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.704+0000 7f6480d3a640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64680744b0 0x7f64680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:28.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.704+0000 7f6480d3a640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64680744b0 0x7f64680769c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f646c009a30 tx=0x7f646c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:28.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.709+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f647004b030 con 0x7f647c0d12e0 2024-04-25T15:43:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.879+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f647c1483a0 con 0x7f64680744b0 2024-04-25T15:43:28.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.887+0000 7f64797fa640 1 -- 172.21.15.80:0/2342167858 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7f647c1483a0 con 0x7f64680744b0 2024-04-25T15:43:28.891 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:28.893 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:43:28.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64680744b0 msgr2=0x7f64680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64680744b0 0x7f64680769c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f646c009a30 tx=0x7f646c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 msgr2=0x7f647c15a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 0x7f647c15a1d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6470000c00 tx=0x7f64700046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 shutdown_connections 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64680744b0 0x7f64680769c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f647c1604b0 0x7f647c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f647c0d12e0 0x7f647c15a1d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 --2- 172.21.15.80:0/2342167858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f647c0b7c10 0x7f647c1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 >> 172.21.15.80:0/2342167858 conn(0x7f647c06e7c0 msgr2=0x7f647c15eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 shutdown_connections 2024-04-25T15:43:28.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:28.890+0000 7f6482f9e640 1 -- 172.21.15.80:0/2342167858 wait complete. 2024-04-25T15:43:28.903 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-25T15:43:27.003215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2018232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362284+0000","last_change":"2024-04-25T15:43:00.262559+0000","last_active":"2024-04-25T15:43:07.362284+0000","last_peered":"2024-04-25T15:43:07.362284+0000","last_clean":"2024-04-25T15:43:07.362284+0000","last_became_active":"2024-04-25T15:43:00.260334+0000","last_became_peered":"2024-04-25T15:43:00.260334+0000","last_unstale":"2024-04-25T15:43:07.362284+0000","last_undegraded":"2024-04-25T15:43:07.362284+0000","last_fullsized":"2024-04-25T15:43:07.362284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:37.689363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360799+0000","last_change":"2024-04-25T15:43:01.287221+0000","last_active":"2024-04-25T15:43:07.360799+0000","last_peered":"2024-04-25T15:43:07.360799+0000","last_clean":"2024-04-25T15:43:07.360799+0000","last_became_active":"2024-04-25T15:43:01.286908+0000","last_became_peered":"2024-04-25T15:43:01.286908+0000","last_unstale":"2024-04-25T15:43:07.360799+0000","last_undegraded":"2024-04-25T15:43:07.360799+0000","last_fullsized":"2024-04-25T15:43:07.360799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359974+0000","last_change":"2024-04-25T15:43:05.318849+0000","last_active":"2024-04-25T15:43:07.359974+0000","last_peered":"2024-04-25T15:43:07.359974+0000","last_clean":"2024-04-25T15:43:07.359974+0000","last_became_active":"2024-04-25T15:43:05.318430+0000","last_became_peered":"2024-04-25T15:43:05.318430+0000","last_unstale":"2024-04-25T15:43:07.359974+0000","last_undegraded":"2024-04-25T15:43:07.359974+0000","last_fullsized":"2024-04-25T15:43:07.359974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361076+0000","last_change":"2024-04-25T15:43:00.271120+0000","last_active":"2024-04-25T15:43:07.361076+0000","last_peered":"2024-04-25T15:43:07.361076+0000","last_clean":"2024-04-25T15:43:07.361076+0000","last_became_active":"2024-04-25T15:43:00.270825+0000","last_became_peered":"2024-04-25T15:43:00.270825+0000","last_unstale":"2024-04-25T15:43:07.361076+0000","last_undegraded":"2024-04-25T15:43:07.361076+0000","last_fullsized":"2024-04-25T15:43:07.361076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362058+0000","last_change":"2024-04-25T15:43:01.301805+0000","last_active":"2024-04-25T15:43:07.362058+0000","last_peered":"2024-04-25T15:43:07.362058+0000","last_clean":"2024-04-25T15:43:07.362058+0000","last_became_active":"2024-04-25T15:43:01.301404+0000","last_became_peered":"2024-04-25T15:43:01.301404+0000","last_unstale":"2024-04-25T15:43:07.362058+0000","last_undegraded":"2024-04-25T15:43:07.362058+0000","last_fullsized":"2024-04-25T15:43:07.362058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303866+0000","last_change":"2024-04-25T15:43:05.327540+0000","last_active":"2024-04-25T15:43:06.303866+0000","last_peered":"2024-04-25T15:43:06.303866+0000","last_clean":"2024-04-25T15:43:06.303866+0000","last_became_active":"2024-04-25T15:43:05.326737+0000","last_became_peered":"2024-04-25T15:43:05.326737+0000","last_unstale":"2024-04-25T15:43:06.303866+0000","last_undegraded":"2024-04-25T15:43:06.303866+0000","last_fullsized":"2024-04-25T15:43:06.303866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:01.657357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305054+0000","last_change":"2024-04-25T15:43:00.269417+0000","last_active":"2024-04-25T15:43:06.305054+0000","last_peered":"2024-04-25T15:43:06.305054+0000","last_clean":"2024-04-25T15:43:06.305054+0000","last_became_active":"2024-04-25T15:43:00.268747+0000","last_became_peered":"2024-04-25T15:43:00.268747+0000","last_unstale":"2024-04-25T15:43:06.305054+0000","last_undegraded":"2024-04-25T15:43:06.305054+0000","last_fullsized":"2024-04-25T15:43:06.305054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:49.833413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515416+0000","last_change":"2024-04-25T15:43:01.293581+0000","last_active":"2024-04-25T15:43:06.515416+0000","last_peered":"2024-04-25T15:43:06.515416+0000","last_clean":"2024-04-25T15:43:06.515416+0000","last_became_active":"2024-04-25T15:43:01.292501+0000","last_became_peered":"2024-04-25T15:43:01.292501+0000","last_unstale":"2024-04-25T15:43:06.515416+0000","last_undegraded":"2024-04-25T15:43:06.515416+0000","last_fullsized":"2024-04-25T15:43:06.515416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305418+0000","last_change":"2024-04-25T15:43:05.332634+0000","last_active":"2024-04-25T15:43:06.305418+0000","last_peered":"2024-04-25T15:43:06.305418+0000","last_clean":"2024-04-25T15:43:06.305418+0000","last_became_active":"2024-04-25T15:43:05.332110+0000","last_became_peered":"2024-04-25T15:43:05.332110+0000","last_unstale":"2024-04-25T15:43:06.305418+0000","last_undegraded":"2024-04-25T15:43:06.305418+0000","last_fullsized":"2024-04-25T15:43:06.305418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304639+0000","last_change":"2024-04-25T15:43:00.270429+0000","last_active":"2024-04-25T15:43:06.304639+0000","last_peered":"2024-04-25T15:43:06.304639+0000","last_clean":"2024-04-25T15:43:06.304639+0000","last_became_active":"2024-04-25T15:43:00.270080+0000","last_became_peered":"2024-04-25T15:43:00.270080+0000","last_unstale":"2024-04-25T15:43:06.304639+0000","last_undegraded":"2024-04-25T15:43:06.304639+0000","last_fullsized":"2024-04-25T15:43:06.304639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515514+0000","last_change":"2024-04-25T15:43:01.294967+0000","last_active":"2024-04-25T15:43:06.515514+0000","last_peered":"2024-04-25T15:43:06.515514+0000","last_clean":"2024-04-25T15:43:06.515514+0000","last_became_active":"2024-04-25T15:43:01.294673+0000","last_became_peered":"2024-04-25T15:43:01.294673+0000","last_unstale":"2024-04-25T15:43:06.515514+0000","last_undegraded":"2024-04-25T15:43:06.515514+0000","last_fullsized":"2024-04-25T15:43:06.515514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303942+0000","last_change":"2024-04-25T15:43:05.330892+0000","last_active":"2024-04-25T15:43:06.303942+0000","last_peered":"2024-04-25T15:43:06.303942+0000","last_clean":"2024-04-25T15:43:06.303942+0000","last_became_active":"2024-04-25T15:43:05.330435+0000","last_became_peered":"2024-04-25T15:43:05.330435+0000","last_unstale":"2024-04-25T15:43:06.303942+0000","last_undegraded":"2024-04-25T15:43:06.303942+0000","last_fullsized":"2024-04-25T15:43:06.303942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:31.934838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173076+0000","last_change":"2024-04-25T15:43:01.297084+0000","last_active":"2024-04-25T15:43:07.173076+0000","last_peered":"2024-04-25T15:43:07.173076+0000","last_clean":"2024-04-25T15:43:07.173076+0000","last_became_active":"2024-04-25T15:43:01.296689+0000","last_became_peered":"2024-04-25T15:43:01.296689+0000","last_unstale":"2024-04-25T15:43:07.173076+0000","last_undegraded":"2024-04-25T15:43:07.173076+0000","last_fullsized":"2024-04-25T15:43:07.173076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304863+0000","last_change":"2024-04-25T15:43:00.267473+0000","last_active":"2024-04-25T15:43:06.304863+0000","last_peered":"2024-04-25T15:43:06.304863+0000","last_clean":"2024-04-25T15:43:06.304863+0000","last_became_active":"2024-04-25T15:43:00.264809+0000","last_became_peered":"2024-04-25T15:43:00.264809+0000","last_unstale":"2024-04-25T15:43:06.304863+0000","last_undegraded":"2024-04-25T15:43:06.304863+0000","last_fullsized":"2024-04-25T15:43:06.304863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.324082+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.323656+0000","last_became_peered":"2024-04-25T15:43:05.323656+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361446+0000","last_change":"2024-04-25T15:43:01.284806+0000","last_active":"2024-04-25T15:43:07.361446+0000","last_peered":"2024-04-25T15:43:07.361446+0000","last_clean":"2024-04-25T15:43:07.361446+0000","last_became_active":"2024-04-25T15:43:01.283772+0000","last_became_peered":"2024-04-25T15:43:01.283772+0000","last_unstale":"2024-04-25T15:43:07.361446+0000","last_undegraded":"2024-04-25T15:43:07.361446+0000","last_fullsized":"2024-04-25T15:43:07.361446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361739+0000","last_change":"2024-04-25T15:43:00.271683+0000","last_active":"2024-04-25T15:43:07.361739+0000","last_peered":"2024-04-25T15:43:07.361739+0000","last_clean":"2024-04-25T15:43:07.361739+0000","last_became_active":"2024-04-25T15:43:00.271031+0000","last_became_peered":"2024-04-25T15:43:00.271031+0000","last_unstale":"2024-04-25T15:43:07.361739+0000","last_undegraded":"2024-04-25T15:43:07.361739+0000","last_fullsized":"2024-04-25T15:43:07.361739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304365+0000","last_change":"2024-04-25T15:43:05.326922+0000","last_active":"2024-04-25T15:43:06.304365+0000","last_peered":"2024-04-25T15:43:06.304365+0000","last_clean":"2024-04-25T15:43:06.304365+0000","last_became_active":"2024-04-25T15:43:05.325427+0000","last_became_peered":"2024-04-25T15:43:05.325427+0000","last_unstale":"2024-04-25T15:43:06.304365+0000","last_undegraded":"2024-04-25T15:43:06.304365+0000","last_fullsized":"2024-04-25T15:43:06.304365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:58.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360745+0000","last_change":"2024-04-25T15:43:01.278582+0000","last_active":"2024-04-25T15:43:07.360745+0000","last_peered":"2024-04-25T15:43:07.360745+0000","last_clean":"2024-04-25T15:43:07.360745+0000","last_became_active":"2024-04-25T15:43:01.278262+0000","last_became_peered":"2024-04-25T15:43:01.278262+0000","last_unstale":"2024-04-25T15:43:07.360745+0000","last_undegraded":"2024-04-25T15:43:07.360745+0000","last_fullsized":"2024-04-25T15:43:07.360745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360634+0000","last_change":"2024-04-25T15:43:00.259534+0000","last_active":"2024-04-25T15:43:07.360634+0000","last_peered":"2024-04-25T15:43:07.360634+0000","last_clean":"2024-04-25T15:43:07.360634+0000","last_became_active":"2024-04-25T15:43:00.259226+0000","last_became_peered":"2024-04-25T15:43:00.259226+0000","last_unstale":"2024-04-25T15:43:07.360634+0000","last_undegraded":"2024-04-25T15:43:07.360634+0000","last_fullsized":"2024-04-25T15:43:07.360634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361329+0000","last_change":"2024-04-25T15:43:05.337344+0000","last_active":"2024-04-25T15:43:07.361329+0000","last_peered":"2024-04-25T15:43:07.361329+0000","last_clean":"2024-04-25T15:43:07.361329+0000","last_became_active":"2024-04-25T15:43:05.336683+0000","last_became_peered":"2024-04-25T15:43:05.336683+0000","last_unstale":"2024-04-25T15:43:07.361329+0000","last_undegraded":"2024-04-25T15:43:07.361329+0000","last_fullsized":"2024-04-25T15:43:07.361329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305043+0000","last_change":"2024-04-25T15:43:01.294128+0000","last_active":"2024-04-25T15:43:06.305043+0000","last_peered":"2024-04-25T15:43:06.305043+0000","last_clean":"2024-04-25T15:43:06.305043+0000","last_became_active":"2024-04-25T15:43:01.293722+0000","last_became_peered":"2024-04-25T15:43:01.293722+0000","last_unstale":"2024-04-25T15:43:06.305043+0000","last_undegraded":"2024-04-25T15:43:06.305043+0000","last_fullsized":"2024-04-25T15:43:06.305043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303483+0000","last_change":"2024-04-25T15:43:00.264522+0000","last_active":"2024-04-25T15:43:06.303483+0000","last_peered":"2024-04-25T15:43:06.303483+0000","last_clean":"2024-04-25T15:43:06.303483+0000","last_became_active":"2024-04-25T15:43:00.264219+0000","last_became_peered":"2024-04-25T15:43:00.264219+0000","last_unstale":"2024-04-25T15:43:06.303483+0000","last_undegraded":"2024-04-25T15:43:06.303483+0000","last_fullsized":"2024-04-25T15:43:06.303483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304418+0000","last_change":"2024-04-25T15:43:05.326280+0000","last_active":"2024-04-25T15:43:06.304418+0000","last_peered":"2024-04-25T15:43:06.304418+0000","last_clean":"2024-04-25T15:43:06.304418+0000","last_became_active":"2024-04-25T15:43:05.325812+0000","last_became_peered":"2024-04-25T15:43:05.325812+0000","last_unstale":"2024-04-25T15:43:06.304418+0000","last_undegraded":"2024-04-25T15:43:06.304418+0000","last_fullsized":"2024-04-25T15:43:06.304418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:42.664135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360353+0000","last_change":"2024-04-25T15:43:01.284195+0000","last_active":"2024-04-25T15:43:07.360353+0000","last_peered":"2024-04-25T15:43:07.360353+0000","last_clean":"2024-04-25T15:43:07.360353+0000","last_became_active":"2024-04-25T15:43:01.283818+0000","last_became_peered":"2024-04-25T15:43:01.283818+0000","last_unstale":"2024-04-25T15:43:07.360353+0000","last_undegraded":"2024-04-25T15:43:07.360353+0000","last_fullsized":"2024-04-25T15:43:07.360353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:38.284567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173875+0000","last_change":"2024-04-25T15:43:00.271369+0000","last_active":"2024-04-25T15:43:07.173875+0000","last_peered":"2024-04-25T15:43:07.173875+0000","last_clean":"2024-04-25T15:43:07.173875+0000","last_became_active":"2024-04-25T15:43:00.270954+0000","last_became_peered":"2024-04-25T15:43:00.270954+0000","last_unstale":"2024-04-25T15:43:07.173875+0000","last_undegraded":"2024-04-25T15:43:07.173875+0000","last_fullsized":"2024-04-25T15:43:07.173875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304636+0000","last_change":"2024-04-25T15:43:05.318710+0000","last_active":"2024-04-25T15:43:06.304636+0000","last_peered":"2024-04-25T15:43:06.304636+0000","last_clean":"2024-04-25T15:43:06.304636+0000","last_became_active":"2024-04-25T15:43:05.318244+0000","last_became_peered":"2024-04-25T15:43:05.318244+0000","last_unstale":"2024-04-25T15:43:06.304636+0000","last_undegraded":"2024-04-25T15:43:06.304636+0000","last_fullsized":"2024-04-25T15:43:06.304636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:59.114149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361273+0000","last_change":"2024-04-25T15:43:01.277350+0000","last_active":"2024-04-25T15:43:07.361273+0000","last_peered":"2024-04-25T15:43:07.361273+0000","last_clean":"2024-04-25T15:43:07.361273+0000","last_became_active":"2024-04-25T15:43:01.277042+0000","last_became_peered":"2024-04-25T15:43:01.277042+0000","last_unstale":"2024-04-25T15:43:07.361273+0000","last_undegraded":"2024-04-25T15:43:07.361273+0000","last_fullsized":"2024-04-25T15:43:07.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361047+0000","last_change":"2024-04-25T15:43:00.270292+0000","last_active":"2024-04-25T15:43:07.361047+0000","last_peered":"2024-04-25T15:43:07.361047+0000","last_clean":"2024-04-25T15:43:07.361047+0000","last_became_active":"2024-04-25T15:43:00.269920+0000","last_became_peered":"2024-04-25T15:43:00.269920+0000","last_unstale":"2024-04-25T15:43:07.361047+0000","last_undegraded":"2024-04-25T15:43:07.361047+0000","last_fullsized":"2024-04-25T15:43:07.361047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360289+0000","last_change":"2024-04-25T15:43:05.327625+0000","last_active":"2024-04-25T15:43:07.360289+0000","last_peered":"2024-04-25T15:43:07.360289+0000","last_clean":"2024-04-25T15:43:07.360289+0000","last_became_active":"2024-04-25T15:43:05.327068+0000","last_became_peered":"2024-04-25T15:43:05.327068+0000","last_unstale":"2024-04-25T15:43:07.360289+0000","last_undegraded":"2024-04-25T15:43:07.360289+0000","last_fullsized":"2024-04-25T15:43:07.360289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:06.933725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361783+0000","last_change":"2024-04-25T15:43:01.289525+0000","last_active":"2024-04-25T15:43:07.361783+0000","last_peered":"2024-04-25T15:43:07.361783+0000","last_clean":"2024-04-25T15:43:07.361783+0000","last_became_active":"2024-04-25T15:43:01.288948+0000","last_became_peered":"2024-04-25T15:43:01.288948+0000","last_unstale":"2024-04-25T15:43:07.361783+0000","last_undegraded":"2024-04-25T15:43:07.361783+0000","last_fullsized":"2024-04-25T15:43:07.361783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305175+0000","last_change":"2024-04-25T15:43:00.270648+0000","last_active":"2024-04-25T15:43:06.305175+0000","last_peered":"2024-04-25T15:43:06.305175+0000","last_clean":"2024-04-25T15:43:06.305175+0000","last_became_active":"2024-04-25T15:43:00.269383+0000","last_became_peered":"2024-04-25T15:43:00.269383+0000","last_unstale":"2024-04-25T15:43:06.305175+0000","last_undegraded":"2024-04-25T15:43:06.305175+0000","last_fullsized":"2024-04-25T15:43:06.305175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:57.288718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360617+0000","last_change":"2024-04-25T15:43:05.324673+0000","last_active":"2024-04-25T15:43:07.360617+0000","last_peered":"2024-04-25T15:43:07.360617+0000","last_clean":"2024-04-25T15:43:07.360617+0000","last_became_active":"2024-04-25T15:43:05.323620+0000","last_became_peered":"2024-04-25T15:43:05.323620+0000","last_unstale":"2024-04-25T15:43:07.360617+0000","last_undegraded":"2024-04-25T15:43:07.360617+0000","last_fullsized":"2024-04-25T15:43:07.360617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515849+0000","last_change":"2024-04-25T15:43:01.303220+0000","last_active":"2024-04-25T15:43:06.515849+0000","last_peered":"2024-04-25T15:43:06.515849+0000","last_clean":"2024-04-25T15:43:06.515849+0000","last_became_active":"2024-04-25T15:43:01.302322+0000","last_became_peered":"2024-04-25T15:43:01.302322+0000","last_unstale":"2024-04-25T15:43:06.515849+0000","last_undegraded":"2024-04-25T15:43:06.515849+0000","last_fullsized":"2024-04-25T15:43:06.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361861+0000","last_change":"2024-04-25T15:43:00.266400+0000","last_active":"2024-04-25T15:43:07.361861+0000","last_peered":"2024-04-25T15:43:07.361861+0000","last_clean":"2024-04-25T15:43:07.361861+0000","last_became_active":"2024-04-25T15:43:00.265691+0000","last_became_peered":"2024-04-25T15:43:00.265691+0000","last_unstale":"2024-04-25T15:43:07.361861+0000","last_undegraded":"2024-04-25T15:43:07.361861+0000","last_fullsized":"2024-04-25T15:43:07.361861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361515+0000","last_change":"2024-04-25T15:43:05.333242+0000","last_active":"2024-04-25T15:43:07.361515+0000","last_peered":"2024-04-25T15:43:07.361515+0000","last_clean":"2024-04-25T15:43:07.361515+0000","last_became_active":"2024-04-25T15:43:05.332499+0000","last_became_peered":"2024-04-25T15:43:05.332499+0000","last_unstale":"2024-04-25T15:43:07.361515+0000","last_undegraded":"2024-04-25T15:43:07.361515+0000","last_fullsized":"2024-04-25T15:43:07.361515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305390+0000","last_change":"2024-04-25T15:43:01.303850+0000","last_active":"2024-04-25T15:43:06.305390+0000","last_peered":"2024-04-25T15:43:06.305390+0000","last_clean":"2024-04-25T15:43:06.305390+0000","last_became_active":"2024-04-25T15:43:01.303351+0000","last_became_peered":"2024-04-25T15:43:01.303351+0000","last_unstale":"2024-04-25T15:43:06.305390+0000","last_undegraded":"2024-04-25T15:43:06.305390+0000","last_fullsized":"2024-04-25T15:43:06.305390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:55.857252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515505+0000","last_change":"2024-04-25T15:43:00.265989+0000","last_active":"2024-04-25T15:43:06.515505+0000","last_peered":"2024-04-25T15:43:06.515505+0000","last_clean":"2024-04-25T15:43:06.515505+0000","last_became_active":"2024-04-25T15:43:00.265654+0000","last_became_peered":"2024-04-25T15:43:00.265654+0000","last_unstale":"2024-04-25T15:43:06.515505+0000","last_undegraded":"2024-04-25T15:43:06.515505+0000","last_fullsized":"2024-04-25T15:43:06.515505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361721+0000","last_change":"2024-04-25T15:43:05.335093+0000","last_active":"2024-04-25T15:43:07.361721+0000","last_peered":"2024-04-25T15:43:07.361721+0000","last_clean":"2024-04-25T15:43:07.361721+0000","last_became_active":"2024-04-25T15:43:05.334657+0000","last_became_peered":"2024-04-25T15:43:05.334657+0000","last_unstale":"2024-04-25T15:43:07.361721+0000","last_undegraded":"2024-04-25T15:43:07.361721+0000","last_fullsized":"2024-04-25T15:43:07.361721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:08.225975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361261+0000","last_change":"2024-04-25T15:43:01.290703+0000","last_active":"2024-04-25T15:43:07.361261+0000","last_peered":"2024-04-25T15:43:07.361261+0000","last_clean":"2024-04-25T15:43:07.361261+0000","last_became_active":"2024-04-25T15:43:01.290172+0000","last_became_peered":"2024-04-25T15:43:01.290172+0000","last_unstale":"2024-04-25T15:43:07.361261+0000","last_undegraded":"2024-04-25T15:43:07.361261+0000","last_fullsized":"2024-04-25T15:43:07.361261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304850+0000","last_change":"2024-04-25T15:43:00.266600+0000","last_active":"2024-04-25T15:43:06.304850+0000","last_peered":"2024-04-25T15:43:06.304850+0000","last_clean":"2024-04-25T15:43:06.304850+0000","last_became_active":"2024-04-25T15:43:00.266272+0000","last_became_peered":"2024-04-25T15:43:00.266272+0000","last_unstale":"2024-04-25T15:43:06.304850+0000","last_undegraded":"2024-04-25T15:43:06.304850+0000","last_fullsized":"2024-04-25T15:43:06.304850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361502+0000","last_change":"2024-04-25T15:43:05.335202+0000","last_active":"2024-04-25T15:43:07.361502+0000","last_peered":"2024-04-25T15:43:07.361502+0000","last_clean":"2024-04-25T15:43:07.361502+0000","last_became_active":"2024-04-25T15:43:05.334737+0000","last_became_peered":"2024-04-25T15:43:05.334737+0000","last_unstale":"2024-04-25T15:43:07.361502+0000","last_undegraded":"2024-04-25T15:43:07.361502+0000","last_fullsized":"2024-04-25T15:43:07.361502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361707+0000","last_change":"2024-04-25T15:43:01.299152+0000","last_active":"2024-04-25T15:43:07.361707+0000","last_peered":"2024-04-25T15:43:07.361707+0000","last_clean":"2024-04-25T15:43:07.361707+0000","last_became_active":"2024-04-25T15:43:01.298809+0000","last_became_peered":"2024-04-25T15:43:01.298809+0000","last_unstale":"2024-04-25T15:43:07.361707+0000","last_undegraded":"2024-04-25T15:43:07.361707+0000","last_fullsized":"2024-04-25T15:43:07.361707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:50.837855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303629+0000","last_change":"2024-04-25T15:43:00.263841+0000","last_active":"2024-04-25T15:43:06.303629+0000","last_peered":"2024-04-25T15:43:06.303629+0000","last_clean":"2024-04-25T15:43:06.303629+0000","last_became_active":"2024-04-25T15:43:00.259513+0000","last_became_peered":"2024-04-25T15:43:00.259513+0000","last_unstale":"2024-04-25T15:43:06.303629+0000","last_undegraded":"2024-04-25T15:43:06.303629+0000","last_fullsized":"2024-04-25T15:43:06.303629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360219+0000","last_change":"2024-04-25T15:43:05.326603+0000","last_active":"2024-04-25T15:43:07.360219+0000","last_peered":"2024-04-25T15:43:07.360219+0000","last_clean":"2024-04-25T15:43:07.360219+0000","last_became_active":"2024-04-25T15:43:05.326181+0000","last_became_peered":"2024-04-25T15:43:05.326181+0000","last_unstale":"2024-04-25T15:43:07.360219+0000","last_undegraded":"2024-04-25T15:43:07.360219+0000","last_fullsized":"2024-04-25T15:43:07.360219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359858+0000","last_change":"2024-04-25T15:43:01.288148+0000","last_active":"2024-04-25T15:43:07.359858+0000","last_peered":"2024-04-25T15:43:07.359858+0000","last_clean":"2024-04-25T15:43:07.359858+0000","last_became_active":"2024-04-25T15:43:01.287837+0000","last_became_peered":"2024-04-25T15:43:01.287837+0000","last_unstale":"2024-04-25T15:43:07.359858+0000","last_undegraded":"2024-04-25T15:43:07.359858+0000","last_fullsized":"2024-04-25T15:43:07.359858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515397+0000","last_change":"2024-04-25T15:43:00.263967+0000","last_active":"2024-04-25T15:43:06.515397+0000","last_peered":"2024-04-25T15:43:06.515397+0000","last_clean":"2024-04-25T15:43:06.515397+0000","last_became_active":"2024-04-25T15:43:00.263603+0000","last_became_peered":"2024-04-25T15:43:00.263603+0000","last_unstale":"2024-04-25T15:43:06.515397+0000","last_undegraded":"2024-04-25T15:43:06.515397+0000","last_fullsized":"2024-04-25T15:43:06.515397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303747+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:43:06.303747+0000","last_peered":"2024-04-25T15:43:06.303747+0000","last_clean":"2024-04-25T15:43:06.303747+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:43:06.303747+0000","last_undegraded":"2024-04-25T15:43:06.303747+0000","last_fullsized":"2024-04-25T15:43:06.303747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173554+0000","last_change":"2024-04-25T15:43:05.325980+0000","last_active":"2024-04-25T15:43:07.173554+0000","last_peered":"2024-04-25T15:43:07.173554+0000","last_clean":"2024-04-25T15:43:07.173554+0000","last_became_active":"2024-04-25T15:43:05.325470+0000","last_became_peered":"2024-04-25T15:43:05.325470+0000","last_unstale":"2024-04-25T15:43:07.173554+0000","last_undegraded":"2024-04-25T15:43:07.173554+0000","last_fullsized":"2024-04-25T15:43:07.173554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304947+0000","last_change":"2024-04-25T15:43:01.291577+0000","last_active":"2024-04-25T15:43:06.304947+0000","last_peered":"2024-04-25T15:43:06.304947+0000","last_clean":"2024-04-25T15:43:06.304947+0000","last_became_active":"2024-04-25T15:43:01.290296+0000","last_became_peered":"2024-04-25T15:43:01.290296+0000","last_unstale":"2024-04-25T15:43:06.304947+0000","last_undegraded":"2024-04-25T15:43:06.304947+0000","last_fullsized":"2024-04-25T15:43:06.304947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:04.182446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305178+0000","last_change":"2024-04-25T15:43:00.263762+0000","last_active":"2024-04-25T15:43:06.305178+0000","last_peered":"2024-04-25T15:43:06.305178+0000","last_clean":"2024-04-25T15:43:06.305178+0000","last_became_active":"2024-04-25T15:43:00.263444+0000","last_became_peered":"2024-04-25T15:43:00.263444+0000","last_unstale":"2024-04-25T15:43:06.305178+0000","last_undegraded":"2024-04-25T15:43:06.305178+0000","last_fullsized":"2024-04-25T15:43:06.305178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173159+0000","last_change":"2024-04-25T15:43:05.322505+0000","last_active":"2024-04-25T15:43:07.173159+0000","last_peered":"2024-04-25T15:43:07.173159+0000","last_clean":"2024-04-25T15:43:07.173159+0000","last_became_active":"2024-04-25T15:43:05.321587+0000","last_became_peered":"2024-04-25T15:43:05.321587+0000","last_unstale":"2024-04-25T15:43:07.173159+0000","last_undegraded":"2024-04-25T15:43:07.173159+0000","last_fullsized":"2024-04-25T15:43:07.173159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515673+0000","last_change":"2024-04-25T15:43:01.300693+0000","last_active":"2024-04-25T15:43:06.515673+0000","last_peered":"2024-04-25T15:43:06.515673+0000","last_clean":"2024-04-25T15:43:06.515673+0000","last_became_active":"2024-04-25T15:43:01.300378+0000","last_became_peered":"2024-04-25T15:43:01.300378+0000","last_unstale":"2024-04-25T15:43:06.515673+0000","last_undegraded":"2024-04-25T15:43:06.515673+0000","last_fullsized":"2024-04-25T15:43:06.515673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360192+0000","last_change":"2024-04-25T15:43:00.267797+0000","last_active":"2024-04-25T15:43:07.360192+0000","last_peered":"2024-04-25T15:43:07.360192+0000","last_clean":"2024-04-25T15:43:07.360192+0000","last_became_active":"2024-04-25T15:43:00.267467+0000","last_became_peered":"2024-04-25T15:43:00.267467+0000","last_unstale":"2024-04-25T15:43:07.360192+0000","last_undegraded":"2024-04-25T15:43:07.360192+0000","last_fullsized":"2024-04-25T15:43:07.360192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360732+0000","last_change":"2024-04-25T15:43:05.325019+0000","last_active":"2024-04-25T15:43:07.360732+0000","last_peered":"2024-04-25T15:43:07.360732+0000","last_clean":"2024-04-25T15:43:07.360732+0000","last_became_active":"2024-04-25T15:43:05.324242+0000","last_became_peered":"2024-04-25T15:43:05.324242+0000","last_unstale":"2024-04-25T15:43:07.360732+0000","last_undegraded":"2024-04-25T15:43:07.360732+0000","last_fullsized":"2024-04-25T15:43:07.360732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305633+0000","last_change":"2024-04-25T15:43:01.295638+0000","last_active":"2024-04-25T15:43:06.305633+0000","last_peered":"2024-04-25T15:43:06.305633+0000","last_clean":"2024-04-25T15:43:06.305633+0000","last_became_active":"2024-04-25T15:43:01.295339+0000","last_became_peered":"2024-04-25T15:43:01.295339+0000","last_unstale":"2024-04-25T15:43:06.305633+0000","last_undegraded":"2024-04-25T15:43:06.305633+0000","last_fullsized":"2024-04-25T15:43:06.305633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:19.579163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305341+0000","last_change":"2024-04-25T15:43:00.267600+0000","last_active":"2024-04-25T15:43:06.305341+0000","last_peered":"2024-04-25T15:43:06.305341+0000","last_clean":"2024-04-25T15:43:06.305341+0000","last_became_active":"2024-04-25T15:43:00.267267+0000","last_became_peered":"2024-04-25T15:43:00.267267+0000","last_unstale":"2024-04-25T15:43:06.305341+0000","last_undegraded":"2024-04-25T15:43:06.305341+0000","last_fullsized":"2024-04-25T15:43:06.305341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515040+0000","last_change":"2024-04-25T15:43:05.320492+0000","last_active":"2024-04-25T15:43:06.515040+0000","last_peered":"2024-04-25T15:43:06.515040+0000","last_clean":"2024-04-25T15:43:06.515040+0000","last_became_active":"2024-04-25T15:43:05.319988+0000","last_became_peered":"2024-04-25T15:43:05.319988+0000","last_unstale":"2024-04-25T15:43:06.515040+0000","last_undegraded":"2024-04-25T15:43:06.515040+0000","last_fullsized":"2024-04-25T15:43:06.515040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:23.622692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305282+0000","last_change":"2024-04-25T15:43:01.298673+0000","last_active":"2024-04-25T15:43:06.305282+0000","last_peered":"2024-04-25T15:43:06.305282+0000","last_clean":"2024-04-25T15:43:06.305282+0000","last_became_active":"2024-04-25T15:43:01.296072+0000","last_became_peered":"2024-04-25T15:43:01.296072+0000","last_unstale":"2024-04-25T15:43:06.305282+0000","last_undegraded":"2024-04-25T15:43:06.305282+0000","last_fullsized":"2024-04-25T15:43:06.305282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304317+0000","last_change":"2024-04-25T15:43:00.265700+0000","last_active":"2024-04-25T15:43:06.304317+0000","last_peered":"2024-04-25T15:43:06.304317+0000","last_clean":"2024-04-25T15:43:06.304317+0000","last_became_active":"2024-04-25T15:43:00.265341+0000","last_became_peered":"2024-04-25T15:43:00.265341+0000","last_unstale":"2024-04-25T15:43:06.304317+0000","last_undegraded":"2024-04-25T15:43:06.304317+0000","last_fullsized":"2024-04-25T15:43:06.304317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304762+0000","last_change":"2024-04-25T15:43:05.325994+0000","last_active":"2024-04-25T15:43:06.304762+0000","last_peered":"2024-04-25T15:43:06.304762+0000","last_clean":"2024-04-25T15:43:06.304762+0000","last_became_active":"2024-04-25T15:43:05.325552+0000","last_became_peered":"2024-04-25T15:43:05.325552+0000","last_unstale":"2024-04-25T15:43:06.304762+0000","last_undegraded":"2024-04-25T15:43:06.304762+0000","last_fullsized":"2024-04-25T15:43:06.304762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:17.249622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303941+0000","last_change":"2024-04-25T15:43:01.297032+0000","last_active":"2024-04-25T15:43:06.303941+0000","last_peered":"2024-04-25T15:43:06.303941+0000","last_clean":"2024-04-25T15:43:06.303941+0000","last_became_active":"2024-04-25T15:43:01.296701+0000","last_became_peered":"2024-04-25T15:43:01.296701+0000","last_unstale":"2024-04-25T15:43:06.303941+0000","last_undegraded":"2024-04-25T15:43:06.303941+0000","last_fullsized":"2024-04-25T15:43:06.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304781+0000","last_change":"2024-04-25T15:43:00.265707+0000","last_active":"2024-04-25T15:43:06.304781+0000","last_peered":"2024-04-25T15:43:06.304781+0000","last_clean":"2024-04-25T15:43:06.304781+0000","last_became_active":"2024-04-25T15:43:00.265407+0000","last_became_peered":"2024-04-25T15:43:00.265407+0000","last_unstale":"2024-04-25T15:43:06.304781+0000","last_undegraded":"2024-04-25T15:43:06.304781+0000","last_fullsized":"2024-04-25T15:43:06.304781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360050+0000","last_change":"2024-04-25T15:43:05.320474+0000","last_active":"2024-04-25T15:43:07.360050+0000","last_peered":"2024-04-25T15:43:07.360050+0000","last_clean":"2024-04-25T15:43:07.360050+0000","last_became_active":"2024-04-25T15:43:05.320017+0000","last_became_peered":"2024-04-25T15:43:05.320017+0000","last_unstale":"2024-04-25T15:43:07.360050+0000","last_undegraded":"2024-04-25T15:43:07.360050+0000","last_fullsized":"2024-04-25T15:43:07.360050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173085+0000","last_change":"2024-04-25T15:43:01.294565+0000","last_active":"2024-04-25T15:43:07.173085+0000","last_peered":"2024-04-25T15:43:07.173085+0000","last_clean":"2024-04-25T15:43:07.173085+0000","last_became_active":"2024-04-25T15:43:01.294244+0000","last_became_peered":"2024-04-25T15:43:01.294244+0000","last_unstale":"2024-04-25T15:43:07.173085+0000","last_undegraded":"2024-04-25T15:43:07.173085+0000","last_fullsized":"2024-04-25T15:43:07.173085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173164+0000","last_change":"2024-04-25T15:43:00.266625+0000","last_active":"2024-04-25T15:43:07.173164+0000","last_peered":"2024-04-25T15:43:07.173164+0000","last_clean":"2024-04-25T15:43:07.173164+0000","last_became_active":"2024-04-25T15:43:00.266059+0000","last_became_peered":"2024-04-25T15:43:00.266059+0000","last_unstale":"2024-04-25T15:43:07.173164+0000","last_undegraded":"2024-04-25T15:43:07.173164+0000","last_fullsized":"2024-04-25T15:43:07.173164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361118+0000","last_change":"2024-04-25T15:43:05.327896+0000","last_active":"2024-04-25T15:43:07.361118+0000","last_peered":"2024-04-25T15:43:07.361118+0000","last_clean":"2024-04-25T15:43:07.361118+0000","last_became_active":"2024-04-25T15:43:05.327450+0000","last_became_peered":"2024-04-25T15:43:05.327450+0000","last_unstale":"2024-04-25T15:43:07.361118+0000","last_undegraded":"2024-04-25T15:43:07.361118+0000","last_fullsized":"2024-04-25T15:43:07.361118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:05.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304793+0000","last_change":"2024-04-25T15:43:01.298299+0000","last_active":"2024-04-25T15:43:06.304793+0000","last_peered":"2024-04-25T15:43:06.304793+0000","last_clean":"2024-04-25T15:43:06.304793+0000","last_became_active":"2024-04-25T15:43:01.295916+0000","last_became_peered":"2024-04-25T15:43:01.295916+0000","last_unstale":"2024-04-25T15:43:06.304793+0000","last_undegraded":"2024-04-25T15:43:06.304793+0000","last_fullsized":"2024-04-25T15:43:06.304793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515439+0000","last_change":"2024-04-25T15:43:00.271764+0000","last_active":"2024-04-25T15:43:06.515439+0000","last_peered":"2024-04-25T15:43:06.515439+0000","last_clean":"2024-04-25T15:43:06.515439+0000","last_became_active":"2024-04-25T15:43:00.271471+0000","last_became_peered":"2024-04-25T15:43:00.271471+0000","last_unstale":"2024-04-25T15:43:06.515439+0000","last_undegraded":"2024-04-25T15:43:06.515439+0000","last_fullsized":"2024-04-25T15:43:06.515439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362023+0000","last_change":"2024-04-25T15:43:05.324240+0000","last_active":"2024-04-25T15:43:07.362023+0000","last_peered":"2024-04-25T15:43:07.362023+0000","last_clean":"2024-04-25T15:43:07.362023+0000","last_became_active":"2024-04-25T15:43:05.323806+0000","last_became_peered":"2024-04-25T15:43:05.323806+0000","last_unstale":"2024-04-25T15:43:07.362023+0000","last_undegraded":"2024-04-25T15:43:07.362023+0000","last_fullsized":"2024-04-25T15:43:07.362023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:04.722313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360889+0000","last_change":"2024-04-25T15:43:01.294356+0000","last_active":"2024-04-25T15:43:07.360889+0000","last_peered":"2024-04-25T15:43:07.360889+0000","last_clean":"2024-04-25T15:43:07.360889+0000","last_became_active":"2024-04-25T15:43:01.294033+0000","last_became_peered":"2024-04-25T15:43:01.294033+0000","last_unstale":"2024-04-25T15:43:07.360889+0000","last_undegraded":"2024-04-25T15:43:07.360889+0000","last_fullsized":"2024-04-25T15:43:07.360889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360783+0000","last_change":"2024-04-25T15:43:00.261060+0000","last_active":"2024-04-25T15:43:07.360783+0000","last_peered":"2024-04-25T15:43:07.360783+0000","last_clean":"2024-04-25T15:43:07.360783+0000","last_became_active":"2024-04-25T15:43:00.258388+0000","last_became_peered":"2024-04-25T15:43:00.258388+0000","last_unstale":"2024-04-25T15:43:07.360783+0000","last_undegraded":"2024-04-25T15:43:07.360783+0000","last_fullsized":"2024-04-25T15:43:07.360783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515749+0000","last_change":"2024-04-25T15:43:05.325879+0000","last_active":"2024-04-25T15:43:06.515749+0000","last_peered":"2024-04-25T15:43:06.515749+0000","last_clean":"2024-04-25T15:43:06.515749+0000","last_became_active":"2024-04-25T15:43:05.325457+0000","last_became_peered":"2024-04-25T15:43:05.325457+0000","last_unstale":"2024-04-25T15:43:06.515749+0000","last_undegraded":"2024-04-25T15:43:06.515749+0000","last_fullsized":"2024-04-25T15:43:06.515749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304575+0000","last_change":"2024-04-25T15:43:01.281220+0000","last_active":"2024-04-25T15:43:06.304575+0000","last_peered":"2024-04-25T15:43:06.304575+0000","last_clean":"2024-04-25T15:43:06.304575+0000","last_became_active":"2024-04-25T15:43:01.280690+0000","last_became_peered":"2024-04-25T15:43:01.280690+0000","last_unstale":"2024-04-25T15:43:06.304575+0000","last_undegraded":"2024-04-25T15:43:06.304575+0000","last_fullsized":"2024-04-25T15:43:06.304575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:10.678852+0000","last_change":"2024-04-25T15:43:00.275195+0000","last_active":"2024-04-25T15:43:10.678852+0000","last_peered":"2024-04-25T15:43:10.678852+0000","last_clean":"2024-04-25T15:43:10.678852+0000","last_became_active":"2024-04-25T15:43:00.274890+0000","last_became_peered":"2024-04-25T15:43:00.274890+0000","last_unstale":"2024-04-25T15:43:10.678852+0000","last_undegraded":"2024-04-25T15:43:10.678852+0000","last_fullsized":"2024-04-25T15:43:10.678852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361677+0000","last_change":"2024-04-25T15:43:05.332218+0000","last_active":"2024-04-25T15:43:07.361677+0000","last_peered":"2024-04-25T15:43:07.361677+0000","last_clean":"2024-04-25T15:43:07.361677+0000","last_became_active":"2024-04-25T15:43:05.331327+0000","last_became_peered":"2024-04-25T15:43:05.331327+0000","last_unstale":"2024-04-25T15:43:07.361677+0000","last_undegraded":"2024-04-25T15:43:07.361677+0000","last_fullsized":"2024-04-25T15:43:07.361677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304852+0000","last_change":"2024-04-25T15:43:01.301873+0000","last_active":"2024-04-25T15:43:06.304852+0000","last_peered":"2024-04-25T15:43:06.304852+0000","last_clean":"2024-04-25T15:43:06.304852+0000","last_became_active":"2024-04-25T15:43:01.301515+0000","last_became_peered":"2024-04-25T15:43:01.301515+0000","last_unstale":"2024-04-25T15:43:06.304852+0000","last_undegraded":"2024-04-25T15:43:06.304852+0000","last_fullsized":"2024-04-25T15:43:06.304852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:56.239547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360072+0000","last_change":"2024-04-25T15:43:00.263472+0000","last_active":"2024-04-25T15:43:07.360072+0000","last_peered":"2024-04-25T15:43:07.360072+0000","last_clean":"2024-04-25T15:43:07.360072+0000","last_became_active":"2024-04-25T15:43:00.263063+0000","last_became_peered":"2024-04-25T15:43:00.263063+0000","last_unstale":"2024-04-25T15:43:07.360072+0000","last_undegraded":"2024-04-25T15:43:07.360072+0000","last_fullsized":"2024-04-25T15:43:07.360072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305069+0000","last_change":"2024-04-25T15:43:05.335662+0000","last_active":"2024-04-25T15:43:06.305069+0000","last_peered":"2024-04-25T15:43:06.305069+0000","last_clean":"2024-04-25T15:43:06.305069+0000","last_became_active":"2024-04-25T15:43:05.334883+0000","last_became_peered":"2024-04-25T15:43:05.334883+0000","last_unstale":"2024-04-25T15:43:06.305069+0000","last_undegraded":"2024-04-25T15:43:06.305069+0000","last_fullsized":"2024-04-25T15:43:06.305069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362170+0000","last_change":"2024-04-25T15:43:01.301400+0000","last_active":"2024-04-25T15:43:07.362170+0000","last_peered":"2024-04-25T15:43:07.362170+0000","last_clean":"2024-04-25T15:43:07.362170+0000","last_became_active":"2024-04-25T15:43:01.301067+0000","last_became_peered":"2024-04-25T15:43:01.301067+0000","last_unstale":"2024-04-25T15:43:07.362170+0000","last_undegraded":"2024-04-25T15:43:07.362170+0000","last_fullsized":"2024-04-25T15:43:07.362170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515580+0000","last_change":"2024-04-25T15:43:00.267119+0000","last_active":"2024-04-25T15:43:06.515580+0000","last_peered":"2024-04-25T15:43:06.515580+0000","last_clean":"2024-04-25T15:43:06.515580+0000","last_became_active":"2024-04-25T15:43:00.266760+0000","last_became_peered":"2024-04-25T15:43:00.266760+0000","last_unstale":"2024-04-25T15:43:06.515580+0000","last_undegraded":"2024-04-25T15:43:06.515580+0000","last_fullsized":"2024-04-25T15:43:06.515580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360595+0000","last_change":"2024-04-25T15:43:05.329155+0000","last_active":"2024-04-25T15:43:07.360595+0000","last_peered":"2024-04-25T15:43:07.360595+0000","last_clean":"2024-04-25T15:43:07.360595+0000","last_became_active":"2024-04-25T15:43:05.328650+0000","last_became_peered":"2024-04-25T15:43:05.328650+0000","last_unstale":"2024-04-25T15:43:07.360595+0000","last_undegraded":"2024-04-25T15:43:07.360595+0000","last_fullsized":"2024-04-25T15:43:07.360595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:14.129232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515527+0000","last_change":"2024-04-25T15:43:01.297332+0000","last_active":"2024-04-25T15:43:06.515527+0000","last_peered":"2024-04-25T15:43:06.515527+0000","last_clean":"2024-04-25T15:43:06.515527+0000","last_became_active":"2024-04-25T15:43:01.296726+0000","last_became_peered":"2024-04-25T15:43:01.296726+0000","last_unstale":"2024-04-25T15:43:06.515527+0000","last_undegraded":"2024-04-25T15:43:06.515527+0000","last_fullsized":"2024-04-25T15:43:06.515527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173728+0000","last_change":"2024-04-25T15:43:00.266633+0000","last_active":"2024-04-25T15:43:07.173728+0000","last_peered":"2024-04-25T15:43:07.173728+0000","last_clean":"2024-04-25T15:43:07.173728+0000","last_became_active":"2024-04-25T15:43:00.266221+0000","last_became_peered":"2024-04-25T15:43:00.266221+0000","last_unstale":"2024-04-25T15:43:07.173728+0000","last_undegraded":"2024-04-25T15:43:07.173728+0000","last_fullsized":"2024-04-25T15:43:07.173728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360149+0000","last_change":"2024-04-25T15:43:05.326763+0000","last_active":"2024-04-25T15:43:07.360149+0000","last_peered":"2024-04-25T15:43:07.360149+0000","last_clean":"2024-04-25T15:43:07.360149+0000","last_became_active":"2024-04-25T15:43:05.326387+0000","last_became_peered":"2024-04-25T15:43:05.326387+0000","last_unstale":"2024-04-25T15:43:07.360149+0000","last_undegraded":"2024-04-25T15:43:07.360149+0000","last_fullsized":"2024-04-25T15:43:07.360149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:43.920077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359880+0000","last_change":"2024-04-25T15:43:05.325423+0000","last_active":"2024-04-25T15:43:07.359880+0000","last_peered":"2024-04-25T15:43:07.359880+0000","last_clean":"2024-04-25T15:43:07.359880+0000","last_became_active":"2024-04-25T15:43:05.324948+0000","last_became_peered":"2024-04-25T15:43:05.324948+0000","last_unstale":"2024-04-25T15:43:07.359880+0000","last_undegraded":"2024-04-25T15:43:07.359880+0000","last_fullsized":"2024-04-25T15:43:07.359880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360431+0000","last_change":"2024-04-25T15:43:01.279748+0000","last_active":"2024-04-25T15:43:07.360431+0000","last_peered":"2024-04-25T15:43:07.360431+0000","last_clean":"2024-04-25T15:43:07.360431+0000","last_became_active":"2024-04-25T15:43:01.278850+0000","last_became_peered":"2024-04-25T15:43:01.278850+0000","last_unstale":"2024-04-25T15:43:07.360431+0000","last_undegraded":"2024-04-25T15:43:07.360431+0000","last_fullsized":"2024-04-25T15:43:07.360431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515195+0000","last_change":"2024-04-25T15:43:00.264122+0000","last_active":"2024-04-25T15:43:06.515195+0000","last_peered":"2024-04-25T15:43:06.515195+0000","last_clean":"2024-04-25T15:43:06.515195+0000","last_became_active":"2024-04-25T15:43:00.263813+0000","last_became_peered":"2024-04-25T15:43:00.263813+0000","last_unstale":"2024-04-25T15:43:06.515195+0000","last_undegraded":"2024-04-25T15:43:06.515195+0000","last_fullsized":"2024-04-25T15:43:06.515195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173731+0000","last_change":"2024-04-25T15:43:05.322215+0000","last_active":"2024-04-25T15:43:07.173731+0000","last_peered":"2024-04-25T15:43:07.173731+0000","last_clean":"2024-04-25T15:43:07.173731+0000","last_became_active":"2024-04-25T15:43:05.321735+0000","last_became_peered":"2024-04-25T15:43:05.321735+0000","last_unstale":"2024-04-25T15:43:07.173731+0000","last_undegraded":"2024-04-25T15:43:07.173731+0000","last_fullsized":"2024-04-25T15:43:07.173731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360649+0000","last_change":"2024-04-25T15:43:01.282374+0000","last_active":"2024-04-25T15:43:07.360649+0000","last_peered":"2024-04-25T15:43:07.360649+0000","last_clean":"2024-04-25T15:43:07.360649+0000","last_became_active":"2024-04-25T15:43:01.282048+0000","last_became_peered":"2024-04-25T15:43:01.282048+0000","last_unstale":"2024-04-25T15:43:07.360649+0000","last_undegraded":"2024-04-25T15:43:07.360649+0000","last_fullsized":"2024-04-25T15:43:07.360649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360467+0000","last_change":"2024-04-25T15:43:00.272805+0000","last_active":"2024-04-25T15:43:07.360467+0000","last_peered":"2024-04-25T15:43:07.360467+0000","last_clean":"2024-04-25T15:43:07.360467+0000","last_became_active":"2024-04-25T15:43:00.272566+0000","last_became_peered":"2024-04-25T15:43:00.272566+0000","last_unstale":"2024-04-25T15:43:07.360467+0000","last_undegraded":"2024-04-25T15:43:07.360467+0000","last_fullsized":"2024-04-25T15:43:07.360467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:29.718089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173285+0000","last_change":"2024-04-25T15:43:00.267609+0000","last_active":"2024-04-25T15:43:07.173285+0000","last_peered":"2024-04-25T15:43:07.173285+0000","last_clean":"2024-04-25T15:43:07.173285+0000","last_became_active":"2024-04-25T15:43:00.266867+0000","last_became_peered":"2024-04-25T15:43:00.266867+0000","last_unstale":"2024-04-25T15:43:07.173285+0000","last_undegraded":"2024-04-25T15:43:07.173285+0000","last_fullsized":"2024-04-25T15:43:07.173285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360778+0000","last_change":"2024-04-25T15:43:01.294246+0000","last_active":"2024-04-25T15:43:07.360778+0000","last_peered":"2024-04-25T15:43:07.360778+0000","last_clean":"2024-04-25T15:43:07.360778+0000","last_became_active":"2024-04-25T15:43:01.293930+0000","last_became_peered":"2024-04-25T15:43:01.293930+0000","last_unstale":"2024-04-25T15:43:07.360778+0000","last_undegraded":"2024-04-25T15:43:07.360778+0000","last_fullsized":"2024-04-25T15:43:07.360778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.321856+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.321309+0000","last_became_peered":"2024-04-25T15:43:05.321309+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:05.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361555+0000","last_change":"2024-04-25T15:43:00.273709+0000","last_active":"2024-04-25T15:43:07.361555+0000","last_peered":"2024-04-25T15:43:07.361555+0000","last_clean":"2024-04-25T15:43:07.361555+0000","last_became_active":"2024-04-25T15:43:00.273411+0000","last_became_peered":"2024-04-25T15:43:00.273411+0000","last_unstale":"2024-04-25T15:43:07.361555+0000","last_undegraded":"2024-04-25T15:43:07.361555+0000","last_fullsized":"2024-04-25T15:43:07.361555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.512229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304319+0000","last_change":"2024-04-25T15:43:01.290938+0000","last_active":"2024-04-25T15:43:06.304319+0000","last_peered":"2024-04-25T15:43:06.304319+0000","last_clean":"2024-04-25T15:43:06.304319+0000","last_became_active":"2024-04-25T15:43:01.290644+0000","last_became_peered":"2024-04-25T15:43:01.290644+0000","last_unstale":"2024-04-25T15:43:06.304319+0000","last_undegraded":"2024-04-25T15:43:06.304319+0000","last_fullsized":"2024-04-25T15:43:06.304319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:51.310158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360648+0000","last_change":"2024-04-25T15:43:05.325374+0000","last_active":"2024-04-25T15:43:07.360648+0000","last_peered":"2024-04-25T15:43:07.360648+0000","last_clean":"2024-04-25T15:43:07.360648+0000","last_became_active":"2024-04-25T15:43:05.324880+0000","last_became_peered":"2024-04-25T15:43:05.324880+0000","last_unstale":"2024-04-25T15:43:07.360648+0000","last_undegraded":"2024-04-25T15:43:07.360648+0000","last_fullsized":"2024-04-25T15:43:07.360648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:44.634102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.172990+0000","last_change":"2024-04-25T15:43:01.294802+0000","last_active":"2024-04-25T15:43:07.172990+0000","last_peered":"2024-04-25T15:43:07.172990+0000","last_clean":"2024-04-25T15:43:07.172990+0000","last_became_active":"2024-04-25T15:43:01.293680+0000","last_became_peered":"2024-04-25T15:43:01.293680+0000","last_unstale":"2024-04-25T15:43:07.172990+0000","last_undegraded":"2024-04-25T15:43:07.172990+0000","last_fullsized":"2024-04-25T15:43:07.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304824+0000","last_change":"2024-04-25T15:43:01.287546+0000","last_active":"2024-04-25T15:43:06.304824+0000","last_peered":"2024-04-25T15:43:06.304824+0000","last_clean":"2024-04-25T15:43:06.304824+0000","last_became_active":"2024-04-25T15:43:01.287193+0000","last_became_peered":"2024-04-25T15:43:01.287193+0000","last_unstale":"2024-04-25T15:43:06.304824+0000","last_undegraded":"2024-04-25T15:43:06.304824+0000","last_fullsized":"2024-04-25T15:43:06.304824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:58.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515392+0000","last_change":"2024-04-25T15:43:01.291635+0000","last_active":"2024-04-25T15:43:06.515392+0000","last_peered":"2024-04-25T15:43:06.515392+0000","last_clean":"2024-04-25T15:43:06.515392+0000","last_became_active":"2024-04-25T15:43:01.291222+0000","last_became_peered":"2024-04-25T15:43:01.291222+0000","last_unstale":"2024-04-25T15:43:06.515392+0000","last_undegraded":"2024-04-25T15:43:06.515392+0000","last_fullsized":"2024-04-25T15:43:06.515392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360670+0000","last_change":"2024-04-25T15:43:01.283764+0000","last_active":"2024-04-25T15:43:07.360670+0000","last_peered":"2024-04-25T15:43:07.360670+0000","last_clean":"2024-04-25T15:43:07.360670+0000","last_became_active":"2024-04-25T15:43:01.283409+0000","last_became_peered":"2024-04-25T15:43:01.283409+0000","last_unstale":"2024-04-25T15:43:07.360670+0000","last_undegraded":"2024-04-25T15:43:07.360670+0000","last_fullsized":"2024-04-25T15:43:07.360670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362184+0000","last_change":"2024-04-25T15:43:01.294089+0000","last_active":"2024-04-25T15:43:07.362184+0000","last_peered":"2024-04-25T15:43:07.362184+0000","last_clean":"2024-04-25T15:43:07.362184+0000","last_became_active":"2024-04-25T15:43:01.293753+0000","last_became_peered":"2024-04-25T15:43:01.293753+0000","last_unstale":"2024-04-25T15:43:07.362184+0000","last_undegraded":"2024-04-25T15:43:07.362184+0000","last_fullsized":"2024-04-25T15:43:07.362184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359861+0000","last_change":"2024-04-25T15:43:01.278680+0000","last_active":"2024-04-25T15:43:07.359861+0000","last_peered":"2024-04-25T15:43:07.359861+0000","last_clean":"2024-04-25T15:43:07.359861+0000","last_became_active":"2024-04-25T15:43:01.278347+0000","last_became_peered":"2024-04-25T15:43:01.278347+0000","last_unstale":"2024-04-25T15:43:07.359861+0000","last_undegraded":"2024-04-25T15:43:07.359861+0000","last_fullsized":"2024-04-25T15:43:07.359861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173725+0000","last_change":"2024-04-25T15:43:01.287386+0000","last_active":"2024-04-25T15:43:07.173725+0000","last_peered":"2024-04-25T15:43:07.173725+0000","last_clean":"2024-04-25T15:43:07.173725+0000","last_became_active":"2024-04-25T15:43:01.287049+0000","last_became_peered":"2024-04-25T15:43:01.287049+0000","last_unstale":"2024-04-25T15:43:07.173725+0000","last_undegraded":"2024-04-25T15:43:07.173725+0000","last_fullsized":"2024-04-25T15:43:07.173725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361171+0000","last_change":"2024-04-25T15:43:01.295000+0000","last_active":"2024-04-25T15:43:07.361171+0000","last_peered":"2024-04-25T15:43:07.361171+0000","last_clean":"2024-04-25T15:43:07.361171+0000","last_became_active":"2024-04-25T15:43:01.294605+0000","last_became_peered":"2024-04-25T15:43:01.294605+0000","last_unstale":"2024-04-25T15:43:07.361171+0000","last_undegraded":"2024-04-25T15:43:07.361171+0000","last_fullsized":"2024-04-25T15:43:07.361171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515111+0000","last_change":"2024-04-25T15:43:01.291742+0000","last_active":"2024-04-25T15:43:06.515111+0000","last_peered":"2024-04-25T15:43:06.515111+0000","last_clean":"2024-04-25T15:43:06.515111+0000","last_became_active":"2024-04-25T15:43:01.291354+0000","last_became_peered":"2024-04-25T15:43:01.291354+0000","last_unstale":"2024-04-25T15:43:06.515111+0000","last_undegraded":"2024-04-25T15:43:06.515111+0000","last_fullsized":"2024-04-25T15:43:06.515111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360284+0000","last_change":"2024-04-25T15:43:01.296211+0000","last_active":"2024-04-25T15:43:07.360284+0000","last_peered":"2024-04-25T15:43:07.360284+0000","last_clean":"2024-04-25T15:43:07.360284+0000","last_became_active":"2024-04-25T15:43:01.295195+0000","last_became_peered":"2024-04-25T15:43:01.295195+0000","last_unstale":"2024-04-25T15:43:07.360284+0000","last_undegraded":"2024-04-25T15:43:07.360284+0000","last_fullsized":"2024-04-25T15:43:07.360284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515314+0000","last_change":"2024-04-25T15:43:01.303436+0000","last_active":"2024-04-25T15:43:06.515314+0000","last_peered":"2024-04-25T15:43:06.515314+0000","last_clean":"2024-04-25T15:43:06.515314+0000","last_became_active":"2024-04-25T15:43:01.303068+0000","last_became_peered":"2024-04-25T15:43:01.303068+0000","last_unstale":"2024-04-25T15:43:06.515314+0000","last_undegraded":"2024-04-25T15:43:06.515314+0000","last_fullsized":"2024-04-25T15:43:06.515314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360519+0000","last_change":"2024-04-25T15:43:01.295585+0000","last_active":"2024-04-25T15:43:07.360519+0000","last_peered":"2024-04-25T15:43:07.360519+0000","last_clean":"2024-04-25T15:43:07.360519+0000","last_became_active":"2024-04-25T15:43:01.294821+0000","last_became_peered":"2024-04-25T15:43:01.294821+0000","last_unstale":"2024-04-25T15:43:07.360519+0000","last_undegraded":"2024-04-25T15:43:07.360519+0000","last_fullsized":"2024-04-25T15:43:07.360519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173483+0000","last_change":"2024-04-25T15:43:01.296022+0000","last_active":"2024-04-25T15:43:07.173483+0000","last_peered":"2024-04-25T15:43:07.173483+0000","last_clean":"2024-04-25T15:43:07.173483+0000","last_became_active":"2024-04-25T15:43:01.295477+0000","last_became_peered":"2024-04-25T15:43:01.295477+0000","last_unstale":"2024-04-25T15:43:07.173483+0000","last_undegraded":"2024-04-25T15:43:07.173483+0000","last_fullsized":"2024-04-25T15:43:07.173483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305121+0000","last_change":"2024-04-25T15:43:01.293363+0000","last_active":"2024-04-25T15:43:06.305121+0000","last_peered":"2024-04-25T15:43:06.305121+0000","last_clean":"2024-04-25T15:43:06.305121+0000","last_became_active":"2024-04-25T15:43:01.290509+0000","last_became_peered":"2024-04-25T15:43:01.290509+0000","last_unstale":"2024-04-25T15:43:06.305121+0000","last_undegraded":"2024-04-25T15:43:06.305121+0000","last_fullsized":"2024-04-25T15:43:06.305121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:44.264051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305240+0000","last_change":"2024-04-25T15:43:01.289526+0000","last_active":"2024-04-25T15:43:06.305240+0000","last_peered":"2024-04-25T15:43:06.305240+0000","last_clean":"2024-04-25T15:43:06.305240+0000","last_became_active":"2024-04-25T15:43:01.289019+0000","last_became_peered":"2024-04-25T15:43:01.289019+0000","last_unstale":"2024-04-25T15:43:06.305240+0000","last_undegraded":"2024-04-25T15:43:06.305240+0000","last_fullsized":"2024-04-25T15:43:06.305240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515937+0000","last_change":"2024-04-25T15:43:01.301402+0000","last_active":"2024-04-25T15:43:06.515937+0000","last_peered":"2024-04-25T15:43:06.515937+0000","last_clean":"2024-04-25T15:43:06.515937+0000","last_became_active":"2024-04-25T15:43:01.301026+0000","last_became_peered":"2024-04-25T15:43:01.301026+0000","last_unstale":"2024-04-25T15:43:06.515937+0000","last_undegraded":"2024-04-25T15:43:06.515937+0000","last_fullsized":"2024-04-25T15:43:06.515937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515052+0000","last_change":"2024-04-25T15:43:01.297919+0000","last_active":"2024-04-25T15:43:06.515052+0000","last_peered":"2024-04-25T15:43:06.515052+0000","last_clean":"2024-04-25T15:43:06.515052+0000","last_became_active":"2024-04-25T15:43:01.295658+0000","last_became_peered":"2024-04-25T15:43:01.295658+0000","last_unstale":"2024-04-25T15:43:06.515052+0000","last_undegraded":"2024-04-25T15:43:06.515052+0000","last_fullsized":"2024-04-25T15:43:06.515052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360534+0000","last_change":"2024-04-25T15:43:01.294743+0000","last_active":"2024-04-25T15:43:07.360534+0000","last_peered":"2024-04-25T15:43:07.360534+0000","last_clean":"2024-04-25T15:43:07.360534+0000","last_became_active":"2024-04-25T15:43:01.294420+0000","last_became_peered":"2024-04-25T15:43:01.294420+0000","last_unstale":"2024-04-25T15:43:07.360534+0000","last_undegraded":"2024-04-25T15:43:07.360534+0000","last_fullsized":"2024-04-25T15:43:07.360534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360776+0000","last_change":"2024-04-25T15:43:01.283558+0000","last_active":"2024-04-25T15:43:07.360776+0000","last_peered":"2024-04-25T15:43:07.360776+0000","last_clean":"2024-04-25T15:43:07.360776+0000","last_became_active":"2024-04-25T15:43:01.283203+0000","last_became_peered":"2024-04-25T15:43:01.283203+0000","last_unstale":"2024-04-25T15:43:07.360776+0000","last_undegraded":"2024-04-25T15:43:07.360776+0000","last_fullsized":"2024-04-25T15:43:07.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:01.569378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360283+0000","last_change":"2024-04-25T15:43:01.287196+0000","last_active":"2024-04-25T15:43:07.360283+0000","last_peered":"2024-04-25T15:43:07.360283+0000","last_clean":"2024-04-25T15:43:07.360283+0000","last_became_active":"2024-04-25T15:43:01.286881+0000","last_became_peered":"2024-04-25T15:43:01.286881+0000","last_unstale":"2024-04-25T15:43:07.360283+0000","last_undegraded":"2024-04-25T15:43:07.360283+0000","last_fullsized":"2024-04-25T15:43:07.360283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304665+0000","last_change":"2024-04-25T15:43:01.294284+0000","last_active":"2024-04-25T15:43:06.304665+0000","last_peered":"2024-04-25T15:43:06.304665+0000","last_clean":"2024-04-25T15:43:06.304665+0000","last_became_active":"2024-04-25T15:43:01.293046+0000","last_became_peered":"2024-04-25T15:43:01.293046+0000","last_unstale":"2024-04-25T15:43:06.304665+0000","last_undegraded":"2024-04-25T15:43:06.304665+0000","last_fullsized":"2024-04-25T15:43:06.304665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:43.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173401+0000","last_change":"2024-04-25T15:43:01.289095+0000","last_active":"2024-04-25T15:43:07.173401+0000","last_peered":"2024-04-25T15:43:07.173401+0000","last_clean":"2024-04-25T15:43:07.173401+0000","last_became_active":"2024-04-25T15:43:01.288193+0000","last_became_peered":"2024-04-25T15:43:01.288193+0000","last_unstale":"2024-04-25T15:43:07.173401+0000","last_undegraded":"2024-04-25T15:43:07.173401+0000","last_fullsized":"2024-04-25T15:43:07.173401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173606+0000","last_change":"2024-04-25T15:43:01.292901+0000","last_active":"2024-04-25T15:43:07.173606+0000","last_peered":"2024-04-25T15:43:07.173606+0000","last_clean":"2024-04-25T15:43:07.173606+0000","last_became_active":"2024-04-25T15:43:01.292459+0000","last_became_peered":"2024-04-25T15:43:01.292459+0000","last_unstale":"2024-04-25T15:43:07.173606+0000","last_undegraded":"2024-04-25T15:43:07.173606+0000","last_fullsized":"2024-04-25T15:43:07.173606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305631+0000","last_change":"2024-04-25T15:43:01.289823+0000","last_active":"2024-04-25T15:43:06.305631+0000","last_peered":"2024-04-25T15:43:06.305631+0000","last_clean":"2024-04-25T15:43:06.305631+0000","last_became_active":"2024-04-25T15:43:01.289511+0000","last_became_peered":"2024-04-25T15:43:01.289511+0000","last_unstale":"2024-04-25T15:43:06.305631+0000","last_undegraded":"2024-04-25T15:43:06.305631+0000","last_fullsized":"2024-04-25T15:43:06.305631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:23.025567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360402+0000","last_change":"2024-04-25T15:43:01.288077+0000","last_active":"2024-04-25T15:43:07.360402+0000","last_peered":"2024-04-25T15:43:07.360402+0000","last_clean":"2024-04-25T15:43:07.360402+0000","last_became_active":"2024-04-25T15:43:01.287776+0000","last_became_peered":"2024-04-25T15:43:01.287776+0000","last_unstale":"2024-04-25T15:43:07.360402+0000","last_undegraded":"2024-04-25T15:43:07.360402+0000","last_fullsized":"2024-04-25T15:43:07.360402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303801+0000","last_change":"2024-04-25T15:43:01.285211+0000","last_active":"2024-04-25T15:43:06.303801+0000","last_peered":"2024-04-25T15:43:06.303801+0000","last_clean":"2024-04-25T15:43:06.303801+0000","last_became_active":"2024-04-25T15:43:01.284874+0000","last_became_peered":"2024-04-25T15:43:01.284874+0000","last_unstale":"2024-04-25T15:43:06.303801+0000","last_undegraded":"2024-04-25T15:43:06.303801+0000","last_fullsized":"2024-04-25T15:43:06.303801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515218+0000","last_change":"2024-04-25T15:43:01.298601+0000","last_active":"2024-04-25T15:43:06.515218+0000","last_peered":"2024-04-25T15:43:06.515218+0000","last_clean":"2024-04-25T15:43:06.515218+0000","last_became_active":"2024-04-25T15:43:01.298301+0000","last_became_peered":"2024-04-25T15:43:01.298301+0000","last_unstale":"2024-04-25T15:43:06.515218+0000","last_undegraded":"2024-04-25T15:43:06.515218+0000","last_fullsized":"2024-04-25T15:43:06.515218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304229+0000","last_change":"2024-04-25T15:43:01.285864+0000","last_active":"2024-04-25T15:43:06.304229+0000","last_peered":"2024-04-25T15:43:06.304229+0000","last_clean":"2024-04-25T15:43:06.304229+0000","last_became_active":"2024-04-25T15:43:01.285575+0000","last_became_peered":"2024-04-25T15:43:01.285575+0000","last_unstale":"2024-04-25T15:43:06.304229+0000","last_undegraded":"2024-04-25T15:43:06.304229+0000","last_fullsized":"2024-04-25T15:43:06.304229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515349+0000","last_change":"2024-04-25T15:43:01.303192+0000","last_active":"2024-04-25T15:43:06.515349+0000","last_peered":"2024-04-25T15:43:06.515349+0000","last_clean":"2024-04-25T15:43:06.515349+0000","last_became_active":"2024-04-25T15:43:01.302882+0000","last_became_peered":"2024-04-25T15:43:01.302882+0000","last_unstale":"2024-04-25T15:43:06.515349+0000","last_undegraded":"2024-04-25T15:43:06.515349+0000","last_fullsized":"2024-04-25T15:43:06.515349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359780+0000","last_change":"2024-04-25T15:43:01.290113+0000","last_active":"2024-04-25T15:43:07.359780+0000","last_peered":"2024-04-25T15:43:07.359780+0000","last_clean":"2024-04-25T15:43:07.359780+0000","last_became_active":"2024-04-25T15:43:01.289784+0000","last_became_peered":"2024-04-25T15:43:01.289784+0000","last_unstale":"2024-04-25T15:43:07.359780+0000","last_undegraded":"2024-04-25T15:43:07.359780+0000","last_fullsized":"2024-04-25T15:43:07.359780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:58.293161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360941+0000","last_change":"2024-04-25T15:43:01.285205+0000","last_active":"2024-04-25T15:43:07.360941+0000","last_peered":"2024-04-25T15:43:07.360941+0000","last_clean":"2024-04-25T15:43:07.360941+0000","last_became_active":"2024-04-25T15:43:01.284834+0000","last_became_peered":"2024-04-25T15:43:01.284834+0000","last_unstale":"2024-04-25T15:43:07.360941+0000","last_undegraded":"2024-04-25T15:43:07.360941+0000","last_fullsized":"2024-04-25T15:43:07.360941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305525+0000","last_change":"2024-04-25T15:43:01.299431+0000","last_active":"2024-04-25T15:43:06.305525+0000","last_peered":"2024-04-25T15:43:06.305525+0000","last_clean":"2024-04-25T15:43:06.305525+0000","last_became_active":"2024-04-25T15:43:01.298478+0000","last_became_peered":"2024-04-25T15:43:01.298478+0000","last_unstale":"2024-04-25T15:43:06.305525+0000","last_undegraded":"2024-04-25T15:43:06.305525+0000","last_fullsized":"2024-04-25T15:43:06.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":103617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":103653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:43:28.908 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:43:29.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.050+0000 7f7ce19d5640 1 Processor -- start 2024-04-25T15:43:29.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.050+0000 7f7ce19d5640 1 -- start start 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.051+0000 7f7ce19d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7cdc0d41b0 0x7f7cdc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.051+0000 7f7ce19d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cdc163fb0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.051+0000 7f7ce19d5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cdc164270 con 0x7f7cdc0b7d60 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.051+0000 7f7ce19d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f7cdc164550 con 0x7f7cdc0d41b0 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cdaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7cdc0d41b0 0x7f7cdc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cdaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7cdc0d41b0 0x7f7cdc0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44410/0 (socket says 172.21.15.80:44410) 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cdaffd640 1 -- 172.21.15.80:0/2751845706 learned_addr learned my addr 172.21.15.80:0/2751845706 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:29.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cd3fff640 1 --1- 172.21.15.80:0/2751845706 >> v1:172.21.15.80:6789/0 conn(0x7f7cdc1602a0 0x7f7cdc0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41900/0 (socket says 172.21.15.80:41900) 2024-04-25T15:43:29.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cdaffd640 1 -- 172.21.15.80:0/2751845706 >> v1:172.21.15.195:6789/0 conn(0x7f7cdc0b7d60 legacy=0x7f7cdc0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cdaffd640 1 -- 172.21.15.80:0/2751845706 >> v1:172.21.15.80:6789/0 conn(0x7f7cdc1602a0 legacy=0x7f7cdc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cdaffd640 1 -- 172.21.15.80:0/2751845706 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc164830 con 0x7f7cdc0d41b0 2024-04-25T15:43:29.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.052+0000 7f7cda7fc640 1 -- 172.21.15.80:0/2751845706 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328492575 0 0) 0x7f7cdc163fb0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7cdaffd640 1 --2- 172.21.15.80:0/2751845706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc0d41b0 0x7f7cdc0b48d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009870 tx=0x7f7ccc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4827c24537d896 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7cda7fc640 1 -- 172.21.15.80:0/2751845706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc037070 con 0x7f7cdc0d41b0 2024-04-25T15:43:29.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7cda7fc640 1 -- 172.21.15.80:0/2751845706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc032440 con 0x7f7cdc0d41b0 2024-04-25T15:43:29.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7cda7fc640 1 -- 172.21.15.80:0/2751845706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc032810 con 0x7f7cdc0d41b0 2024-04-25T15:43:29.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7ce19d5640 1 -- 172.21.15.80:0/2751845706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc0d41b0 msgr2=0x7f7cdc0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/2751845706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc0d41b0 0x7f7cdc0b48d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009870 tx=0x7f7ccc02a270 comp rx=0 tx=0).stop 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7ce19d5640 1 -- 172.21.15.80:0/2751845706 shutdown_connections 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/2751845706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc0d41b0 0x7f7cdc0b48d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.053+0000 7f7ce19d5640 1 -- 172.21.15.80:0/2751845706 >> 172.21.15.80:0/2751845706 conn(0x7f7cdc06e9f0 msgr2=0x7f7cdc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.054+0000 7f7ce19d5640 1 -- 172.21.15.80:0/2751845706 shutdown_connections 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.054+0000 7f7ce19d5640 1 -- 172.21.15.80:0/2751845706 wait complete. 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.055+0000 7f7ce19d5640 1 Processor -- start 2024-04-25T15:43:29.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.055+0000 7f7ce19d5640 1 -- start start 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.056+0000 7f7ce19d5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cdc0d41b0 0x7f7cdc159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.056+0000 7f7ce19d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 0x7f7cdc0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.056+0000 7f7ce19d5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cdc1606b0 0x7f7cdc0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.056+0000 7f7ce19d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0b5150 con 0x7f7cdc1602a0 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7ce19d5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0b4fd0 con 0x7f7cdc1606b0 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7ce19d5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc0b9220 con 0x7f7cdc0d41b0 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 0x7f7cdc0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 0x7f7cdc0ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44422/0 (socket says 172.21.15.80:44422) 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 -- 172.21.15.80:0/3869632476 learned_addr learned my addr 172.21.15.80:0/3869632476 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cdaffd640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cdc0d41b0 0x7f7cdc159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cdb7fe640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cdc1606b0 0x7f7cdc0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 -- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cdc0d41b0 msgr2=0x7f7cdc159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cdc0d41b0 0x7f7cdc159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 -- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cdc1606b0 msgr2=0x7f7cdc0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cdc1606b0 0x7f7cdc0cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 -- 172.21.15.80:0/3869632476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc160ed0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd3fff640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 0x7f7cdc0ca710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400c3c0 tx=0x7f7cc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc40074e0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc40047e0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc1611b0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4004bd0 con 0x7f7cdc1602a0 2024-04-25T15:43:29.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.057+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc161770 con 0x7f7cdc1602a0 2024-04-25T15:43:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.058+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc160c20 con 0x7f7cdc1602a0 2024-04-25T15:43:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.059+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7cc4011070 con 0x7f7cdc1602a0 2024-04-25T15:43:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.059+0000 7f7cd8ff9640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7cbc0744b0 0x7f7cbc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.059+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7cc4095000 con 0x7f7cdc1602a0 2024-04-25T15:43:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.059+0000 7f7cdaffd640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7cbc0744b0 0x7f7cbc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.060+0000 7f7cdaffd640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7cbc0744b0 0x7f7cbc0769c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc034000 tx=0x7f7ccc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.064+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cc405ee00 con 0x7f7cdc1602a0 2024-04-25T15:43:29.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.234+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7cdc06a100 con 0x7f7cbc0744b0 2024-04-25T15:43:29.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.242+0000 7f7cd8ff9640 1 -- 172.21.15.80:0/3869632476 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7f7cdc06a100 con 0x7f7cbc0744b0 2024-04-25T15:43:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:29.248 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.245+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7cbc0744b0 msgr2=0x7f7cbc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.245+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7cbc0744b0 0x7f7cbc0769c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc034000 tx=0x7f7ccc02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 msgr2=0x7f7cdc0ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 0x7f7cdc0ca710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400c3c0 tx=0x7f7cc400c880 comp rx=0 tx=0).stop 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 shutdown_connections 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7cbc0744b0 0x7f7cbc0769c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cdc1606b0 0x7f7cdc0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cdc1602a0 0x7f7cdc0ca710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 --2- 172.21.15.80:0/3869632476 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cdc0d41b0 0x7f7cdc159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 >> 172.21.15.80:0/3869632476 conn(0x7f7cdc06e9f0 msgr2=0x7f7cdc0b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:29.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 shutdown_connections 2024-04-25T15:43:29.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.246+0000 7f7ce19d5640 1 -- 172.21.15.80:0/3869632476 wait complete. 2024-04-25T15:43:29.258 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T15:43:29.004010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2018232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003430"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362284+0000","last_change":"2024-04-25T15:43:00.262559+0000","last_active":"2024-04-25T15:43:07.362284+0000","last_peered":"2024-04-25T15:43:07.362284+0000","last_clean":"2024-04-25T15:43:07.362284+0000","last_became_active":"2024-04-25T15:43:00.260334+0000","last_became_peered":"2024-04-25T15:43:00.260334+0000","last_unstale":"2024-04-25T15:43:07.362284+0000","last_undegraded":"2024-04-25T15:43:07.362284+0000","last_fullsized":"2024-04-25T15:43:07.362284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:37.689363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360799+0000","last_change":"2024-04-25T15:43:01.287221+0000","last_active":"2024-04-25T15:43:07.360799+0000","last_peered":"2024-04-25T15:43:07.360799+0000","last_clean":"2024-04-25T15:43:07.360799+0000","last_became_active":"2024-04-25T15:43:01.286908+0000","last_became_peered":"2024-04-25T15:43:01.286908+0000","last_unstale":"2024-04-25T15:43:07.360799+0000","last_undegraded":"2024-04-25T15:43:07.360799+0000","last_fullsized":"2024-04-25T15:43:07.360799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359974+0000","last_change":"2024-04-25T15:43:05.318849+0000","last_active":"2024-04-25T15:43:07.359974+0000","last_peered":"2024-04-25T15:43:07.359974+0000","last_clean":"2024-04-25T15:43:07.359974+0000","last_became_active":"2024-04-25T15:43:05.318430+0000","last_became_peered":"2024-04-25T15:43:05.318430+0000","last_unstale":"2024-04-25T15:43:07.359974+0000","last_undegraded":"2024-04-25T15:43:07.359974+0000","last_fullsized":"2024-04-25T15:43:07.359974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361076+0000","last_change":"2024-04-25T15:43:00.271120+0000","last_active":"2024-04-25T15:43:07.361076+0000","last_peered":"2024-04-25T15:43:07.361076+0000","last_clean":"2024-04-25T15:43:07.361076+0000","last_became_active":"2024-04-25T15:43:00.270825+0000","last_became_peered":"2024-04-25T15:43:00.270825+0000","last_unstale":"2024-04-25T15:43:07.361076+0000","last_undegraded":"2024-04-25T15:43:07.361076+0000","last_fullsized":"2024-04-25T15:43:07.361076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362058+0000","last_change":"2024-04-25T15:43:01.301805+0000","last_active":"2024-04-25T15:43:07.362058+0000","last_peered":"2024-04-25T15:43:07.362058+0000","last_clean":"2024-04-25T15:43:07.362058+0000","last_became_active":"2024-04-25T15:43:01.301404+0000","last_became_peered":"2024-04-25T15:43:01.301404+0000","last_unstale":"2024-04-25T15:43:07.362058+0000","last_undegraded":"2024-04-25T15:43:07.362058+0000","last_fullsized":"2024-04-25T15:43:07.362058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303866+0000","last_change":"2024-04-25T15:43:05.327540+0000","last_active":"2024-04-25T15:43:06.303866+0000","last_peered":"2024-04-25T15:43:06.303866+0000","last_clean":"2024-04-25T15:43:06.303866+0000","last_became_active":"2024-04-25T15:43:05.326737+0000","last_became_peered":"2024-04-25T15:43:05.326737+0000","last_unstale":"2024-04-25T15:43:06.303866+0000","last_undegraded":"2024-04-25T15:43:06.303866+0000","last_fullsized":"2024-04-25T15:43:06.303866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:01.657357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305054+0000","last_change":"2024-04-25T15:43:00.269417+0000","last_active":"2024-04-25T15:43:06.305054+0000","last_peered":"2024-04-25T15:43:06.305054+0000","last_clean":"2024-04-25T15:43:06.305054+0000","last_became_active":"2024-04-25T15:43:00.268747+0000","last_became_peered":"2024-04-25T15:43:00.268747+0000","last_unstale":"2024-04-25T15:43:06.305054+0000","last_undegraded":"2024-04-25T15:43:06.305054+0000","last_fullsized":"2024-04-25T15:43:06.305054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:49.833413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515416+0000","last_change":"2024-04-25T15:43:01.293581+0000","last_active":"2024-04-25T15:43:06.515416+0000","last_peered":"2024-04-25T15:43:06.515416+0000","last_clean":"2024-04-25T15:43:06.515416+0000","last_became_active":"2024-04-25T15:43:01.292501+0000","last_became_peered":"2024-04-25T15:43:01.292501+0000","last_unstale":"2024-04-25T15:43:06.515416+0000","last_undegraded":"2024-04-25T15:43:06.515416+0000","last_fullsized":"2024-04-25T15:43:06.515416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305418+0000","last_change":"2024-04-25T15:43:05.332634+0000","last_active":"2024-04-25T15:43:06.305418+0000","last_peered":"2024-04-25T15:43:06.305418+0000","last_clean":"2024-04-25T15:43:06.305418+0000","last_became_active":"2024-04-25T15:43:05.332110+0000","last_became_peered":"2024-04-25T15:43:05.332110+0000","last_unstale":"2024-04-25T15:43:06.305418+0000","last_undegraded":"2024-04-25T15:43:06.305418+0000","last_fullsized":"2024-04-25T15:43:06.305418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304639+0000","last_change":"2024-04-25T15:43:00.270429+0000","last_active":"2024-04-25T15:43:06.304639+0000","last_peered":"2024-04-25T15:43:06.304639+0000","last_clean":"2024-04-25T15:43:06.304639+0000","last_became_active":"2024-04-25T15:43:00.270080+0000","last_became_peered":"2024-04-25T15:43:00.270080+0000","last_unstale":"2024-04-25T15:43:06.304639+0000","last_undegraded":"2024-04-25T15:43:06.304639+0000","last_fullsized":"2024-04-25T15:43:06.304639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515514+0000","last_change":"2024-04-25T15:43:01.294967+0000","last_active":"2024-04-25T15:43:06.515514+0000","last_peered":"2024-04-25T15:43:06.515514+0000","last_clean":"2024-04-25T15:43:06.515514+0000","last_became_active":"2024-04-25T15:43:01.294673+0000","last_became_peered":"2024-04-25T15:43:01.294673+0000","last_unstale":"2024-04-25T15:43:06.515514+0000","last_undegraded":"2024-04-25T15:43:06.515514+0000","last_fullsized":"2024-04-25T15:43:06.515514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303942+0000","last_change":"2024-04-25T15:43:05.330892+0000","last_active":"2024-04-25T15:43:06.303942+0000","last_peered":"2024-04-25T15:43:06.303942+0000","last_clean":"2024-04-25T15:43:06.303942+0000","last_became_active":"2024-04-25T15:43:05.330435+0000","last_became_peered":"2024-04-25T15:43:05.330435+0000","last_unstale":"2024-04-25T15:43:06.303942+0000","last_undegraded":"2024-04-25T15:43:06.303942+0000","last_fullsized":"2024-04-25T15:43:06.303942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:31.934838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173076+0000","last_change":"2024-04-25T15:43:01.297084+0000","last_active":"2024-04-25T15:43:07.173076+0000","last_peered":"2024-04-25T15:43:07.173076+0000","last_clean":"2024-04-25T15:43:07.173076+0000","last_became_active":"2024-04-25T15:43:01.296689+0000","last_became_peered":"2024-04-25T15:43:01.296689+0000","last_unstale":"2024-04-25T15:43:07.173076+0000","last_undegraded":"2024-04-25T15:43:07.173076+0000","last_fullsized":"2024-04-25T15:43:07.173076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304863+0000","last_change":"2024-04-25T15:43:00.267473+0000","last_active":"2024-04-25T15:43:06.304863+0000","last_peered":"2024-04-25T15:43:06.304863+0000","last_clean":"2024-04-25T15:43:06.304863+0000","last_became_active":"2024-04-25T15:43:00.264809+0000","last_became_peered":"2024-04-25T15:43:00.264809+0000","last_unstale":"2024-04-25T15:43:06.304863+0000","last_undegraded":"2024-04-25T15:43:06.304863+0000","last_fullsized":"2024-04-25T15:43:06.304863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.324082+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.323656+0000","last_became_peered":"2024-04-25T15:43:05.323656+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361446+0000","last_change":"2024-04-25T15:43:01.284806+0000","last_active":"2024-04-25T15:43:07.361446+0000","last_peered":"2024-04-25T15:43:07.361446+0000","last_clean":"2024-04-25T15:43:07.361446+0000","last_became_active":"2024-04-25T15:43:01.283772+0000","last_became_peered":"2024-04-25T15:43:01.283772+0000","last_unstale":"2024-04-25T15:43:07.361446+0000","last_undegraded":"2024-04-25T15:43:07.361446+0000","last_fullsized":"2024-04-25T15:43:07.361446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361739+0000","last_change":"2024-04-25T15:43:00.271683+0000","last_active":"2024-04-25T15:43:07.361739+0000","last_peered":"2024-04-25T15:43:07.361739+0000","last_clean":"2024-04-25T15:43:07.361739+0000","last_became_active":"2024-04-25T15:43:00.271031+0000","last_became_peered":"2024-04-25T15:43:00.271031+0000","last_unstale":"2024-04-25T15:43:07.361739+0000","last_undegraded":"2024-04-25T15:43:07.361739+0000","last_fullsized":"2024-04-25T15:43:07.361739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304365+0000","last_change":"2024-04-25T15:43:05.326922+0000","last_active":"2024-04-25T15:43:06.304365+0000","last_peered":"2024-04-25T15:43:06.304365+0000","last_clean":"2024-04-25T15:43:06.304365+0000","last_became_active":"2024-04-25T15:43:05.325427+0000","last_became_peered":"2024-04-25T15:43:05.325427+0000","last_unstale":"2024-04-25T15:43:06.304365+0000","last_undegraded":"2024-04-25T15:43:06.304365+0000","last_fullsized":"2024-04-25T15:43:06.304365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:58.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360745+0000","last_change":"2024-04-25T15:43:01.278582+0000","last_active":"2024-04-25T15:43:07.360745+0000","last_peered":"2024-04-25T15:43:07.360745+0000","last_clean":"2024-04-25T15:43:07.360745+0000","last_became_active":"2024-04-25T15:43:01.278262+0000","last_became_peered":"2024-04-25T15:43:01.278262+0000","last_unstale":"2024-04-25T15:43:07.360745+0000","last_undegraded":"2024-04-25T15:43:07.360745+0000","last_fullsized":"2024-04-25T15:43:07.360745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360634+0000","last_change":"2024-04-25T15:43:00.259534+0000","last_active":"2024-04-25T15:43:07.360634+0000","last_peered":"2024-04-25T15:43:07.360634+0000","last_clean":"2024-04-25T15:43:07.360634+0000","last_became_active":"2024-04-25T15:43:00.259226+0000","last_became_peered":"2024-04-25T15:43:00.259226+0000","last_unstale":"2024-04-25T15:43:07.360634+0000","last_undegraded":"2024-04-25T15:43:07.360634+0000","last_fullsized":"2024-04-25T15:43:07.360634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361329+0000","last_change":"2024-04-25T15:43:05.337344+0000","last_active":"2024-04-25T15:43:07.361329+0000","last_peered":"2024-04-25T15:43:07.361329+0000","last_clean":"2024-04-25T15:43:07.361329+0000","last_became_active":"2024-04-25T15:43:05.336683+0000","last_became_peered":"2024-04-25T15:43:05.336683+0000","last_unstale":"2024-04-25T15:43:07.361329+0000","last_undegraded":"2024-04-25T15:43:07.361329+0000","last_fullsized":"2024-04-25T15:43:07.361329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305043+0000","last_change":"2024-04-25T15:43:01.294128+0000","last_active":"2024-04-25T15:43:06.305043+0000","last_peered":"2024-04-25T15:43:06.305043+0000","last_clean":"2024-04-25T15:43:06.305043+0000","last_became_active":"2024-04-25T15:43:01.293722+0000","last_became_peered":"2024-04-25T15:43:01.293722+0000","last_unstale":"2024-04-25T15:43:06.305043+0000","last_undegraded":"2024-04-25T15:43:06.305043+0000","last_fullsized":"2024-04-25T15:43:06.305043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303483+0000","last_change":"2024-04-25T15:43:00.264522+0000","last_active":"2024-04-25T15:43:06.303483+0000","last_peered":"2024-04-25T15:43:06.303483+0000","last_clean":"2024-04-25T15:43:06.303483+0000","last_became_active":"2024-04-25T15:43:00.264219+0000","last_became_peered":"2024-04-25T15:43:00.264219+0000","last_unstale":"2024-04-25T15:43:06.303483+0000","last_undegraded":"2024-04-25T15:43:06.303483+0000","last_fullsized":"2024-04-25T15:43:06.303483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304418+0000","last_change":"2024-04-25T15:43:05.326280+0000","last_active":"2024-04-25T15:43:06.304418+0000","last_peered":"2024-04-25T15:43:06.304418+0000","last_clean":"2024-04-25T15:43:06.304418+0000","last_became_active":"2024-04-25T15:43:05.325812+0000","last_became_peered":"2024-04-25T15:43:05.325812+0000","last_unstale":"2024-04-25T15:43:06.304418+0000","last_undegraded":"2024-04-25T15:43:06.304418+0000","last_fullsized":"2024-04-25T15:43:06.304418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:42.664135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360353+0000","last_change":"2024-04-25T15:43:01.284195+0000","last_active":"2024-04-25T15:43:07.360353+0000","last_peered":"2024-04-25T15:43:07.360353+0000","last_clean":"2024-04-25T15:43:07.360353+0000","last_became_active":"2024-04-25T15:43:01.283818+0000","last_became_peered":"2024-04-25T15:43:01.283818+0000","last_unstale":"2024-04-25T15:43:07.360353+0000","last_undegraded":"2024-04-25T15:43:07.360353+0000","last_fullsized":"2024-04-25T15:43:07.360353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:38.284567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173875+0000","last_change":"2024-04-25T15:43:00.271369+0000","last_active":"2024-04-25T15:43:07.173875+0000","last_peered":"2024-04-25T15:43:07.173875+0000","last_clean":"2024-04-25T15:43:07.173875+0000","last_became_active":"2024-04-25T15:43:00.270954+0000","last_became_peered":"2024-04-25T15:43:00.270954+0000","last_unstale":"2024-04-25T15:43:07.173875+0000","last_undegraded":"2024-04-25T15:43:07.173875+0000","last_fullsized":"2024-04-25T15:43:07.173875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304636+0000","last_change":"2024-04-25T15:43:05.318710+0000","last_active":"2024-04-25T15:43:06.304636+0000","last_peered":"2024-04-25T15:43:06.304636+0000","last_clean":"2024-04-25T15:43:06.304636+0000","last_became_active":"2024-04-25T15:43:05.318244+0000","last_became_peered":"2024-04-25T15:43:05.318244+0000","last_unstale":"2024-04-25T15:43:06.304636+0000","last_undegraded":"2024-04-25T15:43:06.304636+0000","last_fullsized":"2024-04-25T15:43:06.304636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:59.114149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361273+0000","last_change":"2024-04-25T15:43:01.277350+0000","last_active":"2024-04-25T15:43:07.361273+0000","last_peered":"2024-04-25T15:43:07.361273+0000","last_clean":"2024-04-25T15:43:07.361273+0000","last_became_active":"2024-04-25T15:43:01.277042+0000","last_became_peered":"2024-04-25T15:43:01.277042+0000","last_unstale":"2024-04-25T15:43:07.361273+0000","last_undegraded":"2024-04-25T15:43:07.361273+0000","last_fullsized":"2024-04-25T15:43:07.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361047+0000","last_change":"2024-04-25T15:43:00.270292+0000","last_active":"2024-04-25T15:43:07.361047+0000","last_peered":"2024-04-25T15:43:07.361047+0000","last_clean":"2024-04-25T15:43:07.361047+0000","last_became_active":"2024-04-25T15:43:00.269920+0000","last_became_peered":"2024-04-25T15:43:00.269920+0000","last_unstale":"2024-04-25T15:43:07.361047+0000","last_undegraded":"2024-04-25T15:43:07.361047+0000","last_fullsized":"2024-04-25T15:43:07.361047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.954377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360289+0000","last_change":"2024-04-25T15:43:05.327625+0000","last_active":"2024-04-25T15:43:07.360289+0000","last_peered":"2024-04-25T15:43:07.360289+0000","last_clean":"2024-04-25T15:43:07.360289+0000","last_became_active":"2024-04-25T15:43:05.327068+0000","last_became_peered":"2024-04-25T15:43:05.327068+0000","last_unstale":"2024-04-25T15:43:07.360289+0000","last_undegraded":"2024-04-25T15:43:07.360289+0000","last_fullsized":"2024-04-25T15:43:07.360289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:06.933725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361783+0000","last_change":"2024-04-25T15:43:01.289525+0000","last_active":"2024-04-25T15:43:07.361783+0000","last_peered":"2024-04-25T15:43:07.361783+0000","last_clean":"2024-04-25T15:43:07.361783+0000","last_became_active":"2024-04-25T15:43:01.288948+0000","last_became_peered":"2024-04-25T15:43:01.288948+0000","last_unstale":"2024-04-25T15:43:07.361783+0000","last_undegraded":"2024-04-25T15:43:07.361783+0000","last_fullsized":"2024-04-25T15:43:07.361783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305175+0000","last_change":"2024-04-25T15:43:00.270648+0000","last_active":"2024-04-25T15:43:06.305175+0000","last_peered":"2024-04-25T15:43:06.305175+0000","last_clean":"2024-04-25T15:43:06.305175+0000","last_became_active":"2024-04-25T15:43:00.269383+0000","last_became_peered":"2024-04-25T15:43:00.269383+0000","last_unstale":"2024-04-25T15:43:06.305175+0000","last_undegraded":"2024-04-25T15:43:06.305175+0000","last_fullsized":"2024-04-25T15:43:06.305175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:57.288718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360617+0000","last_change":"2024-04-25T15:43:05.324673+0000","last_active":"2024-04-25T15:43:07.360617+0000","last_peered":"2024-04-25T15:43:07.360617+0000","last_clean":"2024-04-25T15:43:07.360617+0000","last_became_active":"2024-04-25T15:43:05.323620+0000","last_became_peered":"2024-04-25T15:43:05.323620+0000","last_unstale":"2024-04-25T15:43:07.360617+0000","last_undegraded":"2024-04-25T15:43:07.360617+0000","last_fullsized":"2024-04-25T15:43:07.360617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515849+0000","last_change":"2024-04-25T15:43:01.303220+0000","last_active":"2024-04-25T15:43:06.515849+0000","last_peered":"2024-04-25T15:43:06.515849+0000","last_clean":"2024-04-25T15:43:06.515849+0000","last_became_active":"2024-04-25T15:43:01.302322+0000","last_became_peered":"2024-04-25T15:43:01.302322+0000","last_unstale":"2024-04-25T15:43:06.515849+0000","last_undegraded":"2024-04-25T15:43:06.515849+0000","last_fullsized":"2024-04-25T15:43:06.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361861+0000","last_change":"2024-04-25T15:43:00.266400+0000","last_active":"2024-04-25T15:43:07.361861+0000","last_peered":"2024-04-25T15:43:07.361861+0000","last_clean":"2024-04-25T15:43:07.361861+0000","last_became_active":"2024-04-25T15:43:00.265691+0000","last_became_peered":"2024-04-25T15:43:00.265691+0000","last_unstale":"2024-04-25T15:43:07.361861+0000","last_undegraded":"2024-04-25T15:43:07.361861+0000","last_fullsized":"2024-04-25T15:43:07.361861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361515+0000","last_change":"2024-04-25T15:43:05.333242+0000","last_active":"2024-04-25T15:43:07.361515+0000","last_peered":"2024-04-25T15:43:07.361515+0000","last_clean":"2024-04-25T15:43:07.361515+0000","last_became_active":"2024-04-25T15:43:05.332499+0000","last_became_peered":"2024-04-25T15:43:05.332499+0000","last_unstale":"2024-04-25T15:43:07.361515+0000","last_undegraded":"2024-04-25T15:43:07.361515+0000","last_fullsized":"2024-04-25T15:43:07.361515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:56.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305390+0000","last_change":"2024-04-25T15:43:01.303850+0000","last_active":"2024-04-25T15:43:06.305390+0000","last_peered":"2024-04-25T15:43:06.305390+0000","last_clean":"2024-04-25T15:43:06.305390+0000","last_became_active":"2024-04-25T15:43:01.303351+0000","last_became_peered":"2024-04-25T15:43:01.303351+0000","last_unstale":"2024-04-25T15:43:06.305390+0000","last_undegraded":"2024-04-25T15:43:06.305390+0000","last_fullsized":"2024-04-25T15:43:06.305390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:55.857252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515505+0000","last_change":"2024-04-25T15:43:00.265989+0000","last_active":"2024-04-25T15:43:06.515505+0000","last_peered":"2024-04-25T15:43:06.515505+0000","last_clean":"2024-04-25T15:43:06.515505+0000","last_became_active":"2024-04-25T15:43:00.265654+0000","last_became_peered":"2024-04-25T15:43:00.265654+0000","last_unstale":"2024-04-25T15:43:06.515505+0000","last_undegraded":"2024-04-25T15:43:06.515505+0000","last_fullsized":"2024-04-25T15:43:06.515505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361721+0000","last_change":"2024-04-25T15:43:05.335093+0000","last_active":"2024-04-25T15:43:07.361721+0000","last_peered":"2024-04-25T15:43:07.361721+0000","last_clean":"2024-04-25T15:43:07.361721+0000","last_became_active":"2024-04-25T15:43:05.334657+0000","last_became_peered":"2024-04-25T15:43:05.334657+0000","last_unstale":"2024-04-25T15:43:07.361721+0000","last_undegraded":"2024-04-25T15:43:07.361721+0000","last_fullsized":"2024-04-25T15:43:07.361721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:08.225975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361261+0000","last_change":"2024-04-25T15:43:01.290703+0000","last_active":"2024-04-25T15:43:07.361261+0000","last_peered":"2024-04-25T15:43:07.361261+0000","last_clean":"2024-04-25T15:43:07.361261+0000","last_became_active":"2024-04-25T15:43:01.290172+0000","last_became_peered":"2024-04-25T15:43:01.290172+0000","last_unstale":"2024-04-25T15:43:07.361261+0000","last_undegraded":"2024-04-25T15:43:07.361261+0000","last_fullsized":"2024-04-25T15:43:07.361261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304850+0000","last_change":"2024-04-25T15:43:00.266600+0000","last_active":"2024-04-25T15:43:06.304850+0000","last_peered":"2024-04-25T15:43:06.304850+0000","last_clean":"2024-04-25T15:43:06.304850+0000","last_became_active":"2024-04-25T15:43:00.266272+0000","last_became_peered":"2024-04-25T15:43:00.266272+0000","last_unstale":"2024-04-25T15:43:06.304850+0000","last_undegraded":"2024-04-25T15:43:06.304850+0000","last_fullsized":"2024-04-25T15:43:06.304850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361502+0000","last_change":"2024-04-25T15:43:05.335202+0000","last_active":"2024-04-25T15:43:07.361502+0000","last_peered":"2024-04-25T15:43:07.361502+0000","last_clean":"2024-04-25T15:43:07.361502+0000","last_became_active":"2024-04-25T15:43:05.334737+0000","last_became_peered":"2024-04-25T15:43:05.334737+0000","last_unstale":"2024-04-25T15:43:07.361502+0000","last_undegraded":"2024-04-25T15:43:07.361502+0000","last_fullsized":"2024-04-25T15:43:07.361502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361707+0000","last_change":"2024-04-25T15:43:01.299152+0000","last_active":"2024-04-25T15:43:07.361707+0000","last_peered":"2024-04-25T15:43:07.361707+0000","last_clean":"2024-04-25T15:43:07.361707+0000","last_became_active":"2024-04-25T15:43:01.298809+0000","last_became_peered":"2024-04-25T15:43:01.298809+0000","last_unstale":"2024-04-25T15:43:07.361707+0000","last_undegraded":"2024-04-25T15:43:07.361707+0000","last_fullsized":"2024-04-25T15:43:07.361707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:50.837855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303629+0000","last_change":"2024-04-25T15:43:00.263841+0000","last_active":"2024-04-25T15:43:06.303629+0000","last_peered":"2024-04-25T15:43:06.303629+0000","last_clean":"2024-04-25T15:43:06.303629+0000","last_became_active":"2024-04-25T15:43:00.259513+0000","last_became_peered":"2024-04-25T15:43:00.259513+0000","last_unstale":"2024-04-25T15:43:06.303629+0000","last_undegraded":"2024-04-25T15:43:06.303629+0000","last_fullsized":"2024-04-25T15:43:06.303629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360219+0000","last_change":"2024-04-25T15:43:05.326603+0000","last_active":"2024-04-25T15:43:07.360219+0000","last_peered":"2024-04-25T15:43:07.360219+0000","last_clean":"2024-04-25T15:43:07.360219+0000","last_became_active":"2024-04-25T15:43:05.326181+0000","last_became_peered":"2024-04-25T15:43:05.326181+0000","last_unstale":"2024-04-25T15:43:07.360219+0000","last_undegraded":"2024-04-25T15:43:07.360219+0000","last_fullsized":"2024-04-25T15:43:07.360219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:48.954098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359858+0000","last_change":"2024-04-25T15:43:01.288148+0000","last_active":"2024-04-25T15:43:07.359858+0000","last_peered":"2024-04-25T15:43:07.359858+0000","last_clean":"2024-04-25T15:43:07.359858+0000","last_became_active":"2024-04-25T15:43:01.287837+0000","last_became_peered":"2024-04-25T15:43:01.287837+0000","last_unstale":"2024-04-25T15:43:07.359858+0000","last_undegraded":"2024-04-25T15:43:07.359858+0000","last_fullsized":"2024-04-25T15:43:07.359858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515397+0000","last_change":"2024-04-25T15:43:00.263967+0000","last_active":"2024-04-25T15:43:06.515397+0000","last_peered":"2024-04-25T15:43:06.515397+0000","last_clean":"2024-04-25T15:43:06.515397+0000","last_became_active":"2024-04-25T15:43:00.263603+0000","last_became_peered":"2024-04-25T15:43:00.263603+0000","last_unstale":"2024-04-25T15:43:06.515397+0000","last_undegraded":"2024-04-25T15:43:06.515397+0000","last_fullsized":"2024-04-25T15:43:06.515397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303747+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:43:06.303747+0000","last_peered":"2024-04-25T15:43:06.303747+0000","last_clean":"2024-04-25T15:43:06.303747+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:43:06.303747+0000","last_undegraded":"2024-04-25T15:43:06.303747+0000","last_fullsized":"2024-04-25T15:43:06.303747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173554+0000","last_change":"2024-04-25T15:43:05.325980+0000","last_active":"2024-04-25T15:43:07.173554+0000","last_peered":"2024-04-25T15:43:07.173554+0000","last_clean":"2024-04-25T15:43:07.173554+0000","last_became_active":"2024-04-25T15:43:05.325470+0000","last_became_peered":"2024-04-25T15:43:05.325470+0000","last_unstale":"2024-04-25T15:43:07.173554+0000","last_undegraded":"2024-04-25T15:43:07.173554+0000","last_fullsized":"2024-04-25T15:43:07.173554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304947+0000","last_change":"2024-04-25T15:43:01.291577+0000","last_active":"2024-04-25T15:43:06.304947+0000","last_peered":"2024-04-25T15:43:06.304947+0000","last_clean":"2024-04-25T15:43:06.304947+0000","last_became_active":"2024-04-25T15:43:01.290296+0000","last_became_peered":"2024-04-25T15:43:01.290296+0000","last_unstale":"2024-04-25T15:43:06.304947+0000","last_undegraded":"2024-04-25T15:43:06.304947+0000","last_fullsized":"2024-04-25T15:43:06.304947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:04.182446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305178+0000","last_change":"2024-04-25T15:43:00.263762+0000","last_active":"2024-04-25T15:43:06.305178+0000","last_peered":"2024-04-25T15:43:06.305178+0000","last_clean":"2024-04-25T15:43:06.305178+0000","last_became_active":"2024-04-25T15:43:00.263444+0000","last_became_peered":"2024-04-25T15:43:00.263444+0000","last_unstale":"2024-04-25T15:43:06.305178+0000","last_undegraded":"2024-04-25T15:43:06.305178+0000","last_fullsized":"2024-04-25T15:43:06.305178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173159+0000","last_change":"2024-04-25T15:43:05.322505+0000","last_active":"2024-04-25T15:43:07.173159+0000","last_peered":"2024-04-25T15:43:07.173159+0000","last_clean":"2024-04-25T15:43:07.173159+0000","last_became_active":"2024-04-25T15:43:05.321587+0000","last_became_peered":"2024-04-25T15:43:05.321587+0000","last_unstale":"2024-04-25T15:43:07.173159+0000","last_undegraded":"2024-04-25T15:43:07.173159+0000","last_fullsized":"2024-04-25T15:43:07.173159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515673+0000","last_change":"2024-04-25T15:43:01.300693+0000","last_active":"2024-04-25T15:43:06.515673+0000","last_peered":"2024-04-25T15:43:06.515673+0000","last_clean":"2024-04-25T15:43:06.515673+0000","last_became_active":"2024-04-25T15:43:01.300378+0000","last_became_peered":"2024-04-25T15:43:01.300378+0000","last_unstale":"2024-04-25T15:43:06.515673+0000","last_undegraded":"2024-04-25T15:43:06.515673+0000","last_fullsized":"2024-04-25T15:43:06.515673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360192+0000","last_change":"2024-04-25T15:43:00.267797+0000","last_active":"2024-04-25T15:43:07.360192+0000","last_peered":"2024-04-25T15:43:07.360192+0000","last_clean":"2024-04-25T15:43:07.360192+0000","last_became_active":"2024-04-25T15:43:00.267467+0000","last_became_peered":"2024-04-25T15:43:00.267467+0000","last_unstale":"2024-04-25T15:43:07.360192+0000","last_undegraded":"2024-04-25T15:43:07.360192+0000","last_fullsized":"2024-04-25T15:43:07.360192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:55.235104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360732+0000","last_change":"2024-04-25T15:43:05.325019+0000","last_active":"2024-04-25T15:43:07.360732+0000","last_peered":"2024-04-25T15:43:07.360732+0000","last_clean":"2024-04-25T15:43:07.360732+0000","last_became_active":"2024-04-25T15:43:05.324242+0000","last_became_peered":"2024-04-25T15:43:05.324242+0000","last_unstale":"2024-04-25T15:43:07.360732+0000","last_undegraded":"2024-04-25T15:43:07.360732+0000","last_fullsized":"2024-04-25T15:43:07.360732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305633+0000","last_change":"2024-04-25T15:43:01.295638+0000","last_active":"2024-04-25T15:43:06.305633+0000","last_peered":"2024-04-25T15:43:06.305633+0000","last_clean":"2024-04-25T15:43:06.305633+0000","last_became_active":"2024-04-25T15:43:01.295339+0000","last_became_peered":"2024-04-25T15:43:01.295339+0000","last_unstale":"2024-04-25T15:43:06.305633+0000","last_undegraded":"2024-04-25T15:43:06.305633+0000","last_fullsized":"2024-04-25T15:43:06.305633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:19.579163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305341+0000","last_change":"2024-04-25T15:43:00.267600+0000","last_active":"2024-04-25T15:43:06.305341+0000","last_peered":"2024-04-25T15:43:06.305341+0000","last_clean":"2024-04-25T15:43:06.305341+0000","last_became_active":"2024-04-25T15:43:00.267267+0000","last_became_peered":"2024-04-25T15:43:00.267267+0000","last_unstale":"2024-04-25T15:43:06.305341+0000","last_undegraded":"2024-04-25T15:43:06.305341+0000","last_fullsized":"2024-04-25T15:43:06.305341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515040+0000","last_change":"2024-04-25T15:43:05.320492+0000","last_active":"2024-04-25T15:43:06.515040+0000","last_peered":"2024-04-25T15:43:06.515040+0000","last_clean":"2024-04-25T15:43:06.515040+0000","last_became_active":"2024-04-25T15:43:05.319988+0000","last_became_peered":"2024-04-25T15:43:05.319988+0000","last_unstale":"2024-04-25T15:43:06.515040+0000","last_undegraded":"2024-04-25T15:43:06.515040+0000","last_fullsized":"2024-04-25T15:43:06.515040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:23.622692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305282+0000","last_change":"2024-04-25T15:43:01.298673+0000","last_active":"2024-04-25T15:43:06.305282+0000","last_peered":"2024-04-25T15:43:06.305282+0000","last_clean":"2024-04-25T15:43:06.305282+0000","last_became_active":"2024-04-25T15:43:01.296072+0000","last_became_peered":"2024-04-25T15:43:01.296072+0000","last_unstale":"2024-04-25T15:43:06.305282+0000","last_undegraded":"2024-04-25T15:43:06.305282+0000","last_fullsized":"2024-04-25T15:43:06.305282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304317+0000","last_change":"2024-04-25T15:43:00.265700+0000","last_active":"2024-04-25T15:43:06.304317+0000","last_peered":"2024-04-25T15:43:06.304317+0000","last_clean":"2024-04-25T15:43:06.304317+0000","last_became_active":"2024-04-25T15:43:00.265341+0000","last_became_peered":"2024-04-25T15:43:00.265341+0000","last_unstale":"2024-04-25T15:43:06.304317+0000","last_undegraded":"2024-04-25T15:43:06.304317+0000","last_fullsized":"2024-04-25T15:43:06.304317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304762+0000","last_change":"2024-04-25T15:43:05.325994+0000","last_active":"2024-04-25T15:43:06.304762+0000","last_peered":"2024-04-25T15:43:06.304762+0000","last_clean":"2024-04-25T15:43:06.304762+0000","last_became_active":"2024-04-25T15:43:05.325552+0000","last_became_peered":"2024-04-25T15:43:05.325552+0000","last_unstale":"2024-04-25T15:43:06.304762+0000","last_undegraded":"2024-04-25T15:43:06.304762+0000","last_fullsized":"2024-04-25T15:43:06.304762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:17.249622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303941+0000","last_change":"2024-04-25T15:43:01.297032+0000","last_active":"2024-04-25T15:43:06.303941+0000","last_peered":"2024-04-25T15:43:06.303941+0000","last_clean":"2024-04-25T15:43:06.303941+0000","last_became_active":"2024-04-25T15:43:01.296701+0000","last_became_peered":"2024-04-25T15:43:01.296701+0000","last_unstale":"2024-04-25T15:43:06.303941+0000","last_undegraded":"2024-04-25T15:43:06.303941+0000","last_fullsized":"2024-04-25T15:43:06.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304781+0000","last_change":"2024-04-25T15:43:00.265707+0000","last_active":"2024-04-25T15:43:06.304781+0000","last_peered":"2024-04-25T15:43:06.304781+0000","last_clean":"2024-04-25T15:43:06.304781+0000","last_became_active":"2024-04-25T15:43:00.265407+0000","last_became_peered":"2024-04-25T15:43:00.265407+0000","last_unstale":"2024-04-25T15:43:06.304781+0000","last_undegraded":"2024-04-25T15:43:06.304781+0000","last_fullsized":"2024-04-25T15:43:06.304781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360050+0000","last_change":"2024-04-25T15:43:05.320474+0000","last_active":"2024-04-25T15:43:07.360050+0000","last_peered":"2024-04-25T15:43:07.360050+0000","last_clean":"2024-04-25T15:43:07.360050+0000","last_became_active":"2024-04-25T15:43:05.320017+0000","last_became_peered":"2024-04-25T15:43:05.320017+0000","last_unstale":"2024-04-25T15:43:07.360050+0000","last_undegraded":"2024-04-25T15:43:07.360050+0000","last_fullsized":"2024-04-25T15:43:07.360050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173085+0000","last_change":"2024-04-25T15:43:01.294565+0000","last_active":"2024-04-25T15:43:07.173085+0000","last_peered":"2024-04-25T15:43:07.173085+0000","last_clean":"2024-04-25T15:43:07.173085+0000","last_became_active":"2024-04-25T15:43:01.294244+0000","last_became_peered":"2024-04-25T15:43:01.294244+0000","last_unstale":"2024-04-25T15:43:07.173085+0000","last_undegraded":"2024-04-25T15:43:07.173085+0000","last_fullsized":"2024-04-25T15:43:07.173085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173164+0000","last_change":"2024-04-25T15:43:00.266625+0000","last_active":"2024-04-25T15:43:07.173164+0000","last_peered":"2024-04-25T15:43:07.173164+0000","last_clean":"2024-04-25T15:43:07.173164+0000","last_became_active":"2024-04-25T15:43:00.266059+0000","last_became_peered":"2024-04-25T15:43:00.266059+0000","last_unstale":"2024-04-25T15:43:07.173164+0000","last_undegraded":"2024-04-25T15:43:07.173164+0000","last_fullsized":"2024-04-25T15:43:07.173164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361118+0000","last_change":"2024-04-25T15:43:05.327896+0000","last_active":"2024-04-25T15:43:07.361118+0000","last_peered":"2024-04-25T15:43:07.361118+0000","last_clean":"2024-04-25T15:43:07.361118+0000","last_became_active":"2024-04-25T15:43:05.327450+0000","last_became_peered":"2024-04-25T15:43:05.327450+0000","last_unstale":"2024-04-25T15:43:07.361118+0000","last_undegraded":"2024-04-25T15:43:07.361118+0000","last_fullsized":"2024-04-25T15:43:07.361118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:05.460321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304793+0000","last_change":"2024-04-25T15:43:01.298299+0000","last_active":"2024-04-25T15:43:06.304793+0000","last_peered":"2024-04-25T15:43:06.304793+0000","last_clean":"2024-04-25T15:43:06.304793+0000","last_became_active":"2024-04-25T15:43:01.295916+0000","last_became_peered":"2024-04-25T15:43:01.295916+0000","last_unstale":"2024-04-25T15:43:06.304793+0000","last_undegraded":"2024-04-25T15:43:06.304793+0000","last_fullsized":"2024-04-25T15:43:06.304793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515439+0000","last_change":"2024-04-25T15:43:00.271764+0000","last_active":"2024-04-25T15:43:06.515439+0000","last_peered":"2024-04-25T15:43:06.515439+0000","last_clean":"2024-04-25T15:43:06.515439+0000","last_became_active":"2024-04-25T15:43:00.271471+0000","last_became_peered":"2024-04-25T15:43:00.271471+0000","last_unstale":"2024-04-25T15:43:06.515439+0000","last_undegraded":"2024-04-25T15:43:06.515439+0000","last_fullsized":"2024-04-25T15:43:06.515439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:50.305716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362023+0000","last_change":"2024-04-25T15:43:05.324240+0000","last_active":"2024-04-25T15:43:07.362023+0000","last_peered":"2024-04-25T15:43:07.362023+0000","last_clean":"2024-04-25T15:43:07.362023+0000","last_became_active":"2024-04-25T15:43:05.323806+0000","last_became_peered":"2024-04-25T15:43:05.323806+0000","last_unstale":"2024-04-25T15:43:07.362023+0000","last_undegraded":"2024-04-25T15:43:07.362023+0000","last_fullsized":"2024-04-25T15:43:07.362023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:04.722313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360889+0000","last_change":"2024-04-25T15:43:01.294356+0000","last_active":"2024-04-25T15:43:07.360889+0000","last_peered":"2024-04-25T15:43:07.360889+0000","last_clean":"2024-04-25T15:43:07.360889+0000","last_became_active":"2024-04-25T15:43:01.294033+0000","last_became_peered":"2024-04-25T15:43:01.294033+0000","last_unstale":"2024-04-25T15:43:07.360889+0000","last_undegraded":"2024-04-25T15:43:07.360889+0000","last_fullsized":"2024-04-25T15:43:07.360889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360783+0000","last_change":"2024-04-25T15:43:00.261060+0000","last_active":"2024-04-25T15:43:07.360783+0000","last_peered":"2024-04-25T15:43:07.360783+0000","last_clean":"2024-04-25T15:43:07.360783+0000","last_became_active":"2024-04-25T15:43:00.258388+0000","last_became_peered":"2024-04-25T15:43:00.258388+0000","last_unstale":"2024-04-25T15:43:07.360783+0000","last_undegraded":"2024-04-25T15:43:07.360783+0000","last_fullsized":"2024-04-25T15:43:07.360783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:13.131332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515749+0000","last_change":"2024-04-25T15:43:05.325879+0000","last_active":"2024-04-25T15:43:06.515749+0000","last_peered":"2024-04-25T15:43:06.515749+0000","last_clean":"2024-04-25T15:43:06.515749+0000","last_became_active":"2024-04-25T15:43:05.325457+0000","last_became_peered":"2024-04-25T15:43:05.325457+0000","last_unstale":"2024-04-25T15:43:06.515749+0000","last_undegraded":"2024-04-25T15:43:06.515749+0000","last_fullsized":"2024-04-25T15:43:06.515749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:18.134480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304575+0000","last_change":"2024-04-25T15:43:01.281220+0000","last_active":"2024-04-25T15:43:06.304575+0000","last_peered":"2024-04-25T15:43:06.304575+0000","last_clean":"2024-04-25T15:43:06.304575+0000","last_became_active":"2024-04-25T15:43:01.280690+0000","last_became_peered":"2024-04-25T15:43:01.280690+0000","last_unstale":"2024-04-25T15:43:06.304575+0000","last_undegraded":"2024-04-25T15:43:06.304575+0000","last_fullsized":"2024-04-25T15:43:06.304575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.911998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:10.678852+0000","last_change":"2024-04-25T15:43:00.275195+0000","last_active":"2024-04-25T15:43:10.678852+0000","last_peered":"2024-04-25T15:43:10.678852+0000","last_clean":"2024-04-25T15:43:10.678852+0000","last_became_active":"2024-04-25T15:43:00.274890+0000","last_became_peered":"2024-04-25T15:43:00.274890+0000","last_unstale":"2024-04-25T15:43:10.678852+0000","last_undegraded":"2024-04-25T15:43:10.678852+0000","last_fullsized":"2024-04-25T15:43:10.678852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:10.143353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361677+0000","last_change":"2024-04-25T15:43:05.332218+0000","last_active":"2024-04-25T15:43:07.361677+0000","last_peered":"2024-04-25T15:43:07.361677+0000","last_clean":"2024-04-25T15:43:07.361677+0000","last_became_active":"2024-04-25T15:43:05.331327+0000","last_became_peered":"2024-04-25T15:43:05.331327+0000","last_unstale":"2024-04-25T15:43:07.361677+0000","last_undegraded":"2024-04-25T15:43:07.361677+0000","last_fullsized":"2024-04-25T15:43:07.361677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:37.404558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304852+0000","last_change":"2024-04-25T15:43:01.301873+0000","last_active":"2024-04-25T15:43:06.304852+0000","last_peered":"2024-04-25T15:43:06.304852+0000","last_clean":"2024-04-25T15:43:06.304852+0000","last_became_active":"2024-04-25T15:43:01.301515+0000","last_became_peered":"2024-04-25T15:43:01.301515+0000","last_unstale":"2024-04-25T15:43:06.304852+0000","last_undegraded":"2024-04-25T15:43:06.304852+0000","last_fullsized":"2024-04-25T15:43:06.304852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:56.239547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360072+0000","last_change":"2024-04-25T15:43:00.263472+0000","last_active":"2024-04-25T15:43:07.360072+0000","last_peered":"2024-04-25T15:43:07.360072+0000","last_clean":"2024-04-25T15:43:07.360072+0000","last_became_active":"2024-04-25T15:43:00.263063+0000","last_became_peered":"2024-04-25T15:43:00.263063+0000","last_unstale":"2024-04-25T15:43:07.360072+0000","last_undegraded":"2024-04-25T15:43:07.360072+0000","last_fullsized":"2024-04-25T15:43:07.360072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:54.852809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305069+0000","last_change":"2024-04-25T15:43:05.335662+0000","last_active":"2024-04-25T15:43:06.305069+0000","last_peered":"2024-04-25T15:43:06.305069+0000","last_clean":"2024-04-25T15:43:06.305069+0000","last_became_active":"2024-04-25T15:43:05.334883+0000","last_became_peered":"2024-04-25T15:43:05.334883+0000","last_unstale":"2024-04-25T15:43:06.305069+0000","last_undegraded":"2024-04-25T15:43:06.305069+0000","last_fullsized":"2024-04-25T15:43:06.305069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:16.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362170+0000","last_change":"2024-04-25T15:43:01.301400+0000","last_active":"2024-04-25T15:43:07.362170+0000","last_peered":"2024-04-25T15:43:07.362170+0000","last_clean":"2024-04-25T15:43:07.362170+0000","last_became_active":"2024-04-25T15:43:01.301067+0000","last_became_peered":"2024-04-25T15:43:01.301067+0000","last_unstale":"2024-04-25T15:43:07.362170+0000","last_undegraded":"2024-04-25T15:43:07.362170+0000","last_fullsized":"2024-04-25T15:43:07.362170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515580+0000","last_change":"2024-04-25T15:43:00.267119+0000","last_active":"2024-04-25T15:43:06.515580+0000","last_peered":"2024-04-25T15:43:06.515580+0000","last_clean":"2024-04-25T15:43:06.515580+0000","last_became_active":"2024-04-25T15:43:00.266760+0000","last_became_peered":"2024-04-25T15:43:00.266760+0000","last_unstale":"2024-04-25T15:43:06.515580+0000","last_undegraded":"2024-04-25T15:43:06.515580+0000","last_fullsized":"2024-04-25T15:43:06.515580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360595+0000","last_change":"2024-04-25T15:43:05.329155+0000","last_active":"2024-04-25T15:43:07.360595+0000","last_peered":"2024-04-25T15:43:07.360595+0000","last_clean":"2024-04-25T15:43:07.360595+0000","last_became_active":"2024-04-25T15:43:05.328650+0000","last_became_peered":"2024-04-25T15:43:05.328650+0000","last_unstale":"2024-04-25T15:43:07.360595+0000","last_undegraded":"2024-04-25T15:43:07.360595+0000","last_fullsized":"2024-04-25T15:43:07.360595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:14.129232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515527+0000","last_change":"2024-04-25T15:43:01.297332+0000","last_active":"2024-04-25T15:43:06.515527+0000","last_peered":"2024-04-25T15:43:06.515527+0000","last_clean":"2024-04-25T15:43:06.515527+0000","last_became_active":"2024-04-25T15:43:01.296726+0000","last_became_peered":"2024-04-25T15:43:01.296726+0000","last_unstale":"2024-04-25T15:43:06.515527+0000","last_undegraded":"2024-04-25T15:43:06.515527+0000","last_fullsized":"2024-04-25T15:43:06.515527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173728+0000","last_change":"2024-04-25T15:43:00.266633+0000","last_active":"2024-04-25T15:43:07.173728+0000","last_peered":"2024-04-25T15:43:07.173728+0000","last_clean":"2024-04-25T15:43:07.173728+0000","last_became_active":"2024-04-25T15:43:00.266221+0000","last_became_peered":"2024-04-25T15:43:00.266221+0000","last_unstale":"2024-04-25T15:43:07.173728+0000","last_undegraded":"2024-04-25T15:43:07.173728+0000","last_fullsized":"2024-04-25T15:43:07.173728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.637048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360149+0000","last_change":"2024-04-25T15:43:05.326763+0000","last_active":"2024-04-25T15:43:07.360149+0000","last_peered":"2024-04-25T15:43:07.360149+0000","last_clean":"2024-04-25T15:43:07.360149+0000","last_became_active":"2024-04-25T15:43:05.326387+0000","last_became_peered":"2024-04-25T15:43:05.326387+0000","last_unstale":"2024-04-25T15:43:07.360149+0000","last_undegraded":"2024-04-25T15:43:07.360149+0000","last_fullsized":"2024-04-25T15:43:07.360149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:43.920077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359880+0000","last_change":"2024-04-25T15:43:05.325423+0000","last_active":"2024-04-25T15:43:07.359880+0000","last_peered":"2024-04-25T15:43:07.359880+0000","last_clean":"2024-04-25T15:43:07.359880+0000","last_became_active":"2024-04-25T15:43:05.324948+0000","last_became_peered":"2024-04-25T15:43:05.324948+0000","last_unstale":"2024-04-25T15:43:07.359880+0000","last_undegraded":"2024-04-25T15:43:07.359880+0000","last_fullsized":"2024-04-25T15:43:07.359880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.700338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360431+0000","last_change":"2024-04-25T15:43:01.279748+0000","last_active":"2024-04-25T15:43:07.360431+0000","last_peered":"2024-04-25T15:43:07.360431+0000","last_clean":"2024-04-25T15:43:07.360431+0000","last_became_active":"2024-04-25T15:43:01.278850+0000","last_became_peered":"2024-04-25T15:43:01.278850+0000","last_unstale":"2024-04-25T15:43:07.360431+0000","last_undegraded":"2024-04-25T15:43:07.360431+0000","last_fullsized":"2024-04-25T15:43:07.360431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515195+0000","last_change":"2024-04-25T15:43:00.264122+0000","last_active":"2024-04-25T15:43:06.515195+0000","last_peered":"2024-04-25T15:43:06.515195+0000","last_clean":"2024-04-25T15:43:06.515195+0000","last_became_active":"2024-04-25T15:43:00.263813+0000","last_became_peered":"2024-04-25T15:43:00.263813+0000","last_unstale":"2024-04-25T15:43:06.515195+0000","last_undegraded":"2024-04-25T15:43:06.515195+0000","last_fullsized":"2024-04-25T15:43:06.515195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173731+0000","last_change":"2024-04-25T15:43:05.322215+0000","last_active":"2024-04-25T15:43:07.173731+0000","last_peered":"2024-04-25T15:43:07.173731+0000","last_clean":"2024-04-25T15:43:07.173731+0000","last_became_active":"2024-04-25T15:43:05.321735+0000","last_became_peered":"2024-04-25T15:43:05.321735+0000","last_unstale":"2024-04-25T15:43:07.173731+0000","last_undegraded":"2024-04-25T15:43:07.173731+0000","last_fullsized":"2024-04-25T15:43:07.173731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:58.955527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360649+0000","last_change":"2024-04-25T15:43:01.282374+0000","last_active":"2024-04-25T15:43:07.360649+0000","last_peered":"2024-04-25T15:43:07.360649+0000","last_clean":"2024-04-25T15:43:07.360649+0000","last_became_active":"2024-04-25T15:43:01.282048+0000","last_became_peered":"2024-04-25T15:43:01.282048+0000","last_unstale":"2024-04-25T15:43:07.360649+0000","last_undegraded":"2024-04-25T15:43:07.360649+0000","last_fullsized":"2024-04-25T15:43:07.360649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360467+0000","last_change":"2024-04-25T15:43:00.272805+0000","last_active":"2024-04-25T15:43:07.360467+0000","last_peered":"2024-04-25T15:43:07.360467+0000","last_clean":"2024-04-25T15:43:07.360467+0000","last_became_active":"2024-04-25T15:43:00.272566+0000","last_became_peered":"2024-04-25T15:43:00.272566+0000","last_unstale":"2024-04-25T15:43:07.360467+0000","last_undegraded":"2024-04-25T15:43:07.360467+0000","last_fullsized":"2024-04-25T15:43:07.360467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:29.718089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173285+0000","last_change":"2024-04-25T15:43:00.267609+0000","last_active":"2024-04-25T15:43:07.173285+0000","last_peered":"2024-04-25T15:43:07.173285+0000","last_clean":"2024-04-25T15:43:07.173285+0000","last_became_active":"2024-04-25T15:43:00.266867+0000","last_became_peered":"2024-04-25T15:43:00.266867+0000","last_unstale":"2024-04-25T15:43:07.173285+0000","last_undegraded":"2024-04-25T15:43:07.173285+0000","last_fullsized":"2024-04-25T15:43:07.173285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:42.551384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360778+0000","last_change":"2024-04-25T15:43:01.294246+0000","last_active":"2024-04-25T15:43:07.360778+0000","last_peered":"2024-04-25T15:43:07.360778+0000","last_clean":"2024-04-25T15:43:07.360778+0000","last_became_active":"2024-04-25T15:43:01.293930+0000","last_became_peered":"2024-04-25T15:43:01.293930+0000","last_unstale":"2024-04-25T15:43:07.360778+0000","last_undegraded":"2024-04-25T15:43:07.360778+0000","last_fullsized":"2024-04-25T15:43:07.360778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305109+0000","last_change":"2024-04-25T15:43:05.321856+0000","last_active":"2024-04-25T15:43:06.305109+0000","last_peered":"2024-04-25T15:43:06.305109+0000","last_clean":"2024-04-25T15:43:06.305109+0000","last_became_active":"2024-04-25T15:43:05.321309+0000","last_became_peered":"2024-04-25T15:43:05.321309+0000","last_unstale":"2024-04-25T15:43:06.305109+0000","last_undegraded":"2024-04-25T15:43:06.305109+0000","last_fullsized":"2024-04-25T15:43:06.305109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:05.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361555+0000","last_change":"2024-04-25T15:43:00.273709+0000","last_active":"2024-04-25T15:43:07.361555+0000","last_peered":"2024-04-25T15:43:07.361555+0000","last_clean":"2024-04-25T15:43:07.361555+0000","last_became_active":"2024-04-25T15:43:00.273411+0000","last_became_peered":"2024-04-25T15:43:00.273411+0000","last_unstale":"2024-04-25T15:43:07.361555+0000","last_undegraded":"2024-04-25T15:43:07.361555+0000","last_fullsized":"2024-04-25T15:43:07.361555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:59.240332+0000","last_clean_scrub_stamp":"2024-04-25T15:42:59.240332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.512229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304319+0000","last_change":"2024-04-25T15:43:01.290938+0000","last_active":"2024-04-25T15:43:06.304319+0000","last_peered":"2024-04-25T15:43:06.304319+0000","last_clean":"2024-04-25T15:43:06.304319+0000","last_became_active":"2024-04-25T15:43:01.290644+0000","last_became_peered":"2024-04-25T15:43:01.290644+0000","last_unstale":"2024-04-25T15:43:06.304319+0000","last_undegraded":"2024-04-25T15:43:06.304319+0000","last_fullsized":"2024-04-25T15:43:06.304319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:51.310158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360648+0000","last_change":"2024-04-25T15:43:05.325374+0000","last_active":"2024-04-25T15:43:07.360648+0000","last_peered":"2024-04-25T15:43:07.360648+0000","last_clean":"2024-04-25T15:43:07.360648+0000","last_became_active":"2024-04-25T15:43:05.324880+0000","last_became_peered":"2024-04-25T15:43:05.324880+0000","last_unstale":"2024-04-25T15:43:07.360648+0000","last_undegraded":"2024-04-25T15:43:07.360648+0000","last_fullsized":"2024-04-25T15:43:07.360648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:04.288303+0000","last_clean_scrub_stamp":"2024-04-25T15:43:04.288303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:44.634102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.172990+0000","last_change":"2024-04-25T15:43:01.294802+0000","last_active":"2024-04-25T15:43:07.172990+0000","last_peered":"2024-04-25T15:43:07.172990+0000","last_clean":"2024-04-25T15:43:07.172990+0000","last_became_active":"2024-04-25T15:43:01.293680+0000","last_became_peered":"2024-04-25T15:43:01.293680+0000","last_unstale":"2024-04-25T15:43:07.172990+0000","last_undegraded":"2024-04-25T15:43:07.172990+0000","last_fullsized":"2024-04-25T15:43:07.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304824+0000","last_change":"2024-04-25T15:43:01.287546+0000","last_active":"2024-04-25T15:43:06.304824+0000","last_peered":"2024-04-25T15:43:06.304824+0000","last_clean":"2024-04-25T15:43:06.304824+0000","last_became_active":"2024-04-25T15:43:01.287193+0000","last_became_peered":"2024-04-25T15:43:01.287193+0000","last_unstale":"2024-04-25T15:43:06.304824+0000","last_undegraded":"2024-04-25T15:43:06.304824+0000","last_fullsized":"2024-04-25T15:43:06.304824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:58.771370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515392+0000","last_change":"2024-04-25T15:43:01.291635+0000","last_active":"2024-04-25T15:43:06.515392+0000","last_peered":"2024-04-25T15:43:06.515392+0000","last_clean":"2024-04-25T15:43:06.515392+0000","last_became_active":"2024-04-25T15:43:01.291222+0000","last_became_peered":"2024-04-25T15:43:01.291222+0000","last_unstale":"2024-04-25T15:43:06.515392+0000","last_undegraded":"2024-04-25T15:43:06.515392+0000","last_fullsized":"2024-04-25T15:43:06.515392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:38.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360670+0000","last_change":"2024-04-25T15:43:01.283764+0000","last_active":"2024-04-25T15:43:07.360670+0000","last_peered":"2024-04-25T15:43:07.360670+0000","last_clean":"2024-04-25T15:43:07.360670+0000","last_became_active":"2024-04-25T15:43:01.283409+0000","last_became_peered":"2024-04-25T15:43:01.283409+0000","last_unstale":"2024-04-25T15:43:07.360670+0000","last_undegraded":"2024-04-25T15:43:07.360670+0000","last_fullsized":"2024-04-25T15:43:07.360670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.362184+0000","last_change":"2024-04-25T15:43:01.294089+0000","last_active":"2024-04-25T15:43:07.362184+0000","last_peered":"2024-04-25T15:43:07.362184+0000","last_clean":"2024-04-25T15:43:07.362184+0000","last_became_active":"2024-04-25T15:43:01.293753+0000","last_became_peered":"2024-04-25T15:43:01.293753+0000","last_unstale":"2024-04-25T15:43:07.362184+0000","last_undegraded":"2024-04-25T15:43:07.362184+0000","last_fullsized":"2024-04-25T15:43:07.362184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359861+0000","last_change":"2024-04-25T15:43:01.278680+0000","last_active":"2024-04-25T15:43:07.359861+0000","last_peered":"2024-04-25T15:43:07.359861+0000","last_clean":"2024-04-25T15:43:07.359861+0000","last_became_active":"2024-04-25T15:43:01.278347+0000","last_became_peered":"2024-04-25T15:43:01.278347+0000","last_unstale":"2024-04-25T15:43:07.359861+0000","last_undegraded":"2024-04-25T15:43:07.359861+0000","last_fullsized":"2024-04-25T15:43:07.359861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173725+0000","last_change":"2024-04-25T15:43:01.287386+0000","last_active":"2024-04-25T15:43:07.173725+0000","last_peered":"2024-04-25T15:43:07.173725+0000","last_clean":"2024-04-25T15:43:07.173725+0000","last_became_active":"2024-04-25T15:43:01.287049+0000","last_became_peered":"2024-04-25T15:43:01.287049+0000","last_unstale":"2024-04-25T15:43:07.173725+0000","last_undegraded":"2024-04-25T15:43:07.173725+0000","last_fullsized":"2024-04-25T15:43:07.173725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.361171+0000","last_change":"2024-04-25T15:43:01.295000+0000","last_active":"2024-04-25T15:43:07.361171+0000","last_peered":"2024-04-25T15:43:07.361171+0000","last_clean":"2024-04-25T15:43:07.361171+0000","last_became_active":"2024-04-25T15:43:01.294605+0000","last_became_peered":"2024-04-25T15:43:01.294605+0000","last_unstale":"2024-04-25T15:43:07.361171+0000","last_undegraded":"2024-04-25T15:43:07.361171+0000","last_fullsized":"2024-04-25T15:43:07.361171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:55.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515111+0000","last_change":"2024-04-25T15:43:01.291742+0000","last_active":"2024-04-25T15:43:06.515111+0000","last_peered":"2024-04-25T15:43:06.515111+0000","last_clean":"2024-04-25T15:43:06.515111+0000","last_became_active":"2024-04-25T15:43:01.291354+0000","last_became_peered":"2024-04-25T15:43:01.291354+0000","last_unstale":"2024-04-25T15:43:06.515111+0000","last_undegraded":"2024-04-25T15:43:06.515111+0000","last_fullsized":"2024-04-25T15:43:06.515111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.206093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360284+0000","last_change":"2024-04-25T15:43:01.296211+0000","last_active":"2024-04-25T15:43:07.360284+0000","last_peered":"2024-04-25T15:43:07.360284+0000","last_clean":"2024-04-25T15:43:07.360284+0000","last_became_active":"2024-04-25T15:43:01.295195+0000","last_became_peered":"2024-04-25T15:43:01.295195+0000","last_unstale":"2024-04-25T15:43:07.360284+0000","last_undegraded":"2024-04-25T15:43:07.360284+0000","last_fullsized":"2024-04-25T15:43:07.360284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515314+0000","last_change":"2024-04-25T15:43:01.303436+0000","last_active":"2024-04-25T15:43:06.515314+0000","last_peered":"2024-04-25T15:43:06.515314+0000","last_clean":"2024-04-25T15:43:06.515314+0000","last_became_active":"2024-04-25T15:43:01.303068+0000","last_became_peered":"2024-04-25T15:43:01.303068+0000","last_unstale":"2024-04-25T15:43:06.515314+0000","last_undegraded":"2024-04-25T15:43:06.515314+0000","last_fullsized":"2024-04-25T15:43:06.515314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360519+0000","last_change":"2024-04-25T15:43:01.295585+0000","last_active":"2024-04-25T15:43:07.360519+0000","last_peered":"2024-04-25T15:43:07.360519+0000","last_clean":"2024-04-25T15:43:07.360519+0000","last_became_active":"2024-04-25T15:43:01.294821+0000","last_became_peered":"2024-04-25T15:43:01.294821+0000","last_unstale":"2024-04-25T15:43:07.360519+0000","last_undegraded":"2024-04-25T15:43:07.360519+0000","last_fullsized":"2024-04-25T15:43:07.360519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:23.740257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173483+0000","last_change":"2024-04-25T15:43:01.296022+0000","last_active":"2024-04-25T15:43:07.173483+0000","last_peered":"2024-04-25T15:43:07.173483+0000","last_clean":"2024-04-25T15:43:07.173483+0000","last_became_active":"2024-04-25T15:43:01.295477+0000","last_became_peered":"2024-04-25T15:43:01.295477+0000","last_unstale":"2024-04-25T15:43:07.173483+0000","last_undegraded":"2024-04-25T15:43:07.173483+0000","last_fullsized":"2024-04-25T15:43:07.173483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.245039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305121+0000","last_change":"2024-04-25T15:43:01.293363+0000","last_active":"2024-04-25T15:43:06.305121+0000","last_peered":"2024-04-25T15:43:06.305121+0000","last_clean":"2024-04-25T15:43:06.305121+0000","last_became_active":"2024-04-25T15:43:01.290509+0000","last_became_peered":"2024-04-25T15:43:01.290509+0000","last_unstale":"2024-04-25T15:43:06.305121+0000","last_undegraded":"2024-04-25T15:43:06.305121+0000","last_fullsized":"2024-04-25T15:43:06.305121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:44.264051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305240+0000","last_change":"2024-04-25T15:43:01.289526+0000","last_active":"2024-04-25T15:43:06.305240+0000","last_peered":"2024-04-25T15:43:06.305240+0000","last_clean":"2024-04-25T15:43:06.305240+0000","last_became_active":"2024-04-25T15:43:01.289019+0000","last_became_peered":"2024-04-25T15:43:01.289019+0000","last_unstale":"2024-04-25T15:43:06.305240+0000","last_undegraded":"2024-04-25T15:43:06.305240+0000","last_fullsized":"2024-04-25T15:43:06.305240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:00.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515937+0000","last_change":"2024-04-25T15:43:01.301402+0000","last_active":"2024-04-25T15:43:06.515937+0000","last_peered":"2024-04-25T15:43:06.515937+0000","last_clean":"2024-04-25T15:43:06.515937+0000","last_became_active":"2024-04-25T15:43:01.301026+0000","last_became_peered":"2024-04-25T15:43:01.301026+0000","last_unstale":"2024-04-25T15:43:06.515937+0000","last_undegraded":"2024-04-25T15:43:06.515937+0000","last_fullsized":"2024-04-25T15:43:06.515937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:33.361029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515052+0000","last_change":"2024-04-25T15:43:01.297919+0000","last_active":"2024-04-25T15:43:06.515052+0000","last_peered":"2024-04-25T15:43:06.515052+0000","last_clean":"2024-04-25T15:43:06.515052+0000","last_became_active":"2024-04-25T15:43:01.295658+0000","last_became_peered":"2024-04-25T15:43:01.295658+0000","last_unstale":"2024-04-25T15:43:06.515052+0000","last_undegraded":"2024-04-25T15:43:06.515052+0000","last_fullsized":"2024-04-25T15:43:06.515052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360534+0000","last_change":"2024-04-25T15:43:01.294743+0000","last_active":"2024-04-25T15:43:07.360534+0000","last_peered":"2024-04-25T15:43:07.360534+0000","last_clean":"2024-04-25T15:43:07.360534+0000","last_became_active":"2024-04-25T15:43:01.294420+0000","last_became_peered":"2024-04-25T15:43:01.294420+0000","last_unstale":"2024-04-25T15:43:07.360534+0000","last_undegraded":"2024-04-25T15:43:07.360534+0000","last_fullsized":"2024-04-25T15:43:07.360534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:57.613828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360776+0000","last_change":"2024-04-25T15:43:01.283558+0000","last_active":"2024-04-25T15:43:07.360776+0000","last_peered":"2024-04-25T15:43:07.360776+0000","last_clean":"2024-04-25T15:43:07.360776+0000","last_became_active":"2024-04-25T15:43:01.283203+0000","last_became_peered":"2024-04-25T15:43:01.283203+0000","last_unstale":"2024-04-25T15:43:07.360776+0000","last_undegraded":"2024-04-25T15:43:07.360776+0000","last_fullsized":"2024-04-25T15:43:07.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:01.569378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360283+0000","last_change":"2024-04-25T15:43:01.287196+0000","last_active":"2024-04-25T15:43:07.360283+0000","last_peered":"2024-04-25T15:43:07.360283+0000","last_clean":"2024-04-25T15:43:07.360283+0000","last_became_active":"2024-04-25T15:43:01.286881+0000","last_became_peered":"2024-04-25T15:43:01.286881+0000","last_unstale":"2024-04-25T15:43:07.360283+0000","last_undegraded":"2024-04-25T15:43:07.360283+0000","last_fullsized":"2024-04-25T15:43:07.360283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304665+0000","last_change":"2024-04-25T15:43:01.294284+0000","last_active":"2024-04-25T15:43:06.304665+0000","last_peered":"2024-04-25T15:43:06.304665+0000","last_clean":"2024-04-25T15:43:06.304665+0000","last_became_active":"2024-04-25T15:43:01.293046+0000","last_became_peered":"2024-04-25T15:43:01.293046+0000","last_unstale":"2024-04-25T15:43:06.304665+0000","last_undegraded":"2024-04-25T15:43:06.304665+0000","last_fullsized":"2024-04-25T15:43:06.304665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:43.555827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173401+0000","last_change":"2024-04-25T15:43:01.289095+0000","last_active":"2024-04-25T15:43:07.173401+0000","last_peered":"2024-04-25T15:43:07.173401+0000","last_clean":"2024-04-25T15:43:07.173401+0000","last_became_active":"2024-04-25T15:43:01.288193+0000","last_became_peered":"2024-04-25T15:43:01.288193+0000","last_unstale":"2024-04-25T15:43:07.173401+0000","last_undegraded":"2024-04-25T15:43:07.173401+0000","last_fullsized":"2024-04-25T15:43:07.173401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:08.247565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.173606+0000","last_change":"2024-04-25T15:43:01.292901+0000","last_active":"2024-04-25T15:43:07.173606+0000","last_peered":"2024-04-25T15:43:07.173606+0000","last_clean":"2024-04-25T15:43:07.173606+0000","last_became_active":"2024-04-25T15:43:01.292459+0000","last_became_peered":"2024-04-25T15:43:01.292459+0000","last_unstale":"2024-04-25T15:43:07.173606+0000","last_undegraded":"2024-04-25T15:43:07.173606+0000","last_fullsized":"2024-04-25T15:43:07.173606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:29.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305631+0000","last_change":"2024-04-25T15:43:01.289823+0000","last_active":"2024-04-25T15:43:06.305631+0000","last_peered":"2024-04-25T15:43:06.305631+0000","last_clean":"2024-04-25T15:43:06.305631+0000","last_became_active":"2024-04-25T15:43:01.289511+0000","last_became_peered":"2024-04-25T15:43:01.289511+0000","last_unstale":"2024-04-25T15:43:06.305631+0000","last_undegraded":"2024-04-25T15:43:06.305631+0000","last_fullsized":"2024-04-25T15:43:06.305631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:23.025567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360402+0000","last_change":"2024-04-25T15:43:01.288077+0000","last_active":"2024-04-25T15:43:07.360402+0000","last_peered":"2024-04-25T15:43:07.360402+0000","last_clean":"2024-04-25T15:43:07.360402+0000","last_became_active":"2024-04-25T15:43:01.287776+0000","last_became_peered":"2024-04-25T15:43:01.287776+0000","last_unstale":"2024-04-25T15:43:07.360402+0000","last_undegraded":"2024-04-25T15:43:07.360402+0000","last_fullsized":"2024-04-25T15:43:07.360402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:00.077547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.303801+0000","last_change":"2024-04-25T15:43:01.285211+0000","last_active":"2024-04-25T15:43:06.303801+0000","last_peered":"2024-04-25T15:43:06.303801+0000","last_clean":"2024-04-25T15:43:06.303801+0000","last_became_active":"2024-04-25T15:43:01.284874+0000","last_became_peered":"2024-04-25T15:43:01.284874+0000","last_unstale":"2024-04-25T15:43:06.303801+0000","last_undegraded":"2024-04-25T15:43:06.303801+0000","last_fullsized":"2024-04-25T15:43:06.303801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:12.879400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515218+0000","last_change":"2024-04-25T15:43:01.298601+0000","last_active":"2024-04-25T15:43:06.515218+0000","last_peered":"2024-04-25T15:43:06.515218+0000","last_clean":"2024-04-25T15:43:06.515218+0000","last_became_active":"2024-04-25T15:43:01.298301+0000","last_became_peered":"2024-04-25T15:43:01.298301+0000","last_unstale":"2024-04-25T15:43:06.515218+0000","last_undegraded":"2024-04-25T15:43:06.515218+0000","last_fullsized":"2024-04-25T15:43:06.515218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:54.212863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.304229+0000","last_change":"2024-04-25T15:43:01.285864+0000","last_active":"2024-04-25T15:43:06.304229+0000","last_peered":"2024-04-25T15:43:06.304229+0000","last_clean":"2024-04-25T15:43:06.304229+0000","last_became_active":"2024-04-25T15:43:01.285575+0000","last_became_peered":"2024-04-25T15:43:01.285575+0000","last_unstale":"2024-04-25T15:43:06.304229+0000","last_undegraded":"2024-04-25T15:43:06.304229+0000","last_fullsized":"2024-04-25T15:43:06.304229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:44.910569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.515349+0000","last_change":"2024-04-25T15:43:01.303192+0000","last_active":"2024-04-25T15:43:06.515349+0000","last_peered":"2024-04-25T15:43:06.515349+0000","last_clean":"2024-04-25T15:43:06.515349+0000","last_became_active":"2024-04-25T15:43:01.302882+0000","last_became_peered":"2024-04-25T15:43:01.302882+0000","last_unstale":"2024-04-25T15:43:06.515349+0000","last_undegraded":"2024-04-25T15:43:06.515349+0000","last_fullsized":"2024-04-25T15:43:06.515349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:38.620606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.359780+0000","last_change":"2024-04-25T15:43:01.290113+0000","last_active":"2024-04-25T15:43:07.359780+0000","last_peered":"2024-04-25T15:43:07.359780+0000","last_clean":"2024-04-25T15:43:07.359780+0000","last_became_active":"2024-04-25T15:43:01.289784+0000","last_became_peered":"2024-04-25T15:43:01.289784+0000","last_unstale":"2024-04-25T15:43:07.359780+0000","last_undegraded":"2024-04-25T15:43:07.359780+0000","last_fullsized":"2024-04-25T15:43:07.359780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:58.293161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:07.360941+0000","last_change":"2024-04-25T15:43:01.285205+0000","last_active":"2024-04-25T15:43:07.360941+0000","last_peered":"2024-04-25T15:43:07.360941+0000","last_clean":"2024-04-25T15:43:07.360941+0000","last_became_active":"2024-04-25T15:43:01.284834+0000","last_became_peered":"2024-04-25T15:43:01.284834+0000","last_unstale":"2024-04-25T15:43:07.360941+0000","last_undegraded":"2024-04-25T15:43:07.360941+0000","last_fullsized":"2024-04-25T15:43:07.360941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:27.891309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T15:43:06.305525+0000","last_change":"2024-04-25T15:43:01.299431+0000","last_active":"2024-04-25T15:43:06.305525+0000","last_peered":"2024-04-25T15:43:06.305525+0000","last_clean":"2024-04-25T15:43:06.305525+0000","last_became_active":"2024-04-25T15:43:01.298478+0000","last_became_peered":"2024-04-25T15:43:01.298478+0000","last_unstale":"2024-04-25T15:43:06.305525+0000","last_undegraded":"2024-04-25T15:43:06.305525+0000","last_fullsized":"2024-04-25T15:43:06.305525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:43:00.244774+0000","last_clean_scrub_stamp":"2024-04-25T15:43:00.244774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:52.547809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":103617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":103653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:43:29.262 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:43:29.262 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T15:43:29.262 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T15:43:29.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T15:43:29.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.406+0000 7fa80dd9e640 1 Processor -- start 2024-04-25T15:43:29.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.406+0000 7fa80dd9e640 1 -- start start 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa80dd9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8080cf960 0x7fa8080cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa80dd9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8081607c0 con 0x7fa8080ce220 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa80dd9e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8080ceba0 con 0x7fa8080b1ef0 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa80dd9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa8080cf4d0 con 0x7fa8080cf960 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa8077fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa8080ce220 0x7fa80809bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41904/0 (socket says 172.21.15.80:41904) 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa8077fe640 1 -- 172.21.15.80:0/1916218930 learned_addr learned my addr 172.21.15.80:0/1916218930 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa806ffd640 1 --2- 172.21.15.80:0/1916218930 >> v2:172.21.15.80:3300/0 conn(0x7fa8080cf960 0x7fa8080cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa806ffd640 1 -- 172.21.15.80:0/1916218930 >> v1:172.21.15.195:6789/0 conn(0x7fa8080b1ef0 legacy=0x7fa8080d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa806ffd640 1 -- 172.21.15.80:0/1916218930 >> v1:172.21.15.80:6789/0 conn(0x7fa8080ce220 legacy=0x7fa80809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.408+0000 7fa806ffd640 1 -- 172.21.15.80:0/1916218930 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080cee80 con 0x7fa8080cf960 2024-04-25T15:43:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.409+0000 7fa806ffd640 1 --2- 172.21.15.80:0/1916218930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8080cfd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0097a0 tx=0x7fa7fc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2cda8d44cf5af8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.411+0000 7fa8067fc640 1 -- 172.21.15.80:0/1916218930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc037070 con 0x7fa8080cf960 2024-04-25T15:43:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.411+0000 7fa8067fc640 1 -- 172.21.15.80:0/1916218930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc032640 con 0x7fa8080cf960 2024-04-25T15:43:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.411+0000 7fa8067fc640 1 -- 172.21.15.80:0/1916218930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc032a10 con 0x7fa8080cf960 2024-04-25T15:43:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1916218930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 msgr2=0x7fa8080cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1916218930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8080cfd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0097a0 tx=0x7fa7fc02a2c0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1916218930 shutdown_connections 2024-04-25T15:43:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1916218930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8080cfd70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1916218930 >> 172.21.15.80:0/1916218930 conn(0x7fa8080b7620 msgr2=0x7fa8080b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1916218930 shutdown_connections 2024-04-25T15:43:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.412+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1916218930 wait complete. 2024-04-25T15:43:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.414+0000 7fa80dd9e640 1 Processor -- start 2024-04-25T15:43:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.414+0000 7fa80dd9e640 1 -- start start 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.415+0000 7fa80dd9e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8080b1ef0 0x7fa80815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.415+0000 7fa80dd9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8080ce220 0x7fa808161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.415+0000 7fa80dd9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8081e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.415+0000 7fa80dd9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080d3530 con 0x7fa8080cf960 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.415+0000 7fa80dd9e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080ce630 con 0x7fa8080b1ef0 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.415+0000 7fa80dd9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa80815dbf0 con 0x7fa8080ce220 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8081e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8081e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44444/0 (socket says 172.21.15.80:44444) 2024-04-25T15:43:29.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 -- 172.21.15.80:0/1523928633 learned_addr learned my addr 172.21.15.80:0/1523928633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa8077fe640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8080b1ef0 0x7fa80815f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa806ffd640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8080ce220 0x7fa808161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 -- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8080ce220 msgr2=0x7fa808161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8080ce220 0x7fa808161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 -- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8080b1ef0 msgr2=0x7fa80815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8080b1ef0 0x7fa80815f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 -- 172.21.15.80:0/1523928633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080af700 con 0x7fa8080cf960 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa807fff640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8081e9930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c6b0 tx=0x7fa80000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800003b70 con 0x7fa8080cf960 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800003d10 con 0x7fa8080cf960 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800005310 con 0x7fa8080cf960 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8080af9e0 con 0x7fa8080cf960 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.416+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8080affa0 con 0x7fa8080cf960 2024-04-25T15:43:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.417+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80806a100 con 0x7fa8080cf960 2024-04-25T15:43:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.418+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa8000054b0 con 0x7fa8080cf960 2024-04-25T15:43:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.418+0000 7fa7effff640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7f40744b0 0x7fa7f40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.418+0000 7fa8077fe640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7f40744b0 0x7fa7f40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.418+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa800095170 con 0x7fa8080cf960 2024-04-25T15:43:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.419+0000 7fa8077fe640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7f40744b0 0x7fa7f40769c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005880 tx=0x7fa7f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.423+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa80005f000 con 0x7fa8080cf960 2024-04-25T15:43:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.635+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa80806eab0 con 0x7fa8080cf960 2024-04-25T15:43:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.635+0000 7fa7effff640 1 -- 172.21.15.80:0/1523928633 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa800063300 con 0x7fa8080cf960 2024-04-25T15:43:29.636 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:29.637 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T15:43:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7f40744b0 msgr2=0x7fa7f40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7f40744b0 0x7fa7f40769c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005880 tx=0x7fa7f8009040 comp rx=0 tx=0).stop 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 msgr2=0x7fa8081e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8081e9930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c6b0 tx=0x7fa80000cb70 comp rx=0 tx=0).stop 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 shutdown_connections 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7f40744b0 0x7fa7f40769c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8080cf960 0x7fa8081e9930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa8080ce220 0x7fa808161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 --2- 172.21.15.80:0/1523928633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8080b1ef0 0x7fa80815f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 >> 172.21.15.80:0/1523928633 conn(0x7fa8080b7620 msgr2=0x7fa808071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 shutdown_connections 2024-04-25T15:43:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.637+0000 7fa80dd9e640 1 -- 172.21.15.80:0/1523928633 wait complete. 2024-04-25T15:43:29.650 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T15:43:29.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:29.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.756+0000 7fc6a81f8640 1 Processor -- start 2024-04-25T15:43:29.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.756+0000 7fc6a81f8640 1 -- start start 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.757+0000 7fc6a81f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 0x7fc6a00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.757+0000 7fc6a81f8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a01642e0 con 0x7fc6a00ce860 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.757+0000 7fc6a81f8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a01645c0 con 0x7fc6a0073a40 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.757+0000 7fc6a81f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a01648a0 con 0x7fc6a0163e00 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.757+0000 7fc6a5f94640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6a00ce860 0x7fc6a0073330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41916/0 (socket says 172.21.15.80:41916) 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.757+0000 7fc6a5f94640 1 -- 172.21.15.80:0/1655850543 learned_addr learned my addr 172.21.15.80:0/1655850543 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a6795640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 0x7fc6a00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201914551 0 0) 0x7fc6a01642e0 con 0x7fc6a00ce860 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc68c003520 con 0x7fc6a00ce860 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2374842784 0 0) 0x7fc68c003520 con 0x7fc6a00ce860 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 msgr2=0x7fc6a00b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 0x7fc6a00b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 >> v1:172.21.15.195:6789/0 conn(0x7fc6a0073a40 legacy=0x7fc6a006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a0164b80 con 0x7fc6a00ce860 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc69c001670 con 0x7fc6a00ce860 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 >> v1:172.21.15.80:6789/0 conn(0x7fc6a00ce860 legacy=0x7fc6a0073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 0x7fc68c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc68c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc68c004d40 0x7fc68c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01648a0 con 0x7fc68c003f40 2024-04-25T15:43:29.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c00bad0 con 0x7fc68c004d40 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc68c00bcd0 con 0x7fc6a0163e00 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5793640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc68c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5f94640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 0x7fc68c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a6795640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc68c004d40 0x7fc68c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5793640 1 -- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 msgr2=0x7fc68c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5793640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0163e00 0x7fc68c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5793640 1 -- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc68c004d40 msgr2=0x7fc68c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5793640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc68c004d40 0x7fc68c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.758+0000 7fc6a5793640 1 -- 172.21.15.80:0/1655850543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c003520 con 0x7fc68c003f40 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.759+0000 7fc6a5793640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc68c004800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6900018b0 tx=0x7fc68c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f65215bd34e1a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.759+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690037070 con 0x7fc68c003f40 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.759+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69002abf0 con 0x7fc68c003f40 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.759+0000 7fc6a4f92640 1 -- 172.21.15.80:0/1655850543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690001480 con 0x7fc68c003f40 2024-04-25T15:43:29.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a81f8640 1 -- 172.21.15.80:0/1655850543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 msgr2=0x7fc68c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/1655850543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc68c004800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6900018b0 tx=0x7fc68c005830 comp rx=0 tx=0).stop 2024-04-25T15:43:29.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a6795640 1 -- 172.21.15.80:0/1655850543 reap_dead start 2024-04-25T15:43:29.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a81f8640 1 -- 172.21.15.80:0/1655850543 shutdown_connections 2024-04-25T15:43:29.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a81f8640 1 -- 172.21.15.80:0/1655850543 >> 172.21.15.80:0/1655850543 conn(0x7fc6a00d3ea0 msgr2=0x7fc6a00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:29.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a81f8640 1 -- 172.21.15.80:0/1655850543 shutdown_connections 2024-04-25T15:43:29.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.760+0000 7fc6a81f8640 1 -- 172.21.15.80:0/1655850543 wait complete. 2024-04-25T15:43:29.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.762+0000 7fc6a81f8640 1 Processor -- start 2024-04-25T15:43:29.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.762+0000 7fc6a81f8640 1 -- start start 2024-04-25T15:43:29.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a81f8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc6a0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a81f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0153e40 0x7fc6a00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a81f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a00c8420 0x7fc6a00c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a81f8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a00b30a0 con 0x7fc68c003f40 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a81f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a00b2f20 con 0x7fc6a00c8420 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a81f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a00b3220 con 0x7fc6a0153e40 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc6a0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc6a0153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44462/0 (socket says 172.21.15.80:44462) 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 -- 172.21.15.80:0/3160797890 learned_addr learned my addr 172.21.15.80:0/3160797890 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5793640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0153e40 0x7fc6a00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a6795640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a00c8420 0x7fc6a00c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 -- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0153e40 msgr2=0x7fc6a00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0153e40 0x7fc6a00cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 -- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a00c8420 msgr2=0x7fc6a00c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a00c8420 0x7fc6a00c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.763+0000 7fc6a5f94640 1 -- 172.21.15.80:0/3160797890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a00cd8a0 con 0x7fc68c003f40 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.764+0000 7fc6a5f94640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc6a0153620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc69c007340 tx=0x7fc69c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.764+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c01a070 con 0x7fc68c003f40 2024-04-25T15:43:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.764+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c00f8b0 con 0x7fc68c003f40 2024-04-25T15:43:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.764+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a00c90d0 con 0x7fc68c003f40 2024-04-25T15:43:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.764+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00fc60 con 0x7fc68c003f40 2024-04-25T15:43:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.764+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a00c9690 con 0x7fc68c003f40 2024-04-25T15:43:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.765+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a006a100 con 0x7fc68c003f40 2024-04-25T15:43:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.765+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc69c01d070 con 0x7fc68c003f40 2024-04-25T15:43:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.766+0000 7fc6967fc640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6840744b0 0x7fc6840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:29.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.766+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc69c095020 con 0x7fc68c003f40 2024-04-25T15:43:29.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.766+0000 7fc6a5793640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6840744b0 0x7fc6840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:29.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.766+0000 7fc6a5793640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6840744b0 0x7fc6840769c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc690034000 tx=0x7fc69002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:29.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.770+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc69c05f500 con 0x7fc68c003f40 2024-04-25T15:43:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.947+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6a006de90 con 0x7fc68c003f40 2024-04-25T15:43:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.948+0000 7fc6967fc640 1 -- 172.21.15.80:0/3160797890 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fc69c05ee00 con 0x7fc68c003f40 2024-04-25T15:43:29.949 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:29.949 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:29.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6840744b0 msgr2=0x7fc6840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6840744b0 0x7fc6840769c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc690034000 tx=0x7fc69002e000 comp rx=0 tx=0).stop 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 msgr2=0x7fc6a0153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc6a0153620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc69c007340 tx=0x7fc69c007800 comp rx=0 tx=0).stop 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 shutdown_connections 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6840744b0 0x7fc6840769c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6a00c8420 0x7fc6a00c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6a0153e40 0x7fc6a00cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 --2- 172.21.15.80:0/3160797890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc68c003f40 0x7fc6a0153620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 >> 172.21.15.80:0/3160797890 conn(0x7fc6a00d3ea0 msgr2=0x7fc6a015ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 shutdown_connections 2024-04-25T15:43:29.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:29.950+0000 7fc6a81f8640 1 -- 172.21.15.80:0/3160797890 wait complete. 2024-04-25T15:43:29.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:29.963 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.072+0000 7f3637ae0640 1 Processor -- start 2024-04-25T15:43:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.073+0000 7f3637ae0640 1 -- start start 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f3637ae0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f36300b5490 0x7f3630160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f3637ae0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36301643f0 con 0x7f36300d0b00 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f3637ae0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36301646d0 con 0x7f36300d2d50 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f3637ae0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f36301649b0 con 0x7f36300b5490 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f363507b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f36300d0b00 0x7f36300d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41928/0 (socket says 172.21.15.80:41928) 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f363507b640 1 -- 172.21.15.80:0/947947874 learned_addr learned my addr 172.21.15.80:0/947947874 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f363587c640 1 --2- 172.21.15.80:0/947947874 >> v2:172.21.15.195:3300/0 conn(0x7f36300b5490 0x7f3630160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929578191 0 0) 0x7f36301643f0 con 0x7f36300d0b00 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.074+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f361c003520 con 0x7f36300d0b00 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 466035516 0 0) 0x7f361c003520 con 0x7f36300d0b00 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 >> v2:172.21.15.195:3300/0 conn(0x7f36300b5490 msgr2=0x7f3630160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 --2- 172.21.15.80:0/947947874 >> v2:172.21.15.195:3300/0 conn(0x7f36300b5490 0x7f3630160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 >> v1:172.21.15.195:6789/0 conn(0x7f36300d2d50 legacy=0x7f36300d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3630164c90 con 0x7f36300d0b00 2024-04-25T15:43:30.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f3620001670 con 0x7f36300d0b00 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 >> v1:172.21.15.80:6789/0 conn(0x7f36300d0b00 legacy=0x7f36300d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0039b0 0x7f361c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f361c004800 0x7f361c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f361c0051c0 0x7f361c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f36301649b0 con 0x7f361c0051c0 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f361c00c160 con 0x7f361c0039b0 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f361c00c360 con 0x7f361c004800 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363607d640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f361c0051c0 0x7f361c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363587c640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0039b0 0x7f361c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363507b640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f361c004800 0x7f361c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363607d640 1 -- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f361c004800 msgr2=0x7f361c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363607d640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f361c004800 0x7f361c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363607d640 1 -- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0039b0 msgr2=0x7f361c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:30.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363607d640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0039b0 0x7f361c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.075+0000 7f363607d640 1 -- 172.21.15.80:0/947947874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c003520 con 0x7f361c0051c0 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.076+0000 7f363607d640 1 -- 172.21.15.80:0/947947874 reap_dead start 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.076+0000 7f363607d640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f361c0051c0 0x7f361c00b9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3628001e20 tx=0x7f361c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccbec79ecf7981d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.076+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628001a70 con 0x7f361c0051c0 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.076+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362802ad70 con 0x7f361c0051c0 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.076+0000 7f363487a640 1 -- 172.21.15.80:0/947947874 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628003b90 con 0x7f361c0051c0 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 -- 172.21.15.80:0/947947874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f361c0051c0 msgr2=0x7f361c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f361c0051c0 0x7f361c00b9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3628001e20 tx=0x7f361c005830 comp rx=0 tx=0).stop 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 -- 172.21.15.80:0/947947874 shutdown_connections 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 --2- 172.21.15.80:0/947947874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f361c0051c0 0x7f361c00b9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 -- 172.21.15.80:0/947947874 >> 172.21.15.80:0/947947874 conn(0x7f363006e650 msgr2=0x7f363006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 -- 172.21.15.80:0/947947874 shutdown_connections 2024-04-25T15:43:30.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.077+0000 7f3637ae0640 1 -- 172.21.15.80:0/947947874 wait complete. 2024-04-25T15:43:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.079+0000 7f3637ae0640 1 Processor -- start 2024-04-25T15:43:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.079+0000 7f3637ae0640 1 -- start start 2024-04-25T15:43:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f3637ae0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0051c0 0x7f3630150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f3637ae0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 0x7f36300b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f3637ae0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f363015a2d0 0x7f36300b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f3637ae0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3630163f80 con 0x7f36300ac7c0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f3637ae0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3630164100 con 0x7f361c0051c0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f3637ae0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f36300b5490 con 0x7f363015a2d0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 0x7f36300b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 0x7f36300b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44486/0 (socket says 172.21.15.80:44486) 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 -- 172.21.15.80:0/481540639 learned_addr learned my addr 172.21.15.80:0/481540639 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 -- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f363015a2d0 msgr2=0x7f36300b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363607d640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f363015a2d0 0x7f36300b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f363015a2d0 0x7f36300b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 -- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0051c0 msgr2=0x7f3630150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363587c640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0051c0 0x7f3630150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0051c0 0x7f3630150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 -- 172.21.15.80:0/481540639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36300c9980 con 0x7f36300ac7c0 2024-04-25T15:43:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.080+0000 7f363507b640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 0x7f36300b7140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3620007370 tx=0x7f3620007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.081+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362001a070 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.081+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362000f9c0 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.081+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36301619c0 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.081+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362000fdb0 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.081+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3630161f80 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.082+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36300c9bf0 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.082+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f362001d070 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.083+0000 7f36267fc640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.083+0000 7f363587c640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.083+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3620094f20 con 0x7f36300ac7c0 2024-04-25T15:43:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.083+0000 7f363587c640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36300d08c0 tx=0x7f362c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.087+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f362005f400 con 0x7f36300ac7c0 2024-04-25T15:43:30.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.261+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f363006a100 con 0x7f36300ac7c0 2024-04-25T15:43:30.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.261+0000 7f36267fc640 1 -- 172.21.15.80:0/481540639 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f36200673f0 con 0x7f36300ac7c0 2024-04-25T15:43:30.262 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:30.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 msgr2=0x7f36140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36300d08c0 tx=0x7f362c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 msgr2=0x7f36300b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 0x7f36300b7140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3620007370 tx=0x7f3620007830 comp rx=0 tx=0).stop 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 shutdown_connections 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f363015a2d0 0x7f36300b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36300ac7c0 0x7f36300b7140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 --2- 172.21.15.80:0/481540639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f361c0051c0 0x7f3630150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 >> 172.21.15.80:0/481540639 conn(0x7f363006e650 msgr2=0x7f36300cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 shutdown_connections 2024-04-25T15:43:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.263+0000 7f3637ae0640 1 -- 172.21.15.80:0/481540639 wait complete. 2024-04-25T15:43:30.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:30.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.385+0000 7f3c21d35640 1 Processor -- start 2024-04-25T15:43:30.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.385+0000 7f3c21d35640 1 -- start start 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.386+0000 7f3c21d35640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3c1c0d1000 0x7f3c1c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.386+0000 7f3c21d35640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0b2d80 0x7f3c1c0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.386+0000 7f3c21d35640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c0d0840 con 0x7f3c1c075c90 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.386+0000 7f3c21d35640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3c1c0b7d30 con 0x7f3c1c0d1000 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.386+0000 7f3c21d35640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c0d0b70 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0b2d80 0x7f3c1c0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c13fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3c1c0d1000 0x7f3c1c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1b7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f3c1c075c90 0x7f3c1c0b1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45120/0 (socket says 172.21.15.80:45120) 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1b7fe640 1 -- 172.21.15.80:0/3285024925 learned_addr learned my addr 172.21.15.80:0/3285024925 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1bfff640 1 -- 172.21.15.80:0/3285024925 >> v2:172.21.15.195:3300/0 conn(0x7f3c1c0d1000 msgr2=0x7f3c1c15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1affd640 1 -- 172.21.15.80:0/3285024925 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755535244 0 0) 0x7f3c1c0d0840 con 0x7f3c1c075c90 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1bfff640 1 --2- 172.21.15.80:0/3285024925 >> v2:172.21.15.195:3300/0 conn(0x7f3c1c0d1000 0x7f3c1c15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1bfff640 1 -- 172.21.15.80:0/3285024925 >> v1:172.21.15.195:6789/0 conn(0x7f3c1c075c90 legacy=0x7f3c1c0b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.387+0000 7f3c1bfff640 1 -- 172.21.15.80:0/3285024925 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c0b7770 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.388+0000 7f3c1bfff640 1 --2- 172.21.15.80:0/3285024925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0b2d80 0x7f3c1c0b3190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009d90 tx=0x7f3c1402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1468491cc38f4ff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.388+0000 7f3c1affd640 1 -- 172.21.15.80:0/3285024925 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14031600 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.388+0000 7f3c1affd640 1 -- 172.21.15.80:0/3285024925 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140317a0 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.388+0000 7f3c1affd640 1 -- 172.21.15.80:0/3285024925 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14031b70 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 -- 172.21.15.80:0/3285024925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0b2d80 msgr2=0x7f3c1c0b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3285024925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0b2d80 0x7f3c1c0b3190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009d90 tx=0x7f3c1402a5d0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 -- 172.21.15.80:0/3285024925 shutdown_connections 2024-04-25T15:43:30.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3285024925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0b2d80 0x7f3c1c0b3190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3285024925 >> v2:172.21.15.195:3300/0 conn(0x7f3c1c0d1000 0x7f3c1c15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 -- 172.21.15.80:0/3285024925 >> 172.21.15.80:0/3285024925 conn(0x7f3c1c09b410 msgr2=0x7f3c1c0b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 -- 172.21.15.80:0/3285024925 shutdown_connections 2024-04-25T15:43:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.389+0000 7f3c21d35640 1 -- 172.21.15.80:0/3285024925 wait complete. 2024-04-25T15:43:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.391+0000 7f3c21d35640 1 Processor -- start 2024-04-25T15:43:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.391+0000 7f3c21d35640 1 -- start start 2024-04-25T15:43:30.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c21d35640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c1c075c90 0x7f3c1c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c21d35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 0x7f3c1c1f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c21d35640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0d1000 0x7f3c1c1f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c21d35640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c06c5c0 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c21d35640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c0b36d0 con 0x7f3c1c075c90 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c21d35640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c06c740 con 0x7f3c1c0d1000 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 0x7f3c1c1f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 0x7f3c1c1f98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44498/0 (socket says 172.21.15.80:44498) 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 -- 172.21.15.80:0/3305535756 learned_addr learned my addr 172.21.15.80:0/3305535756 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c1bfff640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0d1000 0x7f3c1c1f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c1b7fe640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c1c075c90 0x7f3c1c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 -- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0d1000 msgr2=0x7f3c1c1f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0d1000 0x7f3c1c1f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 -- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c1c075c90 msgr2=0x7f3c1c0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c1c075c90 0x7f3c1c0cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c13fff640 1 -- 172.21.15.80:0/3305535756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c0ce7f0 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c1b7fe640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c1c075c90 0x7f3c1c0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.392+0000 7f3c1bfff640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0d1000 0x7f3c1c1f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.393+0000 7f3c13fff640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 0x7f3c1c1f98d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400e870 tx=0x7f3c0400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.393+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04017070 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.393+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0400ee60 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.393+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c0cead0 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.393+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400cb60 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.393+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c0cf090 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.394+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1c0ce560 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.395+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3c0401a070 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.395+0000 7f3c18ff9640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bfc0744b0 0x7f3bfc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.395+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3c04095750 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.395+0000 7f3c1b7fe640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bfc0744b0 0x7f3bfc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.395+0000 7f3c1b7fe640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bfc0744b0 0x7f3bfc0769c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c000f60 tx=0x7f3c0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.400+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c0405fc30 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.582+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3c1c06d280 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.582+0000 7f3c18ff9640 1 -- 172.21.15.80:0/3305535756 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f3c1c06d280 con 0x7f3c1c0b2d80 2024-04-25T15:43:30.583 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bfc0744b0 msgr2=0x7f3bfc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bfc0744b0 0x7f3bfc0769c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c000f60 tx=0x7f3c0c009040 comp rx=0 tx=0).stop 2024-04-25T15:43:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 msgr2=0x7f3c1c1f98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 0x7f3c1c1f98d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400e870 tx=0x7f3c0400ed30 comp rx=0 tx=0).stop 2024-04-25T15:43:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 shutdown_connections 2024-04-25T15:43:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bfc0744b0 0x7f3bfc0769c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c1c0d1000 0x7f3c1c1f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c1c0b2d80 0x7f3c1c1f98d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 --2- 172.21.15.80:0/3305535756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c1c075c90 0x7f3c1c0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 >> 172.21.15.80:0/3305535756 conn(0x7f3c1c09b410 msgr2=0x7f3c1c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 shutdown_connections 2024-04-25T15:43:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.584+0000 7f3c21d35640 1 -- 172.21.15.80:0/3305535756 wait complete. 2024-04-25T15:43:30.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.706+0000 7fada32e0640 1 Processor -- start 2024-04-25T15:43:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.706+0000 7fada32e0640 1 -- start start 2024-04-25T15:43:30.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada32e0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad9c15e060 0x7fad9c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada32e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad9c0d08c0 0x7fad9c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada32e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9c0d0cd0 con 0x7fad9c0b2b80 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada32e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fad9c161b00 con 0x7fad9c0d08c0 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada32e0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fad9c161dc0 con 0x7fad9c15e060 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada187d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad9c0d08c0 0x7fad9c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada187d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad9c0d08c0 0x7fad9c0d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44506/0 (socket says 172.21.15.80:44506) 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada187d640 1 -- 172.21.15.80:0/487163344 learned_addr learned my addr 172.21.15.80:0/487163344 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.707+0000 7fada087b640 1 --2- 172.21.15.80:0/487163344 >> v2:172.21.15.195:3300/0 conn(0x7fad9c15e060 0x7fad9c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.708+0000 7fada187d640 1 -- 172.21.15.80:0/487163344 >> v2:172.21.15.195:3300/0 conn(0x7fad9c15e060 msgr2=0x7fad9c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.708+0000 7fada187d640 1 --2- 172.21.15.80:0/487163344 >> v2:172.21.15.195:3300/0 conn(0x7fad9c15e060 0x7fad9c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.708+0000 7fada187d640 1 -- 172.21.15.80:0/487163344 >> v1:172.21.15.195:6789/0 conn(0x7fad9c0b2b80 legacy=0x7fad9c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.708+0000 7fada187d640 1 -- 172.21.15.80:0/487163344 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c1620a0 con 0x7fad9c0d08c0 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.708+0000 7fada187d640 1 --2- 172.21.15.80:0/487163344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c0d22e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0711f0 tx=0x7fad9402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62818ebac5ac042 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fad93fff640 1 -- 172.21.15.80:0/487163344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94036070 con 0x7fad9c0d08c0 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fad93fff640 1 -- 172.21.15.80:0/487163344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad94031600 con 0x7fad9c0d08c0 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fad93fff640 1 -- 172.21.15.80:0/487163344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad940319d0 con 0x7fad9c0d08c0 2024-04-25T15:43:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 -- 172.21.15.80:0/487163344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 msgr2=0x7fad9c0d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 --2- 172.21.15.80:0/487163344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c0d22e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0711f0 tx=0x7fad9402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 -- 172.21.15.80:0/487163344 shutdown_connections 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 --2- 172.21.15.80:0/487163344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c0d22e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 --2- 172.21.15.80:0/487163344 >> v2:172.21.15.195:3300/0 conn(0x7fad9c15e060 0x7fad9c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 -- 172.21.15.80:0/487163344 >> 172.21.15.80:0/487163344 conn(0x7fad9c0b54a0 msgr2=0x7fad9c0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 -- 172.21.15.80:0/487163344 shutdown_connections 2024-04-25T15:43:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.709+0000 7fada32e0640 1 -- 172.21.15.80:0/487163344 wait complete. 2024-04-25T15:43:30.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.711+0000 7fada32e0640 1 Processor -- start 2024-04-25T15:43:30.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.711+0000 7fada32e0640 1 -- start start 2024-04-25T15:43:30.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada32e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0b2b80 0x7fad9c15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada32e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c15d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada32e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9c15e060 0x7fad9c155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada32e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c162940 con 0x7fad9c0d08c0 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada32e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c162660 con 0x7fad9c0b2b80 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada32e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c0d2820 con 0x7fad9c15e060 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.712+0000 7fada087b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c15d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c15d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44512/0 (socket says 172.21.15.80:44512) 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 -- 172.21.15.80:0/2133566169 learned_addr learned my addr 172.21.15.80:0/2133566169 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada187d640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9c15e060 0x7fad9c155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada107c640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0b2b80 0x7fad9c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 -- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9c15e060 msgr2=0x7fad9c155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9c15e060 0x7fad9c155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 -- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0b2b80 msgr2=0x7fad9c15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0b2b80 0x7fad9c15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 -- 172.21.15.80:0/2133566169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c15be70 con 0x7fad9c0d08c0 2024-04-25T15:43:30.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada187d640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9c15e060 0x7fad9c155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada087b640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c15d450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e870 tx=0x7fad8c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c017070 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c00ee60 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c15c150 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00cb00 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.713+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c15c710 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.714+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c06a100 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.715+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fad8c01a070 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.716+0000 7fad91ffb640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad800744e0 0x7fad800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.716+0000 7fada107c640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad800744e0 0x7fad800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.716+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fad8c095660 con 0x7fad9c0d08c0 2024-04-25T15:43:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.716+0000 7fada107c640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad800744e0 0x7fad800769f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.720+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad8c05fb40 con 0x7fad9c0d08c0 2024-04-25T15:43:30.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.896+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fad9c0b2960 con 0x7fad9c0d08c0 2024-04-25T15:43:30.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.897+0000 7fad91ffb640 1 -- 172.21.15.80:0/2133566169 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fad8c05f440 con 0x7fad9c0d08c0 2024-04-25T15:43:30.898 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:30.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad800744e0 msgr2=0x7fad800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad800744e0 0x7fad800769f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad98009040 comp rx=0 tx=0).stop 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 msgr2=0x7fad9c15d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c15d450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e870 tx=0x7fad8c00ed30 comp rx=0 tx=0).stop 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 shutdown_connections 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad800744e0 0x7fad800769f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9c15e060 0x7fad9c155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad9c0d08c0 0x7fad9c15d450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 --2- 172.21.15.80:0/2133566169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0b2b80 0x7fad9c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 >> 172.21.15.80:0/2133566169 conn(0x7fad9c0b54a0 msgr2=0x7fad9c0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 shutdown_connections 2024-04-25T15:43:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:30.899+0000 7fada32e0640 1 -- 172.21.15.80:0/2133566169 wait complete. 2024-04-25T15:43:30.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.024+0000 7f66ce813640 1 Processor -- start 2024-04-25T15:43:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.024+0000 7f66ce813640 1 -- start start 2024-04-25T15:43:31.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66ce813640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66c809b620 0x7f66c80b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66ce813640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c80d2d80 0x7f66c80d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66ce813640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c809bb90 con 0x7f66c806e6a0 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66ce813640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f66c80b2810 con 0x7f66c809b620 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66ce813640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f66c80b2250 con 0x7f66c80d2d80 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66c7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66c809b620 0x7f66c80b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66c7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66c809b620 0x7f66c80b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44528/0 (socket says 172.21.15.80:44528) 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66c77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f66c806e6a0 0x7f66c80d2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41946/0 (socket says 172.21.15.80:41946) 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66c7fff640 1 -- 172.21.15.80:0/3082796806 learned_addr learned my addr 172.21.15.80:0/3082796806 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.025+0000 7f66ccdb0640 1 --2- 172.21.15.80:0/3082796806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c80d2d80 0x7f66c80d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c7fff640 1 -- 172.21.15.80:0/3082796806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c80d2d80 msgr2=0x7f66c80d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c7fff640 1 --2- 172.21.15.80:0/3082796806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c80d2d80 0x7f66c80d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c7fff640 1 -- 172.21.15.80:0/3082796806 >> v1:172.21.15.80:6789/0 conn(0x7f66c806e6a0 legacy=0x7f66c80d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c7fff640 1 -- 172.21.15.80:0/3082796806 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c80b2530 con 0x7f66c809b620 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c7fff640 1 --2- 172.21.15.80:0/3082796806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c809b620 0x7f66c80b3d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66b800bb10 tx=0x7f66b802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b04c5552073f18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c6ffd640 1 -- 172.21.15.80:0/3082796806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8032700 con 0x7f66c809b620 2024-04-25T15:43:31.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.026+0000 7f66c6ffd640 1 -- 172.21.15.80:0/3082796806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b80328a0 con 0x7f66c809b620 2024-04-25T15:43:31.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66c6ffd640 1 -- 172.21.15.80:0/3082796806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8032c70 con 0x7f66c809b620 2024-04-25T15:43:31.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66ce813640 1 -- 172.21.15.80:0/3082796806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c809b620 msgr2=0x7f66c80b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66ce813640 1 --2- 172.21.15.80:0/3082796806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c809b620 0x7f66c80b3d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66b800bb10 tx=0x7f66b802c800 comp rx=0 tx=0).stop 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66ce813640 1 -- 172.21.15.80:0/3082796806 shutdown_connections 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66ce813640 1 --2- 172.21.15.80:0/3082796806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c80d2d80 0x7f66c80d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66ce813640 1 --2- 172.21.15.80:0/3082796806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c809b620 0x7f66c80b3d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.027+0000 7f66ce813640 1 -- 172.21.15.80:0/3082796806 >> 172.21.15.80:0/3082796806 conn(0x7f66c80b7690 msgr2=0x7f66c80b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.028+0000 7f66ce813640 1 -- 172.21.15.80:0/3082796806 shutdown_connections 2024-04-25T15:43:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.028+0000 7f66ce813640 1 -- 172.21.15.80:0/3082796806 wait complete. 2024-04-25T15:43:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.029+0000 7f66ce813640 1 Processor -- start 2024-04-25T15:43:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.030+0000 7f66ce813640 1 -- start start 2024-04-25T15:43:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ce813640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c806e6a0 0x7f66c80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ce813640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66c809b620 0x7f66c80c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ce813640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 0x7f66c8157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ce813640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f66c806ef10 con 0x7f66c80cc4c0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ce813640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f66c806eab0 con 0x7f66c809b620 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ce813640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f66c806f090 con 0x7f66c806e6a0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 0x7f66c8157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 0x7f66c8157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44544/0 (socket says 172.21.15.80:44544) 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 -- 172.21.15.80:0/1176371791 learned_addr learned my addr 172.21.15.80:0/1176371791 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66c77fe640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66c809b620 0x7f66c80c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66c7fff640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c806e6a0 0x7f66c80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 -- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c806e6a0 msgr2=0x7f66c80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c806e6a0 0x7f66c80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 -- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66c809b620 msgr2=0x7f66c80c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66c809b620 0x7f66c80c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.031+0000 7f66ccdb0640 1 -- 172.21.15.80:0/1176371791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c80c7db0 con 0x7f66c80cc4c0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.032+0000 7f66ccdb0640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 0x7f66c8157b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66c0007d70 tx=0x7f66c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.032+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0014420 con 0x7f66c80cc4c0 2024-04-25T15:43:31.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.032+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c0019070 con 0x7f66c80cc4c0 2024-04-25T15:43:31.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.032+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c80c5360 con 0x7f66c80cc4c0 2024-04-25T15:43:31.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.032+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0014820 con 0x7f66c80cc4c0 2024-04-25T15:43:31.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.032+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c80c5600 con 0x7f66c80cc4c0 2024-04-25T15:43:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.033+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c806a100 con 0x7f66c80cc4c0 2024-04-25T15:43:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.033+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f66c00149c0 con 0x7f66c80cc4c0 2024-04-25T15:43:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.034+0000 7f66c4ff9640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66b40744e0 0x7f66b40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.034+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f66c0095d20 con 0x7f66c80cc4c0 2024-04-25T15:43:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.034+0000 7f66c7fff640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66b40744e0 0x7f66b40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.034+0000 7f66c7fff640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66b40744e0 0x7f66b40769f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f66b8037000 tx=0x7f66b8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.039+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66c80c5360 con 0x7f66c80cc4c0 2024-04-25T15:43:31.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.216+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f66c8072120 con 0x7f66c80cc4c0 2024-04-25T15:43:31.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.216+0000 7f66c4ff9640 1 -- 172.21.15.80:0/1176371791 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f66c0060170 con 0x7f66c80cc4c0 2024-04-25T15:43:31.217 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.218+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66b40744e0 msgr2=0x7f66b40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.218+0000 7f66ce813640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66b40744e0 0x7f66b40769f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f66b8037000 tx=0x7f66b8032000 comp rx=0 tx=0).stop 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.218+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 msgr2=0x7f66c8157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.218+0000 7f66ce813640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 0x7f66c8157b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66c0007d70 tx=0x7f66c000e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 shutdown_connections 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66b40744e0 0x7f66b40769f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66c80cc4c0 0x7f66c8157b20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66c809b620 0x7f66c80c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 --2- 172.21.15.80:0/1176371791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66c806e6a0 0x7f66c80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 >> 172.21.15.80:0/1176371791 conn(0x7f66c80b7690 msgr2=0x7f66c8071500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 shutdown_connections 2024-04-25T15:43:31.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.219+0000 7f66ce813640 1 -- 172.21.15.80:0/1176371791 wait complete. 2024-04-25T15:43:31.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:31.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.336+0000 7f3e36785640 1 Processor -- start 2024-04-25T15:43:31.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.336+0000 7f3e36785640 1 -- start start 2024-04-25T15:43:31.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e36785640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b4b60 0x7f3e300b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e36785640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e3006d6d0 0x7f3e300b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e36785640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e300b2f30 con 0x7f3e300b3680 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e36785640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3e3006eb60 con 0x7f3e3006d6d0 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e36785640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3e300b2c90 con 0x7f3e300b4b60 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e3006d6d0 0x7f3e300b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e34d22640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3e300b3680 0x7f3e300d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41950/0 (socket says 172.21.15.80:41950) 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e34d22640 1 -- 172.21.15.80:0/3264982928 learned_addr learned my addr 172.21.15.80:0/3264982928 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2ffff640 1 --2- 172.21.15.80:0/3264982928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b4b60 0x7f3e300b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2f7fe640 1 -- 172.21.15.80:0/3264982928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b4b60 msgr2=0x7f3e300b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2f7fe640 1 --2- 172.21.15.80:0/3264982928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b4b60 0x7f3e300b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2f7fe640 1 -- 172.21.15.80:0/3264982928 >> v1:172.21.15.80:6789/0 conn(0x7f3e300b3680 legacy=0x7f3e300d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2f7fe640 1 -- 172.21.15.80:0/3264982928 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300d10a0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.338+0000 7f3e2effd640 1 -- 172.21.15.80:0/3264982928 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178430292 0 0) 0x7f3e300b2f30 con 0x7f3e300b3680 2024-04-25T15:43:31.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.339+0000 7f3e2f7fe640 1 --2- 172.21.15.80:0/3264982928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e300b3140 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e240097a0 tx=0x7f3e2402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d818402a5fdbb9ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.339+0000 7f3e2effd640 1 -- 172.21.15.80:0/3264982928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24037070 con 0x7f3e3006d6d0 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.339+0000 7f3e2effd640 1 -- 172.21.15.80:0/3264982928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2402ae50 con 0x7f3e3006d6d0 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.339+0000 7f3e2effd640 1 -- 172.21.15.80:0/3264982928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24032660 con 0x7f3e3006d6d0 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 -- 172.21.15.80:0/3264982928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 msgr2=0x7f3e300b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 --2- 172.21.15.80:0/3264982928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e300b3140 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e240097a0 tx=0x7f3e2402a100 comp rx=0 tx=0).stop 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 -- 172.21.15.80:0/3264982928 shutdown_connections 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 --2- 172.21.15.80:0/3264982928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e300b3140 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 --2- 172.21.15.80:0/3264982928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b4b60 0x7f3e300b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 -- 172.21.15.80:0/3264982928 >> 172.21.15.80:0/3264982928 conn(0x7f3e300d0450 msgr2=0x7f3e300d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 -- 172.21.15.80:0/3264982928 shutdown_connections 2024-04-25T15:43:31.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.340+0000 7f3e36785640 1 -- 172.21.15.80:0/3264982928 wait complete. 2024-04-25T15:43:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.342+0000 7f3e36785640 1 Processor -- start 2024-04-25T15:43:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.342+0000 7f3e36785640 1 -- start start 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e36785640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e3009d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e36785640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b3680 0x7f3e301dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e36785640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e300b4b60 0x7f3e300cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e36785640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3009d0e0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e36785640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3009cbe0 con 0x7f3e300b4b60 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e36785640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3009d260 con 0x7f3e300b3680 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e3009d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e3009d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44564/0 (socket says 172.21.15.80:44564) 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.343+0000 7f3e2ffff640 1 -- 172.21.15.80:0/489369429 learned_addr learned my addr 172.21.15.80:0/489369429 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:31.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e34d22640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e300b4b60 0x7f3e300cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2f7fe640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b3680 0x7f3e301dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2ffff640 1 -- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b3680 msgr2=0x7f3e301dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2ffff640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b3680 0x7f3e301dc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2ffff640 1 -- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e300b4b60 msgr2=0x7f3e300cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2ffff640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e300b4b60 0x7f3e300cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2ffff640 1 -- 172.21.15.80:0/489369429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3009f0a0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2ffff640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e3009d690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000d7d0 tx=0x7f3e2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20018020 con 0x7f3e3006d6d0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200096c0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3009e000 con 0x7f3e3006d6d0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20009ab0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.344+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3009e5c0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.345+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e30075c90 con 0x7f3e3006d6d0 2024-04-25T15:43:31.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.346+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3e2001b020 con 0x7f3e3006d6d0 2024-04-25T15:43:31.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.346+0000 7f3e2cff9640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3e1c0744b0 0x7f3e1c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.346+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e20095ae0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.346+0000 7f3e2f7fe640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3e1c0744b0 0x7f3e1c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.347+0000 7f3e2f7fe640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3e1c0744b0 0x7f3e1c0769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3e24034000 tx=0x7f3e2402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.351+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e20022020 con 0x7f3e3006d6d0 2024-04-25T15:43:31.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.565+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e3006a100 con 0x7f3e3006d6d0 2024-04-25T15:43:31.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.566+0000 7f3e2cff9640 1 -- 172.21.15.80:0/489369429 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f3e3009f0a0 con 0x7f3e3006d6d0 2024-04-25T15:43:31.567 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:31.567 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:43:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3e1c0744b0 msgr2=0x7f3e1c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3e1c0744b0 0x7f3e1c0769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3e24034000 tx=0x7f3e2402e000 comp rx=0 tx=0).stop 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 msgr2=0x7f3e3009d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e3009d690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000d7d0 tx=0x7f3e2000dc90 comp rx=0 tx=0).stop 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 shutdown_connections 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3e1c0744b0 0x7f3e1c0769c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e300b4b60 0x7f3e300cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e300b3680 0x7f3e301dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 --2- 172.21.15.80:0/489369429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e3006d6d0 0x7f3e3009d690 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 >> 172.21.15.80:0/489369429 conn(0x7f3e300d0450 msgr2=0x7f3e300b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 shutdown_connections 2024-04-25T15:43:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.568+0000 7f3e36785640 1 -- 172.21.15.80:0/489369429 wait complete. 2024-04-25T15:43:31.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.687+0000 7f768e8e2640 1 Processor -- start 2024-04-25T15:43:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.687+0000 7f768e8e2640 1 -- start start 2024-04-25T15:43:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768e8e2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76880d4230 0x7f76881604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768e8e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76880b9620 con 0x7f76880d12e0 2024-04-25T15:43:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768e8e2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76880d4640 con 0x7f76880b7de0 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768e8e2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f76880d16f0 con 0x7f76880d4230 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768ce7f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76880d4230 0x7f76881604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768ce7f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76880d4230 0x7f76881604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44572/0 (socket says 172.21.15.80:44572) 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768ce7f640 1 -- 172.21.15.80:0/3566663464 learned_addr learned my addr 172.21.15.80:0/3566663464 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f7687fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f76880d12e0 0x7f76880b76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41960/0 (socket says 172.21.15.80:41960) 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768ce7f640 1 -- 172.21.15.80:0/3566663464 >> v1:172.21.15.195:6789/0 conn(0x7f76880b7de0 legacy=0x7f76880ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768ce7f640 1 -- 172.21.15.80:0/3566663464 >> v1:172.21.15.80:6789/0 conn(0x7f76880d12e0 legacy=0x7f76880b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f768ce7f640 1 -- 172.21.15.80:0/3566663464 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76880d1930 con 0x7f76880d4230 2024-04-25T15:43:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.688+0000 7f7686ffd640 1 -- 172.21.15.80:0/3566663464 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188789307 0 0) 0x7f7678001110 con 0x7f76880d12e0 2024-04-25T15:43:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.689+0000 7f768ce7f640 1 --2- 172.21.15.80:0/3566663464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76881604b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7680009e50 tx=0x7f768002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bad0afd8ca64a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.689+0000 7f7686ffd640 1 -- 172.21.15.80:0/3566663464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680036070 con 0x7f76880d4230 2024-04-25T15:43:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.689+0000 7f7686ffd640 1 -- 172.21.15.80:0/3566663464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7680031600 con 0x7f76880d4230 2024-04-25T15:43:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.689+0000 7f7686ffd640 1 -- 172.21.15.80:0/3566663464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76800319d0 con 0x7f76880d4230 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 -- 172.21.15.80:0/3566663464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 msgr2=0x7f76881604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 --2- 172.21.15.80:0/3566663464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76881604b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7680009e50 tx=0x7f768002a6d0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 -- 172.21.15.80:0/3566663464 shutdown_connections 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 --2- 172.21.15.80:0/3566663464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76881604b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 -- 172.21.15.80:0/3566663464 >> 172.21.15.80:0/3566663464 conn(0x7f768806e7c0 msgr2=0x7f768806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 -- 172.21.15.80:0/3566663464 shutdown_connections 2024-04-25T15:43:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.690+0000 7f768e8e2640 1 -- 172.21.15.80:0/3566663464 wait complete. 2024-04-25T15:43:31.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.692+0000 7f768e8e2640 1 Processor -- start 2024-04-25T15:43:31.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.692+0000 7f768e8e2640 1 -- start start 2024-04-25T15:43:31.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768e8e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76880d12e0 0x7f7688150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768e8e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76880cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768e8e2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76880ce500 0x7f76881ec050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768e8e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f76880b9b80 con 0x7f76880d4230 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768e8e2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f76880d1c10 con 0x7f76880ce500 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768e8e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f76880b9e60 con 0x7f76880d12e0 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f76877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76880cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f76877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76880cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44574/0 (socket says 172.21.15.80:44574) 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f76877fe640 1 -- 172.21.15.80:0/1262153538 learned_addr learned my addr 172.21.15.80:0/1262153538 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.693+0000 7f768ce7f640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76880ce500 0x7f76881ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f7687fff640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76880d12e0 0x7f7688150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f76877fe640 1 -- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76880d12e0 msgr2=0x7f7688150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f76877fe640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76880d12e0 0x7f7688150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f76877fe640 1 -- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76880ce500 msgr2=0x7f76881ec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f76877fe640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76880ce500 0x7f76881ec050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f76877fe640 1 -- 172.21.15.80:0/1262153538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76881505b0 con 0x7f76880d4230 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f768ce7f640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76880ce500 0x7f76881ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f76877fe640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76880cdfc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f767c00b3f0 tx=0x7f767c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c015020 con 0x7f76880d4230 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c011830 con 0x7f76880d4230 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76881f9ed0 con 0x7f76880d4230 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c011c20 con 0x7f76880d4230 2024-04-25T15:43:31.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.694+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76881fa490 con 0x7f76880d4230 2024-04-25T15:43:31.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.695+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7688160810 con 0x7f76880d4230 2024-04-25T15:43:31.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.696+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f767c018020 con 0x7f76880d4230 2024-04-25T15:43:31.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.696+0000 7f7684ff9640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76740744b0 0x7f76740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:31.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.696+0000 7f7687fff640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76740744b0 0x7f76740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:31.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.696+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f767c0951e0 con 0x7f76880d4230 2024-04-25T15:43:31.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.697+0000 7f7687fff640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76740744b0 0x7f76740769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7678000f60 tx=0x7f7678007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:31.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.701+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7688160810 con 0x7f76880d4230 2024-04-25T15:43:31.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.877+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f768806a100 con 0x7f76880d4230 2024-04-25T15:43:31.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.878+0000 7f7684ff9640 1 -- 172.21.15.80:0/1262153538 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f767c01f030 con 0x7f76880d4230 2024-04-25T15:43:31.880 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:31.880 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76740744b0 msgr2=0x7f76740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76740744b0 0x7f76740769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7678000f60 tx=0x7f7678007c00 comp rx=0 tx=0).stop 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 msgr2=0x7f76880cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76880cdfc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f767c00b3f0 tx=0x7f767c00b8b0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 shutdown_connections 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76740744b0 0x7f76740769c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76880ce500 0x7f76881ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76880d4230 0x7f76880cdfc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 --2- 172.21.15.80:0/1262153538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76880d12e0 0x7f7688150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.880+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 >> 172.21.15.80:0/1262153538 conn(0x7f768806e7c0 msgr2=0x7f7688161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.881+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 shutdown_connections 2024-04-25T15:43:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:31.881+0000 7f768e8e2640 1 -- 172.21.15.80:0/1262153538 wait complete. 2024-04-25T15:43:31.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:31.894 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.003+0000 7f9574a05640 1 Processor -- start 2024-04-25T15:43:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.003+0000 7f9574a05640 1 -- start start 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.004+0000 7f9574a05640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f9570075c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.004+0000 7f9574a05640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95700cff80 0x7f95700d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.004+0000 7f9574a05640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95700d08d0 con 0x7f95700d1b40 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.004+0000 7f9574a05640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f95700cf500 con 0x7f95700cff80 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.004+0000 7f9574a05640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95700cf990 con 0x7f95700b7540 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.004+0000 7f956ed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95700cff80 0x7f95700d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95700cff80 0x7f95700d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44578/0 (socket says 172.21.15.80:44578) 2024-04-25T15:43:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 -- 172.21.15.80:0/4139766509 learned_addr learned my addr 172.21.15.80:0/4139766509 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956e59c640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f9570075c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 -- 172.21.15.80:0/4139766509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 msgr2=0x7f9570075c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f9570075c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 -- 172.21.15.80:0/4139766509 >> v1:172.21.15.195:6789/0 conn(0x7f95700d1b40 legacy=0x7f95700b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 -- 172.21.15.80:0/4139766509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957006df10 con 0x7f95700cff80 2024-04-25T15:43:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956e59c640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f9570075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.005+0000 7f956ed9d640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f95700d0390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f956800d150 tx=0x7f956802c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e918ea2121125f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f956dd9b640 1 -- 172.21.15.80:0/4139766509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568039070 con 0x7f95700cff80 2024-04-25T15:43:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f956dd9b640 1 -- 172.21.15.80:0/4139766509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9568009600 con 0x7f95700cff80 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f956dd9b640 1 -- 172.21.15.80:0/4139766509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95680099d0 con 0x7f95700cff80 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 -- 172.21.15.80:0/4139766509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 msgr2=0x7f95700d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f95700d0390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f956800d150 tx=0x7f956802c840 comp rx=0 tx=0).stop 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 -- 172.21.15.80:0/4139766509 shutdown_connections 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f95700d0390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 --2- 172.21.15.80:0/4139766509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f9570075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 -- 172.21.15.80:0/4139766509 >> 172.21.15.80:0/4139766509 conn(0x7f957009b410 msgr2=0x7f95700b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 -- 172.21.15.80:0/4139766509 shutdown_connections 2024-04-25T15:43:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.006+0000 7f9574a05640 1 -- 172.21.15.80:0/4139766509 wait complete. 2024-04-25T15:43:32.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.008+0000 7f9574a05640 1 Processor -- start 2024-04-25T15:43:32.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.008+0000 7f9574a05640 1 -- start start 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f95700c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f957014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95700d1b40 0x7f9570148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f957006dc30 con 0x7f95700cff80 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f957006d970 con 0x7f95700d1b40 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95700b1720 con 0x7f95700b7540 2024-04-25T15:43:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f957014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f957014a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44586/0 (socket says 172.21.15.80:44586) 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 -- 172.21.15.80:0/3914286378 learned_addr learned my addr 172.21.15.80:0/3914286378 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f956e59c640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f95700c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f956ed9d640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95700d1b40 0x7f9570148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 -- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 msgr2=0x7f95700c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f95700c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 -- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95700d1b40 msgr2=0x7f9570148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95700d1b40 0x7f9570148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 -- 172.21.15.80:0/3914286378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957014cfa0 con 0x7f95700cff80 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9567fff640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f957014a0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f955800b420 tx=0x7f955800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558011830 con 0x7f95700cff80 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9558016070 con 0x7f95700cff80 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558011c10 con 0x7f95700cff80 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95701471b0 con 0x7f95700cff80 2024-04-25T15:43:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.010+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9570147770 con 0x7f95700cff80 2024-04-25T15:43:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.011+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957006a100 con 0x7f95700cff80 2024-04-25T15:43:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.012+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f955801b460 con 0x7f95700cff80 2024-04-25T15:43:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.012+0000 7f9566ffd640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95500744b0 0x7f95500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.013+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9558094fb0 con 0x7f95700cff80 2024-04-25T15:43:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.013+0000 7f956e59c640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95500744b0 0x7f95500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.013+0000 7f956e59c640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95500744b0 0x7f95500769c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f956000aac0 tx=0x7f9560008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.018+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9558020020 con 0x7f95700cff80 2024-04-25T15:43:32.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.192+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95700b7f20 con 0x7f95700cff80 2024-04-25T15:43:32.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.192+0000 7f9566ffd640 1 -- 172.21.15.80:0/3914286378 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f957014cfa0 con 0x7f95700cff80 2024-04-25T15:43:32.193 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95500744b0 msgr2=0x7f95500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95500744b0 0x7f95500769c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f956000aac0 tx=0x7f9560008040 comp rx=0 tx=0).stop 2024-04-25T15:43:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 msgr2=0x7f957014a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f957014a0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f955800b420 tx=0x7f955800b8e0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 shutdown_connections 2024-04-25T15:43:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95500744b0 0x7f95500769c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95700d1b40 0x7f9570148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95700cff80 0x7f957014a0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 --2- 172.21.15.80:0/3914286378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95700b7540 0x7f95700c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 >> 172.21.15.80:0/3914286378 conn(0x7f957009b410 msgr2=0x7f95700d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 shutdown_connections 2024-04-25T15:43:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.194+0000 7f9574a05640 1 -- 172.21.15.80:0/3914286378 wait complete. 2024-04-25T15:43:32.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.317+0000 7f561661a640 1 Processor -- start 2024-04-25T15:43:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.317+0000 7f561661a640 1 -- start start 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f561661a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f56101615a0 0x7f56100d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f561661a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100d2e10 0x7f561006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f561661a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56100d3220 con 0x7f561009bf80 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f561661a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f561006c5c0 con 0x7f56101615a0 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f561661a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5610162450 con 0x7f56100d2e10 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f561009bf80 0x7f5610161c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41962/0 (socket says 172.21.15.80:41962) 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560ffff640 1 -- 172.21.15.80:0/3726172507 learned_addr learned my addr 172.21.15.80:0/3726172507 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560f7fe640 1 --2- 172.21.15.80:0/3726172507 >> v2:172.21.15.195:3300/0 conn(0x7f56101615a0 0x7f56100d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100d2e10 0x7f561006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135467382 0 0) 0x7f5600001110 con 0x7f561009bf80 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f8003520 con 0x7f561009bf80 2024-04-25T15:43:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4189171611 0 0) 0x7f55f8003520 con 0x7f561009bf80 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100d2e10 msgr2=0x7f561006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100d2e10 0x7f561006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 >> v2:172.21.15.195:3300/0 conn(0x7f56101615a0 msgr2=0x7f56100d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 --2- 172.21.15.80:0/3726172507 >> v2:172.21.15.195:3300/0 conn(0x7f56101615a0 0x7f56100d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5610162730 con 0x7f561009bf80 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f5600001840 con 0x7f561009bf80 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 >> v1:172.21.15.80:6789/0 conn(0x7f561009bf80 legacy=0x7f5610161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55f80039b0 0x7f55f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55f8004800 0x7f55f8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.319+0000 7f560effd640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f8005150 0x7f55f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f561006c5c0 con 0x7f55f8005150 2024-04-25T15:43:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5610162450 con 0x7f55f80039b0 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f55f800c030 con 0x7f55f8004800 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100d2e10 0x7f561006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f560f7fe640 1 --2- 172.21.15.80:0/3726172507 >> v2:172.21.15.195:3300/0 conn(0x7f56101615a0 0x7f56100d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f560ffff640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55f80039b0 0x7f55f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f8005150 0x7f55f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f560f7fe640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55f8004800 0x7f55f8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 -- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55f8004800 msgr2=0x7f55f8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55f8004800 0x7f55f8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 -- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55f80039b0 msgr2=0x7f55f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55f80039b0 0x7f55f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.320+0000 7f5614bb7640 1 -- 172.21.15.80:0/3726172507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f8003520 con 0x7f55f8005150 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f8005150 0x7f55f800b9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56100b8650 tx=0x7f55f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ae69da3a97ccb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608036070 con 0x7f55f8005150 2024-04-25T15:43:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5608003c50 con 0x7f55f8005150 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f560effd640 1 -- 172.21.15.80:0/3726172507 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608009d40 con 0x7f55f8005150 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f561661a640 1 -- 172.21.15.80:0/3726172507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f8005150 msgr2=0x7f55f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f561661a640 1 --2- 172.21.15.80:0/3726172507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f8005150 0x7f55f800b9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56100b8650 tx=0x7f55f8005830 comp rx=0 tx=0).stop 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.321+0000 7f5614bb7640 1 -- 172.21.15.80:0/3726172507 reap_dead start 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.322+0000 7f561661a640 1 -- 172.21.15.80:0/3726172507 shutdown_connections 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.322+0000 7f561661a640 1 -- 172.21.15.80:0/3726172507 >> 172.21.15.80:0/3726172507 conn(0x7f56100b7640 msgr2=0x7f56100b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.322+0000 7f561661a640 1 -- 172.21.15.80:0/3726172507 shutdown_connections 2024-04-25T15:43:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.322+0000 7f561661a640 1 -- 172.21.15.80:0/3726172507 wait complete. 2024-04-25T15:43:32.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.323+0000 7f561661a640 1 Processor -- start 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.324+0000 7f561661a640 1 -- start start 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f561661a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100cc220 0x7f56100b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f561661a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56100b40b0 0x7f56100c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f561661a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 0x7f56101f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f561661a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f56101619b0 con 0x7f56100c6970 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f561661a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f561006c810 con 0x7f56100b40b0 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f561661a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f561006cd30 con 0x7f56100cc220 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 0x7f56101f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 0x7f56101f9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44616/0 (socket says 172.21.15.80:44616) 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 -- 172.21.15.80:0/3471030539 learned_addr learned my addr 172.21.15.80:0/3471030539 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f560f7fe640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56100b40b0 0x7f56100c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f560ffff640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100cc220 0x7f56100b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 -- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100cc220 msgr2=0x7f56100b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100cc220 0x7f56100b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 -- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56100b40b0 msgr2=0x7f56100c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56100b40b0 0x7f56100c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 -- 172.21.15.80:0/3471030539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56100b44c0 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f5614bb7640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 0x7f56101f9d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5608034040 tx=0x7f5608009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.325+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608036070 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.326+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5608043070 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.326+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56100d2520 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.326+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608009d40 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.326+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56100c7360 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.327+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561006a100 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.327+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5608005d10 con 0x7f56100c6970 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.328+0000 7f560cff9640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55fc0744b0 0x7f55fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.328+0000 7f560ffff640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55fc0744b0 0x7f55fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.328+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f56080b5c60 con 0x7f56100c6970 2024-04-25T15:43:32.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.328+0000 7f560ffff640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55fc0744b0 0x7f55fc0769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f56100c8410 tx=0x7f5600007ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.332+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56100b44c0 con 0x7f56100c6970 2024-04-25T15:43:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.508+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f56100d3570 con 0x7f56100c6970 2024-04-25T15:43:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.508+0000 7f560cff9640 1 -- 172.21.15.80:0/3471030539 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f5608031e20 con 0x7f56100c6970 2024-04-25T15:43:32.510 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:32.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55fc0744b0 msgr2=0x7f55fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55fc0744b0 0x7f55fc0769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f56100c8410 tx=0x7f5600007ac0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 msgr2=0x7f56101f9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 0x7f56101f9d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5608034040 tx=0x7f5608009750 comp rx=0 tx=0).stop 2024-04-25T15:43:32.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 shutdown_connections 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55fc0744b0 0x7f55fc0769c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56100c6970 0x7f56101f9d00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56100b40b0 0x7f56100c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 --2- 172.21.15.80:0/3471030539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56100cc220 0x7f56100b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 >> 172.21.15.80:0/3471030539 conn(0x7f56100b7640 msgr2=0x7f5610160220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 shutdown_connections 2024-04-25T15:43:32.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.511+0000 7f561661a640 1 -- 172.21.15.80:0/3471030539 wait complete. 2024-04-25T15:43:32.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:32.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.634+0000 7f6932461640 1 Processor -- start 2024-04-25T15:43:32.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.634+0000 7f6932461640 1 -- start start 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f6932461640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f692c0b2df0 0x7f692c06c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f6932461640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c0d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f6932461640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c0cf090 con 0x7f692c0ce310 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f6932461640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f692c161dd0 con 0x7f692c0b2df0 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f6932461640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f692c0ce7f0 con 0x7f692c06cb00 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f692b7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f692c0b2df0 0x7f692c06c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f69309fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c0d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.635+0000 7f692bfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f692c0ce310 0x7f692c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45136/0 (socket says 172.21.15.80:45136) 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692b7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f692c0b2df0 0x7f692c06c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50822/0 (socket says 172.21.15.80:50822) 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692bfff640 1 -- 172.21.15.80:0/1690444309 learned_addr learned my addr 172.21.15.80:0/1690444309 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692b7fe640 1 -- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 msgr2=0x7f692c0d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692b7fe640 1 --2- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c0d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692b7fe640 1 -- 172.21.15.80:0/1690444309 >> v1:172.21.15.195:6789/0 conn(0x7f692c0ce310 legacy=0x7f692c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692affd640 1 -- 172.21.15.80:0/1690444309 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052915972 0 0) 0x7f692c0cf090 con 0x7f692c0ce310 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f692b7fe640 1 -- 172.21.15.80:0/1690444309 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c0cead0 con 0x7f692c0b2df0 2024-04-25T15:43:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.636+0000 7f69309fe640 1 --2- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c0d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.637+0000 7f692b7fe640 1 --2- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c06c5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f692002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc0e438cc8b3cde9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.637+0000 7f692affd640 1 -- 172.21.15.80:0/1690444309 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920037070 con 0x7f692c0b2df0 2024-04-25T15:43:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.637+0000 7f692affd640 1 -- 172.21.15.80:0/1690444309 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692002ae50 con 0x7f692c0b2df0 2024-04-25T15:43:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.637+0000 7f692affd640 1 -- 172.21.15.80:0/1690444309 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920032660 con 0x7f692c0b2df0 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.637+0000 7f6932461640 1 -- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 msgr2=0x7f692c06c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 --2- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c06c5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f692002a100 comp rx=0 tx=0).stop 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 -- 172.21.15.80:0/1690444309 shutdown_connections 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 --2- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c0d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 --2- 172.21.15.80:0/1690444309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c06c5c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 -- 172.21.15.80:0/1690444309 >> 172.21.15.80:0/1690444309 conn(0x7f692c0b75b0 msgr2=0x7f692c0b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 -- 172.21.15.80:0/1690444309 shutdown_connections 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.638+0000 7f6932461640 1 -- 172.21.15.80:0/1690444309 wait complete. 2024-04-25T15:43:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.639+0000 7f6932461640 1 Processor -- start 2024-04-25T15:43:32.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.640+0000 7f6932461640 1 -- start start 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f6932461640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f6932461640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c1f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f6932461640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 0x7f692c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f6932461640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0d2d30 con 0x7f692c0ce310 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f6932461640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0b40f0 con 0x7f692c0b2df0 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f6932461640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f692c0d2eb0 con 0x7f692c06cb00 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 0x7f692c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 0x7f692c15a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44628/0 (socket says 172.21.15.80:44628) 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f692bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 -- 172.21.15.80:0/522900815 learned_addr learned my addr 172.21.15.80:0/522900815 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f692b7fe640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c1f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 -- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 msgr2=0x7f692c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 -- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 msgr2=0x7f692c1f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c1f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 -- 172.21.15.80:0/522900815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c15e740 con 0x7f692c0ce310 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.641+0000 7f69309fe640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 0x7f692c15a970 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f692400ef90 tx=0x7f692400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.642+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924018020 con 0x7f692c0ce310 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.642+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6924014480 con 0x7f692c0ce310 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.642+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c1f4ed0 con 0x7f692c0ce310 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.642+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924014850 con 0x7f692c0ce310 2024-04-25T15:43:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.642+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c0cad30 con 0x7f692c0ce310 2024-04-25T15:43:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.643+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c0ca7c0 con 0x7f692c0ce310 2024-04-25T15:43:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.643+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6924005d10 con 0x7f692c0ce310 2024-04-25T15:43:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.644+0000 7f6928ff9640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69180744b0 0x7f69180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.644+0000 7f692bfff640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69180744b0 0x7f69180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.644+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f69240960f0 con 0x7f692c0ce310 2024-04-25T15:43:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.644+0000 7f692bfff640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69180744b0 0x7f69180769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f691c000fb0 tx=0x7f691c007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.649+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6924022030 con 0x7f692c0ce310 2024-04-25T15:43:32.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.822+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f692c070dd0 con 0x7f692c0ce310 2024-04-25T15:43:32.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.822+0000 7f6928ff9640 1 -- 172.21.15.80:0/522900815 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f692c1f4ed0 con 0x7f692c0ce310 2024-04-25T15:43:32.823 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:32.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69180744b0 msgr2=0x7f69180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69180744b0 0x7f69180769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f691c000fb0 tx=0x7f691c007e70 comp rx=0 tx=0).stop 2024-04-25T15:43:32.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 msgr2=0x7f692c15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 0x7f692c15a970 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f692400ef90 tx=0x7f692400c490 comp rx=0 tx=0).stop 2024-04-25T15:43:32.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 shutdown_connections 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69180744b0 0x7f69180769c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f692c0ce310 0x7f692c15a970 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c0b2df0 0x7f692c1f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 --2- 172.21.15.80:0/522900815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f692c06cb00 0x7f692c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 >> 172.21.15.80:0/522900815 conn(0x7f692c0b75b0 msgr2=0x7f692c0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 shutdown_connections 2024-04-25T15:43:32.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.824+0000 7f6932461640 1 -- 172.21.15.80:0/522900815 wait complete. 2024-04-25T15:43:32.837 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:32.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.946+0000 7fb1ed6a7640 1 Processor -- start 2024-04-25T15:43:32.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.946+0000 7fb1ed6a7640 1 -- start start 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1ed6a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80b5490 0x7fb1e8160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1ed6a7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1e80d2d50 0x7fb1e80d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1ed6a7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e81643f0 con 0x7fb1e80d0b00 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1ed6a7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e81646d0 con 0x7fb1e80d2d50 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1ed6a7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e81649b0 con 0x7fb1e80b5490 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e77fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1e80d2d50 0x7fb1e80d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e67fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb1e80d0b00 0x7fb1e80d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41972/0 (socket says 172.21.15.80:41972) 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e67fc640 1 -- 172.21.15.80:0/2695277107 learned_addr learned my addr 172.21.15.80:0/2695277107 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e6ffd640 1 --2- 172.21.15.80:0/2695277107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80b5490 0x7fb1e8160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e77fe640 1 -- 172.21.15.80:0/2695277107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80b5490 msgr2=0x7fb1e8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e77fe640 1 --2- 172.21.15.80:0/2695277107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80b5490 0x7fb1e8160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e77fe640 1 -- 172.21.15.80:0/2695277107 >> v1:172.21.15.80:6789/0 conn(0x7fb1e80d0b00 legacy=0x7fb1e80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e5ffb640 1 -- 172.21.15.80:0/2695277107 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637254627 0 0) 0x7fb1e81643f0 con 0x7fb1e80d0b00 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.948+0000 7fb1e77fe640 1 -- 172.21.15.80:0/2695277107 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e8164c90 con 0x7fb1e80d2d50 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.949+0000 7fb1e77fe640 1 --2- 172.21.15.80:0/2695277107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e80d2d50 0x7fb1e80d47d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00097a0 tx=0x7fb1e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bee967629f6800f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.949+0000 7fb1e5ffb640 1 -- 172.21.15.80:0/2695277107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0037070 con 0x7fb1e80d2d50 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.949+0000 7fb1e5ffb640 1 -- 172.21.15.80:0/2695277107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0032440 con 0x7fb1e80d2d50 2024-04-25T15:43:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.949+0000 7fb1e5ffb640 1 -- 172.21.15.80:0/2695277107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0032810 con 0x7fb1e80d2d50 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/2695277107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e80d2d50 msgr2=0x7fb1e80d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/2695277107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e80d2d50 0x7fb1e80d47d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00097a0 tx=0x7fb1e002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/2695277107 shutdown_connections 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/2695277107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e80d2d50 0x7fb1e80d47d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/2695277107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80b5490 0x7fb1e8160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/2695277107 >> 172.21.15.80:0/2695277107 conn(0x7fb1e806e650 msgr2=0x7fb1e806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/2695277107 shutdown_connections 2024-04-25T15:43:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.950+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/2695277107 wait complete. 2024-04-25T15:43:32.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.952+0000 7fb1ed6a7640 1 Processor -- start 2024-04-25T15:43:32.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.952+0000 7fb1ed6a7640 1 -- start start 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1ed6a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1e80d0b00 0x7fb1e80b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1ed6a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80d2d50 0x7fb1e8154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1ed6a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 0x7fb1e80b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1ed6a7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80b94e0 con 0x7fb1e8155490 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1ed6a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80b9360 con 0x7fb1e80d0b00 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1ed6a7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e8163f80 con 0x7fb1e80d2d50 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 0x7fb1e80b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 0x7fb1e80b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44646/0 (socket says 172.21.15.80:44646) 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 -- 172.21.15.80:0/1133814472 learned_addr learned my addr 172.21.15.80:0/1133814472 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e67fc640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80d2d50 0x7fb1e8154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e6ffd640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1e80d0b00 0x7fb1e80b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 -- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80d2d50 msgr2=0x7fb1e8154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80d2d50 0x7fb1e8154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 -- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1e80d0b00 msgr2=0x7fb1e80b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1e80d0b00 0x7fb1e80b6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 -- 172.21.15.80:0/1133814472 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e8154880 con 0x7fb1e8155490 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.953+0000 7fb1e77fe640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 0x7fb1e80b75c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00097a0 tx=0x7fb1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.954+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0037050 con 0x7fb1e8155490 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.954+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0038040 con 0x7fb1e8155490 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.954+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e8155c00 con 0x7fb1e8155490 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.954+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0004490 con 0x7fb1e8155490 2024-04-25T15:43:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.954+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e81561c0 con 0x7fb1e8155490 2024-04-25T15:43:32.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.955+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e806a100 con 0x7fb1e8155490 2024-04-25T15:43:32.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.955+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb1e0030980 con 0x7fb1e8155490 2024-04-25T15:43:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.956+0000 7fb1cf7fe640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1d40744b0 0x7fb1d40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.956+0000 7fb1e6ffd640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1d40744b0 0x7fb1d40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.956+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb1e00b5f90 con 0x7fb1e8155490 2024-04-25T15:43:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.956+0000 7fb1e6ffd640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1d40744b0 0x7fb1d40769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80d08c0 tx=0x7fb1d8003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:32.960+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1e8154880 con 0x7fb1e8155490 2024-04-25T15:43:33.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:33.031 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:43:33.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.139+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb1e80cda80 con 0x7fb1e8155490 2024-04-25T15:43:33.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.140+0000 7fb1cf7fe640 1 -- 172.21.15.80:0/1133814472 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fb1e0080470 con 0x7fb1e8155490 2024-04-25T15:43:33.141 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1d40744b0 msgr2=0x7fb1d40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1d40744b0 0x7fb1d40769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80d08c0 tx=0x7fb1d8003990 comp rx=0 tx=0).stop 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 msgr2=0x7fb1e80b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 0x7fb1e80b75c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00097a0 tx=0x7fb1e00046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 shutdown_connections 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1d40744b0 0x7fb1d40769c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1e8155490 0x7fb1e80b75c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1e80d2d50 0x7fb1e8154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 --2- 172.21.15.80:0/1133814472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1e80d0b00 0x7fb1e80b6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 >> 172.21.15.80:0/1133814472 conn(0x7fb1e806e650 msgr2=0x7fb1e815d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:33.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 shutdown_connections 2024-04-25T15:43:33.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.143+0000 7fb1ed6a7640 1 -- 172.21.15.80:0/1133814472 wait complete. 2024-04-25T15:43:33.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:33.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.261+0000 7faea4042640 1 Processor -- start 2024-04-25T15:43:33.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.261+0000 7faea4042640 1 -- start start 2024-04-25T15:43:33.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea4042640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae9c15d310 0x7fae9c09b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea4042640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c0d2ed0 0x7fae9c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea4042640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae9c06e990 con 0x7fae9c0cfcd0 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea4042640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fae9c0d0610 con 0x7fae9c15d310 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea4042640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fae9c06ec00 con 0x7fae9c0d2ed0 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea1dde640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae9c15d310 0x7fae9c09b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea1dde640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae9c15d310 0x7fae9c09b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44658/0 (socket says 172.21.15.80:44658) 2024-04-25T15:43:33.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.262+0000 7faea1dde640 1 -- 172.21.15.80:0/3878638822 learned_addr learned my addr 172.21.15.80:0/3878638822 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:33.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.263+0000 7faea25df640 1 --2- 172.21.15.80:0/3878638822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c0d2ed0 0x7fae9c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.263+0000 7faea1dde640 1 -- 172.21.15.80:0/3878638822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c0d2ed0 msgr2=0x7fae9c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:33.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.263+0000 7faea1dde640 1 --2- 172.21.15.80:0/3878638822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c0d2ed0 0x7fae9c0d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.263+0000 7faea1dde640 1 -- 172.21.15.80:0/3878638822 >> v1:172.21.15.195:6789/0 conn(0x7fae9c0cfcd0 legacy=0x7fae9c0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.263+0000 7faea1dde640 1 -- 172.21.15.80:0/3878638822 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c06eee0 con 0x7fae9c15d310 2024-04-25T15:43:33.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.263+0000 7faea1dde640 1 --2- 172.21.15.80:0/3878638822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c15d310 0x7fae9c09b950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae98009870 tx=0x7fae9802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2034f6b2e98d4b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea0ddc640 1 -- 172.21.15.80:0/3878638822 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98037070 con 0x7fae9c15d310 2024-04-25T15:43:33.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea0ddc640 1 -- 172.21.15.80:0/3878638822 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae98032440 con 0x7fae9c15d310 2024-04-25T15:43:33.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea0ddc640 1 -- 172.21.15.80:0/3878638822 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98032810 con 0x7fae9c15d310 2024-04-25T15:43:33.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 -- 172.21.15.80:0/3878638822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c15d310 msgr2=0x7fae9c09b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 --2- 172.21.15.80:0/3878638822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c15d310 0x7fae9c09b950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae98009870 tx=0x7fae9802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 -- 172.21.15.80:0/3878638822 shutdown_connections 2024-04-25T15:43:33.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 --2- 172.21.15.80:0/3878638822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c0d2ed0 0x7fae9c0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 --2- 172.21.15.80:0/3878638822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c15d310 0x7fae9c09b950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 -- 172.21.15.80:0/3878638822 >> 172.21.15.80:0/3878638822 conn(0x7fae9c0b7750 msgr2=0x7fae9c0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:33.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 -- 172.21.15.80:0/3878638822 shutdown_connections 2024-04-25T15:43:33.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.264+0000 7faea4042640 1 -- 172.21.15.80:0/3878638822 wait complete. 2024-04-25T15:43:33.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.266+0000 7faea4042640 1 Processor -- start 2024-04-25T15:43:33.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.266+0000 7faea4042640 1 -- start start 2024-04-25T15:43:33.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.267+0000 7faea4042640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae9c0cfcd0 0x7fae9c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.267+0000 7faea4042640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c15d310 0x7fae9c0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.267+0000 7faea4042640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 0x7fae9c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.267+0000 7faea4042640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c0d1440 con 0x7fae9c1599b0 2024-04-25T15:43:33.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.267+0000 7faea4042640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c0d12c0 con 0x7fae9c0cfcd0 2024-04-25T15:43:33.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.267+0000 7faea4042640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fae9c0d15c0 con 0x7fae9c15d310 2024-04-25T15:43:33.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 0x7fae9c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 0x7fae9c0ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44660/0 (socket says 172.21.15.80:44660) 2024-04-25T15:43:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 -- 172.21.15.80:0/3095370697 learned_addr learned my addr 172.21.15.80:0/3095370697 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea1dde640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae9c0cfcd0 0x7fae9c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea15dd640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c15d310 0x7fae9c0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 -- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c15d310 msgr2=0x7fae9c0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c15d310 0x7fae9c0c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 -- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae9c0cfcd0 msgr2=0x7fae9c159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae9c0cfcd0 0x7fae9c159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 -- 172.21.15.80:0/3095370697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c0c9c20 con 0x7fae9c1599b0 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea1dde640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae9c0cfcd0 0x7fae9c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea25df640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 0x7fae9c0ca9e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae9400ec10 tx=0x7fae9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94018020 con 0x7fae9c1599b0 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9400cd40 con 0x7fae9c1599b0 2024-04-25T15:43:33.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940146c0 con 0x7fae9c1599b0 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9c0c9f00 con 0x7fae9c1599b0 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.268+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae9c0ca4c0 con 0x7fae9c1599b0 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.269+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae9c06a100 con 0x7fae9c1599b0 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.270+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fae9401b020 con 0x7fae9c1599b0 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.270+0000 7fae927fc640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae800744e0 0x7fae800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.270+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fae94096270 con 0x7fae9c1599b0 2024-04-25T15:43:33.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.270+0000 7faea1dde640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae800744e0 0x7fae800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.271+0000 7faea1dde640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae800744e0 0x7fae800769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae98034000 tx=0x7fae9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.275+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae94022020 con 0x7fae9c1599b0 2024-04-25T15:43:33.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.492+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae9c0cc820 con 0x7fae9c1599b0 2024-04-25T15:43:33.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.493+0000 7fae927fc640 1 -- 172.21.15.80:0/3095370697 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fae94010040 con 0x7fae9c1599b0 2024-04-25T15:43:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:33.493 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:33.493 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.494+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae800744e0 msgr2=0x7fae800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.494+0000 7faea4042640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae800744e0 0x7fae800769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae98034000 tx=0x7fae9802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.494+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 msgr2=0x7fae9c0ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.494+0000 7faea4042640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 0x7fae9c0ca9e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae9400ec10 tx=0x7fae9400c490 comp rx=0 tx=0).stop 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 shutdown_connections 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae800744e0 0x7fae800769f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae9c1599b0 0x7fae9c0ca9e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae9c15d310 0x7fae9c0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 --2- 172.21.15.80:0/3095370697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae9c0cfcd0 0x7fae9c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 >> 172.21.15.80:0/3095370697 conn(0x7fae9c0b7750 msgr2=0x7fae9c071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 shutdown_connections 2024-04-25T15:43:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.495+0000 7faea4042640 1 -- 172.21.15.80:0/3095370697 wait complete. 2024-04-25T15:43:33.506 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:33.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.613+0000 7f5266b2e640 1 Processor -- start 2024-04-25T15:43:33.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.613+0000 7f5266b2e640 1 -- start start 2024-04-25T15:43:33.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f5266b2e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52600ce220 0x7f526009bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f5266b2e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52601607c0 con 0x7f52600cf960 2024-04-25T15:43:33.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f5266b2e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52600d0180 con 0x7f52600cfd70 2024-04-25T15:43:33.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f5266b2e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f52600cf4d0 con 0x7f52600ce220 2024-04-25T15:43:33.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f52648ca640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52600ce220 0x7f526009bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f525ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f52600cf960 0x7f52600b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41982/0 (socket says 172.21.15.80:41982) 2024-04-25T15:43:33.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f52648ca640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52600ce220 0x7f526009bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44670/0 (socket says 172.21.15.80:44670) 2024-04-25T15:43:33.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f525ffff640 1 -- 172.21.15.80:0/4293416891 learned_addr learned my addr 172.21.15.80:0/4293416891 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:33.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f52648ca640 1 -- 172.21.15.80:0/4293416891 >> v1:172.21.15.195:6789/0 conn(0x7f52600cfd70 legacy=0x7f52600d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:33.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f52648ca640 1 -- 172.21.15.80:0/4293416891 >> v1:172.21.15.80:6789/0 conn(0x7f52600cf960 legacy=0x7f52600b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.615+0000 7f52648ca640 1 -- 172.21.15.80:0/4293416891 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600ceba0 con 0x7f52600ce220 2024-04-25T15:43:33.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.616+0000 7f52648ca640 1 --2- 172.21.15.80:0/4293416891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600ce220 0x7f526009bb70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f52500097a0 tx=0x7f525002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2364a382bac3b2d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.616+0000 7f525f7fe640 1 -- 172.21.15.80:0/4293416891 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250037070 con 0x7f52600ce220 2024-04-25T15:43:33.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.616+0000 7f525f7fe640 1 -- 172.21.15.80:0/4293416891 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525002adf0 con 0x7f52600ce220 2024-04-25T15:43:33.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.616+0000 7f525f7fe640 1 -- 172.21.15.80:0/4293416891 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250032660 con 0x7f52600ce220 2024-04-25T15:43:33.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 -- 172.21.15.80:0/4293416891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600ce220 msgr2=0x7f526009bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 --2- 172.21.15.80:0/4293416891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600ce220 0x7f526009bb70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f52500097a0 tx=0x7f525002a160 comp rx=0 tx=0).stop 2024-04-25T15:43:33.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 -- 172.21.15.80:0/4293416891 shutdown_connections 2024-04-25T15:43:33.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 --2- 172.21.15.80:0/4293416891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600ce220 0x7f526009bb70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 -- 172.21.15.80:0/4293416891 >> 172.21.15.80:0/4293416891 conn(0x7f52600b7620 msgr2=0x7f52600b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:33.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 -- 172.21.15.80:0/4293416891 shutdown_connections 2024-04-25T15:43:33.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.617+0000 7f5266b2e640 1 -- 172.21.15.80:0/4293416891 wait complete. 2024-04-25T15:43:33.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.618+0000 7f5266b2e640 1 Processor -- start 2024-04-25T15:43:33.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.618+0000 7f5266b2e640 1 -- start start 2024-04-25T15:43:33.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f5266b2e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52600ce220 0x7f52600a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f5266b2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 0x7f526009d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f5266b2e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52600cfd70 0x7f52600cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f5266b2e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f52600cf160 con 0x7f52600cf960 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f5266b2e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f52600ce630 con 0x7f52600cfd70 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f5266b2e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f526009c0b0 con 0x7f52600ce220 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 0x7f526009d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 0x7f526009d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44686/0 (socket says 172.21.15.80:44686) 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 -- 172.21.15.80:0/1948998224 learned_addr learned my addr 172.21.15.80:0/1948998224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f52648ca640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52600ce220 0x7f52600a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 -- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52600ce220 msgr2=0x7f52600a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52600ce220 0x7f52600a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 -- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52600cfd70 msgr2=0x7f52600cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f52650cb640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52600cfd70 0x7f52600cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52600cfd70 0x7f52600cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 -- 172.21.15.80:0/1948998224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526009f230 con 0x7f52600cf960 2024-04-25T15:43:33.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.620+0000 7f525ffff640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 0x7f526009d320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f525400c570 tx=0x7f525400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.621+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254018070 con 0x7f52600cf960 2024-04-25T15:43:33.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.621+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52540074e0 con 0x7f52600cf960 2024-04-25T15:43:33.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.621+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526009f4a0 con 0x7f52600cf960 2024-04-25T15:43:33.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.621+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254004a20 con 0x7f52600cf960 2024-04-25T15:43:33.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.621+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526009fa60 con 0x7f52600cf960 2024-04-25T15:43:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.622+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526006a100 con 0x7f52600cf960 2024-04-25T15:43:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.622+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f525401b070 con 0x7f52600cf960 2024-04-25T15:43:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.623+0000 7f525d7fa640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f524c0744e0 0x7f524c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.623+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f52540948b0 con 0x7f52600cf960 2024-04-25T15:43:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.623+0000 7f52648ca640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f524c0744e0 0x7f524c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.623+0000 7f52648ca640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f524c0744e0 0x7f524c0769f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5250034000 tx=0x7f525002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.627+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f525405ed00 con 0x7f52600cf960 2024-04-25T15:43:33.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.803+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52600a07a0 con 0x7f52600cf960 2024-04-25T15:43:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.805+0000 7f525d7fa640 1 -- 172.21.15.80:0/1948998224 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f525405e600 con 0x7f52600cf960 2024-04-25T15:43:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:33.805 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:05.669154+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f524c0744e0 msgr2=0x7f524c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f524c0744e0 0x7f524c0769f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5250034000 tx=0x7f525002e000 comp rx=0 tx=0).stop 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 msgr2=0x7f526009d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 0x7f526009d320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f525400c570 tx=0x7f525400ca30 comp rx=0 tx=0).stop 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 shutdown_connections 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f524c0744e0 0x7f524c0769f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52600cfd70 0x7f52600cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52600cf960 0x7f526009d320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 --2- 172.21.15.80:0/1948998224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52600ce220 0x7f52600a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 >> 172.21.15.80:0/1948998224 conn(0x7f52600b7620 msgr2=0x7f526006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 shutdown_connections 2024-04-25T15:43:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.807+0000 7f5266b2e640 1 -- 172.21.15.80:0/1948998224 wait complete. 2024-04-25T15:43:33.819 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:33.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.925+0000 7fb021c0c640 1 Processor -- start 2024-04-25T15:43:33.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.925+0000 7fb021c0c640 1 -- start start 2024-04-25T15:43:33.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb021c0c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb01c0b4b60 0x7fb01c0b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb021c0c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c16a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb021c0c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01c0b2f30 con 0x7fb01c06d6d0 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb021c0c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb01c06eb60 con 0x7fb01c0b4b60 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb021c0c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb01c0b2c90 con 0x7fb01c0b3850 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb01b7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb01c0b4b60 0x7fb01c0b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb01bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c16a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb01b7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb01c0b4b60 0x7fb01c0b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50884/0 (socket says 172.21.15.80:50884) 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1646233622 learned_addr learned my addr 172.21.15.80:0/1646233622 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.927+0000 7fb01affd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb01c06d6d0 0x7fb01c0b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:45164/0 (socket says 172.21.15.80:45164) 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 msgr2=0x7fb01c16a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01b7fe640 1 --2- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c16a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1646233622 >> v1:172.21.15.195:6789/0 conn(0x7fb01c06d6d0 legacy=0x7fb01c0b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1646233622 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c0d10a0 con 0x7fb01c0b4b60 2024-04-25T15:43:33.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01bfff640 1 --2- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c16a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01b7fe640 1 --2- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 0x7fb01c0b91c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009850 tx=0x7fb00c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a42174d31076738a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.928+0000 7fb01a7fc640 1 -- 172.21.15.80:0/1646233622 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c004030 con 0x7fb01c0b4b60 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb01a7fc640 1 -- 172.21.15.80:0/1646233622 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c0041d0 con 0x7fb01c0b4b60 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb01a7fc640 1 -- 172.21.15.80:0/1646233622 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c003610 con 0x7fb01c0b4b60 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 -- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 msgr2=0x7fb01c0b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 0x7fb01c0b91c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009850 tx=0x7fb00c02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 -- 172.21.15.80:0/1646233622 shutdown_connections 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c16a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1646233622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 0x7fb01c0b91c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 -- 172.21.15.80:0/1646233622 >> 172.21.15.80:0/1646233622 conn(0x7fb01c0d0450 msgr2=0x7fb01c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 -- 172.21.15.80:0/1646233622 shutdown_connections 2024-04-25T15:43:33.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.929+0000 7fb021c0c640 1 -- 172.21.15.80:0/1646233622 wait complete. 2024-04-25T15:43:33.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.931+0000 7fb021c0c640 1 Processor -- start 2024-04-25T15:43:33.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.931+0000 7fb021c0c640 1 -- start start 2024-04-25T15:43:33.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.932+0000 7fb021c0c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 0x7fb01c0a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.932+0000 7fb021c0c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c1dba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.932+0000 7fb021c0c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 0x7fb01c1eba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.932+0000 7fb021c0c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c0d2f50 con 0x7fb01c06d6d0 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.932+0000 7fb021c0c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c09cbe0 con 0x7fb01c0b4b60 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.932+0000 7fb021c0c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb01c09d0e0 con 0x7fb01c0b3850 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 0x7fb01c0a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 0x7fb01c0a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44698/0 (socket says 172.21.15.80:44698) 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1821916319 learned_addr learned my addr 172.21.15.80:0/1821916319 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1821916319 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 msgr2=0x7fb01c1dba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c1dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1821916319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 msgr2=0x7fb01c1eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 0x7fb01c1eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 -- 172.21.15.80:0/1821916319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c09f2d0 con 0x7fb01c06d6d0 2024-04-25T15:43:33.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb01b7fe640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 0x7fb01c0a1170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb00c034040 tx=0x7fb00c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c041030 con 0x7fb01c06d6d0 2024-04-25T15:43:33.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c003bd0 con 0x7fb01c06d6d0 2024-04-25T15:43:33.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01c09f7d0 con 0x7fb01c06d6d0 2024-04-25T15:43:33.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c004030 con 0x7fb01c06d6d0 2024-04-25T15:43:33.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.933+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01c09fd90 con 0x7fb01c06d6d0 2024-04-25T15:43:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.934+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01c075c90 con 0x7fb01c06d6d0 2024-04-25T15:43:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.935+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb00c044070 con 0x7fb01c06d6d0 2024-04-25T15:43:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.935+0000 7fb003fff640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0080744b0 0x7fb0080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.935+0000 7fb01affd640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0080744b0 0x7fb0080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.935+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb00c0b5f50 con 0x7fb01c06d6d0 2024-04-25T15:43:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.936+0000 7fb01affd640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0080744b0 0x7fb0080769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb010000f60 tx=0x7fb010007a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:33.940+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb00c080430 con 0x7fb01c06d6d0 2024-04-25T15:43:34.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.154+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb01c06a100 con 0x7fb01c06d6d0 2024-04-25T15:43:34.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.155+0000 7fb003fff640 1 -- 172.21.15.80:0/1821916319 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fb00c088420 con 0x7fb01c06d6d0 2024-04-25T15:43:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:34.155 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:34.155 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:43:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.156+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0080744b0 msgr2=0x7fb0080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.156+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0080744b0 0x7fb0080769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb010000f60 tx=0x7fb010007a00 comp rx=0 tx=0).stop 2024-04-25T15:43:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.156+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 msgr2=0x7fb01c0a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.156+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 0x7fb01c0a1170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb00c034040 tx=0x7fb00c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 shutdown_connections 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0080744b0 0x7fb0080769c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb01c0b4b60 0x7fb01c1eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb01c0b3850 0x7fb01c1dba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 --2- 172.21.15.80:0/1821916319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb01c06d6d0 0x7fb01c0a1170 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 >> 172.21.15.80:0/1821916319 conn(0x7fb01c0d0450 msgr2=0x7fb01c0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 shutdown_connections 2024-04-25T15:43:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.157+0000 7fb021c0c640 1 -- 172.21.15.80:0/1821916319 wait complete. 2024-04-25T15:43:34.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:43:00.620270+0000', 'modified': '2024-04-25T15:43:22.730431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.195:6833/1446733248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 1446733248}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 1446733248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-04-25T15:43:34.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:43:34.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T15:43:34.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.681+0000 7fe562e96640 1 Processor -- start 2024-04-25T15:43:34.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.681+0000 7fe562e96640 1 -- start start 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.682+0000 7fe562e96640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe55c0b48d0 0x7fe55c0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.682+0000 7fe562e96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.682+0000 7fe562e96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0b7fa0 con 0x7fe55c0d41b0 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.682+0000 7fe562e96640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c163fb0 con 0x7fe55c0b48d0 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.682+0000 7fe562e96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c164270 con 0x7fe55c0b7b90 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe55c0b48d0 0x7fe55c0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe561433640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe55c0b48d0 0x7fe55c0b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:53856/0 (socket says 172.21.15.80:53856) 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe561433640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c0d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:36682/0 (socket says 172.21.15.80:36682) 2024-04-25T15:43:34.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 -- 172.21.15.80:0/1648631951 learned_addr learned my addr 172.21.15.80:0/1648631951 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 -- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 msgr2=0x7fe55c0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 --2- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c0d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 -- 172.21.15.80:0/1648631951 >> v1:172.21.15.195:6789/0 conn(0x7fe55c0d41b0 legacy=0x7fe55c1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.683+0000 7fe553fff640 1 -- 172.21.15.80:0/1648631951 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c164550 con 0x7fe55c0b48d0 2024-04-25T15:43:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.684+0000 7fe553fff640 1 --2- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0b48d0 0x7fe55c0b7650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009870 tx=0x7fe54c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fedfebdc44e5ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.684+0000 7fe5537fe640 1 -- 172.21.15.80:0/1648631951 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c037070 con 0x7fe55c0b48d0 2024-04-25T15:43:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.684+0000 7fe5537fe640 1 -- 172.21.15.80:0/1648631951 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c032440 con 0x7fe55c0b48d0 2024-04-25T15:43:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.684+0000 7fe5537fe640 1 -- 172.21.15.80:0/1648631951 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c032810 con 0x7fe55c0b48d0 2024-04-25T15:43:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 -- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0b48d0 msgr2=0x7fe55c0b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 --2- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0b48d0 0x7fe55c0b7650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009870 tx=0x7fe54c02a270 comp rx=0 tx=0).stop 2024-04-25T15:43:34.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 -- 172.21.15.80:0/1648631951 shutdown_connections 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 --2- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c0d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 --2- 172.21.15.80:0/1648631951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0b48d0 0x7fe55c0b7650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 -- 172.21.15.80:0/1648631951 >> 172.21.15.80:0/1648631951 conn(0x7fe55c06e9f0 msgr2=0x7fe55c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 -- 172.21.15.80:0/1648631951 shutdown_connections 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.685+0000 7fe562e96640 1 -- 172.21.15.80:0/1648631951 wait complete. 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.687+0000 7fe562e96640 1 Processor -- start 2024-04-25T15:43:34.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.687+0000 7fe562e96640 1 -- start start 2024-04-25T15:43:34.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe562e96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 0x7fe55c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe562e96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe562e96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0d41b0 0x7fe55c0cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe562e96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c0b4fd0 con 0x7fe55c0b48d0 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe562e96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c164b10 con 0x7fe55c0d41b0 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe562e96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c0b5150 con 0x7fe55c0b7b90 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe560c32640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 0x7fe55c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe560c32640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 0x7fe55c1620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59472/0 (socket says 172.21.15.80:59472) 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe560c32640 1 -- 172.21.15.80:0/4257921699 learned_addr learned my addr 172.21.15.80:0/4257921699 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe561433640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0d41b0 0x7fe55c0cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.688+0000 7fe553fff640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe560c32640 1 -- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 msgr2=0x7fe55c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe560c32640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c15b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe560c32640 1 -- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0d41b0 msgr2=0x7fe55c0cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe560c32640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0d41b0 0x7fe55c0cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe560c32640 1 -- 172.21.15.80:0/4257921699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c0cd6d0 con 0x7fe55c0b48d0 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe560c32640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 0x7fe55c1620b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c3f0 tx=0x7fe55800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe5517fa640 1 -- 172.21.15.80:0/4257921699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5580052d0 con 0x7fe55c0b48d0 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe5517fa640 1 -- 172.21.15.80:0/4257921699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe558005490 con 0x7fe55c0b48d0 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe5517fa640 1 -- 172.21.15.80:0/4257921699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558007260 con 0x7fe55c0b48d0 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c0cd9b0 con 0x7fe55c0b48d0 2024-04-25T15:43:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.689+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c0cf670 con 0x7fe55c0b48d0 2024-04-25T15:43:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.691+0000 7fe5517fa640 1 -- 172.21.15.80:0/4257921699 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe558007400 con 0x7fe55c0b48d0 2024-04-25T15:43:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.691+0000 7fe5517fa640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5480744b0 0x7fe5480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.691+0000 7fe553fff640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5480744b0 0x7fe5480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.691+0000 7fe5517fa640 1 -- 172.21.15.80:0/4257921699 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe558094a30 con 0x7fe55c0b48d0 2024-04-25T15:43:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.692+0000 7fe553fff640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5480744b0 0x7fe5480769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe54c034000 tx=0x7fe54c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.692+0000 7fe569e29740 1 Processor -- start 2024-04-25T15:43:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.692+0000 7fe569e29740 1 -- start start 2024-04-25T15:43:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e56600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe569e29740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e2c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe569e29740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5573f3d90740 con 0x5573f3a613b0 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5573f3d2c3a0 con 0x5573f3a69590 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5573f3d8c700 con 0x5573f3a8a270 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59488/0 (socket says 172.21.15.80:59488) 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 -- 172.21.15.80:0/1121085634 learned_addr learned my addr 172.21.15.80:0/1121085634 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe560c32640 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e56600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe561433640 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e2c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 -- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 msgr2=0x5573f3e56600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e56600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 -- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 msgr2=0x5573f3e2c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e2c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 -- 172.21.15.80:0/1121085634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573f3d48750 con 0x5573f3a613b0 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe561433640 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e2c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe553fff640 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe54c000c00 tx=0x7fe54c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb5cacfd3588302 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe5427fc640 1 -- 172.21.15.80:0/1121085634 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c037040 con 0x5573f3a613b0 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe5427fc640 1 -- 172.21.15.80:0/1121085634 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c04c070 con 0x5573f3a613b0 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.694+0000 7fe5427fc640 1 -- 172.21.15.80:0/1121085634 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c03c880 con 0x5573f3a613b0 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 -- 172.21.15.80:0/1121085634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 msgr2=0x5573f3e52fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe54c000c00 tx=0x7fe54c02c000 comp rx=0 tx=0).stop 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 -- 172.21.15.80:0/1121085634 shutdown_connections 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e2c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52fa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 --2- 172.21.15.80:0/1121085634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e56600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 -- 172.21.15.80:0/1121085634 >> 172.21.15.80:0/1121085634 conn(0x5573f3a7e3c0 msgr2=0x5573f3e2b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 -- 172.21.15.80:0/1121085634 shutdown_connections 2024-04-25T15:43:34.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.695+0000 7fe569e29740 1 -- 172.21.15.80:0/1121085634 wait complete. 2024-04-25T15:43:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.696+0000 7fe569e29740 1 -- start start 2024-04-25T15:43:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.696+0000 7fe569e29740 1 Processor -- start 2024-04-25T15:43:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e52e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e2c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5573f3d17fe0 con 0x5573f3a613b0 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5573f3e59dc0 con 0x5573f3a69590 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5573f3e6f390 con 0x5573f3a8a270 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 10 client.0 _ll_register_callbacks cb 0x5573f3d2e150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59490/0 (socket says 172.21.15.80:59490) 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 -- 172.21.15.80:0/280761758 learned_addr learned my addr 172.21.15.80:0/280761758 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe553fff640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e52e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe561433640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e2c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 -- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 msgr2=0x5573f3e2c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e2c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 -- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 msgr2=0x5573f3e52e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e52e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 -- 172.21.15.80:0/280761758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573f3aa22d0 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe560c32640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe55805a7f0 tx=0x7fe55805e280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd706743478fd94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe53b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe53b7fe640 1 -- 172.21.15.80:0/280761758 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558073d30 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe53b7fe640 1 -- 172.21.15.80:0/280761758 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe55805d9d0 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe54c04c070 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe53b7fe640 1 -- 172.21.15.80:0/280761758 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fe558092050 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 10 client.4875 fetch_fsmap learned FSMap version 8 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5573f3b6c6b0 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.698+0000 7fe53b7fe640 1 -- 172.21.15.80:0/280761758 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c04c070 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe53b7fe640 1 -- 172.21.15.80:0/280761758 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fe55805a0e0 con 0x5573f3a613b0 2024-04-25T15:43:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe569e29740 10 client.4875 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe569e29740 10 client.4875 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe569e29740 20 client.4875 populate_metadata read hostname 'smithi080' 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe569e29740 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a48e40 0x5573f3e58ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe569e29740 4 client.4875 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 --> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573f3d9e350 con 0x5573f3a48e40 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe553fff640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a48e40 0x5573f3e58ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe53b7fe640 10 client.4875 ms_handle_connect on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.699+0000 7fe553fff640 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a48e40 0x5573f3e58ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff68189898b13f59 server_cookie=b689336ef8fd7383 in_seq=0 out_seq=0 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe53b7fe640 1 -- 172.21.15.80:0/280761758 <== mds.0 v2:172.21.15.195:6832/1446733248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5573f3d9e350 con 0x5573f3a48e40 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe53b7fe640 10 client.4875 handle_command_reply: tid=0 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 client.4875 shutdown 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 msgr2=0x5573f3e52950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe55805a7f0 tx=0x7fe55805e280 comp rx=0 tx=0).stop 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 shutdown_connections 2024-04-25T15:43:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a48e40 0x5573f3e58ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a8a270 0x5573f3e2c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a69590 0x5573f3e52e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe53b7fe640 0 client.4875 ms_handle_reset on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 --2- 172.21.15.80:0/280761758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e52950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.700+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 >> 172.21.15.80:0/280761758 conn(0x5573f3a7e3c0 msgr2=0x5573f3e2b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.701+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 shutdown_connections 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.701+0000 7fe569e29740 1 -- 172.21.15.80:0/280761758 wait complete. 2024-04-25T15:43:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.701+0000 7fe569e29740 20 client.4875 trim_cache size 0 max 16384 2024-04-25T15:43:34.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.719+0000 7fe569e29740 1 Processor -- start 2024-04-25T15:43:34.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.719+0000 7fe569e29740 1 -- start start 2024-04-25T15:43:34.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3e59360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe569e29740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e556c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe569e29740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c203150 con 0x5573f3a613b0 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1617b0 con 0x5573f3a48e40 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c0cb680 con 0x5573f3a69590 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e746a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59492/0 (socket says 172.21.15.80:59492) 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 -- 172.21.15.80:0/75504317 learned_addr learned my addr 172.21.15.80:0/75504317 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe561433640 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe560c32640 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3e59360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 -- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 msgr2=0x5573f3e556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 -- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 msgr2=0x5573f3e59360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3e59360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 -- 172.21.15.80:0/75504317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573f3e2c960 con 0x5573f3a613b0 2024-04-25T15:43:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe553fff640 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e746a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009990 tx=0x7fe54c03a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4e48d43de7b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe541ffb640 1 -- 172.21.15.80:0/75504317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c037040 con 0x5573f3a613b0 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe541ffb640 1 -- 172.21.15.80:0/75504317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c04c040 con 0x5573f3a613b0 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.721+0000 7fe541ffb640 1 -- 172.21.15.80:0/75504317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c03cc20 con 0x5573f3a613b0 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 -- 172.21.15.80:0/75504317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 msgr2=0x5573f3e746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e746a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009990 tx=0x7fe54c03a000 comp rx=0 tx=0).stop 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 -- 172.21.15.80:0/75504317 shutdown_connections 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e746a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 --2- 172.21.15.80:0/75504317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3e59360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 -- 172.21.15.80:0/75504317 >> 172.21.15.80:0/75504317 conn(0x5573f3a7e3c0 msgr2=0x5573f3e25300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 -- 172.21.15.80:0/75504317 shutdown_connections 2024-04-25T15:43:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.722+0000 7fe569e29740 1 -- 172.21.15.80:0/75504317 wait complete. 2024-04-25T15:43:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.723+0000 7fe569e29740 1 -- start start 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.723+0000 7fe569e29740 1 Processor -- start 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3ef09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e6b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e55a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5573f3e719b0 con 0x5573f3a613b0 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5573f3e70b70 con 0x5573f3a48e40 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5573f3e2c710 con 0x5573f3a69590 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.724+0000 7fe569e29740 10 client.0 _ll_register_callbacks cb 0x7fe558001140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e6b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e6b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59494/0 (socket says 172.21.15.80:59494) 2024-04-25T15:43:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 -- 172.21.15.80:0/39289509 learned_addr learned my addr 172.21.15.80:0/39289509 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe561433640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e55a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe560c32640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3ef09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 -- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 msgr2=0x5573f3e55a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e55a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 -- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 msgr2=0x5573f3ef09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3ef09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 -- 172.21.15.80:0/39289509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573f3e59670 con 0x5573f3a613b0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe560c32640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3ef09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe553fff640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e6b750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009990 tx=0x7fe54c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e98455ca383b974 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe53b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe53b7fe640 1 -- 172.21.15.80:0/39289509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c037040 con 0x5573f3a613b0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe53b7fe640 1 -- 172.21.15.80:0/39289509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe54c03c800 con 0x5573f3a613b0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe54c04c040 con 0x5573f3a613b0 2024-04-25T15:43:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe53b7fe640 1 -- 172.21.15.80:0/39289509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fe54c03ca00 con 0x5573f3a613b0 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe569e29740 10 client.4881 fetch_fsmap learned FSMap version 8 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.725+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5573f3e6be20 con 0x5573f3a613b0 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe53b7fe640 1 -- 172.21.15.80:0/39289509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c04c040 con 0x5573f3a613b0 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe53b7fe640 1 -- 172.21.15.80:0/39289509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fe54c06d080 con 0x5573f3a613b0 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe569e29740 10 client.4881 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe569e29740 10 client.4881 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe569e29740 20 client.4881 populate_metadata read hostname 'smithi080' 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe569e29740 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a1e280 0x5573f3e57650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe569e29740 4 client.4881 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 --> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] -- command(tid 0: {"prefix": "status"}) -- 0x5573f3d981c0 con 0x5573f3a1e280 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe560c32640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a1e280 0x5573f3e57650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe53b7fe640 10 client.4881 ms_handle_connect on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.726+0000 7fe560c32640 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a1e280 0x5573f3e57650 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ac4fb9869d4bc1 server_cookie=8bb61eee947b574b in_seq=0 out_seq=0 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe53b7fe640 1 -- 172.21.15.80:0/39289509 <== mds.0 v2:172.21.15.195:6832/1446733248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5573f3d981c0 con 0x5573f3a1e280 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe53b7fe640 10 client.4881 handle_command_reply: tid=0 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 client.4881 shutdown 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 msgr2=0x5573f3e6b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e6b750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009990 tx=0x7fe54c004730 comp rx=0 tx=0).stop 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 shutdown_connections 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:6832/1446733248,v1:172.21.15.195:6833/1446733248] conn(0x5573f3a1e280 0x5573f3e57650 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5573f3a69590 0x5573f3e55a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe53b7fe640 0 client.4881 ms_handle_reset on v2:172.21.15.195:6832/1446733248 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5573f3a613b0 0x5573f3e6b750 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 --2- 172.21.15.80:0/39289509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5573f3a48e40 0x5573f3ef09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 >> 172.21.15.80:0/39289509 conn(0x5573f3a7e3c0 msgr2=0x5573f3e21a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 shutdown_connections 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 1 -- 172.21.15.80:0/39289509 wait complete. 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe569e29740 20 client.4881 trim_cache size 0 max 16384 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4285, 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:43:34.733 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 33.448390955000001, 2024-04-25T15:43:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 8, 2024-04-25T15:43:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 25, 2024-04-25T15:43:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T15:43:34.734 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 40.004680413000003 2024-04-25T15:43:34.734 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5480744b0 msgr2=0x7fe5480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5480744b0 0x7fe5480769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe54c034000 tx=0x7fe54c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 msgr2=0x7fe55c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 0x7fe55c1620b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c3f0 tx=0x7fe55800c8b0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 shutdown_connections 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5480744b0 0x7fe5480769c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c0d41b0 0x7fe55c0cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55c0b7b90 0x7fe55c15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.727+0000 7fe562e96640 1 --2- 172.21.15.80:0/4257921699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55c0b48d0 0x7fe55c1620b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:34.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.728+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 >> 172.21.15.80:0/4257921699 conn(0x7fe55c06e9f0 msgr2=0x7fe55c0b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:34.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.728+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 shutdown_connections 2024-04-25T15:43:34.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:34.728+0000 7fe562e96640 1 -- 172.21.15.80:0/4257921699 wait complete. 2024-04-25T15:43:34.739 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T15:43:34.747 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T15:43:34.748 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T15:43:34.748 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T15:43:34.748 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T15:43:34.760 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T15:43:34.761 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T15:43:34.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:34.761 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:43:34.775 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T15:43:34.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:34.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T15:43:34.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:34.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T15:43:34.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:34.942 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:43:34.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:34.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T15:43:35.022 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-25T15:43:35.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:43:35.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.023 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:43:35.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.041 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T15:43:35.112 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T15:43:35.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:43:35.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.113 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:43:35.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.170 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T15:43:35.237 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T15:43:35.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:43:35.239 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-25T15:43:35.239 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:43:35.239 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:43:35.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:43:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.347+0000 7f53b4492640 1 Processor -- start 2024-04-25T15:43:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.347+0000 7f53b4492640 1 -- start start 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b4492640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53ac0d1090 0x7f53ac06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b4492640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53ac06db10 0x7f53ac0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b4492640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac06df20 con 0x7f53ac0afc60 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b4492640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f53ac070470 con 0x7f53ac06db10 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b4492640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f53ac0ae960 con 0x7f53ac0d1090 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53ac06db10 0x7f53ac0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53ac06db10 0x7f53ac0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59504/0 (socket says 172.21.15.80:59504) 2024-04-25T15:43:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 -- 172.21.15.80:0/1110031408 learned_addr learned my addr 172.21.15.80:0/1110031408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b222e640 1 --2- 172.21.15.80:0/1110031408 >> v2:172.21.15.195:3300/0 conn(0x7f53ac0d1090 0x7f53ac06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 -- 172.21.15.80:0/1110031408 >> v2:172.21.15.195:3300/0 conn(0x7f53ac0d1090 msgr2=0x7f53ac06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 --2- 172.21.15.80:0/1110031408 >> v2:172.21.15.195:3300/0 conn(0x7f53ac0d1090 0x7f53ac06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 -- 172.21.15.80:0/1110031408 >> v1:172.21.15.195:6789/0 conn(0x7f53ac0afc60 legacy=0x7f53ac15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.349+0000 7f53b1a2d640 1 -- 172.21.15.80:0/1110031408 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac0aec40 con 0x7f53ac06db10 2024-04-25T15:43:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.350+0000 7f53b1a2d640 1 --2- 172.21.15.80:0/1110031408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac0af720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f539c009870 tx=0x7f539c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e47aeb26f1f3e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.350+0000 7f53b122c640 1 -- 172.21.15.80:0/1110031408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c037070 con 0x7f53ac06db10 2024-04-25T15:43:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.350+0000 7f53b122c640 1 -- 172.21.15.80:0/1110031408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c032440 con 0x7f53ac06db10 2024-04-25T15:43:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.350+0000 7f53b122c640 1 -- 172.21.15.80:0/1110031408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c032810 con 0x7f53ac06db10 2024-04-25T15:43:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 -- 172.21.15.80:0/1110031408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 msgr2=0x7f53ac0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 --2- 172.21.15.80:0/1110031408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac0af720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f539c009870 tx=0x7f539c02a210 comp rx=0 tx=0).stop 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 -- 172.21.15.80:0/1110031408 shutdown_connections 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 --2- 172.21.15.80:0/1110031408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac0af720 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 --2- 172.21.15.80:0/1110031408 >> v2:172.21.15.195:3300/0 conn(0x7f53ac0d1090 0x7f53ac06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 -- 172.21.15.80:0/1110031408 >> 172.21.15.80:0/1110031408 conn(0x7f53ac0d1e20 msgr2=0x7f53ac073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 -- 172.21.15.80:0/1110031408 shutdown_connections 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.351+0000 7f53b4492640 1 -- 172.21.15.80:0/1110031408 wait complete. 2024-04-25T15:43:35.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.353+0000 7f53b4492640 1 Processor -- start 2024-04-25T15:43:35.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.353+0000 7f53b4492640 1 -- start start 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b4492640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac1f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b4492640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53ac0afc60 0x7f53ac15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b4492640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53ac0d1090 0x7f53ac1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b4492640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac0b0070 con 0x7f53ac06db10 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b4492640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac0af200 con 0x7f53ac0d1090 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b4492640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac0b01f0 con 0x7f53ac0afc60 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac1f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac1f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59520/0 (socket says 172.21.15.80:59520) 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 -- 172.21.15.80:0/905444437 learned_addr learned my addr 172.21.15.80:0/905444437 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b1a2d640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53ac0afc60 0x7f53ac15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b2a2f640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53ac0d1090 0x7f53ac1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 -- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53ac0afc60 msgr2=0x7f53ac15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53ac0afc60 0x7f53ac15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 -- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53ac0d1090 msgr2=0x7f53ac1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53ac0d1090 0x7f53ac1432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 -- 172.21.15.80:0/905444437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac140700 con 0x7f53ac06db10 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b1a2d640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53ac0afc60 0x7f53ac15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b2a2f640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53ac0d1090 0x7f53ac1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.354+0000 7f53b222e640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac1f4630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009cd0 tx=0x7f53a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.355+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8018020 con 0x7f53ac06db10 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.355+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a8014480 con 0x7f53ac06db10 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.355+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac142220 con 0x7f53ac06db10 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.355+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8014850 con 0x7f53ac06db10 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.355+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac1427e0 con 0x7f53ac06db10 2024-04-25T15:43:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.356+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac06a100 con 0x7f53ac06db10 2024-04-25T15:43:35.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.356+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f53a801b020 con 0x7f53ac06db10 2024-04-25T15:43:35.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.357+0000 7f53a2ffd640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53900744b0 0x7f53900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:35.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.357+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f53a8096390 con 0x7f53ac06db10 2024-04-25T15:43:35.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.357+0000 7f53b1a2d640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53900744b0 0x7f53900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.357+0000 7f53b1a2d640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53900744b0 0x7f53900769c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f539c034000 tx=0x7f539c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:35.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.361+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53a8022020 con 0x7f53ac06db10 2024-04-25T15:43:35.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.575+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f53ac074510 con 0x7f53ac06db10 2024-04-25T15:43:35.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.575+0000 7f53a2ffd640 1 -- 172.21.15.80:0/905444437 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f53a8010040 con 0x7f53ac06db10 2024-04-25T15:43:35.576 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53900744b0 msgr2=0x7f53900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53900744b0 0x7f53900769c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f539c034000 tx=0x7f539c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 msgr2=0x7f53ac1f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac1f4630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009cd0 tx=0x7f53a800c490 comp rx=0 tx=0).stop 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 shutdown_connections 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f53900744b0 0x7f53900769c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53ac0d1090 0x7f53ac1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53ac0afc60 0x7f53ac15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 --2- 172.21.15.80:0/905444437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac06db10 0x7f53ac1f4630 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 >> 172.21.15.80:0/905444437 conn(0x7f53ac0d1e20 msgr2=0x7f53ac0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.577+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 shutdown_connections 2024-04-25T15:43:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35.578+0000 7f53b4492640 1 -- 172.21.15.80:0/905444437 wait complete. 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:43:35.589 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:43:35.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.589 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:43:35.604 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:35.604 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:35.604 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:35.604 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:35.604 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:43:35.605 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:35.606 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:43:35.606 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:35.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:35.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.738 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:43:35.760 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:43:35.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.761 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:43:35.817 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:43:35.817 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:43:35.817 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:43:35.817 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:43:35.817 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:43:35.818 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:35.818 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:35.818 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:43:35.818 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:43:35.818 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:43:35.818 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:35.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.940 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:43:35.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:35.955 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-25T15:43:36.010 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:36.010 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:36.010 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:43:36.010 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T15:43:36.010 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:36.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:36.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.126 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T15:43:36.126 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.235 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:36.235 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:36.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:43:36.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:43:36.235 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:36.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:36.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:36.309 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:43:36.323 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:43:36.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:36.323 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:43:36.379 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:43:36.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:36.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:36.470 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:36.470 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:36.572 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:36.572 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:36.573 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:43:36.573 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:43:36.573 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:43:36.573 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:43:36.574 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:43:36.574 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:43:36.574 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:43:36.574 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:43:36.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:43:36.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:36.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:43:36.599 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:36.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:36.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.695 INFO:teuthology.orchestra.run.smithi080.stdout:client4574 2024-04-25T15:43:36.695 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:36.695 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:36.710 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:36.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:36.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.805 INFO:teuthology.orchestra.run.smithi080.stdout:client4574 2024-04-25T15:43:36.806 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:36.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.861 INFO:teuthology.orchestra.run.smithi080.stdout:client4574 2024-04-25T15:43:36.861 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e35f5388-3109-4b08-854a-9a0b33367f12.client4574/status') 2024-04-25T15:43:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:36.918 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4574 (3)172.21.15.80:0/2333144391 2024-04-25T15:43:36.918 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-04-25T15:43:36.918 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-04-25T15:43:36.918 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-04-25T15:43:36.918 INFO:teuthology.orchestra.run.smithi080.stderr:70 bytes copied, 2.1992e-05 s, 3.2 MB/s 2024-04-25T15:43:36.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:36.926 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-25T15:43:36.926 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:43:36.926 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T15:43:36.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:43:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.034+0000 7fc607f46640 1 Processor -- start 2024-04-25T15:43:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.035+0000 7fc607f46640 1 -- start start 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc607f46640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc600071950 0x7fc600072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc607f46640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc600161c80 0x7fc6000b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc607f46640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6001624d0 con 0x7fc6000b74c0 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc607f46640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc600072aa0 con 0x7fc600071950 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc607f46640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc6001627b0 con 0x7fc600161c80 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc605ce2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc600071950 0x7fc600072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc605ce2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc600071950 0x7fc600072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59534/0 (socket says 172.21.15.80:59534) 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc605ce2640 1 -- 172.21.15.80:0/2525494107 learned_addr learned my addr 172.21.15.80:0/2525494107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.036+0000 7fc6054e1640 1 --2- 172.21.15.80:0/2525494107 >> v2:172.21.15.195:3300/0 conn(0x7fc600161c80 0x7fc6000b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc605ce2640 1 -- 172.21.15.80:0/2525494107 >> v2:172.21.15.195:3300/0 conn(0x7fc600161c80 msgr2=0x7fc6000b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc605ce2640 1 --2- 172.21.15.80:0/2525494107 >> v2:172.21.15.195:3300/0 conn(0x7fc600161c80 0x7fc6000b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc605ce2640 1 -- 172.21.15.80:0/2525494107 >> v1:172.21.15.195:6789/0 conn(0x7fc6000b74c0 legacy=0x7fc6000d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:37.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc605ce2640 1 -- 172.21.15.80:0/2525494107 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc600162a90 con 0x7fc600071950 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc605ce2640 1 --2- 172.21.15.80:0/2525494107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600072560 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc600162d70 tx=0x7fc5fc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e9e16d4df99f17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc604ce0640 1 -- 172.21.15.80:0/2525494107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc036070 con 0x7fc600071950 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc604ce0640 1 -- 172.21.15.80:0/2525494107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc031600 con 0x7fc600071950 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.037+0000 7fc604ce0640 1 -- 172.21.15.80:0/2525494107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0319d0 con 0x7fc600071950 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 -- 172.21.15.80:0/2525494107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 msgr2=0x7fc600072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 --2- 172.21.15.80:0/2525494107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600072560 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc600162d70 tx=0x7fc5fc02a660 comp rx=0 tx=0).stop 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 -- 172.21.15.80:0/2525494107 shutdown_connections 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 --2- 172.21.15.80:0/2525494107 >> v2:172.21.15.195:3300/0 conn(0x7fc600161c80 0x7fc6000b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 --2- 172.21.15.80:0/2525494107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600072560 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 -- 172.21.15.80:0/2525494107 >> 172.21.15.80:0/2525494107 conn(0x7fc6000d3ea0 msgr2=0x7fc6000d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:37.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 -- 172.21.15.80:0/2525494107 shutdown_connections 2024-04-25T15:43:37.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.038+0000 7fc607f46640 1 -- 172.21.15.80:0/2525494107 wait complete. 2024-04-25T15:43:37.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.040+0000 7fc607f46640 1 Processor -- start 2024-04-25T15:43:37.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.040+0000 7fc607f46640 1 -- start start 2024-04-25T15:43:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc607f46640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc607f46640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6000b74c0 0x7fc6000cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc607f46640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600161c80 0x7fc6000cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc607f46640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc600162210 con 0x7fc600071950 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc607f46640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc600162090 con 0x7fc600161c80 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc607f46640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6000d31a0 con 0x7fc6000b74c0 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc605ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc605ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59540/0 (socket says 172.21.15.80:59540) 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.041+0000 7fc605ce2640 1 -- 172.21.15.80:0/4102084776 learned_addr learned my addr 172.21.15.80:0/4102084776 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc6064e3640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600161c80 0x7fc6000cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc6054e1640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6000b74c0 0x7fc6000cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc605ce2640 1 -- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6000b74c0 msgr2=0x7fc6000cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc605ce2640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6000b74c0 0x7fc6000cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc605ce2640 1 -- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600161c80 msgr2=0x7fc6000cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc605ce2640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600161c80 0x7fc6000cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc605ce2640 1 -- 172.21.15.80:0/4102084776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60015bf40 con 0x7fc600071950 2024-04-25T15:43:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc6064e3640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600161c80 0x7fc6000cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc605ce2640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600156aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009f40 tx=0x7fc5fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc036050 con 0x7fc600071950 2024-04-25T15:43:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc042070 con 0x7fc600071950 2024-04-25T15:43:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60015c220 con 0x7fc600071950 2024-04-25T15:43:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc009510 con 0x7fc600071950 2024-04-25T15:43:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.042+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60015c7e0 con 0x7fc600071950 2024-04-25T15:43:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.043+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6000b3610 con 0x7fc600071950 2024-04-25T15:43:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.044+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc5fc007c50 con 0x7fc600071950 2024-04-25T15:43:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.044+0000 7fc5f67fc640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5e40744b0 0x7fc5e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.044+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5fc0b64d0 con 0x7fc600071950 2024-04-25T15:43:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.044+0000 7fc6054e1640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5e40744b0 0x7fc5e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.045+0000 7fc6054e1640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5e40744b0 0x7fc5e40769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6000cd500 tx=0x7fc5f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:37.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.049+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6000b3610 con 0x7fc600071950 2024-04-25T15:43:37.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.264+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc60006a100 con 0x7fc600071950 2024-04-25T15:43:37.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.264+0000 7fc5f67fc640 1 -- 172.21.15.80:0/4102084776 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc5fc080920 con 0x7fc600071950 2024-04-25T15:43:37.264 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T15:43:37.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5e40744b0 msgr2=0x7fc5e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5e40744b0 0x7fc5e40769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6000cd500 tx=0x7fc5f0008040 comp rx=0 tx=0).stop 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 msgr2=0x7fc600156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600156aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009f40 tx=0x7fc5fc004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 shutdown_connections 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5e40744b0 0x7fc5e40769c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc600161c80 0x7fc6000cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6000b74c0 0x7fc6000cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 --2- 172.21.15.80:0/4102084776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc600071950 0x7fc600156aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 >> 172.21.15.80:0/4102084776 conn(0x7fc6000d3ea0 msgr2=0x7fc6000b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 shutdown_connections 2024-04-25T15:43:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37.266+0000 7fc607f46640 1 -- 172.21.15.80:0/4102084776 wait complete. 2024-04-25T15:43:37.277 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:43:37.278 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T15:43:37.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.278 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:43:37.293 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:37.293 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:37.293 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:37.294 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link tentative 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.296 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:43:37.355 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:43:37.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.357 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:43:37.412 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:43:37.412 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:43:37.412 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:43:37.412 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:43:37.412 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:43:37.412 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:37.412 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:37.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:43:37.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:43:37.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:43:37.413 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:37.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:37.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.534 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:43:37.549 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:43:37.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.549 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-25T15:43:37.604 INFO:teuthology.orchestra.run.smithi080.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T15:43:37.605 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:37.605 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:37.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:43:37.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T15:43:37.605 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:37.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:37.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:37.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 7a:d8:c3:38:e1:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T15:43:37.742 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::78d8:c3ff:fe38:e1f4/64 scope link 2024-04-25T15:43:37.743 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:37.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 7a:d8:c3:38:e1:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::78d8:c3ff:fe38:e1f4/64 scope link 2024-04-25T15:43:37.807 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:37.808 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T15:43:37.808 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T15:43:37.809 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:37.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:37.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:37.956 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:37.956 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:43:37.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.1 up 2024-04-25T15:43:37.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T15:43:37.956 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:43:38.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:38.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:38.030 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T15:43:38.044 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T15:43:38.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:38.045 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T15:43:38.099 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-25T15:43:38.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:38.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:38.190 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:38.191 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 2@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:43:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:43:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:43:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:43:38.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:43:38.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:38.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T15:43:38.224 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:38.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:38.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:38.318 INFO:teuthology.orchestra.run.smithi080.stdout:client4580 2024-04-25T15:43:38.319 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:38.319 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:38.334 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:38.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:38.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:38.429 INFO:teuthology.orchestra.run.smithi080.stdout:client4580 2024-04-25T15:43:38.430 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:38.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:38.484 INFO:teuthology.orchestra.run.smithi080.stdout:client4580 2024-04-25T15:43:38.485 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e35f5388-3109-4b08-854a-9a0b33367f12.client4580/status') 2024-04-25T15:43:38.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:38.541 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4580 (3)172.21.15.80:0/1492144700 2024-04-25T15:43:38.541 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-04-25T15:43:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-04-25T15:43:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-04-25T15:43:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:70 bytes copied, 2.5428e-05 s, 2.8 MB/s 2024-04-25T15:43:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:38.548 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-25T15:43:38.548 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:43:38.548 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:43:38.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:43:38.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.655+0000 7f02bf5a8640 1 Processor -- start 2024-04-25T15:43:38.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.656+0000 7f02bf5a8640 1 -- start start 2024-04-25T15:43:38.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bf5a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02b809bea0 0x7f02b80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bf5a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80d2830 0x7f02b80d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bf5a8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f02b80cf320 0x7f02b80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bf5a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f02b806cc40 con 0x7f02b809bea0 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bf5a8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f02b806c660 con 0x7f02b80cf320 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bf5a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02b80d3180 con 0x7f02b80d2830 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02b809bea0 0x7f02b80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02b809bea0 0x7f02b80ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59544/0 (socket says 172.21.15.80:59544) 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 -- 172.21.15.80:0/2948088763 learned_addr learned my addr 172.21.15.80:0/2948088763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bcb43640 1 --2- 172.21.15.80:0/2948088763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80d2830 0x7f02b80d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bdb45640 1 --2- 172.21.15.80:0/2948088763 >> v2:172.21.15.195:3300/0 conn(0x7f02b80cf320 0x7f02b80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 -- 172.21.15.80:0/2948088763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80d2830 msgr2=0x7f02b80d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 --2- 172.21.15.80:0/2948088763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80d2830 0x7f02b80d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 -- 172.21.15.80:0/2948088763 >> v2:172.21.15.195:3300/0 conn(0x7f02b80cf320 msgr2=0x7f02b80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 --2- 172.21.15.80:0/2948088763 >> v2:172.21.15.195:3300/0 conn(0x7f02b80cf320 0x7f02b80cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.657+0000 7f02bd344640 1 -- 172.21.15.80:0/2948088763 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b80ced60 con 0x7f02b809bea0 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.658+0000 7f02bd344640 1 --2- 172.21.15.80:0/2948088763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b809bea0 0x7f02b80ce380 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f02b80d33f0 tx=0x7f02b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96d51a4ea64ca45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.658+0000 7f02affff640 1 -- 172.21.15.80:0/2948088763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4036070 con 0x7f02b809bea0 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.658+0000 7f02affff640 1 -- 172.21.15.80:0/2948088763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4031600 con 0x7f02b809bea0 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.658+0000 7f02affff640 1 -- 172.21.15.80:0/2948088763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40319d0 con 0x7f02b809bea0 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 -- 172.21.15.80:0/2948088763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b809bea0 msgr2=0x7f02b80ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/2948088763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b809bea0 0x7f02b80ce380 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f02b80d33f0 tx=0x7f02b402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 -- 172.21.15.80:0/2948088763 shutdown_connections 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/2948088763 >> v2:172.21.15.195:3300/0 conn(0x7f02b80cf320 0x7f02b80cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/2948088763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80d2830 0x7f02b80d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/2948088763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b809bea0 0x7f02b80ce380 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 -- 172.21.15.80:0/2948088763 >> 172.21.15.80:0/2948088763 conn(0x7f02b80b7620 msgr2=0x7f02b80b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 -- 172.21.15.80:0/2948088763 shutdown_connections 2024-04-25T15:43:38.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.659+0000 7f02bf5a8640 1 -- 172.21.15.80:0/2948088763 wait complete. 2024-04-25T15:43:38.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.661+0000 7f02bf5a8640 1 Processor -- start 2024-04-25T15:43:38.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.661+0000 7f02bf5a8640 1 -- start start 2024-04-25T15:43:38.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bf5a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b809bea0 0x7f02b8159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bf5a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80cf320 0x7f02b81554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bf5a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 0x7f02b8071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bf5a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80cf040 con 0x7f02b80d2830 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bf5a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f02b815e420 con 0x7f02b809bea0 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bf5a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02b80ce8c0 con 0x7f02b80cf320 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 0x7f02b8071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 0x7f02b8071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59552/0 (socket says 172.21.15.80:59552) 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 -- 172.21.15.80:0/723561756 learned_addr learned my addr 172.21.15.80:0/723561756 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bd344640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b809bea0 0x7f02b8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bcb43640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80cf320 0x7f02b81554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 -- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80cf320 msgr2=0x7f02b81554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80cf320 0x7f02b81554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 -- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b809bea0 msgr2=0x7f02b8159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b809bea0 0x7f02b8159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.662+0000 7f02bdb45640 1 -- 172.21.15.80:0/723561756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b80c86c0 con 0x7f02b80d2830 2024-04-25T15:43:38.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.663+0000 7f02bdb45640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 0x7f02b8071620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f02b000e7c0 tx=0x7f02b000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:38.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.663+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0017070 con 0x7f02b80d2830 2024-04-25T15:43:38.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.663+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b000c730 con 0x7f02b80d2830 2024-04-25T15:43:38.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.663+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b000cb40 con 0x7f02b80d2830 2024-04-25T15:43:38.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.663+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b80c89a0 con 0x7f02b80d2830 2024-04-25T15:43:38.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.663+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b80c8f60 con 0x7f02b80d2830 2024-04-25T15:43:38.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.664+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b806a100 con 0x7f02b80d2830 2024-04-25T15:43:38.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.665+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f02b001a070 con 0x7f02b80d2830 2024-04-25T15:43:38.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.665+0000 7f02adffb640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f029c0744b0 0x7f029c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:38.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.665+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02b0095310 con 0x7f02b80d2830 2024-04-25T15:43:38.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.665+0000 7f02bd344640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f029c0744b0 0x7f029c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:38.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.666+0000 7f02bd344640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f029c0744b0 0x7f029c0769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02b4033000 tx=0x7f02b4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:38.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.670+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02b005f760 con 0x7f02b80d2830 2024-04-25T15:43:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.880+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02b806e130 con 0x7f02b80d2830 2024-04-25T15:43:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.881+0000 7f02adffb640 1 -- 172.21.15.80:0/723561756 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f02b005f060 con 0x7f02b80d2830 2024-04-25T15:43:38.881 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f029c0744b0 msgr2=0x7f029c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f029c0744b0 0x7f029c0769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02b4033000 tx=0x7f02b4009000 comp rx=0 tx=0).stop 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 msgr2=0x7f02b8071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 0x7f02b8071620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f02b000e7c0 tx=0x7f02b000ec80 comp rx=0 tx=0).stop 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 shutdown_connections 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f029c0744b0 0x7f029c0769c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b80d2830 0x7f02b8071620 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b80cf320 0x7f02b81554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 --2- 172.21.15.80:0/723561756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b809bea0 0x7f02b8159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 >> 172.21.15.80:0/723561756 conn(0x7f02b80b7620 msgr2=0x7f02b806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 shutdown_connections 2024-04-25T15:43:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:38.883+0000 7f02bf5a8640 1 -- 172.21.15.80:0/723561756 wait complete. 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:43:38.894 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:43:38.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:38.895 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:38.913 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42716sec preferred_lft 42716sec 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:43:38.914 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:38.914 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:43:38.915 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:39.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:39.100 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:39.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:39.108 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:43:39.131 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:43:39.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:39.132 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:43:39.201 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:43:39.201 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:43:39.201 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:43:39.201 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:43:39.202 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:43:39.202 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:39.202 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:39.202 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:43:39.202 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:43:39.202 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:43:39.202 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:39.289 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:39.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:39.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:39.454 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:43:39.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:39.470 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-25T15:43:39.526 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:39.526 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:39.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:43:39.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T15:43:39.527 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:39.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:39.636 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:39.642 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T15:43:39.643 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:39.643 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:39.643 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T15:43:39.643 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:43:39.643 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T15:43:39.643 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T15:43:39.644 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T15:43:39.644 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:39.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:39.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:39.769 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:39.769 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:39.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:43:39.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:43:39.769 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:39.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:39.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:39.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:39.844 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:43:39.859 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:43:39.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:39.859 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:43:39.914 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:43:39.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:39.914 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:40.010 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:40.010 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:43:40.112 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:43:40.113 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:43:40.113 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:43:40.113 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:43:40.114 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:43:40.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:40.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:43:40.137 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:40.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:40.226 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:client4771 2024-04-25T15:43:40.232 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:40.232 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:40.247 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:40.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:40.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:40.343 INFO:teuthology.orchestra.run.smithi195.stdout:client4771 2024-04-25T15:43:40.343 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:40.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:40.393 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:40.398 INFO:teuthology.orchestra.run.smithi195.stdout:client4771 2024-04-25T15:43:40.398 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e35f5388-3109-4b08-854a-9a0b33367f12.client4771/status') 2024-04-25T15:43:40.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:40.457 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.4771 (3)192.168.0.1:0/2314495742 2024-04-25T15:43:40.457 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-04-25T15:43:40.457 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-04-25T15:43:40.457 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-04-25T15:43:40.457 INFO:teuthology.orchestra.run.smithi195.stderr:69 bytes copied, 3.8332e-05 s, 1.8 MB/s 2024-04-25T15:43:40.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:40.464 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-25T15:43:40.464 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:43:40.464 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T15:43:40.464 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:43:40.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.582+0000 7fcf4eb0d640 1 Processor -- start 2024-04-25T15:43:40.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.582+0000 7fcf4eb0d640 1 -- start start 2024-04-25T15:43:40.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4eb0d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcf480ce220 0x7fcf4809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:40.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4eb0d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf480cfd70 0x7fcf480d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:40.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4eb0d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf481607c0 con 0x7fcf480cf960 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4eb0d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcf480cf4d0 con 0x7fcf480cfd70 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4eb0d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcf480ce630 con 0x7fcf480ce220 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4d0aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf480cfd70 0x7fcf480d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf47fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcf480cf960 0x7fcf480b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43996/0 (socket says 172.21.15.80:43996) 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf47fff640 1 -- 172.21.15.80:0/1305316001 learned_addr learned my addr 172.21.15.80:0/1305316001 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4d0aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf480cfd70 0x7fcf480d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59554/0 (socket says 172.21.15.80:59554) 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4c8a9640 1 --2- 172.21.15.80:0/1305316001 >> v2:172.21.15.195:3300/0 conn(0x7fcf480ce220 0x7fcf4809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4d0aa640 1 -- 172.21.15.80:0/1305316001 >> v2:172.21.15.195:3300/0 conn(0x7fcf480ce220 msgr2=0x7fcf4809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4d0aa640 1 --2- 172.21.15.80:0/1305316001 >> v2:172.21.15.195:3300/0 conn(0x7fcf480ce220 0x7fcf4809bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4d0aa640 1 -- 172.21.15.80:0/1305316001 >> v1:172.21.15.80:6789/0 conn(0x7fcf480cf960 legacy=0x7fcf480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4d0aa640 1 -- 172.21.15.80:0/1305316001 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf480d0180 con 0x7fcf480cfd70 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf477fe640 1 -- 172.21.15.80:0/1305316001 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038737915 0 0) 0x7fcf481607c0 con 0x7fcf480cf960 2024-04-25T15:43:40.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.584+0000 7fcf4c8a9640 1 --2- 172.21.15.80:0/1305316001 >> v2:172.21.15.195:3300/0 conn(0x7fcf480ce220 0x7fcf4809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.585+0000 7fcf4d0aa640 1 --2- 172.21.15.80:0/1305316001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480cfd70 0x7fcf480d1a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf480d3840 tx=0x7fcf4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8541235cda2b678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.585+0000 7fcf477fe640 1 -- 172.21.15.80:0/1305316001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40007740 con 0x7fcf480cfd70 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.585+0000 7fcf477fe640 1 -- 172.21.15.80:0/1305316001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf400078e0 con 0x7fcf480cfd70 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.585+0000 7fcf477fe640 1 -- 172.21.15.80:0/1305316001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40007cb0 con 0x7fcf480cfd70 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/1305316001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480cfd70 msgr2=0x7fcf480d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/1305316001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480cfd70 0x7fcf480d1a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf480d3840 tx=0x7fcf4002a710 comp rx=0 tx=0).stop 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/1305316001 shutdown_connections 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/1305316001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480cfd70 0x7fcf480d1a70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/1305316001 >> v2:172.21.15.195:3300/0 conn(0x7fcf480ce220 0x7fcf4809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/1305316001 >> 172.21.15.80:0/1305316001 conn(0x7fcf480b7620 msgr2=0x7fcf480b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/1305316001 shutdown_connections 2024-04-25T15:43:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.586+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/1305316001 wait complete. 2024-04-25T15:43:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.588+0000 7fcf4eb0d640 1 Processor -- start 2024-04-25T15:43:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.588+0000 7fcf4eb0d640 1 -- start start 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4eb0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 0x7fcf481595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4eb0d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf480cf960 0x7fcf480c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4eb0d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf480cfd70 0x7fcf480c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4eb0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcf480cf160 con 0x7fcf480ce220 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4eb0d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcf480cee80 con 0x7fcf480cf960 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4eb0d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4809c0b0 con 0x7fcf480cfd70 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 0x7fcf481595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 0x7fcf481595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59560/0 (socket says 172.21.15.80:59560) 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 -- 172.21.15.80:0/438878239 learned_addr learned my addr 172.21.15.80:0/438878239 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf47fff640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf480cf960 0x7fcf480c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4d0aa640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf480cfd70 0x7fcf480c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 -- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf480cfd70 msgr2=0x7fcf480c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf480cfd70 0x7fcf480c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 -- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf480cf960 msgr2=0x7fcf480c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf480cf960 0x7fcf480c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4c8a9640 1 -- 172.21.15.80:0/438878239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf48163160 con 0x7fcf480ce220 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf47fff640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf480cf960 0x7fcf480c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.589+0000 7fcf4d0aa640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf480cfd70 0x7fcf480c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.590+0000 7fcf4c8a9640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 0x7fcf481595d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800d800 tx=0x7fcf3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.590+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38004030 con 0x7fcf480ce220 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.590+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf380041d0 con 0x7fcf480ce220 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.590+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf48163440 con 0x7fcf480ce220 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.590+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380096a0 con 0x7fcf480ce220 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.590+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf48160b40 con 0x7fcf480ce220 2024-04-25T15:43:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.591+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4806a100 con 0x7fcf480ce220 2024-04-25T15:43:40.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.592+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcf38009840 con 0x7fcf480ce220 2024-04-25T15:43:40.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.592+0000 7fcf457fa640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf340744b0 0x7fcf340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:40.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.592+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcf38095870 con 0x7fcf480ce220 2024-04-25T15:43:40.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.592+0000 7fcf47fff640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf340744b0 0x7fcf340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:40.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.593+0000 7fcf47fff640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf340744b0 0x7fcf340769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf480c7910 tx=0x7fcf3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:40.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.597+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf3805fcc0 con 0x7fcf480ce220 2024-04-25T15:43:40.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.809+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcf480b50d0 con 0x7fcf480ce220 2024-04-25T15:43:40.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.810+0000 7fcf457fa640 1 -- 172.21.15.80:0/438878239 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fcf3805f5c0 con 0x7fcf480ce220 2024-04-25T15:43:40.810 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf340744b0 msgr2=0x7fcf340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf340744b0 0x7fcf340769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf480c7910 tx=0x7fcf3c009040 comp rx=0 tx=0).stop 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 msgr2=0x7fcf481595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 0x7fcf481595d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800d800 tx=0x7fcf3800dcc0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 shutdown_connections 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf340744b0 0x7fcf340769c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf480cfd70 0x7fcf480c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf480cf960 0x7fcf480c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 --2- 172.21.15.80:0/438878239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf480ce220 0x7fcf481595d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:40.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 >> 172.21.15.80:0/438878239 conn(0x7fcf480b7620 msgr2=0x7fcf480b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:40.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 shutdown_connections 2024-04-25T15:43:40.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:40.812+0000 7fcf4eb0d640 1 -- 172.21.15.80:0/438878239 wait complete. 2024-04-25T15:43:40.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:43:40.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:43:40.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:43:40.823 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T15:43:40.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T15:43:40.823 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:43:40.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:43:40.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:43:40.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T15:43:40.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:40.824 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:40.840 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42714sec preferred_lft 42714sec 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:43:40.841 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link tentative 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:40.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:40.842 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:43:40.902 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:43:40.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:40.904 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:43:40.961 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:43:40.961 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:43:40.961 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:43:40.961 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:43:40.961 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:43:40.961 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:40.961 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:40.961 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:43:40.961 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:43:40.961 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:43:40.962 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:41.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:41.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:41.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:41.085 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:43:41.099 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:43:41.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:41.100 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-25T15:43:41.154 INFO:teuthology.orchestra.run.smithi195.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T15:43:41.154 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:41.154 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:41.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:43:41.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T15:43:41.155 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:41.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:41.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:41.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:41.269 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T15:43:41.292 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether da:f2:01:91:07:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::d8f2:1ff:fe91:76d/64 scope link tentative 2024-04-25T15:43:41.293 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:41.295 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:43:41.358 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether da:f2:01:91:07:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T15:43:41.359 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T15:43:41.359 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.359 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::d8f2:1ff:fe91:76d/64 scope link tentative 2024-04-25T15:43:41.359 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:43:41.360 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T15:43:41.360 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:41.360 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:41.360 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T15:43:41.360 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T15:43:41.360 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T15:43:41.361 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T15:43:41.361 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T15:43:41.361 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:41.448 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:41.504 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:41.511 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:43:41.511 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:43:41.511 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.1 up 2024-04-25T15:43:41.511 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T15:43:41.511 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:43:41.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:41.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:41.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:41.585 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T15:43:41.599 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T15:43:41.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:43:41.600 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T15:43:41.654 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-25T15:43:41.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:41.654 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:41.746 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:41.747 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:41.754 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:43:41.754 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 3@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:43:41.755 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:43:41.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:43:41.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:41.757 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T15:43:41.786 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:41.875 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:41.877 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:41.883 INFO:teuthology.orchestra.run.smithi195.stdout:client4777 2024-04-25T15:43:41.883 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:41.883 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:41.898 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:41.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:41.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:41.992 INFO:teuthology.orchestra.run.smithi195.stdout:client4777 2024-04-25T15:43:41.992 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:43:42.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:43:42.042 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:42.048 INFO:teuthology.orchestra.run.smithi195.stdout:client4777 2024-04-25T15:43:42.048 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e35f5388-3109-4b08-854a-9a0b33367f12.client4777/status') 2024-04-25T15:43:42.095 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:43:42.104 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.4777 (3)192.168.0.2:0/2526789966 2024-04-25T15:43:42.104 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-04-25T15:43:42.105 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-04-25T15:43:42.105 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-04-25T15:43:42.105 INFO:teuthology.orchestra.run.smithi195.stderr:69 bytes copied, 2.1596e-05 s, 3.2 MB/s 2024-04-25T15:43:42.105 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:43:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:43:42.112 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T15:43:42.128 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.237+0000 7f238914d640 1 Processor -- start 2024-04-25T15:43:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.237+0000 7f238914d640 1 -- start start 2024-04-25T15:43:42.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.238+0000 7f238914d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f23840d41b0 0x7f23840b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.238+0000 7f238914d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 0x7f23840b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.238+0000 7f238914d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840b7fa0 con 0x7f23840b7b90 2024-04-25T15:43:42.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.238+0000 7f238914d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f23840d59d0 con 0x7f23840d41b0 2024-04-25T15:43:42.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.238+0000 7f238914d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2384163fb0 con 0x7f23841602a0 2024-04-25T15:43:42.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f237bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 0x7f23840b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f2382d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f23840d41b0 0x7f23840b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f237bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 0x7f23840b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:36776/0 (socket says 172.21.15.80:36776) 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f237bfff640 1 -- 172.21.15.80:0/415588845 learned_addr learned my addr 172.21.15.80:0/415588845 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f238359e640 1 --1- 172.21.15.80:0/415588845 >> v1:172.21.15.195:6789/0 conn(0x7f23840b7b90 0x7f23840d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:33858/0 (socket says 172.21.15.80:33858) 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f2382d9d640 1 -- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 msgr2=0x7f23840b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f2382d9d640 1 --2- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 0x7f23840b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f2382d9d640 1 -- 172.21.15.80:0/415588845 >> v1:172.21.15.195:6789/0 conn(0x7f23840b7b90 legacy=0x7f23840d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f2382d9d640 1 -- 172.21.15.80:0/415588845 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2384164270 con 0x7f23840d41b0 2024-04-25T15:43:42.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.239+0000 7f237bfff640 1 --2- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 0x7f23840b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:42.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.240+0000 7f2382d9d640 1 --2- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23840d41b0 0x7f23840b48d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f237402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb1d6750029a3cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.240+0000 7f238259c640 1 -- 172.21.15.80:0/415588845 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037070 con 0x7f23840d41b0 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.240+0000 7f238259c640 1 -- 172.21.15.80:0/415588845 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374032440 con 0x7f23840d41b0 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.240+0000 7f238259c640 1 -- 172.21.15.80:0/415588845 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374032810 con 0x7f23840d41b0 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 -- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23840d41b0 msgr2=0x7f23840b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 --2- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23840d41b0 0x7f23840b48d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f237402a180 comp rx=0 tx=0).stop 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 -- 172.21.15.80:0/415588845 shutdown_connections 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 --2- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23841602a0 0x7f23840b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 --2- 172.21.15.80:0/415588845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23840d41b0 0x7f23840b48d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 -- 172.21.15.80:0/415588845 >> 172.21.15.80:0/415588845 conn(0x7f238406e9f0 msgr2=0x7f23840d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 -- 172.21.15.80:0/415588845 shutdown_connections 2024-04-25T15:43:42.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.241+0000 7f238914d640 1 -- 172.21.15.80:0/415588845 wait complete. 2024-04-25T15:43:42.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.243+0000 7f238914d640 1 Processor -- start 2024-04-25T15:43:42.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.243+0000 7f238914d640 1 -- start start 2024-04-25T15:43:42.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238914d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 0x7f2384155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238914d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23840d41b0 0x7f23841606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238914d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23841602a0 0x7f2384160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238914d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2384164b10 con 0x7f23840b7b90 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238914d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2384164830 con 0x7f23841602a0 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238914d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f23840b4fd0 con 0x7f23840d41b0 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f2382d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 0x7f2384155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f2382d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 0x7f2384155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59570/0 (socket says 172.21.15.80:59570) 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f2382d9d640 1 -- 172.21.15.80:0/3269096804 learned_addr learned my addr 172.21.15.80:0/3269096804 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f237bfff640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23840d41b0 0x7f23841606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f238359e640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23841602a0 0x7f2384160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f2382d9d640 1 -- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23840d41b0 msgr2=0x7f23841606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.244+0000 7f2382d9d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23840d41b0 0x7f23841606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f2382d9d640 1 -- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23841602a0 msgr2=0x7f2384160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f2382d9d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23841602a0 0x7f2384160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f2382d9d640 1 -- 172.21.15.80:0/3269096804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2384155880 con 0x7f23840b7b90 2024-04-25T15:43:42.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f238359e640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23841602a0 0x7f2384160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:42.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f2382d9d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 0x7f2384155340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f23740098c0 tx=0x7f23740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037040 con 0x7f23840b7b90 2024-04-25T15:43:42.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374030500 con 0x7f23840b7b90 2024-04-25T15:43:42.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23841613c0 con 0x7f23840b7b90 2024-04-25T15:43:42.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23740308d0 con 0x7f23840b7b90 2024-04-25T15:43:42.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.245+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2384157350 con 0x7f23840b7b90 2024-04-25T15:43:42.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.246+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238406a100 con 0x7f23840b7b90 2024-04-25T15:43:42.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.247+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2374044020 con 0x7f23840b7b90 2024-04-25T15:43:42.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.247+0000 7f237b7fe640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23640744b0 0x7f23640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.247+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f23740b5880 con 0x7f23840b7b90 2024-04-25T15:43:42.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.247+0000 7f237bfff640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23640744b0 0x7f23640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.248+0000 7f237bfff640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23640744b0 0x7f23640769c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23840c8b90 tx=0x7f236c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.252+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f237407fca0 con 0x7f23840b7b90 2024-04-25T15:43:42.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.427+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f238415f360 con 0x7f23840b7b90 2024-04-25T15:43:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.429+0000 7f237b7fe640 1 -- 172.21.15.80:0/3269096804 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18834 (secure 0 0 0) 0x7f237407f5a0 con 0x7f23840b7b90 2024-04-25T15:43:42.429 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:42.429 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:41.443711+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.430+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23640744b0 msgr2=0x7f23640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.430+0000 7f238914d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23640744b0 0x7f23640769c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23840c8b90 tx=0x7f236c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.430+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 msgr2=0x7f2384155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.430+0000 7f238914d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 0x7f2384155340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f23740098c0 tx=0x7f23740046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 shutdown_connections 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23640744b0 0x7f23640769c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23841602a0 0x7f2384160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23840d41b0 0x7f23841606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 --2- 172.21.15.80:0/3269096804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23840b7b90 0x7f2384155340 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 >> 172.21.15.80:0/3269096804 conn(0x7f238406e9f0 msgr2=0x7f23840b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 shutdown_connections 2024-04-25T15:43:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.431+0000 7f238914d640 1 -- 172.21.15.80:0/3269096804 wait complete. 2024-04-25T15:43:42.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:42.443 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.557+0000 7f07c07d5640 1 Processor -- start 2024-04-25T15:43:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.557+0000 7f07c07d5640 1 -- start start 2024-04-25T15:43:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07c07d5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80d2f80 0x7f07b80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07c07d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07b806eb70 0x7f07b8166c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07c07d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b80d0290 con 0x7f07b80cfe80 2024-04-25T15:43:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07c07d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f07b806d6d0 con 0x7f07b806eb70 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07c07d5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f07b80cf9d0 con 0x7f07b80d2f80 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07bed72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07b806eb70 0x7f07b8166c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07bed72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07b806eb70 0x7f07b8166c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59572/0 (socket says 172.21.15.80:59572) 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07bed72640 1 -- 172.21.15.80:0/1721947023 learned_addr learned my addr 172.21.15.80:0/1721947023 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07be571640 1 --1- 172.21.15.80:0/1721947023 >> v1:172.21.15.80:6789/0 conn(0x7f07b80cfe80 0x7f07b80d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43998/0 (socket says 172.21.15.80:43998) 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.558+0000 7f07bdd70640 1 --2- 172.21.15.80:0/1721947023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80d2f80 0x7f07b80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bed72640 1 -- 172.21.15.80:0/1721947023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80d2f80 msgr2=0x7f07b80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bed72640 1 --2- 172.21.15.80:0/1721947023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80d2f80 0x7f07b80cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bed72640 1 -- 172.21.15.80:0/1721947023 >> v1:172.21.15.80:6789/0 conn(0x7f07b80cfe80 legacy=0x7f07b80d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bed72640 1 -- 172.21.15.80:0/1721947023 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b80b4770 con 0x7f07b806eb70 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bed72640 1 --2- 172.21.15.80:0/1721947023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b806eb70 0x7f07b8166c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009e50 tx=0x7f07b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd5bfe4b6ff1a35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bd56f640 1 -- 172.21.15.80:0/1721947023 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0036070 con 0x7f07b806eb70 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bd56f640 1 -- 172.21.15.80:0/1721947023 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b0031600 con 0x7f07b806eb70 2024-04-25T15:43:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.559+0000 7f07bd56f640 1 -- 172.21.15.80:0/1721947023 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b00319d0 con 0x7f07b806eb70 2024-04-25T15:43:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 -- 172.21.15.80:0/1721947023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b806eb70 msgr2=0x7f07b8166c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1721947023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b806eb70 0x7f07b8166c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009e50 tx=0x7f07b002a680 comp rx=0 tx=0).stop 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 -- 172.21.15.80:0/1721947023 shutdown_connections 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1721947023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b806eb70 0x7f07b8166c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1721947023 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80d2f80 0x7f07b80cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 -- 172.21.15.80:0/1721947023 >> 172.21.15.80:0/1721947023 conn(0x7f07b80b75f0 msgr2=0x7f07b80b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 -- 172.21.15.80:0/1721947023 shutdown_connections 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.560+0000 7f07c07d5640 1 -- 172.21.15.80:0/1721947023 wait complete. 2024-04-25T15:43:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.562+0000 7f07c07d5640 1 Processor -- start 2024-04-25T15:43:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.562+0000 7f07c07d5640 1 -- start start 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07c07d5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b806eb70 0x7f07b81f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07c07d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 0x7f07b81f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07c07d5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80c90d0 0x7f07b81e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 0x7f07b81f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 0x7f07b81f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59586/0 (socket says 172.21.15.80:59586) 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 -- 172.21.15.80:0/1252114745 learned_addr learned my addr 172.21.15.80:0/1252114745 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80d2170 con 0x7f07b80cfe80 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80b4d30 con 0x7f07b806eb70 2024-04-25T15:43:42.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f07b80d22f0 con 0x7f07b80c90d0 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07be571640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b806eb70 0x7f07b81f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bed72640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80c90d0 0x7f07b81e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 -- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80c90d0 msgr2=0x7f07b81e58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80c90d0 0x7f07b81e58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 -- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b806eb70 msgr2=0x7f07b81f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.565+0000 7f07bdd70640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b806eb70 0x7f07b81f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07bdd70640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b80c8310 con 0x7f07b80cfe80 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07bdd70640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 0x7f07b81f7a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07a800e870 tx=0x7f07a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8017070 con 0x7f07b80cfe80 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b80c85f0 con 0x7f07b80cfe80 2024-04-25T15:43:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b81e6520 con 0x7f07b80cfe80 2024-04-25T15:43:42.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a800ee60 con 0x7f07b80cfe80 2024-04-25T15:43:42.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.566+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8021060 con 0x7f07b80cfe80 2024-04-25T15:43:42.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.567+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a0005290 con 0x7f07b80cfe80 2024-04-25T15:43:42.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.568+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f07a801a070 con 0x7f07b80cfe80 2024-04-25T15:43:42.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.568+0000 7f07aeffd640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f079c0744e0 0x7f079c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.568+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f07a8095af0 con 0x7f07b80cfe80 2024-04-25T15:43:42.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.568+0000 7f07be571640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f079c0744e0 0x7f079c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.569+0000 7f07be571640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f079c0744e0 0x7f079c0769f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007fd0 tx=0x7f07b4007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.573+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f07a805f7b0 con 0x7f07b80cfe80 2024-04-25T15:43:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.747+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f07a0005850 con 0x7f07b80cfe80 2024-04-25T15:43:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.747+0000 7f07aeffd640 1 -- 172.21.15.80:0/1252114745 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f07a8063ab0 con 0x7f07b80cfe80 2024-04-25T15:43:42.747 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f079c0744e0 msgr2=0x7f079c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f079c0744e0 0x7f079c0769f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007fd0 tx=0x7f07b4007e80 comp rx=0 tx=0).stop 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 msgr2=0x7f07b81f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 0x7f07b81f7a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07a800e870 tx=0x7f07a800ed30 comp rx=0 tx=0).stop 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 shutdown_connections 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f079c0744e0 0x7f079c0769f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b80c90d0 0x7f07b81e58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80cfe80 0x7f07b81f7a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 --2- 172.21.15.80:0/1252114745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b806eb70 0x7f07b81f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 >> 172.21.15.80:0/1252114745 conn(0x7f07b80b75f0 msgr2=0x7f07b809b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 shutdown_connections 2024-04-25T15:43:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.749+0000 7f07c07d5640 1 -- 172.21.15.80:0/1252114745 wait complete. 2024-04-25T15:43:42.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:42.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.870+0000 7fa94b3c7640 1 Processor -- start 2024-04-25T15:43:42.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.870+0000 7fa94b3c7640 1 -- start start 2024-04-25T15:43:42.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa94b3c7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa94409b850 0x7fa9440ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa94b3c7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa9440ce800 0x7fa9440af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa94b3c7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9440cd220 con 0x7fa94409c0a0 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa94b3c7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa9440cd500 con 0x7fa9440ce800 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa94b3c7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa9440cd7e0 con 0x7fa94409b850 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa949964640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa9440ce800 0x7fa9440af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa949964640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa9440ce800 0x7fa9440af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59588/0 (socket says 172.21.15.80:59588) 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa949964640 1 -- 172.21.15.80:0/1847171216 learned_addr learned my addr 172.21.15.80:0/1847171216 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.871+0000 7fa948962640 1 --2- 172.21.15.80:0/1847171216 >> v2:172.21.15.195:3300/0 conn(0x7fa94409b850 0x7fa9440ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa949964640 1 -- 172.21.15.80:0/1847171216 >> v2:172.21.15.195:3300/0 conn(0x7fa94409b850 msgr2=0x7fa9440ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa949964640 1 --2- 172.21.15.80:0/1847171216 >> v2:172.21.15.195:3300/0 conn(0x7fa94409b850 0x7fa9440ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa949964640 1 -- 172.21.15.80:0/1847171216 >> v1:172.21.15.195:6789/0 conn(0x7fa94409c0a0 legacy=0x7fa944160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa949964640 1 -- 172.21.15.80:0/1847171216 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9440cdac0 con 0x7fa9440ce800 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa949964640 1 --2- 172.21.15.80:0/1847171216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440af5f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa9440727e0 tx=0x7fa93c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604bb096113f7861 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa93bfff640 1 -- 172.21.15.80:0/1847171216 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c036070 con 0x7fa9440ce800 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa93bfff640 1 -- 172.21.15.80:0/1847171216 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa93c031600 con 0x7fa9440ce800 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.872+0000 7fa93bfff640 1 -- 172.21.15.80:0/1847171216 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0319d0 con 0x7fa9440ce800 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1847171216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 msgr2=0x7fa9440af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1847171216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440af5f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa9440727e0 tx=0x7fa93c02a730 comp rx=0 tx=0).stop 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1847171216 shutdown_connections 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1847171216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440af5f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1847171216 >> v2:172.21.15.195:3300/0 conn(0x7fa94409b850 0x7fa9440ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1847171216 >> 172.21.15.80:0/1847171216 conn(0x7fa9440b75b0 msgr2=0x7fa9440b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1847171216 shutdown_connections 2024-04-25T15:43:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.873+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1847171216 wait complete. 2024-04-25T15:43:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.875+0000 7fa94b3c7640 1 Processor -- start 2024-04-25T15:43:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.875+0000 7fa94b3c7640 1 -- start start 2024-04-25T15:43:42.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa94b3c7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa94409b850 0x7fa9440cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa94b3c7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa94409c0a0 0x7fa94415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa94b3c7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa94b3c7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa9440afb30 con 0x7fa9440ce800 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa94b3c7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa9440ccef0 con 0x7fa94409b850 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa94b3c7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa9440afcb0 con 0x7fa94409c0a0 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa949964640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa949964640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59598/0 (socket says 172.21.15.80:59598) 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.876+0000 7fa949964640 1 -- 172.21.15.80:0/1965286208 learned_addr learned my addr 172.21.15.80:0/1965286208 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949163640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa94409b850 0x7fa9440cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa948962640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa94409c0a0 0x7fa94415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949964640 1 -- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa94409c0a0 msgr2=0x7fa94415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949964640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa94409c0a0 0x7fa94415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949964640 1 -- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa94409b850 msgr2=0x7fa9440cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949964640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa94409b850 0x7fa9440cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949964640 1 -- 172.21.15.80:0/1965286208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94415d300 con 0x7fa9440ce800 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949163640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa94409b850 0x7fa9440cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa949964640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440c8180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009f40 tx=0x7fa93c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c036050 con 0x7fa9440ce800 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa93c042070 con 0x7fa9440ce800 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa944163530 con 0x7fa9440ce800 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c009510 con 0x7fa9440ce800 2024-04-25T15:43:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.877+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa944160670 con 0x7fa9440ce800 2024-04-25T15:43:42.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.878+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94406a100 con 0x7fa9440ce800 2024-04-25T15:43:42.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.879+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa93c007c70 con 0x7fa9440ce800 2024-04-25T15:43:42.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.879+0000 7fa939ffb640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa9280744b0 0x7fa9280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:42.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.879+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa93c0b63c0 con 0x7fa9440ce800 2024-04-25T15:43:42.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.879+0000 7fa949163640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa9280744b0 0x7fa9280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:42.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.880+0000 7fa949163640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa9280744b0 0x7fa9280769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa940001690 tx=0x7fa940009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:42.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:42.884+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa94415d300 con 0x7fa9440ce800 2024-04-25T15:43:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.060+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa9441632c0 con 0x7fa9440ce800 2024-04-25T15:43:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.060+0000 7fa939ffb640 1 -- 172.21.15.80:0/1965286208 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fa93c080870 con 0x7fa9440ce800 2024-04-25T15:43:43.060 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa9280744b0 msgr2=0x7fa9280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa9280744b0 0x7fa9280769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa940001690 tx=0x7fa940009040 comp rx=0 tx=0).stop 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 msgr2=0x7fa9440c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440c8180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009f40 tx=0x7fa93c004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 shutdown_connections 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa9280744b0 0x7fa9280769c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9440ce800 0x7fa9440c8180 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa94409c0a0 0x7fa94415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 --2- 172.21.15.80:0/1965286208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa94409b850 0x7fa9440cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 >> 172.21.15.80:0/1965286208 conn(0x7fa9440b75b0 msgr2=0x7fa9440b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 shutdown_connections 2024-04-25T15:43:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.062+0000 7fa94b3c7640 1 -- 172.21.15.80:0/1965286208 wait complete. 2024-04-25T15:43:43.074 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:43.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.184+0000 7ff7f19c7640 1 Processor -- start 2024-04-25T15:43:43.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.184+0000 7ff7f19c7640 1 -- start start 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7f19c7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7ec0b5490 0x7ff7ec160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7f19c7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec1643f0 con 0x7ff7ec0d0b00 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7f19c7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec1646d0 con 0x7ff7ec0d2d50 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7f19c7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ec1649b0 con 0x7ff7ec0b5490 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7eaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7ec0b5490 0x7ff7ec160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7eaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7ec0b5490 0x7ff7ec160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59612/0 (socket says 172.21.15.80:59612) 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7ea7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff7ec0d0b00 0x7ff7ec0d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44008/0 (socket says 172.21.15.80:44008) 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.185+0000 7ff7eaffd640 1 -- 172.21.15.80:0/2051702013 learned_addr learned my addr 172.21.15.80:0/2051702013 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7eaffd640 1 -- 172.21.15.80:0/2051702013 >> v1:172.21.15.195:6789/0 conn(0x7ff7ec0d2d50 legacy=0x7ff7ec0d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:43.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7eaffd640 1 -- 172.21.15.80:0/2051702013 >> v1:172.21.15.80:6789/0 conn(0x7ff7ec0d0b00 legacy=0x7ff7ec0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7eaffd640 1 -- 172.21.15.80:0/2051702013 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec164c90 con 0x7ff7ec0b5490 2024-04-25T15:43:43.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7e9ffb640 1 -- 172.21.15.80:0/2051702013 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665151230 0 0) 0x7ff7ec1643f0 con 0x7ff7ec0d0b00 2024-04-25T15:43:43.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7eaffd640 1 --2- 172.21.15.80:0/2051702013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0b5490 0x7ff7ec160300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009870 tx=0x7ff7e402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cce1f524db0e6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7e9ffb640 1 -- 172.21.15.80:0/2051702013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4037070 con 0x7ff7ec0b5490 2024-04-25T15:43:43.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7e9ffb640 1 -- 172.21.15.80:0/2051702013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e4032440 con 0x7ff7ec0b5490 2024-04-25T15:43:43.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.186+0000 7ff7e9ffb640 1 -- 172.21.15.80:0/2051702013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4032810 con 0x7ff7ec0b5490 2024-04-25T15:43:43.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 -- 172.21.15.80:0/2051702013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0b5490 msgr2=0x7ff7ec160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/2051702013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0b5490 0x7ff7ec160300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009870 tx=0x7ff7e402a2a0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 -- 172.21.15.80:0/2051702013 shutdown_connections 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/2051702013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0b5490 0x7ff7ec160300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 -- 172.21.15.80:0/2051702013 >> 172.21.15.80:0/2051702013 conn(0x7ff7ec06e650 msgr2=0x7ff7ec06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 -- 172.21.15.80:0/2051702013 shutdown_connections 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.187+0000 7ff7f19c7640 1 -- 172.21.15.80:0/2051702013 wait complete. 2024-04-25T15:43:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.189+0000 7ff7f19c7640 1 Processor -- start 2024-04-25T15:43:43.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.189+0000 7ff7f19c7640 1 -- start start 2024-04-25T15:43:43.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7f19c7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7ec0d0b00 0x7ff7ec0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7f19c7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec0d2d50 0x7ff7ec0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7f19c7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 0x7ff7ec0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7f19c7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0b94e0 con 0x7ff7ec0adab0 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7f19c7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0b9360 con 0x7ff7ec0d2d50 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7f19c7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec163f80 con 0x7ff7ec0d0b00 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.190+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 0x7ff7ec0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 0x7ff7ec0cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59628/0 (socket says 172.21.15.80:59628) 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 -- 172.21.15.80:0/3920141057 learned_addr learned my addr 172.21.15.80:0/3920141057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7ea7fc640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec0d2d50 0x7ff7ec0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eaffd640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7ec0d0b00 0x7ff7ec0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 -- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7ec0d0b00 msgr2=0x7ff7ec0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7ec0d0b00 0x7ff7ec0ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 -- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec0d2d50 msgr2=0x7ff7ec0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec0d2d50 0x7ff7ec0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 -- 172.21.15.80:0/3920141057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec0aca10 con 0x7ff7ec0adab0 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7eb7fe640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 0x7ff7ec0cb260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ba10 tx=0x7ff7dc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc019070 con 0x7ff7ec0adab0 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc00cb40 con 0x7ff7ec0adab0 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec0accf0 con 0x7ff7ec0adab0 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc014440 con 0x7ff7ec0adab0 2024-04-25T15:43:43.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.191+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec0ad2b0 con 0x7ff7ec0adab0 2024-04-25T15:43:43.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.192+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec06a100 con 0x7ff7ec0adab0 2024-04-25T15:43:43.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.193+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff7dc01c070 con 0x7ff7ec0adab0 2024-04-25T15:43:43.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.193+0000 7ff7d3fff640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7d80744b0 0x7ff7d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.193+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff7dc095180 con 0x7ff7ec0adab0 2024-04-25T15:43:43.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.193+0000 7ff7eaffd640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7d80744b0 0x7ff7d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.194+0000 7ff7eaffd640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7d80744b0 0x7ff7d80769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4034000 tx=0x7ff7e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.198+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7dc05f5a0 con 0x7ff7ec0adab0 2024-04-25T15:43:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.374+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff7ec0d41d0 con 0x7ff7ec0adab0 2024-04-25T15:43:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.374+0000 7ff7d3fff640 1 -- 172.21.15.80:0/3920141057 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff7dc05eea0 con 0x7ff7ec0adab0 2024-04-25T15:43:43.375 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.376+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7d80744b0 msgr2=0x7ff7d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7d80744b0 0x7ff7d80769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4034000 tx=0x7ff7e402e000 comp rx=0 tx=0).stop 2024-04-25T15:43:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 msgr2=0x7ff7ec0cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 0x7ff7ec0cb260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ba10 tx=0x7ff7dc00bed0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 shutdown_connections 2024-04-25T15:43:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7d80744b0 0x7ff7d80769c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7ec0adab0 0x7ff7ec0cb260 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec0d2d50 0x7ff7ec0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 --2- 172.21.15.80:0/3920141057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7ec0d0b00 0x7ff7ec0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 >> 172.21.15.80:0/3920141057 conn(0x7ff7ec06e650 msgr2=0x7ff7ec162b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 shutdown_connections 2024-04-25T15:43:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.377+0000 7ff7f19c7640 1 -- 172.21.15.80:0/3920141057 wait complete. 2024-04-25T15:43:43.388 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:43.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.498+0000 7f2f9e66e640 1 Processor -- start 2024-04-25T15:43:43.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.498+0000 7f2f9e66e640 1 -- start start 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.499+0000 7f2f9e66e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f980d2190 0x7f2f9809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.499+0000 7f2f9e66e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f98160760 con 0x7f2f9809b410 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.499+0000 7f2f9e66e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f980b3410 con 0x7f2f980d3110 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.499+0000 7f2f9e66e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9809b920 con 0x7f2f980d2190 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.499+0000 7f2f9cc0b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f980d2190 0x7f2f9809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f9cc0b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f980d2190 0x7f2f9809bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59632/0 (socket says 172.21.15.80:59632) 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f9cc0b640 1 -- 172.21.15.80:0/1042507525 learned_addr learned my addr 172.21.15.80:0/1042507525 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:43.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f97fff640 1 --1- 172.21.15.80:0/1042507525 >> v1:172.21.15.80:6789/0 conn(0x7f2f9809b410 0x7f2f980d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44018/0 (socket says 172.21.15.80:44018) 2024-04-25T15:43:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f9cc0b640 1 -- 172.21.15.80:0/1042507525 >> v1:172.21.15.195:6789/0 conn(0x7f2f980d3110 legacy=0x7f2f980cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f9cc0b640 1 -- 172.21.15.80:0/1042507525 >> v1:172.21.15.80:6789/0 conn(0x7f2f9809b410 legacy=0x7f2f980d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f9cc0b640 1 -- 172.21.15.80:0/1042507525 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f980b3c00 con 0x7f2f980d2190 2024-04-25T15:43:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f96ffd640 1 -- 172.21.15.80:0/1042507525 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411656098 0 0) 0x7f2f98160760 con 0x7f2f9809b410 2024-04-25T15:43:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.500+0000 7f2f9cc0b640 1 --2- 172.21.15.80:0/1042507525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f980d2190 0x7f2f9809bdf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009e50 tx=0x7f2f9002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118c6b33ed72ecaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f96ffd640 1 -- 172.21.15.80:0/1042507525 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90036070 con 0x7f2f980d2190 2024-04-25T15:43:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f96ffd640 1 -- 172.21.15.80:0/1042507525 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f90031600 con 0x7f2f980d2190 2024-04-25T15:43:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f96ffd640 1 -- 172.21.15.80:0/1042507525 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900319f0 con 0x7f2f980d2190 2024-04-25T15:43:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 -- 172.21.15.80:0/1042507525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f980d2190 msgr2=0x7f2f9809bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/1042507525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f980d2190 0x7f2f9809bdf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009e50 tx=0x7f2f9002a7c0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 -- 172.21.15.80:0/1042507525 shutdown_connections 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/1042507525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f980d2190 0x7f2f9809bdf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 -- 172.21.15.80:0/1042507525 >> 172.21.15.80:0/1042507525 conn(0x7f2f980b7620 msgr2=0x7f2f980b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 -- 172.21.15.80:0/1042507525 shutdown_connections 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.501+0000 7f2f9e66e640 1 -- 172.21.15.80:0/1042507525 wait complete. 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.503+0000 7f2f9e66e640 1 Processor -- start 2024-04-25T15:43:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.503+0000 7f2f9e66e640 1 -- start start 2024-04-25T15:43:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.504+0000 7f2f9e66e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 0x7f2f9815e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f980d2190 0x7f2f981e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f980d3110 0x7f2f9809fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2f980cea40 con 0x7f2f9809b410 2024-04-25T15:43:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2f980b41a0 con 0x7f2f980d3110 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2f980cf670 con 0x7f2f980d2190 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 0x7f2f9815e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 0x7f2f9815e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59648/0 (socket says 172.21.15.80:59648) 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 -- 172.21.15.80:0/884359013 learned_addr learned my addr 172.21.15.80:0/884359013 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9cc0b640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f980d3110 0x7f2f9809fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f977fe640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f980d2190 0x7f2f981e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 -- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f980d2190 msgr2=0x7f2f981e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f980d2190 0x7f2f981e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 -- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f980d3110 msgr2=0x7f2f9809fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f980d3110 0x7f2f9809fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 -- 172.21.15.80:0/884359013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f981eae00 con 0x7f2f9809b410 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f977fe640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f980d2190 0x7f2f981e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f97fff640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 0x7f2f9815e9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c3f0 tx=0x7f2f8800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880074e0 con 0x7f2f9809b410 2024-04-25T15:43:43.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f880047e0 con 0x7f2f9809b410 2024-04-25T15:43:43.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f981eb0e0 con 0x7f2f9809b410 2024-04-25T15:43:43.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88004bd0 con 0x7f2f9809b410 2024-04-25T15:43:43.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.505+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f98160a40 con 0x7f2f9809b410 2024-04-25T15:43:43.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.506+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9806a100 con 0x7f2f9809b410 2024-04-25T15:43:43.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.507+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2f8801a020 con 0x7f2f9809b410 2024-04-25T15:43:43.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.507+0000 7f2f94ff9640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f840744e0 0x7f2f840769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.508+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2f88094e20 con 0x7f2f9809b410 2024-04-25T15:43:43.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.508+0000 7f2f977fe640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f840744e0 0x7f2f840769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.508+0000 7f2f977fe640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f840744e0 0x7f2f840769f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f98162670 tx=0x7f2f8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.512+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f8805f1b0 con 0x7f2f9809b410 2024-04-25T15:43:43.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.687+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2f981ea890 con 0x7f2f9809b410 2024-04-25T15:43:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.688+0000 7f2f94ff9640 1 -- 172.21.15.80:0/884359013 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f2f8805eab0 con 0x7f2f9809b410 2024-04-25T15:43:43.689 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f840744e0 msgr2=0x7f2f840769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f840744e0 0x7f2f840769f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f98162670 tx=0x7f2f8c009040 comp rx=0 tx=0).stop 2024-04-25T15:43:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 msgr2=0x7f2f9815e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 0x7f2f9815e9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c3f0 tx=0x7f2f8800c8b0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 shutdown_connections 2024-04-25T15:43:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f840744e0 0x7f2f840769f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f980d3110 0x7f2f9809fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f980d2190 0x7f2f981e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 --2- 172.21.15.80:0/884359013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f9809b410 0x7f2f9815e9c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 >> 172.21.15.80:0/884359013 conn(0x7f2f980b7620 msgr2=0x7f2f980ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 shutdown_connections 2024-04-25T15:43:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.690+0000 7f2f9e66e640 1 -- 172.21.15.80:0/884359013 wait complete. 2024-04-25T15:43:43.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.809+0000 7fdb21e49640 1 Processor -- start 2024-04-25T15:43:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.809+0000 7fdb21e49640 1 -- start start 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb21e49640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb21e49640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 0x7fdb1c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb21e49640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb1c0d1010 con 0x7fdb1c06da90 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb21e49640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdb1c09cdf0 con 0x7fdb1c0b3ac0 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb21e49640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1c09d0d0 con 0x7fdb1c0d34a0 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb1bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 0x7fdb1c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c0b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:36832/0 (socket says 172.21.15.80:36832) 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb1bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 0x7fdb1c0b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:54036/0 (socket says 172.21.15.80:54036) 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/438715298 learned_addr learned my addr 172.21.15.80:0/438715298 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.810+0000 7fdb13fff640 1 --1- 172.21.15.80:0/438715298 >> v1:172.21.15.195:6789/0 conn(0x7fdb1c06da90 0x7fdb1c06e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:33884/0 (socket says 172.21.15.80:33884) 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.811+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/438715298 >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 msgr2=0x7fdb1c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.811+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/438715298 >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 0x7fdb1c0b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.811+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/438715298 >> v1:172.21.15.195:6789/0 conn(0x7fdb1c06da90 legacy=0x7fdb1c06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.811+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/438715298 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c06ec70 con 0x7fdb1c0d34a0 2024-04-25T15:43:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.811+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/438715298 >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 0x7fdb1c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.812+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/438715298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c0b91b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009850 tx=0x7fdb0c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b93d3b43e12049f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.812+0000 7fdb1affd640 1 -- 172.21.15.80:0/438715298 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c004030 con 0x7fdb1c0d34a0 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.812+0000 7fdb1affd640 1 -- 172.21.15.80:0/438715298 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c0041d0 con 0x7fdb1c0d34a0 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.812+0000 7fdb1affd640 1 -- 172.21.15.80:0/438715298 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c003610 con 0x7fdb1c0d34a0 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.812+0000 7fdb21e49640 1 -- 172.21.15.80:0/438715298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 msgr2=0x7fdb1c0b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.812+0000 7fdb21e49640 1 --2- 172.21.15.80:0/438715298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c0b91b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009850 tx=0x7fdb0c02a230 comp rx=0 tx=0).stop 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.813+0000 7fdb21e49640 1 -- 172.21.15.80:0/438715298 shutdown_connections 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.813+0000 7fdb21e49640 1 --2- 172.21.15.80:0/438715298 >> v2:172.21.15.195:3300/0 conn(0x7fdb1c0b3ac0 0x7fdb1c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.813+0000 7fdb21e49640 1 --2- 172.21.15.80:0/438715298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c0b91b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.813+0000 7fdb21e49640 1 -- 172.21.15.80:0/438715298 >> 172.21.15.80:0/438715298 conn(0x7fdb1c0d0450 msgr2=0x7fdb1c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:43.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.813+0000 7fdb21e49640 1 -- 172.21.15.80:0/438715298 shutdown_connections 2024-04-25T15:43:43.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.813+0000 7fdb21e49640 1 -- 172.21.15.80:0/438715298 wait complete. 2024-04-25T15:43:43.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.814+0000 7fdb21e49640 1 Processor -- start 2024-04-25T15:43:43.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.814+0000 7fdb21e49640 1 -- start start 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 0x7fdb1c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0b3ac0 0x7fdb1c1f9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c1fa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0b4410 con 0x7fdb1c06da90 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c06d7b0 con 0x7fdb1c0b3ac0 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1c0b4590 con 0x7fdb1c0d34a0 2024-04-25T15:43:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 0x7fdb1c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 0x7fdb1c0b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59656/0 (socket says 172.21.15.80:59656) 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/1281072585 learned_addr learned my addr 172.21.15.80:0/1281072585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb13fff640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0b3ac0 0x7fdb1c1f9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c1fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 msgr2=0x7fdb1c1fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c1fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0b3ac0 msgr2=0x7fdb1c1f9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0b3ac0 0x7fdb1c1f9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/1281072585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c0b2e80 con 0x7fdb1c06da90 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 0x7fdb1c0b2090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c02a270 tx=0x7fdb0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c041020 con 0x7fdb1c06da90 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c003c50 con 0x7fdb1c06da90 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c1f7a30 con 0x7fdb1c06da90 2024-04-25T15:43:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.816+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c004030 con 0x7fdb1c06da90 2024-04-25T15:43:43.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.817+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c1f7cd0 con 0x7fdb1c06da90 2024-04-25T15:43:43.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.818+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c06a100 con 0x7fdb1c06da90 2024-04-25T15:43:43.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.818+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdb0c044020 con 0x7fdb1c06da90 2024-04-25T15:43:43.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.819+0000 7fdb18ff9640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdafc0744b0 0x7fdafc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:43.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.819+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fdb0c0b60e0 con 0x7fdb1c06da90 2024-04-25T15:43:43.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.819+0000 7fdb13fff640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdafc0744b0 0x7fdafc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:43.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.819+0000 7fdb13fff640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdafc0744b0 0x7fdafc0769c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0cdc70 tx=0x7fdb04007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:43.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:43.823+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb0c04b030 con 0x7fdb1c06da90 2024-04-25T15:43:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.002+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb1c0b52a0 con 0x7fdb1c06da90 2024-04-25T15:43:44.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.003+0000 7fdb18ff9640 1 -- 172.21.15.80:0/1281072585 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7fdb0c07feb0 con 0x7fdb1c06da90 2024-04-25T15:43:44.004 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:44.005 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdafc0744b0 msgr2=0x7fdafc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdafc0744b0 0x7fdafc0769c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0cdc70 tx=0x7fdb04007ce0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 msgr2=0x7fdb1c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 0x7fdb1c0b2090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c02a270 tx=0x7fdb0c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 shutdown_connections 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdafc0744b0 0x7fdafc0769c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb1c0d34a0 0x7fdb1c1fa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0b3ac0 0x7fdb1c1f9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 --2- 172.21.15.80:0/1281072585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c06da90 0x7fdb1c0b2090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 >> 172.21.15.80:0/1281072585 conn(0x7fdb1c0d0450 msgr2=0x7fdb1c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 shutdown_connections 2024-04-25T15:43:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.005+0000 7fdb21e49640 1 -- 172.21.15.80:0/1281072585 wait complete. 2024-04-25T15:43:44.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:44.018 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:44.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.128+0000 7f2568e84640 1 Processor -- start 2024-04-25T15:43:44.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.128+0000 7f2568e84640 1 -- start start 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.129+0000 7f2568e84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f256415d760 0x7f2564156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.129+0000 7f2568e84640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f256406dce0 0x7f25640b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.129+0000 7f2568e84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25640b6b50 con 0x7f2564160ad0 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.129+0000 7f2568e84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f25640b6870 con 0x7f256415d760 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.129+0000 7f2568e84640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f256415cc80 con 0x7f256406dce0 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.129+0000 7f256259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f256415d760 0x7f2564156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f2561d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2564160ad0 0x7f256406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44034/0 (socket says 172.21.15.80:44034) 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f256259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f256415d760 0x7f2564156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59672/0 (socket says 172.21.15.80:59672) 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f2561d9b640 1 -- 172.21.15.80:0/3671947336 learned_addr learned my addr 172.21.15.80:0/3671947336 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f2562d9d640 1 --2- 172.21.15.80:0/3671947336 >> v2:172.21.15.195:3300/0 conn(0x7f256406dce0 0x7f25640b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f256259c640 1 -- 172.21.15.80:0/3671947336 >> v2:172.21.15.195:3300/0 conn(0x7f256406dce0 msgr2=0x7f25640b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f256259c640 1 --2- 172.21.15.80:0/3671947336 >> v2:172.21.15.195:3300/0 conn(0x7f256406dce0 0x7f25640b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f256259c640 1 -- 172.21.15.80:0/3671947336 >> v1:172.21.15.80:6789/0 conn(0x7f2564160ad0 legacy=0x7f256406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f256159a640 1 -- 172.21.15.80:0/3671947336 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155048214 0 0) 0x7f25640b6b50 con 0x7f2564160ad0 2024-04-25T15:43:44.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.130+0000 7f256259c640 1 -- 172.21.15.80:0/3671947336 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256415cf60 con 0x7f256415d760 2024-04-25T15:43:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f256259c640 1 --2- 172.21.15.80:0/3671947336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f256415d760 0x7f2564156c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2564071510 tx=0x7f255402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b0e9825aa4adc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f256159a640 1 -- 172.21.15.80:0/3671947336 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554032770 con 0x7f256415d760 2024-04-25T15:43:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f256159a640 1 -- 172.21.15.80:0/3671947336 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2554038070 con 0x7f256415d760 2024-04-25T15:43:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f256159a640 1 -- 172.21.15.80:0/3671947336 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554032b30 con 0x7f256415d760 2024-04-25T15:43:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f2568e84640 1 -- 172.21.15.80:0/3671947336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f256415d760 msgr2=0x7f2564156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f2568e84640 1 --2- 172.21.15.80:0/3671947336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f256415d760 0x7f2564156c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2564071510 tx=0x7f255402c870 comp rx=0 tx=0).stop 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f2568e84640 1 -- 172.21.15.80:0/3671947336 shutdown_connections 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f2568e84640 1 --2- 172.21.15.80:0/3671947336 >> v2:172.21.15.195:3300/0 conn(0x7f256406dce0 0x7f25640b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f2568e84640 1 --2- 172.21.15.80:0/3671947336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f256415d760 0x7f2564156c20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.131+0000 7f2568e84640 1 -- 172.21.15.80:0/3671947336 >> 172.21.15.80:0/3671947336 conn(0x7f25640734b0 msgr2=0x7f25640738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.132+0000 7f2568e84640 1 -- 172.21.15.80:0/3671947336 shutdown_connections 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.132+0000 7f2568e84640 1 -- 172.21.15.80:0/3671947336 wait complete. 2024-04-25T15:43:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.133+0000 7f2568e84640 1 Processor -- start 2024-04-25T15:43:44.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.133+0000 7f2568e84640 1 -- start start 2024-04-25T15:43:44.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256415d760 0x7f25641e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 0x7f25641e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2564151660 0x7f256413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f25640b6510 con 0x7f2564160ad0 2024-04-25T15:43:44.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f25640711f0 con 0x7f256415d760 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2564160ee0 con 0x7f2564151660 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 0x7f25641e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 0x7f25641e78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59680/0 (socket says 172.21.15.80:59680) 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 -- 172.21.15.80:0/4035234832 learned_addr learned my addr 172.21.15.80:0/4035234832 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f256259c640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256415d760 0x7f25641e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2562d9d640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2564151660 0x7f256413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 -- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2564151660 msgr2=0x7f256413baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2564151660 0x7f256413baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 -- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256415d760 msgr2=0x7f25641e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256415d760 0x7f25641e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 -- 172.21.15.80:0/4035234832 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2564152910 con 0x7f2564160ad0 2024-04-25T15:43:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f256259c640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256415d760 0x7f25641e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2561d9b640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 0x7f25641e78a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f255800c410 tx=0x7f255800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25580074e0 con 0x7f2564160ad0 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25580047e0 con 0x7f2564160ad0 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2564151d00 con 0x7f2564160ad0 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.135+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558004bd0 con 0x7f2564160ad0 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.136+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25641522c0 con 0x7f2564160ad0 2024-04-25T15:43:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.136+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2564151a70 con 0x7f2564160ad0 2024-04-25T15:43:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.137+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2558011070 con 0x7f2564160ad0 2024-04-25T15:43:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.138+0000 7f2552ffd640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f25440744b0 0x7f25440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.138+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2558095210 con 0x7f2564160ad0 2024-04-25T15:43:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.138+0000 7f256259c640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f25440744b0 0x7f25440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.138+0000 7f256259c640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f25440744b0 0x7f25440769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2554037000 tx=0x7f2554032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.142+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f255805f5a0 con 0x7f2564160ad0 2024-04-25T15:43:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.320+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f256406a100 con 0x7f2564160ad0 2024-04-25T15:43:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.321+0000 7f2552ffd640 1 -- 172.21.15.80:0/4035234832 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f255805eea0 con 0x7f2564160ad0 2024-04-25T15:43:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f25440744b0 msgr2=0x7f25440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f25440744b0 0x7f25440769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2554037000 tx=0x7f2554032000 comp rx=0 tx=0).stop 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 msgr2=0x7f25641e78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 0x7f25641e78a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f255800c410 tx=0x7f255800c8d0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 shutdown_connections 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f25440744b0 0x7f25440769c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2564151660 0x7f256413baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2564160ad0 0x7f25641e78a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 --2- 172.21.15.80:0/4035234832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256415d760 0x7f25641e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 >> 172.21.15.80:0/4035234832 conn(0x7f25640734b0 msgr2=0x7f256406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 shutdown_connections 2024-04-25T15:43:44.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.323+0000 7f2568e84640 1 -- 172.21.15.80:0/4035234832 wait complete. 2024-04-25T15:43:44.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.444+0000 7f427518f640 1 Processor -- start 2024-04-25T15:43:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.444+0000 7f427518f640 1 -- start start 2024-04-25T15:43:44.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.445+0000 7f427518f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4270161a80 0x7f42700d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.445+0000 7f427518f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42700d25c0 con 0x7f42700ce940 2024-04-25T15:43:44.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.445+0000 7f427518f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42700d28a0 con 0x7f427015de90 2024-04-25T15:43:44.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.445+0000 7f427518f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f42700ce1f0 con 0x7f4270161a80 2024-04-25T15:43:44.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426f59e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42700ce940 0x7f42700ced50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47606/0 (socket says 172.21.15.80:47606) 2024-04-25T15:43:44.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426f59e640 1 -- 172.21.15.80:0/1630091678 learned_addr learned my addr 172.21.15.80:0/1630091678 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140388960 0 0) 0x7f42700d25c0 con 0x7f42700ce940 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426ed9d640 1 --2- 172.21.15.80:0/1630091678 >> v2:172.21.15.195:3300/0 conn(0x7f4270161a80 0x7f42700d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4258003520 con 0x7f42700ce940 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1922462287 0 0) 0x7f4258003520 con 0x7f42700ce940 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 >> v2:172.21.15.195:3300/0 conn(0x7f4270161a80 msgr2=0x7f42700d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 --2- 172.21.15.80:0/1630091678 >> v2:172.21.15.195:3300/0 conn(0x7f4270161a80 0x7f42700d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 >> v1:172.21.15.195:6789/0 conn(0x7f427015de90 legacy=0x7f42700b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42700d2b80 con 0x7f42700ce940 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f42680019f0 con 0x7f42700ce940 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 >> v1:172.21.15.80:6789/0 conn(0x7f42700ce940 legacy=0x7f42700ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42580039b0 0x7f4258003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4258004800 0x7f4258004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4258005250 0x7f425800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f425800c1b0 con 0x7f4258005250 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f425800c360 con 0x7f4258004800 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f425800c560 con 0x7f42580039b0 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426f59e640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4258005250 0x7f425800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426e59c640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4258004800 0x7f4258004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.446+0000 7f426ed9d640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42580039b0 0x7f4258003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 -- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42580039b0 msgr2=0x7f4258003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42580039b0 0x7f4258003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 -- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4258004800 msgr2=0x7f4258004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4258004800 0x7f4258004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 -- 172.21.15.80:0/1630091678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4258003520 con 0x7f4258005250 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 -- 172.21.15.80:0/1630091678 reap_dead start 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426f59e640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4258005250 0x7f425800b9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f426800a860 tx=0x7f4258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628432b3a02a2faf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426800a480 con 0x7f4258005250 2024-04-25T15:43:44.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426802f070 con 0x7f4258005250 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.447+0000 7f426dd9b640 1 -- 172.21.15.80:0/1630091678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426802bcc0 con 0x7f4258005250 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 -- 172.21.15.80:0/1630091678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4258005250 msgr2=0x7f425800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4258005250 0x7f425800b9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f426800a860 tx=0x7f4258005830 comp rx=0 tx=0).stop 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 -- 172.21.15.80:0/1630091678 shutdown_connections 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 --2- 172.21.15.80:0/1630091678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4258005250 0x7f425800b9c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 -- 172.21.15.80:0/1630091678 >> 172.21.15.80:0/1630091678 conn(0x7f42700b5510 msgr2=0x7f42700b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 -- 172.21.15.80:0/1630091678 shutdown_connections 2024-04-25T15:43:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.448+0000 7f427518f640 1 -- 172.21.15.80:0/1630091678 wait complete. 2024-04-25T15:43:44.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.450+0000 7f427518f640 1 Processor -- start 2024-04-25T15:43:44.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.450+0000 7f427518f640 1 -- start start 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.451+0000 7f427518f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4258005250 0x7f42701f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.451+0000 7f427518f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 0x7f42700ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.451+0000 7f427518f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42700ac9f0 0x7f42701f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f427518f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f42700d33e0 con 0x7f42701f49f0 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f427518f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f42700d2e60 con 0x7f42700ac9f0 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f427518f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42700d1ec0 con 0x7f4258005250 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 0x7f42700ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 0x7f42700ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36530/0 (socket says 172.21.15.80:36530) 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 -- 172.21.15.80:0/490812809 learned_addr learned my addr 172.21.15.80:0/490812809 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426ed9d640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4258005250 0x7f42701f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426f59e640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42700ac9f0 0x7f42701f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 -- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4258005250 msgr2=0x7f42701f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4258005250 0x7f42701f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 -- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42700ac9f0 msgr2=0x7f42701f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42700ac9f0 0x7f42701f7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 -- 172.21.15.80:0/490812809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42700ace00 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426f59e640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42700ac9f0 0x7f42701f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f426e59c640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 0x7f42700ac4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f426400f620 tx=0x7f426400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640052e0 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4264018070 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264003810 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42700aab10 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.452+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42700ab0d0 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.453+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427006a100 con 0x7f42701f49f0 2024-04-25T15:43:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.454+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f42640039b0 con 0x7f42701f49f0 2024-04-25T15:43:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.454+0000 7f42577fe640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f425c0744b0 0x7f425c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.455+0000 7f426ed9d640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f425c0744b0 0x7f425c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.455+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4264095460 con 0x7f42701f49f0 2024-04-25T15:43:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.455+0000 7f426ed9d640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f425c0744b0 0x7f425c0769c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42700748a0 tx=0x7f4260008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.459+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42700ace00 con 0x7f42701f49f0 2024-04-25T15:43:44.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.634+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f42700aa8a0 con 0x7f42701f49f0 2024-04-25T15:43:44.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.635+0000 7f42577fe640 1 -- 172.21.15.80:0/490812809 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f426405f7f0 con 0x7f42701f49f0 2024-04-25T15:43:44.636 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f425c0744b0 msgr2=0x7f425c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f425c0744b0 0x7f425c0769c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42700748a0 tx=0x7f4260008040 comp rx=0 tx=0).stop 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 msgr2=0x7f42700ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 0x7f42700ac4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f426400f620 tx=0x7f426400fae0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 shutdown_connections 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f425c0744b0 0x7f425c0769c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42700ac9f0 0x7f42701f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42701f49f0 0x7f42700ac4b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 --2- 172.21.15.80:0/490812809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4258005250 0x7f42701f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 >> 172.21.15.80:0/490812809 conn(0x7f42700b5510 msgr2=0x7f42700b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 shutdown_connections 2024-04-25T15:43:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.637+0000 7f427518f640 1 -- 172.21.15.80:0/490812809 wait complete. 2024-04-25T15:43:44.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.758+0000 7fb8dd8ee640 1 Processor -- start 2024-04-25T15:43:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.758+0000 7fb8dd8ee640 1 -- start start 2024-04-25T15:43:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8dd8ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb8d80b5490 0x7fb8d8160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8dd8ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d81643f0 con 0x7fb8d80d0b00 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8dd8ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d81646d0 con 0x7fb8d80d2d50 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8dd8ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d81649b0 con 0x7fb8d80b5490 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d67fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb8d80d0b00 0x7fb8d80d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47616/0 (socket says 172.21.15.80:47616) 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d67fc640 1 -- 172.21.15.80:0/2299479921 learned_addr learned my addr 172.21.15.80:0/2299479921 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/2299479921 >> v2:172.21.15.195:3300/0 conn(0x7fb8d80b5490 0x7fb8d8160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264132660 0 0) 0x7fb8d81643f0 con 0x7fb8d80d0b00 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8c0003520 con 0x7fb8d80d0b00 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 370184140 0 0) 0x7fb8c0003520 con 0x7fb8d80d0b00 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 >> v2:172.21.15.195:3300/0 conn(0x7fb8d80b5490 msgr2=0x7fb8d8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 --2- 172.21.15.80:0/2299479921 >> v2:172.21.15.195:3300/0 conn(0x7fb8d80b5490 0x7fb8d8160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 >> v1:172.21.15.195:6789/0 conn(0x7fb8d80d2d50 legacy=0x7fb8d80d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d8164c90 con 0x7fb8d80d0b00 2024-04-25T15:43:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb8cc001670 con 0x7fb8d80d0b00 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 >> v1:172.21.15.80:6789/0 conn(0x7fb8d80d0b00 legacy=0x7fb8d80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.760+0000 7fb8d5ffb640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8c0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d5ffb640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8c0004800 0x7fb8c0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d5ffb640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8c00051c0 0x7fb8c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d81649b0 con 0x7fb8c00039b0 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c000c160 con 0x7fb8c00051c0 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c000c360 con 0x7fb8c0004800 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8c0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d77fe640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8c00051c0 0x7fb8c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d67fc640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8c0004800 0x7fb8c0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8c0004800 msgr2=0x7fb8c0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8c0004800 0x7fb8c0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8c00051c0 msgr2=0x7fb8c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8c00051c0 0x7fb8c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/2299479921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c0003520 con 0x7fb8c00039b0 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d77fe640 1 -- 172.21.15.80:0/2299479921 reap_dead start 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.761+0000 7fb8d67fc640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8c0004800 0x7fb8c0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8c0003e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009f90 tx=0x7fb8c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f727f11ee22462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8036070 con 0x7fb8c00039b0 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8031600 con 0x7fb8c00039b0 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8d5ffb640 1 -- 172.21.15.80:0/2299479921 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8009c10 con 0x7fb8c00039b0 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/2299479921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 msgr2=0x7fb8c0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8c0003e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009f90 tx=0x7fb8c0005830 comp rx=0 tx=0).stop 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/2299479921 shutdown_connections 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/2299479921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8c0003e20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/2299479921 >> 172.21.15.80:0/2299479921 conn(0x7fb8d806e650 msgr2=0x7fb8d806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.762+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/2299479921 shutdown_connections 2024-04-25T15:43:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.763+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/2299479921 wait complete. 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.764+0000 7fb8dd8ee640 1 Processor -- start 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.764+0000 7fb8dd8ee640 1 -- start start 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8d80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8d8162e00 0x7fb8d80c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8d814f220 0x7fb8d8161f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8163f80 con 0x7fb8c00039b0 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8164100 con 0x7fb8d814f220 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d80b5490 con 0x7fb8d8162e00 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8d80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8d80c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36546/0 (socket says 172.21.15.80:36546) 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/1435057568 learned_addr learned my addr 172.21.15.80:0/1435057568 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d67fc640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8d8162e00 0x7fb8d80c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d77fe640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8d814f220 0x7fb8d8161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8d8162e00 msgr2=0x7fb8d80c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8d8162e00 0x7fb8d80c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8d814f220 msgr2=0x7fb8d8161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8d814f220 0x7fb8d8161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 -- 172.21.15.80:0/1435057568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d814e180 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8d6ffd640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8d80c9270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009f90 tx=0x7fb8c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8040020 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c80307d0 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d814e460 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.766+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8036040 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.767+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d814ea20 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.768+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d806a100 con 0x7fb8c00039b0 2024-04-25T15:43:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.768+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb8c8043020 con 0x7fb8c00039b0 2024-04-25T15:43:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.768+0000 7fb8bffff640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8c40744e0 0x7fb8c40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.768+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb8c80b60c0 con 0x7fb8c00039b0 2024-04-25T15:43:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.769+0000 7fb8d67fc640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8c40744e0 0x7fb8c40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.769+0000 7fb8d67fc640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8c40744e0 0x7fb8c40769f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8d815ffc0 tx=0x7fb8cc007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.773+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8c804a030 con 0x7fb8c00039b0 2024-04-25T15:43:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.950+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb8d80d41d0 con 0x7fb8c00039b0 2024-04-25T15:43:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.951+0000 7fb8bffff640 1 -- 172.21.15.80:0/1435057568 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb8c807fe00 con 0x7fb8c00039b0 2024-04-25T15:43:44.952 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8c40744e0 msgr2=0x7fb8c40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8c40744e0 0x7fb8c40769f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8d815ffc0 tx=0x7fb8cc007040 comp rx=0 tx=0).stop 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 msgr2=0x7fb8d80c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8d80c9270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009f90 tx=0x7fb8c8009750 comp rx=0 tx=0).stop 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 shutdown_connections 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8c40744e0 0x7fb8c40769f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8d814f220 0x7fb8d8161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8d8162e00 0x7fb8d80c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.952+0000 7fb8dd8ee640 1 --2- 172.21.15.80:0/1435057568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c00039b0 0x7fb8d80c9270 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.953+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 >> 172.21.15.80:0/1435057568 conn(0x7fb8d806e650 msgr2=0x7fb8d80b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.953+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 shutdown_connections 2024-04-25T15:43:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:44.953+0000 7fb8dd8ee640 1 -- 172.21.15.80:0/1435057568 wait complete. 2024-04-25T15:43:44.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:45.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.074+0000 7f8a7f33f640 1 Processor -- start 2024-04-25T15:43:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.075+0000 7f8a7f33f640 1 -- start start 2024-04-25T15:43:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7f33f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8a781618b0 0x7f8a780b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7f33f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a780b2b00 con 0x7f8a780d26a0 2024-04-25T15:43:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7f33f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7806cb80 con 0x7f8a7806c5c0 2024-04-25T15:43:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7f33f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7806ce60 con 0x7f8a781618b0 2024-04-25T15:43:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7d8dc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8a780d26a0 0x7f8a780cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47620/0 (socket says 172.21.15.80:47620) 2024-04-25T15:43:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/4214768331 learned_addr learned my addr 172.21.15.80:0/4214768331 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a7d0db640 1 --2- 172.21.15.80:0/4214768331 >> v2:172.21.15.195:3300/0 conn(0x7f8a781618b0 0x7f8a780b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.076+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316936166 0 0) 0x7f8a70001110 con 0x7f8a780d26a0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a64003520 con 0x7f8a780d26a0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1961829677 0 0) 0x7f8a64003520 con 0x7f8a780d26a0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 >> v2:172.21.15.195:3300/0 conn(0x7f8a781618b0 msgr2=0x7f8a780b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 --2- 172.21.15.80:0/4214768331 >> v2:172.21.15.195:3300/0 conn(0x7f8a781618b0 0x7f8a780b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 >> v1:172.21.15.195:6789/0 conn(0x7f8a7806c5c0 legacy=0x7f8a780d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a780b2d80 con 0x7f8a780d26a0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f8a70001840 con 0x7f8a780d26a0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 >> v1:172.21.15.80:6789/0 conn(0x7f8a780d26a0 legacy=0x7f8a780cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a640039b0 0x7f8a64003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a64004800 0x7f8a64004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a640051c0 0x7f8a6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7806ce60 con 0x7f8a640051c0 2024-04-25T15:43:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6400c160 con 0x7f8a640039b0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6400c360 con 0x7f8a64004800 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a640051c0 0x7f8a6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d0db640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a640039b0 0x7f8a64003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7c8da640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a64004800 0x7f8a64004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a64004800 msgr2=0x7f8a64004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a64004800 0x7f8a64004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a640039b0 msgr2=0x7f8a64003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a640039b0 0x7f8a64003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.077+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/4214768331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a64003520 con 0x7f8a640051c0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.078+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/4214768331 reap_dead start 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.078+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a640051c0 0x7f8a6400b9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c490 tx=0x7f8a64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f511bf8eefe927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.078+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000c0e0 con 0x7f8a640051c0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.078+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70005af0 con 0x7f8a640051c0 2024-04-25T15:43:45.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.078+0000 7f8a6ffff640 1 -- 172.21.15.80:0/4214768331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70007070 con 0x7f8a640051c0 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 -- 172.21.15.80:0/4214768331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a640051c0 msgr2=0x7f8a6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a640051c0 0x7f8a6400b9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c490 tx=0x7f8a64005830 comp rx=0 tx=0).stop 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 -- 172.21.15.80:0/4214768331 shutdown_connections 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/4214768331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a640051c0 0x7f8a6400b9c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 -- 172.21.15.80:0/4214768331 >> 172.21.15.80:0/4214768331 conn(0x7f8a7809b410 msgr2=0x7f8a780b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 -- 172.21.15.80:0/4214768331 shutdown_connections 2024-04-25T15:43:45.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.079+0000 7f8a7f33f640 1 -- 172.21.15.80:0/4214768331 wait complete. 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.081+0000 7f8a7f33f640 1 Processor -- start 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.081+0000 7f8a7f33f640 1 -- start start 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7f33f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a640051c0 0x7f8a781f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7f33f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a780cd2d0 0x7f8a780cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7f33f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 0x7f8a780b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7f33f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781618b0 con 0x7f8a780aff20 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7f33f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78076270 con 0x7f8a780cd2d0 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7f33f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8a78161a30 con 0x7f8a640051c0 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 0x7f8a780b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 0x7f8a780b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36568/0 (socket says 172.21.15.80:36568) 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/3078289394 learned_addr learned my addr 172.21.15.80:0/3078289394 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7c8da640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a780cd2d0 0x7f8a780cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d0db640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a640051c0 0x7f8a781f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a640051c0 msgr2=0x7f8a781f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a640051c0 0x7f8a781f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a780cd2d0 msgr2=0x7f8a780cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a780cd2d0 0x7f8a780cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.082+0000 7f8a7d8dc640 1 -- 172.21.15.80:0/3078289394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a780b0870 con 0x7f8a780aff20 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.083+0000 7f8a7d8dc640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 0x7f8a780b0330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8a70000c00 tx=0x7f8a70001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.083+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70000ed0 con 0x7f8a780aff20 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.083+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70042070 con 0x7f8a780aff20 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.083+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a780cb040 con 0x7f8a780aff20 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.083+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70007290 con 0x7f8a780aff20 2024-04-25T15:43:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.083+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a780cb600 con 0x7f8a780aff20 2024-04-25T15:43:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.084+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7806a100 con 0x7f8a780aff20 2024-04-25T15:43:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.085+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8a70007430 con 0x7f8a780aff20 2024-04-25T15:43:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.085+0000 7f8a6dffb640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8a5c074680 0x7f8a5c076b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.085+0000 7f8a7d0db640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8a5c074680 0x7f8a5c076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.085+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8a700b5960 con 0x7f8a780aff20 2024-04-25T15:43:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.086+0000 7f8a7d0db640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8a5c074680 0x7f8a5c076b90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a78072c10 tx=0x7f8a7400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.090+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a780b0870 con 0x7f8a780aff20 2024-04-25T15:43:45.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.264+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8a7806ece0 con 0x7f8a780aff20 2024-04-25T15:43:45.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.264+0000 7f8a6dffb640 1 -- 172.21.15.80:0/3078289394 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f8a780b2b00 con 0x7f8a780aff20 2024-04-25T15:43:45.265 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8a5c074680 msgr2=0x7f8a5c076b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8a5c074680 0x7f8a5c076b90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a78072c10 tx=0x7f8a7400b040 comp rx=0 tx=0).stop 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 msgr2=0x7f8a780b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 0x7f8a780b0330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8a70000c00 tx=0x7f8a70001c10 comp rx=0 tx=0).stop 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 shutdown_connections 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8a5c074680 0x7f8a5c076b90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a780aff20 0x7f8a780b0330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a780cd2d0 0x7f8a780cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 --2- 172.21.15.80:0/3078289394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a640051c0 0x7f8a781f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 >> 172.21.15.80:0/3078289394 conn(0x7f8a7809b410 msgr2=0x7f8a78070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 shutdown_connections 2024-04-25T15:43:45.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.266+0000 7f8a7f33f640 1 -- 172.21.15.80:0/3078289394 wait complete. 2024-04-25T15:43:45.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.388+0000 7f6d4497a640 1 Processor -- start 2024-04-25T15:43:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.388+0000 7f6d4497a640 1 -- start start 2024-04-25T15:43:45.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d4497a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d400d2e50 0x7f6d400b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d4497a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d4006ea80 0x7f6d4006e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d4497a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d400b25e0 con 0x7f6d4015d170 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d4497a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6d4006ddc0 con 0x7f6d4006ea80 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d4497a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4006d770 con 0x7f6d400d2e50 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d3ed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d4006ea80 0x7f6d4006e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d3ed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d4006ea80 0x7f6d4006e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36584/0 (socket says 172.21.15.80:36584) 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d3ed9d640 1 -- 172.21.15.80:0/39597896 learned_addr learned my addr 172.21.15.80:0/39597896 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.389+0000 7f6d3e59c640 1 --1- 172.21.15.80:0/39597896 >> v1:172.21.15.80:6789/0 conn(0x7f6d4015d170 0x7f6d400d2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47628/0 (socket says 172.21.15.80:47628) 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d37fff640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d400d2e50 0x7f6d400b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d3ed9d640 1 -- 172.21.15.80:0/39597896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d400d2e50 msgr2=0x7f6d400b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d3ed9d640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d400d2e50 0x7f6d400b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d3ed9d640 1 -- 172.21.15.80:0/39597896 >> v1:172.21.15.80:6789/0 conn(0x7f6d4015d170 legacy=0x7f6d400d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d3ed9d640 1 -- 172.21.15.80:0/39597896 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4006da50 con 0x7f6d4006ea80 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d3dd9b640 1 -- 172.21.15.80:0/39597896 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176395595 0 0) 0x7f6d400b25e0 con 0x7f6d4015d170 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d37fff640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d400d2e50 0x7f6d400b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.390+0000 7f6d3ed9d640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4006ea80 0x7f6d4006e250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009e50 tx=0x7f6d3802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbe2785873275e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d3dd9b640 1 -- 172.21.15.80:0/39597896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38036070 con 0x7f6d4006ea80 2024-04-25T15:43:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d3dd9b640 1 -- 172.21.15.80:0/39597896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d38031600 con 0x7f6d4006ea80 2024-04-25T15:43:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d3dd9b640 1 -- 172.21.15.80:0/39597896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d380319d0 con 0x7f6d4006ea80 2024-04-25T15:43:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 -- 172.21.15.80:0/39597896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4006ea80 msgr2=0x7f6d4006e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4006ea80 0x7f6d4006e250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009e50 tx=0x7f6d3802a710 comp rx=0 tx=0).stop 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 -- 172.21.15.80:0/39597896 shutdown_connections 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4006ea80 0x7f6d4006e250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 --2- 172.21.15.80:0/39597896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d400d2e50 0x7f6d400b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 -- 172.21.15.80:0/39597896 >> 172.21.15.80:0/39597896 conn(0x7f6d400b7620 msgr2=0x7f6d400b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 -- 172.21.15.80:0/39597896 shutdown_connections 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.391+0000 7f6d4497a640 1 -- 172.21.15.80:0/39597896 wait complete. 2024-04-25T15:43:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.393+0000 7f6d4497a640 1 Processor -- start 2024-04-25T15:43:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.393+0000 7f6d4497a640 1 -- start start 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.394+0000 7f6d4497a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d4006ea80 0x7f6d400d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.394+0000 7f6d4497a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 0x7f6d400d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.394+0000 7f6d4497a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d40145d70 0x7f6d40146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d4497a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400cf190 con 0x7f6d4015d170 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d4497a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400b2270 con 0x7f6d4006ea80 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d4497a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d400cf310 con 0x7f6d40145d70 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 0x7f6d400d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 0x7f6d400d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36592/0 (socket says 172.21.15.80:36592) 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 -- 172.21.15.80:0/2549704773 learned_addr learned my addr 172.21.15.80:0/2549704773 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d3ed9d640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d40145d70 0x7f6d40146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d3e59c640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d4006ea80 0x7f6d400d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 -- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d40145d70 msgr2=0x7f6d40146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d40145d70 0x7f6d40146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 -- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d4006ea80 msgr2=0x7f6d400d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d4006ea80 0x7f6d400d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 -- 172.21.15.80:0/2549704773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d401466c0 con 0x7f6d4015d170 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d37fff640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 0x7f6d400d28f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800c7f0 tx=0x7f6d2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28015070 con 0x7f6d4015d170 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d280077c0 con 0x7f6d4015d170 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d400d2e30 con 0x7f6d4015d170 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28007bb0 con 0x7f6d4015d170 2024-04-25T15:43:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.395+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d40144140 con 0x7f6d4015d170 2024-04-25T15:43:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.396+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4006a100 con 0x7f6d4015d170 2024-04-25T15:43:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.397+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6d28018070 con 0x7f6d4015d170 2024-04-25T15:43:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.398+0000 7f6d36ffd640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d200744b0 0x7f6d200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.398+0000 7f6d3e59c640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d200744b0 0x7f6d200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.398+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6d28095450 con 0x7f6d4015d170 2024-04-25T15:43:45.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.398+0000 7f6d3e59c640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d200744b0 0x7f6d200769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d30000f60 tx=0x7f6d30007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.402+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d401466c0 con 0x7f6d4015d170 2024-04-25T15:43:45.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.579+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d40072020 con 0x7f6d4015d170 2024-04-25T15:43:45.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.581+0000 7f6d36ffd640 1 -- 172.21.15.80:0/2549704773 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f6d2805f870 con 0x7f6d4015d170 2024-04-25T15:43:45.582 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:45.582 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d200744b0 msgr2=0x7f6d200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d200744b0 0x7f6d200769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d30000f60 tx=0x7f6d30007c00 comp rx=0 tx=0).stop 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 msgr2=0x7f6d400d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 0x7f6d400d28f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800c7f0 tx=0x7f6d2800ccb0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 shutdown_connections 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d200744b0 0x7f6d200769c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d40145d70 0x7f6d40146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d4015d170 0x7f6d400d28f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 --2- 172.21.15.80:0/2549704773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d4006ea80 0x7f6d400d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 >> 172.21.15.80:0/2549704773 conn(0x7f6d400b7620 msgr2=0x7f6d400b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:45.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 shutdown_connections 2024-04-25T15:43:45.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.583+0000 7f6d4497a640 1 -- 172.21.15.80:0/2549704773 wait complete. 2024-04-25T15:43:45.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:45.596 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:45.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.704+0000 7f5ffa851640 1 Processor -- start 2024-04-25T15:43:45.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.704+0000 7f5ffa851640 1 -- start start 2024-04-25T15:43:45.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ffa851640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40d31a0 0x7f5ff40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ffa851640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ff40b3bf0 0x7f5ff40b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ffa851640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff4161770 con 0x7f5ff40b24a0 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ffa851640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff40b28b0 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ffa851640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff40b40f0 con 0x7f5ff40d31a0 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ff40b3bf0 0x7f5ff40b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ff40b3bf0 0x7f5ff40b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36604/0 (socket says 172.21.15.80:36604) 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 -- 172.21.15.80:0/785390240 learned_addr learned my addr 172.21.15.80:0/785390240 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff3fff640 1 --2- 172.21.15.80:0/785390240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40d31a0 0x7f5ff40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 -- 172.21.15.80:0/785390240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40d31a0 msgr2=0x7f5ff40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 --2- 172.21.15.80:0/785390240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40d31a0 0x7f5ff40b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 -- 172.21.15.80:0/785390240 >> v1:172.21.15.195:6789/0 conn(0x7f5ff40b24a0 legacy=0x7f5ff4163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:45.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.706+0000 7f5ff37fe640 1 -- 172.21.15.80:0/785390240 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40d26c0 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.707+0000 7f5ff37fe640 1 --2- 172.21.15.80:0/785390240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b1f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deae7a87a7267838 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.707+0000 7f5ff2ffd640 1 -- 172.21.15.80:0/785390240 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8037070 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.707+0000 7f5ff2ffd640 1 -- 172.21.15.80:0/785390240 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8032440 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.707+0000 7f5ff2ffd640 1 -- 172.21.15.80:0/785390240 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8032810 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 -- 172.21.15.80:0/785390240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 msgr2=0x7f5ff40b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 --2- 172.21.15.80:0/785390240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b1f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe802a180 comp rx=0 tx=0).stop 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 -- 172.21.15.80:0/785390240 shutdown_connections 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 --2- 172.21.15.80:0/785390240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b1f60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 --2- 172.21.15.80:0/785390240 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff40d31a0 0x7f5ff40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 -- 172.21.15.80:0/785390240 >> 172.21.15.80:0/785390240 conn(0x7f5ff40b7640 msgr2=0x7f5ff40b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 -- 172.21.15.80:0/785390240 shutdown_connections 2024-04-25T15:43:45.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.708+0000 7f5ffa851640 1 -- 172.21.15.80:0/785390240 wait complete. 2024-04-25T15:43:45.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.710+0000 7f5ffa851640 1 Processor -- start 2024-04-25T15:43:45.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.710+0000 7f5ffa851640 1 -- start start 2024-04-25T15:43:45.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ffa851640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff40b24a0 0x7f5ff415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ffa851640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ffa851640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff415f830 0x7f5ff40b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ffa851640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff406ef50 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ffa851640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff40d2c80 con 0x7f5ff40b24a0 2024-04-25T15:43:45.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ffa851640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff40b37f0 con 0x7f5ff415f830 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36620/0 (socket says 172.21.15.80:36620) 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 -- 172.21.15.80:0/1981082295 learned_addr learned my addr 172.21.15.80:0/1981082295 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff3fff640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff40b24a0 0x7f5ff415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff8dee640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff415f830 0x7f5ff40b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 -- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff415f830 msgr2=0x7f5ff40b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff415f830 0x7f5ff40b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 -- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff40b24a0 msgr2=0x7f5ff415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff40b24a0 0x7f5ff415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff37fe640 1 -- 172.21.15.80:0/1981082295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff409f590 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.711+0000 7f5ff3fff640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff40b24a0 0x7f5ff415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.712+0000 7f5ff37fe640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b4330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.712+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8041020 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.712+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8030970 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.712+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff409f870 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.712+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8037040 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.712+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff409fe30 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.713+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff406a100 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.713+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5fe8044020 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.714+0000 7f5ff0ff9640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fe00744b0 0x7f5fe00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:45.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.714+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5fe80b6020 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.714+0000 7f5ff3fff640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fe00744b0 0x7f5fe00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:45.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.714+0000 7f5ff3fff640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fe00744b0 0x7f5fe00769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4006fd0 tx=0x7f5fe4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:45.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.718+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fe804b030 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.893+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5ff409bb60 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.893+0000 7f5ff0ff9640 1 -- 172.21.15.80:0/1981082295 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5fe8080440 con 0x7f5ff40b3bf0 2024-04-25T15:43:45.895 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fe00744b0 msgr2=0x7f5fe00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fe00744b0 0x7f5fe00769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4006fd0 tx=0x7f5fe4008040 comp rx=0 tx=0).stop 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 msgr2=0x7f5ff40b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b4330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe80046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 shutdown_connections 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fe00744b0 0x7f5fe00769c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ff415f830 0x7f5ff40b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff40b3bf0 0x7f5ff40b4330 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 --2- 172.21.15.80:0/1981082295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ff40b24a0 0x7f5ff415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.895+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 >> 172.21.15.80:0/1981082295 conn(0x7f5ff40b7640 msgr2=0x7f5ff40cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:45.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.896+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 shutdown_connections 2024-04-25T15:43:45.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:45.896+0000 7f5ffa851640 1 -- 172.21.15.80:0/1981082295 wait complete. 2024-04-25T15:43:45.908 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:46.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.017+0000 7f4838984640 1 Processor -- start 2024-04-25T15:43:46.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.017+0000 7f4838984640 1 -- start start 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.018+0000 7f4838984640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f483406dce0 0x7f48340b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.018+0000 7f4838984640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48340b0ca0 0x7f48340b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.018+0000 7f4838984640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48340b4850 con 0x7f483415cc80 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.018+0000 7f4838984640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f48340d1620 con 0x7f48340b0ca0 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.018+0000 7f4838984640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f48340b5460 con 0x7f483406dce0 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48340b0ca0 0x7f48340b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48340b0ca0 0x7f48340b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36626/0 (socket says 172.21.15.80:36626) 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f483259c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f483415cc80 0x7f483406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47634/0 (socket says 172.21.15.80:47634) 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 -- 172.21.15.80:0/505447570 learned_addr learned my addr 172.21.15.80:0/505447570 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4829d9b640 1 --2- 172.21.15.80:0/505447570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f483406dce0 0x7f48340b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 -- 172.21.15.80:0/505447570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f483406dce0 msgr2=0x7f48340b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 --2- 172.21.15.80:0/505447570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f483406dce0 0x7f48340b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 -- 172.21.15.80:0/505447570 >> v1:172.21.15.80:6789/0 conn(0x7f483415cc80 legacy=0x7f483406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4831d9b640 1 -- 172.21.15.80:0/505447570 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998916829 0 0) 0x7f48340b4850 con 0x7f483415cc80 2024-04-25T15:43:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.019+0000 7f4832d9d640 1 -- 172.21.15.80:0/505447570 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48340b4b30 con 0x7f48340b0ca0 2024-04-25T15:43:46.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4832d9d640 1 --2- 172.21.15.80:0/505447570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f48340b58f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f482c009e50 tx=0x7f482c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1ea970c7949acb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4831d9b640 1 -- 172.21.15.80:0/505447570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c036070 con 0x7f48340b0ca0 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4831d9b640 1 -- 172.21.15.80:0/505447570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c031600 con 0x7f48340b0ca0 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4831d9b640 1 -- 172.21.15.80:0/505447570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c0319d0 con 0x7f48340b0ca0 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4838984640 1 -- 172.21.15.80:0/505447570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 msgr2=0x7f48340b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4838984640 1 --2- 172.21.15.80:0/505447570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f48340b58f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f482c009e50 tx=0x7f482c02a710 comp rx=0 tx=0).stop 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4838984640 1 -- 172.21.15.80:0/505447570 shutdown_connections 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4838984640 1 --2- 172.21.15.80:0/505447570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f48340b58f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4838984640 1 --2- 172.21.15.80:0/505447570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f483406dce0 0x7f48340b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.020+0000 7f4838984640 1 -- 172.21.15.80:0/505447570 >> 172.21.15.80:0/505447570 conn(0x7f48340734b0 msgr2=0x7f48340738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.021+0000 7f4838984640 1 -- 172.21.15.80:0/505447570 shutdown_connections 2024-04-25T15:43:46.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.021+0000 7f4838984640 1 -- 172.21.15.80:0/505447570 wait complete. 2024-04-25T15:43:46.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.022+0000 7f4838984640 1 Processor -- start 2024-04-25T15:43:46.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.023+0000 7f4838984640 1 -- start start 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4838984640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f483414a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4838984640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483415cc80 0x7f483409e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4838984640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48341e6ec0 0x7f4834159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4838984640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f483415d090 con 0x7f48340b0ca0 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4838984640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f48340b50f0 con 0x7f483415cc80 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4838984640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f48340b10b0 con 0x7f48341e6ec0 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f483414a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f483414a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36642/0 (socket says 172.21.15.80:36642) 2024-04-25T15:43:46.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 -- 172.21.15.80:0/2586687008 learned_addr learned my addr 172.21.15.80:0/2586687008 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4832d9d640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48341e6ec0 0x7f4834159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f4829d9b640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483415cc80 0x7f483409e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 -- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48341e6ec0 msgr2=0x7f4834159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48341e6ec0 0x7f4834159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 -- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483415cc80 msgr2=0x7f483409e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483415cc80 0x7f483409e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 -- 172.21.15.80:0/2586687008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483409ec90 con 0x7f48340b0ca0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.024+0000 7f483259c640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f483414a3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f482400c430 tx=0x7f482400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.025+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48240074e0 con 0x7f48340b0ca0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.025+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48240047e0 con 0x7f48340b0ca0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.025+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483409ef70 con 0x7f48340b0ca0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.025+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824004bd0 con 0x7f48340b0ca0 2024-04-25T15:43:46.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.025+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483409cdc0 con 0x7f48340b0ca0 2024-04-25T15:43:46.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.026+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4834070ad0 con 0x7f48340b0ca0 2024-04-25T15:43:46.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.026+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4824011070 con 0x7f48340b0ca0 2024-04-25T15:43:46.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.027+0000 7f482b7fe640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f48140744e0 0x7f48140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.027+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4824095040 con 0x7f48340b0ca0 2024-04-25T15:43:46.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.027+0000 7f4829d9b640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f48140744e0 0x7f48140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.027+0000 7f4829d9b640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f48140744e0 0x7f48140769f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48341e8220 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.031+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4834070ad0 con 0x7f48340b0ca0 2024-04-25T15:43:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.204+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f483406a100 con 0x7f48340b0ca0 2024-04-25T15:43:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.204+0000 7f482b7fe640 1 -- 172.21.15.80:0/2586687008 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f482405ee20 con 0x7f48340b0ca0 2024-04-25T15:43:46.206 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f48140744e0 msgr2=0x7f48140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f48140744e0 0x7f48140769f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48341e8220 tx=0x7f481c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 msgr2=0x7f483414a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f483414a3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f482400c430 tx=0x7f482400c8f0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 shutdown_connections 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f48140744e0 0x7f48140769f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48341e6ec0 0x7f4834159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483415cc80 0x7f483409e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 --2- 172.21.15.80:0/2586687008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48340b0ca0 0x7f483414a3f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 >> 172.21.15.80:0/2586687008 conn(0x7f48340734b0 msgr2=0x7f48340b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 shutdown_connections 2024-04-25T15:43:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.206+0000 7f4838984640 1 -- 172.21.15.80:0/2586687008 wait complete. 2024-04-25T15:43:46.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.328+0000 7f7e7eb06640 1 Processor -- start 2024-04-25T15:43:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.328+0000 7f7e7eb06640 1 -- start start 2024-04-25T15:43:46.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.329+0000 7f7e7eb06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780cfe80 0x7f7e780cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.329+0000 7f7e7eb06640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e780d0290 con 0x7f7e780d2870 2024-04-25T15:43:46.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.329+0000 7f7e7eb06640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e780b4770 con 0x7f7e7806eb70 2024-04-25T15:43:46.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.329+0000 7f7e7eb06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7806d6d0 con 0x7f7e780cfe80 2024-04-25T15:43:46.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.329+0000 7f7e77fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7e780d2870 0x7f7e780d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47648/0 (socket says 172.21.15.80:47648) 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.329+0000 7f7e77fff640 1 -- 172.21.15.80:0/58814691 learned_addr learned my addr 172.21.15.80:0/58814691 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e7c8a2640 1 --2- 172.21.15.80:0/58814691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780cfe80 0x7f7e780cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367040822 0 0) 0x7f7e780d0290 con 0x7f7e780d2870 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e68003520 con 0x7f7e780d2870 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255309885 0 0) 0x7f7e780b4770 con 0x7f7e7806eb70 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e780d0290 con 0x7f7e7806eb70 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1436416965 0 0) 0x7f7e68003520 con 0x7f7e780d2870 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/58814691 >> v1:172.21.15.195:6789/0 conn(0x7f7e7806eb70 legacy=0x7f7e78166c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/58814691 >> v1:172.21.15.80:6789/0 conn(0x7f7e780d2870 legacy=0x7f7e780d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.330+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/58814691 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e780b4a50 con 0x7f7e780cfe80 2024-04-25T15:43:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.331+0000 7f7e7c8a2640 1 --2- 172.21.15.80:0/58814691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780cfe80 0x7f7e780cf280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097d0 tx=0x7f7e6c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1299572257ea2c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.331+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c037070 con 0x7f7e780cfe80 2024-04-25T15:43:46.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.331+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c02ab90 con 0x7f7e780cfe80 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.331+0000 7f7e777fe640 1 -- 172.21.15.80:0/58814691 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64001670 con 0x7f7e780cfe80 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.331+0000 7f7e7eb06640 1 -- 172.21.15.80:0/58814691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780cfe80 msgr2=0x7f7e780cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.331+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/58814691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780cfe80 0x7f7e780cf280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097d0 tx=0x7f7e6c02a100 comp rx=0 tx=0).stop 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.332+0000 7f7e7eb06640 1 -- 172.21.15.80:0/58814691 shutdown_connections 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.332+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/58814691 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780cfe80 0x7f7e780cf280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.332+0000 7f7e7eb06640 1 -- 172.21.15.80:0/58814691 >> 172.21.15.80:0/58814691 conn(0x7f7e780b75f0 msgr2=0x7f7e780b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.332+0000 7f7e7eb06640 1 -- 172.21.15.80:0/58814691 shutdown_connections 2024-04-25T15:43:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.332+0000 7f7e7eb06640 1 -- 172.21.15.80:0/58814691 wait complete. 2024-04-25T15:43:46.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.333+0000 7f7e7eb06640 1 Processor -- start 2024-04-25T15:43:46.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.333+0000 7f7e7eb06640 1 -- start start 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 0x7f7e7815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e780cfe80 0x7f7e78157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780d2870 0x7f7e7809d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7e780d2170 con 0x7f7e7806eb70 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7e780cf9d0 con 0x7f7e780cfe80 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e780d22f0 con 0x7f7e780d2870 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 0x7f7e7815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 0x7f7e7815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36654/0 (socket says 172.21.15.80:36654) 2024-04-25T15:43:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/529820625 learned_addr learned my addr 172.21.15.80:0/529820625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e77fff640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e780cfe80 0x7f7e78157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7d0a3640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780d2870 0x7f7e7809d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780d2870 msgr2=0x7f7e7809d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780d2870 0x7f7e7809d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e780cfe80 msgr2=0x7f7e78157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e780cfe80 0x7f7e78157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 -- 172.21.15.80:0/529820625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7815b990 con 0x7f7e7806eb70 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7d0a3640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780d2870 0x7f7e7809d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7c8a2640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 0x7f7e7815efa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097d0 tx=0x7f7e6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c037050 con 0x7f7e7806eb70 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c043070 con 0x7f7e7806eb70 2024-04-25T15:43:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7815b6b0 con 0x7f7e7806eb70 2024-04-25T15:43:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.335+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c006e10 con 0x7f7e7806eb70 2024-04-25T15:43:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.336+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7815e7a0 con 0x7f7e7806eb70 2024-04-25T15:43:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.336+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7815e2c0 con 0x7f7e7806eb70 2024-04-25T15:43:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.337+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7e6c03ca30 con 0x7f7e7806eb70 2024-04-25T15:43:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.337+0000 7f7e757fa640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7e5c0744e0 0x7f7e5c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.338+0000 7f7e77fff640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7e5c0744e0 0x7f7e5c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.338+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7e6c0b6080 con 0x7f7e7806eb70 2024-04-25T15:43:46.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.338+0000 7f7e77fff640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7e5c0744e0 0x7f7e5c0769f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000fd0 tx=0x7f7e64001150 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.342+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e7815b990 con 0x7f7e7806eb70 2024-04-25T15:43:46.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.517+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7e7806a100 con 0x7f7e7806eb70 2024-04-25T15:43:46.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.517+0000 7f7e757fa640 1 -- 172.21.15.80:0/529820625 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f7e6c080410 con 0x7f7e7806eb70 2024-04-25T15:43:46.518 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:46.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7e5c0744e0 msgr2=0x7f7e5c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7e5c0744e0 0x7f7e5c0769f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000fd0 tx=0x7f7e64001150 comp rx=0 tx=0).stop 2024-04-25T15:43:46.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 msgr2=0x7f7e7815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 0x7f7e7815efa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097d0 tx=0x7f7e6c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 shutdown_connections 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7e5c0744e0 0x7f7e5c0769f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e780d2870 0x7f7e7809d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e780cfe80 0x7f7e78157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 --2- 172.21.15.80:0/529820625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7806eb70 0x7f7e7815efa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 >> 172.21.15.80:0/529820625 conn(0x7f7e780b75f0 msgr2=0x7f7e780b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 shutdown_connections 2024-04-25T15:43:46.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.519+0000 7f7e7eb06640 1 -- 172.21.15.80:0/529820625 wait complete. 2024-04-25T15:43:46.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:46.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.640+0000 7fd553996640 1 Processor -- start 2024-04-25T15:43:46.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.640+0000 7fd553996640 1 -- start start 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd553996640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd54c160280 0x7fd54c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd553996640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c0d1aa0 0x7fd54c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd553996640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c0d2ad0 con 0x7fd54c161870 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd553996640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c0d1eb0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd553996640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c163f60 con 0x7fd54c160280 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd551f33640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c0d1aa0 0x7fd54c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd551f33640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c0d1aa0 0x7fd54c06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36662/0 (socket says 172.21.15.80:36662) 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd551f33640 1 -- 172.21.15.80:0/1408744440 learned_addr learned my addr 172.21.15.80:0/1408744440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.641+0000 7fd551732640 1 --1- 172.21.15.80:0/1408744440 >> v1:172.21.15.80:6789/0 conn(0x7fd54c161870 0x7fd54c0d23c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47664/0 (socket says 172.21.15.80:47664) 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd550f31640 1 --2- 172.21.15.80:0/1408744440 >> v2:172.21.15.195:3300/0 conn(0x7fd54c160280 0x7fd54c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd551f33640 1 -- 172.21.15.80:0/1408744440 >> v2:172.21.15.195:3300/0 conn(0x7fd54c160280 msgr2=0x7fd54c0d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd551f33640 1 --2- 172.21.15.80:0/1408744440 >> v2:172.21.15.195:3300/0 conn(0x7fd54c160280 0x7fd54c0d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd551f33640 1 -- 172.21.15.80:0/1408744440 >> v1:172.21.15.80:6789/0 conn(0x7fd54c161870 legacy=0x7fd54c0d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd551f33640 1 -- 172.21.15.80:0/1408744440 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c164240 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd543fff640 1 -- 172.21.15.80:0/1408744440 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273008625 0 0) 0x7fd54c0d2ad0 con 0x7fd54c161870 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.642+0000 7fd551f33640 1 --2- 172.21.15.80:0/1408744440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c06e240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0d2ca0 tx=0x7fd54402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a424f0d759ee58b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd543fff640 1 -- 172.21.15.80:0/1408744440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544036070 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd543fff640 1 -- 172.21.15.80:0/1408744440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544031600 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd543fff640 1 -- 172.21.15.80:0/1408744440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440319d0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 -- 172.21.15.80:0/1408744440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 msgr2=0x7fd54c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 --2- 172.21.15.80:0/1408744440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c06e240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0d2ca0 tx=0x7fd54402a730 comp rx=0 tx=0).stop 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 -- 172.21.15.80:0/1408744440 shutdown_connections 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 --2- 172.21.15.80:0/1408744440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c06e240 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 --2- 172.21.15.80:0/1408744440 >> v2:172.21.15.195:3300/0 conn(0x7fd54c160280 0x7fd54c0d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 -- 172.21.15.80:0/1408744440 >> 172.21.15.80:0/1408744440 conn(0x7fd54c0b54a0 msgr2=0x7fd54c0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 -- 172.21.15.80:0/1408744440 shutdown_connections 2024-04-25T15:43:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.643+0000 7fd553996640 1 -- 172.21.15.80:0/1408744440 wait complete. 2024-04-25T15:43:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.645+0000 7fd553996640 1 Processor -- start 2024-04-25T15:43:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.645+0000 7fd553996640 1 -- start start 2024-04-25T15:43:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd553996640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd553996640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd54c160280 0x7fd54c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd553996640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd54c161870 0x7fd54c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd553996640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b2ec0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd553996640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c164800 con 0x7fd54c160280 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd553996640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0b3040 con 0x7fd54c161870 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.646+0000 7fd551732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36664/0 (socket says 172.21.15.80:36664) 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 -- 172.21.15.80:0/2453675788 learned_addr learned my addr 172.21.15.80:0/2453675788 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd550f31640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd54c160280 0x7fd54c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551f33640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd54c161870 0x7fd54c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 -- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd54c161870 msgr2=0x7fd54c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd54c161870 0x7fd54c0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 -- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd54c160280 msgr2=0x7fd54c14a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd54c160280 0x7fd54c14a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 -- 172.21.15.80:0/2453675788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0c9910 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd551732640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c14dce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c410 tx=0x7fd54800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5480074e0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5480047e0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c0c9bf0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548004bd0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.647+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c0ca1b0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.648+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c06a100 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.649+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd548011070 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.649+0000 7fd541ffb640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5300744b0 0x7fd5300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.650+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd5480951b0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.650+0000 7fd550f31640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5300744b0 0x7fd5300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.650+0000 7fd550f31640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5300744b0 0x7fd5300769c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd54c1f99c0 tx=0x7fd53c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.654+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd54805eef0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.829+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd54c06dde0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.830+0000 7fd541ffb640 1 -- 172.21.15.80:0/2453675788 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fd5480631f0 con 0x7fd54c0d1aa0 2024-04-25T15:43:46.831 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5300744b0 msgr2=0x7fd5300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5300744b0 0x7fd5300769c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd54c1f99c0 tx=0x7fd53c009190 comp rx=0 tx=0).stop 2024-04-25T15:43:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 msgr2=0x7fd54c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c14dce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c410 tx=0x7fd54800c8d0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 shutdown_connections 2024-04-25T15:43:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5300744b0 0x7fd5300769c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd54c161870 0x7fd54c0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd54c160280 0x7fd54c14a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 --2- 172.21.15.80:0/2453675788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c0d1aa0 0x7fd54c14dce0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 >> 172.21.15.80:0/2453675788 conn(0x7fd54c0b54a0 msgr2=0x7fd54c15f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 shutdown_connections 2024-04-25T15:43:46.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.832+0000 7fd553996640 1 -- 172.21.15.80:0/2453675788 wait complete. 2024-04-25T15:43:46.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:46.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.950+0000 7ff3efd06640 1 Processor -- start 2024-04-25T15:43:46.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.950+0000 7ff3efd06640 1 -- start start 2024-04-25T15:43:46.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3efd06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80ce220 0x7ff3e809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3efd06640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3e80cf960 0x7ff3e80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3efd06640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3e80b1ef0 0x7ff3e80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3efd06640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80cf4d0 con 0x7ff3e80cf960 2024-04-25T15:43:46.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3efd06640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80ce630 con 0x7ff3e80b1ef0 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3efd06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e81607c0 con 0x7ff3e80ce220 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3e80cf960 0x7ff3e80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3e80cf960 0x7ff3e80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36680/0 (socket says 172.21.15.80:36680) 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 -- 172.21.15.80:0/3060998495 learned_addr learned my addr 172.21.15.80:0/3060998495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 -- 172.21.15.80:0/3060998495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80ce220 msgr2=0x7ff3e809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3edaa2640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80ce220 0x7ff3e809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ee2a3640 1 --2- 172.21.15.80:0/3060998495 >> v2:172.21.15.195:3300/0 conn(0x7ff3e80b1ef0 0x7ff3e80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80ce220 0x7ff3e809bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 -- 172.21.15.80:0/3060998495 >> v2:172.21.15.195:3300/0 conn(0x7ff3e80b1ef0 msgr2=0x7ff3e80b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 --2- 172.21.15.80:0/3060998495 >> v2:172.21.15.195:3300/0 conn(0x7ff3e80b1ef0 0x7ff3e80b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ed2a1640 1 -- 172.21.15.80:0/3060998495 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80ceba0 con 0x7ff3e80cf960 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3edaa2640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80ce220 0x7ff3e809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.952+0000 7ff3ee2a3640 1 --2- 172.21.15.80:0/3060998495 >> v2:172.21.15.195:3300/0 conn(0x7ff3e80b1ef0 0x7ff3e80b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.953+0000 7ff3ed2a1640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80cfd70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8074300 tx=0x7ff3d802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bba35fdcd74f384 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.953+0000 7ff3ecaa0640 1 -- 172.21.15.80:0/3060998495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8037070 con 0x7ff3e80cf960 2024-04-25T15:43:46.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.953+0000 7ff3ecaa0640 1 -- 172.21.15.80:0/3060998495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d8032440 con 0x7ff3e80cf960 2024-04-25T15:43:46.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.953+0000 7ff3ecaa0640 1 -- 172.21.15.80:0/3060998495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8032810 con 0x7ff3e80cf960 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 -- 172.21.15.80:0/3060998495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 msgr2=0x7ff3e80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80cfd70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8074300 tx=0x7ff3d802a290 comp rx=0 tx=0).stop 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 -- 172.21.15.80:0/3060998495 shutdown_connections 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 --2- 172.21.15.80:0/3060998495 >> v2:172.21.15.195:3300/0 conn(0x7ff3e80b1ef0 0x7ff3e80b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80cfd70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 --2- 172.21.15.80:0/3060998495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80ce220 0x7ff3e809bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 -- 172.21.15.80:0/3060998495 >> 172.21.15.80:0/3060998495 conn(0x7ff3e80b7620 msgr2=0x7ff3e80b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 -- 172.21.15.80:0/3060998495 shutdown_connections 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.954+0000 7ff3efd06640 1 -- 172.21.15.80:0/3060998495 wait complete. 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.956+0000 7ff3efd06640 1 Processor -- start 2024-04-25T15:43:46.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.956+0000 7ff3efd06640 1 -- start start 2024-04-25T15:43:46.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3efd06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80b1ef0 0x7ff3e80b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3efd06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80ce220 0x7ff3e80af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3efd06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3efd06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e809c0b0 con 0x7ff3e80cf960 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3efd06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80cf160 con 0x7ff3e80ce220 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3efd06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80d3530 con 0x7ff3e80b1ef0 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3ee2a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3ee2a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36690/0 (socket says 172.21.15.80:36690) 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3ee2a3640 1 -- 172.21.15.80:0/1543840969 learned_addr learned my addr 172.21.15.80:0/1543840969 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3edaa2640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80b1ef0 0x7ff3e80b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.957+0000 7ff3ed2a1640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80ce220 0x7ff3e80af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3ee2a3640 1 -- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80b1ef0 msgr2=0x7ff3e80b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3ee2a3640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80b1ef0 0x7ff3e80b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3ee2a3640 1 -- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80ce220 msgr2=0x7ff3e80af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3ee2a3640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80ce220 0x7ff3e80af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:46.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3ee2a3640 1 -- 172.21.15.80:0/1543840969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e814d530 con 0x7ff3e80cf960 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3ee2a3640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80afba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c520 tx=0x7ff3e000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0015070 con 0x7ff3e80cf960 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e0011800 con 0x7ff3e80cf960 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0011bf0 con 0x7ff3e80cf960 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e814d9f0 con 0x7ff3e80cf960 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.958+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e80cc290 con 0x7ff3e80cf960 2024-04-25T15:43:46.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.959+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e80c9d10 con 0x7ff3e80cf960 2024-04-25T15:43:46.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.960+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff3e0018070 con 0x7ff3e80cf960 2024-04-25T15:43:46.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.960+0000 7ff3de7fc640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3cc0744b0 0x7ff3cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:46.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.960+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff3e0095390 con 0x7ff3e80cf960 2024-04-25T15:43:46.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.960+0000 7ff3edaa2640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3cc0744b0 0x7ff3cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:46.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.960+0000 7ff3edaa2640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3cc0744b0 0x7ff3cc0769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400f500 tx=0x7ff3e4007770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:46.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:46.965+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3e005f0d0 con 0x7ff3e80cf960 2024-04-25T15:43:47.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.143+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3e806a100 con 0x7ff3e80cf960 2024-04-25T15:43:47.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.145+0000 7ff3de7fc640 1 -- 172.21.15.80:0/1543840969 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7ff3e00633d0 con 0x7ff3e80cf960 2024-04-25T15:43:47.146 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:47.146 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.146+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3cc0744b0 msgr2=0x7ff3cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.146+0000 7ff3efd06640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3cc0744b0 0x7ff3cc0769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400f500 tx=0x7ff3e4007770 comp rx=0 tx=0).stop 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.146+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 msgr2=0x7ff3e80afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.146+0000 7ff3efd06640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80afba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c520 tx=0x7ff3e000c9e0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 shutdown_connections 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3cc0744b0 0x7ff3cc0769c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e80cf960 0x7ff3e80afba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80ce220 0x7ff3e80af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 --2- 172.21.15.80:0/1543840969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80b1ef0 0x7ff3e80b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 >> 172.21.15.80:0/1543840969 conn(0x7ff3e80b7620 msgr2=0x7ff3e80b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 shutdown_connections 2024-04-25T15:43:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.147+0000 7ff3efd06640 1 -- 172.21.15.80:0/1543840969 wait complete. 2024-04-25T15:43:47.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:47.160 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.270+0000 7fa332946640 1 Processor -- start 2024-04-25T15:43:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.270+0000 7fa332946640 1 -- start start 2024-04-25T15:43:47.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa332946640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa32c0d31a0 0x7fa32c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa332946640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa32c0b3bf0 0x7fa32c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa332946640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32c161770 con 0x7fa32c0b24a0 2024-04-25T15:43:47.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa332946640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c0b28b0 con 0x7fa32c0d31a0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa332946640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c0b40f0 con 0x7fa32c0b3bf0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa32c0d31a0 0x7fa32c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa32c0d31a0 0x7fa32c0b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36702/0 (socket says 172.21.15.80:36702) 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 -- 172.21.15.80:0/2060797064 learned_addr learned my addr 172.21.15.80:0/2060797064 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32b7fe640 1 --2- 172.21.15.80:0/2060797064 >> v2:172.21.15.195:3300/0 conn(0x7fa32c0b3bf0 0x7fa32c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 -- 172.21.15.80:0/2060797064 >> v2:172.21.15.195:3300/0 conn(0x7fa32c0b3bf0 msgr2=0x7fa32c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 --2- 172.21.15.80:0/2060797064 >> v2:172.21.15.195:3300/0 conn(0x7fa32c0b3bf0 0x7fa32c0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 -- 172.21.15.80:0/2060797064 >> v1:172.21.15.195:6789/0 conn(0x7fa32c0b24a0 legacy=0x7fa32c163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.271+0000 7fa32bfff640 1 -- 172.21.15.80:0/2060797064 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0d26c0 con 0x7fa32c0d31a0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.272+0000 7fa32bfff640 1 --2- 172.21.15.80:0/2060797064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c0d31a0 0x7fa32c0b1a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa32c163d90 tx=0x7fa31c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5b8b9848e8c8c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.272+0000 7fa32affd640 1 -- 172.21.15.80:0/2060797064 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c037070 con 0x7fa32c0d31a0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.272+0000 7fa32affd640 1 -- 172.21.15.80:0/2060797064 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31c032440 con 0x7fa32c0d31a0 2024-04-25T15:43:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.272+0000 7fa32affd640 1 -- 172.21.15.80:0/2060797064 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c032810 con 0x7fa32c0d31a0 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 -- 172.21.15.80:0/2060797064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c0d31a0 msgr2=0x7fa32c0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 --2- 172.21.15.80:0/2060797064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c0d31a0 0x7fa32c0b1a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa32c163d90 tx=0x7fa31c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 -- 172.21.15.80:0/2060797064 shutdown_connections 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 --2- 172.21.15.80:0/2060797064 >> v2:172.21.15.195:3300/0 conn(0x7fa32c0b3bf0 0x7fa32c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 --2- 172.21.15.80:0/2060797064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c0d31a0 0x7fa32c0b1a20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 -- 172.21.15.80:0/2060797064 >> 172.21.15.80:0/2060797064 conn(0x7fa32c0b7640 msgr2=0x7fa32c0b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 -- 172.21.15.80:0/2060797064 shutdown_connections 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.273+0000 7fa332946640 1 -- 172.21.15.80:0/2060797064 wait complete. 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.275+0000 7fa332946640 1 Processor -- start 2024-04-25T15:43:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.275+0000 7fa332946640 1 -- start start 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa332946640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa32c0b24a0 0x7fa32c1f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa332946640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa32c0b3bf0 0x7fa32c1f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa332946640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 0x7fa32c162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa332946640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c06ef50 con 0x7fa32c1f6b10 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa332946640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c0d2c80 con 0x7fa32c0b24a0 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa332946640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c0b37f0 con 0x7fa32c0b3bf0 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa330ee3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 0x7fa32c162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa330ee3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 0x7fa32c162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36712/0 (socket says 172.21.15.80:36712) 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.276+0000 7fa330ee3640 1 -- 172.21.15.80:0/2074995957 learned_addr learned my addr 172.21.15.80:0/2074995957 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa32bfff640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa32c0b24a0 0x7fa32c1f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa32b7fe640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa32c0b3bf0 0x7fa32c1f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa330ee3640 1 -- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa32c0b3bf0 msgr2=0x7fa32c1f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa330ee3640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa32c0b3bf0 0x7fa32c1f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa330ee3640 1 -- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa32c0b24a0 msgr2=0x7fa32c1f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa330ee3640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa32c0b24a0 0x7fa32c1f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa330ee3640 1 -- 172.21.15.80:0/2074995957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c1f7340 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa330ee3640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 0x7fa32c162310 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa32400c6e0 tx=0x7fa32400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324003b70 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa324003d30 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c1f6200 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324005310 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.277+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c15bc20 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.278+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c06a100 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.278+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa3240054b0 con 0x7fa32c1f6b10 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.279+0000 7fa328ff9640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3180744e0 0x7fa3180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.279+0000 7fa32bfff640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3180744e0 0x7fa3180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.279+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa324095410 con 0x7fa32c1f6b10 2024-04-25T15:43:47.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.279+0000 7fa32bfff640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3180744e0 0x7fa3180769f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa31c034000 tx=0x7fa31c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.284+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa32405f830 con 0x7fa32c1f6b10 2024-04-25T15:43:47.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.456+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa32c1f70d0 con 0x7fa32c1f6b10 2024-04-25T15:43:47.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.456+0000 7fa328ff9640 1 -- 172.21.15.80:0/2074995957 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa32405f130 con 0x7fa32c1f6b10 2024-04-25T15:43:47.457 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:47.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3180744e0 msgr2=0x7fa3180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3180744e0 0x7fa3180769f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa31c034000 tx=0x7fa31c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 msgr2=0x7fa32c162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 0x7fa32c162310 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa32400c6e0 tx=0x7fa32400cba0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 shutdown_connections 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3180744e0 0x7fa3180769f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c1f6b10 0x7fa32c162310 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa32c0b3bf0 0x7fa32c1f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 --2- 172.21.15.80:0/2074995957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa32c0b24a0 0x7fa32c1f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 >> 172.21.15.80:0/2074995957 conn(0x7fa32c0b7640 msgr2=0x7fa32c161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 shutdown_connections 2024-04-25T15:43:47.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.458+0000 7fa332946640 1 -- 172.21.15.80:0/2074995957 wait complete. 2024-04-25T15:43:47.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:47.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.579+0000 7f651aa49640 1 Processor -- start 2024-04-25T15:43:47.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.579+0000 7f651aa49640 1 -- start start 2024-04-25T15:43:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f651aa49640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140d1600 0x7f65140d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f651aa49640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65140d1f50 con 0x7f65140718d0 2024-04-25T15:43:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f651aa49640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65140ce890 con 0x7f65140cf930 2024-04-25T15:43:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f651aa49640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65140cf4a0 con 0x7f65140d1600 2024-04-25T15:43:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6518fe6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f65140718d0 0x7f6514071ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47678/0 (socket says 172.21.15.80:47678) 2024-04-25T15:43:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6518fe6640 1 -- 172.21.15.80:0/3498527399 learned_addr learned my addr 172.21.15.80:0/3498527399 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f65137fe640 1 --2- 172.21.15.80:0/3498527399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140d1600 0x7f65140d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017824310 0 0) 0x7f650c001490 con 0x7f65140718d0 2024-04-25T15:43:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64fc003520 con 0x7f65140718d0 2024-04-25T15:43:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241878540 0 0) 0x7f65140ce890 con 0x7f65140cf930 2024-04-25T15:43:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f650c001490 con 0x7f65140cf930 2024-04-25T15:43:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f65137fe640 1 -- 172.21.15.80:0/3498527399 >> v1:172.21.15.195:6789/0 conn(0x7f65140cf930 legacy=0x7f6514160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f65137fe640 1 -- 172.21.15.80:0/3498527399 >> v1:172.21.15.80:6789/0 conn(0x7f65140718d0 legacy=0x7f6514071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1193326294 0 0) 0x7f64fc003520 con 0x7f65140718d0 2024-04-25T15:43:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.581+0000 7f65137fe640 1 -- 172.21.15.80:0/3498527399 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65140ceb70 con 0x7f65140d1600 2024-04-25T15:43:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.582+0000 7f65137fe640 1 --2- 172.21.15.80:0/3498527399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140d1600 0x7f65140d1a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f65140cf620 tx=0x7f650802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b64a47e2b613da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.582+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508037070 con 0x7f65140d1600 2024-04-25T15:43:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.582+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650802ac10 con 0x7f65140d1600 2024-04-25T15:43:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.582+0000 7f6512ffd640 1 -- 172.21.15.80:0/3498527399 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c001bc0 con 0x7f65140d1600 2024-04-25T15:43:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 -- 172.21.15.80:0/3498527399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140d1600 msgr2=0x7f65140d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 --2- 172.21.15.80:0/3498527399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140d1600 0x7f65140d1a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f65140cf620 tx=0x7f650802a180 comp rx=0 tx=0).stop 2024-04-25T15:43:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 -- 172.21.15.80:0/3498527399 shutdown_connections 2024-04-25T15:43:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 --2- 172.21.15.80:0/3498527399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140d1600 0x7f65140d1a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 -- 172.21.15.80:0/3498527399 >> 172.21.15.80:0/3498527399 conn(0x7f65140d3a30 msgr2=0x7f65140d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 -- 172.21.15.80:0/3498527399 shutdown_connections 2024-04-25T15:43:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.583+0000 7f651aa49640 1 -- 172.21.15.80:0/3498527399 wait complete. 2024-04-25T15:43:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.585+0000 7f651aa49640 1 Processor -- start 2024-04-25T15:43:47.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.585+0000 7f651aa49640 1 -- start start 2024-04-25T15:43:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f651aa49640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140718d0 0x7f65141623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f651aa49640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 0x7f65141469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f651aa49640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65140d1600 0x7f6514147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f651aa49640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65140cf130 con 0x7f65140cf930 2024-04-25T15:43:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f651aa49640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f65140cfd40 con 0x7f65140d1600 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f651aa49640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f651406d6d0 con 0x7f65140718d0 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f65137fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 0x7f65141469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f65137fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 0x7f65141469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36726/0 (socket says 172.21.15.80:36726) 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.586+0000 7f65137fe640 1 -- 172.21.15.80:0/2567245264 learned_addr learned my addr 172.21.15.80:0/2567245264 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f6513fff640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140718d0 0x7f65141623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f6518fe6640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65140d1600 0x7f6514147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f65137fe640 1 -- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140718d0 msgr2=0x7f65141623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f65137fe640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140718d0 0x7f65141623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f65137fe640 1 -- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65140d1600 msgr2=0x7f6514147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f65137fe640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65140d1600 0x7f6514147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f65137fe640 1 -- 172.21.15.80:0/2567245264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6514161320 con 0x7f65140cf930 2024-04-25T15:43:47.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f65137fe640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 0x7f65141469e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f65080098c0 tx=0x7f65080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508042020 con 0x7f65140cf930 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650803d670 con 0x7f65140cf930 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508037040 con 0x7f65140cf930 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6514161600 con 0x7f65140cf930 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.587+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6514161bc0 con 0x7f65140cf930 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.588+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651406a100 con 0x7f65140cf930 2024-04-25T15:43:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.589+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6508045020 con 0x7f65140cf930 2024-04-25T15:43:47.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.589+0000 7f6510ff9640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65000744b0 0x7f65000769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.589+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f65080b5fd0 con 0x7f65140cf930 2024-04-25T15:43:47.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.589+0000 7f6513fff640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65000744b0 0x7f65000769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.590+0000 7f6513fff640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65000744b0 0x7f65000769c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65040011e0 tx=0x7f6504009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.594+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f650804c030 con 0x7f65140cf930 2024-04-25T15:43:47.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.769+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f65140b99b0 con 0x7f65140cf930 2024-04-25T15:43:47.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.769+0000 7f6510ff9640 1 -- 172.21.15.80:0/2567245264 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f65080802e0 con 0x7f65140cf930 2024-04-25T15:43:47.770 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65000744b0 msgr2=0x7f65000769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65000744b0 0x7f65000769c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65040011e0 tx=0x7f6504009040 comp rx=0 tx=0).stop 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 msgr2=0x7f65141469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 0x7f65141469e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f65080098c0 tx=0x7f65080046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 shutdown_connections 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65000744b0 0x7f65000769c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65140d1600 0x7f6514147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65140cf930 0x7f65141469e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 --2- 172.21.15.80:0/2567245264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65140718d0 0x7f65141623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 >> 172.21.15.80:0/2567245264 conn(0x7f65140d3a30 msgr2=0x7f65140b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 shutdown_connections 2024-04-25T15:43:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.771+0000 7f651aa49640 1 -- 172.21.15.80:0/2567245264 wait complete. 2024-04-25T15:43:47.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:47.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.894+0000 7ff5553c5640 1 Processor -- start 2024-04-25T15:43:47.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.894+0000 7ff5553c5640 1 -- start start 2024-04-25T15:43:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.895+0000 7ff5553c5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55009b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.895+0000 7ff5553c5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff55006dae0 0x7ff55009bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.895+0000 7ff5553c5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff5500cf360 0x7ff5500cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.895+0000 7ff5553c5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff55006e050 con 0x7ff55006dae0 2024-04-25T15:43:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.895+0000 7ff5553c5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff55006e310 con 0x7ff5500cf360 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.895+0000 7ff5553c5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff55006e5f0 con 0x7ff55006d6d0 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff55006dae0 0x7ff55009bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff55006dae0 0x7ff55009bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36732/0 (socket says 172.21.15.80:36732) 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 -- 172.21.15.80:0/1603912251 learned_addr learned my addr 172.21.15.80:0/1603912251 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54effd640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55009b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54f7fe640 1 --2- 172.21.15.80:0/1603912251 >> v2:172.21.15.195:3300/0 conn(0x7ff5500cf360 0x7ff5500cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 -- 172.21.15.80:0/1603912251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 msgr2=0x7ff55009b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55009b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 -- 172.21.15.80:0/1603912251 >> v2:172.21.15.195:3300/0 conn(0x7ff5500cf360 msgr2=0x7ff5500cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 --2- 172.21.15.80:0/1603912251 >> v2:172.21.15.195:3300/0 conn(0x7ff5500cf360 0x7ff5500cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54e7fc640 1 -- 172.21.15.80:0/1603912251 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5500d0570 con 0x7ff55006dae0 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54effd640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55009b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.896+0000 7ff54f7fe640 1 --2- 172.21.15.80:0/1603912251 >> v2:172.21.15.195:3300/0 conn(0x7ff5500cf360 0x7ff5500cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff54e7fc640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55006dae0 0x7ff55009bb50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5500d25d0 tx=0x7ff54402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319cfc2e2c6d257c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff54dffb640 1 -- 172.21.15.80:0/1603912251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544037070 con 0x7ff55006dae0 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff54dffb640 1 -- 172.21.15.80:0/1603912251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54402ae00 con 0x7ff55006dae0 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff54dffb640 1 -- 172.21.15.80:0/1603912251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544032660 con 0x7ff55006dae0 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff5553c5640 1 -- 172.21.15.80:0/1603912251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55006dae0 msgr2=0x7ff55009bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff5553c5640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55006dae0 0x7ff55009bb50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5500d25d0 tx=0x7ff54402a0b0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff5553c5640 1 -- 172.21.15.80:0/1603912251 shutdown_connections 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff5553c5640 1 --2- 172.21.15.80:0/1603912251 >> v2:172.21.15.195:3300/0 conn(0x7ff5500cf360 0x7ff5500cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff5553c5640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55006dae0 0x7ff55009bb50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.897+0000 7ff5553c5640 1 --2- 172.21.15.80:0/1603912251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55009b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.898+0000 7ff5553c5640 1 -- 172.21.15.80:0/1603912251 >> 172.21.15.80:0/1603912251 conn(0x7ff5500b7690 msgr2=0x7ff5500b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.898+0000 7ff5553c5640 1 -- 172.21.15.80:0/1603912251 shutdown_connections 2024-04-25T15:43:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.898+0000 7ff5553c5640 1 -- 172.21.15.80:0/1603912251 wait complete. 2024-04-25T15:43:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.899+0000 7ff5553c5640 1 Processor -- start 2024-04-25T15:43:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.899+0000 7ff5553c5640 1 -- start start 2024-04-25T15:43:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5553c5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5553c5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55006dae0 0x7ff55014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5553c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 0x7ff55014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5553c5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff55015d270 con 0x7ff5500cf360 2024-04-25T15:43:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5553c5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff55006ee70 con 0x7ff55006dae0 2024-04-25T15:43:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5553c5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff55015d3f0 con 0x7ff55006d6d0 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 0x7ff55014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 0x7ff55014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36748/0 (socket says 172.21.15.80:36748) 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 -- 172.21.15.80:0/2982786298 learned_addr learned my addr 172.21.15.80:0/2982786298 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54effd640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54e7fc640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55006dae0 0x7ff55014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 -- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 msgr2=0x7ff55014be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55014be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 -- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55006dae0 msgr2=0x7ff55014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55006dae0 0x7ff55014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 -- 172.21.15.80:0/2982786298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55014c380 con 0x7ff5500cf360 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff54f7fe640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 0x7ff55014ef00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff54800ccf0 tx=0x7ff54800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.901+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54800f680 con 0x7ff5500cf360 2024-04-25T15:43:47.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.902+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54800f840 con 0x7ff5500cf360 2024-04-25T15:43:47.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.902+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5501f7dc0 con 0x7ff5500cf360 2024-04-25T15:43:47.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.902+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54800fc30 con 0x7ff5500cf360 2024-04-25T15:43:47.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.902+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5501f8380 con 0x7ff5500cf360 2024-04-25T15:43:47.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.902+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55006a100 con 0x7ff5500cf360 2024-04-25T15:43:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.903+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff5480213f0 con 0x7ff5500cf360 2024-04-25T15:43:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.903+0000 7ff5377fe640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.904+0000 7ff54effd640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.904+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff5480961c0 con 0x7ff5500cf360 2024-04-25T15:43:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.904+0000 7ff54effd640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff53c0744b0 0x7ff53c0769c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff540006ab0 tx=0x7ff540008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:47.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:47.908+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff548014030 con 0x7ff5500cf360 2024-04-25T15:43:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.083+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff55014f520 con 0x7ff5500cf360 2024-04-25T15:43:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.084+0000 7ff5377fe640 1 -- 172.21.15.80:0/2982786298 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff54805ff90 con 0x7ff5500cf360 2024-04-25T15:43:48.085 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff53c0744b0 msgr2=0x7ff53c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff53c0744b0 0x7ff53c0769c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff540006ab0 tx=0x7ff540008040 comp rx=0 tx=0).stop 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 msgr2=0x7ff55014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 0x7ff55014ef00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff54800ccf0 tx=0x7ff54800a650 comp rx=0 tx=0).stop 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 shutdown_connections 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5500cf360 0x7ff55014ef00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55006dae0 0x7ff55014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 --2- 172.21.15.80:0/2982786298 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55006d6d0 0x7ff55014be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 >> 172.21.15.80:0/2982786298 conn(0x7ff5500b7690 msgr2=0x7ff550071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:48.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 shutdown_connections 2024-04-25T15:43:48.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.086+0000 7ff5553c5640 1 -- 172.21.15.80:0/2982786298 wait complete. 2024-04-25T15:43:48.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:48.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.207+0000 7f07dd0e0640 1 Processor -- start 2024-04-25T15:43:48.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.207+0000 7f07dd0e0640 1 -- start start 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07dd0e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8160240 0x7f07d80ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07dd0e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d8160650 con 0x7f07d80d3e60 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07dd0e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d80ceb30 con 0x7f07d806dfe0 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07dd0e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f07d806e9c0 con 0x7f07d8160240 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07d759e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07d80d3e60 0x7f07d80d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47694/0 (socket says 172.21.15.80:47694) 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07d759e640 1 -- 172.21.15.80:0/2589615036 learned_addr learned my addr 172.21.15.80:0/2589615036 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.208+0000 7f07d6d9d640 1 --2- 172.21.15.80:0/2589615036 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8160240 0x7f07d80ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.209+0000 7f07d5d9b640 1 -- 172.21.15.80:0/2589615036 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310276058 0 0) 0x7f07d8160650 con 0x7f07d80d3e60 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.209+0000 7f07d5d9b640 1 -- 172.21.15.80:0/2589615036 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07c0003520 con 0x7f07d80d3e60 2024-04-25T15:43:48.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.209+0000 7f07d6d9d640 1 -- 172.21.15.80:0/2589615036 >> v1:172.21.15.195:6789/0 conn(0x7f07d806dfe0 legacy=0x7f07d80d3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.209+0000 7f07d6d9d640 1 -- 172.21.15.80:0/2589615036 >> v1:172.21.15.80:6789/0 conn(0x7f07d80d3e60 legacy=0x7f07d80d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.209+0000 7f07d5d9b640 1 -- 172.21.15.80:0/2589615036 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770368236 0 0) 0x7f07d80ceb30 con 0x7f07d806dfe0 2024-04-25T15:43:48.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.209+0000 7f07d6d9d640 1 -- 172.21.15.80:0/2589615036 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d806eca0 con 0x7f07d8160240 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07d6d9d640 1 --2- 172.21.15.80:0/2589615036 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8160240 0x7f07d80ce5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07c80097d0 tx=0x7f07c802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea725bc9ca0a675d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07d5d9b640 1 -- 172.21.15.80:0/2589615036 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8037070 con 0x7f07d8160240 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07d5d9b640 1 -- 172.21.15.80:0/2589615036 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c8032440 con 0x7f07d8160240 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07d5d9b640 1 -- 172.21.15.80:0/2589615036 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c80327f0 con 0x7f07d8160240 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 -- 172.21.15.80:0/2589615036 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8160240 msgr2=0x7f07d80ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/2589615036 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8160240 0x7f07d80ce5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07c80097d0 tx=0x7f07c802a210 comp rx=0 tx=0).stop 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 -- 172.21.15.80:0/2589615036 shutdown_connections 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/2589615036 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8160240 0x7f07d80ce5f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 -- 172.21.15.80:0/2589615036 >> 172.21.15.80:0/2589615036 conn(0x7f07d80b5510 msgr2=0x7f07d80b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:48.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 -- 172.21.15.80:0/2589615036 shutdown_connections 2024-04-25T15:43:48.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.210+0000 7f07dd0e0640 1 -- 172.21.15.80:0/2589615036 wait complete. 2024-04-25T15:43:48.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.212+0000 7f07dd0e0640 1 Processor -- start 2024-04-25T15:43:48.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.213+0000 7f07dd0e0640 1 -- start start 2024-04-25T15:43:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07dd0e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d806dfe0 0x7f07d80c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07dd0e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 0x7f07d814a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07dd0e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d8160240 0x7f07d814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07dd0e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f07d80d1930 con 0x7f07d80d3e60 2024-04-25T15:43:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07dd0e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f07d80d1650 con 0x7f07d8160240 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07dd0e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f07d80b2e20 con 0x7f07d806dfe0 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 0x7f07d814a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 0x7f07d814a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36760/0 (socket says 172.21.15.80:36760) 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 -- 172.21.15.80:0/1501577651 learned_addr learned my addr 172.21.15.80:0/1501577651 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d759e640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d8160240 0x7f07d814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d6d9d640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d806dfe0 0x7f07d80c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 -- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d806dfe0 msgr2=0x7f07d80c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d806dfe0 0x7f07d80c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 -- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d8160240 msgr2=0x7f07d814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d8160240 0x7f07d814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.214+0000 7f07d659c640 1 -- 172.21.15.80:0/1501577651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d80c9220 con 0x7f07d80d3e60 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.215+0000 7f07d659c640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 0x7f07d814a600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00c410 tx=0x7f07cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.215+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc017070 con 0x7f07d80d3e60 2024-04-25T15:43:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.215+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc0035f0 con 0x7f07d80d3e60 2024-04-25T15:43:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.215+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d80c9500 con 0x7f07d80d3e60 2024-04-25T15:43:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.215+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0039e0 con 0x7f07d80d3e60 2024-04-25T15:43:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.215+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d80c9ac0 con 0x7f07d80d3e60 2024-04-25T15:43:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.216+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d814b6a0 con 0x7f07d80d3e60 2024-04-25T15:43:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.216+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f07cc01a070 con 0x7f07d80d3e60 2024-04-25T15:43:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.217+0000 7f07bf7fe640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07c40744b0 0x7f07c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.217+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f07cc0949b0 con 0x7f07d80d3e60 2024-04-25T15:43:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.217+0000 7f07d6d9d640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07c40744b0 0x7f07c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.217+0000 7f07d6d9d640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07c40744b0 0x7f07c40769c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07c8034000 tx=0x7f07c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.221+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f07cc05e700 con 0x7f07d80d3e60 2024-04-25T15:43:48.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.397+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f07d806a100 con 0x7f07d80d3e60 2024-04-25T15:43:48.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.398+0000 7f07bf7fe640 1 -- 172.21.15.80:0/1501577651 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f07cc062a00 con 0x7f07d80d3e60 2024-04-25T15:43:48.399 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:48.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.399+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07c40744b0 msgr2=0x7f07c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.399+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07c40744b0 0x7f07c40769c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07c8034000 tx=0x7f07c802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:48.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.399+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 msgr2=0x7f07d814a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.399+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 0x7f07d814a600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00c410 tx=0x7f07cc00c8d0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 shutdown_connections 2024-04-25T15:43:48.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f07c40744b0 0x7f07c40769c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d8160240 0x7f07d814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07d80d3e60 0x7f07d814a600 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 --2- 172.21.15.80:0/1501577651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d806dfe0 0x7f07d80c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 >> 172.21.15.80:0/1501577651 conn(0x7f07d80b5510 msgr2=0x7f07d80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:48.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 shutdown_connections 2024-04-25T15:43:48.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.400+0000 7f07dd0e0640 1 -- 172.21.15.80:0/1501577651 wait complete. 2024-04-25T15:43:48.437 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2024-04-25T15:43:48.437 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-25T15:43:48.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.545+0000 7ff563cb6640 1 Processor -- start 2024-04-25T15:43:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.545+0000 7ff563cb6640 1 -- start start 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff563cb6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 0x7ff55c0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff563cb6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff55c0b7b90 0x7ff55c0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff563cb6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55c0b7fa0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff563cb6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff55c163fb0 con 0x7ff55c0b7b90 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff563cb6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c164270 con 0x7ff55c0b48d0 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff561251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 0x7ff55c0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff562253640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff55c0b7b90 0x7ff55c0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff561251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 0x7ff55c0b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:33980/0 (socket says 172.21.15.80:33980) 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.546+0000 7ff561251640 1 -- 172.21.15.80:0/3699980982 learned_addr learned my addr 172.21.15.80:0/3699980982 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.547+0000 7ff562253640 1 -- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 msgr2=0x7ff55c0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.547+0000 7ff562253640 1 --2- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 0x7ff55c0b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.547+0000 7ff562253640 1 -- 172.21.15.80:0/3699980982 >> v1:172.21.15.195:6789/0 conn(0x7ff55c0d41b0 legacy=0x7ff55c1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.547+0000 7ff562253640 1 -- 172.21.15.80:0/3699980982 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c164550 con 0x7ff55c0b7b90 2024-04-25T15:43:48.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.547+0000 7ff561251640 1 --2- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 0x7ff55c0b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.548+0000 7ff562253640 1 --2- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b7b90 0x7ff55c0d49c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff554009d90 tx=0x7ff55402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d4ba8becf3f5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.548+0000 7ff560a50640 1 -- 172.21.15.80:0/3699980982 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554007740 con 0x7ff55c0b7b90 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.548+0000 7ff560a50640 1 -- 172.21.15.80:0/3699980982 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5540078e0 con 0x7ff55c0b7b90 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.548+0000 7ff560a50640 1 -- 172.21.15.80:0/3699980982 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554007cb0 con 0x7ff55c0b7b90 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.548+0000 7ff563cb6640 1 -- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b7b90 msgr2=0x7ff55c0d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.548+0000 7ff563cb6640 1 --2- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b7b90 0x7ff55c0d49c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff554009d90 tx=0x7ff55402a660 comp rx=0 tx=0).stop 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.549+0000 7ff563cb6640 1 -- 172.21.15.80:0/3699980982 shutdown_connections 2024-04-25T15:43:48.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.549+0000 7ff563cb6640 1 --2- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b7b90 0x7ff55c0d49c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.549+0000 7ff563cb6640 1 --2- 172.21.15.80:0/3699980982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b48d0 0x7ff55c0b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.549+0000 7ff563cb6640 1 -- 172.21.15.80:0/3699980982 >> 172.21.15.80:0/3699980982 conn(0x7ff55c06e9f0 msgr2=0x7ff55c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:48.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.549+0000 7ff563cb6640 1 -- 172.21.15.80:0/3699980982 shutdown_connections 2024-04-25T15:43:48.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.549+0000 7ff563cb6640 1 -- 172.21.15.80:0/3699980982 wait complete. 2024-04-25T15:43:48.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.550+0000 7ff563cb6640 1 Processor -- start 2024-04-25T15:43:48.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.550+0000 7ff563cb6640 1 -- start start 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b48d0 0x7ff55c1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b7b90 0x7ff55c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 0x7ff55c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c0b4fd0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c164b10 con 0x7ff55c0b48d0 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c0b5150 con 0x7ff55c0b7b90 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 0x7ff55c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 0x7ff55c0c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36768/0 (socket says 172.21.15.80:36768) 2024-04-25T15:43:48.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 -- 172.21.15.80:0/1091769502 learned_addr learned my addr 172.21.15.80:0/1091769502 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff561a52640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b48d0 0x7ff55c1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff561251640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b7b90 0x7ff55c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 -- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b7b90 msgr2=0x7ff55c158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b7b90 0x7ff55c158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 -- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b48d0 msgr2=0x7ff55c1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b48d0 0x7ff55c1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 -- 172.21.15.80:0/1091769502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c152510 con 0x7ff55c0d41b0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff562253640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 0x7ff55c0c84e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff554009eb0 tx=0x7ff554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55403f070 con 0x7ff55c0d41b0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff554031bc0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c156ae0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.552+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554009450 con 0x7ff55c0d41b0 2024-04-25T15:43:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.553+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c1570a0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.554+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c06a100 con 0x7ff55c0d41b0 2024-04-25T15:43:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.554+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff55403b410 con 0x7ff55c0d41b0 2024-04-25T15:43:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.555+0000 7ff5527fc640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff5400744b0 0x7ff5400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.555+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff5540b6ca0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.555+0000 7ff561a52640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff5400744b0 0x7ff5400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.555+0000 7ff561a52640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff5400744b0 0x7ff5400769c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5580016e0 tx=0x7ff558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.559+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff55c152510 con 0x7ff55c0d41b0 2024-04-25T15:43:48.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.735+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff55c15d470 con 0x7ff55c0d41b0 2024-04-25T15:43:48.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.736+0000 7ff5527fc640 1 -- 172.21.15.80:0/1091769502 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7ff5540809f0 con 0x7ff55c0d41b0 2024-04-25T15:43:48.737 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:48.738 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:48.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff5400744b0 msgr2=0x7ff5400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff5400744b0 0x7ff5400769c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5580016e0 tx=0x7ff558009040 comp rx=0 tx=0).stop 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 msgr2=0x7ff55c0c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 0x7ff55c0c84e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff554009eb0 tx=0x7ff554004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 shutdown_connections 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff5400744b0 0x7ff5400769c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff55c0d41b0 0x7ff55c0c84e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff55c0b7b90 0x7ff55c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 --2- 172.21.15.80:0/1091769502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff55c0b48d0 0x7ff55c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 >> 172.21.15.80:0/1091769502 conn(0x7ff55c06e9f0 msgr2=0x7ff55c0b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 shutdown_connections 2024-04-25T15:43:48.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.738+0000 7ff563cb6640 1 -- 172.21.15.80:0/1091769502 wait complete. 2024-04-25T15:43:48.751 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:48.751 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.861+0000 7fea52e34640 1 Processor -- start 2024-04-25T15:43:48.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.861+0000 7fea52e34640 1 -- start start 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea52e34640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea4c0cf930 0x7fea4c160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea52e34640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fea4c0d1600 0x7fea4c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea52e34640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c0d1f50 con 0x7fea4c0718d0 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea52e34640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fea4c0cf4a0 con 0x7fea4c0cf930 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea52e34640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fea4c0cfd40 con 0x7fea4c0d1600 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea50bd0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fea4c0cf930 0x7fea4c160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea513d1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fea4c0718d0 0x7fea4c071ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47706/0 (socket says 172.21.15.80:47706) 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea513d1640 1 -- 172.21.15.80:0/2831345852 learned_addr learned my addr 172.21.15.80:0/2831345852 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea4bfff640 1 --2- 172.21.15.80:0/2831345852 >> v2:172.21.15.195:3300/0 conn(0x7fea4c0d1600 0x7fea4c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea50bd0640 1 -- 172.21.15.80:0/2831345852 >> v2:172.21.15.195:3300/0 conn(0x7fea4c0d1600 msgr2=0x7fea4c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea50bd0640 1 --2- 172.21.15.80:0/2831345852 >> v2:172.21.15.195:3300/0 conn(0x7fea4c0d1600 0x7fea4c0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea50bd0640 1 -- 172.21.15.80:0/2831345852 >> v1:172.21.15.80:6789/0 conn(0x7fea4c0718d0 legacy=0x7fea4c071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea50bd0640 1 -- 172.21.15.80:0/2831345852 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c0ce890 con 0x7fea4c0cf930 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.863+0000 7fea4bfff640 1 --2- 172.21.15.80:0/2831345852 >> v2:172.21.15.195:3300/0 conn(0x7fea4c0d1600 0x7fea4c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.864+0000 7fea50bd0640 1 --2- 172.21.15.80:0/2831345852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0cf930 0x7fea4c160120 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fea4c163d60 tx=0x7fea3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca084bb8a5301c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.864+0000 7fea4b7fe640 1 -- 172.21.15.80:0/2831345852 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c037070 con 0x7fea4c0cf930 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.864+0000 7fea4b7fe640 1 -- 172.21.15.80:0/2831345852 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c032440 con 0x7fea4c0cf930 2024-04-25T15:43:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.864+0000 7fea4b7fe640 1 -- 172.21.15.80:0/2831345852 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c032810 con 0x7fea4c0cf930 2024-04-25T15:43:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 -- 172.21.15.80:0/2831345852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0cf930 msgr2=0x7fea4c160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 --2- 172.21.15.80:0/2831345852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0cf930 0x7fea4c160120 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fea4c163d60 tx=0x7fea3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 -- 172.21.15.80:0/2831345852 shutdown_connections 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 --2- 172.21.15.80:0/2831345852 >> v2:172.21.15.195:3300/0 conn(0x7fea4c0d1600 0x7fea4c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 --2- 172.21.15.80:0/2831345852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0cf930 0x7fea4c160120 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 -- 172.21.15.80:0/2831345852 >> 172.21.15.80:0/2831345852 conn(0x7fea4c0d3a30 msgr2=0x7fea4c0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 -- 172.21.15.80:0/2831345852 shutdown_connections 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.865+0000 7fea52e34640 1 -- 172.21.15.80:0/2831345852 wait complete. 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.867+0000 7fea52e34640 1 Processor -- start 2024-04-25T15:43:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.867+0000 7fea52e34640 1 -- start start 2024-04-25T15:43:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea52e34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 0x7fea4c147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea52e34640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4c0cf930 0x7fea4c1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea52e34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea4c0d1600 0x7fea4c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea52e34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c0cf130 con 0x7fea4c0718d0 2024-04-25T15:43:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea52e34640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c0cee50 con 0x7fea4c0cf930 2024-04-25T15:43:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea52e34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fea4c160660 con 0x7fea4c0d1600 2024-04-25T15:43:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea50bd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 0x7fea4c147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea50bd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 0x7fea4c147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36788/0 (socket says 172.21.15.80:36788) 2024-04-25T15:43:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea50bd0640 1 -- 172.21.15.80:0/1423588521 learned_addr learned my addr 172.21.15.80:0/1423588521 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea4bfff640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4c0cf930 0x7fea4c1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea513d1640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea4c0d1600 0x7fea4c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea50bd0640 1 -- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea4c0d1600 msgr2=0x7fea4c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.868+0000 7fea50bd0640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea4c0d1600 0x7fea4c0b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea50bd0640 1 -- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4c0cf930 msgr2=0x7fea4c1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea50bd0640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4c0cf930 0x7fea4c1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea50bd0640 1 -- 172.21.15.80:0/1423588521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c1588c0 con 0x7fea4c0718d0 2024-04-25T15:43:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea513d1640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea4c0d1600 0x7fea4c0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea50bd0640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 0x7fea4c147970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009890 tx=0x7fea3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c037040 con 0x7fea4c0718d0 2024-04-25T15:43:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c042070 con 0x7fea4c0718d0 2024-04-25T15:43:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4c158ba0 con 0x7fea4c0718d0 2024-04-25T15:43:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c030a50 con 0x7fea4c0718d0 2024-04-25T15:43:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.869+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea4c159160 con 0x7fea4c0718d0 2024-04-25T15:43:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.870+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4c06a100 con 0x7fea4c0718d0 2024-04-25T15:43:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.871+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fea3c030bf0 con 0x7fea4c0718d0 2024-04-25T15:43:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.871+0000 7fea497fa640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea380744e0 0x7fea380769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.871+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fea3c0b6040 con 0x7fea4c0718d0 2024-04-25T15:43:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.871+0000 7fea4bfff640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea380744e0 0x7fea380769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.871+0000 7fea4bfff640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea380744e0 0x7fea380769f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fea4c15b840 tx=0x7fea40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:48.876+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea3c080460 con 0x7fea4c0718d0 2024-04-25T15:43:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.051+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea4c0b99b0 con 0x7fea4c0718d0 2024-04-25T15:43:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.052+0000 7fea497fa640 1 -- 172.21.15.80:0/1423588521 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fea3c07fd60 con 0x7fea4c0718d0 2024-04-25T15:43:49.053 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea380744e0 msgr2=0x7fea380769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea380744e0 0x7fea380769f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fea4c15b840 tx=0x7fea40008040 comp rx=0 tx=0).stop 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 msgr2=0x7fea4c147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 0x7fea4c147970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009890 tx=0x7fea3c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 shutdown_connections 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fea380744e0 0x7fea380769f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea4c0d1600 0x7fea4c0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4c0cf930 0x7fea4c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 --2- 172.21.15.80:0/1423588521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea4c0718d0 0x7fea4c147970 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 >> 172.21.15.80:0/1423588521 conn(0x7fea4c0d3a30 msgr2=0x7fea4c15f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 shutdown_connections 2024-04-25T15:43:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.054+0000 7fea52e34640 1 -- 172.21.15.80:0/1423588521 wait complete. 2024-04-25T15:43:49.066 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:49.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.174+0000 7f03cedf3640 1 Processor -- start 2024-04-25T15:43:49.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.174+0000 7f03cedf3640 1 -- start start 2024-04-25T15:43:49.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cedf3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f03c8160090 0x7f03c806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cedf3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c80ce640 con 0x7f03c80718d0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cedf3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c80d2840 con 0x7f03c80b2db0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cedf3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f03c80cef30 con 0x7f03c8160090 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cd390640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f03c80718d0 0x7f03c8071ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47710/0 (socket says 172.21.15.80:47710) 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cd390640 1 -- 172.21.15.80:0/3639050223 learned_addr learned my addr 172.21.15.80:0/3639050223 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c7fff640 1 --2- 172.21.15.80:0/3639050223 >> v2:172.21.15.195:3300/0 conn(0x7f03c8160090 0x7f03c806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015351592 0 0) 0x7f03c80ce640 con 0x7f03c80718d0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b0003520 con 0x7f03c80718d0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2390232127 0 0) 0x7f03b0003520 con 0x7f03c80718d0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 >> v2:172.21.15.195:3300/0 conn(0x7f03c8160090 msgr2=0x7f03c806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 --2- 172.21.15.80:0/3639050223 >> v2:172.21.15.195:3300/0 conn(0x7f03c8160090 0x7f03c806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 >> v1:172.21.15.195:6789/0 conn(0x7f03c80b2db0 legacy=0x7f03c80d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c80ce8e0 con 0x7f03c80718d0 2024-04-25T15:43:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f03c00019f0 con 0x7f03c80718d0 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 >> v1:172.21.15.80:6789/0 conn(0x7f03c80718d0 legacy=0x7f03c8071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03b00039b0 0x7f03b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0004800 0x7f03b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b0005250 0x7f03b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03c80cef30 con 0x7f03b0005250 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03b000c1e0 con 0x7f03b00039b0 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03b000c3e0 con 0x7f03b0004800 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03c7fff640 1 --2- 172.21.15.80:0/3639050223 >> v2:172.21.15.195:3300/0 conn(0x7f03c8160090 0x7f03c806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.176+0000 7f03cd390640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b0005250 0x7f03b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03c7fff640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0004800 0x7f03b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03ccb8f640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03b00039b0 0x7f03b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 -- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0004800 msgr2=0x7f03b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0004800 0x7f03b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 -- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03b00039b0 msgr2=0x7f03b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03b00039b0 0x7f03b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 -- 172.21.15.80:0/3639050223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b0003520 con 0x7f03b0005250 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03c7fff640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0004800 0x7f03b0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 -- 172.21.15.80:0/3639050223 reap_dead start 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.177+0000 7f03cd390640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b0005250 0x7f03b000b9c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f03c000a850 tx=0x7f03b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdb126911bfbea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c000a4a0 con 0x7f03b0005250 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c002f070 con 0x7f03b0005250 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03c77fe640 1 -- 172.21.15.80:0/3639050223 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c002bce0 con 0x7f03b0005250 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 -- 172.21.15.80:0/3639050223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b0005250 msgr2=0x7f03b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b0005250 0x7f03b000b9c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f03c000a850 tx=0x7f03b0005830 comp rx=0 tx=0).stop 2024-04-25T15:43:49.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 -- 172.21.15.80:0/3639050223 shutdown_connections 2024-04-25T15:43:49.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 --2- 172.21.15.80:0/3639050223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03b0005250 0x7f03b000b9c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 -- 172.21.15.80:0/3639050223 >> 172.21.15.80:0/3639050223 conn(0x7f03c80d3a30 msgr2=0x7f03c80d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:49.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 -- 172.21.15.80:0/3639050223 shutdown_connections 2024-04-25T15:43:49.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.178+0000 7f03cedf3640 1 -- 172.21.15.80:0/3639050223 wait complete. 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.180+0000 7f03cedf3640 1 Processor -- start 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.180+0000 7f03cedf3640 1 -- start start 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.181+0000 7f03cedf3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0005250 0x7f03c814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.181+0000 7f03cedf3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c806d4b0 0x7f03c806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cedf3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 0x7f03c80b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cedf3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81604a0 con 0x7f03c80b8430 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cedf3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03c80b31c0 con 0x7f03c806d4b0 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cedf3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03c80d2010 con 0x7f03b0005250 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 0x7f03c80b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 0x7f03c80b8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36806/0 (socket says 172.21.15.80:36806) 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 -- 172.21.15.80:0/164127969 learned_addr learned my addr 172.21.15.80:0/164127969 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:49.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03c7fff640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c806d4b0 0x7f03c806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03ccb8f640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0005250 0x7f03c814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 -- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0005250 msgr2=0x7f03c814ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0005250 0x7f03c814ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 -- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c806d4b0 msgr2=0x7f03c806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c806d4b0 0x7f03c806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 -- 172.21.15.80:0/164127969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c80b8d80 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cd390640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 0x7f03c80b8840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f03c0000f80 tx=0x7f03c002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0045070 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c00406a0 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c81f9e50 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0040a90 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.182+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c81fa410 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.184+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c806a100 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.184+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f03c0048070 con 0x7f03c80b8430 2024-04-25T15:43:49.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.185+0000 7f03c57fa640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03b40744e0 0x7f03b40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.185+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f03c00b5b00 con 0x7f03c80b8430 2024-04-25T15:43:49.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.185+0000 7f03ccb8f640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03b40744e0 0x7f03b40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.185+0000 7f03ccb8f640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03b40744e0 0x7f03b40769f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03b8007fd0 tx=0x7f03b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.189+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03c80b8d80 con 0x7f03c80b8430 2024-04-25T15:43:49.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.369+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f03c81f9bc0 con 0x7f03c80b8430 2024-04-25T15:43:49.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.370+0000 7f03c57fa640 1 -- 172.21.15.80:0/164127969 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f03c00860f0 con 0x7f03c80b8430 2024-04-25T15:43:49.371 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03b40744e0 msgr2=0x7f03b40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03b40744e0 0x7f03b40769f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03b8007fd0 tx=0x7f03b8009040 comp rx=0 tx=0).stop 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 msgr2=0x7f03c80b8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 0x7f03c80b8840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f03c0000f80 tx=0x7f03c002d070 comp rx=0 tx=0).stop 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 shutdown_connections 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03b40744e0 0x7f03b40769f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03c80b8430 0x7f03c80b8840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c806d4b0 0x7f03c806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 --2- 172.21.15.80:0/164127969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03b0005250 0x7f03c814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 >> 172.21.15.80:0/164127969 conn(0x7f03c80d3a30 msgr2=0x7f03c8161e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:49.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 shutdown_connections 2024-04-25T15:43:49.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.372+0000 7f03cedf3640 1 -- 172.21.15.80:0/164127969 wait complete. 2024-04-25T15:43:49.384 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.494+0000 7f5fd4372640 1 Processor -- start 2024-04-25T15:43:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.494+0000 7f5fd4372640 1 -- start start 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd4372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc09b620 0x7f5fcc0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd4372640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fcc06e6a0 0x7f5fcc0d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd4372640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5fcc0d2bb0 0x7f5fcc0d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd4372640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5fcc0d2fc0 con 0x7f5fcc06e6a0 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd4372640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5fcc09bb90 con 0x7f5fcc0d2bb0 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd4372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5fcc0b2810 con 0x7f5fcc09b620 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd190d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fcc06e6a0 0x7f5fcc0d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd190d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fcc06e6a0 0x7f5fcc0d2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36812/0 (socket says 172.21.15.80:36812) 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.495+0000 7f5fd190d640 1 -- 172.21.15.80:0/2029958140 learned_addr learned my addr 172.21.15.80:0/2029958140 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd290f640 1 --2- 172.21.15.80:0/2029958140 >> v2:172.21.15.195:3300/0 conn(0x7f5fcc0d2bb0 0x7f5fcc0d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd210e640 1 --2- 172.21.15.80:0/2029958140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc09b620 0x7f5fcc0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd190d640 1 -- 172.21.15.80:0/2029958140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc09b620 msgr2=0x7f5fcc0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd190d640 1 --2- 172.21.15.80:0/2029958140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc09b620 0x7f5fcc0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd190d640 1 -- 172.21.15.80:0/2029958140 >> v2:172.21.15.195:3300/0 conn(0x7f5fcc0d2bb0 msgr2=0x7f5fcc0d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd190d640 1 --2- 172.21.15.80:0/2029958140 >> v2:172.21.15.195:3300/0 conn(0x7f5fcc0d2bb0 0x7f5fcc0d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd190d640 1 -- 172.21.15.80:0/2029958140 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fcc0b2250 con 0x7f5fcc06e6a0 2024-04-25T15:43:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd190d640 1 --2- 172.21.15.80:0/2029958140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc0d2670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc074010 tx=0x7f5fbc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36b5b9e4ced5c8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.496+0000 7f5fd110c640 1 -- 172.21.15.80:0/2029958140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc037070 con 0x7f5fcc06e6a0 2024-04-25T15:43:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd110c640 1 -- 172.21.15.80:0/2029958140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fbc02ae00 con 0x7f5fcc06e6a0 2024-04-25T15:43:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd110c640 1 -- 172.21.15.80:0/2029958140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc032660 con 0x7f5fcc06e6a0 2024-04-25T15:43:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 -- 172.21.15.80:0/2029958140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc06e6a0 msgr2=0x7f5fcc0d2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 --2- 172.21.15.80:0/2029958140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc0d2670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc074010 tx=0x7f5fbc02a0b0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 -- 172.21.15.80:0/2029958140 shutdown_connections 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 --2- 172.21.15.80:0/2029958140 >> v2:172.21.15.195:3300/0 conn(0x7f5fcc0d2bb0 0x7f5fcc0d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 --2- 172.21.15.80:0/2029958140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc0d2670 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 --2- 172.21.15.80:0/2029958140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc09b620 0x7f5fcc0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 -- 172.21.15.80:0/2029958140 >> 172.21.15.80:0/2029958140 conn(0x7f5fcc0b7690 msgr2=0x7f5fcc0b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 -- 172.21.15.80:0/2029958140 shutdown_connections 2024-04-25T15:43:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.497+0000 7f5fd4372640 1 -- 172.21.15.80:0/2029958140 wait complete. 2024-04-25T15:43:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.499+0000 7f5fd4372640 1 Processor -- start 2024-04-25T15:43:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.499+0000 7f5fd4372640 1 -- start start 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd4372640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc1f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd4372640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 0x7f5fcc0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd4372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc0d2bb0 0x7f5fcc156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd4372640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc06eab0 con 0x7f5fcc09b620 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd4372640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc06e180 con 0x7f5fcc06e6a0 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd4372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5fcc06ef10 con 0x7f5fcc0d2bb0 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd190d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 0x7f5fcc0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd190d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 0x7f5fcc0c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36814/0 (socket says 172.21.15.80:36814) 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.500+0000 7f5fd190d640 1 -- 172.21.15.80:0/1247204358 learned_addr learned my addr 172.21.15.80:0/1247204358 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd290f640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc0d2bb0 0x7f5fcc156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd210e640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc1f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd190d640 1 -- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc0d2bb0 msgr2=0x7f5fcc156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd190d640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc0d2bb0 0x7f5fcc156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd190d640 1 -- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fcc06e6a0 msgr2=0x7f5fcc1f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd190d640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc1f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd190d640 1 -- 172.21.15.80:0/1247204358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fcc0cc220 con 0x7f5fcc09b620 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd290f640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc0d2bb0 0x7f5fcc156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd190d640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 0x7f5fcc0c9a10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc02a0f0 tx=0x7f5fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc041070 con 0x7f5fcc09b620 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fbc032e20 con 0x7f5fcc09b620 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fcc0cc500 con 0x7f5fcc09b620 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc037040 con 0x7f5fcc09b620 2024-04-25T15:43:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.501+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fcc0c9f50 con 0x7f5fcc09b620 2024-04-25T15:43:49.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.502+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fcc0b1ed0 con 0x7f5fcc09b620 2024-04-25T15:43:49.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.503+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5fbc03a070 con 0x7f5fcc09b620 2024-04-25T15:43:49.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.503+0000 7f5fc2ffd640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fb00744b0 0x7f5fb00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.503+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5fbc0b55a0 con 0x7f5fcc09b620 2024-04-25T15:43:49.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.503+0000 7f5fd210e640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fb00744b0 0x7f5fb00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.504+0000 7f5fd210e640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fb00744b0 0x7f5fb00769c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8003610 tx=0x7f5fc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.508+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fcc0b1ed0 con 0x7f5fcc09b620 2024-04-25T15:43:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.682+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5fcc06a100 con 0x7f5fcc09b620 2024-04-25T15:43:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.682+0000 7f5fc2ffd640 1 -- 172.21.15.80:0/1247204358 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f5fbc07f2e0 con 0x7f5fcc09b620 2024-04-25T15:43:49.683 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fb00744b0 msgr2=0x7f5fb00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fb00744b0 0x7f5fb00769c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8003610 tx=0x7f5fc8008040 comp rx=0 tx=0).stop 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 msgr2=0x7f5fcc0c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 0x7f5fcc0c9a10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc02a0f0 tx=0x7f5fbc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 shutdown_connections 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5fb00744b0 0x7f5fb00769c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fcc0d2bb0 0x7f5fcc156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fcc09b620 0x7f5fcc0c9a10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 --2- 172.21.15.80:0/1247204358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fcc06e6a0 0x7f5fcc1f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 >> 172.21.15.80:0/1247204358 conn(0x7f5fcc0b7690 msgr2=0x7f5fcc0b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:49.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 shutdown_connections 2024-04-25T15:43:49.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.684+0000 7f5fd4372640 1 -- 172.21.15.80:0/1247204358 wait complete. 2024-04-25T15:43:49.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:49.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.806+0000 7fc582405640 1 Processor -- start 2024-04-25T15:43:49.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.806+0000 7fc582405640 1 -- start start 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc582405640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc57c0727c0 0x7fc57c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc582405640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc57c0718d0 0x7fc57c0d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc582405640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0d3160 0x7fc57c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc582405640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c072400 con 0x7fc57c0718d0 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc582405640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c0d2790 con 0x7fc57c0727c0 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc582405640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c0b3290 con 0x7fc57c0d3160 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc57b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc57c0718d0 0x7fc57c0d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc57b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc57c0718d0 0x7fc57c0d2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36826/0 (socket says 172.21.15.80:36826) 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc57b7fe640 1 -- 172.21.15.80:0/1020493635 learned_addr learned my addr 172.21.15.80:0/1020493635 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.807+0000 7fc57bfff640 1 --2- 172.21.15.80:0/1020493635 >> v2:172.21.15.195:3300/0 conn(0x7fc57c0727c0 0x7fc57c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57b7fe640 1 -- 172.21.15.80:0/1020493635 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0d3160 msgr2=0x7fc57c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57b7fe640 1 --2- 172.21.15.80:0/1020493635 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0d3160 0x7fc57c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57b7fe640 1 -- 172.21.15.80:0/1020493635 >> v2:172.21.15.195:3300/0 conn(0x7fc57c0727c0 msgr2=0x7fc57c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:49.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57b7fe640 1 --2- 172.21.15.80:0/1020493635 >> v2:172.21.15.195:3300/0 conn(0x7fc57c0727c0 0x7fc57c0b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57b7fe640 1 -- 172.21.15.80:0/1020493635 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c072120 con 0x7fc57c0718d0 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57b7fe640 1 --2- 172.21.15.80:0/1020493635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0718d0 0x7fc57c0d2c20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0d2910 tx=0x7fc57002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6925d7a2c277d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57affd640 1 -- 172.21.15.80:0/1020493635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570037070 con 0x7fc57c0718d0 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57affd640 1 -- 172.21.15.80:0/1020493635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570032440 con 0x7fc57c0718d0 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.808+0000 7fc57affd640 1 -- 172.21.15.80:0/1020493635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570032810 con 0x7fc57c0718d0 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 -- 172.21.15.80:0/1020493635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0718d0 msgr2=0x7fc57c0d2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 --2- 172.21.15.80:0/1020493635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0718d0 0x7fc57c0d2c20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0d2910 tx=0x7fc57002a130 comp rx=0 tx=0).stop 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 -- 172.21.15.80:0/1020493635 shutdown_connections 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 --2- 172.21.15.80:0/1020493635 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0d3160 0x7fc57c0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 --2- 172.21.15.80:0/1020493635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0718d0 0x7fc57c0d2c20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 --2- 172.21.15.80:0/1020493635 >> v2:172.21.15.195:3300/0 conn(0x7fc57c0727c0 0x7fc57c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 -- 172.21.15.80:0/1020493635 >> 172.21.15.80:0/1020493635 conn(0x7fc57c0d3a30 msgr2=0x7fc57c0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:49.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 -- 172.21.15.80:0/1020493635 shutdown_connections 2024-04-25T15:43:49.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.809+0000 7fc582405640 1 -- 172.21.15.80:0/1020493635 wait complete. 2024-04-25T15:43:49.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.811+0000 7fc582405640 1 Processor -- start 2024-04-25T15:43:49.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.811+0000 7fc582405640 1 -- start start 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc582405640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc57c0718d0 0x7fc57c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc582405640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0727c0 0x7fc57c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc582405640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 0x7fc57c1f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc582405640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c071ce0 con 0x7fc57c0d3160 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc582405640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c0d2420 con 0x7fc57c0718d0 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc582405640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c071e60 con 0x7fc57c0727c0 2024-04-25T15:43:49.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.812+0000 7fc5809a2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 0x7fc57c1f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 0x7fc57c1f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36842/0 (socket says 172.21.15.80:36842) 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 -- 172.21.15.80:0/2826308421 learned_addr learned my addr 172.21.15.80:0/2826308421 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc57bfff640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc57c0718d0 0x7fc57c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc57b7fe640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0727c0 0x7fc57c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 -- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0727c0 msgr2=0x7fc57c15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0727c0 0x7fc57c15b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 -- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc57c0718d0 msgr2=0x7fc57c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc57c0718d0 0x7fc57c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 -- 172.21.15.80:0/2826308421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c15c280 con 0x7fc57c0d3160 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc5809a2640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 0x7fc57c1f79f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ba10 tx=0x7fc57400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574019070 con 0x7fc57c0d3160 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57400cb60 con 0x7fc57c0d3160 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c1561b0 con 0x7fc57c0d3160 2024-04-25T15:43:49.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574014440 con 0x7fc57c0d3160 2024-04-25T15:43:49.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.813+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c156730 con 0x7fc57c0d3160 2024-04-25T15:43:49.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.814+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57c0cf660 con 0x7fc57c0d3160 2024-04-25T15:43:49.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.815+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc57401c070 con 0x7fc57c0d3160 2024-04-25T15:43:49.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.815+0000 7fc578ff9640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5680744b0 0x7fc5680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:49.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.815+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc5740952d0 con 0x7fc57c0d3160 2024-04-25T15:43:49.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.816+0000 7fc57bfff640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5680744b0 0x7fc5680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:49.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.816+0000 7fc57bfff640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5680744b0 0x7fc5680769c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00aa20 tx=0x7fc56c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:49.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.820+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc57c0cf660 con 0x7fc57c0d3160 2024-04-25T15:43:49.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.997+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc57c0b6dc0 con 0x7fc57c0d3160 2024-04-25T15:43:49.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.997+0000 7fc578ff9640 1 -- 172.21.15.80:0/2826308421 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fc57c0b6dc0 con 0x7fc57c0d3160 2024-04-25T15:43:49.998 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:50.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5680744b0 msgr2=0x7fc5680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5680744b0 0x7fc5680769c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00aa20 tx=0x7fc56c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:50.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 msgr2=0x7fc57c1f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 0x7fc57c1f79f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ba10 tx=0x7fc57400bed0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 shutdown_connections 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5680744b0 0x7fc5680769c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc57c0d3160 0x7fc57c1f79f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc57c0727c0 0x7fc57c15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 --2- 172.21.15.80:0/2826308421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc57c0718d0 0x7fc57c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 >> 172.21.15.80:0/2826308421 conn(0x7fc57c0d3a30 msgr2=0x7fc57c0b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 shutdown_connections 2024-04-25T15:43:50.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:49.999+0000 7fc582405640 1 -- 172.21.15.80:0/2826308421 wait complete. 2024-04-25T15:43:50.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-04-25T15:43:50.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.121+0000 7fb1dd020640 1 Processor -- start 2024-04-25T15:43:50.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.121+0000 7fb1dd020640 1 -- start start 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.122+0000 7fb1dd020640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb1d8164530 0x7fb1d8164940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.122+0000 7fb1dd020640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d80cdf00 con 0x7fb1d80ce780 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.122+0000 7fb1dd020640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d809bfa0 con 0x7fb1d809bb90 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.122+0000 7fb1dd020640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d809c250 con 0x7fb1d8164530 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d759e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb1d80ce780 0x7fb1d80ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47718/0 (socket says 172.21.15.80:47718) 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d759e640 1 -- 172.21.15.80:0/194272728 learned_addr learned my addr 172.21.15.80:0/194272728 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:50.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d659c640 1 --2- 172.21.15.80:0/194272728 >> v2:172.21.15.195:3300/0 conn(0x7fb1d8164530 0x7fb1d8164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d5d9b640 1 -- 172.21.15.80:0/194272728 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368805354 0 0) 0x7fb1d80cdf00 con 0x7fb1d80ce780 2024-04-25T15:43:50.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d5d9b640 1 -- 172.21.15.80:0/194272728 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c0003520 con 0x7fb1d80ce780 2024-04-25T15:43:50.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d659c640 1 -- 172.21.15.80:0/194272728 >> v1:172.21.15.195:6789/0 conn(0x7fb1d809bb90 legacy=0x7fb1d8163e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d659c640 1 -- 172.21.15.80:0/194272728 >> v1:172.21.15.80:6789/0 conn(0x7fb1d80ce780 legacy=0x7fb1d80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.123+0000 7fb1d659c640 1 -- 172.21.15.80:0/194272728 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d80d2520 con 0x7fb1d8164530 2024-04-25T15:43:50.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.124+0000 7fb1d659c640 1 --2- 172.21.15.80:0/194272728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d8164530 0x7fb1d8164940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80097a0 tx=0x7fb1c802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62ad5ee33ddfc8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:50.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.124+0000 7fb1d5d9b640 1 -- 172.21.15.80:0/194272728 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8037070 con 0x7fb1d8164530 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.124+0000 7fb1d5d9b640 1 -- 172.21.15.80:0/194272728 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c8032440 con 0x7fb1d8164530 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.124+0000 7fb1d5d9b640 1 -- 172.21.15.80:0/194272728 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80327f0 con 0x7fb1d8164530 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 -- 172.21.15.80:0/194272728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d8164530 msgr2=0x7fb1d8164940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 --2- 172.21.15.80:0/194272728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d8164530 0x7fb1d8164940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80097a0 tx=0x7fb1c802a230 comp rx=0 tx=0).stop 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 -- 172.21.15.80:0/194272728 shutdown_connections 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 --2- 172.21.15.80:0/194272728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d8164530 0x7fb1d8164940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 -- 172.21.15.80:0/194272728 >> 172.21.15.80:0/194272728 conn(0x7fb1d80b75b0 msgr2=0x7fb1d80b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 -- 172.21.15.80:0/194272728 shutdown_connections 2024-04-25T15:43:50.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.125+0000 7fb1dd020640 1 -- 172.21.15.80:0/194272728 wait complete. 2024-04-25T15:43:50.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.127+0000 7fb1dd020640 1 Processor -- start 2024-04-25T15:43:50.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.127+0000 7fb1dd020640 1 -- start start 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1dd020640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d809bb90 0x7fb1d80b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1dd020640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 0x7fb1d80b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1dd020640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1d8164530 0x7fb1d80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1dd020640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80d2dc0 con 0x7fb1d80ce780 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1dd020640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80d2ae0 con 0x7fb1d809bb90 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1dd020640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80d32e0 con 0x7fb1d8164530 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1d659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 0x7fb1d80b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1d659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 0x7fb1d80b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36848/0 (socket says 172.21.15.80:36848) 2024-04-25T15:43:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.128+0000 7fb1d659c640 1 -- 172.21.15.80:0/1731259746 learned_addr learned my addr 172.21.15.80:0/1731259746 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d6d9d640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d809bb90 0x7fb1d80b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d759e640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1d8164530 0x7fb1d80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d659c640 1 -- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1d8164530 msgr2=0x7fb1d80b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d659c640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1d8164530 0x7fb1d80b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d659c640 1 -- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d809bb90 msgr2=0x7fb1d80b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d659c640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d809bb90 0x7fb1d80b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d659c640 1 -- 172.21.15.80:0/1731259746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d81f66d0 con 0x7fb1d80ce780 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d759e640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1d8164530 0x7fb1d80b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1d659c640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 0x7fb1d80b2710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8035040 tx=0x7fb1c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8037050 con 0x7fb1d80ce780 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c8043070 con 0x7fb1d80ce780 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8032810 con 0x7fb1d80ce780 2024-04-25T15:43:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d80b1160 con 0x7fb1d80ce780 2024-04-25T15:43:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.129+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d809dc40 con 0x7fb1d80ce780 2024-04-25T15:43:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.131+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d8164940 con 0x7fb1d80ce780 2024-04-25T15:43:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.131+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb1c80329b0 con 0x7fb1d80ce780 2024-04-25T15:43:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.132+0000 7fb1bf7fe640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1c40744e0 0x7fb1c40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.132+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb1c80b60a0 con 0x7fb1d80ce780 2024-04-25T15:43:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.132+0000 7fb1d6d9d640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1c40744e0 0x7fb1c40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.132+0000 7fb1d6d9d640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1c40744e0 0x7fb1c40769f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0016e0 tx=0x7fb1cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.137+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1d8164940 con 0x7fb1d80ce780 2024-04-25T15:43:50.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.389+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7fb1d806a100 con 0x7fb1d80ce780 2024-04-25T15:43:50.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.486+0000 7fb1bf7fe640 1 -- 172.21.15.80:0/1731259746 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v70) ==== 147+0+0 (secure 0 0 0) 0x7fb1c80804c0 con 0x7fb1d80ce780 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.488+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1c40744e0 msgr2=0x7fb1c40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.488+0000 7fb1dd020640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1c40744e0 0x7fb1c40769f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0016e0 tx=0x7fb1cc009040 comp rx=0 tx=0).stop 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.488+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 msgr2=0x7fb1d80b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.488+0000 7fb1dd020640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 0x7fb1d80b2710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8035040 tx=0x7fb1c80046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 shutdown_connections 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1c40744e0 0x7fb1c40769f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1d8164530 0x7fb1d80b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1d80ce780 0x7fb1d80b2710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 --2- 172.21.15.80:0/1731259746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1d809bb90 0x7fb1d80b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 >> 172.21.15.80:0/1731259746 conn(0x7fb1d80b75b0 msgr2=0x7fb1d815fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:50.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 shutdown_connections 2024-04-25T15:43:50.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.489+0000 7fb1dd020640 1 -- 172.21.15.80:0/1731259746 wait complete. 2024-04-25T15:43:50.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T15:43:50.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.612+0000 7f80178bd640 1 Processor -- start 2024-04-25T15:43:50.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.612+0000 7f80178bd640 1 -- start start 2024-04-25T15:43:50.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f80178bd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f80100b5490 0x7f8010160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f80178bd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80100d0b00 0x7f80100d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f80178bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80100d57e0 con 0x7f80100d2b80 2024-04-25T15:43:50.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f80178bd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f80101643f0 con 0x7f80100d0b00 2024-04-25T15:43:50.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f80178bd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f80101646d0 con 0x7f80100b5490 2024-04-25T15:43:50.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f8014e58640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80100d0b00 0x7f80100d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f8015e5a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f80100d2b80 0x7f80100b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47722/0 (socket says 172.21.15.80:47722) 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f8014e58640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80100d0b00 0x7f80100d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36854/0 (socket says 172.21.15.80:36854) 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.613+0000 7f8015e5a640 1 -- 172.21.15.80:0/553690494 learned_addr learned my addr 172.21.15.80:0/553690494 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.614+0000 7f8015659640 1 --2- 172.21.15.80:0/553690494 >> v2:172.21.15.195:3300/0 conn(0x7f80100b5490 0x7f8010160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.614+0000 7f8014e58640 1 -- 172.21.15.80:0/553690494 >> v2:172.21.15.195:3300/0 conn(0x7f80100b5490 msgr2=0x7f8010160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.614+0000 7f8014e58640 1 --2- 172.21.15.80:0/553690494 >> v2:172.21.15.195:3300/0 conn(0x7f80100b5490 0x7f8010160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.614+0000 7f8014e58640 1 -- 172.21.15.80:0/553690494 >> v1:172.21.15.80:6789/0 conn(0x7f80100d2b80 legacy=0x7f80100b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.614+0000 7f8014e58640 1 -- 172.21.15.80:0/553690494 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80101649b0 con 0x7f80100d0b00 2024-04-25T15:43:50.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.614+0000 7f8007fff640 1 -- 172.21.15.80:0/553690494 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657057742 0 0) 0x7f80100d57e0 con 0x7f80100d2b80 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.615+0000 7f8014e58640 1 --2- 172.21.15.80:0/553690494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d0b00 0x7f80100d2640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f801008ed90 tx=0x7f800002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a804484bc23e41db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.615+0000 7f8007fff640 1 -- 172.21.15.80:0/553690494 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000037070 con 0x7f80100d0b00 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.615+0000 7f8007fff640 1 -- 172.21.15.80:0/553690494 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8000032440 con 0x7f80100d0b00 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.615+0000 7f8007fff640 1 -- 172.21.15.80:0/553690494 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000032810 con 0x7f80100d0b00 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 -- 172.21.15.80:0/553690494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d0b00 msgr2=0x7f80100d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 --2- 172.21.15.80:0/553690494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d0b00 0x7f80100d2640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f801008ed90 tx=0x7f800002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 -- 172.21.15.80:0/553690494 shutdown_connections 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 --2- 172.21.15.80:0/553690494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d0b00 0x7f80100d2640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 --2- 172.21.15.80:0/553690494 >> v2:172.21.15.195:3300/0 conn(0x7f80100b5490 0x7f8010160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 -- 172.21.15.80:0/553690494 >> 172.21.15.80:0/553690494 conn(0x7f801006e650 msgr2=0x7f801006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 -- 172.21.15.80:0/553690494 shutdown_connections 2024-04-25T15:43:50.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.616+0000 7f80178bd640 1 -- 172.21.15.80:0/553690494 wait complete. 2024-04-25T15:43:50.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.618+0000 7f80178bd640 1 Processor -- start 2024-04-25T15:43:50.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.618+0000 7f80178bd640 1 -- start start 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f80178bd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80100d0b00 0x7f801014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f80178bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 0x7f80101f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f80178bd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80101f5370 0x7f80101f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f80178bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80100d2f90 con 0x7f80100d2b80 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f80178bd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8010160840 con 0x7f80101f5370 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f80178bd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f80100b9360 con 0x7f80100d0b00 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 0x7f80101f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 0x7f80101f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36868/0 (socket says 172.21.15.80:36868) 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 -- 172.21.15.80:0/2919701137 learned_addr learned my addr 172.21.15.80:0/2919701137 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8015e5a640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80101f5370 0x7f80101f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8015659640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80100d0b00 0x7f801014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 -- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80100d0b00 msgr2=0x7f801014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80100d0b00 0x7f801014bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 -- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80101f5370 msgr2=0x7f80101f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80101f5370 0x7f80101f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.619+0000 7f8014e58640 1 -- 172.21.15.80:0/2919701137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80101529a0 con 0x7f80100d2b80 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f8015e5a640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80101f5370 0x7f80101f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f8015659640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80100d0b00 0x7f801014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f8014e58640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 0x7f80101f4e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8000000c00 tx=0x7f80000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:50.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000037040 con 0x7f80100d2b80 2024-04-25T15:43:50.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8000042070 con 0x7f80100d2b80 2024-04-25T15:43:50.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80100b73d0 con 0x7f80100d2b80 2024-04-25T15:43:50.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000030920 con 0x7f80100d2b80 2024-04-25T15:43:50.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.620+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801014c870 con 0x7f80100d2b80 2024-04-25T15:43:50.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.621+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801006a100 con 0x7f80100d2b80 2024-04-25T15:43:50.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.622+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8000030ac0 con 0x7f80100d2b80 2024-04-25T15:43:50.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.623+0000 7f8005ffb640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ff40744e0 0x7f7ff40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:50.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.623+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f80000b5d90 con 0x7f80100d2b80 2024-04-25T15:43:50.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.623+0000 7f8015659640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ff40744e0 0x7f7ff40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:50.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.623+0000 7f8015659640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ff40744e0 0x7f7ff40769f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80100d08c0 tx=0x7f800c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:50.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.628+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f800004c020 con 0x7f80100d2b80 2024-04-25T15:43:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.806+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f80100d41d0 con 0x7f80100d2b80 2024-04-25T15:43:50.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.810+0000 7f8005ffb640 1 -- 172.21.15.80:0/2919701137 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f800007fb60 con 0x7f80100d2b80 2024-04-25T15:43:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ff40744e0 msgr2=0x7f7ff40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ff40744e0 0x7f7ff40769f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80100d08c0 tx=0x7f800c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 msgr2=0x7f80101f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 0x7f80101f4e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8000000c00 tx=0x7f80000046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 shutdown_connections 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ff40744e0 0x7f7ff40769f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80101f5370 0x7f80101f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80100d2b80 0x7f80101f4e30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 --2- 172.21.15.80:0/2919701137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80100d0b00 0x7f801014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 >> 172.21.15.80:0/2919701137 conn(0x7f801006e650 msgr2=0x7f80100ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 shutdown_connections 2024-04-25T15:43:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:50.812+0000 7f80178bd640 1 -- 172.21.15.80:0/2919701137 wait complete. 2024-04-25T15:43:50.824 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:43:50.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:43:50.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:43:50.920 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:43:50.921 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:50.921 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:50.937 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:50.937 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:50.992 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:50.992 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:51.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:51.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.194+0000 7f2dda430640 1 Processor -- start 2024-04-25T15:43:51.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.194+0000 7f2dda430640 1 -- start start 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.195+0000 7f2dda430640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2dd40d41b0 0x7f2dd40b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.195+0000 7f2dda430640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.195+0000 7f2dda430640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2dd40b7b90 0x7f2dd40d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.195+0000 7f2dda430640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd40b7fa0 con 0x7f2dd40d41b0 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.195+0000 7f2dda430640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd4163fb0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.195+0000 7f2dda430640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd4164270 con 0x7f2dd41602a0 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2dd40d41b0 0x7f2dd40b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2dd40d41b0 0x7f2dd40b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36874/0 (socket says 172.21.15.80:36874) 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3420845869 learned_addr learned my addr 172.21.15.80:0/3420845869 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:51.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd37fe640 1 --2- 172.21.15.80:0/3420845869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd89cd640 1 --2- 172.21.15.80:0/3420845869 >> v2:172.21.15.195:3300/0 conn(0x7f2dd40b7b90 0x7f2dd40d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3420845869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 msgr2=0x7f2dd40b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 --2- 172.21.15.80:0/3420845869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3420845869 >> v2:172.21.15.195:3300/0 conn(0x7f2dd40b7b90 msgr2=0x7f2dd40d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 --2- 172.21.15.80:0/3420845869 >> v2:172.21.15.195:3300/0 conn(0x7f2dd40b7b90 0x7f2dd40d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.196+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3420845869 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd4164550 con 0x7f2dd40d41b0 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dd3fff640 1 --2- 172.21.15.80:0/3420845869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40d41b0 0x7f2dd40b48d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dd408e110 tx=0x7f2dc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f414cc4b329c421 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dd2ffd640 1 -- 172.21.15.80:0/3420845869 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8037070 con 0x7f2dd40d41b0 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dd2ffd640 1 -- 172.21.15.80:0/3420845869 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8032440 con 0x7f2dd40d41b0 2024-04-25T15:43:51.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dd2ffd640 1 -- 172.21.15.80:0/3420845869 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8032810 con 0x7f2dd40d41b0 2024-04-25T15:43:51.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dda430640 1 -- 172.21.15.80:0/3420845869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40d41b0 msgr2=0x7f2dd40b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dda430640 1 --2- 172.21.15.80:0/3420845869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40d41b0 0x7f2dd40b48d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dd408e110 tx=0x7f2dc802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dda430640 1 -- 172.21.15.80:0/3420845869 shutdown_connections 2024-04-25T15:43:51.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dda430640 1 --2- 172.21.15.80:0/3420845869 >> v2:172.21.15.195:3300/0 conn(0x7f2dd40b7b90 0x7f2dd40d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dda430640 1 --2- 172.21.15.80:0/3420845869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.197+0000 7f2dda430640 1 --2- 172.21.15.80:0/3420845869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40d41b0 0x7f2dd40b48d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.198+0000 7f2dda430640 1 -- 172.21.15.80:0/3420845869 >> 172.21.15.80:0/3420845869 conn(0x7f2dd406e9f0 msgr2=0x7f2dd40d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.198+0000 7f2dda430640 1 -- 172.21.15.80:0/3420845869 shutdown_connections 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.198+0000 7f2dda430640 1 -- 172.21.15.80:0/3420845869 wait complete. 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.199+0000 7f2dda430640 1 Processor -- start 2024-04-25T15:43:51.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.199+0000 7f2dda430640 1 -- start start 2024-04-25T15:43:51.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dda430640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 0x7f2dd40ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dda430640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dd40d41b0 0x7f2dd41f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dda430640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dda430640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40b4fd0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dda430640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4164b10 con 0x7f2dd40d41b0 2024-04-25T15:43:51.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dda430640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd40b5150 con 0x7f2dd41602a0 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 0x7f2dd40ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 0x7f2dd40ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36876/0 (socket says 172.21.15.80:36876) 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3107019975 learned_addr learned my addr 172.21.15.80:0/3107019975 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd37fe640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dd40d41b0 0x7f2dd41f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd89cd640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 msgr2=0x7f2dd40ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dd40d41b0 msgr2=0x7f2dd41f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dd40d41b0 0x7f2dd41f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 -- 172.21.15.80:0/3107019975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd41f97d0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.201+0000 7f2dd3fff640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 0x7f2dd40ccc40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2dc802a220 tx=0x7f2dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.202+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8041020 con 0x7f2dd40b7b90 2024-04-25T15:43:51.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.202+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc80306c0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.202+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd40cd5b0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.202+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8037040 con 0x7f2dd40b7b90 2024-04-25T15:43:51.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.202+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd40cdb70 con 0x7f2dd40b7b90 2024-04-25T15:43:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.203+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd406a100 con 0x7f2dd40b7b90 2024-04-25T15:43:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.203+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2dc8044020 con 0x7f2dd40b7b90 2024-04-25T15:43:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.204+0000 7f2dd0ff9640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc00744b0 0x7f2dc00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.204+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2dc80b5ce0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.204+0000 7f2dd37fe640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc00744b0 0x7f2dc00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.204+0000 7f2dd37fe640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc00744b0 0x7f2dc00769c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40cf630 tx=0x7f2dc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.209+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2dc804b030 con 0x7f2dd40b7b90 2024-04-25T15:43:51.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.387+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dd40d3070 con 0x7f2dd40b7b90 2024-04-25T15:43:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.388+0000 7f2dd0ff9640 1 -- 172.21.15.80:0/3107019975 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f2dd41f97d0 con 0x7f2dd40b7b90 2024-04-25T15:43:51.390 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:51.390 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.390+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc00744b0 msgr2=0x7f2dc00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.390+0000 7f2dda430640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc00744b0 0x7f2dc00769c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40cf630 tx=0x7f2dc4008040 comp rx=0 tx=0).stop 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.390+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 msgr2=0x7f2dd40ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.390+0000 7f2dda430640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 0x7f2dd40ccc40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2dc802a220 tx=0x7f2dc80046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 shutdown_connections 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc00744b0 0x7f2dc00769c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2dd41602a0 0x7f2dd40ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dd40d41b0 0x7f2dd41f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 --2- 172.21.15.80:0/3107019975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dd40b7b90 0x7f2dd40ccc40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 >> 172.21.15.80:0/3107019975 conn(0x7f2dd406e9f0 msgr2=0x7f2dd4162e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 shutdown_connections 2024-04-25T15:43:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.391+0000 7f2dda430640 1 -- 172.21.15.80:0/3107019975 wait complete. 2024-04-25T15:43:51.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:51.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:51.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.513+0000 7feb8f4f2640 1 Processor -- start 2024-04-25T15:43:51.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.513+0000 7feb8f4f2640 1 -- start start 2024-04-25T15:43:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8f4f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb8815cc80 0x7feb8806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8f4f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880b0e70 0x7feb880b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8f4f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8806df20 con 0x7feb8806db10 2024-04-25T15:43:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8f4f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7feb880d1620 con 0x7feb8815cc80 2024-04-25T15:43:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8f4f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb880b5460 con 0x7feb880b0e70 2024-04-25T15:43:51.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8d28e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb8815cc80 0x7feb8806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8ca8d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb8806db10 0x7feb880b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47738/0 (socket says 172.21.15.80:47738) 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8ca8d640 1 -- 172.21.15.80:0/994409858 learned_addr learned my addr 172.21.15.80:0/994409858 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8d28e640 1 -- 172.21.15.80:0/994409858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880b0e70 msgr2=0x7feb880b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8d28e640 1 --2- 172.21.15.80:0/994409858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880b0e70 0x7feb880b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8d28e640 1 -- 172.21.15.80:0/994409858 >> v1:172.21.15.80:6789/0 conn(0x7feb8806db10 legacy=0x7feb880b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb7ffff640 1 -- 172.21.15.80:0/994409858 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914301445 0 0) 0x7feb78001110 con 0x7feb8806db10 2024-04-25T15:43:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.515+0000 7feb8d28e640 1 -- 172.21.15.80:0/994409858 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb880b4850 con 0x7feb8815cc80 2024-04-25T15:43:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.516+0000 7feb8d28e640 1 --2- 172.21.15.80:0/994409858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb8815cc80 0x7feb8806d5d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb8400bfa0 tx=0x7feb8402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2701e1ed400191 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.516+0000 7feb7ffff640 1 -- 172.21.15.80:0/994409858 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84039070 con 0x7feb8815cc80 2024-04-25T15:43:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.516+0000 7feb7ffff640 1 -- 172.21.15.80:0/994409858 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb84009540 con 0x7feb8815cc80 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.516+0000 7feb7ffff640 1 -- 172.21.15.80:0/994409858 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84009910 con 0x7feb8815cc80 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 -- 172.21.15.80:0/994409858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb8815cc80 msgr2=0x7feb8806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/994409858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb8815cc80 0x7feb8806d5d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb8400bfa0 tx=0x7feb8402c890 comp rx=0 tx=0).stop 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 -- 172.21.15.80:0/994409858 shutdown_connections 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/994409858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880b0e70 0x7feb880b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/994409858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb8815cc80 0x7feb8806d5d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 -- 172.21.15.80:0/994409858 >> 172.21.15.80:0/994409858 conn(0x7feb880734b0 msgr2=0x7feb880738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 -- 172.21.15.80:0/994409858 shutdown_connections 2024-04-25T15:43:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.517+0000 7feb8f4f2640 1 -- 172.21.15.80:0/994409858 wait complete. 2024-04-25T15:43:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.519+0000 7feb8f4f2640 1 Processor -- start 2024-04-25T15:43:51.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.519+0000 7feb8f4f2640 1 -- start start 2024-04-25T15:43:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8f4f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8806db10 0x7feb88158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8f4f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 0x7feb88143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8f4f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8815cc80 0x7feb88144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8f4f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feb880b50f0 con 0x7feb880b0e70 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8f4f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feb880b4e10 con 0x7feb8806db10 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8f4f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb8815d090 con 0x7feb8815cc80 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 0x7feb88143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 0x7feb88143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36898/0 (socket says 172.21.15.80:36898) 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 -- 172.21.15.80:0/4243671209 learned_addr learned my addr 172.21.15.80:0/4243671209 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8d28e640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8806db10 0x7feb88158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8da8f640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8815cc80 0x7feb88144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 -- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8815cc80 msgr2=0x7feb88144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8815cc80 0x7feb88144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 -- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8806db10 msgr2=0x7feb88158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8806db10 0x7feb88158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.520+0000 7feb8ca8d640 1 -- 172.21.15.80:0/4243671209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb881507f0 con 0x7feb880b0e70 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.521+0000 7feb8ca8d640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 0x7feb88143ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c3f0 tx=0x7feb7800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.521+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb780074e0 con 0x7feb880b0e70 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.521+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb780047e0 con 0x7feb880b0e70 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.521+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb88157e90 con 0x7feb880b0e70 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.521+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78004c10 con 0x7feb880b0e70 2024-04-25T15:43:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.521+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb88158450 con 0x7feb880b0e70 2024-04-25T15:43:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.522+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb88157be0 con 0x7feb880b0e70 2024-04-25T15:43:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.523+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb78011070 con 0x7feb880b0e70 2024-04-25T15:43:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.523+0000 7feb7dffb640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb6c0744b0 0x7feb6c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.523+0000 7feb8d28e640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb6c0744b0 0x7feb6c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.523+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7feb78095100 con 0x7feb880b0e70 2024-04-25T15:43:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.524+0000 7feb8d28e640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb6c0744b0 0x7feb6c0769c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feb84036000 tx=0x7feb8400b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.528+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb8806df20 con 0x7feb880b0e70 2024-04-25T15:43:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.704+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feb8806a100 con 0x7feb880b0e70 2024-04-25T15:43:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.705+0000 7feb7dffb640 1 -- 172.21.15.80:0/4243671209 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7feb7805ee40 con 0x7feb880b0e70 2024-04-25T15:43:51.706 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb6c0744b0 msgr2=0x7feb6c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb6c0744b0 0x7feb6c0769c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feb84036000 tx=0x7feb8400b000 comp rx=0 tx=0).stop 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 msgr2=0x7feb88143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 0x7feb88143ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c3f0 tx=0x7feb7800c8b0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 shutdown_connections 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb6c0744b0 0x7feb6c0769c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb8815cc80 0x7feb88144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb880b0e70 0x7feb88143ff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 --2- 172.21.15.80:0/4243671209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb8806db10 0x7feb88158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 >> 172.21.15.80:0/4243671209 conn(0x7feb880734b0 msgr2=0x7feb8815a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 shutdown_connections 2024-04-25T15:43:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.707+0000 7feb8f4f2640 1 -- 172.21.15.80:0/4243671209 wait complete. 2024-04-25T15:43:51.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:51.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.828+0000 7fa4d8d6c640 1 Processor -- start 2024-04-25T15:43:51.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.828+0000 7fa4d8d6c640 1 -- start start 2024-04-25T15:43:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d8d6c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa4d40cebe0 0x7fa4d40cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d8d6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d40d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d8d6c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4d40b2550 0x7fa4d40d2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d8d6c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d40d2580 con 0x7fa4d40b2550 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d8d6c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d40b3650 con 0x7fa4d40cebe0 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d8d6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d40b2a40 con 0x7fa4d40b2140 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4d40b2550 0x7fa4d40d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4d40b2550 0x7fa4d40d2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36906/0 (socket says 172.21.15.80:36906) 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.829+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/2087920737 learned_addr learned my addr 172.21.15.80:0/2087920737 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d259c640 1 --2- 172.21.15.80:0/2087920737 >> v2:172.21.15.195:3300/0 conn(0x7fa4d40cebe0 0x7fa4d40cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d1d9b640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d40d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/2087920737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 msgr2=0x7fa4d40d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d2d9d640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d40d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/2087920737 >> v2:172.21.15.195:3300/0 conn(0x7fa4d40cebe0 msgr2=0x7fa4d40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d2d9d640 1 --2- 172.21.15.80:0/2087920737 >> v2:172.21.15.195:3300/0 conn(0x7fa4d40cebe0 0x7fa4d40cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/2087920737 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40b2d20 con 0x7fa4d40b2550 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d259c640 1 --2- 172.21.15.80:0/2087920737 >> v2:172.21.15.195:3300/0 conn(0x7fa4d40cebe0 0x7fa4d40cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d1d9b640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.830+0000 7fa4d2d9d640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40b2550 0x7fa4d40d2040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4072e10 tx=0x7fa4c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71352ce3ef596246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d159a640 1 -- 172.21.15.80:0/2087920737 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4037070 con 0x7fa4d40b2550 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d159a640 1 -- 172.21.15.80:0/2087920737 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c4032440 con 0x7fa4d40b2550 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d159a640 1 -- 172.21.15.80:0/2087920737 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4032810 con 0x7fa4d40b2550 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/2087920737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40b2550 msgr2=0x7fa4d40d2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40b2550 0x7fa4d40d2040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4072e10 tx=0x7fa4c402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/2087920737 shutdown_connections 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40b2550 0x7fa4d40d2040 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/2087920737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/2087920737 >> v2:172.21.15.195:3300/0 conn(0x7fa4d40cebe0 0x7fa4d40cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/2087920737 >> 172.21.15.80:0/2087920737 conn(0x7fa4d40b75f0 msgr2=0x7fa4d40b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/2087920737 shutdown_connections 2024-04-25T15:43:51.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.831+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/2087920737 wait complete. 2024-04-25T15:43:51.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.833+0000 7fa4d8d6c640 1 Processor -- start 2024-04-25T15:43:51.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.833+0000 7fa4d8d6c640 1 -- start start 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d4154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4d40b2550 0x7fa4d40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 0x7fa4d406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d40d2840 con 0x7fa4d40cebe0 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d40b32e0 con 0x7fa4d40b2550 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d40d29c0 con 0x7fa4d40b2140 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 0x7fa4d406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 0x7fa4d406d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36918/0 (socket says 172.21.15.80:36918) 2024-04-25T15:43:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/4100274239 learned_addr learned my addr 172.21.15.80:0/4100274239 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d259c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d4154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d1d9b640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4d40b2550 0x7fa4d40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 msgr2=0x7fa4d4154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d4154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4d40b2550 msgr2=0x7fa4d40c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4d40b2550 0x7fa4d40c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 -- 172.21.15.80:0/4100274239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40c7190 con 0x7fa4d40cebe0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d2d9d640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 0x7fa4d406d610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40090b0 tx=0x7fa4c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4037040 con 0x7fa4d40cebe0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c4042070 con 0x7fa4d40cebe0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d40cad60 con 0x7fa4d40cebe0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.835+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4030bd0 con 0x7fa4d40cebe0 2024-04-25T15:43:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.836+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d40cb320 con 0x7fa4d40cebe0 2024-04-25T15:43:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.837+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d406a100 con 0x7fa4d40cebe0 2024-04-25T15:43:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.837+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa4c4047460 con 0x7fa4d40cebe0 2024-04-25T15:43:51.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.838+0000 7fa4caffd640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa4b40744e0 0x7fa4b40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:51.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.838+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa4c40b6030 con 0x7fa4d40cebe0 2024-04-25T15:43:51.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.838+0000 7fa4d259c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa4b40744e0 0x7fa4b40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:51.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.838+0000 7fa4d259c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa4b40744e0 0x7fa4b40769f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00f500 tx=0x7fa4cc007770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:51.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:51.842+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4c407fe00 con 0x7fa4d40cebe0 2024-04-25T15:43:52.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.019+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa4d40b3d00 con 0x7fa4d40cebe0 2024-04-25T15:43:52.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.019+0000 7fa4caffd640 1 -- 172.21.15.80:0/4100274239 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fa4c4084100 con 0x7fa4d40cebe0 2024-04-25T15:43:52.021 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa4b40744e0 msgr2=0x7fa4b40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa4b40744e0 0x7fa4b40769f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00f500 tx=0x7fa4cc007770 comp rx=0 tx=0).stop 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 msgr2=0x7fa4d406d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 0x7fa4d406d610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40090b0 tx=0x7fa4c40046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 shutdown_connections 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa4b40744e0 0x7fa4b40769f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d40cebe0 0x7fa4d406d610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4d40b2550 0x7fa4d40c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 --2- 172.21.15.80:0/4100274239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa4d40b2140 0x7fa4d4154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 >> 172.21.15.80:0/4100274239 conn(0x7fa4d40b75f0 msgr2=0x7fa4d415fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.021+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 shutdown_connections 2024-04-25T15:43:52.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.022+0000 7fa4d8d6c640 1 -- 172.21.15.80:0/4100274239 wait complete. 2024-04-25T15:43:52.034 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:52.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.143+0000 7f5ce7126640 1 Processor -- start 2024-04-25T15:43:52.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.143+0000 7f5ce7126640 1 -- start start 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5ce7126640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce006d920 0x7f5ce006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5ce7126640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce00cc710 con 0x7f5ce0163960 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5ce7126640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce00cc9f0 con 0x7f5ce00b7540 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5ce7126640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce00cccd0 con 0x7f5ce006d920 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5ce56c3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5ce0163960 0x7f5ce00cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47742/0 (socket says 172.21.15.80:47742) 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5ce56c3640 1 -- 172.21.15.80:0/1593751348 learned_addr learned my addr 172.21.15.80:0/1593751348 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.144+0000 7f5cdffff640 1 --2- 172.21.15.80:0/1593751348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce006d920 0x7f5ce006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239108288 0 0) 0x7f5ce00cc710 con 0x7f5ce0163960 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd0003520 con 0x7f5ce0163960 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388062426 0 0) 0x7f5ce00cc9f0 con 0x7f5ce00b7540 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce00cc710 con 0x7f5ce00b7540 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdffff640 1 -- 172.21.15.80:0/1593751348 >> v1:172.21.15.195:6789/0 conn(0x7f5ce00b7540 legacy=0x7f5ce006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdffff640 1 -- 172.21.15.80:0/1593751348 >> v1:172.21.15.80:6789/0 conn(0x7f5ce0163960 legacy=0x7f5ce00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.145+0000 7f5cdffff640 1 -- 172.21.15.80:0/1593751348 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce00ccfb0 con 0x7f5ce006d920 2024-04-25T15:43:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.146+0000 7f5cdffff640 1 --2- 172.21.15.80:0/1593751348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce006d920 0x7f5ce006c770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097d0 tx=0x7f5ccc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15038658e0c4b7ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.146+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc037070 con 0x7f5ce006d920 2024-04-25T15:43:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.146+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc032440 con 0x7f5ce006d920 2024-04-25T15:43:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.146+0000 7f5cdf7fe640 1 -- 172.21.15.80:0/1593751348 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0327f0 con 0x7f5ce006d920 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.146+0000 7f5ce7126640 1 -- 172.21.15.80:0/1593751348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce006d920 msgr2=0x7f5ce006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.146+0000 7f5ce7126640 1 --2- 172.21.15.80:0/1593751348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce006d920 0x7f5ce006c770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097d0 tx=0x7f5ccc02a210 comp rx=0 tx=0).stop 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.147+0000 7f5ce7126640 1 -- 172.21.15.80:0/1593751348 shutdown_connections 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.147+0000 7f5ce7126640 1 --2- 172.21.15.80:0/1593751348 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce006d920 0x7f5ce006c770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.147+0000 7f5ce7126640 1 -- 172.21.15.80:0/1593751348 >> 172.21.15.80:0/1593751348 conn(0x7f5ce009b410 msgr2=0x7f5ce00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.147+0000 7f5ce7126640 1 -- 172.21.15.80:0/1593751348 shutdown_connections 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.147+0000 7f5ce7126640 1 -- 172.21.15.80:0/1593751348 wait complete. 2024-04-25T15:43:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.148+0000 7f5ce7126640 1 Processor -- start 2024-04-25T15:43:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.148+0000 7f5ce7126640 1 -- start start 2024-04-25T15:43:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce7126640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce00b7540 0x7f5ce01f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce7126640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce0163960 0x7f5ce01fa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce7126640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 0x7f5ce00c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce7126640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce006cf40 con 0x7f5ce00d27a0 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce7126640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce006cdc0 con 0x7f5ce00b7540 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce7126640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce00cdbe0 con 0x7f5ce0163960 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 0x7f5ce00c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 0x7f5ce00c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36922/0 (socket says 172.21.15.80:36922) 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 -- 172.21.15.80:0/2776906563 learned_addr learned my addr 172.21.15.80:0/2776906563 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce4ec2640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce00b7540 0x7f5ce01f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5cdffff640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce0163960 0x7f5ce01fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 -- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce0163960 msgr2=0x7f5ce01fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce0163960 0x7f5ce01fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 -- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce00b7540 msgr2=0x7f5ce01f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce00b7540 0x7f5ce01f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 -- 172.21.15.80:0/2776906563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce01f6e90 con 0x7f5ce00d27a0 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce4ec2640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce00b7540 0x7f5ce01f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5cdffff640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce0163960 0x7f5ce01fa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.150+0000 7f5ce56c3640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 0x7f5ce00c5b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800caf0 tx=0x7f5cd800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.151+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8017070 con 0x7f5ce00d27a0 2024-04-25T15:43:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.151+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd800aca0 con 0x7f5ce00d27a0 2024-04-25T15:43:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.151+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce01f7170 con 0x7f5ce00d27a0 2024-04-25T15:43:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.151+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8012620 con 0x7f5ce00d27a0 2024-04-25T15:43:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.151+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce01f9ef0 con 0x7f5ce00d27a0 2024-04-25T15:43:52.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.152+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce006a100 con 0x7f5ce00d27a0 2024-04-25T15:43:52.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.152+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5cd801a070 con 0x7f5ce00d27a0 2024-04-25T15:43:52.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.153+0000 7f5cdd7fa640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5cc40744e0 0x7f5cc40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.153+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5cd8095320 con 0x7f5ce00d27a0 2024-04-25T15:43:52.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.153+0000 7f5ce4ec2640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5cc40744e0 0x7f5cc40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.153+0000 7f5ce4ec2640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5cc40744e0 0x7f5cc40769f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00cfab0 tx=0x7f5cd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.157+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5cd805f740 con 0x7f5ce00d27a0 2024-04-25T15:43:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.332+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ce01f6c20 con 0x7f5ce00d27a0 2024-04-25T15:43:52.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.333+0000 7f5cdd7fa640 1 -- 172.21.15.80:0/2776906563 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f5cd805f040 con 0x7f5ce00d27a0 2024-04-25T15:43:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5cc40744e0 msgr2=0x7f5cc40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5cc40744e0 0x7f5cc40769f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00cfab0 tx=0x7f5cd4009040 comp rx=0 tx=0).stop 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 msgr2=0x7f5ce00c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 0x7f5ce00c5b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800caf0 tx=0x7f5cd800a060 comp rx=0 tx=0).stop 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 shutdown_connections 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5cc40744e0 0x7f5cc40769f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ce00d27a0 0x7f5ce00c5b50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5ce0163960 0x7f5ce01fa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 --2- 172.21.15.80:0/2776906563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce00b7540 0x7f5ce01f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 >> 172.21.15.80:0/2776906563 conn(0x7f5ce009b410 msgr2=0x7f5ce00b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 shutdown_connections 2024-04-25T15:43:52.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.335+0000 7f5ce7126640 1 -- 172.21.15.80:0/2776906563 wait complete. 2024-04-25T15:43:52.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:52.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.455+0000 7f8bb37c7640 1 Processor -- start 2024-04-25T15:43:52.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.455+0000 7f8bb37c7640 1 -- start start 2024-04-25T15:43:52.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.456+0000 7f8bb37c7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8bac06cc10 0x7f8bac06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.456+0000 7f8bb37c7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac0d1460 0x7f8bac06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.456+0000 7f8bb37c7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bac0cfc90 con 0x7f8bac0b37b0 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.456+0000 7f8bb37c7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8bac06c9a0 con 0x7f8bac06cc10 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.456+0000 7f8bb37c7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac0d2c10 con 0x7f8bac0d1460 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1d64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac0d1460 0x7f8bac06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8bac06cc10 0x7f8bac06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8bac06cc10 0x7f8bac06d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:46170/0 (socket says 172.21.15.80:46170) 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1d64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac0d1460 0x7f8bac06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:34190/0 (socket says 172.21.15.80:34190) 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb0d62640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f8bac0b37b0 0x7f8bac0d1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:35300/0 (socket says 172.21.15.80:35300) 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 -- 172.21.15.80:0/178643539 learned_addr learned my addr 172.21.15.80:0/178643539 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 -- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac0d1460 msgr2=0x7f8bac06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 --2- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac0d1460 0x7f8bac06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 -- 172.21.15.80:0/178643539 >> v1:172.21.15.195:6789/0 conn(0x7f8bac0b37b0 legacy=0x7f8bac0d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8ba3fff640 1 -- 172.21.15.80:0/178643539 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298247632 0 0) 0x7f8bac0cfc90 con 0x7f8bac0b37b0 2024-04-25T15:43:52.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.457+0000 7f8bb1563640 1 -- 172.21.15.80:0/178643539 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac0cff30 con 0x7f8bac06cc10 2024-04-25T15:43:52.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.458+0000 7f8bb1563640 1 --2- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac06cc10 0x7f8bac06d160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009870 tx=0x7f8ba802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e15cf1edb8b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.458+0000 7f8ba3fff640 1 -- 172.21.15.80:0/178643539 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8037070 con 0x7f8bac06cc10 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.458+0000 7f8ba3fff640 1 -- 172.21.15.80:0/178643539 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8032440 con 0x7f8bac06cc10 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.458+0000 7f8ba3fff640 1 -- 172.21.15.80:0/178643539 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8032810 con 0x7f8bac06cc10 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 -- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac06cc10 msgr2=0x7f8bac06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac06cc10 0x7f8bac06d160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009870 tx=0x7f8ba802a270 comp rx=0 tx=0).stop 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 -- 172.21.15.80:0/178643539 shutdown_connections 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac0d1460 0x7f8bac06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/178643539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac06cc10 0x7f8bac06d160 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 -- 172.21.15.80:0/178643539 >> 172.21.15.80:0/178643539 conn(0x7f8bac09b410 msgr2=0x7f8bac0b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 -- 172.21.15.80:0/178643539 shutdown_connections 2024-04-25T15:43:52.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.459+0000 7f8bb37c7640 1 -- 172.21.15.80:0/178643539 wait complete. 2024-04-25T15:43:52.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.461+0000 7f8bb37c7640 1 Processor -- start 2024-04-25T15:43:52.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.461+0000 7f8bb37c7640 1 -- start start 2024-04-25T15:43:52.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb37c7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac06cc10 0x7f8bac15e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb37c7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac0b37b0 0x7f8bac156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb37c7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 0x7f8bac0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb37c7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac076230 con 0x7f8bac0d1460 2024-04-25T15:43:52.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb37c7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac06c670 con 0x7f8bac0b37b0 2024-04-25T15:43:52.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb37c7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac163860 con 0x7f8bac06cc10 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb1d64640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 0x7f8bac0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb1d64640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 0x7f8bac0c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36926/0 (socket says 172.21.15.80:36926) 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb1d64640 1 -- 172.21.15.80:0/2337644748 learned_addr learned my addr 172.21.15.80:0/2337644748 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb1563640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac06cc10 0x7f8bac15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.462+0000 7f8bb0d62640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac0b37b0 0x7f8bac156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb1d64640 1 -- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac06cc10 msgr2=0x7f8bac15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb1d64640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac06cc10 0x7f8bac15e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb1d64640 1 -- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac0b37b0 msgr2=0x7f8bac156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb1d64640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac0b37b0 0x7f8bac156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb1d64640 1 -- 172.21.15.80:0/2337644748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac15f050 con 0x7f8bac0d1460 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb1d64640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 0x7f8bac0c8010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400ef90 tx=0x7f8ba400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4018020 con 0x7f8bac0d1460 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4014480 con 0x7f8bac0d1460 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac0c5bf0 con 0x7f8bac0d1460 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4009e60 con 0x7f8bac0d1460 2024-04-25T15:43:52.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.463+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac0c61b0 con 0x7f8bac0d1460 2024-04-25T15:43:52.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.464+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bac06a100 con 0x7f8bac0d1460 2024-04-25T15:43:52.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.465+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8ba4005d10 con 0x7f8bac0d1460 2024-04-25T15:43:52.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.465+0000 7f8ba1ffb640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b900744b0 0x7f8b900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.465+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8ba4096230 con 0x7f8bac0d1460 2024-04-25T15:43:52.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.465+0000 7f8bb1563640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b900744b0 0x7f8b900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.466+0000 7f8bb1563640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b900744b0 0x7f8b900769c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8034000 tx=0x7f8ba802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.470+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ba4022030 con 0x7f8bac0d1460 2024-04-25T15:43:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.644+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8bac0b7bd0 con 0x7f8bac0d1460 2024-04-25T15:43:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.645+0000 7f8ba1ffb640 1 -- 172.21.15.80:0/2337644748 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f8bac0b7bd0 con 0x7f8bac0d1460 2024-04-25T15:43:52.646 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:52.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b900744b0 msgr2=0x7f8b900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b900744b0 0x7f8b900769c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8034000 tx=0x7f8ba802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:52.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 msgr2=0x7f8bac0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 0x7f8bac0c8010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400ef90 tx=0x7f8ba400c490 comp rx=0 tx=0).stop 2024-04-25T15:43:52.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 shutdown_connections 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b900744b0 0x7f8b900769c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bac0d1460 0x7f8bac0c8010 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bac0b37b0 0x7f8bac156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 --2- 172.21.15.80:0/2337644748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8bac06cc10 0x7f8bac15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 >> 172.21.15.80:0/2337644748 conn(0x7f8bac09b410 msgr2=0x7f8bac162b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 shutdown_connections 2024-04-25T15:43:52.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.647+0000 7f8bb37c7640 1 -- 172.21.15.80:0/2337644748 wait complete. 2024-04-25T15:43:52.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:43:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.766+0000 7f4248029640 1 Processor -- start 2024-04-25T15:43:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.766+0000 7f4248029640 1 -- start start 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4248029640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4240071950 0x7f4240072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4248029640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240161c80 0x7f42400b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4248029640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f42400b74c0 0x7f42400d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4248029640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4240072aa0 con 0x7f4240071950 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4248029640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f42401624d0 con 0x7f42400b74c0 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4248029640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42401627b0 con 0x7f4240161c80 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4245dc5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4240071950 0x7f4240072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.767+0000 7f4245dc5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4240071950 0x7f4240072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36942/0 (socket says 172.21.15.80:36942) 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 -- 172.21.15.80:0/866644071 learned_addr learned my addr 172.21.15.80:0/866644071 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f42465c6640 1 --2- 172.21.15.80:0/866644071 >> v2:172.21.15.195:3300/0 conn(0x7f42400b74c0 0x7f42400d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f42455c4640 1 --2- 172.21.15.80:0/866644071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240161c80 0x7f42400b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 -- 172.21.15.80:0/866644071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240161c80 msgr2=0x7f42400b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 --2- 172.21.15.80:0/866644071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240161c80 0x7f42400b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 -- 172.21.15.80:0/866644071 >> v2:172.21.15.195:3300/0 conn(0x7f42400b74c0 msgr2=0x7f42400d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 --2- 172.21.15.80:0/866644071 >> v2:172.21.15.195:3300/0 conn(0x7f42400b74c0 0x7f42400d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 -- 172.21.15.80:0/866644071 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4240162a90 con 0x7f4240071950 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f42465c6640 1 --2- 172.21.15.80:0/866644071 >> v2:172.21.15.195:3300/0 conn(0x7f42400b74c0 0x7f42400d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.768+0000 7f4245dc5640 1 --2- 172.21.15.80:0/866644071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240071950 0x7f4240072560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f42401626e0 tx=0x7f423c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94be27be4d8bdb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4244dc3640 1 -- 172.21.15.80:0/866644071 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c037070 con 0x7f4240071950 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4244dc3640 1 -- 172.21.15.80:0/866644071 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423c032440 con 0x7f4240071950 2024-04-25T15:43:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4244dc3640 1 -- 172.21.15.80:0/866644071 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c032810 con 0x7f4240071950 2024-04-25T15:43:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 -- 172.21.15.80:0/866644071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240071950 msgr2=0x7f4240072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 --2- 172.21.15.80:0/866644071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240071950 0x7f4240072560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f42401626e0 tx=0x7f423c02a130 comp rx=0 tx=0).stop 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 -- 172.21.15.80:0/866644071 shutdown_connections 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 --2- 172.21.15.80:0/866644071 >> v2:172.21.15.195:3300/0 conn(0x7f42400b74c0 0x7f42400d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 --2- 172.21.15.80:0/866644071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240161c80 0x7f42400b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 --2- 172.21.15.80:0/866644071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240071950 0x7f4240072560 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 -- 172.21.15.80:0/866644071 >> 172.21.15.80:0/866644071 conn(0x7f42400d3ea0 msgr2=0x7f42400d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.769+0000 7f4248029640 1 -- 172.21.15.80:0/866644071 shutdown_connections 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.770+0000 7f4248029640 1 -- 172.21.15.80:0/866644071 wait complete. 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.771+0000 7f4248029640 1 Processor -- start 2024-04-25T15:43:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.771+0000 7f4248029640 1 -- start start 2024-04-25T15:43:52.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.772+0000 7f4248029640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240071950 0x7f42400afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42400b74c0 0x7f4240155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 0x7f42400b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4240162210 con 0x7f4240161c80 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4240162090 con 0x7f42400b74c0 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42400d2fd0 con 0x7f4240071950 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 0x7f42400b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 0x7f42400b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36946/0 (socket says 172.21.15.80:36946) 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 -- 172.21.15.80:0/2640447727 learned_addr learned my addr 172.21.15.80:0/2640447727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42455c4640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42400b74c0 0x7f4240155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4245dc5640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240071950 0x7f42400afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 -- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240071950 msgr2=0x7f42400afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240071950 0x7f42400afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 -- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42400b74c0 msgr2=0x7f4240155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42400b74c0 0x7f4240155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 -- 172.21.15.80:0/2640447727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42400aec90 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42465c6640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 0x7f42400b0610 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f423800cca0 tx=0x7f423800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423800f680 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423800f840 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423800fc30 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42400aef70 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.773+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42400af530 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.775+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42400aea00 con 0x7f4240161c80 2024-04-25T15:43:52.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.775+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f42380213f0 con 0x7f4240161c80 2024-04-25T15:43:52.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.775+0000 7f42367fc640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42240744b0 0x7f42240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:52.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.775+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4238096190 con 0x7f4240161c80 2024-04-25T15:43:52.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.775+0000 7f4245dc5640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42240744b0 0x7f42240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:52.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.776+0000 7f4245dc5640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42240744b0 0x7f42240769c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f423c034000 tx=0x7f423c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:52.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.780+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4238014030 con 0x7f4240161c80 2024-04-25T15:43:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.966+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f424006a100 con 0x7f4240161c80 2024-04-25T15:43:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.966+0000 7f42367fc640 1 -- 172.21.15.80:0/2640447727 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f423805ff60 con 0x7f4240161c80 2024-04-25T15:43:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42240744b0 msgr2=0x7f42240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42240744b0 0x7f42240769c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f423c034000 tx=0x7f423c02e000 comp rx=0 tx=0).stop 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 msgr2=0x7f42400b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 0x7f42400b0610 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f423800cca0 tx=0x7f423800a650 comp rx=0 tx=0).stop 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 shutdown_connections 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42240744b0 0x7f42240769c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4240161c80 0x7f42400b0610 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42400b74c0 0x7f4240155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 --2- 172.21.15.80:0/2640447727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4240071950 0x7f42400afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:52.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 >> 172.21.15.80:0/2640447727 conn(0x7f42400d3ea0 msgr2=0x7f42400b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:52.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 shutdown_connections 2024-04-25T15:43:52.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:52.968+0000 7f4248029640 1 -- 172.21.15.80:0/2640447727 wait complete. 2024-04-25T15:43:52.980 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:43:52.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:52.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T15:43:53.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:43:53.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:53.005 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:43:53.062 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:53.062 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:53.080 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:53.080 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:53.139 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:53.139 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:53.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:53.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.302+0000 7f9a5c8d1640 1 Processor -- start 2024-04-25T15:43:53.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.302+0000 7f9a5c8d1640 1 -- start start 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5c8d1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a58165cc0 0x7f9a581680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5c8d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a580b1180 con 0x7f9a58153f70 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5c8d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5815d4f0 con 0x7f9a5806d5d0 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5c8d1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5815e270 con 0x7f9a58165cc0 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a56d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a58165cc0 0x7f9a581680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a58153f70 0x7f9a580b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47744/0 (socket says 172.21.15.80:47744) 2024-04-25T15:43:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5659c640 1 -- 172.21.15.80:0/1158413640 learned_addr learned my addr 172.21.15.80:0/1158413640 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a56d9d640 1 -- 172.21.15.80:0/1158413640 >> v1:172.21.15.195:6789/0 conn(0x7f9a5806d5d0 legacy=0x7f9a5806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a56d9d640 1 -- 172.21.15.80:0/1158413640 >> v1:172.21.15.80:6789/0 conn(0x7f9a58153f70 legacy=0x7f9a580b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a5559a640 1 -- 172.21.15.80:0/1158413640 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721610832 0 0) 0x7f9a580b1180 con 0x7f9a58153f70 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.304+0000 7f9a56d9d640 1 -- 172.21.15.80:0/1158413640 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5815d790 con 0x7f9a58165cc0 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.305+0000 7f9a56d9d640 1 --2- 172.21.15.80:0/1158413640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58165cc0 0x7f9a581680e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a500097a0 tx=0x7f9a5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37334d81357e67db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.305+0000 7f9a5559a640 1 -- 172.21.15.80:0/1158413640 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50037070 con 0x7f9a58165cc0 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.305+0000 7f9a5559a640 1 -- 172.21.15.80:0/1158413640 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a50032440 con 0x7f9a58165cc0 2024-04-25T15:43:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.305+0000 7f9a5559a640 1 -- 172.21.15.80:0/1158413640 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50032810 con 0x7f9a58165cc0 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/1158413640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58165cc0 msgr2=0x7f9a581680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/1158413640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58165cc0 0x7f9a581680e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a500097a0 tx=0x7f9a5002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/1158413640 shutdown_connections 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/1158413640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58165cc0 0x7f9a581680e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/1158413640 >> 172.21.15.80:0/1158413640 conn(0x7f9a580d1e20 msgr2=0x7f9a58073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/1158413640 shutdown_connections 2024-04-25T15:43:53.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.306+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/1158413640 wait complete. 2024-04-25T15:43:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.308+0000 7f9a5c8d1640 1 Processor -- start 2024-04-25T15:43:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.308+0000 7f9a5c8d1640 1 -- start start 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a5c8d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5806d5d0 0x7f9a58162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a5c8d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 0x7f9a58157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a5c8d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a58165cc0 0x7f9a581f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a5c8d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580b0dd0 con 0x7f9a58153f70 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a5c8d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580b5710 con 0x7f9a58165cc0 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a5c8d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9a581f5240 con 0x7f9a5806d5d0 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a55d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 0x7f9a58157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a55d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 0x7f9a58157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36964/0 (socket says 172.21.15.80:36964) 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.309+0000 7f9a55d9b640 1 -- 172.21.15.80:0/2184713850 learned_addr learned my addr 172.21.15.80:0/2184713850 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a56d9d640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a58165cc0 0x7f9a581f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a5659c640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5806d5d0 0x7f9a58162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a55d9b640 1 -- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5806d5d0 msgr2=0x7f9a58162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a55d9b640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5806d5d0 0x7f9a58162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a55d9b640 1 -- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a58165cc0 msgr2=0x7f9a581f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a55d9b640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a58165cc0 0x7f9a581f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a55d9b640 1 -- 172.21.15.80:0/2184713850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a58161ba0 con 0x7f9a58153f70 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a55d9b640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 0x7f9a58157070 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00b420 tx=0x7f9a4c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c011830 con 0x7f9a58153f70 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4c016070 con 0x7f9a58153f70 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a581575b0 con 0x7f9a58153f70 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c011c10 con 0x7f9a58153f70 2024-04-25T15:43:53.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.310+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a58162120 con 0x7f9a58153f70 2024-04-25T15:43:53.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.311+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a58157810 con 0x7f9a58153f70 2024-04-25T15:43:53.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.312+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9a4c01b460 con 0x7f9a58153f70 2024-04-25T15:43:53.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.312+0000 7f9a46ffd640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a380744b0 0x7f9a380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.312+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9a4c094ea0 con 0x7f9a58153f70 2024-04-25T15:43:53.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.312+0000 7f9a5659c640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a380744b0 0x7f9a380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.313+0000 7f9a5659c640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a380744b0 0x7f9a380769c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a480012e0 tx=0x7f9a48001630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.317+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a58157810 con 0x7f9a58153f70 2024-04-25T15:43:53.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.500+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a5806a100 con 0x7f9a58153f70 2024-04-25T15:43:53.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.501+0000 7f9a46ffd640 1 -- 172.21.15.80:0/2184713850 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f9a4c020020 con 0x7f9a58153f70 2024-04-25T15:43:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:53.503 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a380744b0 msgr2=0x7f9a380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a380744b0 0x7f9a380769c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a480012e0 tx=0x7f9a48001630 comp rx=0 tx=0).stop 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 msgr2=0x7f9a58157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 0x7f9a58157070 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00b420 tx=0x7f9a4c00b8e0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 shutdown_connections 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a380744b0 0x7f9a380769c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a58165cc0 0x7f9a581f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a58153f70 0x7f9a58157070 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.503+0000 7f9a5c8d1640 1 --2- 172.21.15.80:0/2184713850 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5806d5d0 0x7f9a58162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.504+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 >> 172.21.15.80:0/2184713850 conn(0x7f9a580d1e20 msgr2=0x7f9a580b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:53.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.504+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 shutdown_connections 2024-04-25T15:43:53.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.504+0000 7f9a5c8d1640 1 -- 172.21.15.80:0/2184713850 wait complete. 2024-04-25T15:43:53.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:53.516 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:53.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.627+0000 7f614a95e640 1 Processor -- start 2024-04-25T15:43:53.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.627+0000 7f614a95e640 1 -- start start 2024-04-25T15:43:53.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f614a95e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6144160090 0x7f614406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f614a95e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f6144071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f614a95e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6144072220 con 0x7f61440b2db0 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f614a95e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f61440cef30 con 0x7f6144160090 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f614a95e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f61440b31c0 con 0x7f61440718d0 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6144160090 0x7f614406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6144160090 0x7f614406d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36980/0 (socket says 172.21.15.80:36980) 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 -- 172.21.15.80:0/4021050224 learned_addr learned my addr 172.21.15.80:0/4021050224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f6143fff640 1 --1- 172.21.15.80:0/4021050224 >> v1:172.21.15.80:6789/0 conn(0x7f61440b2db0 0x7f61440d2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47754/0 (socket says 172.21.15.80:47754) 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f6148efb640 1 --2- 172.21.15.80:0/4021050224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f6144071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 -- 172.21.15.80:0/4021050224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 msgr2=0x7f6144071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 --2- 172.21.15.80:0/4021050224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f6144071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 -- 172.21.15.80:0/4021050224 >> v1:172.21.15.80:6789/0 conn(0x7f61440b2db0 legacy=0x7f61440d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f61437fe640 1 -- 172.21.15.80:0/4021050224 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61440ce640 con 0x7f6144160090 2024-04-25T15:43:53.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.628+0000 7f6142ffd640 1 -- 172.21.15.80:0/4021050224 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943718799 0 0) 0x7f6134001110 con 0x7f61440b2db0 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.629+0000 7f61437fe640 1 --2- 172.21.15.80:0/4021050224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6144160090 0x7f614406d6d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6138009870 tx=0x7f613802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ceca3473432100 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.629+0000 7f6142ffd640 1 -- 172.21.15.80:0/4021050224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138037070 con 0x7f6144160090 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.629+0000 7f6142ffd640 1 -- 172.21.15.80:0/4021050224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138032440 con 0x7f6144160090 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.629+0000 7f6142ffd640 1 -- 172.21.15.80:0/4021050224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138032810 con 0x7f6144160090 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 -- 172.21.15.80:0/4021050224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6144160090 msgr2=0x7f614406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 --2- 172.21.15.80:0/4021050224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6144160090 0x7f614406d6d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6138009870 tx=0x7f613802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 -- 172.21.15.80:0/4021050224 shutdown_connections 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 --2- 172.21.15.80:0/4021050224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f6144071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 --2- 172.21.15.80:0/4021050224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6144160090 0x7f614406d6d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 -- 172.21.15.80:0/4021050224 >> 172.21.15.80:0/4021050224 conn(0x7f61440d3a30 msgr2=0x7f61440d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 -- 172.21.15.80:0/4021050224 shutdown_connections 2024-04-25T15:43:53.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.630+0000 7f614a95e640 1 -- 172.21.15.80:0/4021050224 wait complete. 2024-04-25T15:43:53.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.632+0000 7f614a95e640 1 Processor -- start 2024-04-25T15:43:53.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.632+0000 7f614a95e640 1 -- start start 2024-04-25T15:43:53.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f614a95e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f61441fab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f614a95e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 0x7f61441571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f614a95e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6144160090 0x7f61441eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f614a95e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f61440cebc0 con 0x7f61440b2db0 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f614a95e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f61440ce920 con 0x7f6144160090 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f614a95e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f61441604a0 con 0x7f61440718d0 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f61437fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 0x7f61441571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f61437fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 0x7f61441571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36986/0 (socket says 172.21.15.80:36986) 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f61437fe640 1 -- 172.21.15.80:0/97730357 learned_addr learned my addr 172.21.15.80:0/97730357 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f6148efb640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6144160090 0x7f61441eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.633+0000 7f6143fff640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f61441fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f61437fe640 1 -- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 msgr2=0x7f61441fab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f61437fe640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f61441fab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f61437fe640 1 -- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6144160090 msgr2=0x7f61441eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f61437fe640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6144160090 0x7f61441eb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f61437fe640 1 -- 172.21.15.80:0/97730357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441fb090 con 0x7f61440b2db0 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f61437fe640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 0x7f61441571b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6138009870 tx=0x7f61380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138037040 con 0x7f61440b2db0 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138004230 con 0x7f61440b2db0 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61441576f0 con 0x7f61440b2db0 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138003610 con 0x7f61440b2db0 2024-04-25T15:43:53.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.634+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61440b6ba0 con 0x7f61440b2db0 2024-04-25T15:43:53.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.635+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614406a100 con 0x7f61440b2db0 2024-04-25T15:43:53.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.636+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f613802ad10 con 0x7f61440b2db0 2024-04-25T15:43:53.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.636+0000 7f6140ff9640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61300744e0 0x7f61300769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.636+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f61380b6160 con 0x7f61440b2db0 2024-04-25T15:43:53.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.636+0000 7f6143fff640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61300744e0 0x7f61300769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.637+0000 7f6143fff640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61300744e0 0x7f61300769f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6134000f60 tx=0x7f6134007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.641+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61441fb090 con 0x7f61440b2db0 2024-04-25T15:43:53.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.813+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f61440b99b0 con 0x7f61440b2db0 2024-04-25T15:43:53.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.814+0000 7f6140ff9640 1 -- 172.21.15.80:0/97730357 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f6138080580 con 0x7f61440b2db0 2024-04-25T15:43:53.815 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61300744e0 msgr2=0x7f61300769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61300744e0 0x7f61300769f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6134000f60 tx=0x7f6134007c00 comp rx=0 tx=0).stop 2024-04-25T15:43:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 msgr2=0x7f61441571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 0x7f61441571b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6138009870 tx=0x7f61380046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 shutdown_connections 2024-04-25T15:43:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f61300744e0 0x7f61300769f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6144160090 0x7f61441eb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61440b2db0 0x7f61441571b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 --2- 172.21.15.80:0/97730357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61440718d0 0x7f61441fab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 >> 172.21.15.80:0/97730357 conn(0x7f61440d3a30 msgr2=0x7f614406d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 shutdown_connections 2024-04-25T15:43:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.816+0000 7f614a95e640 1 -- 172.21.15.80:0/97730357 wait complete. 2024-04-25T15:43:53.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:53.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.938+0000 7f0d38f7d640 1 Processor -- start 2024-04-25T15:43:53.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.938+0000 7f0d38f7d640 1 -- start start 2024-04-25T15:43:53.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d38f7d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 0x7f0d340d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d38f7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 0x7f0d340d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d38f7d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d341643f0 con 0x7f0d340b5490 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d38f7d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0d341646d0 con 0x7f0d340d0b00 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d38f7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d341649b0 con 0x7f0d340d2b80 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 0x7f0d340d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d2bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 0x7f0d340d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d2bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 0x7f0d340d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:46228/0 (socket says 172.21.15.80:46228) 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 0x7f0d340d47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:34242/0 (socket says 172.21.15.80:34242) 2024-04-25T15:43:53.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.939+0000 7f0d2bfff640 1 -- 172.21.15.80:0/3767433144 learned_addr learned my addr 172.21.15.80:0/3767433144 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.940+0000 7f0d32d9d640 1 -- 172.21.15.80:0/3767433144 >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 msgr2=0x7f0d340d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.940+0000 7f0d32d9d640 1 --2- 172.21.15.80:0/3767433144 >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 0x7f0d340d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.940+0000 7f0d32d9d640 1 -- 172.21.15.80:0/3767433144 >> v1:172.21.15.195:6789/0 conn(0x7f0d340b5490 legacy=0x7f0d34160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.940+0000 7f0d32d9d640 1 -- 172.21.15.80:0/3767433144 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d34164c90 con 0x7f0d340d2b80 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.940+0000 7f0d2bfff640 1 --2- 172.21.15.80:0/3767433144 >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 0x7f0d340d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.941+0000 7f0d32d9d640 1 --2- 172.21.15.80:0/3767433144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 0x7f0d340d47d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009d90 tx=0x7f0d2c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7734e7ea07f98a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.941+0000 7f0d31d9b640 1 -- 172.21.15.80:0/3767433144 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c007740 con 0x7f0d340d2b80 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.941+0000 7f0d31d9b640 1 -- 172.21.15.80:0/3767433144 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0078e0 con 0x7f0d340d2b80 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.941+0000 7f0d31d9b640 1 -- 172.21.15.80:0/3767433144 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c007cb0 con 0x7f0d340d2b80 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.941+0000 7f0d38f7d640 1 -- 172.21.15.80:0/3767433144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 msgr2=0x7f0d340d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.941+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/3767433144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 0x7f0d340d47d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009d90 tx=0x7f0d2c02a660 comp rx=0 tx=0).stop 2024-04-25T15:43:53.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.942+0000 7f0d38f7d640 1 -- 172.21.15.80:0/3767433144 shutdown_connections 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.942+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/3767433144 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d2b80 0x7f0d340d47d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.942+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/3767433144 >> v2:172.21.15.195:3300/0 conn(0x7f0d340d0b00 0x7f0d340d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.942+0000 7f0d38f7d640 1 -- 172.21.15.80:0/3767433144 >> 172.21.15.80:0/3767433144 conn(0x7f0d3406e650 msgr2=0x7f0d3406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.942+0000 7f0d38f7d640 1 -- 172.21.15.80:0/3767433144 shutdown_connections 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.942+0000 7f0d38f7d640 1 -- 172.21.15.80:0/3767433144 wait complete. 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.943+0000 7f0d38f7d640 1 Processor -- start 2024-04-25T15:43:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.943+0000 7f0d38f7d640 1 -- start start 2024-04-25T15:43:53.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d38f7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d0b00 0x7f0d340ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d38f7d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d340d2b80 0x7f0d340cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d38f7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 0x7f0d3415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d38f7d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340b94e0 con 0x7f0d3414ffe0 2024-04-25T15:43:53.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d38f7d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340b9360 con 0x7f0d340d2b80 2024-04-25T15:43:53.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d38f7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0d34163f80 con 0x7f0d340d0b00 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 0x7f0d3415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d3259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d0b00 0x7f0d340ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 0x7f0d3415f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36988/0 (socket says 172.21.15.80:36988) 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 -- 172.21.15.80:0/2762280686 learned_addr learned my addr 172.21.15.80:0/2762280686 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d2bfff640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d340d2b80 0x7f0d340cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 -- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d0b00 msgr2=0x7f0d340ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d0b00 0x7f0d340ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 -- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d340d2b80 msgr2=0x7f0d340cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d340d2b80 0x7f0d340cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 -- 172.21.15.80:0/2762280686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3414d310 con 0x7f0d3414ffe0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.945+0000 7f0d32d9d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 0x7f0d3415f090 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009eb0 tx=0x7f0d2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.946+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c03f070 con 0x7f0d3414ffe0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.946+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c031bc0 con 0x7f0d3414ffe0 2024-04-25T15:43:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.946+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d340ad010 con 0x7f0d3414ffe0 2024-04-25T15:43:53.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.946+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c009450 con 0x7f0d3414ffe0 2024-04-25T15:43:53.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.946+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d340ad5d0 con 0x7f0d3414ffe0 2024-04-25T15:43:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.947+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3406a100 con 0x7f0d3414ffe0 2024-04-25T15:43:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.947+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0d2c03b410 con 0x7f0d3414ffe0 2024-04-25T15:43:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.948+0000 7f0d2affd640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0d140744e0 0x7f0d140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.948+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0d2c0b6c60 con 0x7f0d3414ffe0 2024-04-25T15:43:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.948+0000 7f0d3259c640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0d140744e0 0x7f0d140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.948+0000 7f0d3259c640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0d140744e0 0x7f0d140769f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0d340d08c0 tx=0x7f0d24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:53.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:53.953+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d2c080a30 con 0x7f0d3414ffe0 2024-04-25T15:43:54.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.129+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d340acd30 con 0x7f0d3414ffe0 2024-04-25T15:43:54.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.129+0000 7f0d2affd640 1 -- 172.21.15.80:0/2762280686 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f0d2c084d30 con 0x7f0d3414ffe0 2024-04-25T15:43:54.130 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:54.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0d140744e0 msgr2=0x7f0d140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0d140744e0 0x7f0d140769f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0d340d08c0 tx=0x7f0d24009040 comp rx=0 tx=0).stop 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 msgr2=0x7f0d3415f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 0x7f0d3415f090 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009eb0 tx=0x7f0d2c004a40 comp rx=0 tx=0).stop 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 shutdown_connections 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0d140744e0 0x7f0d140769f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d3414ffe0 0x7f0d3415f090 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d340d2b80 0x7f0d340cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 --2- 172.21.15.80:0/2762280686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d340d0b00 0x7f0d340ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 >> 172.21.15.80:0/2762280686 conn(0x7f0d3406e650 msgr2=0x7f0d340b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 shutdown_connections 2024-04-25T15:43:54.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.131+0000 7f0d38f7d640 1 -- 172.21.15.80:0/2762280686 wait complete. 2024-04-25T15:43:54.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:54.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.252+0000 7f758598c640 1 Processor -- start 2024-04-25T15:43:54.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.252+0000 7f758598c640 1 -- start start 2024-04-25T15:43:54.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f758598c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b2ab0 0x7f75800cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f758598c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f75800cf3d0 0x7f75800c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f758598c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75800c89f0 con 0x7f75800cefc0 2024-04-25T15:43:54.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f758598c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f75800b7970 con 0x7f75800cf3d0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f758598c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f758006d070 con 0x7f75800b2ab0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f75800cefc0 0x7f75800cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47766/0 (socket says 172.21.15.80:47766) 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757e7fc640 1 -- 172.21.15.80:0/1217622192 learned_addr learned my addr 172.21.15.80:0/1217622192 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757f7fe640 1 --2- 172.21.15.80:0/1217622192 >> v2:172.21.15.195:3300/0 conn(0x7f75800cf3d0 0x7f75800c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757effd640 1 --2- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b2ab0 0x7f75800cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757dffb640 1 -- 172.21.15.80:0/1217622192 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806142577 0 0) 0x7f75800c89f0 con 0x7f75800cefc0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757dffb640 1 -- 172.21.15.80:0/1217622192 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7568003520 con 0x7f75800cefc0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757dffb640 1 -- 172.21.15.80:0/1217622192 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960851769 0 0) 0x7f7568003520 con 0x7f75800cefc0 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757f7fe640 1 -- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b2ab0 msgr2=0x7f75800cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757f7fe640 1 --2- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b2ab0 0x7f75800cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757f7fe640 1 -- 172.21.15.80:0/1217622192 >> v1:172.21.15.80:6789/0 conn(0x7f75800cefc0 legacy=0x7f75800cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.254+0000 7f757f7fe640 1 -- 172.21.15.80:0/1217622192 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758006d350 con 0x7f75800cf3d0 2024-04-25T15:43:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.255+0000 7f757f7fe640 1 --2- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800cf3d0 0x7f75800c81c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7578009d90 tx=0x7f757802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985967d0c9fa5d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.255+0000 7f757dffb640 1 -- 172.21.15.80:0/1217622192 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574001670 con 0x7f75800cf3d0 2024-04-25T15:43:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.255+0000 7f757dffb640 1 -- 172.21.15.80:0/1217622192 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7578007540 con 0x7f75800cf3d0 2024-04-25T15:43:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.255+0000 7f757dffb640 1 -- 172.21.15.80:0/1217622192 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780078f0 con 0x7f75800cf3d0 2024-04-25T15:43:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 -- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800cf3d0 msgr2=0x7f75800c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 --2- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800cf3d0 0x7f75800c81c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7578009d90 tx=0x7f757802a5f0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 -- 172.21.15.80:0/1217622192 shutdown_connections 2024-04-25T15:43:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 --2- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800cf3d0 0x7f75800c81c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 --2- 172.21.15.80:0/1217622192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800b2ab0 0x7f75800cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 -- 172.21.15.80:0/1217622192 >> 172.21.15.80:0/1217622192 conn(0x7f758009b410 msgr2=0x7f75800b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:54.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 -- 172.21.15.80:0/1217622192 shutdown_connections 2024-04-25T15:43:54.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.256+0000 7f758598c640 1 -- 172.21.15.80:0/1217622192 wait complete. 2024-04-25T15:43:54.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.258+0000 7f758598c640 1 Processor -- start 2024-04-25T15:43:54.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.258+0000 7f758598c640 1 -- start start 2024-04-25T15:43:54.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.259+0000 7f758598c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800b2ab0 0x7f7580147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.259+0000 7f758598c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 0x7f758015e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.259+0000 7f758598c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800cf3d0 0x7f758015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.259+0000 7f758598c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f75800c8700 con 0x7f75800cefc0 2024-04-25T15:43:54.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.259+0000 7f758598c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f758006d910 con 0x7f75800b2ab0 2024-04-25T15:43:54.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.259+0000 7f758598c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f758006de30 con 0x7f75800cf3d0 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 0x7f758015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 0x7f758015e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37000/0 (socket says 172.21.15.80:37000) 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 -- 172.21.15.80:0/352940404 learned_addr learned my addr 172.21.15.80:0/352940404 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757effd640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800b2ab0 0x7f7580147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757f7fe640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800cf3d0 0x7f758015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 -- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800cf3d0 msgr2=0x7f758015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800cf3d0 0x7f758015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 -- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800b2ab0 msgr2=0x7f7580147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800b2ab0 0x7f7580147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 -- 172.21.15.80:0/352940404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7580148050 con 0x7f75800cefc0 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757f7fe640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800cf3d0 0x7f758015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f757e7fc640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 0x7f758015e840 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f757400c4b0 tx=0x7f757400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574017070 con 0x7f75800cefc0 2024-04-25T15:43:54.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7574005ce0 con 0x7f75800cefc0 2024-04-25T15:43:54.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758015f5b0 con 0x7f75800cefc0 2024-04-25T15:43:54.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740072b0 con 0x7f75800cefc0 2024-04-25T15:43:54.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.260+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75800af2e0 con 0x7f75800cefc0 2024-04-25T15:43:54.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.261+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758006a100 con 0x7f75800cefc0 2024-04-25T15:43:54.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.262+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f757401a070 con 0x7f75800cefc0 2024-04-25T15:43:54.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.262+0000 7f7567fff640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f756c0744e0 0x7f756c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.263+0000 7f757effd640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f756c0744e0 0x7f756c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.263+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7574094990 con 0x7f75800cefc0 2024-04-25T15:43:54.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.263+0000 7f757effd640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f756c0744e0 0x7f756c0769f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7570009a30 tx=0x7f7570008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.267+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f757405e650 con 0x7f75800cefc0 2024-04-25T15:43:54.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.441+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75800b2580 con 0x7f75800cefc0 2024-04-25T15:43:54.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.442+0000 7f7567fff640 1 -- 172.21.15.80:0/352940404 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f7574062950 con 0x7f75800cefc0 2024-04-25T15:43:54.443 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:54.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f756c0744e0 msgr2=0x7f756c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f756c0744e0 0x7f756c0769f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7570009a30 tx=0x7f7570008040 comp rx=0 tx=0).stop 2024-04-25T15:43:54.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 msgr2=0x7f758015e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 0x7f758015e840 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f757400c4b0 tx=0x7f757400c970 comp rx=0 tx=0).stop 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 shutdown_connections 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f756c0744e0 0x7f756c0769f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f75800cf3d0 0x7f758015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75800cefc0 0x7f758015e840 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 --2- 172.21.15.80:0/352940404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75800b2ab0 0x7f7580147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 >> 172.21.15.80:0/352940404 conn(0x7f758009b410 msgr2=0x7f75800b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 shutdown_connections 2024-04-25T15:43:54.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.444+0000 7f758598c640 1 -- 172.21.15.80:0/352940404 wait complete. 2024-04-25T15:43:54.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:54.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.566+0000 7fe08eb1f640 1 Processor -- start 2024-04-25T15:43:54.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.566+0000 7fe08eb1f640 1 -- start start 2024-04-25T15:43:54.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08eb1f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe08809b410 0x7fe08809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08eb1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0880cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08eb1f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe088160760 con 0x7fe0880d3110 2024-04-25T15:43:54.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08eb1f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe08809b920 con 0x7fe08809b410 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08eb1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0880b3410 con 0x7fe0880d2190 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08c8bb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe08809b410 0x7fe08809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe087fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0880d3110 0x7fe0880d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55040/0 (socket says 172.21.15.80:55040) 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08c8bb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe08809b410 0x7fe08809bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39680/0 (socket says 172.21.15.80:39680) 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe087fff640 1 -- 172.21.15.80:0/4041394706 learned_addr learned my addr 172.21.15.80:0/4041394706 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08d0bc640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0880cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08c8bb640 1 -- 172.21.15.80:0/4041394706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 msgr2=0x7fe0880cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08c8bb640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0880cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08c8bb640 1 -- 172.21.15.80:0/4041394706 >> v1:172.21.15.80:6789/0 conn(0x7fe0880d3110 legacy=0x7fe0880d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe0877fe640 1 -- 172.21.15.80:0/4041394706 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535005166 0 0) 0x7fe088160760 con 0x7fe0880d3110 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08c8bb640 1 -- 172.21.15.80:0/4041394706 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0880b3c00 con 0x7fe08809b410 2024-04-25T15:43:54.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.568+0000 7fe08d0bc640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0880cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:54.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.569+0000 7fe08c8bb640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08809b410 0x7fe08809bdf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097a0 tx=0x7fe07802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc01b6e5b91a651e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.569+0000 7fe0877fe640 1 -- 172.21.15.80:0/4041394706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078037070 con 0x7fe08809b410 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.569+0000 7fe0877fe640 1 -- 172.21.15.80:0/4041394706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe078032440 con 0x7fe08809b410 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.569+0000 7fe0877fe640 1 -- 172.21.15.80:0/4041394706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078032810 con 0x7fe08809b410 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 -- 172.21.15.80:0/4041394706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08809b410 msgr2=0x7fe08809bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08809b410 0x7fe08809bdf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097a0 tx=0x7fe07802a180 comp rx=0 tx=0).stop 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 -- 172.21.15.80:0/4041394706 shutdown_connections 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0880cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/4041394706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08809b410 0x7fe08809bdf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 -- 172.21.15.80:0/4041394706 >> 172.21.15.80:0/4041394706 conn(0x7fe0880b7620 msgr2=0x7fe0880b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 -- 172.21.15.80:0/4041394706 shutdown_connections 2024-04-25T15:43:54.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.570+0000 7fe08eb1f640 1 -- 172.21.15.80:0/4041394706 wait complete. 2024-04-25T15:43:54.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.571+0000 7fe08eb1f640 1 Processor -- start 2024-04-25T15:43:54.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.571+0000 7fe08eb1f640 1 -- start start 2024-04-25T15:43:54.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08eb1f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe08809b410 0x7fe0881e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08eb1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0881f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08eb1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 0x7fe088162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08eb1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0880cea40 con 0x7fe0880d3110 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08eb1f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0880b41a0 con 0x7fe08809b410 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08eb1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0880cf4a0 con 0x7fe0880d2190 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 0x7fe088162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 0x7fe088162c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39696/0 (socket says 172.21.15.80:39696) 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 -- 172.21.15.80:0/3554502767 learned_addr learned my addr 172.21.15.80:0/3554502767 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08c8bb640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe08809b410 0x7fe0881e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 -- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 msgr2=0x7fe0881f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe087fff640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0881f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0881f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 -- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe08809b410 msgr2=0x7fe0881e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe08809b410 0x7fe0881e8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08d0bc640 1 -- 172.21.15.80:0/3554502767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0881e9440 con 0x7fe0880d3110 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.573+0000 7fe08c8bb640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe08809b410 0x7fe0881e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.574+0000 7fe08d0bc640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 0x7fe088162c10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe08000cd20 tx=0x7fe08000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.574+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08000f680 con 0x7fe0880d3110 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.574+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08000f840 con 0x7fe0880d3110 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.574+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08000fc30 con 0x7fe0880d3110 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.574+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0881e9720 con 0x7fe0880d3110 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.574+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0881e9ce0 con 0x7fe0880d3110 2024-04-25T15:43:54.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.575+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08806ee30 con 0x7fe0880d3110 2024-04-25T15:43:54.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.575+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe08000e3e0 con 0x7fe0880d3110 2024-04-25T15:43:54.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.576+0000 7fe0857fa640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0740744b0 0x7fe0740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.576+0000 7fe08c8bb640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0740744b0 0x7fe0740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.576+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe080096390 con 0x7fe0880d3110 2024-04-25T15:43:54.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.576+0000 7fe08c8bb640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0740744b0 0x7fe0740769c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe078034000 tx=0x7fe07802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.580+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe08806ee30 con 0x7fe0880d3110 2024-04-25T15:43:54.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.754+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe08806a100 con 0x7fe0880d3110 2024-04-25T15:43:54.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.755+0000 7fe0857fa640 1 -- 172.21.15.80:0/3554502767 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe080014030 con 0x7fe0880d3110 2024-04-25T15:43:54.756 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0740744b0 msgr2=0x7fe0740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0740744b0 0x7fe0740769c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe078034000 tx=0x7fe07802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 msgr2=0x7fe088162c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 0x7fe088162c10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe08000cd20 tx=0x7fe08000a650 comp rx=0 tx=0).stop 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 shutdown_connections 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0740744b0 0x7fe0740769c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0880d3110 0x7fe088162c10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0880d2190 0x7fe0881f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 --2- 172.21.15.80:0/3554502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe08809b410 0x7fe0881e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 >> 172.21.15.80:0/3554502767 conn(0x7fe0880b7620 msgr2=0x7fe088071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:54.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 shutdown_connections 2024-04-25T15:43:54.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.757+0000 7fe08eb1f640 1 -- 172.21.15.80:0/3554502767 wait complete. 2024-04-25T15:43:54.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:43:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.876+0000 7f5eb9ce7640 1 Processor -- start 2024-04-25T15:43:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.876+0000 7f5eb9ce7640 1 -- start start 2024-04-25T15:43:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb9ce7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40d1090 0x7f5eb406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb9ce7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5eb406db10 0x7f5eb40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb9ce7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb406df20 con 0x7f5eb40afc60 2024-04-25T15:43:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb9ce7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb4070470 con 0x7f5eb406db10 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb9ce7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb40ae960 con 0x7f5eb40d1090 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eabfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5eb406db10 0x7f5eb40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5eb40afc60 0x7f5eb415b020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55046/0 (socket says 172.21.15.80:55046) 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.877+0000 7f5eb3fff640 1 -- 172.21.15.80:0/3737322103 learned_addr learned my addr 172.21.15.80:0/3737322103 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eb37fe640 1 --2- 172.21.15.80:0/3737322103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40d1090 0x7f5eb406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eabfff640 1 -- 172.21.15.80:0/3737322103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40d1090 msgr2=0x7f5eb406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eabfff640 1 --2- 172.21.15.80:0/3737322103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40d1090 0x7f5eb406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eabfff640 1 -- 172.21.15.80:0/3737322103 >> v1:172.21.15.80:6789/0 conn(0x7f5eb40afc60 legacy=0x7f5eb415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eb2ffd640 1 -- 172.21.15.80:0/3737322103 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578693436 0 0) 0x7f5eac001490 con 0x7f5eb40afc60 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eabfff640 1 -- 172.21.15.80:0/3737322103 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb40aec40 con 0x7f5eb406db10 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eabfff640 1 --2- 172.21.15.80:0/3737322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb406db10 0x7f5eb40af720 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0097a0 tx=0x7f5e9c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b995fde7e64be89e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eb2ffd640 1 -- 172.21.15.80:0/3737322103 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c037070 con 0x7f5eb406db10 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eb2ffd640 1 -- 172.21.15.80:0/3737322103 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c02ae50 con 0x7f5eb406db10 2024-04-25T15:43:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.878+0000 7f5eb2ffd640 1 -- 172.21.15.80:0/3737322103 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c032660 con 0x7f5eb406db10 2024-04-25T15:43:54.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/3737322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb406db10 msgr2=0x7f5eb40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/3737322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb406db10 0x7f5eb40af720 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0097a0 tx=0x7f5e9c02a100 comp rx=0 tx=0).stop 2024-04-25T15:43:54.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/3737322103 shutdown_connections 2024-04-25T15:43:54.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/3737322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb406db10 0x7f5eb40af720 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/3737322103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40d1090 0x7f5eb406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/3737322103 >> 172.21.15.80:0/3737322103 conn(0x7f5eb40d1e20 msgr2=0x7f5eb4073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/3737322103 shutdown_connections 2024-04-25T15:43:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.879+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/3737322103 wait complete. 2024-04-25T15:43:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.881+0000 7f5eb9ce7640 1 Processor -- start 2024-04-25T15:43:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.881+0000 7f5eb9ce7640 1 -- start start 2024-04-25T15:43:54.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb9ce7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5eb406db10 0x7f5eb40c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb9ce7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40afc60 0x7f5eb41f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb9ce7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 0x7f5eb41f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb9ce7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb40b0070 con 0x7f5eb40d1090 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb9ce7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb40af200 con 0x7f5eb406db10 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb9ce7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb40b01f0 con 0x7f5eb40afc60 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 0x7f5eb41f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 0x7f5eb41f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39716/0 (socket says 172.21.15.80:39716) 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb3fff640 1 -- 172.21.15.80:0/1490888380 learned_addr learned my addr 172.21.15.80:0/1490888380 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eb37fe640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5eb406db10 0x7f5eb40c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.882+0000 7f5eabfff640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40afc60 0x7f5eb41f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb3fff640 1 -- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40afc60 msgr2=0x7f5eb41f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb3fff640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40afc60 0x7f5eb41f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb3fff640 1 -- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5eb406db10 msgr2=0x7f5eb40c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb3fff640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5eb406db10 0x7f5eb40c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb3fff640 1 -- 172.21.15.80:0/1490888380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb40c6f80 con 0x7f5eb40d1090 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb37fe640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5eb406db10 0x7f5eb40c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb3fff640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 0x7f5eb41f8010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c700 tx=0x7f5eac00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac018070 con 0x7f5eb40d1090 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eac00ce10 con 0x7f5eb40d1090 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb409e130 con 0x7f5eb40d1090 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00a860 con 0x7f5eb40d1090 2024-04-25T15:43:54.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.883+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb40c7620 con 0x7f5eb40d1090 2024-04-25T15:43:54.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.884+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb409e650 con 0x7f5eb40d1090 2024-04-25T15:43:54.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.885+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5eac01b070 con 0x7f5eb40d1090 2024-04-25T15:43:54.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.885+0000 7f5eb0ff9640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e940744b0 0x7f5e940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:54.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.885+0000 7f5eb37fe640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e940744b0 0x7f5e940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:54.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.885+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5eac094b70 con 0x7f5eb40d1090 2024-04-25T15:43:54.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.886+0000 7f5eb37fe640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e940744b0 0x7f5e940769c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4147cb0 tx=0x7f5ea4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:54.890+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5eb406df20 con 0x7f5eb40d1090 2024-04-25T15:43:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.076+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5eb406a100 con 0x7f5eb40d1090 2024-04-25T15:43:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.077+0000 7f5eb0ff9640 1 -- 172.21.15.80:0/1490888380 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5eac05e8b0 con 0x7f5eb40d1090 2024-04-25T15:43:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:43:55.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e940744b0 msgr2=0x7f5e940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e940744b0 0x7f5e940769c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4147cb0 tx=0x7f5ea4008040 comp rx=0 tx=0).stop 2024-04-25T15:43:55.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 msgr2=0x7f5eb41f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 0x7f5eb41f8010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c700 tx=0x7f5eac00cbc0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 shutdown_connections 2024-04-25T15:43:55.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e940744b0 0x7f5e940769c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5eb40d1090 0x7f5eb41f8010 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5eb40afc60 0x7f5eb41f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 --2- 172.21.15.80:0/1490888380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5eb406db10 0x7f5eb40c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 >> 172.21.15.80:0/1490888380 conn(0x7f5eb40d1e20 msgr2=0x7f5eb4146a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 shutdown_connections 2024-04-25T15:43:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.079+0000 7f5eb9ce7640 1 -- 172.21.15.80:0/1490888380 wait complete. 2024-04-25T15:43:55.091 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:43:55.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:55.091 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T15:43:55.122 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:43:55.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:55.122 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:43:55.191 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:55.191 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:55.207 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:55.207 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:55.262 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:43:55.263 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:55.317 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:55.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.464+0000 7f8f7cdce640 1 Processor -- start 2024-04-25T15:43:55.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.465+0000 7f8f7cdce640 1 -- start start 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f7cdce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 0x7f8f780cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f7cdce640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f780b3fe0 con 0x7f8f781604d0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f7cdce640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f780ce110 con 0x7f8f780d21f0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f7cdce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f780ce6d0 con 0x7f8f7809bdf0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f7659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8f781604d0 0x7f8f780d1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55048/0 (socket says 172.21.15.80:55048) 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f7659c640 1 -- 172.21.15.80:0/1698951270 learned_addr learned my addr 172.21.15.80:0/1698951270 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016305351 0 0) 0x7f8f780b3fe0 con 0x7f8f781604d0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f64003520 con 0x7f8f781604d0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f76d9d640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 0x7f8f780cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1102750265 0 0) 0x7f8f64003520 con 0x7f8f781604d0 2024-04-25T15:43:55.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 msgr2=0x7f8f780cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f75d9b640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 0x7f8f780cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.466+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 >> v1:172.21.15.195:6789/0 conn(0x7f8f780d21f0 legacy=0x7f8f780cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f780ce3f0 con 0x7f8f781604d0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f8f68001670 con 0x7f8f781604d0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 >> v1:172.21.15.80:6789/0 conn(0x7f8f781604d0 legacy=0x7f8f780d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f640039e0 0x7f8f64003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 0x7f8f64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f64004d40 0x7f8f64005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780ce6d0 con 0x7f8f64004d40 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6400bbf0 con 0x7f8f640039e0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6400bdf0 con 0x7f8f7809bdf0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f76d9d640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f64004d40 0x7f8f64005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f7659c640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f640039e0 0x7f8f64003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f6ffff640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 0x7f8f64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f76d9d640 1 -- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 msgr2=0x7f8f64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f76d9d640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f7809bdf0 0x7f8f64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f76d9d640 1 -- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f640039e0 msgr2=0x7f8f64003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f76d9d640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f640039e0 0x7f8f64003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.467+0000 7f8f76d9d640 1 -- 172.21.15.80:0/1698951270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f64003520 con 0x7f8f64004d40 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.468+0000 7f8f76d9d640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f64004d40 0x7f8f64005210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8f7809bb10 tx=0x7f8f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2d225b13a442ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.468+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70033070 con 0x7f8f64004d40 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.468+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7002f630 con 0x7f8f64004d40 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.468+0000 7f8f75d9b640 1 -- 172.21.15.80:0/1698951270 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70009be0 con 0x7f8f64004d40 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f7cdce640 1 -- 172.21.15.80:0/1698951270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f64004d40 msgr2=0x7f8f64005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/1698951270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f64004d40 0x7f8f64005210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8f7809bb10 tx=0x7f8f64005830 comp rx=0 tx=0).stop 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f76d9d640 1 -- 172.21.15.80:0/1698951270 reap_dead start 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f7cdce640 1 -- 172.21.15.80:0/1698951270 shutdown_connections 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f7cdce640 1 -- 172.21.15.80:0/1698951270 >> 172.21.15.80:0/1698951270 conn(0x7f8f780b7620 msgr2=0x7f8f780b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f7cdce640 1 -- 172.21.15.80:0/1698951270 shutdown_connections 2024-04-25T15:43:55.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.469+0000 7f8f7cdce640 1 -- 172.21.15.80:0/1698951270 wait complete. 2024-04-25T15:43:55.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.471+0000 7f8f7cdce640 1 Processor -- start 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.471+0000 7f8f7cdce640 1 -- start start 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7cdce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 0x7f8f781614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7cdce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7809cdb0 0x7f8f78161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7cdce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f78162390 0x7f8f7809f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7cdce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780b3b70 con 0x7f8f7815ce10 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7cdce640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7806ef30 con 0x7f8f7809cdb0 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7cdce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8f780b3cf0 con 0x7f8f78162390 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 0x7f8f781614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 0x7f8f781614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39730/0 (socket says 172.21.15.80:39730) 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 -- 172.21.15.80:0/2589774379 learned_addr learned my addr 172.21.15.80:0/2589774379 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 -- 172.21.15.80:0/2589774379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f78162390 msgr2=0x7f8f7809f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f78162390 0x7f8f7809f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 -- 172.21.15.80:0/2589774379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7809cdb0 msgr2=0x7f8f78161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7809cdb0 0x7f8f78161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 -- 172.21.15.80:0/2589774379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7809e930 con 0x7f8f7815ce10 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.472+0000 7f8f7659c640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 0x7f8f781614a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8f68007290 tx=0x7f8f68007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.473+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800f860 con 0x7f8f7815ce10 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.473+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f68018070 con 0x7f8f7815ce10 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.473+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800fc80 con 0x7f8f7815ce10 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.473+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7809ebd0 con 0x7f8f7815ce10 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.473+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7809f190 con 0x7f8f7815ce10 2024-04-25T15:43:55.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.474+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7806a100 con 0x7f8f7815ce10 2024-04-25T15:43:55.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.474+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8f6801d460 con 0x7f8f7815ce10 2024-04-25T15:43:55.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.475+0000 7f8f6effd640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f580744b0 0x7f8f580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.475+0000 7f8f6ffff640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f580744b0 0x7f8f580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.475+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8f68095610 con 0x7f8f7815ce10 2024-04-25T15:43:55.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.475+0000 7f8f6ffff640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f580744b0 0x7f8f580769c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f78072360 tx=0x7f8f60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:55.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.479+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f6805fa30 con 0x7f8f7815ce10 2024-04-25T15:43:55.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.654+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f78161c30 con 0x7f8f7815ce10 2024-04-25T15:43:55.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.655+0000 7f8f6effd640 1 -- 172.21.15.80:0/2589774379 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f8f6805f330 con 0x7f8f7815ce10 2024-04-25T15:43:55.657 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:55.657 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f580744b0 msgr2=0x7f8f580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f580744b0 0x7f8f580769c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f78072360 tx=0x7f8f60009040 comp rx=0 tx=0).stop 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 msgr2=0x7f8f781614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 0x7f8f781614a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8f68007290 tx=0x7f8f68007750 comp rx=0 tx=0).stop 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 shutdown_connections 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f580744b0 0x7f8f580769c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f78162390 0x7f8f7809f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7809cdb0 0x7f8f78161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 --2- 172.21.15.80:0/2589774379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f7815ce10 0x7f8f781614a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 >> 172.21.15.80:0/2589774379 conn(0x7f8f780b7620 msgr2=0x7f8f780b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.657+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 shutdown_connections 2024-04-25T15:43:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.658+0000 7f8f7cdce640 1 -- 172.21.15.80:0/2589774379 wait complete. 2024-04-25T15:43:55.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:55.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:55.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.779+0000 7f88b19e3640 1 Processor -- start 2024-04-25T15:43:55.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.779+0000 7f88b19e3640 1 -- start start 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.780+0000 7f88b19e3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88ac15e060 0x7f88ac0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.780+0000 7f88b19e3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88ac0d08c0 0x7f88ac0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.780+0000 7f88b19e3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac0d0cd0 con 0x7f88ac0b2b80 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.780+0000 7f88b19e3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac161b00 con 0x7f88ac15e060 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.780+0000 7f88b19e3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac161dc0 con 0x7f88ac0d08c0 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aa7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88ac15e060 0x7f88ac0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aaffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f88ac0b2b80 0x7f88ac0cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55052/0 (socket says 172.21.15.80:55052) 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aaffd640 1 -- 172.21.15.80:0/85016326 learned_addr learned my addr 172.21.15.80:0/85016326 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:55.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aa7fc640 1 -- 172.21.15.80:0/85016326 >> v2:172.21.15.195:3300/0 conn(0x7f88ac0d08c0 msgr2=0x7f88ac0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:55.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aa7fc640 1 --2- 172.21.15.80:0/85016326 >> v2:172.21.15.195:3300/0 conn(0x7f88ac0d08c0 0x7f88ac0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aa7fc640 1 -- 172.21.15.80:0/85016326 >> v1:172.21.15.80:6789/0 conn(0x7f88ac0b2b80 legacy=0x7f88ac0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88a9ffb640 1 -- 172.21.15.80:0/85016326 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737178207 0 0) 0x7f88ac0d0cd0 con 0x7f88ac0b2b80 2024-04-25T15:43:55.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.781+0000 7f88aa7fc640 1 -- 172.21.15.80:0/85016326 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac1620a0 con 0x7f88ac15e060 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88aa7fc640 1 --2- 172.21.15.80:0/85016326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac0d0380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0d4a40 tx=0x7f88a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a917aab5fd35353f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88a9ffb640 1 -- 172.21.15.80:0/85016326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0037070 con 0x7f88ac15e060 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88a9ffb640 1 -- 172.21.15.80:0/85016326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a0032440 con 0x7f88ac15e060 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88a9ffb640 1 -- 172.21.15.80:0/85016326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a002ae60 con 0x7f88ac15e060 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 -- 172.21.15.80:0/85016326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 msgr2=0x7f88ac0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 --2- 172.21.15.80:0/85016326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac0d0380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0d4a40 tx=0x7f88a002a110 comp rx=0 tx=0).stop 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 -- 172.21.15.80:0/85016326 shutdown_connections 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 --2- 172.21.15.80:0/85016326 >> v2:172.21.15.195:3300/0 conn(0x7f88ac0d08c0 0x7f88ac0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 --2- 172.21.15.80:0/85016326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac0d0380 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 -- 172.21.15.80:0/85016326 >> 172.21.15.80:0/85016326 conn(0x7f88ac0b54a0 msgr2=0x7f88ac0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:55.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.782+0000 7f88b19e3640 1 -- 172.21.15.80:0/85016326 shutdown_connections 2024-04-25T15:43:55.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.783+0000 7f88b19e3640 1 -- 172.21.15.80:0/85016326 wait complete. 2024-04-25T15:43:55.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.784+0000 7f88b19e3640 1 Processor -- start 2024-04-25T15:43:55.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.784+0000 7f88b19e3640 1 -- start start 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ac0b2b80 0x7f88ac156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ac0d08c0 0x7f88ac15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac162940 con 0x7f88ac15e060 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac162660 con 0x7f88ac0b2b80 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0d2820 con 0x7f88ac0d08c0 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39746/0 (socket says 172.21.15.80:39746) 2024-04-25T15:43:55.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 -- 172.21.15.80:0/3433010484 learned_addr learned my addr 172.21.15.80:0/3433010484 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88aaffd640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ac0b2b80 0x7f88ac156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88aa7fc640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ac0d08c0 0x7f88ac15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 -- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ac0d08c0 msgr2=0x7f88ac15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ac0d08c0 0x7f88ac15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 -- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ac0b2b80 msgr2=0x7f88ac156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ac0b2b80 0x7f88ac156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 -- 172.21.15.80:0/3433010484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0cb020 con 0x7f88ac15e060 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88aa7fc640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ac0d08c0 0x7f88ac15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88aaffd640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ac0b2b80 0x7f88ac156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88ab7fe640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac15cc70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f88a400b440 tx=0x7f88a400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4015020 con 0x7f88ac15e060 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a4011830 con 0x7f88ac15e060 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac15f620 con 0x7f88ac15e060 2024-04-25T15:43:55.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.786+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4011c20 con 0x7f88ac15e060 2024-04-25T15:43:55.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.787+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac15fbe0 con 0x7f88ac15e060 2024-04-25T15:43:55.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.788+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac0cad90 con 0x7f88ac15e060 2024-04-25T15:43:55.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.788+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f88a4018020 con 0x7f88ac15e060 2024-04-25T15:43:55.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.788+0000 7f8893fff640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88980744b0 0x7f88980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:55.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.789+0000 7f88aaffd640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88980744b0 0x7f88980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:55.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.789+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f88a40954d0 con 0x7f88ac15e060 2024-04-25T15:43:55.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.789+0000 7f88aaffd640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88980744b0 0x7f88980769c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f889c0012e0 tx=0x7f889c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.793+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f88a401f020 con 0x7f88ac15e060 2024-04-25T15:43:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.968+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88ac15b2f0 con 0x7f88ac15e060 2024-04-25T15:43:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.968+0000 7f8893fff640 1 -- 172.21.15.80:0/3433010484 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f88a405f8f0 con 0x7f88ac15e060 2024-04-25T15:43:55.969 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88980744b0 msgr2=0x7f88980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88980744b0 0x7f88980769c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f889c0012e0 tx=0x7f889c009040 comp rx=0 tx=0).stop 2024-04-25T15:43:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 msgr2=0x7f88ac15cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac15cc70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f88a400b440 tx=0x7f88a400b840 comp rx=0 tx=0).stop 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 shutdown_connections 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88980744b0 0x7f88980769c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88ac15e060 0x7f88ac15cc70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88ac0d08c0 0x7f88ac15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 --2- 172.21.15.80:0/3433010484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88ac0b2b80 0x7f88ac156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 >> 172.21.15.80:0/3433010484 conn(0x7f88ac0b54a0 msgr2=0x7f88ac0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 shutdown_connections 2024-04-25T15:43:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:55.970+0000 7f88b19e3640 1 -- 172.21.15.80:0/3433010484 wait complete. 2024-04-25T15:43:55.982 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:56.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.091+0000 7f8fc4c67640 1 Processor -- start 2024-04-25T15:43:56.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.091+0000 7f8fc4c67640 1 -- start start 2024-04-25T15:43:56.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.092+0000 7f8fc4c67640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc0160240 0x7f8fc00ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.092+0000 7f8fc4c67640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8fc006dfe0 0x7f8fc00d3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.092+0000 7f8fc4c67640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fc006e3f0 0x7f8fc00d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fc4c67640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc00d41d0 con 0x7f8fc006e3f0 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fc4c67640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc0160650 con 0x7f8fc006dfe0 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fc4c67640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc00ceb30 con 0x7f8fc0160240 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fc006e3f0 0x7f8fc00d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fc006e3f0 0x7f8fc00d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39758/0 (socket says 172.21.15.80:39758) 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 -- 172.21.15.80:0/3822814502 learned_addr learned my addr 172.21.15.80:0/3822814502 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbe59c640 1 --2- 172.21.15.80:0/3822814502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc0160240 0x7f8fc00ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbdd9b640 1 --2- 172.21.15.80:0/3822814502 >> v2:172.21.15.195:3300/0 conn(0x7f8fc006dfe0 0x7f8fc00d3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 -- 172.21.15.80:0/3822814502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc0160240 msgr2=0x7f8fc00ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 --2- 172.21.15.80:0/3822814502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc0160240 0x7f8fc00ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 -- 172.21.15.80:0/3822814502 >> v2:172.21.15.195:3300/0 conn(0x7f8fc006dfe0 msgr2=0x7f8fc00d3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 --2- 172.21.15.80:0/3822814502 >> v2:172.21.15.195:3300/0 conn(0x7f8fc006dfe0 0x7f8fc00d3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbed9d640 1 -- 172.21.15.80:0/3822814502 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc006e9c0 con 0x7f8fc006e3f0 2024-04-25T15:43:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.093+0000 7f8fbdd9b640 1 --2- 172.21.15.80:0/3822814502 >> v2:172.21.15.195:3300/0 conn(0x7f8fc006dfe0 0x7f8fc00d3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.094+0000 7f8fbed9d640 1 --2- 172.21.15.80:0/3822814502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc006e3f0 0x7f8fc00d3c90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00d14f0 tx=0x7f8fb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b192cf357484865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.094+0000 7f8fbd59a640 1 -- 172.21.15.80:0/3822814502 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8037070 con 0x7f8fc006e3f0 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.094+0000 7f8fbd59a640 1 -- 172.21.15.80:0/3822814502 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8032440 con 0x7f8fc006e3f0 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.094+0000 7f8fbd59a640 1 -- 172.21.15.80:0/3822814502 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8032810 con 0x7f8fc006e3f0 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 -- 172.21.15.80:0/3822814502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc006e3f0 msgr2=0x7f8fc00d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/3822814502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc006e3f0 0x7f8fc00d3c90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00d14f0 tx=0x7f8fb802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 -- 172.21.15.80:0/3822814502 shutdown_connections 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/3822814502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc006e3f0 0x7f8fc00d3c90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/3822814502 >> v2:172.21.15.195:3300/0 conn(0x7f8fc006dfe0 0x7f8fc00d3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/3822814502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc0160240 0x7f8fc00ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 -- 172.21.15.80:0/3822814502 >> 172.21.15.80:0/3822814502 conn(0x7f8fc00b5510 msgr2=0x7f8fc00b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 -- 172.21.15.80:0/3822814502 shutdown_connections 2024-04-25T15:43:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.095+0000 7f8fc4c67640 1 -- 172.21.15.80:0/3822814502 wait complete. 2024-04-25T15:43:56.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.097+0000 7f8fc4c67640 1 Processor -- start 2024-04-25T15:43:56.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.097+0000 7f8fc4c67640 1 -- start start 2024-04-25T15:43:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fc4c67640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc006dfe0 0x7f8fc0154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fc4c67640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc006e3f0 0x7f8fc00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fc4c67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 0x7f8fc00ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fc4c67640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc00d1650 con 0x7f8fc0160240 2024-04-25T15:43:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fc4c67640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc006ef80 con 0x7f8fc006dfe0 2024-04-25T15:43:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fc4c67640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc00d1930 con 0x7f8fc006e3f0 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 0x7f8fc00ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 0x7f8fc00ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39774/0 (socket says 172.21.15.80:39774) 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 -- 172.21.15.80:0/828650251 learned_addr learned my addr 172.21.15.80:0/828650251 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbdd9b640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc006e3f0 0x7f8fc00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbe59c640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc006dfe0 0x7f8fc0154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 -- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc006e3f0 msgr2=0x7f8fc00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc006e3f0 0x7f8fc00ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 -- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc006dfe0 msgr2=0x7f8fc0154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc006dfe0 0x7f8fc0154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbed9d640 1 -- 172.21.15.80:0/828650251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc00cb730 con 0x7f8fc0160240 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbdd9b640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc006e3f0 0x7f8fc00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.098+0000 7f8fbe59c640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc006dfe0 0x7f8fc0154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.099+0000 7f8fbed9d640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 0x7f8fc00ccca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80090b0 tx=0x7f8fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.099+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8041020 con 0x7f8fc0160240 2024-04-25T15:43:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.099+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb803d640 con 0x7f8fc0160240 2024-04-25T15:43:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.099+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc0154590 con 0x7f8fc0160240 2024-04-25T15:43:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.099+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8037040 con 0x7f8fc0160240 2024-04-25T15:43:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.099+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc0161490 con 0x7f8fc0160240 2024-04-25T15:43:56.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.100+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc006a100 con 0x7f8fc0160240 2024-04-25T15:43:56.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.100+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8fb8044020 con 0x7f8fc0160240 2024-04-25T15:43:56.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.101+0000 7f8faeffd640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8fa00744e0 0x7f8fa00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.101+0000 7f8fbe59c640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8fa00744e0 0x7f8fa00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.101+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8fb80b5d50 con 0x7f8fc0160240 2024-04-25T15:43:56.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.101+0000 7f8fbe59c640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8fa00744e0 0x7f8fa00769f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0163ca0 tx=0x7f8fb000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.105+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8fb80b9030 con 0x7f8fc0160240 2024-04-25T15:43:56.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.284+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8fc00cf590 con 0x7f8fc0160240 2024-04-25T15:43:56.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.284+0000 7f8faeffd640 1 -- 172.21.15.80:0/828650251 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f8fb804b030 con 0x7f8fc0160240 2024-04-25T15:43:56.286 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:56.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8fa00744e0 msgr2=0x7f8fa00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8fa00744e0 0x7f8fa00769f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0163ca0 tx=0x7f8fb000b040 comp rx=0 tx=0).stop 2024-04-25T15:43:56.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 msgr2=0x7f8fc00ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 0x7f8fc00ccca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80090b0 tx=0x7f8fb80046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 shutdown_connections 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8fa00744e0 0x7f8fa00769f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc0160240 0x7f8fc00ccca0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fc006e3f0 0x7f8fc00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 --2- 172.21.15.80:0/828650251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc006dfe0 0x7f8fc0154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 >> 172.21.15.80:0/828650251 conn(0x7f8fc00b5510 msgr2=0x7f8fc00cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 shutdown_connections 2024-04-25T15:43:56.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.286+0000 7f8fc4c67640 1 -- 172.21.15.80:0/828650251 wait complete. 2024-04-25T15:43:56.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.407+0000 7f1e3ae42640 1 Processor -- start 2024-04-25T15:43:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.408+0000 7f1e3ae42640 1 -- start start 2024-04-25T15:43:56.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e3ae42640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e3406dce0 0x7f1e340b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e3ae42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e340b0ca0 0x7f1e340b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e3ae42640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e340b4850 con 0x7f1e3415cc80 2024-04-25T15:43:56.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e3ae42640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1e340d1620 con 0x7f1e3406dce0 2024-04-25T15:43:56.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e3ae42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e340b5460 con 0x7f1e340b0ca0 2024-04-25T15:43:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e33fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e3406dce0 0x7f1e340b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e38bde640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1e3415cc80 0x7f1e3406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:42936/0 (socket says 172.21.15.80:42936) 2024-04-25T15:43:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e393df640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e340b0ca0 0x7f1e340b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.409+0000 7f1e38bde640 1 -- 172.21.15.80:0/3955435633 learned_addr learned my addr 172.21.15.80:0/3955435633 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e33fff640 1 -- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e340b0ca0 msgr2=0x7f1e340b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e33fff640 1 --2- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e340b0ca0 0x7f1e340b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e33fff640 1 -- 172.21.15.80:0/3955435633 >> v1:172.21.15.195:6789/0 conn(0x7f1e3415cc80 legacy=0x7f1e3406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e33fff640 1 -- 172.21.15.80:0/3955435633 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e340b4b30 con 0x7f1e3406dce0 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e337fe640 1 -- 172.21.15.80:0/3955435633 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158884171 0 0) 0x7f1e340b4850 con 0x7f1e3415cc80 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e393df640 1 --2- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e340b0ca0 0x7f1e340b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.410+0000 7f1e33fff640 1 --2- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e3406dce0 0x7f1e340b0760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e280097a0 tx=0x7f1e2802c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7442fc43e50ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e337fe640 1 -- 172.21.15.80:0/3955435633 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28039070 con 0x7f1e3406dce0 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e337fe640 1 -- 172.21.15.80:0/3955435633 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e28034640 con 0x7f1e3406dce0 2024-04-25T15:43:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e337fe640 1 -- 172.21.15.80:0/3955435633 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28034a10 con 0x7f1e3406dce0 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 -- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e3406dce0 msgr2=0x7f1e340b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e3406dce0 0x7f1e340b0760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e280097a0 tx=0x7f1e2802c390 comp rx=0 tx=0).stop 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 -- 172.21.15.80:0/3955435633 shutdown_connections 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e340b0ca0 0x7f1e340b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/3955435633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e3406dce0 0x7f1e340b0760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 -- 172.21.15.80:0/3955435633 >> 172.21.15.80:0/3955435633 conn(0x7f1e340734b0 msgr2=0x7f1e340738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 -- 172.21.15.80:0/3955435633 shutdown_connections 2024-04-25T15:43:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.411+0000 7f1e3ae42640 1 -- 172.21.15.80:0/3955435633 wait complete. 2024-04-25T15:43:56.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.413+0000 7f1e3ae42640 1 Processor -- start 2024-04-25T15:43:56.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.413+0000 7f1e3ae42640 1 -- start start 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e3ae42640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e340b0ca0 0x7f1e3415b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e3ae42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e3415cc80 0x7f1e34152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e3ae42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 0x7f1e341e6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e3ae42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3415d090 con 0x7f1e341e6780 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e3ae42640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e340b50f0 con 0x7f1e340b0ca0 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e3ae42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e340b10b0 con 0x7f1e3415cc80 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 0x7f1e341e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 0x7f1e341e6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39784/0 (socket says 172.21.15.80:39784) 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 -- 172.21.15.80:0/1728713707 learned_addr learned my addr 172.21.15.80:0/1728713707 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:56.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e38bde640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e340b0ca0 0x7f1e3415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e33fff640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e3415cc80 0x7f1e34152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 -- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e3415cc80 msgr2=0x7f1e34152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e3415cc80 0x7f1e34152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 -- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e340b0ca0 msgr2=0x7f1e3415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e340b0ca0 0x7f1e3415b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 -- 172.21.15.80:0/1728713707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e341e70d0 con 0x7f1e341e6780 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e393df640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 0x7f1e341e6b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00efc0 tx=0x7f1e2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c018020 con 0x7f1e341e6780 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c014480 con 0x7f1e341e6780 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.415+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c014870 con 0x7f1e341e6780 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.416+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3415e220 con 0x7f1e341e6780 2024-04-25T15:43:56.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.416+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3415e7e0 con 0x7f1e341e6780 2024-04-25T15:43:56.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.416+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3406a100 con 0x7f1e341e6780 2024-04-25T15:43:56.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.417+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1e2c005d10 con 0x7f1e341e6780 2024-04-25T15:43:56.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.417+0000 7f1e317fa640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e200744b0 0x7f1e200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.418+0000 7f1e38bde640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e200744b0 0x7f1e200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.418+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1e2c0961c0 con 0x7f1e341e6780 2024-04-25T15:43:56.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.418+0000 7f1e38bde640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e200744b0 0x7f1e200769c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1e24007fd0 tx=0x7f1e24007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.422+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1e2c022030 con 0x7f1e341e6780 2024-04-25T15:43:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.599+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1e340d1020 con 0x7f1e341e6780 2024-04-25T15:43:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.599+0000 7f1e317fa640 1 -- 172.21.15.80:0/1728713707 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f1e341e70d0 con 0x7f1e341e6780 2024-04-25T15:43:56.601 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e200744b0 msgr2=0x7f1e200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e200744b0 0x7f1e200769c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1e24007fd0 tx=0x7f1e24007de0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 msgr2=0x7f1e341e6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 0x7f1e341e6b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00efc0 tx=0x7f1e2c00c490 comp rx=0 tx=0).stop 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 shutdown_connections 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e200744b0 0x7f1e200769c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e341e6780 0x7f1e341e6b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e3415cc80 0x7f1e34152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 --2- 172.21.15.80:0/1728713707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e340b0ca0 0x7f1e3415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 >> 172.21.15.80:0/1728713707 conn(0x7f1e340734b0 msgr2=0x7f1e3406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 shutdown_connections 2024-04-25T15:43:56.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.601+0000 7f1e3ae42640 1 -- 172.21.15.80:0/1728713707 wait complete. 2024-04-25T15:43:56.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.722+0000 7f184fe92640 1 Processor -- start 2024-04-25T15:43:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.723+0000 7f184fe92640 1 -- start start 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184fe92640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f18480d2f80 0x7f18480cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184fe92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f184806eb70 0x7f1848166c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184fe92640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18480d0290 con 0x7f18480cfe80 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184fe92640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f184806d6d0 con 0x7f18480d2f80 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184fe92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f18480cf9d0 con 0x7f184806eb70 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184d42d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f18480d2f80 0x7f18480cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184dc2e640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f18480cfe80 0x7f18480d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:42944/0 (socket says 172.21.15.80:42944) 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184e42f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f184806eb70 0x7f1848166c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.724+0000 7f184dc2e640 1 -- 172.21.15.80:0/4180344831 learned_addr learned my addr 172.21.15.80:0/4180344831 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184cc2c640 1 -- 172.21.15.80:0/4180344831 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267741469 0 0) 0x7f18480d0290 con 0x7f18480cfe80 2024-04-25T15:43:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184cc2c640 1 -- 172.21.15.80:0/4180344831 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1834003520 con 0x7f18480cfe80 2024-04-25T15:43:56.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184d42d640 1 -- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f184806eb70 msgr2=0x7f1848166c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:56.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184d42d640 1 --2- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f184806eb70 0x7f1848166c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184d42d640 1 -- 172.21.15.80:0/4180344831 >> v1:172.21.15.195:6789/0 conn(0x7f18480cfe80 legacy=0x7f18480d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184d42d640 1 -- 172.21.15.80:0/4180344831 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18480b4770 con 0x7f18480d2f80 2024-04-25T15:43:56.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.725+0000 7f184e42f640 1 --2- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f184806eb70 0x7f1848166c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184d42d640 1 --2- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18480d2f80 0x7f18480cf280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18380097d0 tx=0x7f183802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718fc4d5e54a2497 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184cc2c640 1 -- 172.21.15.80:0/4180344831 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838037070 con 0x7f18480d2f80 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184cc2c640 1 -- 172.21.15.80:0/4180344831 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183802ae40 con 0x7f18480d2f80 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184cc2c640 1 -- 172.21.15.80:0/4180344831 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838032640 con 0x7f18480d2f80 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 -- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18480d2f80 msgr2=0x7f18480cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 --2- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18480d2f80 0x7f18480cf280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18380097d0 tx=0x7f183802a130 comp rx=0 tx=0).stop 2024-04-25T15:43:56.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 -- 172.21.15.80:0/4180344831 shutdown_connections 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 --2- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f184806eb70 0x7f1848166c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 --2- 172.21.15.80:0/4180344831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18480d2f80 0x7f18480cf280 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 -- 172.21.15.80:0/4180344831 >> 172.21.15.80:0/4180344831 conn(0x7f18480b75f0 msgr2=0x7f18480b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.726+0000 7f184fe92640 1 -- 172.21.15.80:0/4180344831 shutdown_connections 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.727+0000 7f184fe92640 1 -- 172.21.15.80:0/4180344831 wait complete. 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.728+0000 7f184fe92640 1 Processor -- start 2024-04-25T15:43:56.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.728+0000 7f184fe92640 1 -- start start 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 0x7f1848153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18480cfe80 0x7f184815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1848154020 0x7f1848160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f18480d2170 con 0x7f184806eb70 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f18480b4d30 con 0x7f1848154020 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f18480d22f0 con 0x7f18480cfe80 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 0x7f1848153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 0x7f1848153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39796/0 (socket says 172.21.15.80:39796) 2024-04-25T15:43:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 -- 172.21.15.80:0/4062342068 learned_addr learned my addr 172.21.15.80:0/4062342068 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184e42f640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1848154020 0x7f1848160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184d42d640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18480cfe80 0x7f184815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 -- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18480cfe80 msgr2=0x7f184815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18480cfe80 0x7f184815fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 -- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1848154020 msgr2=0x7f1848160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1848154020 0x7f1848160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 -- 172.21.15.80:0/4062342068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1848147aa0 con 0x7f184806eb70 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184dc2e640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 0x7f1848153ae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f184400ca50 tx=0x7f184400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844017070 con 0x7f184806eb70 2024-04-25T15:43:56.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184400aaf0 con 0x7f184806eb70 2024-04-25T15:43:56.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184814d490 con 0x7f184806eb70 2024-04-25T15:43:56.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844012400 con 0x7f184806eb70 2024-04-25T15:43:56.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.730+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184814da50 con 0x7f184806eb70 2024-04-25T15:43:56.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.731+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184806a100 con 0x7f184806eb70 2024-04-25T15:43:56.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.732+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f184401a070 con 0x7f184806eb70 2024-04-25T15:43:56.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.732+0000 7f183e7fc640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f182c0744e0 0x7f182c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:56.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.732+0000 7f184d42d640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f182c0744e0 0x7f182c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:56.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.732+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1844095170 con 0x7f184806eb70 2024-04-25T15:43:56.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.733+0000 7f184d42d640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f182c0744e0 0x7f182c0769f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1838034000 tx=0x7f183802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:56.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.737+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f184405ef40 con 0x7f184806eb70 2024-04-25T15:43:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.911+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f184815d770 con 0x7f184806eb70 2024-04-25T15:43:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.911+0000 7f183e7fc640 1 -- 172.21.15.80:0/4062342068 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f1844063240 con 0x7f184806eb70 2024-04-25T15:43:56.912 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f182c0744e0 msgr2=0x7f182c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f182c0744e0 0x7f182c0769f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1838034000 tx=0x7f183802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 msgr2=0x7f1848153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 0x7f1848153ae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f184400ca50 tx=0x7f184400ce50 comp rx=0 tx=0).stop 2024-04-25T15:43:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 shutdown_connections 2024-04-25T15:43:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f182c0744e0 0x7f182c0769f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1848154020 0x7f1848160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18480cfe80 0x7f184815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 --2- 172.21.15.80:0/4062342068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806eb70 0x7f1848153ae0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 >> 172.21.15.80:0/4062342068 conn(0x7f18480b75f0 msgr2=0x7f184809b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 shutdown_connections 2024-04-25T15:43:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:56.913+0000 7f184fe92640 1 -- 172.21.15.80:0/4062342068 wait complete. 2024-04-25T15:43:56.925 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:43:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.033+0000 7f4e5f338640 1 Processor -- start 2024-04-25T15:43:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.034+0000 7f4e5f338640 1 -- start start 2024-04-25T15:43:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5f338640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580d34a0 0x7f4e580b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5f338640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e580b3ac0 0x7f4e580b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5f338640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e580d1010 con 0x7f4e5806da90 2024-04-25T15:43:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5f338640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5809cdf0 con 0x7f4e580b3ac0 2024-04-25T15:43:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5f338640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5809d0d0 con 0x7f4e580d34a0 2024-04-25T15:43:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d8d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e580b3ac0 0x7f4e580b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5c8d3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e5806da90 0x7f4e5806e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55058/0 (socket says 172.21.15.80:55058) 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d8d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e580b3ac0 0x7f4e580b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39798/0 (socket says 172.21.15.80:39798) 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5c8d3640 1 -- 172.21.15.80:0/4002520272 learned_addr learned my addr 172.21.15.80:0/4002520272 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d0d4640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580d34a0 0x7f4e580b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d8d5640 1 -- 172.21.15.80:0/4002520272 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580d34a0 msgr2=0x7f4e580b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d8d5640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580d34a0 0x7f4e580b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d8d5640 1 -- 172.21.15.80:0/4002520272 >> v1:172.21.15.80:6789/0 conn(0x7f4e5806da90 legacy=0x7f4e5806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d8d5640 1 -- 172.21.15.80:0/4002520272 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5806ec70 con 0x7f4e580b3ac0 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.035+0000 7f4e5d0d4640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580d34a0 0x7f4e580b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.036+0000 7f4e5d8d5640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e580b3ac0 0x7f4e580b3ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5480ca2e58af00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.036+0000 7f4e4ffff640 1 -- 172.21.15.80:0/4002520272 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50007740 con 0x7f4e580b3ac0 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.036+0000 7f4e4ffff640 1 -- 172.21.15.80:0/4002520272 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e500078e0 con 0x7f4e580b3ac0 2024-04-25T15:43:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.036+0000 7f4e4ffff640 1 -- 172.21.15.80:0/4002520272 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50007cb0 con 0x7f4e580b3ac0 2024-04-25T15:43:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 -- 172.21.15.80:0/4002520272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e580b3ac0 msgr2=0x7f4e580b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e580b3ac0 0x7f4e580b3ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e5002a660 comp rx=0 tx=0).stop 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 -- 172.21.15.80:0/4002520272 shutdown_connections 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e580b3ac0 0x7f4e580b3ed0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 --2- 172.21.15.80:0/4002520272 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580d34a0 0x7f4e580b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 -- 172.21.15.80:0/4002520272 >> 172.21.15.80:0/4002520272 conn(0x7f4e580d0450 msgr2=0x7f4e580d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 -- 172.21.15.80:0/4002520272 shutdown_connections 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.037+0000 7f4e5f338640 1 -- 172.21.15.80:0/4002520272 wait complete. 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.039+0000 7f4e5f338640 1 Processor -- start 2024-04-25T15:43:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.039+0000 7f4e5f338640 1 -- start start 2024-04-25T15:43:57.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5f338640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 0x7f4e5809d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5f338640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580b3ac0 0x7f4e580b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5f338640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e580d34a0 0x7f4e58156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5f338640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e580b4410 con 0x7f4e5806da90 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5f338640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5806d7b0 con 0x7f4e580d34a0 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5f338640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e580b4590 con 0x7f4e580b3ac0 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 0x7f4e5809d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 0x7f4e5809d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39814/0 (socket says 172.21.15.80:39814) 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 -- 172.21.15.80:0/3065478750 learned_addr learned my addr 172.21.15.80:0/3065478750 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5c8d3640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580b3ac0 0x7f4e580b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d8d5640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e580d34a0 0x7f4e58156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 -- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580b3ac0 msgr2=0x7f4e580b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580b3ac0 0x7f4e580b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 -- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e580d34a0 msgr2=0x7f4e58156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.040+0000 7f4e5d0d4640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e580d34a0 0x7f4e58156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e5d0d4640 1 -- 172.21.15.80:0/3065478750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e580b2500 con 0x7f4e5806da90 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e5d8d5640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e580d34a0 0x7f4e58156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e5d0d4640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 0x7f4e5809d790 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400d830 tx=0x7f4e5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54018020 con 0x7f4e5806da90 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e54004030 con 0x7f4e5806da90 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54004400 con 0x7f4e5806da90 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5809dcd0 con 0x7f4e5806da90 2024-04-25T15:43:57.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.041+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e580a10c0 con 0x7f4e5806da90 2024-04-25T15:43:57.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.042+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5806a100 con 0x7f4e5806da90 2024-04-25T15:43:57.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.043+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4e54005ba0 con 0x7f4e5806da90 2024-04-25T15:43:57.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.043+0000 7f4e4dffb640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e3c0744b0 0x7f4e3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.043+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4e54095890 con 0x7f4e5806da90 2024-04-25T15:43:57.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.043+0000 7f4e5c8d3640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e3c0744b0 0x7f4e3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.043+0000 7f4e5c8d3640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e3c0744b0 0x7f4e3c0769c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e580b2220 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.048+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e54022020 con 0x7f4e5806da90 2024-04-25T15:43:57.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.235+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4e580b52a0 con 0x7f4e5806da90 2024-04-25T15:43:57.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.235+0000 7f4e4dffb640 1 -- 172.21.15.80:0/3065478750 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f4e5405fcb0 con 0x7f4e5806da90 2024-04-25T15:43:57.236 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e3c0744b0 msgr2=0x7f4e3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e3c0744b0 0x7f4e3c0769c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e580b2220 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 msgr2=0x7f4e5809d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 0x7f4e5809d790 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400d830 tx=0x7f4e5400dcf0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 shutdown_connections 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e3c0744b0 0x7f4e3c0769c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e580d34a0 0x7f4e58156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e580b3ac0 0x7f4e580b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 --2- 172.21.15.80:0/3065478750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e5806da90 0x7f4e5809d790 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 >> 172.21.15.80:0/3065478750 conn(0x7f4e580d0450 msgr2=0x7f4e580cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 shutdown_connections 2024-04-25T15:43:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.237+0000 7f4e5f338640 1 -- 172.21.15.80:0/3065478750 wait complete. 2024-04-25T15:43:57.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T15:43:57.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:57.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T15:43:57.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:43:57.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:57.274 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T15:43:57.330 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:57.330 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:57.348 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:57.348 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:57.405 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:43:57.405 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:43:57.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:57.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.569+0000 7fe7982a7640 1 Processor -- start 2024-04-25T15:43:57.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.569+0000 7fe7982a7640 1 -- start start 2024-04-25T15:43:57.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe7982a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe790072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe7982a7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7900d2a90 0x7fe7900d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe7982a7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7900d33e0 con 0x7fe790161c80 2024-04-25T15:43:57.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe7982a7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe790072aa0 con 0x7fe7900d2a90 2024-04-25T15:43:57.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe7982a7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe7901624d0 con 0x7fe790071950 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe795842640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe790161c80 0x7fe7900b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55066/0 (socket says 172.21.15.80:55066) 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.570+0000 7fe795842640 1 -- 172.21.15.80:0/536856983 learned_addr learned my addr 172.21.15.80:0/536856983 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796844640 1 --2- 172.21.15.80:0/536856983 >> v2:172.21.15.195:3300/0 conn(0x7fe7900d2a90 0x7fe7900d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe790072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146728105 0 0) 0x7fe780001290 con 0x7fe790161c80 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe77c003520 con 0x7fe790161c80 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 641831311 0 0) 0x7fe77c003520 con 0x7fe790161c80 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 msgr2=0x7fe790072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe790072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 >> v2:172.21.15.195:3300/0 conn(0x7fe7900d2a90 msgr2=0x7fe7900d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 --2- 172.21.15.80:0/536856983 >> v2:172.21.15.195:3300/0 conn(0x7fe7900d2a90 0x7fe7900d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7901627b0 con 0x7fe790161c80 2024-04-25T15:43:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe7800019c0 con 0x7fe790161c80 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 >> v1:172.21.15.80:6789/0 conn(0x7fe790161c80 legacy=0x7fe7900b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe77c0039b0 0x7fe77c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe77c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c004d40 0x7fe77c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901624d0 con 0x7fe77c0039b0 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c00b9c0 con 0x7fe77c004d40 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe77c00bbc0 con 0x7fe790071950 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe77c0039b0 0x7fe77c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795842640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe77c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796844640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c004d40 0x7fe77c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 -- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 msgr2=0x7fe77c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe77c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 -- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c004d40 msgr2=0x7fe77c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c004d40 0x7fe77c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe796043640 1 -- 172.21.15.80:0/536856983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c003520 con 0x7fe77c0039b0 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.571+0000 7fe795842640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe790071950 0x7fe77c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.572+0000 7fe796043640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe77c0039b0 0x7fe77c003e20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009a90 tx=0x7fe77c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bafb76fcbaa68f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.572+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c036070 con 0x7fe77c0039b0 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.572+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c031400 con 0x7fe77c0039b0 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.572+0000 7fe795041640 1 -- 172.21.15.80:0/536856983 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c009690 con 0x7fe77c0039b0 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe7982a7640 1 -- 172.21.15.80:0/536856983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe77c0039b0 msgr2=0x7fe77c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe7982a7640 1 --2- 172.21.15.80:0/536856983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe77c0039b0 0x7fe77c003e20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009a90 tx=0x7fe77c005830 comp rx=0 tx=0).stop 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe796844640 1 -- 172.21.15.80:0/536856983 reap_dead start 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe7982a7640 1 -- 172.21.15.80:0/536856983 shutdown_connections 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe7982a7640 1 -- 172.21.15.80:0/536856983 >> 172.21.15.80:0/536856983 conn(0x7fe7900d3ea0 msgr2=0x7fe7900d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe7982a7640 1 -- 172.21.15.80:0/536856983 shutdown_connections 2024-04-25T15:43:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.573+0000 7fe7982a7640 1 -- 172.21.15.80:0/536856983 wait complete. 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.575+0000 7fe7982a7640 1 Processor -- start 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.575+0000 7fe7982a7640 1 -- start start 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe7982a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0039b0 0x7fe7900c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe7982a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 0x7fe7901e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe7982a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7901e9610 0x7fe79015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe7982a7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900b7690 con 0x7fe7901561f0 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe7982a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900d2290 con 0x7fe77c0039b0 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe7982a7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe7900b7810 con 0x7fe7901e9610 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 0x7fe7901e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 0x7fe7901e90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39830/0 (socket says 172.21.15.80:39830) 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 -- 172.21.15.80:0/1056731233 learned_addr learned my addr 172.21.15.80:0/1056731233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe796844640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7901e9610 0x7fe79015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 -- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7901e9610 msgr2=0x7fe79015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7901e9610 0x7fe79015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 -- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0039b0 msgr2=0x7fe7900c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe796043640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0039b0 0x7fe7900c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0039b0 0x7fe7900c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.576+0000 7fe795842640 1 -- 172.21.15.80:0/1056731233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7901e9a20 con 0x7fe7901561f0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.577+0000 7fe795842640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 0x7fe7901e90d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe78000e7b0 tx=0x7fe78000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.577+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800070d0 con 0x7fe7901561f0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.577+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe780018070 con 0x7fe7901561f0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.577+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe790156f20 con 0x7fe7901561f0 2024-04-25T15:43:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.577+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780007490 con 0x7fe7901561f0 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.577+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7901574e0 con 0x7fe7901561f0 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.578+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79006a100 con 0x7fe7901561f0 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.579+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe7800057a0 con 0x7fe7901561f0 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.579+0000 7fe786ffd640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7740744b0 0x7fe7740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.579+0000 7fe796043640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7740744b0 0x7fe7740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.579+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe780095610 con 0x7fe7901561f0 2024-04-25T15:43:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.579+0000 7fe796043640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7740744b0 0x7fe7740769c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe78c033000 tx=0x7fe78c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.584+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe7901e9a20 con 0x7fe7901561f0 2024-04-25T15:43:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.760+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7900d1e40 con 0x7fe7901561f0 2024-04-25T15:43:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.761+0000 7fe786ffd640 1 -- 172.21.15.80:0/1056731233 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7fe7900d33e0 con 0x7fe7901561f0 2024-04-25T15:43:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:57.763 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:43:57.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7740744b0 msgr2=0x7fe7740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7740744b0 0x7fe7740769c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe78c033000 tx=0x7fe78c008030 comp rx=0 tx=0).stop 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 msgr2=0x7fe7901e90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 0x7fe7901e90d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe78000e7b0 tx=0x7fe78000ebb0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 shutdown_connections 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7740744b0 0x7fe7740769c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7901e9610 0x7fe79015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7901561f0 0x7fe7901e90d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 --2- 172.21.15.80:0/1056731233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0039b0 0x7fe7900c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 >> 172.21.15.80:0/1056731233 conn(0x7fe7900d3ea0 msgr2=0x7fe7900ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 shutdown_connections 2024-04-25T15:43:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.763+0000 7fe7982a7640 1 -- 172.21.15.80:0/1056731233 wait complete. 2024-04-25T15:43:57.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:43:57.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:43:57.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.885+0000 7f27dbb06640 1 Processor -- start 2024-04-25T15:43:57.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.886+0000 7f27dbb06640 1 -- start start 2024-04-25T15:43:57.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27dbb06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d406c5c0 0x7f27d40d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27dbb06640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d40d2f40 0x7f27d406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27dbb06640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d40ce590 con 0x7f27d406ecd0 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27dbb06640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f27d40ce360 con 0x7f27d40d2f40 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27dbb06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f27d409c320 con 0x7f27d406c5c0 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d40d2f40 0x7f27d406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d40d2f40 0x7f27d406e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39832/0 (socket says 172.21.15.80:39832) 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 -- 172.21.15.80:0/2733860434 learned_addr learned my addr 172.21.15.80:0/2733860434 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d98a2640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d406c5c0 0x7f27d40d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 -- 172.21.15.80:0/2733860434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d406c5c0 msgr2=0x7f27d40d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d406c5c0 0x7f27d40d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 -- 172.21.15.80:0/2733860434 >> v1:172.21.15.195:6789/0 conn(0x7f27d406ecd0 legacy=0x7f27d40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d90a1640 1 -- 172.21.15.80:0/2733860434 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d40ce830 con 0x7f27d40d2f40 2024-04-25T15:43:57.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.887+0000 7f27d98a2640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d406c5c0 0x7f27d40d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:57.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.888+0000 7f27d90a1640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d40d2f40 0x7f27d406e790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f27d40d03f0 tx=0x7f27c402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7a2809b3f77f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.888+0000 7f27d88a0640 1 -- 172.21.15.80:0/2733860434 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4037070 con 0x7f27d40d2f40 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.888+0000 7f27d88a0640 1 -- 172.21.15.80:0/2733860434 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c4032440 con 0x7f27d40d2f40 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.888+0000 7f27d88a0640 1 -- 172.21.15.80:0/2733860434 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4032810 con 0x7f27d40d2f40 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 -- 172.21.15.80:0/2733860434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d40d2f40 msgr2=0x7f27d406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d40d2f40 0x7f27d406e790 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f27d40d03f0 tx=0x7f27c402a160 comp rx=0 tx=0).stop 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 -- 172.21.15.80:0/2733860434 shutdown_connections 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d40d2f40 0x7f27d406e790 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 --2- 172.21.15.80:0/2733860434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d406c5c0 0x7f27d40d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 -- 172.21.15.80:0/2733860434 >> 172.21.15.80:0/2733860434 conn(0x7f27d40b7620 msgr2=0x7f27d40b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 -- 172.21.15.80:0/2733860434 shutdown_connections 2024-04-25T15:43:57.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.889+0000 7f27dbb06640 1 -- 172.21.15.80:0/2733860434 wait complete. 2024-04-25T15:43:57.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.891+0000 7f27dbb06640 1 Processor -- start 2024-04-25T15:43:57.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.891+0000 7f27dbb06640 1 -- start start 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27dbb06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 0x7f27d415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27dbb06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d406ecd0 0x7f27d40c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27dbb06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d40d2f40 0x7f27d40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27dbb06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f27d406c9d0 con 0x7f27d406c5c0 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27dbb06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f27d40cedf0 con 0x7f27d406ecd0 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27dbb06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f27d406cb50 con 0x7f27d40d2f40 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27d98a2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 0x7f27d415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27d98a2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 0x7f27d415e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39848/0 (socket says 172.21.15.80:39848) 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.892+0000 7f27d98a2640 1 -- 172.21.15.80:0/3344947867 learned_addr learned my addr 172.21.15.80:0/3344947867 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27da0a3640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d40d2f40 0x7f27d40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d90a1640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d406ecd0 0x7f27d40c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d98a2640 1 -- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d40d2f40 msgr2=0x7f27d40ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d98a2640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d40d2f40 0x7f27d40ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d98a2640 1 -- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d406ecd0 msgr2=0x7f27d40c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:57.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d98a2640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d406ecd0 0x7f27d40c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d98a2640 1 -- 172.21.15.80:0/3344947867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d415e810 con 0x7f27d406c5c0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27da0a3640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d40d2f40 0x7f27d40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d90a1640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d406ecd0 0x7f27d40c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27d98a2640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 0x7f27d415e2d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c7f0 tx=0x7f27d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0015070 con 0x7f27d406c5c0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0007820 con 0x7f27d406c5c0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d415ec90 con 0x7f27d406c5c0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0007c10 con 0x7f27d406c5c0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.893+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d40c7850 con 0x7f27d406c5c0 2024-04-25T15:43:57.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.894+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d406a100 con 0x7f27d406c5c0 2024-04-25T15:43:57.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.895+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f27d0018070 con 0x7f27d406c5c0 2024-04-25T15:43:57.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.895+0000 7f27ca7fc640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27b80744e0 0x7f27b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:57.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.895+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f27d0095480 con 0x7f27d406c5c0 2024-04-25T15:43:57.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.895+0000 7f27d90a1640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27b80744e0 0x7f27b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:57.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.895+0000 7f27d90a1640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27b80744e0 0x7f27b80769f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f27c4034000 tx=0x7f27c402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:57.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:57.900+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f27d005f8a0 con 0x7f27d406c5c0 2024-04-25T15:43:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.075+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f27d409b9d0 con 0x7f27d406c5c0 2024-04-25T15:43:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.076+0000 7f27ca7fc640 1 -- 172.21.15.80:0/3344947867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f27d005f1a0 con 0x7f27d406c5c0 2024-04-25T15:43:58.077 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:43:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27b80744e0 msgr2=0x7f27b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27b80744e0 0x7f27b80769f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f27c4034000 tx=0x7f27c402e000 comp rx=0 tx=0).stop 2024-04-25T15:43:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 msgr2=0x7f27d415e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 0x7f27d415e2d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c7f0 tx=0x7f27d000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 shutdown_connections 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27b80744e0 0x7f27b80769f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27d40d2f40 0x7f27d40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d406ecd0 0x7f27d40c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 --2- 172.21.15.80:0/3344947867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d406c5c0 0x7f27d415e2d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 >> 172.21.15.80:0/3344947867 conn(0x7f27d40b7620 msgr2=0x7f27d4157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 shutdown_connections 2024-04-25T15:43:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.078+0000 7f27dbb06640 1 -- 172.21.15.80:0/3344947867 wait complete. 2024-04-25T15:43:58.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:43:58.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.200+0000 7fa3024f0640 1 Processor -- start 2024-04-25T15:43:58.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.200+0000 7fa3024f0640 1 -- start start 2024-04-25T15:43:58.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa3024f0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0d1600 0x7fa2fc0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa3024f0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa2fc0718d0 0x7fa2fc071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa3024f0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2fc0d1f50 con 0x7fa2fc0cf930 2024-04-25T15:43:58.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa3024f0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa2fc0cf4a0 con 0x7fa2fc0718d0 2024-04-25T15:43:58.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa3024f0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2fc0cfd40 con 0x7fa2fc0d1600 2024-04-25T15:43:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa2fbfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa2fc0cf930 0x7fa2fc160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:42950/0 (socket says 172.21.15.80:42950) 2024-04-25T15:43:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0d1600 0x7fa2fc0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa2fbfff640 1 -- 172.21.15.80:0/2443631136 learned_addr learned my addr 172.21.15.80:0/2443631136 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa300a8d640 1 --2- 172.21.15.80:0/2443631136 >> v2:172.21.15.195:3300/0 conn(0x7fa2fc0718d0 0x7fa2fc071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa2faffd640 1 -- 172.21.15.80:0/2443631136 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565807250 0 0) 0x7fa2ec001110 con 0x7fa2fc0cf930 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.202+0000 7fa2faffd640 1 -- 172.21.15.80:0/2443631136 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e4003520 con 0x7fa2fc0cf930 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.203+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/2443631136 >> v2:172.21.15.195:3300/0 conn(0x7fa2fc0718d0 msgr2=0x7fa2fc071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.203+0000 7fa2fb7fe640 1 --2- 172.21.15.80:0/2443631136 >> v2:172.21.15.195:3300/0 conn(0x7fa2fc0718d0 0x7fa2fc071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.203+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/2443631136 >> v1:172.21.15.195:6789/0 conn(0x7fa2fc0cf930 legacy=0x7fa2fc160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.203+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/2443631136 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc0ce890 con 0x7fa2fc0d1600 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.203+0000 7fa300a8d640 1 --2- 172.21.15.80:0/2443631136 >> v2:172.21.15.195:3300/0 conn(0x7fa2fc0718d0 0x7fa2fc071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.203+0000 7fa2fb7fe640 1 --2- 172.21.15.80:0/2443631136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0d1600 0x7fa2fc0d1a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00097a0 tx=0x7fa2f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa9b9fbcf3e8381 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa2faffd640 1 -- 172.21.15.80:0/2443631136 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0037070 con 0x7fa2fc0d1600 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa2faffd640 1 -- 172.21.15.80:0/2443631136 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f0032440 con 0x7fa2fc0d1600 2024-04-25T15:43:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa2faffd640 1 -- 172.21.15.80:0/2443631136 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0032810 con 0x7fa2fc0d1600 2024-04-25T15:43:58.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 -- 172.21.15.80:0/2443631136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0d1600 msgr2=0x7fa2fc0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 --2- 172.21.15.80:0/2443631136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0d1600 0x7fa2fc0d1a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00097a0 tx=0x7fa2f002a180 comp rx=0 tx=0).stop 2024-04-25T15:43:58.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 -- 172.21.15.80:0/2443631136 shutdown_connections 2024-04-25T15:43:58.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 --2- 172.21.15.80:0/2443631136 >> v2:172.21.15.195:3300/0 conn(0x7fa2fc0718d0 0x7fa2fc071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 --2- 172.21.15.80:0/2443631136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0d1600 0x7fa2fc0d1a10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 -- 172.21.15.80:0/2443631136 >> 172.21.15.80:0/2443631136 conn(0x7fa2fc0d3a30 msgr2=0x7fa2fc0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:58.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 -- 172.21.15.80:0/2443631136 shutdown_connections 2024-04-25T15:43:58.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.204+0000 7fa3024f0640 1 -- 172.21.15.80:0/2443631136 wait complete. 2024-04-25T15:43:58.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.206+0000 7fa3024f0640 1 Processor -- start 2024-04-25T15:43:58.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.206+0000 7fa3024f0640 1 -- start start 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.207+0000 7fa3024f0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0718d0 0x7fa2fc1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.207+0000 7fa3024f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 0x7fa2fc0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.207+0000 7fa3024f0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2fc0d1600 0x7fa2fc15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.207+0000 7fa3024f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0cf130 con 0x7fa2fc0cf930 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.207+0000 7fa3024f0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0cee50 con 0x7fa2fc0d1600 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.207+0000 7fa3024f0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2fc072220 con 0x7fa2fc0718d0 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 0x7fa2fc0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 0x7fa2fc0b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39858/0 (socket says 172.21.15.80:39858) 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/616417657 learned_addr learned my addr 172.21.15.80:0/616417657 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fbfff640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0718d0 0x7fa2fc1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa300a8d640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2fc0d1600 0x7fa2fc15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0718d0 msgr2=0x7fa2fc1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0718d0 0x7fa2fc1529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2fc0d1600 msgr2=0x7fa2fc15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2fc0d1600 0x7fa2fc15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 -- 172.21.15.80:0/616417657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc0b4e00 con 0x7fa2fc0cf930 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2fb7fe640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 0x7fa2fc0b4590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0000c00 tx=0x7fa2f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0041020 con 0x7fa2fc0cf930 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f003d640 con 0x7fa2fc0cf930 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc0b2c40 con 0x7fa2fc0cf930 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0037040 con 0x7fa2fc0cf930 2024-04-25T15:43:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.208+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc0b3200 con 0x7fa2fc0cf930 2024-04-25T15:43:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.210+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc06a100 con 0x7fa2fc0cf930 2024-04-25T15:43:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.210+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa2f0044020 con 0x7fa2fc0cf930 2024-04-25T15:43:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.210+0000 7fa2f8ff9640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2e80744b0 0x7fa2e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.210+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa2f00b5b50 con 0x7fa2fc0cf930 2024-04-25T15:43:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.210+0000 7fa2fbfff640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2e80744b0 0x7fa2e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.211+0000 7fa2fbfff640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2e80744b0 0x7fa2e80769c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec007fd0 tx=0x7fa2ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.215+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2f004b030 con 0x7fa2fc0cf930 2024-04-25T15:43:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.390+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2fc0b99b0 con 0x7fa2fc0cf930 2024-04-25T15:43:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.390+0000 7fa2f8ff9640 1 -- 172.21.15.80:0/616417657 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fa2f007ff80 con 0x7fa2fc0cf930 2024-04-25T15:43:58.391 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:58.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2e80744b0 msgr2=0x7fa2e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2e80744b0 0x7fa2e80769c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec007fd0 tx=0x7fa2ec009040 comp rx=0 tx=0).stop 2024-04-25T15:43:58.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 msgr2=0x7fa2fc0b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 0x7fa2fc0b4590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0000c00 tx=0x7fa2f00046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 shutdown_connections 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2e80744b0 0x7fa2e80769c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2fc0d1600 0x7fa2fc15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2fc0cf930 0x7fa2fc0b4590 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 --2- 172.21.15.80:0/616417657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2fc0718d0 0x7fa2fc1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 >> 172.21.15.80:0/616417657 conn(0x7fa2fc0d3a30 msgr2=0x7fa2fc0b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 shutdown_connections 2024-04-25T15:43:58.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.392+0000 7fa3024f0640 1 -- 172.21.15.80:0/616417657 wait complete. 2024-04-25T15:43:58.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:43:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.513+0000 7f630373c640 1 Processor -- start 2024-04-25T15:43:58.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.514+0000 7f630373c640 1 -- start start 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f630373c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62fc09c0a0 0x7f62fc160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f630373c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f62fc0af5f0 0x7f62fc0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f630373c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62fc1607a0 con 0x7f62fc09b850 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f630373c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc0cd220 con 0x7f62fc09c0a0 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f630373c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc0cd500 con 0x7f62fc0af5f0 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62fc09c0a0 0x7f62fc160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62fc09c0a0 0x7f62fc160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39870/0 (socket says 172.21.15.80:39870) 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 -- 172.21.15.80:0/133391898 learned_addr learned my addr 172.21.15.80:0/133391898 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f6300cd7640 1 --1- 172.21.15.80:0/133391898 >> v1:172.21.15.80:6789/0 conn(0x7f62fc09b850 0x7f62fc0ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55082/0 (socket says 172.21.15.80:55082) 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 -- 172.21.15.80:0/133391898 >> v2:172.21.15.195:3300/0 conn(0x7f62fc0af5f0 msgr2=0x7f62fc0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 --2- 172.21.15.80:0/133391898 >> v2:172.21.15.195:3300/0 conn(0x7f62fc0af5f0 0x7f62fc0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 -- 172.21.15.80:0/133391898 >> v1:172.21.15.80:6789/0 conn(0x7f62fc09b850 legacy=0x7f62fc0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f63014d8640 1 -- 172.21.15.80:0/133391898 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc0cd7e0 con 0x7f62fc09c0a0 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.515+0000 7f62f3fff640 1 -- 172.21.15.80:0/133391898 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653929039 0 0) 0x7f62fc1607a0 con 0x7f62fc09b850 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.516+0000 7f63014d8640 1 --2- 172.21.15.80:0/133391898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc160260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0cce80 tx=0x7f62f802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f6e18f9acc054c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.516+0000 7f62f3fff640 1 -- 172.21.15.80:0/133391898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f80325f0 con 0x7f62fc09c0a0 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.516+0000 7f62f3fff640 1 -- 172.21.15.80:0/133391898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f8032790 con 0x7f62fc09c0a0 2024-04-25T15:43:58.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.516+0000 7f62f3fff640 1 -- 172.21.15.80:0/133391898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8032b60 con 0x7f62fc09c0a0 2024-04-25T15:43:58.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 -- 172.21.15.80:0/133391898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 msgr2=0x7f62fc160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 --2- 172.21.15.80:0/133391898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc160260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0cce80 tx=0x7f62f802a780 comp rx=0 tx=0).stop 2024-04-25T15:43:58.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 -- 172.21.15.80:0/133391898 shutdown_connections 2024-04-25T15:43:58.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 --2- 172.21.15.80:0/133391898 >> v2:172.21.15.195:3300/0 conn(0x7f62fc0af5f0 0x7f62fc0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 --2- 172.21.15.80:0/133391898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc160260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 -- 172.21.15.80:0/133391898 >> 172.21.15.80:0/133391898 conn(0x7f62fc0b75b0 msgr2=0x7f62fc0b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:58.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 -- 172.21.15.80:0/133391898 shutdown_connections 2024-04-25T15:43:58.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.517+0000 7f630373c640 1 -- 172.21.15.80:0/133391898 wait complete. 2024-04-25T15:43:58.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.519+0000 7f630373c640 1 Processor -- start 2024-04-25T15:43:58.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.519+0000 7f630373c640 1 -- start start 2024-04-25T15:43:58.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f630373c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62fc09b850 0x7f62fc0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f630373c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f630373c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62fc0af5f0 0x7f62fc15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f630373c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0ccef0 con 0x7f62fc09c0a0 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f630373c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0cdda0 con 0x7f62fc0af5f0 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f630373c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc0ce9d0 con 0x7f62fc09b850 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc0ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39884/0 (socket says 172.21.15.80:39884) 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 -- 172.21.15.80:0/2567790704 learned_addr learned my addr 172.21.15.80:0/2567790704 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6301cd9640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62fc0af5f0 0x7f62fc15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f63014d8640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62fc09b850 0x7f62fc0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 -- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62fc09b850 msgr2=0x7f62fc0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62fc09b850 0x7f62fc0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 -- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62fc0af5f0 msgr2=0x7f62fc15c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62fc0af5f0 0x7f62fc15c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6300cd7640 1 -- 172.21.15.80:0/2567790704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc0c8540 con 0x7f62fc09c0a0 2024-04-25T15:43:58.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f6301cd9640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62fc0af5f0 0x7f62fc15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.520+0000 7f63014d8640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62fc09b850 0x7f62fc0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.521+0000 7f6300cd7640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc0ca2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c460 tx=0x7f62ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.521+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec018070 con 0x7f62fc09c0a0 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.521+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec007500 con 0x7f62fc09c0a0 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.521+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc162bf0 con 0x7f62fc09c0a0 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.521+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004a20 con 0x7f62fc09c0a0 2024-04-25T15:43:58.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.521+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc0c6500 con 0x7f62fc09c0a0 2024-04-25T15:43:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.522+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc06a100 con 0x7f62fc09c0a0 2024-04-25T15:43:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.523+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f62ec01b070 con 0x7f62fc09c0a0 2024-04-25T15:43:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.523+0000 7f62f1ffb640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62e00744b0 0x7f62e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.523+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f62ec094820 con 0x7f62fc09c0a0 2024-04-25T15:43:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.523+0000 7f63014d8640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62e00744b0 0x7f62e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.523+0000 7f63014d8640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62e00744b0 0x7f62e00769c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f62f8033000 tx=0x7f62f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.528+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62ec05ec40 con 0x7f62fc09c0a0 2024-04-25T15:43:58.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.703+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62fc15f3e0 con 0x7f62fc09c0a0 2024-04-25T15:43:58.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.704+0000 7f62f1ffb640 1 -- 172.21.15.80:0/2567790704 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f62ec05e540 con 0x7f62fc09c0a0 2024-04-25T15:43:58.705 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62e00744b0 msgr2=0x7f62e00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62e00744b0 0x7f62e00769c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f62f8033000 tx=0x7f62f802e000 comp rx=0 tx=0).stop 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 msgr2=0x7f62fc0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc0ca2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c460 tx=0x7f62ec00c920 comp rx=0 tx=0).stop 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 shutdown_connections 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62e00744b0 0x7f62e00769c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62fc0af5f0 0x7f62fc15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62fc09c0a0 0x7f62fc0ca2d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 --2- 172.21.15.80:0/2567790704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62fc09b850 0x7f62fc0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 >> 172.21.15.80:0/2567790704 conn(0x7f62fc0b75b0 msgr2=0x7f62fc0ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 shutdown_connections 2024-04-25T15:43:58.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.706+0000 7f630373c640 1 -- 172.21.15.80:0/2567790704 wait complete. 2024-04-25T15:43:58.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:43:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.827+0000 7f4a4af84640 1 Processor -- start 2024-04-25T15:43:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.827+0000 7f4a4af84640 1 -- start start 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a4af84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a4406d870 0x7f4a440d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a4af84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a440cfc90 con 0x7f4a4406cc10 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a4af84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a4406c9a0 con 0x7f4a440b37b0 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a4af84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4a440d2c10 con 0x7f4a4406d870 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a43fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a4406d870 0x7f4a440d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a43fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a4406d870 0x7f4a440d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39892/0 (socket says 172.21.15.80:39892) 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a48d20640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4a4406cc10 0x7f4a4406d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55094/0 (socket says 172.21.15.80:55094) 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.828+0000 7f4a43fff640 1 -- 172.21.15.80:0/1749602784 learned_addr learned my addr 172.21.15.80:0/1749602784 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a43fff640 1 -- 172.21.15.80:0/1749602784 >> v1:172.21.15.195:6789/0 conn(0x7f4a440b37b0 legacy=0x7f4a440d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:58.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a43fff640 1 -- 172.21.15.80:0/1749602784 >> v1:172.21.15.80:6789/0 conn(0x7f4a4406cc10 legacy=0x7f4a4406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a43fff640 1 -- 172.21.15.80:0/1749602784 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a440cff30 con 0x7f4a4406d870 2024-04-25T15:43:58.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a437fe640 1 -- 172.21.15.80:0/1749602784 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651887979 0 0) 0x7f4a440cfc90 con 0x7f4a4406cc10 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a43fff640 1 --2- 172.21.15.80:0/1749602784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406d870 0x7f4a440d0450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4a440cfe60 tx=0x7f4a3002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c5a5e217080932 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a437fe640 1 -- 172.21.15.80:0/1749602784 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30037070 con 0x7f4a4406d870 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a437fe640 1 -- 172.21.15.80:0/1749602784 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30032440 con 0x7f4a4406d870 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.829+0000 7f4a437fe640 1 -- 172.21.15.80:0/1749602784 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30032810 con 0x7f4a4406d870 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 -- 172.21.15.80:0/1749602784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406d870 msgr2=0x7f4a440d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1749602784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406d870 0x7f4a440d0450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4a440cfe60 tx=0x7f4a3002a290 comp rx=0 tx=0).stop 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 -- 172.21.15.80:0/1749602784 shutdown_connections 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1749602784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406d870 0x7f4a440d0450 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 -- 172.21.15.80:0/1749602784 >> 172.21.15.80:0/1749602784 conn(0x7f4a4409b410 msgr2=0x7f4a440b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 -- 172.21.15.80:0/1749602784 shutdown_connections 2024-04-25T15:43:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.830+0000 7f4a4af84640 1 -- 172.21.15.80:0/1749602784 wait complete. 2024-04-25T15:43:58.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.832+0000 7f4a4af84640 1 Processor -- start 2024-04-25T15:43:58.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.832+0000 7f4a4af84640 1 -- start start 2024-04-25T15:43:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a4af84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 0x7f4a441543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a4af84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a440b37b0 0x7f4a4409f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a4af84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a4415f750 0x7f4a4409f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a4af84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44076230 con 0x7f4a4406cc10 2024-04-25T15:43:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a4af84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4406c670 con 0x7f4a440b37b0 2024-04-25T15:43:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a4af84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4a44163860 con 0x7f4a4415f750 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a48d20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 0x7f4a441543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a48d20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 0x7f4a441543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39898/0 (socket says 172.21.15.80:39898) 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.833+0000 7f4a48d20640 1 -- 172.21.15.80:0/1635510460 learned_addr learned my addr 172.21.15.80:0/1635510460 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a43fff640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a440b37b0 0x7f4a4409f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a49521640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a4415f750 0x7f4a4409f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a48d20640 1 -- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a4415f750 msgr2=0x7f4a4409f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a48d20640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a4415f750 0x7f4a4409f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a48d20640 1 -- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a440b37b0 msgr2=0x7f4a4409f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a48d20640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a440b37b0 0x7f4a4409f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a48d20640 1 -- 172.21.15.80:0/1635510460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a44154900 con 0x7f4a4406cc10 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a43fff640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a440b37b0 0x7f4a4409f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a49521640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a4415f750 0x7f4a4409f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:43:58.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a48d20640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 0x7f4a441543c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c460 tx=0x7f4a3800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38018070 con 0x7f4a4406cc10 2024-04-25T15:43:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a38007500 con 0x7f4a4406cc10 2024-04-25T15:43:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4409cc20 con 0x7f4a4406cc10 2024-04-25T15:43:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38004a20 con 0x7f4a4406cc10 2024-04-25T15:43:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.834+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a4409e8b0 con 0x7f4a4406cc10 2024-04-25T15:43:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.835+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4409e3e0 con 0x7f4a4406cc10 2024-04-25T15:43:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.836+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4a38004bc0 con 0x7f4a4406cc10 2024-04-25T15:43:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.836+0000 7f4a417fa640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a280744b0 0x7f4a280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.836+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4a380948d0 con 0x7f4a4406cc10 2024-04-25T15:43:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.836+0000 7f4a43fff640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a280744b0 0x7f4a280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.837+0000 7f4a43fff640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a280744b0 0x7f4a280769c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4a30034000 tx=0x7f4a3002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:58.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:58.841+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a3805ed00 con 0x7f4a4406cc10 2024-04-25T15:43:59.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.015+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4a4406a100 con 0x7f4a4406cc10 2024-04-25T15:43:59.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.016+0000 7f4a417fa640 1 -- 172.21.15.80:0/1635510460 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f4a38092e20 con 0x7f4a4406cc10 2024-04-25T15:43:59.017 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:43:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a280744b0 msgr2=0x7f4a280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a280744b0 0x7f4a280769c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4a30034000 tx=0x7f4a3002e000 comp rx=0 tx=0).stop 2024-04-25T15:43:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 msgr2=0x7f4a441543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 0x7f4a441543c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c460 tx=0x7f4a3800c920 comp rx=0 tx=0).stop 2024-04-25T15:43:59.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 shutdown_connections 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a280744b0 0x7f4a280769c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a4415f750 0x7f4a4409f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a440b37b0 0x7f4a4409f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 --2- 172.21.15.80:0/1635510460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a4406cc10 0x7f4a441543c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 >> 172.21.15.80:0/1635510460 conn(0x7f4a4409b410 msgr2=0x7f4a440b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 shutdown_connections 2024-04-25T15:43:59.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.018+0000 7f4a4af84640 1 -- 172.21.15.80:0/1635510460 wait complete. 2024-04-25T15:43:59.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:43:59.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.139+0000 7fef5d734640 1 Processor -- start 2024-04-25T15:43:59.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.139+0000 7fef5d734640 1 -- start start 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.140+0000 7fef5d734640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef580d41b0 0x7fef580b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef5d734640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef580b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef5d734640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef580b7fa0 con 0x7fef580b7b90 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef5d734640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fef580d59d0 con 0x7fef580d41b0 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef5d734640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef58163fb0 con 0x7fef581602a0 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef580d41b0 0x7fef580b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef580d41b0 0x7fef580b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39900/0 (socket says 172.21.15.80:39900) 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef577fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fef580b7b90 0x7fef580d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55098/0 (socket says 172.21.15.80:55098) 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 -- 172.21.15.80:0/3537646393 learned_addr learned my addr 172.21.15.80:0/3537646393 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:59.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef567fc640 1 --2- 172.21.15.80:0/3537646393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef580b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 -- 172.21.15.80:0/3537646393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 msgr2=0x7fef580b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 --2- 172.21.15.80:0/3537646393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef580b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 -- 172.21.15.80:0/3537646393 >> v1:172.21.15.80:6789/0 conn(0x7fef580b7b90 legacy=0x7fef580d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef55ffb640 1 -- 172.21.15.80:0/3537646393 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870793978 0 0) 0x7fef50001490 con 0x7fef580b7b90 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.141+0000 7fef56ffd640 1 -- 172.21.15.80:0/3537646393 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef58164270 con 0x7fef580d41b0 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.142+0000 7fef56ffd640 1 --2- 172.21.15.80:0/3537646393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580d41b0 0x7fef580b48d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a96eae38a311d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.142+0000 7fef55ffb640 1 -- 172.21.15.80:0/3537646393 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48037070 con 0x7fef580d41b0 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.142+0000 7fef55ffb640 1 -- 172.21.15.80:0/3537646393 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef48032440 con 0x7fef580d41b0 2024-04-25T15:43:59.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.142+0000 7fef55ffb640 1 -- 172.21.15.80:0/3537646393 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48032810 con 0x7fef580d41b0 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 -- 172.21.15.80:0/3537646393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580d41b0 msgr2=0x7fef580b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 --2- 172.21.15.80:0/3537646393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580d41b0 0x7fef580b48d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4802a270 comp rx=0 tx=0).stop 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 -- 172.21.15.80:0/3537646393 shutdown_connections 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 --2- 172.21.15.80:0/3537646393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef580b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 --2- 172.21.15.80:0/3537646393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580d41b0 0x7fef580b48d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 -- 172.21.15.80:0/3537646393 >> 172.21.15.80:0/3537646393 conn(0x7fef5806e9f0 msgr2=0x7fef580d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 -- 172.21.15.80:0/3537646393 shutdown_connections 2024-04-25T15:43:59.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.143+0000 7fef5d734640 1 -- 172.21.15.80:0/3537646393 wait complete. 2024-04-25T15:43:59.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.145+0000 7fef5d734640 1 Processor -- start 2024-04-25T15:43:59.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.145+0000 7fef5d734640 1 -- start start 2024-04-25T15:43:59.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef5d734640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 0x7fef58155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef5d734640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580d41b0 0x7fef580c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef5d734640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef581ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef5d734640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef58164b10 con 0x7fef580b7b90 2024-04-25T15:43:59.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef5d734640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fef58164830 con 0x7fef580d41b0 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef5d734640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef580b4fd0 con 0x7fef581602a0 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 0x7fef58155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 0x7fef58155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39916/0 (socket says 172.21.15.80:39916) 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 -- 172.21.15.80:0/1229307370 learned_addr learned my addr 172.21.15.80:0/1229307370 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 -- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 msgr2=0x7fef581ebf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef577fe640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef581ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef581ebf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 -- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580d41b0 msgr2=0x7fef580c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef567fc640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580d41b0 0x7fef580c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580d41b0 0x7fef580c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.146+0000 7fef56ffd640 1 -- 172.21.15.80:0/1229307370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef581587d0 con 0x7fef580b7b90 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.147+0000 7fef56ffd640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 0x7fef58155dd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef4802a2b0 tx=0x7fef480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.147+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48041020 con 0x7fef580b7b90 2024-04-25T15:43:59.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.147+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480306c0 con 0x7fef580b7b90 2024-04-25T15:43:59.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.147+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef58158ab0 con 0x7fef580b7b90 2024-04-25T15:43:59.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.147+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48037040 con 0x7fef580b7b90 2024-04-25T15:43:59.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.147+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef58159070 con 0x7fef580b7b90 2024-04-25T15:43:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.148+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef58158550 con 0x7fef580b7b90 2024-04-25T15:43:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.148+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fef48044020 con 0x7fef580b7b90 2024-04-25T15:43:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.149+0000 7fef3f7fe640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef440744e0 0x7fef440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.149+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fef480b5de0 con 0x7fef580b7b90 2024-04-25T15:43:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.149+0000 7fef567fc640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef440744e0 0x7fef440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.149+0000 7fef567fc640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef440744e0 0x7fef440769f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef4c006fd0 tx=0x7fef4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.153+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef58158550 con 0x7fef580b7b90 2024-04-25T15:43:59.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.339+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef5806a100 con 0x7fef580b7b90 2024-04-25T15:43:59.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.339+0000 7fef3f7fe640 1 -- 172.21.15.80:0/1229307370 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fef4804b030 con 0x7fef580b7b90 2024-04-25T15:43:59.341 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef440744e0 msgr2=0x7fef440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef440744e0 0x7fef440769f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef4c006fd0 tx=0x7fef4c008040 comp rx=0 tx=0).stop 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 msgr2=0x7fef58155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 0x7fef58155dd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef4802a2b0 tx=0x7fef480046c0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 shutdown_connections 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef440744e0 0x7fef440769f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef581602a0 0x7fef581ebf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580d41b0 0x7fef580c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 --2- 172.21.15.80:0/1229307370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef580b7b90 0x7fef58155dd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 >> 172.21.15.80:0/1229307370 conn(0x7fef5806e9f0 msgr2=0x7fef580d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:59.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 shutdown_connections 2024-04-25T15:43:59.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.341+0000 7fef5d734640 1 -- 172.21.15.80:0/1229307370 wait complete. 2024-04-25T15:43:59.353 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T15:43:59.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:59.354 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T15:43:59.384 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:43:59.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:43:59.384 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T15:43:59.441 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T15:43:59.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:43:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.548+0000 7f2a99b0d640 1 Processor -- start 2024-04-25T15:43:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.549+0000 7f2a99b0d640 1 -- start start 2024-04-25T15:43:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a99b0d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a940b2a40 0x7f2a940b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a99b0d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2a9409ce90 0x7f2a940d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a99b0d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a9409d2a0 con 0x7f2a940cff30 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a99b0d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2a940cfb70 con 0x7f2a940b2a40 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a99b0d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2a940b9350 con 0x7f2a9409ce90 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a940b2a40 0x7f2a940b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a940b2a40 0x7f2a940b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39924/0 (socket says 172.21.15.80:39924) 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 -- 172.21.15.80:0/2194283787 learned_addr learned my addr 172.21.15.80:0/2194283787 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a93fff640 1 --2- 172.21.15.80:0/2194283787 >> v2:172.21.15.195:3300/0 conn(0x7f2a9409ce90 0x7f2a940d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 -- 172.21.15.80:0/2194283787 >> v2:172.21.15.195:3300/0 conn(0x7f2a9409ce90 msgr2=0x7f2a940d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 --2- 172.21.15.80:0/2194283787 >> v2:172.21.15.195:3300/0 conn(0x7f2a9409ce90 0x7f2a940d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 -- 172.21.15.80:0/2194283787 >> v1:172.21.15.195:6789/0 conn(0x7f2a940cff30 legacy=0x7f2a940d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.550+0000 7f2a92ffd640 1 -- 172.21.15.80:0/2194283787 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a940cf890 con 0x7f2a940b2a40 2024-04-25T15:43:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.551+0000 7f2a92ffd640 1 --2- 172.21.15.80:0/2194283787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940b2a40 0x7f2a940b7230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a940cdfb0 tx=0x7f2a8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f5ec693111b1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.551+0000 7f2a927fc640 1 -- 172.21.15.80:0/2194283787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88037070 con 0x7f2a940b2a40 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.551+0000 7f2a927fc640 1 -- 172.21.15.80:0/2194283787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a88032440 con 0x7f2a940b2a40 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.551+0000 7f2a927fc640 1 -- 172.21.15.80:0/2194283787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88032810 con 0x7f2a940b2a40 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 -- 172.21.15.80:0/2194283787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940b2a40 msgr2=0x7f2a940b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/2194283787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940b2a40 0x7f2a940b7230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a940cdfb0 tx=0x7f2a8802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 -- 172.21.15.80:0/2194283787 shutdown_connections 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/2194283787 >> v2:172.21.15.195:3300/0 conn(0x7f2a9409ce90 0x7f2a940d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/2194283787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940b2a40 0x7f2a940b7230 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 -- 172.21.15.80:0/2194283787 >> 172.21.15.80:0/2194283787 conn(0x7f2a940d0450 msgr2=0x7f2a940d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 -- 172.21.15.80:0/2194283787 shutdown_connections 2024-04-25T15:43:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.552+0000 7f2a99b0d640 1 -- 172.21.15.80:0/2194283787 wait complete. 2024-04-25T15:43:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.554+0000 7f2a99b0d640 1 Processor -- start 2024-04-25T15:43:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.554+0000 7f2a99b0d640 1 -- start start 2024-04-25T15:43:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a99b0d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9409ce90 0x7f2a94155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a99b0d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a940b2a40 0x7f2a9406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a99b0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 0x7f2a9415f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a99b0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940d0f70 con 0x7f2a940cff30 2024-04-25T15:43:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a99b0d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940b9020 con 0x7f2a940b2a40 2024-04-25T15:43:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a99b0d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2a940d10f0 con 0x7f2a9409ce90 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a93fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 0x7f2a9415f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a93fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 0x7f2a9415f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39926/0 (socket says 172.21.15.80:39926) 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a93fff640 1 -- 172.21.15.80:0/708327581 learned_addr learned my addr 172.21.15.80:0/708327581 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a92ffd640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a940b2a40 0x7f2a9406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.555+0000 7f2a937fe640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9409ce90 0x7f2a94155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a93fff640 1 -- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9409ce90 msgr2=0x7f2a94155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a93fff640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9409ce90 0x7f2a94155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a93fff640 1 -- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a940b2a40 msgr2=0x7f2a9406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a93fff640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a940b2a40 0x7f2a9406dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a93fff640 1 -- 172.21.15.80:0/708327581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9406e230 con 0x7f2a940cff30 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a93fff640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 0x7f2a9415f620 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c007e90 tx=0x7f2a8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c014420 con 0x7f2a940cff30 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8c019070 con 0x7f2a940cff30 2024-04-25T15:43:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9406ec40 con 0x7f2a940cff30 2024-04-25T15:43:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c014800 con 0x7f2a940cff30 2024-04-25T15:43:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.556+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9406f200 con 0x7f2a940cff30 2024-04-25T15:43:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.557+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9406a100 con 0x7f2a940cff30 2024-04-25T15:43:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.558+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2a8c0149a0 con 0x7f2a940cff30 2024-04-25T15:43:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.558+0000 7f2a7bfff640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2a800744b0 0x7f2a800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.558+0000 7f2a937fe640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2a800744b0 0x7f2a800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.558+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2a8c095d10 con 0x7f2a940cff30 2024-04-25T15:43:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.559+0000 7f2a937fe640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2a800744b0 0x7f2a800769c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a84007fd0 tx=0x7f2a84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.563+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a8c05fa50 con 0x7f2a940cff30 2024-04-25T15:43:59.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.773+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a940d23e0 con 0x7f2a940cff30 2024-04-25T15:43:59.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.774+0000 7f2a7bfff640 1 -- 172.21.15.80:0/708327581 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f2a8c063d50 con 0x7f2a940cff30 2024-04-25T15:43:59.775 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:43:59.775 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:43:59.776 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2a800744b0 msgr2=0x7f2a800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2a800744b0 0x7f2a800769c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a84007fd0 tx=0x7f2a84009040 comp rx=0 tx=0).stop 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 msgr2=0x7f2a9415f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 0x7f2a9415f620 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c007e90 tx=0x7f2a8c00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 shutdown_connections 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2a800744b0 0x7f2a800769c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a940cff30 0x7f2a9415f620 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a940b2a40 0x7f2a9406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 --2- 172.21.15.80:0/708327581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a9409ce90 0x7f2a94155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 >> 172.21.15.80:0/708327581 conn(0x7f2a940d0450 msgr2=0x7f2a94071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:59.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 shutdown_connections 2024-04-25T15:43:59.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.776+0000 7f2a99b0d640 1 -- 172.21.15.80:0/708327581 wait complete. 2024-04-25T15:43:59.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:43:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.894+0000 7f5e9e14d640 1 Processor -- start 2024-04-25T15:43:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.894+0000 7f5e9e14d640 1 -- start start 2024-04-25T15:43:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e9e14d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5e980b0d80 0x7f5e9815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e9e14d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b65a0 0x7f5e98073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e9e14d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e9806fe10 0x7f5e98074070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e9e14d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5e980703e0 con 0x7f5e9806fe10 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e9e14d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5e980affc0 con 0x7f5e980b0d80 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e9e14d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5e980b02a0 con 0x7f5e980b65a0 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e97fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e9806fe10 0x7f5e98074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e97fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e9806fe10 0x7f5e98074070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39942/0 (socket says 172.21.15.80:39942) 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e97fff640 1 -- 172.21.15.80:0/4241414308 learned_addr learned my addr 172.21.15.80:0/4241414308 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e977fe640 1 --2- 172.21.15.80:0/4241414308 >> v2:172.21.15.195:3300/0 conn(0x7f5e980b0d80 0x7f5e9815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e96ffd640 1 --2- 172.21.15.80:0/4241414308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b65a0 0x7f5e98073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.895+0000 7f5e97fff640 1 -- 172.21.15.80:0/4241414308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b65a0 msgr2=0x7f5e98073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e97fff640 1 --2- 172.21.15.80:0/4241414308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b65a0 0x7f5e98073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e97fff640 1 -- 172.21.15.80:0/4241414308 >> v2:172.21.15.195:3300/0 conn(0x7f5e980b0d80 msgr2=0x7f5e9815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e97fff640 1 --2- 172.21.15.80:0/4241414308 >> v2:172.21.15.195:3300/0 conn(0x7f5e980b0d80 0x7f5e9815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e97fff640 1 -- 172.21.15.80:0/4241414308 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e980b0580 con 0x7f5e9806fe10 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e977fe640 1 --2- 172.21.15.80:0/4241414308 >> v2:172.21.15.195:3300/0 conn(0x7f5e980b0d80 0x7f5e9815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:43:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e97fff640 1 --2- 172.21.15.80:0/4241414308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e98074070 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5e98070a20 tx=0x7f5e9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc374fbbb5ce1531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e967fc640 1 -- 172.21.15.80:0/4241414308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90036070 con 0x7f5e9806fe10 2024-04-25T15:43:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e967fc640 1 -- 172.21.15.80:0/4241414308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e90031600 con 0x7f5e9806fe10 2024-04-25T15:43:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.896+0000 7f5e967fc640 1 -- 172.21.15.80:0/4241414308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e900319d0 con 0x7f5e9806fe10 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 -- 172.21.15.80:0/4241414308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 msgr2=0x7f5e98074070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/4241414308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e98074070 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5e98070a20 tx=0x7f5e9002a6a0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 -- 172.21.15.80:0/4241414308 shutdown_connections 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/4241414308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e98074070 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/4241414308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b65a0 0x7f5e98073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/4241414308 >> v2:172.21.15.195:3300/0 conn(0x7f5e980b0d80 0x7f5e9815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 -- 172.21.15.80:0/4241414308 >> 172.21.15.80:0/4241414308 conn(0x7f5e980d1e20 msgr2=0x7f5e98073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 -- 172.21.15.80:0/4241414308 shutdown_connections 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.897+0000 7f5e9e14d640 1 -- 172.21.15.80:0/4241414308 wait complete. 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.899+0000 7f5e9e14d640 1 Processor -- start 2024-04-25T15:43:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.899+0000 7f5e9e14d640 1 -- start start 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e9e14d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e9809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e9e14d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b0d80 0x7f5e98148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e9e14d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e980b65a0 0x7f5e980cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e9e14d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9806d5d0 con 0x7f5e9806fe10 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e9e14d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980ae7c0 con 0x7f5e980b65a0 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e9e14d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9806d750 con 0x7f5e980b0d80 2024-04-25T15:43:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e9809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e9809b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39946/0 (socket says 172.21.15.80:39946) 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.900+0000 7f5e977fe640 1 -- 172.21.15.80:0/3204363284 learned_addr learned my addr 172.21.15.80:0/3204363284 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e97fff640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e980b65a0 0x7f5e980cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e96ffd640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b0d80 0x7f5e98148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e977fe640 1 -- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b0d80 msgr2=0x7f5e98148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e977fe640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b0d80 0x7f5e98148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e977fe640 1 -- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e980b65a0 msgr2=0x7f5e980cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e977fe640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e980b65a0 0x7f5e980cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e977fe640 1 -- 172.21.15.80:0/3204363284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9809b950 con 0x7f5e9806fe10 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e977fe640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e9809b410 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d830 tx=0x7f5e8800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88018030 con 0x7f5e9806fe10 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8800be00 con 0x7f5e9806fe10 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e980ce380 con 0x7f5e9806fe10 2024-04-25T15:43:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880098b0 con 0x7f5e9806fe10 2024-04-25T15:43:59.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.901+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e980ce940 con 0x7f5e9806fe10 2024-04-25T15:43:59.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.902+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e98158cf0 con 0x7f5e9806fe10 2024-04-25T15:43:59.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.903+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5e8801b070 con 0x7f5e9806fe10 2024-04-25T15:43:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.903+0000 7f5e7ffff640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e840744b0 0x7f5e840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:43:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.903+0000 7f5e96ffd640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e840744b0 0x7f5e840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:43:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.904+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5e88095790 con 0x7f5e9806fe10 2024-04-25T15:43:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.904+0000 7f5e96ffd640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e840744b0 0x7f5e840769c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006fd0 tx=0x7f5e8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:43:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:43:59.908+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e8801be40 con 0x7f5e9806fe10 2024-04-25T15:44:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.083+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e9806a100 con 0x7f5e9806fe10 2024-04-25T15:44:00.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.084+0000 7f5e7ffff640 1 -- 172.21.15.80:0/3204363284 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f5e8805fbb0 con 0x7f5e9806fe10 2024-04-25T15:44:00.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:00.086 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:00.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e840744b0 msgr2=0x7f5e840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e840744b0 0x7f5e840769c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006fd0 tx=0x7f5e8c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:00.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 msgr2=0x7f5e9809b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e9809b410 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d830 tx=0x7f5e8800dcf0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 shutdown_connections 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e840744b0 0x7f5e840769c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e980b65a0 0x7f5e980cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e980b0d80 0x7f5e98148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 --2- 172.21.15.80:0/3204363284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e9806fe10 0x7f5e9809b410 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 >> 172.21.15.80:0/3204363284 conn(0x7f5e980d1e20 msgr2=0x7f5e980b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 shutdown_connections 2024-04-25T15:44:00.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.086+0000 7f5e9e14d640 1 -- 172.21.15.80:0/3204363284 wait complete. 2024-04-25T15:44:00.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:42:59.206260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:42:59.570541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T15:43:03.294408+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T15:44:00.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:00.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.208+0000 7f4501082640 1 Processor -- start 2024-04-25T15:44:00.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.208+0000 7f4501082640 1 -- start start 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f4501082640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44fc0ce730 0x7f44fc160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f4501082640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc0d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f4501082640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc0ceb40 con 0x7f44fc0b2f90 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f4501082640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f44fc164670 con 0x7f44fc0ce730 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f4501082640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f44fc164950 con 0x7f44fc0d3870 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f44f3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44fc0ce730 0x7f44fc160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f44f3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44fc0ce730 0x7f44fc160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39962/0 (socket says 172.21.15.80:39962) 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.209+0000 7f44f3fff640 1 -- 172.21.15.80:0/841841806 learned_addr learned my addr 172.21.15.80:0/841841806 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:00.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44fb59e640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc0d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44f3fff640 1 -- 172.21.15.80:0/841841806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 msgr2=0x7f44fc0d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44f3fff640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc0d3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44f3fff640 1 -- 172.21.15.80:0/841841806 >> v1:172.21.15.195:6789/0 conn(0x7f44fc0b2f90 legacy=0x7f44fc163e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44f3fff640 1 -- 172.21.15.80:0/841841806 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc164c30 con 0x7f44fc0ce730 2024-04-25T15:44:00.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44fb59e640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc0d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:00.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.210+0000 7f44f3fff640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0ce730 0x7f44fc160140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009870 tx=0x7f44e402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a2ea3ef4f8a947 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f44fa59c640 1 -- 172.21.15.80:0/841841806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e4037070 con 0x7f44fc0ce730 2024-04-25T15:44:00.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f44fa59c640 1 -- 172.21.15.80:0/841841806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e4032440 con 0x7f44fc0ce730 2024-04-25T15:44:00.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f44fa59c640 1 -- 172.21.15.80:0/841841806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e4032810 con 0x7f44fc0ce730 2024-04-25T15:44:00.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 -- 172.21.15.80:0/841841806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0ce730 msgr2=0x7f44fc160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0ce730 0x7f44fc160140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009870 tx=0x7f44e402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 -- 172.21.15.80:0/841841806 shutdown_connections 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc0d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 --2- 172.21.15.80:0/841841806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0ce730 0x7f44fc160140 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 -- 172.21.15.80:0/841841806 >> 172.21.15.80:0/841841806 conn(0x7f44fc0b5510 msgr2=0x7f44fc0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 -- 172.21.15.80:0/841841806 shutdown_connections 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.211+0000 7f4501082640 1 -- 172.21.15.80:0/841841806 wait complete. 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.213+0000 7f4501082640 1 Processor -- start 2024-04-25T15:44:00.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.213+0000 7f4501082640 1 -- start start 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 0x7f44fc1621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc0ce730 0x7f44fc158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc160680 con 0x7f44fc0b2f90 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0d41c0 con 0x7f44fc0ce730 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f44fc06e350 con 0x7f44fc0d3870 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 0x7f44fc1621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 0x7f44fc1621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39976/0 (socket says 172.21.15.80:39976) 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 -- 172.21.15.80:0/3277589887 learned_addr learned my addr 172.21.15.80:0/3277589887 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fb59e640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44f3fff640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc0ce730 0x7f44fc158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 -- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 msgr2=0x7f44fc15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc15ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 -- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc0ce730 msgr2=0x7f44fc158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc0ce730 0x7f44fc158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 -- 172.21.15.80:0/3277589887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc162730 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44fad9d640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 0x7f44fc1621f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c470 tx=0x7f44ec00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0052d0 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec005490 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007260 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc160e20 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.215+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc1613e0 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.216+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44fc06a100 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.217+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f44ec007400 con 0x7f44fc0b2f90 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.217+0000 7f44f37fe640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44dc0744e0 0x7f44dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.218+0000 7f44f3fff640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44dc0744e0 0x7f44dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.218+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f44ec094a00 con 0x7f44fc0b2f90 2024-04-25T15:44:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.218+0000 7f44f3fff640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44dc0744e0 0x7f44dc0769f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f44e4034000 tx=0x7f44e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.222+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f44ec05e740 con 0x7f44fc0b2f90 2024-04-25T15:44:00.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.398+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44fc0b9960 con 0x7f44fc0b2f90 2024-04-25T15:44:00.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.398+0000 7f44f37fe640 1 -- 172.21.15.80:0/3277589887 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f44ec062a40 con 0x7f44fc0b2f90 2024-04-25T15:44:00.399 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44dc0744e0 msgr2=0x7f44dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44dc0744e0 0x7f44dc0769f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f44e4034000 tx=0x7f44e402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 msgr2=0x7f44fc1621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 0x7f44fc1621f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c470 tx=0x7f44ec00c930 comp rx=0 tx=0).stop 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 shutdown_connections 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f44dc0744e0 0x7f44dc0769f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44fc0d3870 0x7f44fc15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc0ce730 0x7f44fc158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 --2- 172.21.15.80:0/3277589887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44fc0b2f90 0x7f44fc1621f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 >> 172.21.15.80:0/3277589887 conn(0x7f44fc0b5510 msgr2=0x7f44fc0b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 shutdown_connections 2024-04-25T15:44:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.400+0000 7f4501082640 1 -- 172.21.15.80:0/3277589887 wait complete. 2024-04-25T15:44:00.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:44:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.523+0000 7f59cc29f640 1 Processor -- start 2024-04-25T15:44:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.523+0000 7f59cc29f640 1 -- start start 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59cc29f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59c40d2f80 0x7f59c40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59cc29f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c40d0290 con 0x7f59c40cfe80 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59cc29f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c40b4770 con 0x7f59c406eb70 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59cc29f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f59c406d6d0 con 0x7f59c40d2f80 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59ca03b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f59c40cfe80 0x7f59c40d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55106/0 (socket says 172.21.15.80:55106) 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59ca03b640 1 -- 172.21.15.80:0/2072631688 learned_addr learned my addr 172.21.15.80:0/2072631688 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59c983a640 1 --2- 172.21.15.80:0/2072631688 >> v2:172.21.15.195:3300/0 conn(0x7f59c40d2f80 0x7f59c40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.524+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422286486 0 0) 0x7f59c40d0290 con 0x7f59c40cfe80 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b0005730 con 0x7f59c40cfe80 2024-04-25T15:44:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1960587224 0 0) 0x7f59b0005730 con 0x7f59c40cfe80 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 >> v2:172.21.15.195:3300/0 conn(0x7f59c40d2f80 msgr2=0x7f59c40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 --2- 172.21.15.80:0/2072631688 >> v2:172.21.15.195:3300/0 conn(0x7f59c40d2f80 0x7f59c40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 >> v1:172.21.15.195:6789/0 conn(0x7f59c406eb70 legacy=0x7f59c4166c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c40b4a50 con 0x7f59c40cfe80 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f59c0001a10 con 0x7f59c40cfe80 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 >> v1:172.21.15.80:6789/0 conn(0x7f59c40cfe80 legacy=0x7f59c40d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59b0005bc0 0x7f59b0006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0006a10 0x7f59b0006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59b0007460 0x7f59b000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59b000e3c0 con 0x7f59b0007460 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f59b000e570 con 0x7f59b0006a10 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f59b000e770 con 0x7f59b0005bc0 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca83c640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59b0007460 0x7f59b000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59c983a640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0006a10 0x7f59b0006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca03b640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59b0005bc0 0x7f59b0006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca83c640 1 -- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59b0005bc0 msgr2=0x7f59b0006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca83c640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59b0005bc0 0x7f59b0006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca83c640 1 -- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0006a10 msgr2=0x7f59b0006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca83c640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0006a10 0x7f59b0006e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca83c640 1 -- 172.21.15.80:0/2072631688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b0005730 con 0x7f59b0007460 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.525+0000 7f59ca03b640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59b0005bc0 0x7f59b0006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.526+0000 7f59ca83c640 1 -- 172.21.15.80:0/2072631688 reap_dead start 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.526+0000 7f59ca83c640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59b0007460 0x7f59b000dbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f59bc001750 tx=0x7f59b0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e27ffb90f860ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.526+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc001370 con 0x7f59b0007460 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.526+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc005310 con 0x7f59b0007460 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.526+0000 7f59c9039640 1 -- 172.21.15.80:0/2072631688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc02abe0 con 0x7f59b0007460 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 -- 172.21.15.80:0/2072631688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59b0007460 msgr2=0x7f59b000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59b0007460 0x7f59b000dbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f59bc001750 tx=0x7f59b0007a40 comp rx=0 tx=0).stop 2024-04-25T15:44:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 -- 172.21.15.80:0/2072631688 shutdown_connections 2024-04-25T15:44:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 --2- 172.21.15.80:0/2072631688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59b0007460 0x7f59b000dbd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 -- 172.21.15.80:0/2072631688 >> 172.21.15.80:0/2072631688 conn(0x7f59c40b75f0 msgr2=0x7f59c40b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 -- 172.21.15.80:0/2072631688 shutdown_connections 2024-04-25T15:44:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.527+0000 7f59cc29f640 1 -- 172.21.15.80:0/2072631688 wait complete. 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.529+0000 7f59cc29f640 1 Processor -- start 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.529+0000 7f59cc29f640 1 -- start start 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59cc29f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0007460 0x7f59c41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59cc29f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59c4151a20 0x7f59c4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59cc29f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 0x7f59c415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59cc29f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40d2170 con 0x7f59c4159780 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59cc29f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40cf9d0 con 0x7f59b0007460 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59cc29f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f59c40d22f0 con 0x7f59c4151a20 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 0x7f59c415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 0x7f59c415ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39994/0 (socket says 172.21.15.80:39994) 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 -- 172.21.15.80:0/1818537187 learned_addr learned my addr 172.21.15.80:0/1818537187 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 -- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59c4151a20 msgr2=0x7f59c4159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59c4151a20 0x7f59c4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 -- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0007460 msgr2=0x7f59c41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca03b640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0007460 0x7f59c41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0007460 0x7f59c41512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.530+0000 7f59ca83c640 1 -- 172.21.15.80:0/1818537187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c41517f0 con 0x7f59c4159780 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.531+0000 7f59ca83c640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 0x7f59c415ad20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59bc02a590 tx=0x7f59bc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.531+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc001370 con 0x7f59c4159780 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.531+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc02ae20 con 0x7f59c4159780 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.531+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c415f0d0 con 0x7f59c4159780 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.531+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc007a30 con 0x7f59c4159780 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.531+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c415f690 con 0x7f59c4159780 2024-04-25T15:44:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.532+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c406a100 con 0x7f59c4159780 2024-04-25T15:44:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.532+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f59bc007030 con 0x7f59c4159780 2024-04-25T15:44:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.533+0000 7f59baffd640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59a80744b0 0x7f59a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.533+0000 7f59ca03b640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59a80744b0 0x7f59a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.533+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f59bc0b4a10 con 0x7f59c4159780 2024-04-25T15:44:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.533+0000 7f59ca03b640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59a80744b0 0x7f59a80769c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59c406f1e0 tx=0x7f59c0005f40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.538+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59bc07ee30 con 0x7f59c4159780 2024-04-25T15:44:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.713+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59c40b3390 con 0x7f59c4159780 2024-04-25T15:44:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.713+0000 7f59baffd640 1 -- 172.21.15.80:0/1818537187 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f59bc07e730 con 0x7f59c4159780 2024-04-25T15:44:00.715 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59a80744b0 msgr2=0x7f59a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59a80744b0 0x7f59a80769c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59c406f1e0 tx=0x7f59c0005f40 comp rx=0 tx=0).stop 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 msgr2=0x7f59c415ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 0x7f59c415ad20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59bc02a590 tx=0x7f59bc001120 comp rx=0 tx=0).stop 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 shutdown_connections 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59a80744b0 0x7f59a80769c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59c4159780 0x7f59c415ad20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59c4151a20 0x7f59c4159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 --2- 172.21.15.80:0/1818537187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0007460 0x7f59c41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 >> 172.21.15.80:0/1818537187 conn(0x7f59c40b75f0 msgr2=0x7f59c415cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 shutdown_connections 2024-04-25T15:44:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.715+0000 7f59cc29f640 1 -- 172.21.15.80:0/1818537187 wait complete. 2024-04-25T15:44:00.727 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:44:00.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.837+0000 7f363b996640 1 Processor -- start 2024-04-25T15:44:00.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.837+0000 7f363b996640 1 -- start start 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f363b996640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f363415e060 0x7f36340d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f363b996640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36340d0cd0 con 0x7f36340b2b80 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f363b996640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3634161b00 con 0x7f36340d08c0 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f363b996640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3634161dc0 con 0x7f363415e060 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f3639732640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f36340b2b80 0x7f36340cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55112/0 (socket says 172.21.15.80:55112) 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f3639732640 1 -- 172.21.15.80:0/2780895955 learned_addr learned my addr 172.21.15.80:0/2780895955 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.838+0000 7f3638f31640 1 --2- 172.21.15.80:0/2780895955 >> v2:172.21.15.195:3300/0 conn(0x7f363415e060 0x7f36340d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814368748 0 0) 0x7f36340d0cd0 con 0x7f36340b2b80 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3620003520 con 0x7f36340b2b80 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1048233046 0 0) 0x7f3620003520 con 0x7f36340b2b80 2024-04-25T15:44:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 >> v2:172.21.15.195:3300/0 conn(0x7f363415e060 msgr2=0x7f36340d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 --2- 172.21.15.80:0/2780895955 >> v2:172.21.15.195:3300/0 conn(0x7f363415e060 0x7f36340d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 >> v1:172.21.15.195:6789/0 conn(0x7f36340d08c0 legacy=0x7f36340d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36341620a0 con 0x7f36340b2b80 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f3630001690 con 0x7f36340b2b80 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 >> v1:172.21.15.80:6789/0 conn(0x7f36340b2b80 legacy=0x7f36340cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f3620003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3620004800 0x7f3620004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3620005250 0x7f362000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3634161dc0 con 0x7f36200039b0 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f362000c1e0 con 0x7f3620004800 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f362000c3e0 con 0x7f3620005250 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639732640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f3620003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3638f31640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3620004800 0x7f3620004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639f33640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3620005250 0x7f362000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639732640 1 -- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3620005250 msgr2=0x7f362000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639732640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3620005250 0x7f362000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639732640 1 -- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3620004800 msgr2=0x7f3620004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639732640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3620004800 0x7f3620004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639732640 1 -- 172.21.15.80:0/2780895955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3620003520 con 0x7f36200039b0 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3638f31640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3620004800 0x7f3620004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.839+0000 7f3639f33640 1 -- 172.21.15.80:0/2780895955 reap_dead start 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.840+0000 7f3639732640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f3620003e20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f363000c210 tx=0x7f3620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ac53167a55da2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.840+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630007d30 con 0x7f36200039b0 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.840+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36300058d0 con 0x7f36200039b0 2024-04-25T15:44:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.840+0000 7f362bfff640 1 -- 172.21.15.80:0/2780895955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630005ce0 con 0x7f36200039b0 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 -- 172.21.15.80:0/2780895955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 msgr2=0x7f3620003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f3620003e20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f363000c210 tx=0x7f3620005830 comp rx=0 tx=0).stop 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 -- 172.21.15.80:0/2780895955 shutdown_connections 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 --2- 172.21.15.80:0/2780895955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f3620003e20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 -- 172.21.15.80:0/2780895955 >> 172.21.15.80:0/2780895955 conn(0x7f36340b54a0 msgr2=0x7f36340b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 -- 172.21.15.80:0/2780895955 shutdown_connections 2024-04-25T15:44:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.841+0000 7f363b996640 1 -- 172.21.15.80:0/2780895955 wait complete. 2024-04-25T15:44:00.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.843+0000 7f363b996640 1 Processor -- start 2024-04-25T15:44:00.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.843+0000 7f363b996640 1 -- start start 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f363b996640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f36340c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f363b996640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340cb450 0x7f36340ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f363b996640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634161030 0x7f36340cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f363b996640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3634162940 con 0x7f36200039b0 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f363b996640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3634162660 con 0x7f3634161030 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f363b996640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f36340d0380 con 0x7f36340cb450 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f36340c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f36340c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40012/0 (socket says 172.21.15.80:40012) 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 -- 172.21.15.80:0/3344553264 learned_addr learned my addr 172.21.15.80:0/3344553264 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3638f31640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340cb450 0x7f36340ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639f33640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634161030 0x7f36340cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 -- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340cb450 msgr2=0x7f36340ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340cb450 0x7f36340ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 -- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634161030 msgr2=0x7f36340cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634161030 0x7f36340cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 -- 172.21.15.80:0/3344553264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36340cbbc0 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3638f31640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340cb450 0x7f36340ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639f33640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634161030 0x7f36340cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.844+0000 7f3639732640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f36340c9430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3630001990 tx=0x7f3634162270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.845+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630041030 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.845+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3630000ed0 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.845+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36340cbea0 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.845+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630038040 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.845+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36340cc460 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.846+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f363406a100 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.846+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3630044070 con 0x7f36200039b0 2024-04-25T15:44:00.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.847+0000 7f3629ffb640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36180744b0 0x7f36180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:00.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.847+0000 7f3638f31640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36180744b0 0x7f36180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:00.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.847+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f36300b5280 con 0x7f36200039b0 2024-04-25T15:44:00.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.847+0000 7f3638f31640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36180744b0 0x7f36180769c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36240090e0 tx=0x7f3624008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:00.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:00.852+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f363004b070 con 0x7f36200039b0 2024-04-25T15:44:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.027+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f36340d1c50 con 0x7f36200039b0 2024-04-25T15:44:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.027+0000 7f3629ffb640 1 -- 172.21.15.80:0/3344553264 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f363007f6a0 con 0x7f36200039b0 2024-04-25T15:44:01.029 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36180744b0 msgr2=0x7f36180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36180744b0 0x7f36180769c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36240090e0 tx=0x7f3624008040 comp rx=0 tx=0).stop 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 msgr2=0x7f36340c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f36340c9430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3630001990 tx=0x7f3634162270 comp rx=0 tx=0).stop 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 shutdown_connections 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36180744b0 0x7f36180769c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634161030 0x7f36340cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340cb450 0x7f36340ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 --2- 172.21.15.80:0/3344553264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36200039b0 0x7f36340c9430 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 >> 172.21.15.80:0/3344553264 conn(0x7f36340b54a0 msgr2=0x7f36340b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:01.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 shutdown_connections 2024-04-25T15:44:01.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.029+0000 7f363b996640 1 -- 172.21.15.80:0/3344553264 wait complete. 2024-04-25T15:44:01.042 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T15:44:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.151+0000 7fe8d0651640 1 Processor -- start 2024-04-25T15:44:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.151+0000 7fe8d0651640 1 -- start start 2024-04-25T15:44:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.152+0000 7fe8d0651640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8c80d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.152+0000 7fe8d0651640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c80d0cd0 con 0x7fe8c80b2b80 2024-04-25T15:44:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.152+0000 7fe8d0651640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8161b00 con 0x7fe8c80d08c0 2024-04-25T15:44:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.152+0000 7fe8d0651640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c8161dc0 con 0x7fe8c815e060 2024-04-25T15:44:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.152+0000 7fe8ce3ed640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe8c80b2b80 0x7fe8c80cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55122/0 (socket says 172.21.15.80:55122) 2024-04-25T15:44:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.152+0000 7fe8ce3ed640 1 -- 172.21.15.80:0/1226368236 learned_addr learned my addr 172.21.15.80:0/1226368236 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104189850 0 0) 0x7fe8c80d0cd0 con 0x7fe8c80b2b80 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b4003520 con 0x7fe8c80b2b80 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cdbec640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8c80d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2857241653 0 0) 0x7fe8b4003520 con 0x7fe8c80b2b80 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 msgr2=0x7fe8c80d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8c80d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 >> v1:172.21.15.195:6789/0 conn(0x7fe8c80d08c0 legacy=0x7fe8c80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c81620a0 con 0x7fe8c80b2b80 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe8c00019f0 con 0x7fe8c80b2b80 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 >> v1:172.21.15.80:6789/0 conn(0x7fe8c80b2b80 legacy=0x7fe8c80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b40039e0 0x7fe8b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b4004d90 0x7fe8b4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8161dc0 con 0x7fe8b40039e0 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b400bc60 con 0x7fe8b4004d90 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b400be60 con 0x7fe8c815e060 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b40039e0 0x7fe8b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cdbec640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cebee640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b4004d90 0x7fe8b4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8ce3ed640 1 -- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 msgr2=0x7fe8b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8ce3ed640 1 -- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b4004d90 msgr2=0x7fe8b4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b4004d90 0x7fe8b4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8ce3ed640 1 -- 172.21.15.80:0/1226368236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b4003520 con 0x7fe8b40039e0 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cdbec640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c815e060 0x7fe8b4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.153+0000 7fe8cebee640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b4004d90 0x7fe8b4005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.154+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b40039e0 0x7fe8b4003e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000a860 tx=0x7fe8b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ddd7fba5a7dd37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.154+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000a480 con 0x7fe8b40039e0 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.154+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c002f070 con 0x7fe8b40039e0 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.154+0000 7fe8cd3eb640 1 -- 172.21.15.80:0/1226368236 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c002bd00 con 0x7fe8b40039e0 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8d0651640 1 -- 172.21.15.80:0/1226368236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b40039e0 msgr2=0x7fe8b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1226368236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8b40039e0 0x7fe8b4003e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000a860 tx=0x7fe8b4005830 comp rx=0 tx=0).stop 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8cebee640 1 -- 172.21.15.80:0/1226368236 reap_dead start 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8d0651640 1 -- 172.21.15.80:0/1226368236 shutdown_connections 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8d0651640 1 -- 172.21.15.80:0/1226368236 >> 172.21.15.80:0/1226368236 conn(0x7fe8c80b54a0 msgr2=0x7fe8c80b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8d0651640 1 -- 172.21.15.80:0/1226368236 shutdown_connections 2024-04-25T15:44:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.155+0000 7fe8d0651640 1 -- 172.21.15.80:0/1226368236 wait complete. 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.157+0000 7fe8d0651640 1 Processor -- start 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.157+0000 7fe8d0651640 1 -- start start 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8d0651640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b40039e0 0x7fe8c80c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8d0651640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 0x7fe8c80cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8d0651640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c8158fc0 0x7fe8c81593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8d0651640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8162940 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8d0651640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8162660 con 0x7fe8b40039e0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8d0651640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c80d0380 con 0x7fe8c8158fc0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8cdbec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 0x7fe8c80cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8cdbec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 0x7fe8c80cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40024/0 (socket says 172.21.15.80:40024) 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8cdbec640 1 -- 172.21.15.80:0/1773217150 learned_addr learned my addr 172.21.15.80:0/1773217150 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b40039e0 0x7fe8c80c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8cebee640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c8158fc0 0x7fe8c81593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.158+0000 7fe8cdbec640 1 -- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c8158fc0 msgr2=0x7fe8c81593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8cdbec640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c8158fc0 0x7fe8c81593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8cdbec640 1 -- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b40039e0 msgr2=0x7fe8c80c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8cdbec640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b40039e0 0x7fe8c80c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8cdbec640 1 -- 172.21.15.80:0/1773217150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c8159910 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8cebee640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c8158fc0 0x7fe8c81593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8cdbec640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 0x7fe8c80cb810 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006a90 tx=0x7fe8b8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8019020 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b8014870 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c80c74a0 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8014c40 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.159+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c806dc50 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.160+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c806a100 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.160+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe8b801c020 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.161+0000 7fe8beffd640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8ac0744b0 0x7fe8ac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.161+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe8b8095c60 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.161+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8ac0744b0 0x7fe8ac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.161+0000 7fe8ce3ed640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8ac0744b0 0x7fe8ac0769c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0033000 tx=0x7fe8c0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.165+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe8b8023030 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.348+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe8c80d1c50 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.348+0000 7fe8beffd640 1 -- 172.21.15.80:0/1773217150 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe8c8159910 con 0x7fe8c80c9fd0 2024-04-25T15:44:01.349 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8ac0744b0 msgr2=0x7fe8ac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8ac0744b0 0x7fe8ac0769c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0033000 tx=0x7fe8c0009030 comp rx=0 tx=0).stop 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 msgr2=0x7fe8c80cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 0x7fe8c80cb810 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006a90 tx=0x7fe8b8004610 comp rx=0 tx=0).stop 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 shutdown_connections 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8ac0744b0 0x7fe8ac0769c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8c8158fc0 0x7fe8c81593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c80c9fd0 0x7fe8c80cb810 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 --2- 172.21.15.80:0/1773217150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8b40039e0 0x7fe8c80c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 >> 172.21.15.80:0/1773217150 conn(0x7fe8c80b54a0 msgr2=0x7fe8c8159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:01.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 shutdown_connections 2024-04-25T15:44:01.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.351+0000 7fe8d0651640 1 -- 172.21.15.80:0/1773217150 wait complete. 2024-04-25T15:44:01.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.470+0000 7f9ef264c640 1 Processor -- start 2024-04-25T15:44:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.470+0000 7f9ef264c640 1 -- start start 2024-04-25T15:44:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.471+0000 7f9ef264c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.471+0000 7f9ef264c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9eec071bb0 0x7f9eec0b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.471+0000 7f9ef264c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eec0b6eb0 con 0x7f9eec164690 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.471+0000 7f9ef264c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9eec0b7150 con 0x7f9eec071bb0 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.471+0000 7f9ef264c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec0b51e0 con 0x7f9eec0cfc40 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.471+0000 7f9ef0be9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9eec071bb0 0x7f9eec0b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9eec071bb0 0x7f9eec0b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40030/0 (socket says 172.21.15.80:40030) 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 -- 172.21.15.80:0/1321914061 learned_addr learned my addr 172.21.15.80:0/1321914061 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9eebfff640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 -- 172.21.15.80:0/1321914061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 msgr2=0x7f9eec160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 -- 172.21.15.80:0/1321914061 >> v1:172.21.15.195:6789/0 conn(0x7f9eec164690 legacy=0x7f9eec0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 -- 172.21.15.80:0/1321914061 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec0b54c0 con 0x7f9eec071bb0 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9eebfff640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.472+0000 7f9ef0be9640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec071bb0 0x7f9eec0b59e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009e50 tx=0x7f9ee402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313431a26e7d363e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9eeaffd640 1 -- 172.21.15.80:0/1321914061 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4036070 con 0x7f9eec071bb0 2024-04-25T15:44:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9eeaffd640 1 -- 172.21.15.80:0/1321914061 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee4031600 con 0x7f9eec071bb0 2024-04-25T15:44:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9eeaffd640 1 -- 172.21.15.80:0/1321914061 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40319d0 con 0x7f9eec071bb0 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 -- 172.21.15.80:0/1321914061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec071bb0 msgr2=0x7f9eec0b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec071bb0 0x7f9eec0b59e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009e50 tx=0x7f9ee402a630 comp rx=0 tx=0).stop 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 -- 172.21.15.80:0/1321914061 shutdown_connections 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec071bb0 0x7f9eec0b59e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 --2- 172.21.15.80:0/1321914061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 -- 172.21.15.80:0/1321914061 >> 172.21.15.80:0/1321914061 conn(0x7f9eec0d2080 msgr2=0x7f9eec0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 -- 172.21.15.80:0/1321914061 shutdown_connections 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.473+0000 7f9ef264c640 1 -- 172.21.15.80:0/1321914061 wait complete. 2024-04-25T15:44:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.475+0000 7f9ef264c640 1 Processor -- start 2024-04-25T15:44:01.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.475+0000 7f9ef264c640 1 -- start start 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.476+0000 7f9ef264c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.476+0000 7f9ef264c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec164690 0x7f9eec15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.476+0000 7f9ef264c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 0x7f9eec15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.476+0000 7f9ef264c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec0b6b70 con 0x7f9eec1501c0 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.476+0000 7f9ef264c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec072040 con 0x7f9eec164690 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.476+0000 7f9ef264c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec164aa0 con 0x7f9eec0cfc40 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 0x7f9eec15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 0x7f9eec15f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40036/0 (socket says 172.21.15.80:40036) 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 -- 172.21.15.80:0/473400940 learned_addr learned my addr 172.21.15.80:0/473400940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9eebfff640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9eeb7fe640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec164690 0x7f9eec15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 -- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 msgr2=0x7f9eec160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 -- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec164690 msgr2=0x7f9eec15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec164690 0x7f9eec15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 -- 172.21.15.80:0/473400940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec0ce0f0 con 0x7f9eec1501c0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9eeb7fe640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec164690 0x7f9eec15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef0be9640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 0x7f9eec15f420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009f70 tx=0x7f9ee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee403f020 con 0x7f9eec1501c0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee4037040 con 0x7f9eec1501c0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec160d70 con 0x7f9eec1501c0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4036070 con 0x7f9eec1501c0 2024-04-25T15:44:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.477+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec161330 con 0x7f9eec1501c0 2024-04-25T15:44:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.478+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eec06a100 con 0x7f9eec1501c0 2024-04-25T15:44:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.479+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9ee4042020 con 0x7f9eec1501c0 2024-04-25T15:44:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.479+0000 7f9ee8ff9640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9ed80744e0 0x7f9ed80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.479+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9ee40b58e0 con 0x7f9eec1501c0 2024-04-25T15:44:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.479+0000 7f9eebfff640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9ed80744e0 0x7f9ed80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.480+0000 7f9eebfff640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9ed80744e0 0x7f9ed80769f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00aac0 tx=0x7f9edc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.484+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ee4049070 con 0x7f9eec1501c0 2024-04-25T15:44:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.695+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eec072570 con 0x7f9eec1501c0 2024-04-25T15:44:01.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.695+0000 7f9ee8ff9640 1 -- 172.21.15.80:0/473400940 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f9ee407fc70 con 0x7f9eec1501c0 2024-04-25T15:44:01.697 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:01.697 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:44:01.697 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.697+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9ed80744e0 msgr2=0x7f9ed80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.697+0000 7f9ef264c640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9ed80744e0 0x7f9ed80769f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00aac0 tx=0x7f9edc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.697+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 msgr2=0x7f9eec15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.697+0000 7f9ef264c640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 0x7f9eec15f420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009f70 tx=0x7f9ee4004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 shutdown_connections 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9ed80744e0 0x7f9ed80769f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9eec1501c0 0x7f9eec15f420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec164690 0x7f9eec15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 --2- 172.21.15.80:0/473400940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eec0cfc40 0x7f9eec160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 >> 172.21.15.80:0/473400940 conn(0x7f9eec0d2080 msgr2=0x7f9eec0b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:01.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 shutdown_connections 2024-04-25T15:44:01.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.698+0000 7f9ef264c640 1 -- 172.21.15.80:0/473400940 wait complete. 2024-04-25T15:44:01.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:01.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.816+0000 7f6b47e84640 1 Processor -- start 2024-04-25T15:44:01.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.816+0000 7f6b47e84640 1 -- start start 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b47e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 0x7f6b4015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b47e84640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 0x7f6b40073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b47e84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b400703e0 con 0x7f6b4006fe10 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b47e84640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6b400affc0 con 0x7f6b400b65a0 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b47e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6b400b02a0 con 0x7f6b400b0d80 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b45c20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 0x7f6b4015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b4541f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 0x7f6b40073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b45c20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 0x7f6b4015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:34680/0 (socket says 172.21.15.80:34680) 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b45c20640 1 -- 172.21.15.80:0/254287888 learned_addr learned my addr 172.21.15.80:0/254287888 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b4541f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 0x7f6b40073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:50552/0 (socket says 172.21.15.80:50552) 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b45c20640 1 -- 172.21.15.80:0/254287888 >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 msgr2=0x7f6b40073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b45c20640 1 --2- 172.21.15.80:0/254287888 >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 0x7f6b40073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.818+0000 7f6b45c20640 1 -- 172.21.15.80:0/254287888 >> v1:172.21.15.195:6789/0 conn(0x7f6b4006fe10 legacy=0x7f6b40160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.819+0000 7f6b45c20640 1 -- 172.21.15.80:0/254287888 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b400b0580 con 0x7f6b400b0d80 2024-04-25T15:44:01.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.819+0000 7f6b4541f640 1 --2- 172.21.15.80:0/254287888 >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 0x7f6b40073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.819+0000 7f6b45c20640 1 --2- 172.21.15.80:0/254287888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 0x7f6b4015c670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009e50 tx=0x7f6b3c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab6aa6d7a0373dd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.819+0000 7f6b44c1e640 1 -- 172.21.15.80:0/254287888 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c036070 con 0x7f6b400b0d80 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.819+0000 7f6b44c1e640 1 -- 172.21.15.80:0/254287888 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c031600 con 0x7f6b400b0d80 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.819+0000 7f6b44c1e640 1 -- 172.21.15.80:0/254287888 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0319d0 con 0x7f6b400b0d80 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 -- 172.21.15.80:0/254287888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 msgr2=0x7f6b4015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 --2- 172.21.15.80:0/254287888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 0x7f6b4015c670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009e50 tx=0x7f6b3c02a710 comp rx=0 tx=0).stop 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 -- 172.21.15.80:0/254287888 shutdown_connections 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 --2- 172.21.15.80:0/254287888 >> v2:172.21.15.195:3300/0 conn(0x7f6b400b65a0 0x7f6b40073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 --2- 172.21.15.80:0/254287888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b400b0d80 0x7f6b4015c670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 -- 172.21.15.80:0/254287888 >> 172.21.15.80:0/254287888 conn(0x7f6b400d1e20 msgr2=0x7f6b40073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:01.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 -- 172.21.15.80:0/254287888 shutdown_connections 2024-04-25T15:44:01.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.820+0000 7f6b47e84640 1 -- 172.21.15.80:0/254287888 wait complete. 2024-04-25T15:44:01.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.822+0000 7f6b47e84640 1 Processor -- start 2024-04-25T15:44:01.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.822+0000 7f6b47e84640 1 -- start start 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b47e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b4006fe10 0x7f6b4014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b47e84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b400b0d80 0x7f6b4009b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b47e84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 0x7f6b4014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b47e84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40074070 con 0x7f6b400b65a0 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b47e84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400ae7c0 con 0x7f6b400b0d80 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b47e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6b400741f0 con 0x7f6b4006fe10 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b46421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 0x7f6b4014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b46421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 0x7f6b4014ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40050/0 (socket says 172.21.15.80:40050) 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.823+0000 7f6b46421640 1 -- 172.21.15.80:0/3497190161 learned_addr learned my addr 172.21.15.80:0/3497190161 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b45c20640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b4006fe10 0x7f6b4014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b4541f640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b400b0d80 0x7f6b4009b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b46421640 1 -- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b4006fe10 msgr2=0x7f6b4014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b46421640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b4006fe10 0x7f6b4014c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b46421640 1 -- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b400b0d80 msgr2=0x7f6b4009b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b46421640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b400b0d80 0x7f6b4009b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b46421640 1 -- 172.21.15.80:0/3497190161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b40149ca0 con 0x7f6b400b65a0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b46421640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 0x7f6b4014ad40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c3c0 tx=0x7f6b3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38017070 con 0x7f6b400b65a0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b380052d0 con 0x7f6b400b65a0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38003810 con 0x7f6b400b65a0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b40149f80 con 0x7f6b400b65a0 2024-04-25T15:44:01.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.824+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4014a540 con 0x7f6b400b65a0 2024-04-25T15:44:01.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.825+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4006a100 con 0x7f6b400b65a0 2024-04-25T15:44:01.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.826+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6b3801a070 con 0x7f6b400b65a0 2024-04-25T15:44:01.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.826+0000 7f6b367fc640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b240744b0 0x7f6b240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:01.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.826+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6b38094960 con 0x7f6b400b65a0 2024-04-25T15:44:01.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.826+0000 7f6b45c20640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b240744b0 0x7f6b240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:01.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.827+0000 7f6b45c20640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b240744b0 0x7f6b240769c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c033000 tx=0x7f6b3c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:01.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:01.831+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b3805ecf0 con 0x7f6b400b65a0 2024-04-25T15:44:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.009+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b4015bfd0 con 0x7f6b400b65a0 2024-04-25T15:44:02.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.010+0000 7f6b367fc640 1 -- 172.21.15.80:0/3497190161 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f6b3805e5f0 con 0x7f6b400b65a0 2024-04-25T15:44:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:02.012 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.012+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b240744b0 msgr2=0x7f6b240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b240744b0 0x7f6b240769c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c033000 tx=0x7f6b3c009000 comp rx=0 tx=0).stop 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 msgr2=0x7f6b4014ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 0x7f6b4014ad40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c3c0 tx=0x7f6b3800c880 comp rx=0 tx=0).stop 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 shutdown_connections 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b240744b0 0x7f6b240769c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b400b65a0 0x7f6b4014ad40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b400b0d80 0x7f6b4009b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 --2- 172.21.15.80:0/3497190161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b4006fe10 0x7f6b4014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 >> 172.21.15.80:0/3497190161 conn(0x7f6b400d1e20 msgr2=0x7f6b40158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:02.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 shutdown_connections 2024-04-25T15:44:02.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.013+0000 7f6b47e84640 1 -- 172.21.15.80:0/3497190161 wait complete. 2024-04-25T15:44:02.025 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:44:02.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:02.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.132+0000 7f6802b9d640 1 Processor -- start 2024-04-25T15:44:02.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.132+0000 7f6802b9d640 1 -- start start 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6802b9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f67fc0b34c0 0x7f67fc0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6802b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cd810 0x7f67fc0d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6802b9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67fc0ce240 con 0x7f67fc0cdc60 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6802b9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f67fc0b38d0 con 0x7f67fc0b34c0 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6802b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc0cc510 con 0x7f67fc0cd810 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6801b9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f67fc0cdc60 0x7f67fc0b1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55128/0 (socket says 172.21.15.80:55128) 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6801b9b640 1 -- 172.21.15.80:0/608611988 learned_addr learned my addr 172.21.15.80:0/608611988 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f680139a640 1 --2- 172.21.15.80:0/608611988 >> v2:172.21.15.195:3300/0 conn(0x7f67fc0b34c0 0x7f67fc0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f680239c640 1 --2- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cd810 0x7f67fc0d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.133+0000 7f6800b99640 1 -- 172.21.15.80:0/608611988 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064180958 0 0) 0x7f67fc0ce240 con 0x7f67fc0cdc60 2024-04-25T15:44:02.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.134+0000 7f6800b99640 1 -- 172.21.15.80:0/608611988 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e8003520 con 0x7f67fc0cdc60 2024-04-25T15:44:02.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.134+0000 7f680139a640 1 -- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cd810 msgr2=0x7f67fc0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:02.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.134+0000 7f680139a640 1 --2- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cd810 0x7f67fc0d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.134+0000 7f680139a640 1 -- 172.21.15.80:0/608611988 >> v1:172.21.15.80:6789/0 conn(0x7f67fc0cdc60 legacy=0x7f67fc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.134+0000 7f6800b99640 1 -- 172.21.15.80:0/608611988 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 831666058 0 0) 0x7f67e8003520 con 0x7f67fc0cdc60 2024-04-25T15:44:02.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.134+0000 7f680139a640 1 -- 172.21.15.80:0/608611988 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0cc7f0 con 0x7f67fc0b34c0 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f680139a640 1 --2- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc0cd2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0097a0 tx=0x7f67ec02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d51cd9035d66af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6800b99640 1 -- 172.21.15.80:0/608611988 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec037070 con 0x7f67fc0b34c0 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6800b99640 1 -- 172.21.15.80:0/608611988 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ec02ae50 con 0x7f67fc0b34c0 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6800b99640 1 -- 172.21.15.80:0/608611988 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec032640 con 0x7f67fc0b34c0 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6802b9d640 1 -- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 msgr2=0x7f67fc0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6802b9d640 1 --2- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc0cd2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0097a0 tx=0x7f67ec02a100 comp rx=0 tx=0).stop 2024-04-25T15:44:02.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6802b9d640 1 -- 172.21.15.80:0/608611988 shutdown_connections 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6802b9d640 1 --2- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cd810 0x7f67fc0d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6802b9d640 1 --2- 172.21.15.80:0/608611988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc0cd2d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.135+0000 7f6802b9d640 1 -- 172.21.15.80:0/608611988 >> 172.21.15.80:0/608611988 conn(0x7f67fc09b410 msgr2=0x7f67fc0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.136+0000 7f6802b9d640 1 -- 172.21.15.80:0/608611988 shutdown_connections 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.136+0000 7f6802b9d640 1 -- 172.21.15.80:0/608611988 wait complete. 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.137+0000 7f6802b9d640 1 Processor -- start 2024-04-25T15:44:02.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.137+0000 7f6802b9d640 1 -- start start 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.138+0000 7f6802b9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.138+0000 7f6802b9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 0x7f67fc1f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6802b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cdc60 0x7f67fc0ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6802b9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0b7690 con 0x7f67fc0cd810 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6802b9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0ccdb0 con 0x7f67fc0b34c0 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6802b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc0d2390 con 0x7f67fc0cdc60 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 0x7f67fc1f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 0x7f67fc1f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40066/0 (socket says 172.21.15.80:40066) 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 -- 172.21.15.80:0/1516177551 learned_addr learned my addr 172.21.15.80:0/1516177551 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6801b9b640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680239c640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cdc60 0x7f67fc0ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 -- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cdc60 msgr2=0x7f67fc0ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cdc60 0x7f67fc0ba370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 -- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 msgr2=0x7f67fc15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 -- 172.21.15.80:0/1516177551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0b8740 con 0x7f67fc0cd810 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f680139a640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 0x7f67fc1f4910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f67ec02a140 tx=0x7f67ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec041070 con 0x7f67fc0cd810 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ec03c460 con 0x7f67fc0cd810 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc0b8a20 con 0x7f67fc0cd810 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec037040 con 0x7f67fc0cd810 2024-04-25T15:44:02.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.139+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc0b8fe0 con 0x7f67fc0cd810 2024-04-25T15:44:02.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.141+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67fc0b8460 con 0x7f67fc0cd810 2024-04-25T15:44:02.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.141+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f67ec044070 con 0x7f67fc0cd810 2024-04-25T15:44:02.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.142+0000 7f67f27fc640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67e00744b0 0x7f67e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.142+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f67ec0b5be0 con 0x7f67fc0cd810 2024-04-25T15:44:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.142+0000 7f6801b9b640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67e00744b0 0x7f67e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.142+0000 7f6801b9b640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67e00744b0 0x7f67e00769c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f67fc074830 tx=0x7f67f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.146+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67ec07f920 con 0x7f67fc0cd810 2024-04-25T15:44:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.356+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67fc0cf2b0 con 0x7f67fc0cd810 2024-04-25T15:44:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.356+0000 7f67f27fc640 1 -- 172.21.15.80:0/1516177551 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f67ec083c20 con 0x7f67fc0cd810 2024-04-25T15:44:02.358 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:02.358 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:44:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67e00744b0 msgr2=0x7f67e00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67e00744b0 0x7f67e00769c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f67fc074830 tx=0x7f67f8009040 comp rx=0 tx=0).stop 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 msgr2=0x7f67fc1f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 0x7f67fc1f4910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f67ec02a140 tx=0x7f67ec0046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 shutdown_connections 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f67e00744b0 0x7f67e00769c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67fc0cdc60 0x7f67fc0ba370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67fc0cd810 0x7f67fc1f4910 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 --2- 172.21.15.80:0/1516177551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67fc0b34c0 0x7f67fc15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.358+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 >> 172.21.15.80:0/1516177551 conn(0x7f67fc09b410 msgr2=0x7f67fc070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:02.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.359+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 shutdown_connections 2024-04-25T15:44:02.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.359+0000 7f6802b9d640 1 -- 172.21.15.80:0/1516177551 wait complete. 2024-04-25T15:44:02.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:02.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.477+0000 7f95682b1640 1 Processor -- start 2024-04-25T15:44:02.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.477+0000 7f95682b1640 1 -- start start 2024-04-25T15:44:02.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f95682b1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95600b91b0 0x7f956006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f95682b1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600d1010 con 0x7f95600b3ac0 2024-04-25T15:44:02.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f95682b1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956009cdf0 con 0x7f95600d34a0 2024-04-25T15:44:02.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f95682b1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f956009d0d0 con 0x7f95600b91b0 2024-04-25T15:44:02.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956584c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95600b91b0 0x7f956006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956584c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95600b91b0 0x7f956006da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40076/0 (socket says 172.21.15.80:40076) 2024-04-25T15:44:02.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956584c640 1 -- 172.21.15.80:0/21769091 learned_addr learned my addr 172.21.15.80:0/21769091 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:02.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956684e640 1 --1- 172.21.15.80:0/21769091 >> v1:172.21.15.80:6789/0 conn(0x7f95600b3ac0 0x7f95600b3ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55136/0 (socket says 172.21.15.80:55136) 2024-04-25T15:44:02.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956584c640 1 -- 172.21.15.80:0/21769091 >> v1:172.21.15.195:6789/0 conn(0x7f95600d34a0 legacy=0x7f956006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956584c640 1 -- 172.21.15.80:0/21769091 >> v1:172.21.15.80:6789/0 conn(0x7f95600b3ac0 legacy=0x7f95600b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956584c640 1 -- 172.21.15.80:0/21769091 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956006ec70 con 0x7f95600b91b0 2024-04-25T15:44:02.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.479+0000 7f956504b640 1 -- 172.21.15.80:0/21769091 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706581517 0 0) 0x7f95600d1010 con 0x7f95600b3ac0 2024-04-25T15:44:02.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.480+0000 7f956584c640 1 --2- 172.21.15.80:0/21769091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b91b0 0x7f956006da90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9550009870 tx=0x7f955002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df6343465e3be20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.480+0000 7f956504b640 1 -- 172.21.15.80:0/21769091 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550037070 con 0x7f95600b91b0 2024-04-25T15:44:02.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.480+0000 7f956504b640 1 -- 172.21.15.80:0/21769091 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955002ae50 con 0x7f95600b91b0 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.480+0000 7f956504b640 1 -- 172.21.15.80:0/21769091 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550032860 con 0x7f95600b91b0 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 -- 172.21.15.80:0/21769091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b91b0 msgr2=0x7f956006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 --2- 172.21.15.80:0/21769091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b91b0 0x7f956006da90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9550009870 tx=0x7f955002a300 comp rx=0 tx=0).stop 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 -- 172.21.15.80:0/21769091 shutdown_connections 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 --2- 172.21.15.80:0/21769091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b91b0 0x7f956006da90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 -- 172.21.15.80:0/21769091 >> 172.21.15.80:0/21769091 conn(0x7f95600d0450 msgr2=0x7f95600d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 -- 172.21.15.80:0/21769091 shutdown_connections 2024-04-25T15:44:02.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.481+0000 7f95682b1640 1 -- 172.21.15.80:0/21769091 wait complete. 2024-04-25T15:44:02.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.482+0000 7f95682b1640 1 Processor -- start 2024-04-25T15:44:02.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.483+0000 7f95682b1640 1 -- start start 2024-04-25T15:44:02.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f95682b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 0x7f9560072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f95682b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95600b91b0 0x7f9560155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f95682b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95600d34a0 0x7f956009ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f95682b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f956006d7b0 con 0x7f95600b3ac0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f95682b1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f95600d12f0 con 0x7f95600b91b0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f95682b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95600b45e0 con 0x7f95600d34a0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 0x7f9560072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 0x7f9560072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40078/0 (socket says 172.21.15.80:40078) 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 -- 172.21.15.80:0/469225399 learned_addr learned my addr 172.21.15.80:0/469225399 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956584c640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95600b91b0 0x7f9560155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956684e640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95600d34a0 0x7f956009ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 -- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95600d34a0 msgr2=0x7f956009ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95600d34a0 0x7f956009ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 -- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95600b91b0 msgr2=0x7f9560155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95600b91b0 0x7f9560155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 -- 172.21.15.80:0/469225399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560072ec0 con 0x7f95600b3ac0 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956684e640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95600d34a0 0x7f956009ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f956604d640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 0x7f9560072980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f955c00c730 tx=0x7f955c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.484+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c003bc0 con 0x7f95600b3ac0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.485+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c003d80 con 0x7f95600b3ac0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.485+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95600b27e0 con 0x7f95600b3ac0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.485+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c00aa90 con 0x7f95600b3ac0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.485+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956009f490 con 0x7f95600b3ac0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.485+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95600507e0 con 0x7f95600b3ac0 2024-04-25T15:44:02.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.486+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f955c00ac30 con 0x7f95600b3ac0 2024-04-25T15:44:02.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.486+0000 7f9556ffd640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95440744e0 0x7f95440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.487+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f955c095440 con 0x7f95600b3ac0 2024-04-25T15:44:02.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.487+0000 7f956584c640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95440744e0 0x7f95440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.487+0000 7f956584c640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95440744e0 0x7f95440769f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9550034000 tx=0x7f955002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.491+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95600507e0 con 0x7f95600b3ac0 2024-04-25T15:44:02.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.702+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f956006a100 con 0x7f95600b3ac0 2024-04-25T15:44:02.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.703+0000 7f9556ffd640 1 -- 172.21.15.80:0/469225399 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f955c05f8f0 con 0x7f95600b3ac0 2024-04-25T15:44:02.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:02.704 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/174330336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":174330336},{"type":"v1","addr":"172.21.15.195:6835","nonce":174330336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1903462419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1903462419},{"type":"v1","addr":"172.21.15.80:6836","nonce":1903462419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2529807503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2529807503},{"type":"v1","addr":"172.21.15.80:6837","nonce":2529807503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:43:00.620270+0000","modified":"2024-04-25T15:43:22.730431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/1446733248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1446733248},{"type":"v1","addr":"172.21.15.195:6833","nonce":1446733248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T15:44:02.705 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T15:44:02.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95440744e0 msgr2=0x7f95440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95440744e0 0x7f95440769f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9550034000 tx=0x7f955002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:02.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 msgr2=0x7f9560072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 0x7f9560072980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f955c00c730 tx=0x7f955c00cbf0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 shutdown_connections 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95440744e0 0x7f95440769f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95600d34a0 0x7f956009ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95600b91b0 0x7f9560155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 --2- 172.21.15.80:0/469225399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95600b3ac0 0x7f9560072980 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 >> 172.21.15.80:0/469225399 conn(0x7f95600d0450 msgr2=0x7f95600d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 shutdown_connections 2024-04-25T15:44:02.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.705+0000 7f95682b1640 1 -- 172.21.15.80:0/469225399 wait complete. 2024-04-25T15:44:02.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:02.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.824+0000 7f1c4e0aa640 1 Processor -- start 2024-04-25T15:44:02.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.824+0000 7f1c4e0aa640 1 -- start start 2024-04-25T15:44:02.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c4e0aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c4815d120 0x7f1c480d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c4e0aa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1c480b2460 0x7f1c4806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c4e0aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c480d2540 con 0x7f1c480d2130 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c4e0aa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1c480c8b70 con 0x7f1c480b2460 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c4e0aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c480c86e0 con 0x7f1c4815d120 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c47fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1c480b2460 0x7f1c4806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c4815d120 0x7f1c480d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c46ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1c480d2130 0x7f1c480b1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:43034/0 (socket says 172.21.15.80:43034) 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c46ffd640 1 -- 172.21.15.80:0/1797863033 learned_addr learned my addr 172.21.15.80:0/1797863033 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c477fe640 1 -- 172.21.15.80:0/1797863033 >> v2:172.21.15.195:3300/0 conn(0x7f1c480b2460 msgr2=0x7f1c4806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c477fe640 1 --2- 172.21.15.80:0/1797863033 >> v2:172.21.15.195:3300/0 conn(0x7f1c480b2460 0x7f1c4806c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c477fe640 1 -- 172.21.15.80:0/1797863033 >> v1:172.21.15.195:6789/0 conn(0x7f1c480d2130 legacy=0x7f1c480b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.826+0000 7f1c467fc640 1 -- 172.21.15.80:0/1797863033 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577079019 0 0) 0x7f1c3c001110 con 0x7f1c480d2130 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.827+0000 7f1c477fe640 1 -- 172.21.15.80:0/1797863033 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c480b2980 con 0x7f1c4815d120 2024-04-25T15:44:02.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.827+0000 7f1c47fff640 1 --2- 172.21.15.80:0/1797863033 >> v2:172.21.15.195:3300/0 conn(0x7f1c480b2460 0x7f1c4806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.827+0000 7f1c477fe640 1 --2- 172.21.15.80:0/1797863033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c4815d120 0x7f1c480d1bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c380097a0 tx=0x7f1c3802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f1c33a38c9658a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.827+0000 7f1c467fc640 1 -- 172.21.15.80:0/1797863033 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38037070 con 0x7f1c4815d120 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c467fc640 1 -- 172.21.15.80:0/1797863033 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38032440 con 0x7f1c4815d120 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c467fc640 1 -- 172.21.15.80:0/1797863033 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38032810 con 0x7f1c4815d120 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/1797863033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c4815d120 msgr2=0x7f1c480d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/1797863033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c4815d120 0x7f1c480d1bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c380097a0 tx=0x7f1c3802a180 comp rx=0 tx=0).stop 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/1797863033 shutdown_connections 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/1797863033 >> v2:172.21.15.195:3300/0 conn(0x7f1c480b2460 0x7f1c4806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/1797863033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c4815d120 0x7f1c480d1bf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/1797863033 >> 172.21.15.80:0/1797863033 conn(0x7f1c4809b410 msgr2=0x7f1c480b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:02.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/1797863033 shutdown_connections 2024-04-25T15:44:02.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.828+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/1797863033 wait complete. 2024-04-25T15:44:02.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.830+0000 7f1c4e0aa640 1 Processor -- start 2024-04-25T15:44:02.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.830+0000 7f1c4e0aa640 1 -- start start 2024-04-25T15:44:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.831+0000 7f1c4e0aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c480b2460 0x7f1c480cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 0x7f1c480ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c4815d120 0x7f1c480ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1c480c8090 con 0x7f1c480d2130 2024-04-25T15:44:02.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1c480d2b50 con 0x7f1c4815d120 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c480c8370 con 0x7f1c480b2460 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 0x7f1c480ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 0x7f1c480ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40092/0 (socket says 172.21.15.80:40092) 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 -- 172.21.15.80:0/741665838 learned_addr learned my addr 172.21.15.80:0/741665838 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c477fe640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c480b2460 0x7f1c480cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c47fff640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c4815d120 0x7f1c480ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 -- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c480b2460 msgr2=0x7f1c480cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c480b2460 0x7f1c480cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 -- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c4815d120 msgr2=0x7f1c480ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c4815d120 0x7f1c480ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 -- 172.21.15.80:0/741665838 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c480cb6a0 con 0x7f1c480d2130 2024-04-25T15:44:02.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c46ffd640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 0x7f1c480ce350 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c410 tx=0x7f1c3c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0074e0 con 0x7f1c480d2130 2024-04-25T15:44:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0047e0 con 0x7f1c480d2130 2024-04-25T15:44:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c480cf3d0 con 0x7f1c480d2130 2024-04-25T15:44:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c004c10 con 0x7f1c480d2130 2024-04-25T15:44:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.832+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c48155730 con 0x7f1c480d2130 2024-04-25T15:44:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.833+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4806a100 con 0x7f1c480d2130 2024-04-25T15:44:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.834+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c3c011070 con 0x7f1c480d2130 2024-04-25T15:44:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.834+0000 7f1c2ffff640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c340744e0 0x7f1c340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.834+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1c3c095130 con 0x7f1c480d2130 2024-04-25T15:44:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.835+0000 7f1c477fe640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c340744e0 0x7f1c340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.835+0000 7f1c477fe640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c340744e0 0x7f1c340769f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c38034000 tx=0x7f1c3802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:02.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:02.839+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c480cb6a0 con 0x7f1c480d2130 2024-04-25T15:44:03.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.015+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c480744f0 con 0x7f1c480d2130 2024-04-25T15:44:03.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.016+0000 7f1c2ffff640 1 -- 172.21.15.80:0/741665838 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18834 (secure 0 0 0) 0x7f1c480d2540 con 0x7f1c480d2130 2024-04-25T15:44:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:03.018 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:43:42.447763+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:42:59.206260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:42:59.570541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T15:43:03.294408+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c340744e0 msgr2=0x7f1c340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c340744e0 0x7f1c340769f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c38034000 tx=0x7f1c3802e000 comp rx=0 tx=0).stop 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 msgr2=0x7f1c480ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 0x7f1c480ce350 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c410 tx=0x7f1c3c00c810 comp rx=0 tx=0).stop 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 shutdown_connections 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c340744e0 0x7f1c340769f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c4815d120 0x7f1c480ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c480d2130 0x7f1c480ce350 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 --2- 172.21.15.80:0/741665838 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c480b2460 0x7f1c480cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 >> 172.21.15.80:0/741665838 conn(0x7f1c4809b410 msgr2=0x7f1c480cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.018+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 shutdown_connections 2024-04-25T15:44:03.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.019+0000 7f1c4e0aa640 1 -- 172.21.15.80:0/741665838 wait complete. 2024-04-25T15:44:03.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:44:03.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.138+0000 7f42c9427640 1 Processor -- start 2024-04-25T15:44:03.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.138+0000 7f42c9427640 1 -- start start 2024-04-25T15:44:03.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c9427640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42c40d12e0 0x7f42c40d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c9427640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c40b9620 con 0x7f42c41604b0 2024-04-25T15:44:03.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c9427640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c40d1930 con 0x7f42c40b7de0 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c9427640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f42c40d16f0 con 0x7f42c40d12e0 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c2ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42c40d12e0 0x7f42c40d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c27fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42c41604b0 0x7f42c40b76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55138/0 (socket says 172.21.15.80:55138) 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c27fc640 1 -- 172.21.15.80:0/2728523607 learned_addr learned my addr 172.21.15.80:0/2728523607 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c2ffd640 1 -- 172.21.15.80:0/2728523607 >> v1:172.21.15.195:6789/0 conn(0x7f42c40b7de0 legacy=0x7f42c40ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c2ffd640 1 -- 172.21.15.80:0/2728523607 >> v1:172.21.15.80:6789/0 conn(0x7f42c41604b0 legacy=0x7f42c40b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.140+0000 7f42c2ffd640 1 -- 172.21.15.80:0/2728523607 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c40b98a0 con 0x7f42c40d12e0 2024-04-25T15:44:03.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.141+0000 7f42c2ffd640 1 --2- 172.21.15.80:0/2728523607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c40d12e0 0x7f42c40d4230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42b40097a0 tx=0x7f42b402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc283fbf7c4540a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:03.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.141+0000 7f42c1ffb640 1 -- 172.21.15.80:0/2728523607 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4037070 con 0x7f42c40d12e0 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.141+0000 7f42c1ffb640 1 -- 172.21.15.80:0/2728523607 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b402ae50 con 0x7f42c40d12e0 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.141+0000 7f42c1ffb640 1 -- 172.21.15.80:0/2728523607 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4032660 con 0x7f42c40d12e0 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 -- 172.21.15.80:0/2728523607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c40d12e0 msgr2=0x7f42c40d4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 --2- 172.21.15.80:0/2728523607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c40d12e0 0x7f42c40d4230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42b40097a0 tx=0x7f42b402a140 comp rx=0 tx=0).stop 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 -- 172.21.15.80:0/2728523607 shutdown_connections 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 --2- 172.21.15.80:0/2728523607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c40d12e0 0x7f42c40d4230 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 -- 172.21.15.80:0/2728523607 >> 172.21.15.80:0/2728523607 conn(0x7f42c406e7c0 msgr2=0x7f42c406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 -- 172.21.15.80:0/2728523607 shutdown_connections 2024-04-25T15:44:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.142+0000 7f42c9427640 1 -- 172.21.15.80:0/2728523607 wait complete. 2024-04-25T15:44:03.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.144+0000 7f42c9427640 1 Processor -- start 2024-04-25T15:44:03.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.144+0000 7f42c9427640 1 -- start start 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c9427640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42c40d12e0 0x7f42c41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c9427640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42c41604b0 0x7f42c41e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c9427640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 0x7f42c4146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c9427640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f42c40b9e60 con 0x7f42c41e9170 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c9427640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f42c40d1c50 con 0x7f42c40d12e0 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c9427640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42c41608c0 con 0x7f42c41604b0 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 0x7f42c4146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 0x7f42c4146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40102/0 (socket says 172.21.15.80:40102) 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 -- 172.21.15.80:0/3687177020 learned_addr learned my addr 172.21.15.80:0/3687177020 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c2ffd640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42c40d12e0 0x7f42c41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c27fc640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42c41604b0 0x7f42c41e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 -- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42c41604b0 msgr2=0x7f42c41e8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42c41604b0 0x7f42c41e8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 -- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42c40d12e0 msgr2=0x7f42c41533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42c40d12e0 0x7f42c41533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.145+0000 7f42c37fe640 1 -- 172.21.15.80:0/3687177020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c41531a0 con 0x7f42c41e9170 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.146+0000 7f42c37fe640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 0x7f42c4146940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00b9a0 tx=0x7f42bc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.146+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc019070 con 0x7f42c41e9170 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.146+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42bc00cba0 con 0x7f42c41e9170 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.146+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc014440 con 0x7f42c41e9170 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.146+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c41554b0 con 0x7f42c41e9170 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.146+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c4155a70 con 0x7f42c41e9170 2024-04-25T15:44:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.147+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c406a100 con 0x7f42c41e9170 2024-04-25T15:44:03.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.148+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f42bc01c070 con 0x7f42c41e9170 2024-04-25T15:44:03.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.148+0000 7f42ab7fe640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42b00744b0 0x7f42b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.148+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f42bc095270 con 0x7f42c41e9170 2024-04-25T15:44:03.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.148+0000 7f42c2ffd640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42b00744b0 0x7f42b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.149+0000 7f42c2ffd640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42b00744b0 0x7f42b00769c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f42b4034000 tx=0x7f42b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:03.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.153+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42bc05f690 con 0x7f42c41e9170 2024-04-25T15:44:03.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:03.303 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:03.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.368+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f42c4155240 con 0x7f42c41e9170 2024-04-25T15:44:03.370 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:44:03.369+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:44:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.371+0000 7f42ab7fe640 1 -- 172.21.15.80:0/3687177020 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f42bc05ef90 con 0x7f42c41e9170 2024-04-25T15:44:03.372 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.373+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42b00744b0 msgr2=0x7f42b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.373+0000 7f42c9427640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42b00744b0 0x7f42b00769c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f42b4034000 tx=0x7f42b402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.373+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 msgr2=0x7f42c4146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.373+0000 7f42c9427640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 0x7f42c4146940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00b9a0 tx=0x7f42bc00be60 comp rx=0 tx=0).stop 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 shutdown_connections 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42b00744b0 0x7f42b00769c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42c41e9170 0x7f42c4146940 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f42c41604b0 0x7f42c41e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 --2- 172.21.15.80:0/3687177020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42c40d12e0 0x7f42c41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 >> 172.21.15.80:0/3687177020 conn(0x7f42c406e7c0 msgr2=0x7f42c40d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:03.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 shutdown_connections 2024-04-25T15:44:03.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.374+0000 7f42c9427640 1 -- 172.21.15.80:0/3687177020 wait complete. 2024-04-25T15:44:03.380 INFO:tasks.ceph.mds.b.smithi195.stderr: -5371> 2024-04-25T15:43:05.720+0000 7f22ea223640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:44:03.387 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:44:03.437 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:44:03.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.538+0000 7f62a9ce0640 1 Processor -- start 2024-04-25T15:44:03.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.538+0000 7f62a9ce0640 1 -- start start 2024-04-25T15:44:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a9ce0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62a40cf2f0 0x7f62a40d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a9ce0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a406ece0 0x7f62a40b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a9ce0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f62a40b3ae0 0x7f62a40d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a9ce0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f62a406cab0 con 0x7f62a40cf2f0 2024-04-25T15:44:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a9ce0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f62a40d1f10 con 0x7f62a40b3ae0 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a9ce0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62a40d02c0 con 0x7f62a406ece0 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62a40cf2f0 0x7f62a40d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62a40cf2f0 0x7f62a40d19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40106/0 (socket says 172.21.15.80:40106) 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a37fe640 1 -- 172.21.15.80:0/950928454 learned_addr learned my addr 172.21.15.80:0/950928454 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.539+0000 7f62a3fff640 1 --2- 172.21.15.80:0/950928454 >> v2:172.21.15.195:3300/0 conn(0x7f62a40b3ae0 0x7f62a40d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a2ffd640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a406ece0 0x7f62a40b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a37fe640 1 -- 172.21.15.80:0/950928454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a406ece0 msgr2=0x7f62a40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a37fe640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a406ece0 0x7f62a40b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a37fe640 1 -- 172.21.15.80:0/950928454 >> v2:172.21.15.195:3300/0 conn(0x7f62a40b3ae0 msgr2=0x7f62a40d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a37fe640 1 --2- 172.21.15.80:0/950928454 >> v2:172.21.15.195:3300/0 conn(0x7f62a40b3ae0 0x7f62a40d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a37fe640 1 -- 172.21.15.80:0/950928454 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a40b3ef0 con 0x7f62a40cf2f0 2024-04-25T15:44:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a3fff640 1 --2- 172.21.15.80:0/950928454 >> v2:172.21.15.195:3300/0 conn(0x7f62a40b3ae0 0x7f62a40d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a2ffd640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a406ece0 0x7f62a40b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a37fe640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a40cf2f0 0x7f62a40d19d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b8960 tx=0x7f629802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b8be353cbcb1d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.540+0000 7f62a27fc640 1 -- 172.21.15.80:0/950928454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298037070 con 0x7f62a40cf2f0 2024-04-25T15:44:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a27fc640 1 -- 172.21.15.80:0/950928454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6298032440 con 0x7f62a40cf2f0 2024-04-25T15:44:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a27fc640 1 -- 172.21.15.80:0/950928454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298032810 con 0x7f62a40cf2f0 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 -- 172.21.15.80:0/950928454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a40cf2f0 msgr2=0x7f62a40d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a40cf2f0 0x7f62a40d19d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b8960 tx=0x7f629802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 -- 172.21.15.80:0/950928454 shutdown_connections 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/950928454 >> v2:172.21.15.195:3300/0 conn(0x7f62a40b3ae0 0x7f62a40d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a406ece0 0x7f62a40b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/950928454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a40cf2f0 0x7f62a40d19d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 -- 172.21.15.80:0/950928454 >> 172.21.15.80:0/950928454 conn(0x7f62a40b75f0 msgr2=0x7f62a40b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 -- 172.21.15.80:0/950928454 shutdown_connections 2024-04-25T15:44:03.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.541+0000 7f62a9ce0640 1 -- 172.21.15.80:0/950928454 wait complete. 2024-04-25T15:44:03.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.543+0000 7f62a9ce0640 1 Processor -- start 2024-04-25T15:44:03.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.543+0000 7f62a9ce0640 1 -- start start 2024-04-25T15:44:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.544+0000 7f62a9ce0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 0x7f62a40b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.544+0000 7f62a9ce0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40b3ae0 0x7f62a40b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.544+0000 7f62a9ce0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a40cf2f0 0x7f62a4159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.544+0000 7f62a9ce0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62a406c740 con 0x7f62a406ece0 2024-04-25T15:44:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.544+0000 7f62a9ce0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62a40d2440 con 0x7f62a40b3ae0 2024-04-25T15:44:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.544+0000 7f62a9ce0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62a40d2db0 con 0x7f62a40cf2f0 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 0x7f62a40b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 0x7f62a40b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40116/0 (socket says 172.21.15.80:40116) 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 -- 172.21.15.80:0/624102396 learned_addr learned my addr 172.21.15.80:0/624102396 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a2ffd640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40b3ae0 0x7f62a40b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a3fff640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a40cf2f0 0x7f62a4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 -- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a40cf2f0 msgr2=0x7f62a4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a40cf2f0 0x7f62a4159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 -- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40b3ae0 msgr2=0x7f62a40b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40b3ae0 0x7f62a40b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 -- 172.21.15.80:0/624102396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a40c6ec0 con 0x7f62a406ece0 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a2ffd640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40b3ae0 0x7f62a40b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a37fe640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 0x7f62a40b0d70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6298000c00 tx=0x7f62980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298041020 con 0x7f62a406ece0 2024-04-25T15:44:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62980306c0 con 0x7f62a406ece0 2024-04-25T15:44:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a40c8870 con 0x7f62a406ece0 2024-04-25T15:44:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298037040 con 0x7f62a406ece0 2024-04-25T15:44:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.545+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a415a210 con 0x7f62a406ece0 2024-04-25T15:44:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.546+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a406a100 con 0x7f62a406ece0 2024-04-25T15:44:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.547+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6298044020 con 0x7f62a406ece0 2024-04-25T15:44:03.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.547+0000 7f628bfff640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62900744b0 0x7f62900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:03.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.547+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f62980b5ea0 con 0x7f62a406ece0 2024-04-25T15:44:03.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.547+0000 7f62a2ffd640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62900744b0 0x7f62900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:03.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.548+0000 7f62a2ffd640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62900744b0 0x7f62900769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b2c90 tx=0x7f6294008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:03.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.552+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f629804b030 con 0x7f62a406ece0 2024-04-25T15:44:03.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:03.765+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f62a415a440 con 0x7f62a406ece0 2024-04-25T15:44:04.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.372+0000 7f628bfff640 1 -- 172.21.15.80:0/624102396 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f62a40b3ef0 con 0x7f62a406ece0 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62900744b0 msgr2=0x7f62900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62900744b0 0x7f62900769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b2c90 tx=0x7f6294008040 comp rx=0 tx=0).stop 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 msgr2=0x7f62a40b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 0x7f62a40b0d70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6298000c00 tx=0x7f62980046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 shutdown_connections 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62900744b0 0x7f62900769c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.374+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62a40cf2f0 0x7f62a4159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.375+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40b3ae0 0x7f62a40b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.375+0000 7f62a9ce0640 1 --2- 172.21.15.80:0/624102396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62a406ece0 0x7f62a40b0d70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.375+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 >> 172.21.15.80:0/624102396 conn(0x7f62a40b75f0 msgr2=0x7f62a4070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.375+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 shutdown_connections 2024-04-25T15:44:04.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.375+0000 7f62a9ce0640 1 -- 172.21.15.80:0/624102396 wait complete. 2024-04-25T15:44:04.389 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:44:04.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.501+0000 7f9f1f1e3640 1 Processor -- start 2024-04-25T15:44:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.501+0000 7f9f1f1e3640 1 -- start start 2024-04-25T15:44:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1f1e3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9f180b0d80 0x7f9f1815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1f1e3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f180b65a0 0x7f9f18073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1f1e3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f180703e0 con 0x7f9f1806fe10 2024-04-25T15:44:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1f1e3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9f180affc0 con 0x7f9f180b65a0 2024-04-25T15:44:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1f1e3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9f180b02a0 con 0x7f9f180b0d80 2024-04-25T15:44:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f17fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f180b65a0 0x7f9f18073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f17fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f180b65a0 0x7f9f18073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42358/0 (socket says 172.21.15.80:42358) 2024-04-25T15:44:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f17fff640 1 -- 172.21.15.80:0/2461957695 learned_addr learned my addr 172.21.15.80:0/2461957695 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1d780640 1 --1- 172.21.15.80:0/2461957695 >> v1:172.21.15.80:6789/0 conn(0x7f9f1806fe10 0x7f9f18160220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40812/0 (socket says 172.21.15.80:40812) 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.503+0000 7f9f1cf7f640 1 --2- 172.21.15.80:0/2461957695 >> v2:172.21.15.195:3300/0 conn(0x7f9f180b0d80 0x7f9f1815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f17fff640 1 -- 172.21.15.80:0/2461957695 >> v2:172.21.15.195:3300/0 conn(0x7f9f180b0d80 msgr2=0x7f9f1815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f17fff640 1 --2- 172.21.15.80:0/2461957695 >> v2:172.21.15.195:3300/0 conn(0x7f9f180b0d80 0x7f9f1815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f17fff640 1 -- 172.21.15.80:0/2461957695 >> v1:172.21.15.80:6789/0 conn(0x7f9f1806fe10 legacy=0x7f9f18160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f17fff640 1 -- 172.21.15.80:0/2461957695 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f180b0580 con 0x7f9f180b65a0 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f177fe640 1 -- 172.21.15.80:0/2461957695 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899801954 0 0) 0x7f9f180703e0 con 0x7f9f1806fe10 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f17fff640 1 --2- 172.21.15.80:0/2461957695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b65a0 0x7f9f18073b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9f18070a20 tx=0x7f9f0c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef58e2dfac00813 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f177fe640 1 -- 172.21.15.80:0/2461957695 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c036020 con 0x7f9f180b65a0 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f177fe640 1 -- 172.21.15.80:0/2461957695 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c032640 con 0x7f9f180b65a0 2024-04-25T15:44:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.504+0000 7f9f177fe640 1 -- 172.21.15.80:0/2461957695 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c032a10 con 0x7f9f180b65a0 2024-04-25T15:44:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/2461957695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b65a0 msgr2=0x7f9f18073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/2461957695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b65a0 0x7f9f18073b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9f18070a20 tx=0x7f9f0c02c940 comp rx=0 tx=0).stop 2024-04-25T15:44:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/2461957695 shutdown_connections 2024-04-25T15:44:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/2461957695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b65a0 0x7f9f18073b30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/2461957695 >> v2:172.21.15.195:3300/0 conn(0x7f9f180b0d80 0x7f9f1815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/2461957695 >> 172.21.15.80:0/2461957695 conn(0x7f9f180d1e20 msgr2=0x7f9f18073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/2461957695 shutdown_connections 2024-04-25T15:44:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.505+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/2461957695 wait complete. 2024-04-25T15:44:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.507+0000 7f9f1f1e3640 1 Processor -- start 2024-04-25T15:44:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.507+0000 7f9f1f1e3640 1 -- start start 2024-04-25T15:44:04.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f1f1e3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9f1806fe10 0x7f9f18157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f1f1e3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 0x7f9f18157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f1f1e3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f180b65a0 0x7f9f1809d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f1f1e3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18074070 con 0x7f9f180b0d80 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f1f1e3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9f180ae7c0 con 0x7f9f180b65a0 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f1f1e3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9f180741f0 con 0x7f9f1806fe10 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.508+0000 7f9f17fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 0x7f9f18157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 0x7f9f18157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42370/0 (socket says 172.21.15.80:42370) 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 -- 172.21.15.80:0/202293785 learned_addr learned my addr 172.21.15.80:0/202293785 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f1d780640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f180b65a0 0x7f9f1809d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f1cf7f640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9f1806fe10 0x7f9f18157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 -- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9f1806fe10 msgr2=0x7f9f18157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:04.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9f1806fe10 0x7f9f18157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 -- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f180b65a0 msgr2=0x7f9f1809d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f180b65a0 0x7f9f1809d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 -- 172.21.15.80:0/202293785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f181576c0 con 0x7f9f180b0d80 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f17fff640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 0x7f9f18157bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c02c980 tx=0x7f9f0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c036040 con 0x7f9f180b0d80 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c03bbe0 con 0x7f9f180b0d80 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f18158110 con 0x7f9f180b0d80 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0453f0 con 0x7f9f180b0d80 2024-04-25T15:44:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.509+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1815e9b0 con 0x7f9f180b0d80 2024-04-25T15:44:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.510+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1806a100 con 0x7f9f180b0d80 2024-04-25T15:44:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.511+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9f0c039020 con 0x7f9f180b0d80 2024-04-25T15:44:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.511+0000 7f9f157fa640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f040744b0 0x7f9f040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.511+0000 7f9f1cf7f640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f040744b0 0x7f9f040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.511+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f9f0c0b85f0 con 0x7f9f180b0d80 2024-04-25T15:44:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.512+0000 7f9f1cf7f640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f040744b0 0x7f9f040769c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f180b1240 tx=0x7f9f08009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.516+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f181576c0 con 0x7f9f180b0d80 2024-04-25T15:44:04.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:04.691+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f18068cd0 con 0x7f9f180b0d80 2024-04-25T15:44:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.537+0000 7f9f157fa640 1 -- 172.21.15.80:0/202293785 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f9f0c040070 con 0x7f9f180b0d80 2024-04-25T15:44:05.541 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:44:05.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.542+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f040744b0 msgr2=0x7f9f040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.542+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f040744b0 0x7f9f040769c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f180b1240 tx=0x7f9f08009190 comp rx=0 tx=0).stop 2024-04-25T15:44:05.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.542+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 msgr2=0x7f9f18157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.542+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 0x7f9f18157bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c02c980 tx=0x7f9f0c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 shutdown_connections 2024-04-25T15:44:05.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f040744b0 0x7f9f040769c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f180b65a0 0x7f9f1809d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f180b0d80 0x7f9f18157bd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 --2- 172.21.15.80:0/202293785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9f1806fe10 0x7f9f18157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 >> 172.21.15.80:0/202293785 conn(0x7f9f180d1e20 msgr2=0x7f9f1815ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:05.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 shutdown_connections 2024-04-25T15:44:05.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.544+0000 7f9f1f1e3640 1 -- 172.21.15.80:0/202293785 wait complete. 2024-04-25T15:44:05.562 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:44:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.680+0000 7f6393164640 1 Processor -- start 2024-04-25T15:44:05.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.680+0000 7f6393164640 1 -- start start 2024-04-25T15:44:05.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6393164640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f638c0b7230 0x7f638c09ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6393164640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c0b9350 con 0x7f638c0cff30 2024-04-25T15:44:05.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6393164640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c0cf890 con 0x7f638c0b2a40 2024-04-25T15:44:05.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6393164640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f638c0cfb70 con 0x7f638c0b7230 2024-04-25T15:44:05.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6390f00640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f638c0cff30 0x7f638c0d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40824/0 (socket says 172.21.15.80:40824) 2024-04-25T15:44:05.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6390f00640 1 -- 172.21.15.80:0/3579543014 learned_addr learned my addr 172.21.15.80:0/3579543014 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f6391701640 1 --2- 172.21.15.80:0/3579543014 >> v2:172.21.15.195:3300/0 conn(0x7f638c0b7230 0x7f638c09ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025213421 0 0) 0x7f638c0b9350 con 0x7f638c0cff30 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6374003520 con 0x7f638c0cff30 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.682+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2518363607 0 0) 0x7f6374003520 con 0x7f638c0cff30 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 >> v2:172.21.15.195:3300/0 conn(0x7f638c0b7230 msgr2=0x7f638c09ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 --2- 172.21.15.80:0/3579543014 >> v2:172.21.15.195:3300/0 conn(0x7f638c0b7230 0x7f638c09ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 >> v1:172.21.15.195:6789/0 conn(0x7f638c0b2a40 legacy=0x7f638c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c0d2830 con 0x7f638c0cff30 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f637c0017f0 con 0x7f638c0cff30 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f6391701640 1 --2- 172.21.15.80:0/3579543014 >> v2:172.21.15.195:3300/0 conn(0x7f638c0b7230 0x7f638c09ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 >> v1:172.21.15.80:6789/0 conn(0x7f638c0cff30 legacy=0x7f638c0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63740039b0 0x7f6374003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f6374004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6374005270 0x7f637400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f638c0cfb70 con 0x7f6374004800 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f637400c190 con 0x7f6374005270 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f637400c390 con 0x7f63740039b0 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638bfff640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f6374004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f6390f00640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63740039b0 0x7f6374003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f6391701640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6374005270 0x7f637400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638bfff640 1 -- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63740039b0 msgr2=0x7f6374003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638bfff640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63740039b0 0x7f6374003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638bfff640 1 -- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6374005270 msgr2=0x7f637400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638bfff640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6374005270 0x7f637400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f6391701640 1 -- 172.21.15.80:0/3579543014 reap_dead start 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.683+0000 7f638bfff640 1 -- 172.21.15.80:0/3579543014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6374003520 con 0x7f6374004800 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.684+0000 7f638bfff640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f6374004c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f638c0740f0 tx=0x7f6374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442f0357c4515fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.684+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380037070 con 0x7f6374004800 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.684+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638002ab90 con 0x7f6374004800 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.684+0000 7f638b7fe640 1 -- 172.21.15.80:0/3579543014 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380001430 con 0x7f6374004800 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 -- 172.21.15.80:0/3579543014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 msgr2=0x7f6374004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f6374004c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f638c0740f0 tx=0x7f6374005830 comp rx=0 tx=0).stop 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 -- 172.21.15.80:0/3579543014 shutdown_connections 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 --2- 172.21.15.80:0/3579543014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f6374004c10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 -- 172.21.15.80:0/3579543014 >> 172.21.15.80:0/3579543014 conn(0x7f638c0d0450 msgr2=0x7f638c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 -- 172.21.15.80:0/3579543014 shutdown_connections 2024-04-25T15:44:05.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.685+0000 7f6393164640 1 -- 172.21.15.80:0/3579543014 wait complete. 2024-04-25T15:44:05.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.686+0000 7f6393164640 1 Processor -- start 2024-04-25T15:44:05.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.686+0000 7f6393164640 1 -- start start 2024-04-25T15:44:05.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6393164640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f638c1e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6393164640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f638c153990 0x7f638c158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6393164640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f638c153da0 0x7f638c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6393164640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f638c0d10f0 con 0x7f6374004800 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6393164640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f638c0d0f70 con 0x7f638c153da0 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6393164640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f638c09ce90 con 0x7f638c153990 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f638c1e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f638c1e9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42390/0 (socket says 172.21.15.80:42390) 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 -- 172.21.15.80:0/295567567 learned_addr learned my addr 172.21.15.80:0/295567567 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f638bfff640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f638c153990 0x7f638c158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6391701640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f638c153da0 0x7f638c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 -- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f638c153990 msgr2=0x7f638c158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f638c153990 0x7f638c158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 -- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f638c153da0 msgr2=0x7f638c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f638c153da0 0x7f638c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 -- 172.21.15.80:0/295567567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c1e8b50 con 0x7f6374004800 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f6390f00640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f638c1e9bb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f637c0010e0 tx=0x7f637c00fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.688+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0070d0 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.689+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637c018070 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.689+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0074d0 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.689+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c1e8df0 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.689+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c1e93b0 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.689+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c06a100 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.690+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f637c0059b0 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.691+0000 7f63897fa640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63780744e0 0x7f63780769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.691+0000 7f638bfff640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63780744e0 0x7f63780769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.691+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7f637c095630 con 0x7f6374004800 2024-04-25T15:44:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.691+0000 7f638bfff640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63780744e0 0x7f63780769f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6380034000 tx=0x7f6380009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:05.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.695+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f637c05fbb0 con 0x7f6374004800 2024-04-25T15:44:05.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:05.871+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f638c076280 con 0x7f6374004800 2024-04-25T15:44:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.545+0000 7f63897fa640 1 -- 172.21.15.80:0/295567567 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f637c05f4b0 con 0x7f6374004800 2024-04-25T15:44:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63780744e0 msgr2=0x7f63780769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63780744e0 0x7f63780769f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6380034000 tx=0x7f6380009030 comp rx=0 tx=0).stop 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 msgr2=0x7f638c1e9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f638c1e9bb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f637c0010e0 tx=0x7f637c00fbd0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 shutdown_connections 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63780744e0 0x7f63780769f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f638c153da0 0x7f638c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f638c153990 0x7f638c158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.547+0000 7f6393164640 1 --2- 172.21.15.80:0/295567567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6374004800 0x7f638c1e9bb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.548+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 >> 172.21.15.80:0/295567567 conn(0x7f638c0d0450 msgr2=0x7f638c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.548+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 shutdown_connections 2024-04-25T15:44:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.548+0000 7f6393164640 1 -- 172.21.15.80:0/295567567 wait complete. 2024-04-25T15:44:06.564 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T15:44:06.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.677+0000 7f99949c0640 1 Processor -- start 2024-04-25T15:44:06.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.677+0000 7f99949c0640 1 -- start start 2024-04-25T15:44:06.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f99949c0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f999009bea0 0x7f99900ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f99949c0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99900d2830 0x7f99900d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f99949c0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999006c660 con 0x7f99900cf320 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f99949c0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f999006cc40 con 0x7f99900d2830 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f99949c0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f99900d3180 con 0x7f999009bea0 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99900d2830 0x7f99900d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99900d2830 0x7f99900d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42400/0 (socket says 172.21.15.80:42400) 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 -- 172.21.15.80:0/4134294704 learned_addr learned my addr 172.21.15.80:0/4134294704 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998e59c640 1 --2- 172.21.15.80:0/4134294704 >> v2:172.21.15.195:3300/0 conn(0x7f999009bea0 0x7f99900ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 -- 172.21.15.80:0/4134294704 >> v2:172.21.15.195:3300/0 conn(0x7f999009bea0 msgr2=0x7f99900ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 --2- 172.21.15.80:0/4134294704 >> v2:172.21.15.195:3300/0 conn(0x7f999009bea0 0x7f99900ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 -- 172.21.15.80:0/4134294704 >> v1:172.21.15.195:6789/0 conn(0x7f99900cf320 legacy=0x7f99900cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:06.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.679+0000 7f998dd9b640 1 -- 172.21.15.80:0/4134294704 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99900ced60 con 0x7f99900d2830 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.680+0000 7f998dd9b640 1 --2- 172.21.15.80:0/4134294704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99900d2830 0x7f99900d2c40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f99900b85f0 tx=0x7f998402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e073cf0e2471bc6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.680+0000 7f998d59a640 1 -- 172.21.15.80:0/4134294704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984037070 con 0x7f99900d2830 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.680+0000 7f998d59a640 1 -- 172.21.15.80:0/4134294704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9984032440 con 0x7f99900d2830 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.680+0000 7f998d59a640 1 -- 172.21.15.80:0/4134294704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984032810 con 0x7f99900d2830 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 -- 172.21.15.80:0/4134294704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99900d2830 msgr2=0x7f99900d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 --2- 172.21.15.80:0/4134294704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99900d2830 0x7f99900d2c40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f99900b85f0 tx=0x7f998402a230 comp rx=0 tx=0).stop 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 -- 172.21.15.80:0/4134294704 shutdown_connections 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 --2- 172.21.15.80:0/4134294704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99900d2830 0x7f99900d2c40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 --2- 172.21.15.80:0/4134294704 >> v2:172.21.15.195:3300/0 conn(0x7f999009bea0 0x7f99900ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 -- 172.21.15.80:0/4134294704 >> 172.21.15.80:0/4134294704 conn(0x7f99900b7620 msgr2=0x7f99900b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:06.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 -- 172.21.15.80:0/4134294704 shutdown_connections 2024-04-25T15:44:06.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.681+0000 7f99949c0640 1 -- 172.21.15.80:0/4134294704 wait complete. 2024-04-25T15:44:06.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.683+0000 7f99949c0640 1 Processor -- start 2024-04-25T15:44:06.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.683+0000 7f99949c0640 1 -- start start 2024-04-25T15:44:06.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f99949c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 0x7f999009e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f99949c0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99900cf320 0x7f999009cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f99949c0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99900d2830 0x7f99901f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f99949c0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99900cf040 con 0x7f999009bea0 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f99949c0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f999015e420 con 0x7f99900cf320 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f99949c0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99900ce8c0 con 0x7f99900d2830 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f998e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 0x7f999009e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f998e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 0x7f999009e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42412/0 (socket says 172.21.15.80:42412) 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.684+0000 7f998e59c640 1 -- 172.21.15.80:0/3384224363 learned_addr learned my addr 172.21.15.80:0/3384224363 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998dd9b640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99900cf320 0x7f999009cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998ed9d640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99900d2830 0x7f99901f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998e59c640 1 -- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99900d2830 msgr2=0x7f99901f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:06.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998e59c640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99900d2830 0x7f99901f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998e59c640 1 -- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99900cf320 msgr2=0x7f999009cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998e59c640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99900cf320 0x7f999009cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998e59c640 1 -- 172.21.15.80:0/3384224363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999009d0c0 con 0x7f999009bea0 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f998e59c640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 0x7f999009e520 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9980007e90 tx=0x7f998000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998001a070 con 0x7f999009bea0 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9980003b90 con 0x7f999009bea0 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999009eec0 con 0x7f999009bea0 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998000ee70 con 0x7f999009bea0 2024-04-25T15:44:06.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.685+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999009f480 con 0x7f999009bea0 2024-04-25T15:44:06.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.686+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999006a100 con 0x7f999009bea0 2024-04-25T15:44:06.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.687+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f998001d070 con 0x7f999009bea0 2024-04-25T15:44:06.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.687+0000 7f997effd640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99700744b0 0x7f99700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:06.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.687+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f9980095450 con 0x7f999009bea0 2024-04-25T15:44:06.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.687+0000 7f998dd9b640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99700744b0 0x7f99700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:06.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.688+0000 7f998dd9b640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99700744b0 0x7f99700769c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9984034000 tx=0x7f998402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:06.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.692+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f999009d0c0 con 0x7f999009bea0 2024-04-25T15:44:06.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:06.869+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9990070800 con 0x7f999009bea0 2024-04-25T15:44:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.550+0000 7f997effd640 1 -- 172.21.15.80:0/3384224363 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f998005f480 con 0x7f999009bea0 2024-04-25T15:44:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' removed 2024-04-25T15:44:07.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99700744b0 msgr2=0x7f99700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99700744b0 0x7f99700769c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9984034000 tx=0x7f998402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 msgr2=0x7f999009e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 0x7f999009e520 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9980007e90 tx=0x7f998000e4b0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 shutdown_connections 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99700744b0 0x7f99700769c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99900d2830 0x7f99901f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99900cf320 0x7f999009cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 --2- 172.21.15.80:0/3384224363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f999009bea0 0x7f999009e520 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 >> 172.21.15.80:0/3384224363 conn(0x7f99900b7620 msgr2=0x7f99900cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 shutdown_connections 2024-04-25T15:44:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.552+0000 7f99949c0640 1 -- 172.21.15.80:0/3384224363 wait complete. 2024-04-25T15:44:07.568 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:44:07.569 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T15:44:07.569 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:44:07.569 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:07.569 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:44:07.569 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T15:44:07.569 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:44:07.569 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:07.570 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:44:07.570 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T15:44:07.570 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:44:07.570 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:07.570 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:44:07.570 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T15:44:07.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:44:07.571 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:07.583 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:44:07.583 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:44:07.586 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:44:07.586 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:44:07.587 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:44:07.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:44:07.588 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:44:07.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:44:07.628 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:44:07.628 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:07.629 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:44:07.629 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:07.630 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:44:07.630 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:07.631 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:44:07.632 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:07.632 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T15:44:07.716 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:44:07.717 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:44:07.720 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:44:07.720 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:44:07.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.747+0000 7fb8b579d640 1 Processor -- start 2024-04-25T15:44:07.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.747+0000 7fb8b579d640 1 -- start start 2024-04-25T15:44:07.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.748+0000 7fb8b579d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb8b00b9020 0x7fb8b006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:07.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.748+0000 7fb8b579d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b00d07b0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.748+0000 7fb8b579d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b00d0a90 con 0x7fb8b00b4aa0 2024-04-25T15:44:07.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.748+0000 7fb8b579d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b00b9430 con 0x7fb8b00b9020 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8af7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb8b00d2a40 0x7fb8b0163c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40848/0 (socket says 172.21.15.80:40848) 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8af7fe640 1 -- 172.21.15.80:0/1892813285 learned_addr learned my addr 172.21.15.80:0/1892813285 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8b4f9c640 1 --2- 172.21.15.80:0/1892813285 >> v2:172.21.15.195:3300/0 conn(0x7fb8b00b9020 0x7fb8b006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651771135 0 0) 0x7fb8b00d07b0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb898003520 con 0x7fb8b00d2a40 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121949585 0 0) 0x7fb8b00d0a90 con 0x7fb8b00b4aa0 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b00d07b0 con 0x7fb8b00b4aa0 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1892813285 >> v1:172.21.15.195:6789/0 conn(0x7fb8b00b4aa0 legacy=0x7fb8b00d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1892813285 >> v1:172.21.15.80:6789/0 conn(0x7fb8b00d2a40 legacy=0x7fb8b0163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.749+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1892813285 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b00d0d70 con 0x7fb8b00b9020 2024-04-25T15:44:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.750+0000 7fb8b4f9c640 1 --2- 172.21.15.80:0/1892813285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b006e930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d90 tx=0x7fb8a802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38a0ccc6a76cbe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.750+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8007740 con 0x7fb8b00b9020 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.750+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a80078e0 con 0x7fb8b00b9020 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.750+0000 7fb8aeffd640 1 -- 172.21.15.80:0/1892813285 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8007cb0 con 0x7fb8b00b9020 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 -- 172.21.15.80:0/1892813285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 msgr2=0x7fb8b006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1892813285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b006e930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d90 tx=0x7fb8a802a660 comp rx=0 tx=0).stop 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 -- 172.21.15.80:0/1892813285 shutdown_connections 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1892813285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b006e930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 -- 172.21.15.80:0/1892813285 >> 172.21.15.80:0/1892813285 conn(0x7fb8b00b7750 msgr2=0x7fb8b00b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 -- 172.21.15.80:0/1892813285 shutdown_connections 2024-04-25T15:44:07.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.751+0000 7fb8b579d640 1 -- 172.21.15.80:0/1892813285 wait complete. 2024-04-25T15:44:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.752+0000 7fb8b579d640 1 Processor -- start 2024-04-25T15:44:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.753+0000 7fb8b579d640 1 -- start start 2024-04-25T15:44:07.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b579d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8b00b4aa0 0x7fb8b01fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:07.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b579d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b0154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:07.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b579d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 0x7fb8b00cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:07.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b579d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00b5280 con 0x7fb8b00d2a40 2024-04-25T15:44:07.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b579d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00d1370 con 0x7fb8b00b9020 2024-04-25T15:44:07.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b579d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b015ffa0 con 0x7fb8b00b4aa0 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 0x7fb8b00cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 0x7fb8b00cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42442/0 (socket says 172.21.15.80:42442) 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1194545539 learned_addr learned my addr 172.21.15.80:0/1194545539 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8affff640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8b00b4aa0 0x7fb8b01fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8af7fe640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b0154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8b00b4aa0 msgr2=0x7fb8b01fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8b00b4aa0 0x7fb8b01fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 msgr2=0x7fb8b0154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b0154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.754+0000 7fb8b4f9c640 1 -- 172.21.15.80:0/1194545539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b01fa6e0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.755+0000 7fb8b4f9c640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 0x7fb8b00cf0b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb8a802ac50 tx=0x7fb8a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.755+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a803f070 con 0x7fb8b00d2a40 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.755+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8031bc0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.755+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b0157000 con 0x7fb8b00d2a40 2024-04-25T15:44:07.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.755+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8009450 con 0x7fb8b00d2a40 2024-04-25T15:44:07.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.755+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b0155ed0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.756+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b0155960 con 0x7fb8b00d2a40 2024-04-25T15:44:07.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.757+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb8a803b410 con 0x7fb8b00d2a40 2024-04-25T15:44:07.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.757+0000 7fb8acff9640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb89c0744b0 0x7fb89c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:07.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.757+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7fb8a80b6bf0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.757+0000 7fb8affff640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb89c0744b0 0x7fb89c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:07.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.758+0000 7fb8affff640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb89c0744b0 0x7fb89c0769c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00015b0 tx=0x7fb8a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.761+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8b01fa6e0 con 0x7fb8b00d2a40 2024-04-25T15:44:07.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:07.949+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb8b0163880 con 0x7fb8b00d2a40 2024-04-25T15:44:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.559+0000 7fb8acff9640 1 -- 172.21.15.80:0/1194545539 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7fb8a8080f80 con 0x7fb8b00d2a40 2024-04-25T15:44:08.561 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-25T15:44:08.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb89c0744b0 msgr2=0x7fb89c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb89c0744b0 0x7fb89c0769c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00015b0 tx=0x7fb8a0009040 comp rx=0 tx=0).stop 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 msgr2=0x7fb8b00cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 0x7fb8b00cf0b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb8a802ac50 tx=0x7fb8a8004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 shutdown_connections 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb89c0744b0 0x7fb89c0769c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b00d2a40 0x7fb8b00cf0b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b00b9020 0x7fb8b0154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 --2- 172.21.15.80:0/1194545539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8b00b4aa0 0x7fb8b01fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.562+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 >> 172.21.15.80:0/1194545539 conn(0x7fb8b00b7750 msgr2=0x7fb8b00b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.563+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 shutdown_connections 2024-04-25T15:44:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.563+0000 7fb8b579d640 1 -- 172.21.15.80:0/1194545539 wait complete. 2024-04-25T15:44:08.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T15:44:08.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.683+0000 7f26b86aa640 1 Processor -- start 2024-04-25T15:44:08.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.683+0000 7f26b86aa640 1 -- start start 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b86aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00b0d80 0x7f26b015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b86aa640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b00703e0 con 0x7f26b00b65a0 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b86aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b00affc0 con 0x7f26b0074240 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b86aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26b00b02a0 con 0x7f26b00b0d80 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b5c45640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f26b00b65a0 0x7f26b0073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40862/0 (socket says 172.21.15.80:40862) 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b5c45640 1 -- 172.21.15.80:0/4165179139 learned_addr learned my addr 172.21.15.80:0/4165179139 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b6446640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00b0d80 0x7f26b015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454391185 0 0) 0x7f26b00703e0 con 0x7f26b00b65a0 2024-04-25T15:44:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.685+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f269c003520 con 0x7f26b00b65a0 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2011728650 0 0) 0x7f269c003520 con 0x7f26b00b65a0 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00b0d80 msgr2=0x7f26b015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00b0d80 0x7f26b015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 >> v1:172.21.15.195:6789/0 conn(0x7f26b0074240 legacy=0x7f26b00b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b00b0580 con 0x7f26b00b65a0 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f26a0001670 con 0x7f26b00b65a0 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 >> v1:172.21.15.80:6789/0 conn(0x7f26b00b65a0 legacy=0x7f26b0073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c0039e0 0x7f269c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f269c004800 0x7f269c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c005150 0x7f269c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f26b00b02a0 con 0x7f269c005150 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f269c00c010 con 0x7f269c0039e0 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f269c00c210 con 0x7f269c004800 2024-04-25T15:44:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6446640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00b0d80 0x7f26b015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6c47640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c005150 0x7f269c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b5c45640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f269c004800 0x7f269c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6446640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c0039e0 0x7f269c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6c47640 1 -- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f269c004800 msgr2=0x7f269c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6c47640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f269c004800 0x7f269c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6c47640 1 -- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c0039e0 msgr2=0x7f269c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6c47640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c0039e0 0x7f269c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.686+0000 7f26b6c47640 1 -- 172.21.15.80:0/4165179139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c003520 con 0x7f269c005150 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.687+0000 7f26b6c47640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c005150 0x7f269c00b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f26a8001f60 tx=0x7f269c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6fb028156e0301 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.687+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8001b30 con 0x7f269c005150 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.687+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8038070 con 0x7f269c005150 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.687+0000 7f26b5444640 1 -- 172.21.15.80:0/4165179139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8033850 con 0x7f269c005150 2024-04-25T15:44:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b86aa640 1 -- 172.21.15.80:0/4165179139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c005150 msgr2=0x7f269c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4165179139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c005150 0x7f269c00b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f26a8001f60 tx=0x7f269c005830 comp rx=0 tx=0).stop 2024-04-25T15:44:08.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b6c47640 1 -- 172.21.15.80:0/4165179139 reap_dead start 2024-04-25T15:44:08.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b86aa640 1 -- 172.21.15.80:0/4165179139 shutdown_connections 2024-04-25T15:44:08.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b86aa640 1 -- 172.21.15.80:0/4165179139 >> 172.21.15.80:0/4165179139 conn(0x7f26b00d1e20 msgr2=0x7f26b0073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:08.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b86aa640 1 -- 172.21.15.80:0/4165179139 shutdown_connections 2024-04-25T15:44:08.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.688+0000 7f26b86aa640 1 -- 172.21.15.80:0/4165179139 wait complete. 2024-04-25T15:44:08.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.690+0000 7f26b86aa640 1 Processor -- start 2024-04-25T15:44:08.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.690+0000 7f26b86aa640 1 -- start start 2024-04-25T15:44:08.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b86aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c005150 0x7f26b015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b86aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 0x7f26b00d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b86aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00d0600 0x7f26b01f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b86aa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f26b006fe10 con 0x7f26b01491f0 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b86aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f26b00ae7c0 con 0x7f269c005150 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b86aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26b006ff90 con 0x7f26b00d0600 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 0x7f26b00d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 0x7f26b00d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42470/0 (socket says 172.21.15.80:42470) 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 -- 172.21.15.80:0/4273591804 learned_addr learned my addr 172.21.15.80:0/4273591804 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b6c47640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00d0600 0x7f26b01f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b6446640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c005150 0x7f26b015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 -- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00d0600 msgr2=0x7f26b01f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00d0600 0x7f26b01f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 -- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c005150 msgr2=0x7f26b015f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c005150 0x7f26b015f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 -- 172.21.15.80:0/4273591804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b015dfe0 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b6c47640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00d0600 0x7f26b01f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b6446640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c005150 0x7f26b015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.691+0000 7f26b5c45640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 0x7f26b00d00c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f26a00072c0 tx=0x7f26a00076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.692+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a000f960 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.692+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a0018070 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.692+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a000fd80 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.692+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b00d0a10 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.692+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b015d500 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.693+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b006a100 con 0x7f26b01491f0 2024-04-25T15:44:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.693+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f26a001d460 con 0x7f26b01491f0 2024-04-25T15:44:08.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.694+0000 7f26a6ffd640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26940744b0 0x7f26940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:08.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.694+0000 7f26b6446640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26940744b0 0x7f26940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:08.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.694+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f26a00950d0 con 0x7f26b01491f0 2024-04-25T15:44:08.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.694+0000 7f26b6446640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26940744b0 0x7f26940769c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f26b0070a20 tx=0x7f26ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.699+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26b00d0a10 con 0x7f26b01491f0 2024-04-25T15:44:08.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.938+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f26b0158060 con 0x7f26b01491f0 2024-04-25T15:44:08.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.938+0000 7f26a6ffd640 1 -- 172.21.15.80:0/4273591804 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f26a005fab0 con 0x7f26b01491f0 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw==", 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q==", 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.941 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA==", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw==", 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.942 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g==", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw==", 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw==", 2024-04-25T15:44:08.944 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q==", 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw==", 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA==", 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.946 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA==", 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg==", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw==", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:08.948 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw==", 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g==", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw==", 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.950 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDMeSpmVFP1JxAAQ3NwNePUywfB5CkeGWRjfA==", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mds", 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDseSpmY/dLMhAAKeBI9YpuuDFxtJ+PWL98vA==", 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDseSpmvf5LMhAAtvfxpyRLti7izhuxhgXsrw==", 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-osd", 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDseSpmIwVMMhAAuHsTHMk2r2xPY/rB/g5sMA==", 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDseSpmOwxMMhAA0pAHAcQFIH+E/+NBa+S8DQ==", 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDseSpmuBJMMhAAV99bNXREXI7LBVwetmCwRw==", 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDseSpmVhlMMhAAykY5ry5Ii8NdU3CpxN2djg==", 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T15:44:08.954 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA==", 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og==", 2024-04-25T15:44:08.955 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:44:08.956 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:44:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26940744b0 msgr2=0x7f26940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26940744b0 0x7f26940769c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f26b0070a20 tx=0x7f26ac008040 comp rx=0 tx=0).stop 2024-04-25T15:44:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 msgr2=0x7f26b00d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 0x7f26b00d00c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f26a00072c0 tx=0x7f26a00076c0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 shutdown_connections 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26940744b0 0x7f26940769c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26b00d0600 0x7f26b01f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b01491f0 0x7f26b00d00c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 --2- 172.21.15.80:0/4273591804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c005150 0x7f26b015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 >> 172.21.15.80:0/4273591804 conn(0x7f26b00d1e20 msgr2=0x7f26b0159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 shutdown_connections 2024-04-25T15:44:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:08.940+0000 7f26b86aa640 1 -- 172.21.15.80:0/4273591804 wait complete. 2024-04-25T15:44:08.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T15:44:09.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.067+0000 7f956d642640 1 Processor -- start 2024-04-25T15:44:09.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.067+0000 7f956d642640 1 -- start start 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f956d642640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 0x7f956806ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f956d642640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 0x7f956809b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f956d642640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95680d21f0 con 0x7f95680d1de0 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f956d642640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f956809b950 con 0x7f95680d2f40 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f956d642640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95680d1020 con 0x7f956815d060 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f9566ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 0x7f956806ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f95677fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 0x7f956809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f9566ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 0x7f956806ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:44196/0 (socket says 172.21.15.80:44196) 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f95677fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 0x7f956809b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:42228/0 (socket says 172.21.15.80:42228) 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.068+0000 7f9566ffd640 1 -- 172.21.15.80:0/1357379682 learned_addr learned my addr 172.21.15.80:0/1357379682 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.069+0000 7f9566ffd640 1 -- 172.21.15.80:0/1357379682 >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 msgr2=0x7f956809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.069+0000 7f9566ffd640 1 --2- 172.21.15.80:0/1357379682 >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 0x7f956809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.069+0000 7f9566ffd640 1 -- 172.21.15.80:0/1357379682 >> v1:172.21.15.80:6789/0 conn(0x7f95680d1de0 legacy=0x7f95680d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.069+0000 7f9566ffd640 1 -- 172.21.15.80:0/1357379682 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95680d1300 con 0x7f956815d060 2024-04-25T15:44:09.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.069+0000 7f95677fe640 1 --2- 172.21.15.80:0/1357379682 >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 0x7f956809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.069+0000 7f9566ffd640 1 --2- 172.21.15.80:0/1357379682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 0x7f956806ebd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f955800bb10 tx=0x7f955802c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0f1f530d6946b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f95667fc640 1 -- 172.21.15.80:0/1357379682 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558036020 con 0x7f956815d060 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f95667fc640 1 -- 172.21.15.80:0/1357379682 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9558032640 con 0x7f956815d060 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f95667fc640 1 -- 172.21.15.80:0/1357379682 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558032a10 con 0x7f956815d060 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 -- 172.21.15.80:0/1357379682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 msgr2=0x7f956806ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 --2- 172.21.15.80:0/1357379682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 0x7f956806ebd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f955800bb10 tx=0x7f955802c940 comp rx=0 tx=0).stop 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 -- 172.21.15.80:0/1357379682 shutdown_connections 2024-04-25T15:44:09.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 --2- 172.21.15.80:0/1357379682 >> v2:172.21.15.195:3300/0 conn(0x7f95680d2f40 0x7f956809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 --2- 172.21.15.80:0/1357379682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f956815d060 0x7f956806ebd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 -- 172.21.15.80:0/1357379682 >> 172.21.15.80:0/1357379682 conn(0x7f9568074740 msgr2=0x7f95680b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:09.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 -- 172.21.15.80:0/1357379682 shutdown_connections 2024-04-25T15:44:09.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.070+0000 7f956d642640 1 -- 172.21.15.80:0/1357379682 wait complete. 2024-04-25T15:44:09.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.072+0000 7f956d642640 1 Processor -- start 2024-04-25T15:44:09.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.072+0000 7f956d642640 1 -- start start 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95680d1de0 0x7f95680ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 0x7f9568159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95680c9150 0x7f9568159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f95680af5f0 con 0x7f956815d060 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f95680d18c0 con 0x7f95680c9150 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95680af770 con 0x7f95680d1de0 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 0x7f9568159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 0x7f9568159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42486/0 (socket says 172.21.15.80:42486) 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 -- 172.21.15.80:0/2438967105 learned_addr learned my addr 172.21.15.80:0/2438967105 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f9566ffd640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95680d1de0 0x7f95680ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f95677fe640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95680c9150 0x7f9568159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 -- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95680d1de0 msgr2=0x7f95680ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95680d1de0 0x7f95680ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 -- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95680c9150 msgr2=0x7f9568159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95680c9150 0x7f9568159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 -- 172.21.15.80:0/2438967105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95681f6180 con 0x7f956815d060 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955e7fc640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 0x7f9568159910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f955000c3c0 tx=0x7f955000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500052d0 con 0x7f956815d060 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9550005490 con 0x7f956815d060 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550007260 con 0x7f956815d060 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.074+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95680c80b0 con 0x7f956815d060 2024-04-25T15:44:09.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.075+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95680c8670 con 0x7f956815d060 2024-04-25T15:44:09.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.075+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95680d0450 con 0x7f956815d060 2024-04-25T15:44:09.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.076+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9550007400 con 0x7f956815d060 2024-04-25T15:44:09.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.077+0000 7f955ffff640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95480744b0 0x7f95480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.077+0000 7f9566ffd640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95480744b0 0x7f95480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.077+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9550094320 con 0x7f956815d060 2024-04-25T15:44:09.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.077+0000 7f9566ffd640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95480744b0 0x7f95480769c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9558037000 tx=0x7f9558032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.081+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f955005e620 con 0x7f956815d060 2024-04-25T15:44:09.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.325+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f956806a100 con 0x7f956815d060 2024-04-25T15:44:09.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.328+0000 7f955ffff640 1 -- 172.21.15.80:0/2438967105 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f9550062920 con 0x7f956815d060 2024-04-25T15:44:09.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95480744b0 msgr2=0x7f95480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95480744b0 0x7f95480769c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9558037000 tx=0x7f9558032000 comp rx=0 tx=0).stop 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 msgr2=0x7f9568159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 0x7f9568159910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f955000c3c0 tx=0x7f955000c880 comp rx=0 tx=0).stop 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 shutdown_connections 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95480744b0 0x7f95480769c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95680c9150 0x7f9568159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f956815d060 0x7f9568159910 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 --2- 172.21.15.80:0/2438967105 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95680d1de0 0x7f95680ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 >> 172.21.15.80:0/2438967105 conn(0x7f9568074740 msgr2=0x7f9568070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 shutdown_connections 2024-04-25T15:44:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.330+0000 7f956d642640 1 -- 172.21.15.80:0/2438967105 wait complete. 2024-04-25T15:44:09.342 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T15:44:09.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.450+0000 7fa4014ee640 1 Processor -- start 2024-04-25T15:44:09.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.450+0000 7fa4014ee640 1 -- start start 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.451+0000 7fa4014ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3fc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.451+0000 7fa4014ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3fc163fb0 con 0x7fa3fc0b7d60 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.451+0000 7fa4014ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3fc164270 con 0x7fa3fc1602a0 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.451+0000 7fa4014ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc164550 con 0x7fa3fc0d41b0 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3fb7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa3fc0b7d60 0x7fa3fc0d49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40886/0 (socket says 172.21.15.80:40886) 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3fb7fe640 1 -- 172.21.15.80:0/2068676250 learned_addr learned my addr 172.21.15.80:0/2068676250 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3faffd640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3fc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428243345 0 0) 0x7fa3fc163fb0 con 0x7fa3fc0b7d60 2024-04-25T15:44:09.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3e4003520 con 0x7fa3fc0b7d60 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1379583380 0 0) 0x7fa3e4003520 con 0x7fa3fc0b7d60 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 msgr2=0x7fa3fc0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3fc0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 >> v1:172.21.15.195:6789/0 conn(0x7fa3fc1602a0 legacy=0x7fa3fc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc164830 con 0x7fa3fc0b7d60 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fa3f40019f0 con 0x7fa3fc0b7d60 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3faffd640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3fc0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 >> v1:172.21.15.80:6789/0 conn(0x7fa3fc0b7d60 legacy=0x7fa3fc0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3e40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e4003f40 0x7fa3e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4004d40 0x7fa3e4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc164550 con 0x7fa3e4004d40 2024-04-25T15:44:09.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e400bad0 con 0x7fa3e4003f40 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.452+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e400bcd0 con 0x7fa3fc0d41b0 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fb7fe640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4004d40 0x7fa3e4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fa7fc640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e4003f40 0x7fa3e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3faffd640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3e40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fb7fe640 1 -- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 msgr2=0x7fa3e40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fb7fe640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc0d41b0 0x7fa3e40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fb7fe640 1 -- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e4003f40 msgr2=0x7fa3e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fb7fe640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e4003f40 0x7fa3e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.453+0000 7fa3fb7fe640 1 -- 172.21.15.80:0/2068676250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e4003520 con 0x7fa3e4004d40 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa3fb7fe640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4004d40 0x7fa3e4005150 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc08eec0 tx=0x7fa3e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7959a991f5dc4ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400a450 con 0x7fa3e4004d40 2024-04-25T15:44:09.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f402f070 con 0x7fa3e4004d40 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa3f9ffb640 1 -- 172.21.15.80:0/2068676250 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f402bc60 con 0x7fa3e4004d40 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa4014ee640 1 -- 172.21.15.80:0/2068676250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4004d40 msgr2=0x7fa3e4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa4014ee640 1 --2- 172.21.15.80:0/2068676250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4004d40 0x7fa3e4005150 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc08eec0 tx=0x7fa3e4005830 comp rx=0 tx=0).stop 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa3fb7fe640 1 -- 172.21.15.80:0/2068676250 reap_dead start 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa4014ee640 1 -- 172.21.15.80:0/2068676250 shutdown_connections 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa4014ee640 1 -- 172.21.15.80:0/2068676250 >> 172.21.15.80:0/2068676250 conn(0x7fa3fc06e9f0 msgr2=0x7fa3fc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa4014ee640 1 -- 172.21.15.80:0/2068676250 shutdown_connections 2024-04-25T15:44:09.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.454+0000 7fa4014ee640 1 -- 172.21.15.80:0/2068676250 wait complete. 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.456+0000 7fa4014ee640 1 Processor -- start 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.456+0000 7fa4014ee640 1 -- start start 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3fc159a10 0x7fa3fc0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 0x7fa3fc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc156520 0x7fa3fc157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc0b5150 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc0b4fd0 con 0x7fa3fc159a10 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc0b9220 con 0x7fa3fc156520 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 0x7fa3fc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 0x7fa3fc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42504/0 (socket says 172.21.15.80:42504) 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 -- 172.21.15.80:0/1857210809 learned_addr learned my addr 172.21.15.80:0/1857210809 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3faffd640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3fc159a10 0x7fa3fc0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fb7fe640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc156520 0x7fa3fc157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 -- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc156520 msgr2=0x7fa3fc157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc156520 0x7fa3fc157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 -- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3fc159a10 msgr2=0x7fa3fc0b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3fc159a10 0x7fa3fc0b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 -- 172.21.15.80:0/1857210809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc156930 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3fa7fc640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 0x7fa3fc155fe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000f870 tx=0x7fa3f000fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f001a070 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f000fe60 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3fc158970 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.458+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0007050 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.459+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3fc158f30 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.460+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3fc160d30 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.460+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa3f001d070 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.460+0000 7fa3e37fe640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3e80744b0 0x7fa3e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.461+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa3f00946a0 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.461+0000 7fa3faffd640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3e80744b0 0x7fa3e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.461+0000 7fa3faffd640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3e80744b0 0x7fa3e80769c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc15c310 tx=0x7fa3ec009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.465+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3fc160d30 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.718+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fa3fc163eb0 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.721+0000 7fa3e37fe640 1 -- 172.21.15.80:0/1857210809 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fa3fc163eb0 con 0x7fa3fc0b6ac0 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3e80744b0 msgr2=0x7fa3e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3e80744b0 0x7fa3e80769c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc15c310 tx=0x7fa3ec009190 comp rx=0 tx=0).stop 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 msgr2=0x7fa3fc155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 0x7fa3fc155fe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000f870 tx=0x7fa3f000fc70 comp rx=0 tx=0).stop 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 shutdown_connections 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3e80744b0 0x7fa3e80769c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3fc156520 0x7fa3fc157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc0b6ac0 0x7fa3fc155fe0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 --2- 172.21.15.80:0/1857210809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3fc159a10 0x7fa3fc0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 >> 172.21.15.80:0/1857210809 conn(0x7fa3fc06e9f0 msgr2=0x7fa3fc161e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 shutdown_connections 2024-04-25T15:44:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.723+0000 7fa4014ee640 1 -- 172.21.15.80:0/1857210809 wait complete. 2024-04-25T15:44:09.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T15:44:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.842+0000 7fe61da61640 1 Processor -- start 2024-04-25T15:44:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.842+0000 7fe61da61640 1 -- start start 2024-04-25T15:44:09.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe61da61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 0x7fe6180d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe61da61640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe6180d2d90 0x7fe61815f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe61da61640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6180d31a0 con 0x7fe61809bee0 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe61da61640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe61815f550 con 0x7fe6180d2d90 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe61da61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe61815e790 con 0x7fe61815e180 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe616ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe61809bee0 0x7fe6180b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40902/0 (socket says 172.21.15.80:40902) 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe616ffd640 1 -- 172.21.15.80:0/3268090483 learned_addr learned my addr 172.21.15.80:0/3268090483 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe6167fc640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 0x7fe6180d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422701425 0 0) 0x7fe6180d31a0 con 0x7fe61809bee0 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe6177fe640 1 --2- 172.21.15.80:0/3268090483 >> v2:172.21.15.195:3300/0 conn(0x7fe6180d2d90 0x7fe61815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe600003520 con 0x7fe61809bee0 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1780603878 0 0) 0x7fe600003520 con 0x7fe61809bee0 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 msgr2=0x7fe6180d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 0x7fe6180d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 >> v2:172.21.15.195:3300/0 conn(0x7fe6180d2d90 msgr2=0x7fe61815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 --2- 172.21.15.80:0/3268090483 >> v2:172.21.15.195:3300/0 conn(0x7fe6180d2d90 0x7fe61815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61815ea70 con 0x7fe61809bee0 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe6080019f0 con 0x7fe61809bee0 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 >> v1:172.21.15.80:6789/0 conn(0x7fe61809bee0 legacy=0x7fe6180b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 0x7fe6000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe600003f30 0x7fe600004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe600004d40 0x7fe600005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe61815e790 con 0x7fe600003f30 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe60000b9c0 con 0x7fe600004d40 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.844+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe60000bb90 con 0x7fe61815e180 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe600003f30 0x7fe600004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe616ffd640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 0x7fe6000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6177fe640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe600004d40 0x7fe600005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 -- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 msgr2=0x7fe6000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe61815e180 0x7fe6000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 -- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe600004d40 msgr2=0x7fe600005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe600004d40 0x7fe600005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 -- 172.21.15.80:0/3268090483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe600003520 con 0x7fe600003f30 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.845+0000 7fe6167fc640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe600003f30 0x7fe600004800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009a90 tx=0x7fe600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120bd644c611931c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c036070 con 0x7fe600003f30 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c031400 con 0x7fe600003f30 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe615ffb640 1 -- 172.21.15.80:0/3268090483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c009690 con 0x7fe600003f30 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe61da61640 1 -- 172.21.15.80:0/3268090483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe600003f30 msgr2=0x7fe600004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe61da61640 1 --2- 172.21.15.80:0/3268090483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe600003f30 0x7fe600004800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009a90 tx=0x7fe600005830 comp rx=0 tx=0).stop 2024-04-25T15:44:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe6177fe640 1 -- 172.21.15.80:0/3268090483 reap_dead start 2024-04-25T15:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe61da61640 1 -- 172.21.15.80:0/3268090483 shutdown_connections 2024-04-25T15:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe61da61640 1 -- 172.21.15.80:0/3268090483 >> 172.21.15.80:0/3268090483 conn(0x7fe6180b7620 msgr2=0x7fe6180b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe61da61640 1 -- 172.21.15.80:0/3268090483 shutdown_connections 2024-04-25T15:44:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.846+0000 7fe61da61640 1 -- 172.21.15.80:0/3268090483 wait complete. 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.848+0000 7fe61da61640 1 Processor -- start 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.848+0000 7fe61da61640 1 -- start start 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.849+0000 7fe61da61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe600003f30 0x7fe618156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.849+0000 7fe61da61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 0x7fe6181604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.849+0000 7fe61da61640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe618156bc0 0x7fe6181609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.849+0000 7fe61da61640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180d2850 con 0x7fe6181567b0 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.849+0000 7fe61da61640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe61815f030 con 0x7fe618156bc0 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.849+0000 7fe61da61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe6180d29d0 con 0x7fe600003f30 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 0x7fe6181604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 0x7fe6181604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42536/0 (socket says 172.21.15.80:42536) 2024-04-25T15:44:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 -- 172.21.15.80:0/2167796312 learned_addr learned my addr 172.21.15.80:0/2167796312 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6177fe640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe618156bc0 0x7fe6181609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe616ffd640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe600003f30 0x7fe618156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 -- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe600003f30 msgr2=0x7fe618156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe600003f30 0x7fe618156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 -- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe618156bc0 msgr2=0x7fe6181609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe618156bc0 0x7fe6181609e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 -- 172.21.15.80:0/2167796312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe618157250 con 0x7fe6181567b0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe6167fc640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 0x7fe6181604a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009a90 tx=0x7fe60c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c040020 con 0x7fe6181567b0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c003a40 con 0x7fe6181567b0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe618157530 con 0x7fe6181567b0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c036040 con 0x7fe6181567b0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.850+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6180cb3a0 con 0x7fe6181567b0 2024-04-25T15:44:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.851+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61806a100 con 0x7fe6181567b0 2024-04-25T15:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.852+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe60c043020 con 0x7fe6181567b0 2024-04-25T15:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.852+0000 7fe5fffff640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6040744b0 0x7fe6040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.853+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fe60c0b50e0 con 0x7fe6181567b0 2024-04-25T15:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.853+0000 7fe616ffd640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6040744b0 0x7fe6040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.853+0000 7fe616ffd640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6040744b0 0x7fe6040769c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe608002230 tx=0x7fe608006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:09.857+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe60c04a070 con 0x7fe6181567b0 2024-04-25T15:44:10.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.100+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fe618156fe0 con 0x7fe6181567b0 2024-04-25T15:44:10.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.103+0000 7fe5fffff640 1 -- 172.21.15.80:0/2167796312 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fe60c07fb50 con 0x7fe6181567b0 2024-04-25T15:44:10.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6040744b0 msgr2=0x7fe6040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6040744b0 0x7fe6040769c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe608002230 tx=0x7fe608006040 comp rx=0 tx=0).stop 2024-04-25T15:44:10.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 msgr2=0x7fe6181604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 0x7fe6181604a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009a90 tx=0x7fe60c004730 comp rx=0 tx=0).stop 2024-04-25T15:44:10.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 shutdown_connections 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6040744b0 0x7fe6040769c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe618156bc0 0x7fe6181609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6181567b0 0x7fe6181604a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 --2- 172.21.15.80:0/2167796312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe600003f30 0x7fe618156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 >> 172.21.15.80:0/2167796312 conn(0x7fe6180b7620 msgr2=0x7fe6180b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 shutdown_connections 2024-04-25T15:44:10.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.105+0000 7fe61da61640 1 -- 172.21.15.80:0/2167796312 wait complete. 2024-04-25T15:44:10.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T15:44:10.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.223+0000 7f15b70e9640 1 Processor -- start 2024-04-25T15:44:10.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.223+0000 7f15b70e9640 1 -- start start 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b70e9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f15b00714a0 0x7f15b00718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b70e9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15b015ff80 0x7f15b0160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b70e9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b0071df0 con 0x7f15b006db10 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b70e9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f15b015faf0 con 0x7f15b015ff80 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b70e9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f15b015ec30 con 0x7f15b00714a0 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15b015ff80 0x7f15b0160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15b015ff80 0x7f15b0160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42550/0 (socket says 172.21.15.80:42550) 2024-04-25T15:44:10.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 -- 172.21.15.80:0/4112524704 learned_addr learned my addr 172.21.15.80:0/4112524704 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15affff640 1 --2- 172.21.15.80:0/4112524704 >> v2:172.21.15.195:3300/0 conn(0x7f15b00714a0 0x7f15b00718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 -- 172.21.15.80:0/4112524704 >> v2:172.21.15.195:3300/0 conn(0x7f15b00714a0 msgr2=0x7f15b00718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 --2- 172.21.15.80:0/4112524704 >> v2:172.21.15.195:3300/0 conn(0x7f15b00714a0 0x7f15b00718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 -- 172.21.15.80:0/4112524704 >> v1:172.21.15.195:6789/0 conn(0x7f15b006db10 legacy=0x7f15b015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.225+0000 7f15b5686640 1 -- 172.21.15.80:0/4112524704 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b01589c0 con 0x7f15b015ff80 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.226+0000 7f15b5686640 1 --2- 172.21.15.80:0/4112524704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b015ff80 0x7f15b0160390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f15b0074cf0 tx=0x7f15a802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd84f02b0f56e13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.226+0000 7f15af7fe640 1 -- 172.21.15.80:0/4112524704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8036070 con 0x7f15b015ff80 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.226+0000 7f15af7fe640 1 -- 172.21.15.80:0/4112524704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8031600 con 0x7f15b015ff80 2024-04-25T15:44:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.226+0000 7f15af7fe640 1 -- 172.21.15.80:0/4112524704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a80319d0 con 0x7f15b015ff80 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 -- 172.21.15.80:0/4112524704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b015ff80 msgr2=0x7f15b0160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 --2- 172.21.15.80:0/4112524704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b015ff80 0x7f15b0160390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f15b0074cf0 tx=0x7f15a802a660 comp rx=0 tx=0).stop 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 -- 172.21.15.80:0/4112524704 shutdown_connections 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 --2- 172.21.15.80:0/4112524704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b015ff80 0x7f15b0160390 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 --2- 172.21.15.80:0/4112524704 >> v2:172.21.15.195:3300/0 conn(0x7f15b00714a0 0x7f15b00718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 -- 172.21.15.80:0/4112524704 >> 172.21.15.80:0/4112524704 conn(0x7f15b00d2080 msgr2=0x7f15b00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 -- 172.21.15.80:0/4112524704 shutdown_connections 2024-04-25T15:44:10.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.227+0000 7f15b70e9640 1 -- 172.21.15.80:0/4112524704 wait complete. 2024-04-25T15:44:10.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.229+0000 7f15b70e9640 1 Processor -- start 2024-04-25T15:44:10.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.229+0000 7f15b70e9640 1 -- start start 2024-04-25T15:44:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b70e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 0x7f15b00abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b70e9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15b00714a0 0x7f15b0149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b70e9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15b015ff80 0x7f15b014a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b70e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f15b015f780 con 0x7f15b006db10 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b70e9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f15b015f170 con 0x7f15b00714a0 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b70e9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f15b015f450 con 0x7f15b015ff80 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 0x7f15b00abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 0x7f15b00abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42562/0 (socket says 172.21.15.80:42562) 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 -- 172.21.15.80:0/2101382265 learned_addr learned my addr 172.21.15.80:0/2101382265 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15affff640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15b00714a0 0x7f15b0149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b5686640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15b015ff80 0x7f15b014a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 -- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15b015ff80 msgr2=0x7f15b014a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15b015ff80 0x7f15b014a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 -- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15b00714a0 msgr2=0x7f15b0149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.230+0000 7f15b4e85640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15b00714a0 0x7f15b0149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15b4e85640 1 -- 172.21.15.80:0/2101382265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b014a380 con 0x7f15b006db10 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15b4e85640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 0x7f15b00abf40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f15a000b3f0 tx=0x7f15a000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0015020 con 0x7f15b006db10 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a0011830 con 0x7f15b006db10 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0011c20 con 0x7f15b006db10 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b00aa5e0 con 0x7f15b006db10 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.231+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b00aaba0 con 0x7f15b006db10 2024-04-25T15:44:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.232+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b00ab260 con 0x7f15b006db10 2024-04-25T15:44:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.232+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f15a0018020 con 0x7f15b006db10 2024-04-25T15:44:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.233+0000 7f15ad7fa640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f159c0744b0 0x7f159c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.233+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f15a0094bf0 con 0x7f15b006db10 2024-04-25T15:44:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.233+0000 7f15affff640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f159c0744b0 0x7f159c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.233+0000 7f15affff640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f159c0744b0 0x7f159c0769c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006fd0 tx=0x7f15a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.237+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15b00ab260 con 0x7f15b006db10 2024-04-25T15:44:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.480+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f15b015aab0 con 0x7f15b006db10 2024-04-25T15:44:10.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.482+0000 7f15ad7fa640 1 -- 172.21.15.80:0/2101382265 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f15a001f030 con 0x7f15b006db10 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.484+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f159c0744b0 msgr2=0x7f159c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.484+0000 7f15b70e9640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f159c0744b0 0x7f159c0769c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006fd0 tx=0x7f15a4008040 comp rx=0 tx=0).stop 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.484+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 msgr2=0x7f15b00abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.484+0000 7f15b70e9640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 0x7f15b00abf40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f15a000b3f0 tx=0x7f15a000b8b0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 shutdown_connections 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f159c0744b0 0x7f159c0769c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15b015ff80 0x7f15b014a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15b00714a0 0x7f15b0149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 --2- 172.21.15.80:0/2101382265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15b006db10 0x7f15b00abf40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 >> 172.21.15.80:0/2101382265 conn(0x7f15b00d2080 msgr2=0x7f15b0158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 shutdown_connections 2024-04-25T15:44:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.485+0000 7f15b70e9640 1 -- 172.21.15.80:0/2101382265 wait complete. 2024-04-25T15:44:10.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T15:44:10.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.605+0000 7f34d35f3640 1 Processor -- start 2024-04-25T15:44:10.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.605+0000 7f34d35f3640 1 -- start start 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d35f3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34cc0ce220 0x7f34cc09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d35f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0cf960 0x7f34cc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d35f3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc1607c0 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d35f3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc0cf4d0 con 0x7f34cc0ce220 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d35f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0ce630 con 0x7f34cc0cf960 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d138f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34cc0ce220 0x7f34cc09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d1b90640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34cc0b1ef0 0x7f34cc0d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40904/0 (socket says 172.21.15.80:40904) 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d138f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34cc0ce220 0x7f34cc09bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42570/0 (socket says 172.21.15.80:42570) 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d1b90640 1 -- 172.21.15.80:0/3482081612 learned_addr learned my addr 172.21.15.80:0/3482081612 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d0b8e640 1 --2- 172.21.15.80:0/3482081612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0cf960 0x7f34cc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d138f640 1 -- 172.21.15.80:0/3482081612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0cf960 msgr2=0x7f34cc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d138f640 1 --2- 172.21.15.80:0/3482081612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0cf960 0x7f34cc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d138f640 1 -- 172.21.15.80:0/3482081612 >> v1:172.21.15.80:6789/0 conn(0x7f34cc0b1ef0 legacy=0x7f34cc0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34d138f640 1 -- 172.21.15.80:0/3482081612 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0ceba0 con 0x7f34cc0ce220 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.607+0000 7f34c3fff640 1 -- 172.21.15.80:0/3482081612 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743272715 0 0) 0x7f34cc1607c0 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.608+0000 7f34d138f640 1 --2- 172.21.15.80:0/3482081612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0ce220 0x7f34cc09bb70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34c80097a0 tx=0x7f34c802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104f3d94436b1ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.608+0000 7f34c3fff640 1 -- 172.21.15.80:0/3482081612 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8037070 con 0x7f34cc0ce220 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.608+0000 7f34c3fff640 1 -- 172.21.15.80:0/3482081612 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8032440 con 0x7f34cc0ce220 2024-04-25T15:44:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.608+0000 7f34c3fff640 1 -- 172.21.15.80:0/3482081612 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8032810 con 0x7f34cc0ce220 2024-04-25T15:44:10.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 -- 172.21.15.80:0/3482081612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0ce220 msgr2=0x7f34cc09bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 --2- 172.21.15.80:0/3482081612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0ce220 0x7f34cc09bb70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34c80097a0 tx=0x7f34c802a210 comp rx=0 tx=0).stop 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 -- 172.21.15.80:0/3482081612 shutdown_connections 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 --2- 172.21.15.80:0/3482081612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0cf960 0x7f34cc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 --2- 172.21.15.80:0/3482081612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0ce220 0x7f34cc09bb70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 -- 172.21.15.80:0/3482081612 >> 172.21.15.80:0/3482081612 conn(0x7f34cc0b7620 msgr2=0x7f34cc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 -- 172.21.15.80:0/3482081612 shutdown_connections 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.609+0000 7f34d35f3640 1 -- 172.21.15.80:0/3482081612 wait complete. 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.610+0000 7f34d35f3640 1 Processor -- start 2024-04-25T15:44:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.610+0000 7f34d35f3640 1 -- start start 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 0x7f34cc153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0ce220 0x7f34cc15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34cc0cf960 0x7f34cc15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc09c0b0 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf160 con 0x7f34cc0cf960 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0d3530 con 0x7f34cc0ce220 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 0x7f34cc153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 0x7f34cc153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42584/0 (socket says 172.21.15.80:42584) 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 -- 172.21.15.80:0/1725327953 learned_addr learned my addr 172.21.15.80:0/1725327953 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:10.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d0b8e640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0ce220 0x7f34cc15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d1b90640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34cc0cf960 0x7f34cc15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 -- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0ce220 msgr2=0x7f34cc15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0ce220 0x7f34cc15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 -- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34cc0cf960 msgr2=0x7f34cc15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34cc0cf960 0x7f34cc15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 -- 172.21.15.80:0/1725327953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0c8150 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d1b90640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34cc0cf960 0x7f34cc15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d138f640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 0x7f34cc153ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f34c8035040 tx=0x7f34c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8037050 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8038040 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8004490 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.612+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc0c70b0 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.613+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc0c7670 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.614+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc06a100 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.614+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f34c803c6d0 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.615+0000 7f34c1ffb640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34b00744b0 0x7f34b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.615+0000 7f34d0b8e640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34b00744b0 0x7f34b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.615+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f34c80b5b20 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.615+0000 7f34d0b8e640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34b00744b0 0x7f34b00769c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0cacf0 tx=0x7f34bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.619+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34c8080470 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.860+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f34cc06f530 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.863+0000 7f34c1ffb640 1 -- 172.21.15.80:0/1725327953 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f34c807fd70 con 0x7f34cc0b1ef0 2024-04-25T15:44:10.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34b00744b0 msgr2=0x7f34b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34b00744b0 0x7f34b00769c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0cacf0 tx=0x7f34bc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:10.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 msgr2=0x7f34cc153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 0x7f34cc153ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f34c8035040 tx=0x7f34c80046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 shutdown_connections 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34b00744b0 0x7f34b00769c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34cc0cf960 0x7f34cc15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34cc0ce220 0x7f34cc15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 --2- 172.21.15.80:0/1725327953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34cc0b1ef0 0x7f34cc153ec0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 >> 172.21.15.80:0/1725327953 conn(0x7f34cc0b7620 msgr2=0x7f34cc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 shutdown_connections 2024-04-25T15:44:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.865+0000 7f34d35f3640 1 -- 172.21.15.80:0/1725327953 wait complete. 2024-04-25T15:44:10.877 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T15:44:10.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.984+0000 7ffbcae0c640 1 Processor -- start 2024-04-25T15:44:10.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.984+0000 7ffbcae0c640 1 -- start start 2024-04-25T15:44:10.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbcae0c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc40b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbcae0c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbc406da90 0x7ffbc406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbcae0c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc40d1010 con 0x7ffbc406eaa0 2024-04-25T15:44:10.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbcae0c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc409cdf0 con 0x7ffbc406da90 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbcae0c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc409d0d0 con 0x7ffbc40d34a0 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbc406da90 0x7ffbc406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbc406da90 0x7ffbc406e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42600/0 (socket says 172.21.15.80:42600) 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc93a9640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffbc406eaa0 0x7ffbc40b3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40914/0 (socket says 172.21.15.80:40914) 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 -- 172.21.15.80:0/3209705025 learned_addr learned my addr 172.21.15.80:0/3209705025 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc8ba8640 1 --2- 172.21.15.80:0/3209705025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc40b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 -- 172.21.15.80:0/3209705025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 msgr2=0x7ffbc40b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 --2- 172.21.15.80:0/3209705025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc40b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 -- 172.21.15.80:0/3209705025 >> v1:172.21.15.80:6789/0 conn(0x7ffbc406eaa0 legacy=0x7ffbc40b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc3fff640 1 -- 172.21.15.80:0/3209705025 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40d2f50 con 0x7ffbc406da90 2024-04-25T15:44:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.985+0000 7ffbc37fe640 1 -- 172.21.15.80:0/3209705025 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272300920 0 0) 0x7ffbc40d1010 con 0x7ffbc406eaa0 2024-04-25T15:44:10.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.986+0000 7ffbc3fff640 1 --2- 172.21.15.80:0/3209705025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406da90 0x7ffbc406e560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009870 tx=0x7ffbb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3205e4a8f9b74a76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.986+0000 7ffbc37fe640 1 -- 172.21.15.80:0/3209705025 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8037070 con 0x7ffbc406da90 2024-04-25T15:44:10.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.986+0000 7ffbc37fe640 1 -- 172.21.15.80:0/3209705025 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8032440 con 0x7ffbc406da90 2024-04-25T15:44:10.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.986+0000 7ffbc37fe640 1 -- 172.21.15.80:0/3209705025 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8032810 con 0x7ffbc406da90 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 -- 172.21.15.80:0/3209705025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406da90 msgr2=0x7ffbc406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/3209705025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406da90 0x7ffbc406e560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009870 tx=0x7ffbb802a270 comp rx=0 tx=0).stop 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 -- 172.21.15.80:0/3209705025 shutdown_connections 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/3209705025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406da90 0x7ffbc406e560 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/3209705025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc40b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 -- 172.21.15.80:0/3209705025 >> 172.21.15.80:0/3209705025 conn(0x7ffbc40d0450 msgr2=0x7ffbc40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 -- 172.21.15.80:0/3209705025 shutdown_connections 2024-04-25T15:44:10.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.987+0000 7ffbcae0c640 1 -- 172.21.15.80:0/3209705025 wait complete. 2024-04-25T15:44:10.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.989+0000 7ffbcae0c640 1 Processor -- start 2024-04-25T15:44:10.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.989+0000 7ffbcae0c640 1 -- start start 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbcae0c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc406da90 0x7ffbc40c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbcae0c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 0x7ffbc40a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbcae0c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc4159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbcae0c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40b41d0 con 0x7ffbc406eaa0 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbcae0c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc406d7b0 con 0x7ffbc406da90 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbcae0c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40b4350 con 0x7ffbc40d34a0 2024-04-25T15:44:10.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 0x7ffbc40a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 0x7ffbc40a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42604/0 (socket says 172.21.15.80:42604) 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbc3fff640 1 -- 172.21.15.80:0/1023183683 learned_addr learned my addr 172.21.15.80:0/1023183683 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.990+0000 7ffbc8ba8640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc406da90 0x7ffbc40c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc93a9640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc4159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc3fff640 1 -- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 msgr2=0x7ffbc4159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc3fff640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc4159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc3fff640 1 -- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc406da90 msgr2=0x7ffbc40c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc3fff640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc406da90 0x7ffbc40c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc3fff640 1 -- 172.21.15.80:0/1023183683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc415a3f0 con 0x7ffbc406eaa0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc3fff640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 0x7ffbc40a1260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009870 tx=0x7ffbb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8037040 con 0x7ffbc406eaa0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8004030 con 0x7ffbc406eaa0 2024-04-25T15:44:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc40a01c0 con 0x7ffbc406eaa0 2024-04-25T15:44:10.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004440 con 0x7ffbc406eaa0 2024-04-25T15:44:10.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.991+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc40a0780 con 0x7ffbc406eaa0 2024-04-25T15:44:10.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.992+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc406a100 con 0x7ffbc406eaa0 2024-04-25T15:44:10.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.993+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffbb803a070 con 0x7ffbc406eaa0 2024-04-25T15:44:10.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.993+0000 7ffbc17fa640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffbb00744b0 0x7ffbb00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:10.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.993+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ffbb80b5780 con 0x7ffbc406eaa0 2024-04-25T15:44:10.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.993+0000 7ffbc8ba8640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffbb00744b0 0x7ffbb00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:10.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.994+0000 7ffbc8ba8640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffbb00744b0 0x7ffbb00769c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400b9f0 tx=0x7ffbb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:10.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:10.998+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffbb8041020 con 0x7ffbc406eaa0 2024-04-25T15:44:11.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.240+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7ffbc40b52a0 con 0x7ffbc406eaa0 2024-04-25T15:44:11.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.245+0000 7ffbc17fa640 1 -- 172.21.15.80:0/1023183683 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ffbb80800e0 con 0x7ffbc406eaa0 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffbb00744b0 msgr2=0x7ffbb00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffbb00744b0 0x7ffbb00769c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400b9f0 tx=0x7ffbb4008040 comp rx=0 tx=0).stop 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 msgr2=0x7ffbc40a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 0x7ffbc40a1260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009870 tx=0x7ffbb80046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 shutdown_connections 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffbb00744b0 0x7ffbb00769c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc40d34a0 0x7ffbc4159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc406eaa0 0x7ffbc40a1260 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 --2- 172.21.15.80:0/1023183683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc406da90 0x7ffbc40c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 >> 172.21.15.80:0/1023183683 conn(0x7ffbc40d0450 msgr2=0x7ffbc4072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:11.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 shutdown_connections 2024-04-25T15:44:11.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.247+0000 7ffbcae0c640 1 -- 172.21.15.80:0/1023183683 wait complete. 2024-04-25T15:44:11.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:11.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.369+0000 7fe1a268c640 1 Processor -- start 2024-04-25T15:44:11.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.369+0000 7fe1a268c640 1 -- start start 2024-04-25T15:44:11.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a268c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c15d310 0x7fe19c09b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a268c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe19c0d2ed0 0x7fe19c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a268c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19c06e990 con 0x7fe19c0cfcd0 2024-04-25T15:44:11.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a268c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c0d0610 con 0x7fe19c0d2ed0 2024-04-25T15:44:11.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a268c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c06ec00 con 0x7fe19c15d310 2024-04-25T15:44:11.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a0c29640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe19c0d2ed0 0x7fe19c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.370+0000 7fe1a0c29640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe19c0d2ed0 0x7fe19c0d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42614/0 (socket says 172.21.15.80:42614) 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe1a0c29640 1 -- 172.21.15.80:0/3497741520 learned_addr learned my addr 172.21.15.80:0/3497741520 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe19bfff640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c15d310 0x7fe19c09b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe1a0c29640 1 -- 172.21.15.80:0/3497741520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c15d310 msgr2=0x7fe19c09b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe1a0c29640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c15d310 0x7fe19c09b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe1a0c29640 1 -- 172.21.15.80:0/3497741520 >> v1:172.21.15.195:6789/0 conn(0x7fe19c0cfcd0 legacy=0x7fe19c0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe1a0c29640 1 -- 172.21.15.80:0/3497741520 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c06eee0 con 0x7fe19c0d2ed0 2024-04-25T15:44:11.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.371+0000 7fe19bfff640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c15d310 0x7fe19c09b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:11.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.372+0000 7fe1a0c29640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0d2ed0 0x7fe19c0d0d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe194009e50 tx=0x7fe19402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8067c46a378353e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.372+0000 7fe19affd640 1 -- 172.21.15.80:0/3497741520 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194036070 con 0x7fe19c0d2ed0 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.372+0000 7fe19affd640 1 -- 172.21.15.80:0/3497741520 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe194031600 con 0x7fe19c0d2ed0 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.372+0000 7fe19affd640 1 -- 172.21.15.80:0/3497741520 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1940319d0 con 0x7fe19c0d2ed0 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.372+0000 7fe1a268c640 1 -- 172.21.15.80:0/3497741520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0d2ed0 msgr2=0x7fe19c0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.372+0000 7fe1a268c640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0d2ed0 0x7fe19c0d0d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe194009e50 tx=0x7fe19402a6d0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.373+0000 7fe1a268c640 1 -- 172.21.15.80:0/3497741520 shutdown_connections 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.373+0000 7fe1a268c640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0d2ed0 0x7fe19c0d0d80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.373+0000 7fe1a268c640 1 --2- 172.21.15.80:0/3497741520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c15d310 0x7fe19c09b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.373+0000 7fe1a268c640 1 -- 172.21.15.80:0/3497741520 >> 172.21.15.80:0/3497741520 conn(0x7fe19c0b7750 msgr2=0x7fe19c0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.373+0000 7fe1a268c640 1 -- 172.21.15.80:0/3497741520 shutdown_connections 2024-04-25T15:44:11.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.373+0000 7fe1a268c640 1 -- 172.21.15.80:0/3497741520 wait complete. 2024-04-25T15:44:11.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.374+0000 7fe1a268c640 1 Processor -- start 2024-04-25T15:44:11.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.375+0000 7fe1a268c640 1 -- start start 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a268c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c0cfcd0 0x7fe19c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a268c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe19c15d310 0x7fe19c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a268c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 0x7fe19c06c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a268c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0d12c0 con 0x7fe19c0c7b70 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a268c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0d02f0 con 0x7fe19c15d310 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a268c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0d1440 con 0x7fe19c0cfcd0 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 0x7fe19c06c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 0x7fe19c06c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42622/0 (socket says 172.21.15.80:42622) 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 -- 172.21.15.80:0/716186481 learned_addr learned my addr 172.21.15.80:0/716186481 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe19b7fe640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe19c15d310 0x7fe19c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe19bfff640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c0cfcd0 0x7fe19c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 -- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c0cfcd0 msgr2=0x7fe19c159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c0cfcd0 0x7fe19c159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 -- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe19c15d310 msgr2=0x7fe19c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe19c15d310 0x7fe19c0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.376+0000 7fe1a0c29640 1 -- 172.21.15.80:0/716186481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c15a2d0 con 0x7fe19c0c7b70 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe19b7fe640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe19c15d310 0x7fe19c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe19bfff640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c0cfcd0 0x7fe19c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe1a0c29640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 0x7fe19c06c5c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe194009e50 tx=0x7fe194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194036050 con 0x7fe19c0c7b70 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe194042070 con 0x7fe19c0c7b70 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c0c69d0 con 0x7fe19c0c7b70 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194009510 con 0x7fe19c0c7b70 2024-04-25T15:44:11.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.377+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c0c6f90 con 0x7fe19c0c7b70 2024-04-25T15:44:11.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.378+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c06a100 con 0x7fe19c0c7b70 2024-04-25T15:44:11.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.378+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe194007bf0 con 0x7fe19c0c7b70 2024-04-25T15:44:11.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.379+0000 7fe198ff9640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1880744b0 0x7fe1880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.379+0000 7fe19bfff640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1880744b0 0x7fe1880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.379+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fe1940b6020 con 0x7fe19c0c7b70 2024-04-25T15:44:11.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.379+0000 7fe19bfff640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1880744b0 0x7fe1880769c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe18c006fd0 tx=0x7fe18c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:11.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.384+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe194080970 con 0x7fe19c0c7b70 2024-04-25T15:44:11.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.559+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe19c0b2a40 con 0x7fe19c0c7b70 2024-04-25T15:44:11.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.560+0000 7fe198ff9640 1 -- 172.21.15.80:0/716186481 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13152 (secure 0 0 0) 0x7fe194080270 con 0x7fe19c0c7b70 2024-04-25T15:44:11.561 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:11.561 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:08.567420+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1880744b0 msgr2=0x7fe1880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1880744b0 0x7fe1880769c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe18c006fd0 tx=0x7fe18c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 msgr2=0x7fe19c06c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 0x7fe19c06c5c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe194009e50 tx=0x7fe194004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 shutdown_connections 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1880744b0 0x7fe1880769c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe19c0c7b70 0x7fe19c06c5c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe19c15d310 0x7fe19c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 --2- 172.21.15.80:0/716186481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe19c0cfcd0 0x7fe19c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 >> 172.21.15.80:0/716186481 conn(0x7fe19c0b7750 msgr2=0x7fe19c071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 shutdown_connections 2024-04-25T15:44:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.562+0000 7fe1a268c640 1 -- 172.21.15.80:0/716186481 wait complete. 2024-04-25T15:44:11.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:11.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.684+0000 7f5b0e296640 1 Processor -- start 2024-04-25T15:44:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.684+0000 7f5b0e296640 1 -- start start 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b0e296640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b0806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b0e296640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b08163960 0x7f5b0806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b0e296640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0806db60 con 0x7f5b0806d750 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b0e296640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5b080cc710 con 0x7f5b08163960 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b0e296640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5b080cc9f0 con 0x7f5b080b7540 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b08163960 0x7f5b0806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b08163960 0x7f5b0806d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42630/0 (socket says 172.21.15.80:42630) 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 -- 172.21.15.80:0/2506121881 learned_addr learned my addr 172.21.15.80:0/2506121881 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b07fff640 1 --2- 172.21.15.80:0/2506121881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b0806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 -- 172.21.15.80:0/2506121881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 msgr2=0x7f5b0806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 --2- 172.21.15.80:0/2506121881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b0806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 -- 172.21.15.80:0/2506121881 >> v1:172.21.15.195:6789/0 conn(0x7f5b0806d750 legacy=0x7f5b080cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.686+0000 7f5b077fe640 1 -- 172.21.15.80:0/2506121881 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b080cccd0 con 0x7f5b08163960 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.687+0000 7f5b077fe640 1 --2- 172.21.15.80:0/2506121881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b0806d210 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009870 tx=0x7f5af802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6582437b80316491 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.687+0000 7f5b06ffd640 1 -- 172.21.15.80:0/2506121881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8037070 con 0x7f5b08163960 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.687+0000 7f5b06ffd640 1 -- 172.21.15.80:0/2506121881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af8032440 con 0x7f5b08163960 2024-04-25T15:44:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.687+0000 7f5b06ffd640 1 -- 172.21.15.80:0/2506121881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8032810 con 0x7f5b08163960 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 -- 172.21.15.80:0/2506121881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 msgr2=0x7f5b0806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 --2- 172.21.15.80:0/2506121881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b0806d210 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009870 tx=0x7f5af802a210 comp rx=0 tx=0).stop 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 -- 172.21.15.80:0/2506121881 shutdown_connections 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 --2- 172.21.15.80:0/2506121881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b0806d210 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 --2- 172.21.15.80:0/2506121881 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b0806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 -- 172.21.15.80:0/2506121881 >> 172.21.15.80:0/2506121881 conn(0x7f5b0809b410 msgr2=0x7f5b080b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 -- 172.21.15.80:0/2506121881 shutdown_connections 2024-04-25T15:44:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.688+0000 7f5b0e296640 1 -- 172.21.15.80:0/2506121881 wait complete. 2024-04-25T15:44:11.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.690+0000 7f5b0e296640 1 Processor -- start 2024-04-25T15:44:11.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.690+0000 7f5b0e296640 1 -- start start 2024-04-25T15:44:11.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0e296640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0806d750 0x7f5b08070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0e296640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b08071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0e296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b080c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0e296640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b080b38e0 con 0x7f5b08163960 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0e296640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0806cdc0 con 0x7f5b0806d750 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0e296640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5b080d2040 con 0x7f5b080b7540 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0c833640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b080c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0c833640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b080c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42640/0 (socket says 172.21.15.80:42640) 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b0c833640 1 -- 172.21.15.80:0/3810824006 learned_addr learned my addr 172.21.15.80:0/3810824006 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b07fff640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0806d750 0x7f5b08070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.691+0000 7f5b077fe640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b08071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0c833640 1 -- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 msgr2=0x7f5b08071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0c833640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b08071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0c833640 1 -- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0806d750 msgr2=0x7f5b08070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0c833640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0806d750 0x7f5b08070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0c833640 1 -- 172.21.15.80:0/3810824006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0815ea50 con 0x7f5b08163960 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0c833640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b080c90d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000b9a0 tx=0x7f5b0000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00019070 con 0x7f5b08163960 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0000cba0 con 0x7f5b08163960 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0815ed30 con 0x7f5b08163960 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00014440 con 0x7f5b08163960 2024-04-25T15:44:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.692+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0815f2f0 con 0x7f5b08163960 2024-04-25T15:44:11.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.693+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0806a100 con 0x7f5b08163960 2024-04-25T15:44:11.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.694+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5b0001c070 con 0x7f5b08163960 2024-04-25T15:44:11.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.694+0000 7f5b04ff9640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af40744e0 0x7f5af40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.694+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f5b00094d60 con 0x7f5b08163960 2024-04-25T15:44:11.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.694+0000 7f5b07fff640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af40744e0 0x7f5af40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.695+0000 7f5b07fff640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af40744e0 0x7f5af40769f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b080cfab0 tx=0x7f5afc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:11.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.699+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b0005efe0 con 0x7f5b08163960 2024-04-25T15:44:11.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.874+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5b080b1a20 con 0x7f5b08163960 2024-04-25T15:44:11.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.874+0000 7f5b04ff9640 1 -- 172.21.15.80:0/3810824006 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f5b000632e0 con 0x7f5b08163960 2024-04-25T15:44:11.875 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af40744e0 msgr2=0x7f5af40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af40744e0 0x7f5af40769f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b080cfab0 tx=0x7f5afc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 msgr2=0x7f5b080c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b080c90d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000b9a0 tx=0x7f5b0000be60 comp rx=0 tx=0).stop 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 shutdown_connections 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af40744e0 0x7f5af40769f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08163960 0x7f5b080c90d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b080b7540 0x7f5b08071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 --2- 172.21.15.80:0/3810824006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0806d750 0x7f5b08070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 >> 172.21.15.80:0/3810824006 conn(0x7f5b0809b410 msgr2=0x7f5b08162140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 shutdown_connections 2024-04-25T15:44:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.876+0000 7f5b0e296640 1 -- 172.21.15.80:0/3810824006 wait complete. 2024-04-25T15:44:11.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:44:11.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.995+0000 7f4e523a8640 1 Processor -- start 2024-04-25T15:44:11.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.995+0000 7f4e523a8640 1 -- start start 2024-04-25T15:44:11.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e523a8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e4c06db10 0x7f4e4c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e523a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e4c0714a0 0x7f4e4c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:11.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e523a8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c071df0 con 0x7f4e4c06c5c0 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e523a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c15faf0 con 0x7f4e4c0714a0 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e523a8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c1589c0 con 0x7f4e4c06db10 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e4c0714a0 0x7f4e4c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e50945640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e4c06c5c0 0x7f4e4c06c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40924/0 (socket says 172.21.15.80:40924) 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e4c0714a0 0x7f4e4c0718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42656/0 (socket says 172.21.15.80:42656) 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e50945640 1 -- 172.21.15.80:0/1001276993 learned_addr learned my addr 172.21.15.80:0/1001276993 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4bfff640 1 --2- 172.21.15.80:0/1001276993 >> v2:172.21.15.195:3300/0 conn(0x7f4e4c06db10 0x7f4e4c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4b7fe640 1 -- 172.21.15.80:0/1001276993 >> v2:172.21.15.195:3300/0 conn(0x7f4e4c06db10 msgr2=0x7f4e4c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4b7fe640 1 --2- 172.21.15.80:0/1001276993 >> v2:172.21.15.195:3300/0 conn(0x7f4e4c06db10 0x7f4e4c15e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4b7fe640 1 -- 172.21.15.80:0/1001276993 >> v1:172.21.15.80:6789/0 conn(0x7f4e4c06c5c0 legacy=0x7f4e4c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4b7fe640 1 -- 172.21.15.80:0/1001276993 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c15ee90 con 0x7f4e4c0714a0 2024-04-25T15:44:11.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.997+0000 7f4e4affd640 1 -- 172.21.15.80:0/1001276993 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610957648 0 0) 0x7f4e44001490 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.998+0000 7f4e4b7fe640 1 --2- 172.21.15.80:0/1001276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c0714a0 0x7f4e4c0718b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c072ec0 tx=0x7f4e4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8409361ae1980c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.998+0000 7f4e4affd640 1 -- 172.21.15.80:0/1001276993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40037070 con 0x7f4e4c0714a0 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.998+0000 7f4e4affd640 1 -- 172.21.15.80:0/1001276993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e40032440 con 0x7f4e4c0714a0 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.998+0000 7f4e4affd640 1 -- 172.21.15.80:0/1001276993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4002ae60 con 0x7f4e4c0714a0 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 -- 172.21.15.80:0/1001276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c0714a0 msgr2=0x7f4e4c0718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 --2- 172.21.15.80:0/1001276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c0714a0 0x7f4e4c0718b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c072ec0 tx=0x7f4e4002a110 comp rx=0 tx=0).stop 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 -- 172.21.15.80:0/1001276993 shutdown_connections 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 --2- 172.21.15.80:0/1001276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c0714a0 0x7f4e4c0718b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 --2- 172.21.15.80:0/1001276993 >> v2:172.21.15.195:3300/0 conn(0x7f4e4c06db10 0x7f4e4c15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 -- 172.21.15.80:0/1001276993 >> 172.21.15.80:0/1001276993 conn(0x7f4e4c0d2080 msgr2=0x7f4e4c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 -- 172.21.15.80:0/1001276993 shutdown_connections 2024-04-25T15:44:12.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:11.999+0000 7f4e523a8640 1 -- 172.21.15.80:0/1001276993 wait complete. 2024-04-25T15:44:12.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.001+0000 7f4e523a8640 1 Processor -- start 2024-04-25T15:44:12.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.001+0000 7f4e523a8640 1 -- start start 2024-04-25T15:44:12.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e523a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 0x7f4e4c13ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e523a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e4c06db10 0x7f4e4c13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e523a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e4c0714a0 0x7f4e4c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e523a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c15f450 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e523a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c15f780 con 0x7f4e4c06db10 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e523a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c15ea60 con 0x7f4e4c0714a0 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 0x7f4e4c13ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e4bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 0x7f4e4c13ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42660/0 (socket says 172.21.15.80:42660) 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e4bfff640 1 -- 172.21.15.80:0/2939061368 learned_addr learned my addr 172.21.15.80:0/2939061368 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.002+0000 7f4e4b7fe640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e4c06db10 0x7f4e4c13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e50945640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e4c0714a0 0x7f4e4c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e4bfff640 1 -- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e4c0714a0 msgr2=0x7f4e4c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e4bfff640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e4c0714a0 0x7f4e4c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e4bfff640 1 -- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e4c06db10 msgr2=0x7f4e4c13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e4bfff640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e4c06db10 0x7f4e4c13a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e4bfff640 1 -- 172.21.15.80:0/2939061368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c13b8c0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e50945640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e4c0714a0 0x7f4e4c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e4bfff640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 0x7f4e4c13ae00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c7c0 tx=0x7f4e3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c015070 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c004220 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c13bba0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c007620 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.003+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c13c160 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.004+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4c06a100 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.005+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4e3c0077c0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.005+0000 7f4e48ff9640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e380744e0 0x7f4e380769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.005+0000 7f4e4b7fe640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e380744e0 0x7f4e380769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.005+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4e3c094df0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.006+0000 7f4e4b7fe640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e380744e0 0x7f4e380769f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e40034000 tx=0x7f4e4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:12.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.010+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e3c05f7d0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.183+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4e4c0cf9b0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.184+0000 7f4e48ff9640 1 -- 172.21.15.80:0/2939061368 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f4e3c05f0d0 con 0x7f4e4c06c5c0 2024-04-25T15:44:12.185 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:12.185 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:44:12.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:12.186 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:44:12.186 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:44:12.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:12.186 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:44:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e380744e0 msgr2=0x7f4e380769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e380744e0 0x7f4e380769f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e40034000 tx=0x7f4e4002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 msgr2=0x7f4e4c13ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 0x7f4e4c13ae00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c7c0 tx=0x7f4e3c00cc80 comp rx=0 tx=0).stop 2024-04-25T15:44:12.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 shutdown_connections 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e380744e0 0x7f4e380769f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e4c0714a0 0x7f4e4c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e4c06db10 0x7f4e4c13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 --2- 172.21.15.80:0/2939061368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e4c06c5c0 0x7f4e4c13ae00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 >> 172.21.15.80:0/2939061368 conn(0x7f4e4c0d2080 msgr2=0x7f4e4c1e4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 shutdown_connections 2024-04-25T15:44:12.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.186+0000 7f4e523a8640 1 -- 172.21.15.80:0/2939061368 wait complete. 2024-04-25T15:44:12.198 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:44:12.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:44:12.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.308+0000 7f2bc5d84640 1 Processor -- start 2024-04-25T15:44:12.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.308+0000 7f2bc5d84640 1 -- start start 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bc5d84640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d22c0 0x7f2bc00d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bc5d84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc0163200 0x7f2bc00ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bc5d84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc00d37e0 con 0x7f2bc01626e0 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bc5d84640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc009cd00 con 0x7f2bc00d22c0 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bc5d84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc00cfe50 con 0x7f2bc0163200 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bbf7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d22c0 0x7f2bc00d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bbffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc0163200 0x7f2bc00ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bbeffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2bc01626e0 0x7f2bc0162af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:37602/0 (socket says 172.21.15.80:37602) 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bbf7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2bc00d22c0 0x7f2bc00d26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:42374/0 (socket says 172.21.15.80:42374) 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.310+0000 7f2bbeffd640 1 -- 172.21.15.80:0/3237350039 learned_addr learned my addr 172.21.15.80:0/3237350039 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:12.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbf7fe640 1 -- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc0163200 msgr2=0x7f2bc00ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:12.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbf7fe640 1 --2- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc0163200 0x7f2bc00ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbf7fe640 1 -- 172.21.15.80:0/3237350039 >> v1:172.21.15.195:6789/0 conn(0x7f2bc01626e0 legacy=0x7f2bc0162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbf7fe640 1 -- 172.21.15.80:0/3237350039 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc00b8240 con 0x7f2bc00d22c0 2024-04-25T15:44:12.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbe7fc640 1 -- 172.21.15.80:0/3237350039 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351507893 0 0) 0x7f2bc00d37e0 con 0x7f2bc01626e0 2024-04-25T15:44:12.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbffff640 1 --2- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc0163200 0x7f2bc00ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:12.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.311+0000 7f2bbf7fe640 1 --2- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d22c0 0x7f2bc00d26d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009790 tx=0x7f2bb002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58546b8b3b70da07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:12.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bbe7fc640 1 -- 172.21.15.80:0/3237350039 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0037070 con 0x7f2bc00d22c0 2024-04-25T15:44:12.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bbe7fc640 1 -- 172.21.15.80:0/3237350039 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb002adb0 con 0x7f2bc00d22c0 2024-04-25T15:44:12.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bbe7fc640 1 -- 172.21.15.80:0/3237350039 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0032660 con 0x7f2bc00d22c0 2024-04-25T15:44:12.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 -- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d22c0 msgr2=0x7f2bc00d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d22c0 0x7f2bc00d26d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009790 tx=0x7f2bb002a060 comp rx=0 tx=0).stop 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 -- 172.21.15.80:0/3237350039 shutdown_connections 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc0163200 0x7f2bc00ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/3237350039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc00d22c0 0x7f2bc00d26d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 -- 172.21.15.80:0/3237350039 >> 172.21.15.80:0/3237350039 conn(0x7f2bc00d0450 msgr2=0x7f2bc00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 -- 172.21.15.80:0/3237350039 shutdown_connections 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.312+0000 7f2bc5d84640 1 -- 172.21.15.80:0/3237350039 wait complete. 2024-04-25T15:44:12.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.314+0000 7f2bc5d84640 1 Processor -- start 2024-04-25T15:44:12.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.314+0000 7f2bc5d84640 1 -- start start 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.315+0000 7f2bc5d84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc00d22c0 0x7f2bc014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.315+0000 7f2bc5d84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 0x7f2bc0150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.315+0000 7f2bc5d84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc0163200 0x7f2bc00c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.315+0000 7f2bc5d84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc009d190 con 0x7f2bc01626e0 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.315+0000 7f2bc5d84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc00cfb70 con 0x7f2bc0163200 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.315+0000 7f2bc5d84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc00d47e0 con 0x7f2bc00d22c0 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 0x7f2bc0150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 0x7f2bc0150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42674/0 (socket says 172.21.15.80:42674) 2024-04-25T15:44:12.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 -- 172.21.15.80:0/497906562 learned_addr learned my addr 172.21.15.80:0/497906562 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbf7fe640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc00d22c0 0x7f2bc014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbffff640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc0163200 0x7f2bc00c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 -- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc00d22c0 msgr2=0x7f2bc014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc00d22c0 0x7f2bc014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 -- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc0163200 msgr2=0x7f2bc00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc0163200 0x7f2bc00c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 -- 172.21.15.80:0/497906562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc0151180 con 0x7f2bc01626e0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bbeffd640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 0x7f2bc0150550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c440 tx=0x7f2bb400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40074e0 con 0x7f2bc01626e0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb40047e0 con 0x7f2bc01626e0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4004bd0 con 0x7f2bc01626e0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc0151460 con 0x7f2bc01626e0 2024-04-25T15:44:12.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.316+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc0151a20 con 0x7f2bc01626e0 2024-04-25T15:44:12.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.318+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc006a100 con 0x7f2bc01626e0 2024-04-25T15:44:12.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.318+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2bb4011070 con 0x7f2bc01626e0 2024-04-25T15:44:12.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.319+0000 7f2ba7fff640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bac0744b0 0x7f2bac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:12.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.319+0000 7f2bbf7fe640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bac0744b0 0x7f2bac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:12.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.319+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f2bb4094af0 con 0x7f2bc01626e0 2024-04-25T15:44:12.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.319+0000 7f2bbf7fe640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bac0744b0 0x7f2bac0769c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0034000 tx=0x7f2bb002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:12.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.323+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bb405f4d0 con 0x7f2bc01626e0 2024-04-25T15:44:12.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.495+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2bc00c7060 con 0x7f2bc01626e0 2024-04-25T15:44:12.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.879+0000 7f2ba7fff640 1 -- 172.21.15.80:0/497906562 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f2bb405edd0 con 0x7f2bc01626e0 2024-04-25T15:44:12.880 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:44:12.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bac0744b0 msgr2=0x7f2bac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bac0744b0 0x7f2bac0769c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0034000 tx=0x7f2bb002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:12.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 msgr2=0x7f2bc0150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 0x7f2bc0150550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c440 tx=0x7f2bb400c840 comp rx=0 tx=0).stop 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 shutdown_connections 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2bac0744b0 0x7f2bac0769c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc0163200 0x7f2bc00c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01626e0 0x7f2bc0150550 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 --2- 172.21.15.80:0/497906562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2bc00d22c0 0x7f2bc014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 >> 172.21.15.80:0/497906562 conn(0x7f2bc00d0450 msgr2=0x7f2bc0071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 shutdown_connections 2024-04-25T15:44:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:12.881+0000 7f2bc5d84640 1 -- 172.21.15.80:0/497906562 wait complete. 2024-04-25T15:44:12.899 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:44:13.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.011+0000 7ffbc7ae0640 1 Processor -- start 2024-04-25T15:44:13.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.011+0000 7ffbc7ae0640 1 -- start start 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc7ae0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc009bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc7ae0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbc00cfd70 0x7ffbc00d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc7ae0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc01607c0 con 0x7ffbc00cf960 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc7ae0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc00cf4d0 con 0x7ffbc00cfd70 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc7ae0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc00ce630 con 0x7ffbc00ce220 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbc00cfd70 0x7ffbc00d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbc00cfd70 0x7ffbc00d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42684/0 (socket says 172.21.15.80:42684) 2024-04-25T15:44:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 -- 172.21.15.80:0/467596146 learned_addr learned my addr 172.21.15.80:0/467596146 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc587c640 1 --2- 172.21.15.80:0/467596146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc009bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 -- 172.21.15.80:0/467596146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 msgr2=0x7ffbc009bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 --2- 172.21.15.80:0/467596146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc009bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 -- 172.21.15.80:0/467596146 >> v1:172.21.15.195:6789/0 conn(0x7ffbc00cf960 legacy=0x7ffbc00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.013+0000 7ffbc607d640 1 -- 172.21.15.80:0/467596146 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc00d0180 con 0x7ffbc00cfd70 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.014+0000 7ffbc607d640 1 --2- 172.21.15.80:0/467596146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc00d1a70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009e50 tx=0x7ffbb802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e65748a1436fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.014+0000 7ffbc487a640 1 -- 172.21.15.80:0/467596146 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8036070 con 0x7ffbc00cfd70 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.014+0000 7ffbc487a640 1 -- 172.21.15.80:0/467596146 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8031600 con 0x7ffbc00cfd70 2024-04-25T15:44:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.014+0000 7ffbc487a640 1 -- 172.21.15.80:0/467596146 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80319d0 con 0x7ffbc00cfd70 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/467596146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 msgr2=0x7ffbc00d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/467596146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc00d1a70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009e50 tx=0x7ffbb802a7a0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/467596146 shutdown_connections 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/467596146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc00d1a70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/467596146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc009bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/467596146 >> 172.21.15.80:0/467596146 conn(0x7ffbc00b7620 msgr2=0x7ffbc00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/467596146 shutdown_connections 2024-04-25T15:44:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.015+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/467596146 wait complete. 2024-04-25T15:44:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.017+0000 7ffbc7ae0640 1 Processor -- start 2024-04-25T15:44:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.017+0000 7ffbc7ae0640 1 -- start start 2024-04-25T15:44:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc7ae0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc7ae0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc00cf960 0x7ffbc014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc7ae0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc01629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc7ae0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00cf160 con 0x7ffbc00cfd70 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc7ae0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00cee80 con 0x7ffbc00cf960 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc7ae0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc009c0b0 con 0x7ffbc00ce220 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc01629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc01629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42690/0 (socket says 172.21.15.80:42690) 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 -- 172.21.15.80:0/1717730246 learned_addr learned my addr 172.21.15.80:0/1717730246 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc587c640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc507b640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc00cf960 0x7ffbc014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 -- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 msgr2=0x7ffbc014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 -- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc00cf960 msgr2=0x7ffbc014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc00cf960 0x7ffbc014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.018+0000 7ffbc607d640 1 -- 172.21.15.80:0/1717730246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc0150090 con 0x7ffbc00cfd70 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.019+0000 7ffbc607d640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc01629a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009e50 tx=0x7ffbb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.019+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8036050 con 0x7ffbc00cfd70 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.019+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8042070 con 0x7ffbc00cfd70 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.019+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc014cdb0 con 0x7ffbc00cfd70 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.019+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8009510 con 0x7ffbc00cfd70 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.019+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc014d730 con 0x7ffbc00cfd70 2024-04-25T15:44:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.020+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc006a100 con 0x7ffbc00cfd70 2024-04-25T15:44:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.020+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffbb8007b30 con 0x7ffbc00cfd70 2024-04-25T15:44:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.021+0000 7ffbb67fc640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffba40744b0 0x7ffba40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.021+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7ffbb80b5ed0 con 0x7ffbc00cfd70 2024-04-25T15:44:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.021+0000 7ffbc587c640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffba40744b0 0x7ffba40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.021+0000 7ffbc587c640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffba40744b0 0x7ffba40769c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0079a0 tx=0x7ffbbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:13.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.026+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffbc0150090 con 0x7ffbc00cfd70 2024-04-25T15:44:13.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.200+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ffbc00711f0 con 0x7ffbc00cfd70 2024-04-25T15:44:13.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.886+0000 7ffbb67fc640 1 -- 172.21.15.80:0/1717730246 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7ffbb8007e20 con 0x7ffbc00cfd70 2024-04-25T15:44:13.888 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:44:13.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffba40744b0 msgr2=0x7ffba40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:13.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffba40744b0 0x7ffba40769c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0079a0 tx=0x7ffbbc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:13.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 msgr2=0x7ffbc01629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:13.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc01629a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009e50 tx=0x7ffbb8004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 shutdown_connections 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ffba40744b0 0x7ffba40769c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbc00cfd70 0x7ffbc01629a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbc00cf960 0x7ffbc014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 --2- 172.21.15.80:0/1717730246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbc00ce220 0x7ffbc014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 >> 172.21.15.80:0/1717730246 conn(0x7ffbc00b7620 msgr2=0x7ffbc00705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 shutdown_connections 2024-04-25T15:44:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:13.890+0000 7ffbc7ae0640 1 -- 172.21.15.80:0/1717730246 wait complete. 2024-04-25T15:44:13.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:44:14.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.031+0000 7fb9dca92640 1 Processor -- start 2024-04-25T15:44:14.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.031+0000 7fb9dca92640 1 -- start start 2024-04-25T15:44:14.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9dca92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d809b410 0x7fb9d809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:14.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9dca92640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9d80d2190 0x7fb9d80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:14.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9dca92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d8160760 con 0x7fb9d80d3110 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9dca92640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d809b920 con 0x7fb9d80d2190 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9dca92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d80b3410 con 0x7fb9d809b410 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9d6d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9d80d2190 0x7fb9d80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9d6d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9d80d2190 0x7fb9d80cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42700/0 (socket says 172.21.15.80:42700) 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.032+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/1036623968 learned_addr learned my addr 172.21.15.80:0/1036623968 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/1036623968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d809b410 msgr2=0x7fb9d809bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d6d9d640 1 --2- 172.21.15.80:0/1036623968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d809b410 0x7fb9d809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/1036623968 >> v1:172.21.15.80:6789/0 conn(0x7fb9d80d3110 legacy=0x7fb9d80d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d5d9b640 1 -- 172.21.15.80:0/1036623968 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000033482 0 0) 0x7fb9d8160760 con 0x7fb9d80d3110 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/1036623968 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d80b3c00 con 0x7fb9d80d2190 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d6d9d640 1 --2- 172.21.15.80:0/1036623968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d2190 0x7fb9d80cef60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009e50 tx=0x7fb9d002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899b1df0272ad011 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d5d9b640 1 -- 172.21.15.80:0/1036623968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0036070 con 0x7fb9d80d2190 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.033+0000 7fb9d5d9b640 1 -- 172.21.15.80:0/1036623968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0031600 con 0x7fb9d80d2190 2024-04-25T15:44:14.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9d5d9b640 1 -- 172.21.15.80:0/1036623968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00319d0 con 0x7fb9d80d2190 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 -- 172.21.15.80:0/1036623968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d2190 msgr2=0x7fb9d80cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 --2- 172.21.15.80:0/1036623968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d2190 0x7fb9d80cef60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009e50 tx=0x7fb9d002a710 comp rx=0 tx=0).stop 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 -- 172.21.15.80:0/1036623968 shutdown_connections 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 --2- 172.21.15.80:0/1036623968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d2190 0x7fb9d80cef60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 --2- 172.21.15.80:0/1036623968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d809b410 0x7fb9d809bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 -- 172.21.15.80:0/1036623968 >> 172.21.15.80:0/1036623968 conn(0x7fb9d80b7620 msgr2=0x7fb9d80b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 -- 172.21.15.80:0/1036623968 shutdown_connections 2024-04-25T15:44:14.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.034+0000 7fb9dca92640 1 -- 172.21.15.80:0/1036623968 wait complete. 2024-04-25T15:44:14.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.036+0000 7fb9dca92640 1 Processor -- start 2024-04-25T15:44:14.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.036+0000 7fb9dca92640 1 -- start start 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.037+0000 7fb9dca92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9d809b410 0x7fb9d8157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d80d2190 0x7fb9d815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 0x7fb9d8071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d80cea40 con 0x7fb9d80d3110 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d80b41a0 con 0x7fb9d809b410 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d80cf4a0 con 0x7fb9d80d2190 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 0x7fb9d8071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 0x7fb9d8071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42710/0 (socket says 172.21.15.80:42710) 2024-04-25T15:44:14.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/2151035558 learned_addr learned my addr 172.21.15.80:0/2151035558 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9cffff640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d80d2190 0x7fb9d815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d659c640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9d809b410 0x7fb9d8157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d80d2190 msgr2=0x7fb9d815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d80d2190 0x7fb9d815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9d809b410 msgr2=0x7fb9d8157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9d809b410 0x7fb9d8157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 -- 172.21.15.80:0/2151035558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d815efd0 con 0x7fb9d80d3110 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d659c640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9d809b410 0x7fb9d8157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9d6d9d640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 0x7fb9d8071890 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009e50 tx=0x7fb9d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0041070 con 0x7fb9d80d3110 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0003990 con 0x7fb9d80d3110 2024-04-25T15:44:14.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d815f2b0 con 0x7fb9d80d3110 2024-04-25T15:44:14.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0036040 con 0x7fb9d80d3110 2024-04-25T15:44:14.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.038+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d81f6b70 con 0x7fb9d80d3110 2024-04-25T15:44:14.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.039+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d806a100 con 0x7fb9d80d3110 2024-04-25T15:44:14.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.040+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9d0007800 con 0x7fb9d80d3110 2024-04-25T15:44:14.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.041+0000 7fb9ceffd640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9b80744b0 0x7fb9b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:14.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.041+0000 7fb9d659c640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9b80744b0 0x7fb9b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:14.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.041+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7fb9d00b5ee0 con 0x7fb9d80d3110 2024-04-25T15:44:14.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.041+0000 7fb9d659c640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9b80744b0 0x7fb9b80769c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a870 tx=0x7fb9c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:14.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.046+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9d004b020 con 0x7fb9d80d3110 2024-04-25T15:44:14.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.257+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb9d80b2ce0 con 0x7fb9d80d3110 2024-04-25T15:44:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.888+0000 7fb9ceffd640 1 -- 172.21.15.80:0/2151035558 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb9d0080040 con 0x7fb9d80d3110 2024-04-25T15:44:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 5 and data pool 6 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9b80744b0 msgr2=0x7fb9b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9b80744b0 0x7fb9b80769c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a870 tx=0x7fb9c8008040 comp rx=0 tx=0).stop 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 msgr2=0x7fb9d8071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 0x7fb9d8071890 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009e50 tx=0x7fb9d0004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 shutdown_connections 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9b80744b0 0x7fb9b80769c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d80d3110 0x7fb9d8071890 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9d80d2190 0x7fb9d815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 --2- 172.21.15.80:0/2151035558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9d809b410 0x7fb9d8157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 >> 172.21.15.80:0/2151035558 conn(0x7fb9d80b7620 msgr2=0x7fb9d80cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 shutdown_connections 2024-04-25T15:44:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:14.892+0000 7fb9dca92640 1 -- 172.21.15.80:0/2151035558 wait complete. 2024-04-25T15:44:14.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.029+0000 7f58d2fc5640 1 Processor -- start 2024-04-25T15:44:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.029+0000 7f58d2fc5640 1 -- start start 2024-04-25T15:44:15.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d2fc5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58cc0d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d2fc5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58cc06c660 con 0x7f58cc09bea0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d2fc5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58cc0d3180 con 0x7f58cc06d0d0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d2fc5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f58cc06cc40 con 0x7f58cc0d2830 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d0d61640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f58cc09bea0 0x7f58cc0ce380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51058/0 (socket says 172.21.15.80:51058) 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d0d61640 1 -- 172.21.15.80:0/3659180080 learned_addr learned my addr 172.21.15.80:0/3659180080 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cbfff640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58cc0d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983397157 0 0) 0x7f58cc06c660 con 0x7f58cc09bea0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b4003520 con 0x7f58cc09bea0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449254994 0 0) 0x7f58c4001490 con 0x7f58cc06d0d0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58cc06c660 con 0x7f58cc06d0d0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1857222338 0 0) 0x7f58b4003520 con 0x7f58cc09bea0 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 msgr2=0x7f58cc0d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58cc0d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 >> v1:172.21.15.195:6789/0 conn(0x7f58cc06d0d0 legacy=0x7f58cc06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc0cea90 con 0x7f58cc09bea0 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f58bc001670 con 0x7f58cc09bea0 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cbfff640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58cc0d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 >> v1:172.21.15.80:6789/0 conn(0x7f58cc09bea0 legacy=0x7f58cc0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58b4003b70 0x7f58b4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4004800 0x7f58b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58b40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc06cc40 con 0x7f58b4003b70 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f58b400bad0 con 0x7f58b4004800 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f58b400bcd0 con 0x7f58cc0d2830 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d0d61640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58b4003b70 0x7f58b4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58cbfff640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4004800 0x7f58b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.031+0000 7f58d1562640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58b40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58d0d61640 1 -- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 msgr2=0x7f58b40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58d0d61640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58cc0d2830 0x7f58b40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58d0d61640 1 -- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4004800 msgr2=0x7f58b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58d0d61640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4004800 0x7f58b4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58d0d61640 1 -- 172.21.15.80:0/3659180080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b4003520 con 0x7f58b4003b70 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58cbfff640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4004800 0x7f58b4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58d0d61640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58b4003b70 0x7f58b4003fc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f58cc09c430 tx=0x7f58b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c9cfbbefa6af34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc007c40 con 0x7f58b4003b70 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc005ad0 con 0x7f58b4003b70 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.032+0000 7f58cb7fe640 1 -- 172.21.15.80:0/3659180080 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc007070 con 0x7f58b4003b70 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d2fc5640 1 -- 172.21.15.80:0/3659180080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58b4003b70 msgr2=0x7f58b4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/3659180080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58b4003b70 0x7f58b4003fc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f58cc09c430 tx=0x7f58b4005830 comp rx=0 tx=0).stop 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d1562640 1 -- 172.21.15.80:0/3659180080 reap_dead start 2024-04-25T15:44:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d2fc5640 1 -- 172.21.15.80:0/3659180080 shutdown_connections 2024-04-25T15:44:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d2fc5640 1 -- 172.21.15.80:0/3659180080 >> 172.21.15.80:0/3659180080 conn(0x7f58cc0b7620 msgr2=0x7f58cc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d2fc5640 1 -- 172.21.15.80:0/3659180080 shutdown_connections 2024-04-25T15:44:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.033+0000 7f58d2fc5640 1 -- 172.21.15.80:0/3659180080 wait complete. 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.035+0000 7f58d2fc5640 1 Processor -- start 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.035+0000 7f58d2fc5640 1 -- start start 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.036+0000 7f58d2fc5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58b4003b70 0x7f58cc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.036+0000 7f58d2fc5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 0x7f58cc0c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.036+0000 7f58d2fc5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc0c6a80 0x7f58cc0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.036+0000 7f58d2fc5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc15e420 con 0x7f58cc0c6670 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.036+0000 7f58d2fc5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc06c8d0 con 0x7f58cc0c6a80 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.036+0000 7f58d2fc5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f58cc0cf040 con 0x7f58b4003b70 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 0x7f58cc0c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 0x7f58cc0c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41116/0 (socket says 172.21.15.80:41116) 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 -- 172.21.15.80:0/4260538038 learned_addr learned my addr 172.21.15.80:0/4260538038 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58d0d61640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58b4003b70 0x7f58cc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58d1562640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc0c6a80 0x7f58cc0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 -- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58b4003b70 msgr2=0x7f58cc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58b4003b70 0x7f58cc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 -- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc0c6a80 msgr2=0x7f58cc0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc0c6a80 0x7f58cc0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 -- 172.21.15.80:0/4260538038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc0c7f10 con 0x7f58cc0c6670 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58d1562640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc0c6a80 0x7f58cc0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58cbfff640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 0x7f58cc0c7000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58c0011570 tx=0x7f58c0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0015870 con 0x7f58cc0c6670 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c0015a10 con 0x7f58cc0c6670 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0015de0 con 0x7f58cc0c6670 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc0c81f0 con 0x7f58cc0c6670 2024-04-25T15:44:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.037+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58cc0c87b0 con 0x7f58cc0c6670 2024-04-25T15:44:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.038+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58cc0c7c80 con 0x7f58cc0c6670 2024-04-25T15:44:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.039+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f58c000f460 con 0x7f58cc0c6670 2024-04-25T15:44:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.039+0000 7f58c97fa640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58b80744e0 0x7f58b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.040+0000 7f58d0d61640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58b80744e0 0x7f58b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.040+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f58c0095ce0 con 0x7f58cc0c6670 2024-04-25T15:44:15.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.040+0000 7f58d0d61640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58b80744e0 0x7f58b80769f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58bc032000 tx=0x7f58bc02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.044+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58c0019030 con 0x7f58cc0c6670 2024-04-25T15:44:15.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.221+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58cc06a100 con 0x7f58cc0c6670 2024-04-25T15:44:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.222+0000 7f58c97fa640 1 -- 172.21.15.80:0/4260538038 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16943 (secure 0 0 0) 0x7f58c00603a0 con 0x7f58cc0c6670 2024-04-25T15:44:15.223 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:15.223 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:14.259053+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58b80744e0 msgr2=0x7f58b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58b80744e0 0x7f58b80769f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58bc032000 tx=0x7f58bc02d000 comp rx=0 tx=0).stop 2024-04-25T15:44:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 msgr2=0x7f58cc0c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 0x7f58cc0c7000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58c0011570 tx=0x7f58c0011a30 comp rx=0 tx=0).stop 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 shutdown_connections 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58b80744e0 0x7f58b80769f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc0c6a80 0x7f58cc0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58cc0c6670 0x7f58cc0c7000 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 --2- 172.21.15.80:0/4260538038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58b4003b70 0x7f58cc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 >> 172.21.15.80:0/4260538038 conn(0x7f58cc0b7620 msgr2=0x7f58cc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 shutdown_connections 2024-04-25T15:44:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.224+0000 7f58d2fc5640 1 -- 172.21.15.80:0/4260538038 wait complete. 2024-04-25T15:44:15.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.344+0000 7f1545a34640 1 Processor -- start 2024-04-25T15:44:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.344+0000 7f1545a34640 1 -- start start 2024-04-25T15:44:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f1545a34640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15400d41b0 0x7f15400b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f1545a34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15400b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f1545a34640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15400b7fa0 con 0x7f15400b7b90 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f1545a34640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f15400d59d0 con 0x7f15400d41b0 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f1545a34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1540163fb0 con 0x7f15401602a0 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f153effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15400d41b0 0x7f15400b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f153effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15400d41b0 0x7f15400b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41132/0 (socket says 172.21.15.80:41132) 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.345+0000 7f153effd640 1 -- 172.21.15.80:0/4135376423 learned_addr learned my addr 172.21.15.80:0/4135376423 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153e7fc640 1 --2- 172.21.15.80:0/4135376423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15400b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153effd640 1 -- 172.21.15.80:0/4135376423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 msgr2=0x7f15400b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153effd640 1 --2- 172.21.15.80:0/4135376423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15400b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153effd640 1 -- 172.21.15.80:0/4135376423 >> v1:172.21.15.80:6789/0 conn(0x7f15400b7b90 legacy=0x7f15400d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153dffb640 1 -- 172.21.15.80:0/4135376423 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314745824 0 0) 0x7f1538001490 con 0x7f15400b7b90 2024-04-25T15:44:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153effd640 1 -- 172.21.15.80:0/4135376423 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1540164270 con 0x7f15400d41b0 2024-04-25T15:44:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.346+0000 7f153effd640 1 --2- 172.21.15.80:0/4135376423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400d41b0 0x7f15400b48d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1530009870 tx=0x7f153002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531fc4cec8e62cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f153dffb640 1 -- 172.21.15.80:0/4135376423 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530037070 con 0x7f15400d41b0 2024-04-25T15:44:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f153dffb640 1 -- 172.21.15.80:0/4135376423 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1530032440 con 0x7f15400d41b0 2024-04-25T15:44:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f153dffb640 1 -- 172.21.15.80:0/4135376423 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530032810 con 0x7f15400d41b0 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 -- 172.21.15.80:0/4135376423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400d41b0 msgr2=0x7f15400b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 --2- 172.21.15.80:0/4135376423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400d41b0 0x7f15400b48d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1530009870 tx=0x7f153002a270 comp rx=0 tx=0).stop 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 -- 172.21.15.80:0/4135376423 shutdown_connections 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 --2- 172.21.15.80:0/4135376423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15400b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 --2- 172.21.15.80:0/4135376423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400d41b0 0x7f15400b48d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 -- 172.21.15.80:0/4135376423 >> 172.21.15.80:0/4135376423 conn(0x7f154006e9f0 msgr2=0x7f15400d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 -- 172.21.15.80:0/4135376423 shutdown_connections 2024-04-25T15:44:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.347+0000 7f1545a34640 1 -- 172.21.15.80:0/4135376423 wait complete. 2024-04-25T15:44:15.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.349+0000 7f1545a34640 1 Processor -- start 2024-04-25T15:44:15.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.349+0000 7f1545a34640 1 -- start start 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.350+0000 7f1545a34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 0x7f1540155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.350+0000 7f1545a34640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15400d41b0 0x7f15400c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.350+0000 7f1545a34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15401ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.350+0000 7f1545a34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1540164b10 con 0x7f15400b7b90 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.350+0000 7f1545a34640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1540164830 con 0x7f15400d41b0 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.350+0000 7f1545a34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f15400b4fd0 con 0x7f15401602a0 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 0x7f1540155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 0x7f1540155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41146/0 (socket says 172.21.15.80:41146) 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 -- 172.21.15.80:0/2645362813 learned_addr learned my addr 172.21.15.80:0/2645362813 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153e7fc640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15400d41b0 0x7f15400c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153f7fe640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15401ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 -- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 msgr2=0x7f15401ebf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15401ebf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 -- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15400d41b0 msgr2=0x7f15400c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15400d41b0 0x7f15400c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 -- 172.21.15.80:0/2645362813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15401587d0 con 0x7f15400b7b90 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153e7fc640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15400d41b0 0x7f15400c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f153effd640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 0x7f1540155dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f153002a2b0 tx=0x7f15300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530037040 con 0x7f15400b7b90 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1530042070 con 0x7f15400b7b90 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1540158ab0 con 0x7f15400b7b90 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530030880 con 0x7f15400b7b90 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.351+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1540159070 con 0x7f15400b7b90 2024-04-25T15:44:15.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.352+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154006a100 con 0x7f15400b7b90 2024-04-25T15:44:15.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.353+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1530030a20 con 0x7f15400b7b90 2024-04-25T15:44:15.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.353+0000 7f1527fff640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f152c0744e0 0x7f152c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.353+0000 7f153e7fc640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f152c0744e0 0x7f152c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.354+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f15300b5c30 con 0x7f15400b7b90 2024-04-25T15:44:15.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.354+0000 7f153e7fc640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f152c0744e0 0x7f152c0769f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1540163a90 tx=0x7f1534008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.358+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15300802c0 con 0x7f15400b7b90 2024-04-25T15:44:15.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.533+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15400d3070 con 0x7f15400b7b90 2024-04-25T15:44:15.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.534+0000 7f1527fff640 1 -- 172.21.15.80:0/2645362813 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16943 (secure 0 0 0) 0x7f153007fbc0 con 0x7f15400b7b90 2024-04-25T15:44:15.536 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:15.536 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:14.259053+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:15.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f152c0744e0 msgr2=0x7f152c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f152c0744e0 0x7f152c0769f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1540163a90 tx=0x7f1534008040 comp rx=0 tx=0).stop 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 msgr2=0x7f1540155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 0x7f1540155dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f153002a2b0 tx=0x7f15300046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 shutdown_connections 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f152c0744e0 0x7f152c0769f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15401602a0 0x7f15401ebf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15400d41b0 0x7f15400c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 --2- 172.21.15.80:0/2645362813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15400b7b90 0x7f1540155dd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 >> 172.21.15.80:0/2645362813 conn(0x7f154006e9f0 msgr2=0x7f15400d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 shutdown_connections 2024-04-25T15:44:15.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.536+0000 7f1545a34640 1 -- 172.21.15.80:0/2645362813 wait complete. 2024-04-25T15:44:15.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:44:15.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.657+0000 7fa5abecd640 1 Processor -- start 2024-04-25T15:44:15.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.658+0000 7fa5abecd640 1 -- start start 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5abecd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa5a406eba0 0x7fa5a40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5abecd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a40ce590 con 0x7fa5a406c5c0 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5abecd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a409c320 con 0x7fa5a406e790 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5abecd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a40ce360 con 0x7fa5a406eba0 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5a9c69640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa5a406c5c0 0x7fa5a40d2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51074/0 (socket says 172.21.15.80:51074) 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5a9c69640 1 -- 172.21.15.80:0/3328706212 learned_addr learned my addr 172.21.15.80:0/3328706212 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5aa46a640 1 --2- 172.21.15.80:0/3328706212 >> v2:172.21.15.80:3300/0 conn(0x7fa5a406eba0 0x7fa5a40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5a8c67640 1 -- 172.21.15.80:0/3328706212 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324764801 0 0) 0x7fa5a40ce590 con 0x7fa5a406c5c0 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5a8c67640 1 -- 172.21.15.80:0/3328706212 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa590003520 con 0x7fa5a406c5c0 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5aa46a640 1 -- 172.21.15.80:0/3328706212 >> v1:172.21.15.195:6789/0 conn(0x7fa5a406e790 legacy=0x7fa5a40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5aa46a640 1 -- 172.21.15.80:0/3328706212 >> v1:172.21.15.80:6789/0 conn(0x7fa5a406c5c0 legacy=0x7fa5a40d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.659+0000 7fa5aa46a640 1 -- 172.21.15.80:0/3328706212 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a40ce830 con 0x7fa5a406eba0 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.660+0000 7fa5aa46a640 1 --2- 172.21.15.80:0/3328706212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a40b2cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009d90 tx=0x7fa59c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb636b1fea93632 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.660+0000 7fa5a8c67640 1 -- 172.21.15.80:0/3328706212 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c031600 con 0x7fa5a406eba0 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.660+0000 7fa5a8c67640 1 -- 172.21.15.80:0/3328706212 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c0317a0 con 0x7fa5a406eba0 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.660+0000 7fa5a8c67640 1 -- 172.21.15.80:0/3328706212 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c031b70 con 0x7fa5a406eba0 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 -- 172.21.15.80:0/3328706212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 msgr2=0x7fa5a40b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 --2- 172.21.15.80:0/3328706212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a40b2cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009d90 tx=0x7fa59c02a610 comp rx=0 tx=0).stop 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 -- 172.21.15.80:0/3328706212 shutdown_connections 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 --2- 172.21.15.80:0/3328706212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a40b2cf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 -- 172.21.15.80:0/3328706212 >> 172.21.15.80:0/3328706212 conn(0x7fa5a40b7620 msgr2=0x7fa5a40b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 -- 172.21.15.80:0/3328706212 shutdown_connections 2024-04-25T15:44:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.661+0000 7fa5abecd640 1 -- 172.21.15.80:0/3328706212 wait complete. 2024-04-25T15:44:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.663+0000 7fa5abecd640 1 Processor -- start 2024-04-25T15:44:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.663+0000 7fa5abecd640 1 -- start start 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5abecd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5a406c5c0 0x7fa5a415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5abecd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a406e790 0x7fa5a40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5abecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5abecd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40d3110 con 0x7fa5a406eba0 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5abecd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40cedf0 con 0x7fa5a406e790 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5abecd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a406efb0 con 0x7fa5a406c5c0 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5aa46a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5aa46a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41178/0 (socket says 172.21.15.80:41178) 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5aa46a640 1 -- 172.21.15.80:0/1120194742 learned_addr learned my addr 172.21.15.80:0/1120194742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.664+0000 7fa5a9468640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a406e790 0x7fa5a40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5a9c69640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5a406c5c0 0x7fa5a415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5aa46a640 1 -- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5a406c5c0 msgr2=0x7fa5a415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5aa46a640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5a406c5c0 0x7fa5a415e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5aa46a640 1 -- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a406e790 msgr2=0x7fa5a40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5aa46a640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a406e790 0x7fa5a40cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5aa46a640 1 -- 172.21.15.80:0/1120194742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a40c63e0 con 0x7fa5a406eba0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5a9468640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a406e790 0x7fa5a40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5aa46a640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a415c6e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa59c02ac00 tx=0x7fa59c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c040070 con 0x7fa5a406eba0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c030b60 con 0x7fa5a406eba0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c009450 con 0x7fa5a406eba0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a41f4180 con 0x7fa5a406eba0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.665+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a40c9b50 con 0x7fa5a406eba0 2024-04-25T15:44:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.666+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a40c9940 con 0x7fa5a406eba0 2024-04-25T15:44:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.667+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa59c039040 con 0x7fa5a406eba0 2024-04-25T15:44:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.667+0000 7fa59a7fc640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5880744b0 0x7fa5880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.667+0000 7fa5a9c69640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5880744b0 0x7fa5880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.667+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa59c0b6160 con 0x7fa5a406eba0 2024-04-25T15:44:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.668+0000 7fa5a9c69640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5880744b0 0x7fa5880769c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000f60 tx=0x7fa5a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.672+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa59c0807f0 con 0x7fa5a406eba0 2024-04-25T15:44:15.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.884+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa5a406a100 con 0x7fa5a406eba0 2024-04-25T15:44:15.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.909+0000 7fa59a7fc640 1 -- 172.21.15.80:0/1120194742 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7fa59c0800f0 con 0x7fa5a406eba0 2024-04-25T15:44:15.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5880744b0 msgr2=0x7fa5880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5880744b0 0x7fa5880769c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000f60 tx=0x7fa5a0009040 comp rx=0 tx=0).stop 2024-04-25T15:44:15.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 msgr2=0x7fa5a415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:15.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a415c6e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa59c02ac00 tx=0x7fa59c004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 shutdown_connections 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5880744b0 0x7fa5880769c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a406eba0 0x7fa5a415c6e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a406e790 0x7fa5a40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 --2- 172.21.15.80:0/1120194742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5a406c5c0 0x7fa5a415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 >> 172.21.15.80:0/1120194742 conn(0x7fa5a40b7620 msgr2=0x7fa5a4070730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 shutdown_connections 2024-04-25T15:44:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:15.912+0000 7fa5abecd640 1 -- 172.21.15.80:0/1120194742 wait complete. 2024-04-25T15:44:15.924 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:44:15.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:44:16.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.034+0000 7f0663cd1640 1 Processor -- start 2024-04-25T15:44:16.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.034+0000 7f0663cd1640 1 -- start start 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f0663cd1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f065c0b2b80 0x7f065c15e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f0663cd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f065c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f0663cd1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f065c0d0cd0 con 0x7f065c0d08c0 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f0663cd1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f065c161b00 con 0x7f065c0b2b80 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f0663cd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f065c161dc0 con 0x7f065c0cee90 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f066226e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f065c0d08c0 0x7f065c071970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51088/0 (socket says 172.21.15.80:51088) 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f066226e640 1 -- 172.21.15.80:0/2304847256 learned_addr learned my addr 172.21.15.80:0/2304847256 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:16.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.035+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395032172 0 0) 0x7f065c0d0cd0 con 0x7f065c0d08c0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0648003520 con 0x7f065c0d08c0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0661a6d640 1 --2- 172.21.15.80:0/2304847256 >> v2:172.21.15.195:3300/0 conn(0x7f065c0b2b80 0x7f065c15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066126c640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f065c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3138491681 0 0) 0x7f0648003520 con 0x7f065c0d08c0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 msgr2=0x7f065c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f065c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 >> v2:172.21.15.195:3300/0 conn(0x7f065c0b2b80 msgr2=0x7f065c15e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 --2- 172.21.15.80:0/2304847256 >> v2:172.21.15.195:3300/0 conn(0x7f065c0b2b80 0x7f065c15e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c1620a0 con 0x7f065c0d08c0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f0654001670 con 0x7f065c0d08c0 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0661a6d640 1 --2- 172.21.15.80:0/2304847256 >> v2:172.21.15.195:3300/0 conn(0x7f065c0b2b80 0x7f065c15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 >> v1:172.21.15.80:6789/0 conn(0x7f065c0d08c0 legacy=0x7f065c071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f06480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0648003f30 0x7f0648004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0648004d40 0x7f0648005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f065c161b00 con 0x7f0648004d40 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f065c161dc0 con 0x7f0648003f30 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f064800bb50 con 0x7f065c0cee90 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066226e640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0648004d40 0x7f0648005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0661a6d640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f06480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066126c640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0648003f30 0x7f0648004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066226e640 1 -- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 msgr2=0x7f06480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066226e640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f06480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066226e640 1 -- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0648003f30 msgr2=0x7f0648004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066226e640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0648003f30 0x7f0648004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f066226e640 1 -- 172.21.15.80:0/2304847256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0648003520 con 0x7f0648004d40 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.036+0000 7f0661a6d640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c0cee90 0x7f06480039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:16.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.037+0000 7f066226e640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0648004d40 0x7f0648005150 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f065c0d4a60 tx=0x7f0648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6212470db3dc7cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.037+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654007d50 con 0x7f0648004d40 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.037+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0654005ad0 con 0x7f0648004d40 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.037+0000 7f0660a6b640 1 -- 172.21.15.80:0/2304847256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654007070 con 0x7f0648004d40 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f0663cd1640 1 -- 172.21.15.80:0/2304847256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0648004d40 msgr2=0x7f0648005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f0663cd1640 1 --2- 172.21.15.80:0/2304847256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0648004d40 0x7f0648005150 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f065c0d4a60 tx=0x7f0648005830 comp rx=0 tx=0).stop 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f066226e640 1 -- 172.21.15.80:0/2304847256 reap_dead start 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f0663cd1640 1 -- 172.21.15.80:0/2304847256 shutdown_connections 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f0663cd1640 1 -- 172.21.15.80:0/2304847256 >> 172.21.15.80:0/2304847256 conn(0x7f065c0b54a0 msgr2=0x7f065c0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f0663cd1640 1 -- 172.21.15.80:0/2304847256 shutdown_connections 2024-04-25T15:44:16.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.038+0000 7f0663cd1640 1 -- 172.21.15.80:0/2304847256 wait complete. 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.040+0000 7f0663cd1640 1 Processor -- start 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.040+0000 7f0663cd1640 1 -- start start 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0663cd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065c1538e0 0x7f065c152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0663cd1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 0x7f065c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0663cd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c1f9cb0 0x7f065c1fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0663cd1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f065c162940 con 0x7f065c1552c0 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0663cd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f065c162660 con 0x7f065c1538e0 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0663cd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f065c0cf2a0 con 0x7f065c1f9cb0 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 0x7f065c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 0x7f065c1556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41206/0 (socket says 172.21.15.80:41206) 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 -- 172.21.15.80:0/4228411607 learned_addr learned my addr 172.21.15.80:0/4228411607 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f0661a6d640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065c1538e0 0x7f065c152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 -- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c1f9cb0 msgr2=0x7f065c1fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066226e640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c1f9cb0 0x7f065c1fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c1f9cb0 0x7f065c1fa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 -- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065c1538e0 msgr2=0x7f065c152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065c1538e0 0x7f065c152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.041+0000 7f066126c640 1 -- 172.21.15.80:0/4228411607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c06e4d0 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.042+0000 7f066126c640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 0x7f065c1556d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f064c011540 tx=0x7f064c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.042+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c015930 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.042+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c015ad0 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.042+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c00f460 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.042+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c06ea60 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.042+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c06f020 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.043+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c06a100 con 0x7f065c1552c0 2024-04-25T15:44:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.043+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f064c00f600 con 0x7f065c1552c0 2024-04-25T15:44:16.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.044+0000 7f06527fc640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06400744b0 0x7f06400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:16.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.044+0000 7f0661a6d640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06400744b0 0x7f06400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:16.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.044+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f064c095b90 con 0x7f065c1552c0 2024-04-25T15:44:16.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.044+0000 7f0661a6d640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06400744b0 0x7f06400769c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f065c0b5b90 tx=0x7f065800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.048+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f064c019030 con 0x7f065c1552c0 2024-04-25T15:44:16.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.264+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f065c0b94d0 con 0x7f065c1552c0 2024-04-25T15:44:16.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.915+0000 7f06527fc640 1 -- 172.21.15.80:0/4228411607 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f064c0602b0 con 0x7f065c1552c0 2024-04-25T15:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.917+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06400744b0 msgr2=0x7f06400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.917+0000 7f0663cd1640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06400744b0 0x7f06400769c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f065c0b5b90 tx=0x7f065800b040 comp rx=0 tx=0).stop 2024-04-25T15:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.917+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 msgr2=0x7f065c1556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.917+0000 7f0663cd1640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 0x7f065c1556d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f064c011540 tx=0x7f064c011a00 comp rx=0 tx=0).stop 2024-04-25T15:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 shutdown_connections 2024-04-25T15:44:16.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06400744b0 0x7f06400769c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065c1f9cb0 0x7f065c1fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065c1552c0 0x7f065c1556d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 --2- 172.21.15.80:0/4228411607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065c1538e0 0x7f065c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 >> 172.21.15.80:0/4228411607 conn(0x7f065c0b54a0 msgr2=0x7f065c0b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 shutdown_connections 2024-04-25T15:44:16.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:16.918+0000 7f0663cd1640 1 -- 172.21.15.80:0/4228411607 wait complete. 2024-04-25T15:44:16.932 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:44:16.932 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.043+0000 7f609e613640 1 Processor -- start 2024-04-25T15:44:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.043+0000 7f609e613640 1 -- start start 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.044+0000 7f609e613640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60980ce220 0x7f609809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.044+0000 7f609e613640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980cfd70 0x7f60980d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.044+0000 7f609e613640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60981607c0 con 0x7f60980cf960 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.044+0000 7f609e613640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f60980cf4d0 con 0x7f60980ce220 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.044+0000 7f609e613640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f60980ce630 con 0x7f60980cfd70 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60980ce220 0x7f609809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60980ce220 0x7f609809bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41220/0 (socket says 172.21.15.80:41220) 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 -- 172.21.15.80:0/1983227499 learned_addr learned my addr 172.21.15.80:0/1983227499 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 -- 172.21.15.80:0/1983227499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980cfd70 msgr2=0x7f60980d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 --2- 172.21.15.80:0/1983227499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980cfd70 0x7f60980d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 -- 172.21.15.80:0/1983227499 >> v1:172.21.15.195:6789/0 conn(0x7f60980cf960 legacy=0x7f60980b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 -- 172.21.15.80:0/1983227499 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980d0180 con 0x7f60980ce220 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.045+0000 7f6097fff640 1 --2- 172.21.15.80:0/1983227499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980ce220 0x7f609809bb70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6088009870 tx=0x7f608802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd44007681f1956 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f6096ffd640 1 -- 172.21.15.80:0/1983227499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088037070 con 0x7f60980ce220 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f6096ffd640 1 -- 172.21.15.80:0/1983227499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088032440 con 0x7f60980ce220 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f6096ffd640 1 -- 172.21.15.80:0/1983227499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088032810 con 0x7f60980ce220 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 -- 172.21.15.80:0/1983227499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980ce220 msgr2=0x7f609809bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 --2- 172.21.15.80:0/1983227499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980ce220 0x7f609809bb70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6088009870 tx=0x7f608802a2c0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 -- 172.21.15.80:0/1983227499 shutdown_connections 2024-04-25T15:44:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 --2- 172.21.15.80:0/1983227499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980cfd70 0x7f60980d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 --2- 172.21.15.80:0/1983227499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980ce220 0x7f609809bb70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 -- 172.21.15.80:0/1983227499 >> 172.21.15.80:0/1983227499 conn(0x7f60980b7620 msgr2=0x7f60980b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 -- 172.21.15.80:0/1983227499 shutdown_connections 2024-04-25T15:44:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.046+0000 7f609e613640 1 -- 172.21.15.80:0/1983227499 wait complete. 2024-04-25T15:44:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.048+0000 7f609e613640 1 Processor -- start 2024-04-25T15:44:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.048+0000 7f609e613640 1 -- start start 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980ce220 0x7f60980ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60980cf960 0x7f6098155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 0x7f6098162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f60980cf160 con 0x7f60980cfd70 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f60980cee80 con 0x7f60980cf960 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f609809c0b0 con 0x7f60980ce220 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 0x7f6098162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 0x7f6098162b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41234/0 (socket says 172.21.15.80:41234) 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 -- 172.21.15.80:0/72724763 learned_addr learned my addr 172.21.15.80:0/72724763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f60977fe640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60980cf960 0x7f6098155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f6097fff640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980ce220 0x7f60980ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 -- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980ce220 msgr2=0x7f60980ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980ce220 0x7f60980ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 -- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60980cf960 msgr2=0x7f6098155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60980cf960 0x7f6098155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 -- 172.21.15.80:0/72724763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980c64e0 con 0x7f60980cfd70 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609cbb0640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 0x7f6098162b60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f609000b9e0 tx=0x7f609000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090019070 con 0x7f60980cfd70 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609000cb40 con 0x7f60980cfd70 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60980c67c0 con 0x7f60980cfd70 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090014440 con 0x7f60980cfd70 2024-04-25T15:44:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.050+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60980c6d80 con 0x7f60980cfd70 2024-04-25T15:44:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.052+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609806a100 con 0x7f60980cfd70 2024-04-25T15:44:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.052+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f609001c070 con 0x7f60980cfd70 2024-04-25T15:44:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.052+0000 7f6094ff9640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60840744b0 0x7f60840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.053+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6090094ef0 con 0x7f60980cfd70 2024-04-25T15:44:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.053+0000 7f6097fff640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60840744b0 0x7f60840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.053+0000 7f6097fff640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60840744b0 0x7f60840769c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6088034000 tx=0x7f608802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.058+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f609005ef30 con 0x7f60980cfd70 2024-04-25T15:44:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.267+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60980d23f0 con 0x7f60980cfd70 2024-04-25T15:44:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.268+0000 7f6094ff9640 1 -- 172.21.15.80:0/72724763 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f6090063230 con 0x7f60980cfd70 2024-04-25T15:44:17.269 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:17.269 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60840744b0 msgr2=0x7f60840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60840744b0 0x7f60840769c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6088034000 tx=0x7f608802e000 comp rx=0 tx=0).stop 2024-04-25T15:44:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 msgr2=0x7f6098162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 0x7f6098162b60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f609000b9e0 tx=0x7f609000bea0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 shutdown_connections 2024-04-25T15:44:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60840744b0 0x7f60840769c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60980cfd70 0x7f6098162b60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60980cf960 0x7f6098155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 --2- 172.21.15.80:0/72724763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60980ce220 0x7f60980ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 >> 172.21.15.80:0/72724763 conn(0x7f60980b7620 msgr2=0x7f609806c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 shutdown_connections 2024-04-25T15:44:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.270+0000 7f609e613640 1 -- 172.21.15.80:0/72724763 wait complete. 2024-04-25T15:44:17.282 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.388+0000 7f3d935ab640 1 Processor -- start 2024-04-25T15:44:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.388+0000 7f3d935ab640 1 -- start start 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d935ab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c0b91b0 0x7f3d8c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d935ab640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c0d1010 con 0x7f3d8c0d34a0 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d935ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c09cdf0 con 0x7f3d8c0b3ac0 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d935ab640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c09d0d0 con 0x7f3d8c0b91b0 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3d8c0d34a0 0x7f3d8c06e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51102/0 (socket says 172.21.15.80:51102) 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 -- 172.21.15.80:0/813988853 learned_addr learned my addr 172.21.15.80:0/813988853 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197636072 0 0) 0x7f3d8c0d1010 con 0x7f3d8c0d34a0 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d78003520 con 0x7f3d8c0d34a0 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d90b46640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c0b91b0 0x7f3d8c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2764278086 0 0) 0x7f3d78003520 con 0x7f3d8c0d34a0 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c0b91b0 msgr2=0x7f3d8c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c0b91b0 0x7f3d8c06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 >> v1:172.21.15.195:6789/0 conn(0x7f3d8c0b3ac0 legacy=0x7f3d8c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c06ec70 con 0x7f3d8c0d34a0 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f3d88001b70 con 0x7f3d8c0d34a0 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 >> v1:172.21.15.80:6789/0 conn(0x7f3d8c0d34a0 legacy=0x7f3d8c06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d78003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78004800 0x7f3d78004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78005270 0x7f3d7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c09d0d0 con 0x7f3d780039e0 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7800c160 con 0x7f3d78004800 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7800c360 con 0x7f3d78005270 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d90b46640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c0b91b0 0x7f3d8c06da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d78003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91b48640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78005270 0x7f3d7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d90b46640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78004800 0x7f3d78004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 -- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78005270 msgr2=0x7f3d7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78005270 0x7f3d7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 -- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78004800 msgr2=0x7f3d78004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78004800 0x7f3d78004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.391+0000 7f3d91347640 1 -- 172.21.15.80:0/813988853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d78003520 con 0x7f3d780039e0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d91347640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d78003e50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c530 tx=0x7f3d78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21e7e6937839cf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88030070 con 0x7f3d780039e0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88005e00 con 0x7f3d780039e0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d83fff640 1 -- 172.21.15.80:0/813988853 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800c180 con 0x7f3d780039e0 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d935ab640 1 -- 172.21.15.80:0/813988853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 msgr2=0x7f3d78003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d935ab640 1 --2- 172.21.15.80:0/813988853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d78003e50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c530 tx=0x7f3d78005830 comp rx=0 tx=0).stop 2024-04-25T15:44:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d91b48640 1 -- 172.21.15.80:0/813988853 reap_dead start 2024-04-25T15:44:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d935ab640 1 -- 172.21.15.80:0/813988853 shutdown_connections 2024-04-25T15:44:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d935ab640 1 -- 172.21.15.80:0/813988853 >> 172.21.15.80:0/813988853 conn(0x7f3d8c0d0450 msgr2=0x7f3d8c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d935ab640 1 -- 172.21.15.80:0/813988853 shutdown_connections 2024-04-25T15:44:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.392+0000 7f3d935ab640 1 -- 172.21.15.80:0/813988853 wait complete. 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.394+0000 7f3d935ab640 1 Processor -- start 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.394+0000 7f3d935ab640 1 -- start start 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.395+0000 7f3d935ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d8c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.395+0000 7f3d935ab640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c154be0 0x7f3d8c153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.395+0000 7f3d935ab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c153570 0x7f3d8c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.395+0000 7f3d935ab640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c06d7b0 con 0x7f3d780039e0 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.395+0000 7f3d935ab640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c0d12f0 con 0x7f3d8c154be0 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.395+0000 7f3d935ab640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c0b45e0 con 0x7f3d8c153570 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d8c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d8c152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41264/0 (socket says 172.21.15.80:41264) 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 -- 172.21.15.80:0/1285510 learned_addr learned my addr 172.21.15.80:0/1285510 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91b48640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c153570 0x7f3d8c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d90b46640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c154be0 0x7f3d8c153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 -- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c153570 msgr2=0x7f3d8c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c153570 0x7f3d8c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 -- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c154be0 msgr2=0x7f3d8c153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c154be0 0x7f3d8c153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 -- 172.21.15.80:0/1285510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c0c7760 con 0x7f3d780039e0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91b48640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c153570 0x7f3d8c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d90b46640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c154be0 0x7f3d8c153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d91347640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d8c152750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001270 tx=0x7f3d88001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88030050 con 0x7f3d780039e0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88031040 con 0x7f3d780039e0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c156630 con 0x7f3d780039e0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8802ca60 con 0x7f3d780039e0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.396+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c156bf0 con 0x7f3d780039e0 2024-04-25T15:44:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.398+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c06f1e0 con 0x7f3d780039e0 2024-04-25T15:44:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.398+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d8802cc00 con 0x7f3d780039e0 2024-04-25T15:44:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.398+0000 7f3d81ffb640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d700744b0 0x7f3d700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.399+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3d880b5a30 con 0x7f3d780039e0 2024-04-25T15:44:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.399+0000 7f3d90b46640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d700744b0 0x7f3d700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.399+0000 7f3d90b46640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d700744b0 0x7f3d700769c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0b67a0 tx=0x7f3d7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.403+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d8c06f1e0 con 0x7f3d780039e0 2024-04-25T15:44:17.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.578+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d8c06a100 con 0x7f3d780039e0 2024-04-25T15:44:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.579+0000 7f3d81ffb640 1 -- 172.21.15.80:0/1285510 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f3d88080030 con 0x7f3d780039e0 2024-04-25T15:44:17.580 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:17.580 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.581+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d700744b0 msgr2=0x7f3d700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.581+0000 7f3d935ab640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d700744b0 0x7f3d700769c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0b67a0 tx=0x7f3d7c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.581+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 msgr2=0x7f3d8c152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.581+0000 7f3d935ab640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d8c152750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001270 tx=0x7f3d88001f40 comp rx=0 tx=0).stop 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 shutdown_connections 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d700744b0 0x7f3d700769c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d8c153570 0x7f3d8c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c154be0 0x7f3d8c153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 --2- 172.21.15.80:0/1285510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d780039e0 0x7f3d8c152750 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 >> 172.21.15.80:0/1285510 conn(0x7f3d8c0d0450 msgr2=0x7f3d8c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 shutdown_connections 2024-04-25T15:44:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.582+0000 7f3d935ab640 1 -- 172.21.15.80:0/1285510 wait complete. 2024-04-25T15:44:17.593 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:44:17.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.700+0000 7f7ccbd0e640 1 Processor -- start 2024-04-25T15:44:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.700+0000 7f7ccbd0e640 1 -- start start 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7ccbd0e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7cc40b48d0 0x7f7cc40b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7ccbd0e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7cc40b7b90 0x7f7cc40d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7ccbd0e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc40b7fa0 con 0x7f7cc40d41b0 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7ccbd0e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc4163fb0 con 0x7f7cc40b7b90 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7ccbd0e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc4164270 con 0x7f7cc40b48d0 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7cca2ab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7cc40b7b90 0x7f7cc40d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7cca2ab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7cc40b7b90 0x7f7cc40d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41272/0 (socket says 172.21.15.80:41272) 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7cca2ab640 1 -- 172.21.15.80:0/743620637 learned_addr learned my addr 172.21.15.80:0/743620637 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.701+0000 7f7cc92a9640 1 --2- 172.21.15.80:0/743620637 >> v2:172.21.15.195:3300/0 conn(0x7f7cc40b48d0 0x7f7cc40b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.702+0000 7f7cca2ab640 1 -- 172.21.15.80:0/743620637 >> v2:172.21.15.195:3300/0 conn(0x7f7cc40b48d0 msgr2=0x7f7cc40b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.702+0000 7f7cca2ab640 1 --2- 172.21.15.80:0/743620637 >> v2:172.21.15.195:3300/0 conn(0x7f7cc40b48d0 0x7f7cc40b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.702+0000 7f7cca2ab640 1 -- 172.21.15.80:0/743620637 >> v1:172.21.15.195:6789/0 conn(0x7f7cc40d41b0 legacy=0x7f7cc41602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.702+0000 7f7cca2ab640 1 -- 172.21.15.80:0/743620637 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc4164550 con 0x7f7cc40b7b90 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.702+0000 7f7cca2ab640 1 --2- 172.21.15.80:0/743620637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40d49c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7cc408ee90 tx=0x7f7cbc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73164b23ad242cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.702+0000 7f7cc8aa8640 1 -- 172.21.15.80:0/743620637 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc036070 con 0x7f7cc40b7b90 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7cc8aa8640 1 -- 172.21.15.80:0/743620637 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc031600 con 0x7f7cc40b7b90 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7cc8aa8640 1 -- 172.21.15.80:0/743620637 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0319d0 con 0x7f7cc40b7b90 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/743620637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40b7b90 msgr2=0x7f7cc40d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/743620637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40d49c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7cc408ee90 tx=0x7f7cbc02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/743620637 shutdown_connections 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/743620637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40d49c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/743620637 >> v2:172.21.15.195:3300/0 conn(0x7f7cc40b48d0 0x7f7cc40b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/743620637 >> 172.21.15.80:0/743620637 conn(0x7f7cc406e9f0 msgr2=0x7f7cc40d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/743620637 shutdown_connections 2024-04-25T15:44:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.703+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/743620637 wait complete. 2024-04-25T15:44:17.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.705+0000 7f7ccbd0e640 1 Processor -- start 2024-04-25T15:44:17.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.705+0000 7f7ccbd0e640 1 -- start start 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7ccbd0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cc40b48d0 0x7f7cc40cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7ccbd0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7ccbd0e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 0x7f7cc4161880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7ccbd0e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc40b4fd0 con 0x7f7cc40d41b0 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7ccbd0e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc4164b10 con 0x7f7cc40b7b90 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7ccbd0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc40b5150 con 0x7f7cc40b48d0 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.706+0000 7f7cca2ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 0x7f7cc4161880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 0x7f7cc4161880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41286/0 (socket says 172.21.15.80:41286) 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 -- 172.21.15.80:0/1502384509 learned_addr learned my addr 172.21.15.80:0/1502384509 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cc92a9640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cc9aaa640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cc40b48d0 0x7f7cc40cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 -- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cc40b48d0 msgr2=0x7f7cc40cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cc40b48d0 0x7f7cc40cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 -- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cc40b7b90 msgr2=0x7f7cc40cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 -- 172.21.15.80:0/1502384509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc40cacd0 con 0x7f7cc40d41b0 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cca2ab640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 0x7f7cc4161880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc02ac90 tx=0x7f7cbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03f020 con 0x7f7cc40d41b0 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc037040 con 0x7f7cc40d41b0 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc40cafb0 con 0x7f7cc40d41b0 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc036070 con 0x7f7cc40d41b0 2024-04-25T15:44:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.707+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc40cb570 con 0x7f7cc40d41b0 2024-04-25T15:44:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.708+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc406a100 con 0x7f7cc40d41b0 2024-04-25T15:44:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.709+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7cbc042020 con 0x7f7cc40d41b0 2024-04-25T15:44:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.709+0000 7f7cba7fc640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ca80744e0 0x7f7ca80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.709+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7cbc0b5710 con 0x7f7cc40d41b0 2024-04-25T15:44:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.709+0000 7f7cc9aaa640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ca80744e0 0x7f7ca80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.710+0000 7f7cc9aaa640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ca80744e0 0x7f7ca80769f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00016e0 tx=0x7f7cc0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:17.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.714+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cbc049030 con 0x7f7cc40d41b0 2024-04-25T15:44:17.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.886+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7cc40d3070 con 0x7f7ca80744e0 2024-04-25T15:44:17.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.892+0000 7f7cba7fc640 1 -- 172.21.15.80:0/1502384509 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243928 (secure 0 0 0) 0x7f7cc40d3070 con 0x7f7ca80744e0 2024-04-25T15:44:17.895 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:17.896 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ca80744e0 msgr2=0x7f7ca80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ca80744e0 0x7f7ca80769f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00016e0 tx=0x7f7cc0009040 comp rx=0 tx=0).stop 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 msgr2=0x7f7cc4161880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 0x7f7cc4161880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc02ac90 tx=0x7f7cbc004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 shutdown_connections 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7ca80744e0 0x7f7ca80769f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cc40d41b0 0x7f7cc4161880 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cc40b7b90 0x7f7cc40cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 --2- 172.21.15.80:0/1502384509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7cc40b48d0 0x7f7cc40cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:17.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 >> 172.21.15.80:0/1502384509 conn(0x7f7cc406e9f0 msgr2=0x7f7cc40ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:17.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 shutdown_connections 2024-04-25T15:44:17.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:17.895+0000 7f7ccbd0e640 1 -- 172.21.15.80:0/1502384509 wait complete. 2024-04-25T15:44:17.906 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-25T15:44:17.014302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237176,"kb_used_data":4336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737544,"statfs":{"total":773094113280,"available":772851245056,"internally_reserved":0,"allocated":4440064,"data_stored":2550960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.131188"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899394+0000","last_change":"2024-04-25T15:44:13.899394+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899394+0000","last_undegraded":"2024-04-25T15:44:13.899394+0000","last_fullsized":"2024-04-25T15:44:13.899394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899886+0000","last_change":"2024-04-25T15:44:13.899886+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899886+0000","last_undegraded":"2024-04-25T15:44:13.899886+0000","last_fullsized":"2024-04-25T15:44:13.899886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896774+0000","last_change":"2024-04-25T15:44:13.896774+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896774+0000","last_undegraded":"2024-04-25T15:44:13.896774+0000","last_fullsized":"2024-04-25T15:44:13.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894686+0000","last_change":"2024-04-25T15:44:13.894686+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894686+0000","last_undegraded":"2024-04-25T15:44:13.894686+0000","last_fullsized":"2024-04-25T15:44:13.894686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894088+0000","last_change":"2024-04-25T15:44:13.894088+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894088+0000","last_undegraded":"2024-04-25T15:44:13.894088+0000","last_fullsized":"2024-04-25T15:44:13.894088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897800+0000","last_change":"2024-04-25T15:44:13.897800+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897800+0000","last_undegraded":"2024-04-25T15:44:13.897800+0000","last_fullsized":"2024-04-25T15:44:13.897800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898398+0000","last_change":"2024-04-25T15:44:13.898398+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898398+0000","last_undegraded":"2024-04-25T15:44:13.898398+0000","last_fullsized":"2024-04-25T15:44:13.898398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898107+0000","last_change":"2024-04-25T15:44:13.898107+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898107+0000","last_undegraded":"2024-04-25T15:44:13.898107+0000","last_fullsized":"2024-04-25T15:44:13.898107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895345+0000","last_change":"2024-04-25T15:44:13.895345+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895345+0000","last_undegraded":"2024-04-25T15:44:13.895345+0000","last_fullsized":"2024-04-25T15:44:13.895345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893087+0000","last_change":"2024-04-25T15:44:13.893087+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893087+0000","last_undegraded":"2024-04-25T15:44:13.893087+0000","last_fullsized":"2024-04-25T15:44:13.893087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894038+0000","last_change":"2024-04-25T15:44:13.894038+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894038+0000","last_undegraded":"2024-04-25T15:44:13.894038+0000","last_fullsized":"2024-04-25T15:44:13.894038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891312+0000","last_change":"2024-04-25T15:44:13.891312+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891312+0000","last_undegraded":"2024-04-25T15:44:13.891312+0000","last_fullsized":"2024-04-25T15:44:13.891312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893968+0000","last_change":"2024-04-25T15:44:13.893968+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893968+0000","last_undegraded":"2024-04-25T15:44:13.893968+0000","last_fullsized":"2024-04-25T15:44:13.893968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894539+0000","last_change":"2024-04-25T15:44:13.894539+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894539+0000","last_undegraded":"2024-04-25T15:44:13.894539+0000","last_fullsized":"2024-04-25T15:44:13.894539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896435+0000","last_change":"2024-04-25T15:44:13.896435+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896435+0000","last_undegraded":"2024-04-25T15:44:13.896435+0000","last_fullsized":"2024-04-25T15:44:13.896435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.892399+0000","last_change":"2024-04-25T15:44:13.892399+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.892399+0000","last_undegraded":"2024-04-25T15:44:13.892399+0000","last_fullsized":"2024-04-25T15:44:13.892399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891667+0000","last_change":"2024-04-25T15:44:13.891667+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891667+0000","last_undegraded":"2024-04-25T15:44:13.891667+0000","last_fullsized":"2024-04-25T15:44:13.891667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891515+0000","last_change":"2024-04-25T15:44:13.891515+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891515+0000","last_undegraded":"2024-04-25T15:44:13.891515+0000","last_fullsized":"2024-04-25T15:44:13.891515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895016+0000","last_change":"2024-04-25T15:44:13.895016+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895016+0000","last_undegraded":"2024-04-25T15:44:13.895016+0000","last_fullsized":"2024-04-25T15:44:13.895016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908563+0000","last_change":"2024-04-25T15:44:13.906044+0000","last_active":"2024-04-25T15:44:13.908563+0000","last_peered":"2024-04-25T15:44:13.908563+0000","last_clean":"2024-04-25T15:44:13.908563+0000","last_became_active":"2024-04-25T15:44:13.905713+0000","last_became_peered":"2024-04-25T15:44:13.905713+0000","last_unstale":"2024-04-25T15:44:13.908563+0000","last_undegraded":"2024-04-25T15:44:13.908563+0000","last_fullsized":"2024-04-25T15:44:13.908563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:51.097674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897266+0000","last_change":"2024-04-25T15:44:13.897266+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897266+0000","last_undegraded":"2024-04-25T15:44:13.897266+0000","last_fullsized":"2024-04-25T15:44:13.897266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908616+0000","last_change":"2024-04-25T15:44:13.905893+0000","last_active":"2024-04-25T15:44:13.908616+0000","last_peered":"2024-04-25T15:44:13.908616+0000","last_clean":"2024-04-25T15:44:13.908616+0000","last_became_active":"2024-04-25T15:44:13.905538+0000","last_became_peered":"2024-04-25T15:44:13.905538+0000","last_unstale":"2024-04-25T15:44:13.908616+0000","last_undegraded":"2024-04-25T15:44:13.908616+0000","last_fullsized":"2024-04-25T15:44:13.908616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:35.713816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912209+0000","last_change":"2024-04-25T15:44:13.910226+0000","last_active":"2024-04-25T15:44:13.912209+0000","last_peered":"2024-04-25T15:44:13.912209+0000","last_clean":"2024-04-25T15:44:13.912209+0000","last_became_active":"2024-04-25T15:44:13.909924+0000","last_became_peered":"2024-04-25T15:44:13.909924+0000","last_unstale":"2024-04-25T15:44:13.912209+0000","last_undegraded":"2024-04-25T15:44:13.912209+0000","last_fullsized":"2024-04-25T15:44:13.912209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899973+0000","last_change":"2024-04-25T15:44:13.899973+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899973+0000","last_undegraded":"2024-04-25T15:44:13.899973+0000","last_fullsized":"2024-04-25T15:44:13.899973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883061+0000","last_change":"2024-04-25T15:44:12.883061+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883061+0000","last_undegraded":"2024-04-25T15:44:12.883061+0000","last_fullsized":"2024-04-25T15:44:12.883061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897152+0000","last_change":"2024-04-25T15:44:13.897152+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897152+0000","last_undegraded":"2024-04-25T15:44:13.897152+0000","last_fullsized":"2024-04-25T15:44:13.897152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888275+0000","last_change":"2024-04-25T15:44:12.888275+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888275+0000","last_undegraded":"2024-04-25T15:44:12.888275+0000","last_fullsized":"2024-04-25T15:44:12.888275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883080+0000","last_change":"2024-04-25T15:44:12.883080+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883080+0000","last_undegraded":"2024-04-25T15:44:12.883080+0000","last_fullsized":"2024-04-25T15:44:12.883080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912134+0000","last_change":"2024-04-25T15:44:13.909660+0000","last_active":"2024-04-25T15:44:13.912134+0000","last_peered":"2024-04-25T15:44:13.912134+0000","last_clean":"2024-04-25T15:44:13.912134+0000","last_became_active":"2024-04-25T15:44:13.909289+0000","last_became_peered":"2024-04-25T15:44:13.909289+0000","last_unstale":"2024-04-25T15:44:13.912134+0000","last_undegraded":"2024-04-25T15:44:13.912134+0000","last_fullsized":"2024-04-25T15:44:13.912134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.900643+0000","last_change":"2024-04-25T15:44:13.900643+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.900643+0000","last_undegraded":"2024-04-25T15:44:13.900643+0000","last_fullsized":"2024-04-25T15:44:13.900643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.884243+0000","last_change":"2024-04-25T15:44:12.884243+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.884243+0000","last_undegraded":"2024-04-25T15:44:12.884243+0000","last_fullsized":"2024-04-25T15:44:12.884243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893591+0000","last_change":"2024-04-25T15:44:13.893591+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893591+0000","last_undegraded":"2024-04-25T15:44:13.893591+0000","last_fullsized":"2024-04-25T15:44:13.893591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911488+0000","last_change":"2024-04-25T15:44:13.909591+0000","last_active":"2024-04-25T15:44:13.911488+0000","last_peered":"2024-04-25T15:44:13.911488+0000","last_clean":"2024-04-25T15:44:13.911488+0000","last_became_active":"2024-04-25T15:44:13.908524+0000","last_became_peered":"2024-04-25T15:44:13.908524+0000","last_unstale":"2024-04-25T15:44:13.911488+0000","last_undegraded":"2024-04-25T15:44:13.911488+0000","last_fullsized":"2024-04-25T15:44:13.911488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:34.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888560+0000","last_change":"2024-04-25T15:44:12.888560+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888560+0000","last_undegraded":"2024-04-25T15:44:12.888560+0000","last_fullsized":"2024-04-25T15:44:12.888560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897616+0000","last_change":"2024-04-25T15:44:13.897616+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897616+0000","last_undegraded":"2024-04-25T15:44:13.897616+0000","last_fullsized":"2024-04-25T15:44:13.897616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888204+0000","last_change":"2024-04-25T15:44:12.888204+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888204+0000","last_undegraded":"2024-04-25T15:44:12.888204+0000","last_fullsized":"2024-04-25T15:44:12.888204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910809+0000","last_change":"2024-04-25T15:44:13.905855+0000","last_active":"2024-04-25T15:44:13.910809+0000","last_peered":"2024-04-25T15:44:13.910809+0000","last_clean":"2024-04-25T15:44:13.910809+0000","last_became_active":"2024-04-25T15:44:13.905531+0000","last_became_peered":"2024-04-25T15:44:13.905531+0000","last_unstale":"2024-04-25T15:44:13.910809+0000","last_undegraded":"2024-04-25T15:44:13.910809+0000","last_fullsized":"2024-04-25T15:44:13.910809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.068667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896677+0000","last_change":"2024-04-25T15:44:13.896677+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896677+0000","last_undegraded":"2024-04-25T15:44:13.896677+0000","last_fullsized":"2024-04-25T15:44:13.896677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911331+0000","last_change":"2024-04-25T15:44:13.907599+0000","last_active":"2024-04-25T15:44:13.911331+0000","last_peered":"2024-04-25T15:44:13.911331+0000","last_clean":"2024-04-25T15:44:13.911331+0000","last_became_active":"2024-04-25T15:44:13.907294+0000","last_became_peered":"2024-04-25T15:44:13.907294+0000","last_unstale":"2024-04-25T15:44:13.911331+0000","last_undegraded":"2024-04-25T15:44:13.911331+0000","last_fullsized":"2024-04-25T15:44:13.911331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:27.265598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898457+0000","last_change":"2024-04-25T15:44:13.898457+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898457+0000","last_undegraded":"2024-04-25T15:44:13.898457+0000","last_fullsized":"2024-04-25T15:44:13.898457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912140+0000","last_change":"2024-04-25T15:44:13.909667+0000","last_active":"2024-04-25T15:44:13.912140+0000","last_peered":"2024-04-25T15:44:13.912140+0000","last_clean":"2024-04-25T15:44:13.912140+0000","last_became_active":"2024-04-25T15:44:13.909352+0000","last_became_peered":"2024-04-25T15:44:13.909352+0000","last_unstale":"2024-04-25T15:44:13.912140+0000","last_undegraded":"2024-04-25T15:44:13.912140+0000","last_fullsized":"2024-04-25T15:44:13.912140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.906926+0000","last_change":"2024-04-25T15:44:13.905465+0000","last_active":"2024-04-25T15:44:13.906926+0000","last_peered":"2024-04-25T15:44:13.906926+0000","last_clean":"2024-04-25T15:44:13.906926+0000","last_became_active":"2024-04-25T15:44:13.904934+0000","last_became_peered":"2024-04-25T15:44:13.904934+0000","last_unstale":"2024-04-25T15:44:13.906926+0000","last_undegraded":"2024-04-25T15:44:13.906926+0000","last_fullsized":"2024-04-25T15:44:13.906926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:51.344498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898500+0000","last_change":"2024-04-25T15:44:13.898500+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898500+0000","last_undegraded":"2024-04-25T15:44:13.898500+0000","last_fullsized":"2024-04-25T15:44:13.898500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.882888+0000","last_change":"2024-04-25T15:44:12.882888+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.882888+0000","last_undegraded":"2024-04-25T15:44:12.882888+0000","last_fullsized":"2024-04-25T15:44:12.882888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898925+0000","last_change":"2024-04-25T15:44:13.898925+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898925+0000","last_undegraded":"2024-04-25T15:44:13.898925+0000","last_fullsized":"2024-04-25T15:44:13.898925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.887544+0000","last_change":"2024-04-25T15:44:12.887544+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.887544+0000","last_undegraded":"2024-04-25T15:44:12.887544+0000","last_fullsized":"2024-04-25T15:44:12.887544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883039+0000","last_change":"2024-04-25T15:44:12.883039+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883039+0000","last_undegraded":"2024-04-25T15:44:12.883039+0000","last_fullsized":"2024-04-25T15:44:12.883039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907908+0000","last_change":"2024-04-25T15:44:13.903636+0000","last_active":"2024-04-25T15:44:13.907908+0000","last_peered":"2024-04-25T15:44:13.907908+0000","last_clean":"2024-04-25T15:44:13.907908+0000","last_became_active":"2024-04-25T15:44:13.903324+0000","last_became_peered":"2024-04-25T15:44:13.903324+0000","last_unstale":"2024-04-25T15:44:13.907908+0000","last_undegraded":"2024-04-25T15:44:13.907908+0000","last_fullsized":"2024-04-25T15:44:13.907908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:26.716893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893597+0000","last_change":"2024-04-25T15:44:13.893597+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893597+0000","last_undegraded":"2024-04-25T15:44:13.893597+0000","last_fullsized":"2024-04-25T15:44:13.893597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912073+0000","last_change":"2024-04-25T15:44:13.909055+0000","last_active":"2024-04-25T15:44:13.912073+0000","last_peered":"2024-04-25T15:44:13.912073+0000","last_clean":"2024-04-25T15:44:13.912073+0000","last_became_active":"2024-04-25T15:44:13.908746+0000","last_became_peered":"2024-04-25T15:44:13.908746+0000","last_unstale":"2024-04-25T15:44:13.912073+0000","last_undegraded":"2024-04-25T15:44:13.912073+0000","last_fullsized":"2024-04-25T15:44:13.912073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908887+0000","last_change":"2024-04-25T15:44:13.907027+0000","last_active":"2024-04-25T15:44:13.908887+0000","last_peered":"2024-04-25T15:44:13.908887+0000","last_clean":"2024-04-25T15:44:13.908887+0000","last_became_active":"2024-04-25T15:44:13.906711+0000","last_became_peered":"2024-04-25T15:44:13.906711+0000","last_unstale":"2024-04-25T15:44:13.908887+0000","last_undegraded":"2024-04-25T15:44:13.908887+0000","last_fullsized":"2024-04-25T15:44:13.908887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:53.216515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895897+0000","last_change":"2024-04-25T15:44:13.895897+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895897+0000","last_undegraded":"2024-04-25T15:44:13.895897+0000","last_fullsized":"2024-04-25T15:44:13.895897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907847+0000","last_change":"2024-04-25T15:44:13.905601+0000","last_active":"2024-04-25T15:44:13.907847+0000","last_peered":"2024-04-25T15:44:13.907847+0000","last_clean":"2024-04-25T15:44:13.907847+0000","last_became_active":"2024-04-25T15:44:13.905302+0000","last_became_peered":"2024-04-25T15:44:13.905302+0000","last_unstale":"2024-04-25T15:44:13.907847+0000","last_undegraded":"2024-04-25T15:44:13.907847+0000","last_fullsized":"2024-04-25T15:44:13.907847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:15.516137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883782+0000","last_change":"2024-04-25T15:44:12.883782+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883782+0000","last_undegraded":"2024-04-25T15:44:12.883782+0000","last_fullsized":"2024-04-25T15:44:12.883782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899492+0000","last_change":"2024-04-25T15:44:13.899492+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899492+0000","last_undegraded":"2024-04-25T15:44:13.899492+0000","last_fullsized":"2024-04-25T15:44:13.899492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910812+0000","last_change":"2024-04-25T15:44:13.906914+0000","last_active":"2024-04-25T15:44:13.910812+0000","last_peered":"2024-04-25T15:44:13.910812+0000","last_clean":"2024-04-25T15:44:13.910812+0000","last_became_active":"2024-04-25T15:44:13.906620+0000","last_became_peered":"2024-04-25T15:44:13.906620+0000","last_unstale":"2024-04-25T15:44:13.910812+0000","last_undegraded":"2024-04-25T15:44:13.910812+0000","last_fullsized":"2024-04-25T15:44:13.910812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:22.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895626+0000","last_change":"2024-04-25T15:44:13.895626+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895626+0000","last_undegraded":"2024-04-25T15:44:13.895626+0000","last_fullsized":"2024-04-25T15:44:13.895626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.886909+0000","last_change":"2024-04-25T15:44:12.886909+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.886909+0000","last_undegraded":"2024-04-25T15:44:12.886909+0000","last_fullsized":"2024-04-25T15:44:12.886909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907881+0000","last_change":"2024-04-25T15:44:13.904946+0000","last_active":"2024-04-25T15:44:13.907881+0000","last_peered":"2024-04-25T15:44:13.907881+0000","last_clean":"2024-04-25T15:44:13.907881+0000","last_became_active":"2024-04-25T15:44:13.904600+0000","last_became_peered":"2024-04-25T15:44:13.904600+0000","last_unstale":"2024-04-25T15:44:13.907881+0000","last_undegraded":"2024-04-25T15:44:13.907881+0000","last_fullsized":"2024-04-25T15:44:13.907881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:27:52.502490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899328+0000","last_change":"2024-04-25T15:44:13.899328+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899328+0000","last_undegraded":"2024-04-25T15:44:13.899328+0000","last_fullsized":"2024-04-25T15:44:13.899328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911996+0000","last_change":"2024-04-25T15:44:13.910412+0000","last_active":"2024-04-25T15:44:13.911996+0000","last_peered":"2024-04-25T15:44:13.911996+0000","last_clean":"2024-04-25T15:44:13.911996+0000","last_became_active":"2024-04-25T15:44:13.910110+0000","last_became_peered":"2024-04-25T15:44:13.910110+0000","last_unstale":"2024-04-25T15:44:13.911996+0000","last_undegraded":"2024-04-25T15:44:13.911996+0000","last_fullsized":"2024-04-25T15:44:13.911996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896175+0000","last_change":"2024-04-25T15:44:13.896175+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896175+0000","last_undegraded":"2024-04-25T15:44:13.896175+0000","last_fullsized":"2024-04-25T15:44:13.896175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910915+0000","last_change":"2024-04-25T15:44:13.906655+0000","last_active":"2024-04-25T15:44:13.910915+0000","last_peered":"2024-04-25T15:44:13.910915+0000","last_clean":"2024-04-25T15:44:13.910915+0000","last_became_active":"2024-04-25T15:44:13.906266+0000","last_became_peered":"2024-04-25T15:44:13.906266+0000","last_unstale":"2024-04-25T15:44:13.910915+0000","last_undegraded":"2024-04-25T15:44:13.910915+0000","last_fullsized":"2024-04-25T15:44:13.910915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895531+0000","last_change":"2024-04-25T15:44:13.895531+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895531+0000","last_undegraded":"2024-04-25T15:44:13.895531+0000","last_fullsized":"2024-04-25T15:44:13.895531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910307+0000","last_change":"2024-04-25T15:44:13.907835+0000","last_active":"2024-04-25T15:44:13.910307+0000","last_peered":"2024-04-25T15:44:13.910307+0000","last_clean":"2024-04-25T15:44:13.910307+0000","last_became_active":"2024-04-25T15:44:13.907521+0000","last_became_peered":"2024-04-25T15:44:13.907521+0000","last_unstale":"2024-04-25T15:44:13.910307+0000","last_undegraded":"2024-04-25T15:44:13.910307+0000","last_fullsized":"2024-04-25T15:44:13.910307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:38.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883024+0000","last_change":"2024-04-25T15:44:12.883024+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883024+0000","last_undegraded":"2024-04-25T15:44:12.883024+0000","last_fullsized":"2024-04-25T15:44:12.883024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911372+0000","last_change":"2024-04-25T15:44:13.909615+0000","last_active":"2024-04-25T15:44:13.911372+0000","last_peered":"2024-04-25T15:44:13.911372+0000","last_clean":"2024-04-25T15:44:13.911372+0000","last_became_active":"2024-04-25T15:44:13.909300+0000","last_became_peered":"2024-04-25T15:44:13.909300+0000","last_unstale":"2024-04-25T15:44:13.911372+0000","last_undegraded":"2024-04-25T15:44:13.911372+0000","last_fullsized":"2024-04-25T15:44:13.911372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.914823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.884168+0000","last_change":"2024-04-25T15:44:12.884168+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.884168+0000","last_undegraded":"2024-04-25T15:44:12.884168+0000","last_fullsized":"2024-04-25T15:44:12.884168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T15:44:12.884693+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:12.884693+0000","last_peered":"2024-04-25T15:44:12.884693+0000","last_clean":"2024-04-25T15:44:12.884693+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:12.884693+0000","last_undegraded":"2024-04-25T15:44:12.884693+0000","last_fullsized":"2024-04-25T15:44:12.884693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":991232,"data_stored":756932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":166564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":166564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:17.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:18.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.053+0000 7f610a3f3640 1 Processor -- start 2024-04-25T15:44:18.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.053+0000 7f610a3f3640 1 -- start start 2024-04-25T15:44:18.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f610a3f3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f61040b4b60 0x7f61040b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f610a3f3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f610406d6d0 0x7f61040b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f610a3f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b3680 0x7f61040b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f610a3f3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f61040b3fd0 con 0x7f610406d6d0 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f610a3f3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f610406eb60 con 0x7f61040b4b60 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f610a3f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f61040b2f30 con 0x7f61040b3680 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f610406d6d0 0x7f61040b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f610406d6d0 0x7f61040b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41294/0 (socket says 172.21.15.80:41294) 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 -- 172.21.15.80:0/3254716712 learned_addr learned my addr 172.21.15.80:0/3254716712 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f6103fff640 1 --2- 172.21.15.80:0/3254716712 >> v2:172.21.15.195:3300/0 conn(0x7f61040b4b60 0x7f61040b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f6108990640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b3680 0x7f61040b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 -- 172.21.15.80:0/3254716712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b3680 msgr2=0x7f61040b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b3680 0x7f61040b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 -- 172.21.15.80:0/3254716712 >> v2:172.21.15.195:3300/0 conn(0x7f61040b4b60 msgr2=0x7f61040b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 --2- 172.21.15.80:0/3254716712 >> v2:172.21.15.195:3300/0 conn(0x7f61040b4b60 0x7f61040b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f61037fe640 1 -- 172.21.15.80:0/3254716712 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61040b2c90 con 0x7f610406d6d0 2024-04-25T15:44:18.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f6103fff640 1 --2- 172.21.15.80:0/3254716712 >> v2:172.21.15.195:3300/0 conn(0x7f61040b4b60 0x7f61040b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:18.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.055+0000 7f6108990640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b3680 0x7f61040b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:18.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.056+0000 7f61037fe640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610406d6d0 0x7f61040b3140 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f61040b2e60 tx=0x7f60f802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d245b2ae72985a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.056+0000 7f6102ffd640 1 -- 172.21.15.80:0/3254716712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8037070 con 0x7f610406d6d0 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.056+0000 7f6102ffd640 1 -- 172.21.15.80:0/3254716712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8032440 con 0x7f610406d6d0 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.056+0000 7f6102ffd640 1 -- 172.21.15.80:0/3254716712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8032810 con 0x7f610406d6d0 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 -- 172.21.15.80:0/3254716712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610406d6d0 msgr2=0x7f61040b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610406d6d0 0x7f61040b3140 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f61040b2e60 tx=0x7f60f802a160 comp rx=0 tx=0).stop 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 -- 172.21.15.80:0/3254716712 shutdown_connections 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b3680 0x7f61040b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3254716712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610406d6d0 0x7f61040b3140 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3254716712 >> v2:172.21.15.195:3300/0 conn(0x7f61040b4b60 0x7f61040b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 -- 172.21.15.80:0/3254716712 >> 172.21.15.80:0/3254716712 conn(0x7f61040d0450 msgr2=0x7f61040d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 -- 172.21.15.80:0/3254716712 shutdown_connections 2024-04-25T15:44:18.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.057+0000 7f610a3f3640 1 -- 172.21.15.80:0/3254716712 wait complete. 2024-04-25T15:44:18.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.059+0000 7f610a3f3640 1 Processor -- start 2024-04-25T15:44:18.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.059+0000 7f610a3f3640 1 -- start start 2024-04-25T15:44:18.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f610a3f3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610406d6d0 0x7f61041ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f610a3f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 0x7f61041f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f610a3f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b4b60 0x7f61040a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f610a3f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f610409cbe0 con 0x7f61040b3680 2024-04-25T15:44:18.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f610a3f3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f61040d10a0 con 0x7f610406d6d0 2024-04-25T15:44:18.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f610a3f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f610409d0e0 con 0x7f61040b4b60 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 0x7f61041f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 0x7f61041f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41300/0 (socket says 172.21.15.80:41300) 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 -- 172.21.15.80:0/3725098192 learned_addr learned my addr 172.21.15.80:0/3725098192 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f6103fff640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610406d6d0 0x7f61041ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f6108990640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b4b60 0x7f61040a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 -- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b4b60 msgr2=0x7f61040a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b4b60 0x7f61040a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 -- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610406d6d0 msgr2=0x7f61041ecec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.060+0000 7f61037fe640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610406d6d0 0x7f61041ecec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f61037fe640 1 -- 172.21.15.80:0/3725098192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610409f410 con 0x7f61040b3680 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f61037fe640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 0x7f61041f7590 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8037040 con 0x7f61040b3680 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8042070 con 0x7f61040b3680 2024-04-25T15:44:18.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610409f6f0 con 0x7f61040b3680 2024-04-25T15:44:18.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8030bd0 con 0x7f61040b3680 2024-04-25T15:44:18.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.061+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610409fcb0 con 0x7f61040b3680 2024-04-25T15:44:18.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.062+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6104075c90 con 0x7f61040b3680 2024-04-25T15:44:18.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.062+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f60f8047460 con 0x7f61040b3680 2024-04-25T15:44:18.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.063+0000 7f6100ff9640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.063+0000 7f6103fff640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.063+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f60f80b60b0 con 0x7f61040b3680 2024-04-25T15:44:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.063+0000 7f6103fff640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60f400b840 tx=0x7f60f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.068+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60f807ffe0 con 0x7f61040b3680 2024-04-25T15:44:18.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.237+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f610406a100 con 0x7f60f00744b0 2024-04-25T15:44:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.243+0000 7f6100ff9640 1 -- 172.21.15.80:0/3725098192 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243928 (secure 0 0 0) 0x7f610406a100 con 0x7f60f00744b0 2024-04-25T15:44:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 msgr2=0x7f60f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60f400b840 tx=0x7f60f4008040 comp rx=0 tx=0).stop 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 msgr2=0x7f61041f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 0x7f61041f7590 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f80046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 shutdown_connections 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61040b4b60 0x7f61040a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61040b3680 0x7f61041f7590 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 --2- 172.21.15.80:0/3725098192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610406d6d0 0x7f61041ecec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 >> 172.21.15.80:0/3725098192 conn(0x7f61040d0450 msgr2=0x7f610406db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 shutdown_connections 2024-04-25T15:44:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.247+0000 7f610a3f3640 1 -- 172.21.15.80:0/3725098192 wait complete. 2024-04-25T15:44:18.258 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-25T15:44:17.014302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237176,"kb_used_data":4336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737544,"statfs":{"total":773094113280,"available":772851245056,"internally_reserved":0,"allocated":4440064,"data_stored":2550960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.131188"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899394+0000","last_change":"2024-04-25T15:44:13.899394+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899394+0000","last_undegraded":"2024-04-25T15:44:13.899394+0000","last_fullsized":"2024-04-25T15:44:13.899394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899886+0000","last_change":"2024-04-25T15:44:13.899886+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899886+0000","last_undegraded":"2024-04-25T15:44:13.899886+0000","last_fullsized":"2024-04-25T15:44:13.899886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896774+0000","last_change":"2024-04-25T15:44:13.896774+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896774+0000","last_undegraded":"2024-04-25T15:44:13.896774+0000","last_fullsized":"2024-04-25T15:44:13.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894686+0000","last_change":"2024-04-25T15:44:13.894686+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894686+0000","last_undegraded":"2024-04-25T15:44:13.894686+0000","last_fullsized":"2024-04-25T15:44:13.894686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894088+0000","last_change":"2024-04-25T15:44:13.894088+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894088+0000","last_undegraded":"2024-04-25T15:44:13.894088+0000","last_fullsized":"2024-04-25T15:44:13.894088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897800+0000","last_change":"2024-04-25T15:44:13.897800+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897800+0000","last_undegraded":"2024-04-25T15:44:13.897800+0000","last_fullsized":"2024-04-25T15:44:13.897800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898398+0000","last_change":"2024-04-25T15:44:13.898398+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898398+0000","last_undegraded":"2024-04-25T15:44:13.898398+0000","last_fullsized":"2024-04-25T15:44:13.898398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898107+0000","last_change":"2024-04-25T15:44:13.898107+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898107+0000","last_undegraded":"2024-04-25T15:44:13.898107+0000","last_fullsized":"2024-04-25T15:44:13.898107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895345+0000","last_change":"2024-04-25T15:44:13.895345+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895345+0000","last_undegraded":"2024-04-25T15:44:13.895345+0000","last_fullsized":"2024-04-25T15:44:13.895345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893087+0000","last_change":"2024-04-25T15:44:13.893087+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893087+0000","last_undegraded":"2024-04-25T15:44:13.893087+0000","last_fullsized":"2024-04-25T15:44:13.893087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894038+0000","last_change":"2024-04-25T15:44:13.894038+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894038+0000","last_undegraded":"2024-04-25T15:44:13.894038+0000","last_fullsized":"2024-04-25T15:44:13.894038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891312+0000","last_change":"2024-04-25T15:44:13.891312+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891312+0000","last_undegraded":"2024-04-25T15:44:13.891312+0000","last_fullsized":"2024-04-25T15:44:13.891312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893968+0000","last_change":"2024-04-25T15:44:13.893968+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893968+0000","last_undegraded":"2024-04-25T15:44:13.893968+0000","last_fullsized":"2024-04-25T15:44:13.893968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894539+0000","last_change":"2024-04-25T15:44:13.894539+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894539+0000","last_undegraded":"2024-04-25T15:44:13.894539+0000","last_fullsized":"2024-04-25T15:44:13.894539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896435+0000","last_change":"2024-04-25T15:44:13.896435+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896435+0000","last_undegraded":"2024-04-25T15:44:13.896435+0000","last_fullsized":"2024-04-25T15:44:13.896435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.892399+0000","last_change":"2024-04-25T15:44:13.892399+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.892399+0000","last_undegraded":"2024-04-25T15:44:13.892399+0000","last_fullsized":"2024-04-25T15:44:13.892399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891667+0000","last_change":"2024-04-25T15:44:13.891667+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891667+0000","last_undegraded":"2024-04-25T15:44:13.891667+0000","last_fullsized":"2024-04-25T15:44:13.891667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891515+0000","last_change":"2024-04-25T15:44:13.891515+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891515+0000","last_undegraded":"2024-04-25T15:44:13.891515+0000","last_fullsized":"2024-04-25T15:44:13.891515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895016+0000","last_change":"2024-04-25T15:44:13.895016+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895016+0000","last_undegraded":"2024-04-25T15:44:13.895016+0000","last_fullsized":"2024-04-25T15:44:13.895016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908563+0000","last_change":"2024-04-25T15:44:13.906044+0000","last_active":"2024-04-25T15:44:13.908563+0000","last_peered":"2024-04-25T15:44:13.908563+0000","last_clean":"2024-04-25T15:44:13.908563+0000","last_became_active":"2024-04-25T15:44:13.905713+0000","last_became_peered":"2024-04-25T15:44:13.905713+0000","last_unstale":"2024-04-25T15:44:13.908563+0000","last_undegraded":"2024-04-25T15:44:13.908563+0000","last_fullsized":"2024-04-25T15:44:13.908563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:51.097674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897266+0000","last_change":"2024-04-25T15:44:13.897266+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897266+0000","last_undegraded":"2024-04-25T15:44:13.897266+0000","last_fullsized":"2024-04-25T15:44:13.897266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908616+0000","last_change":"2024-04-25T15:44:13.905893+0000","last_active":"2024-04-25T15:44:13.908616+0000","last_peered":"2024-04-25T15:44:13.908616+0000","last_clean":"2024-04-25T15:44:13.908616+0000","last_became_active":"2024-04-25T15:44:13.905538+0000","last_became_peered":"2024-04-25T15:44:13.905538+0000","last_unstale":"2024-04-25T15:44:13.908616+0000","last_undegraded":"2024-04-25T15:44:13.908616+0000","last_fullsized":"2024-04-25T15:44:13.908616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:35.713816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912209+0000","last_change":"2024-04-25T15:44:13.910226+0000","last_active":"2024-04-25T15:44:13.912209+0000","last_peered":"2024-04-25T15:44:13.912209+0000","last_clean":"2024-04-25T15:44:13.912209+0000","last_became_active":"2024-04-25T15:44:13.909924+0000","last_became_peered":"2024-04-25T15:44:13.909924+0000","last_unstale":"2024-04-25T15:44:13.912209+0000","last_undegraded":"2024-04-25T15:44:13.912209+0000","last_fullsized":"2024-04-25T15:44:13.912209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899973+0000","last_change":"2024-04-25T15:44:13.899973+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899973+0000","last_undegraded":"2024-04-25T15:44:13.899973+0000","last_fullsized":"2024-04-25T15:44:13.899973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883061+0000","last_change":"2024-04-25T15:44:12.883061+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883061+0000","last_undegraded":"2024-04-25T15:44:12.883061+0000","last_fullsized":"2024-04-25T15:44:12.883061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897152+0000","last_change":"2024-04-25T15:44:13.897152+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897152+0000","last_undegraded":"2024-04-25T15:44:13.897152+0000","last_fullsized":"2024-04-25T15:44:13.897152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888275+0000","last_change":"2024-04-25T15:44:12.888275+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888275+0000","last_undegraded":"2024-04-25T15:44:12.888275+0000","last_fullsized":"2024-04-25T15:44:12.888275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883080+0000","last_change":"2024-04-25T15:44:12.883080+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883080+0000","last_undegraded":"2024-04-25T15:44:12.883080+0000","last_fullsized":"2024-04-25T15:44:12.883080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912134+0000","last_change":"2024-04-25T15:44:13.909660+0000","last_active":"2024-04-25T15:44:13.912134+0000","last_peered":"2024-04-25T15:44:13.912134+0000","last_clean":"2024-04-25T15:44:13.912134+0000","last_became_active":"2024-04-25T15:44:13.909289+0000","last_became_peered":"2024-04-25T15:44:13.909289+0000","last_unstale":"2024-04-25T15:44:13.912134+0000","last_undegraded":"2024-04-25T15:44:13.912134+0000","last_fullsized":"2024-04-25T15:44:13.912134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.900643+0000","last_change":"2024-04-25T15:44:13.900643+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.900643+0000","last_undegraded":"2024-04-25T15:44:13.900643+0000","last_fullsized":"2024-04-25T15:44:13.900643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.884243+0000","last_change":"2024-04-25T15:44:12.884243+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.884243+0000","last_undegraded":"2024-04-25T15:44:12.884243+0000","last_fullsized":"2024-04-25T15:44:12.884243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893591+0000","last_change":"2024-04-25T15:44:13.893591+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893591+0000","last_undegraded":"2024-04-25T15:44:13.893591+0000","last_fullsized":"2024-04-25T15:44:13.893591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911488+0000","last_change":"2024-04-25T15:44:13.909591+0000","last_active":"2024-04-25T15:44:13.911488+0000","last_peered":"2024-04-25T15:44:13.911488+0000","last_clean":"2024-04-25T15:44:13.911488+0000","last_became_active":"2024-04-25T15:44:13.908524+0000","last_became_peered":"2024-04-25T15:44:13.908524+0000","last_unstale":"2024-04-25T15:44:13.911488+0000","last_undegraded":"2024-04-25T15:44:13.911488+0000","last_fullsized":"2024-04-25T15:44:13.911488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:34.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888560+0000","last_change":"2024-04-25T15:44:12.888560+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888560+0000","last_undegraded":"2024-04-25T15:44:12.888560+0000","last_fullsized":"2024-04-25T15:44:12.888560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897616+0000","last_change":"2024-04-25T15:44:13.897616+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897616+0000","last_undegraded":"2024-04-25T15:44:13.897616+0000","last_fullsized":"2024-04-25T15:44:13.897616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888204+0000","last_change":"2024-04-25T15:44:12.888204+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888204+0000","last_undegraded":"2024-04-25T15:44:12.888204+0000","last_fullsized":"2024-04-25T15:44:12.888204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910809+0000","last_change":"2024-04-25T15:44:13.905855+0000","last_active":"2024-04-25T15:44:13.910809+0000","last_peered":"2024-04-25T15:44:13.910809+0000","last_clean":"2024-04-25T15:44:13.910809+0000","last_became_active":"2024-04-25T15:44:13.905531+0000","last_became_peered":"2024-04-25T15:44:13.905531+0000","last_unstale":"2024-04-25T15:44:13.910809+0000","last_undegraded":"2024-04-25T15:44:13.910809+0000","last_fullsized":"2024-04-25T15:44:13.910809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.068667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896677+0000","last_change":"2024-04-25T15:44:13.896677+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896677+0000","last_undegraded":"2024-04-25T15:44:13.896677+0000","last_fullsized":"2024-04-25T15:44:13.896677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911331+0000","last_change":"2024-04-25T15:44:13.907599+0000","last_active":"2024-04-25T15:44:13.911331+0000","last_peered":"2024-04-25T15:44:13.911331+0000","last_clean":"2024-04-25T15:44:13.911331+0000","last_became_active":"2024-04-25T15:44:13.907294+0000","last_became_peered":"2024-04-25T15:44:13.907294+0000","last_unstale":"2024-04-25T15:44:13.911331+0000","last_undegraded":"2024-04-25T15:44:13.911331+0000","last_fullsized":"2024-04-25T15:44:13.911331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:27.265598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898457+0000","last_change":"2024-04-25T15:44:13.898457+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898457+0000","last_undegraded":"2024-04-25T15:44:13.898457+0000","last_fullsized":"2024-04-25T15:44:13.898457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912140+0000","last_change":"2024-04-25T15:44:13.909667+0000","last_active":"2024-04-25T15:44:13.912140+0000","last_peered":"2024-04-25T15:44:13.912140+0000","last_clean":"2024-04-25T15:44:13.912140+0000","last_became_active":"2024-04-25T15:44:13.909352+0000","last_became_peered":"2024-04-25T15:44:13.909352+0000","last_unstale":"2024-04-25T15:44:13.912140+0000","last_undegraded":"2024-04-25T15:44:13.912140+0000","last_fullsized":"2024-04-25T15:44:13.912140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.906926+0000","last_change":"2024-04-25T15:44:13.905465+0000","last_active":"2024-04-25T15:44:13.906926+0000","last_peered":"2024-04-25T15:44:13.906926+0000","last_clean":"2024-04-25T15:44:13.906926+0000","last_became_active":"2024-04-25T15:44:13.904934+0000","last_became_peered":"2024-04-25T15:44:13.904934+0000","last_unstale":"2024-04-25T15:44:13.906926+0000","last_undegraded":"2024-04-25T15:44:13.906926+0000","last_fullsized":"2024-04-25T15:44:13.906926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:51.344498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898500+0000","last_change":"2024-04-25T15:44:13.898500+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898500+0000","last_undegraded":"2024-04-25T15:44:13.898500+0000","last_fullsized":"2024-04-25T15:44:13.898500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.882888+0000","last_change":"2024-04-25T15:44:12.882888+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.882888+0000","last_undegraded":"2024-04-25T15:44:12.882888+0000","last_fullsized":"2024-04-25T15:44:12.882888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898925+0000","last_change":"2024-04-25T15:44:13.898925+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898925+0000","last_undegraded":"2024-04-25T15:44:13.898925+0000","last_fullsized":"2024-04-25T15:44:13.898925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.887544+0000","last_change":"2024-04-25T15:44:12.887544+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.887544+0000","last_undegraded":"2024-04-25T15:44:12.887544+0000","last_fullsized":"2024-04-25T15:44:12.887544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883039+0000","last_change":"2024-04-25T15:44:12.883039+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883039+0000","last_undegraded":"2024-04-25T15:44:12.883039+0000","last_fullsized":"2024-04-25T15:44:12.883039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907908+0000","last_change":"2024-04-25T15:44:13.903636+0000","last_active":"2024-04-25T15:44:13.907908+0000","last_peered":"2024-04-25T15:44:13.907908+0000","last_clean":"2024-04-25T15:44:13.907908+0000","last_became_active":"2024-04-25T15:44:13.903324+0000","last_became_peered":"2024-04-25T15:44:13.903324+0000","last_unstale":"2024-04-25T15:44:13.907908+0000","last_undegraded":"2024-04-25T15:44:13.907908+0000","last_fullsized":"2024-04-25T15:44:13.907908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:26.716893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893597+0000","last_change":"2024-04-25T15:44:13.893597+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893597+0000","last_undegraded":"2024-04-25T15:44:13.893597+0000","last_fullsized":"2024-04-25T15:44:13.893597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912073+0000","last_change":"2024-04-25T15:44:13.909055+0000","last_active":"2024-04-25T15:44:13.912073+0000","last_peered":"2024-04-25T15:44:13.912073+0000","last_clean":"2024-04-25T15:44:13.912073+0000","last_became_active":"2024-04-25T15:44:13.908746+0000","last_became_peered":"2024-04-25T15:44:13.908746+0000","last_unstale":"2024-04-25T15:44:13.912073+0000","last_undegraded":"2024-04-25T15:44:13.912073+0000","last_fullsized":"2024-04-25T15:44:13.912073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908887+0000","last_change":"2024-04-25T15:44:13.907027+0000","last_active":"2024-04-25T15:44:13.908887+0000","last_peered":"2024-04-25T15:44:13.908887+0000","last_clean":"2024-04-25T15:44:13.908887+0000","last_became_active":"2024-04-25T15:44:13.906711+0000","last_became_peered":"2024-04-25T15:44:13.906711+0000","last_unstale":"2024-04-25T15:44:13.908887+0000","last_undegraded":"2024-04-25T15:44:13.908887+0000","last_fullsized":"2024-04-25T15:44:13.908887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:53.216515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895897+0000","last_change":"2024-04-25T15:44:13.895897+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895897+0000","last_undegraded":"2024-04-25T15:44:13.895897+0000","last_fullsized":"2024-04-25T15:44:13.895897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907847+0000","last_change":"2024-04-25T15:44:13.905601+0000","last_active":"2024-04-25T15:44:13.907847+0000","last_peered":"2024-04-25T15:44:13.907847+0000","last_clean":"2024-04-25T15:44:13.907847+0000","last_became_active":"2024-04-25T15:44:13.905302+0000","last_became_peered":"2024-04-25T15:44:13.905302+0000","last_unstale":"2024-04-25T15:44:13.907847+0000","last_undegraded":"2024-04-25T15:44:13.907847+0000","last_fullsized":"2024-04-25T15:44:13.907847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:15.516137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883782+0000","last_change":"2024-04-25T15:44:12.883782+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883782+0000","last_undegraded":"2024-04-25T15:44:12.883782+0000","last_fullsized":"2024-04-25T15:44:12.883782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899492+0000","last_change":"2024-04-25T15:44:13.899492+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899492+0000","last_undegraded":"2024-04-25T15:44:13.899492+0000","last_fullsized":"2024-04-25T15:44:13.899492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910812+0000","last_change":"2024-04-25T15:44:13.906914+0000","last_active":"2024-04-25T15:44:13.910812+0000","last_peered":"2024-04-25T15:44:13.910812+0000","last_clean":"2024-04-25T15:44:13.910812+0000","last_became_active":"2024-04-25T15:44:13.906620+0000","last_became_peered":"2024-04-25T15:44:13.906620+0000","last_unstale":"2024-04-25T15:44:13.910812+0000","last_undegraded":"2024-04-25T15:44:13.910812+0000","last_fullsized":"2024-04-25T15:44:13.910812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:22.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895626+0000","last_change":"2024-04-25T15:44:13.895626+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895626+0000","last_undegraded":"2024-04-25T15:44:13.895626+0000","last_fullsized":"2024-04-25T15:44:13.895626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.886909+0000","last_change":"2024-04-25T15:44:12.886909+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.886909+0000","last_undegraded":"2024-04-25T15:44:12.886909+0000","last_fullsized":"2024-04-25T15:44:12.886909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907881+0000","last_change":"2024-04-25T15:44:13.904946+0000","last_active":"2024-04-25T15:44:13.907881+0000","last_peered":"2024-04-25T15:44:13.907881+0000","last_clean":"2024-04-25T15:44:13.907881+0000","last_became_active":"2024-04-25T15:44:13.904600+0000","last_became_peered":"2024-04-25T15:44:13.904600+0000","last_unstale":"2024-04-25T15:44:13.907881+0000","last_undegraded":"2024-04-25T15:44:13.907881+0000","last_fullsized":"2024-04-25T15:44:13.907881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:27:52.502490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899328+0000","last_change":"2024-04-25T15:44:13.899328+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899328+0000","last_undegraded":"2024-04-25T15:44:13.899328+0000","last_fullsized":"2024-04-25T15:44:13.899328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911996+0000","last_change":"2024-04-25T15:44:13.910412+0000","last_active":"2024-04-25T15:44:13.911996+0000","last_peered":"2024-04-25T15:44:13.911996+0000","last_clean":"2024-04-25T15:44:13.911996+0000","last_became_active":"2024-04-25T15:44:13.910110+0000","last_became_peered":"2024-04-25T15:44:13.910110+0000","last_unstale":"2024-04-25T15:44:13.911996+0000","last_undegraded":"2024-04-25T15:44:13.911996+0000","last_fullsized":"2024-04-25T15:44:13.911996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896175+0000","last_change":"2024-04-25T15:44:13.896175+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896175+0000","last_undegraded":"2024-04-25T15:44:13.896175+0000","last_fullsized":"2024-04-25T15:44:13.896175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910915+0000","last_change":"2024-04-25T15:44:13.906655+0000","last_active":"2024-04-25T15:44:13.910915+0000","last_peered":"2024-04-25T15:44:13.910915+0000","last_clean":"2024-04-25T15:44:13.910915+0000","last_became_active":"2024-04-25T15:44:13.906266+0000","last_became_peered":"2024-04-25T15:44:13.906266+0000","last_unstale":"2024-04-25T15:44:13.910915+0000","last_undegraded":"2024-04-25T15:44:13.910915+0000","last_fullsized":"2024-04-25T15:44:13.910915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895531+0000","last_change":"2024-04-25T15:44:13.895531+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895531+0000","last_undegraded":"2024-04-25T15:44:13.895531+0000","last_fullsized":"2024-04-25T15:44:13.895531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910307+0000","last_change":"2024-04-25T15:44:13.907835+0000","last_active":"2024-04-25T15:44:13.910307+0000","last_peered":"2024-04-25T15:44:13.910307+0000","last_clean":"2024-04-25T15:44:13.910307+0000","last_became_active":"2024-04-25T15:44:13.907521+0000","last_became_peered":"2024-04-25T15:44:13.907521+0000","last_unstale":"2024-04-25T15:44:13.910307+0000","last_undegraded":"2024-04-25T15:44:13.910307+0000","last_fullsized":"2024-04-25T15:44:13.910307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:38.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883024+0000","last_change":"2024-04-25T15:44:12.883024+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883024+0000","last_undegraded":"2024-04-25T15:44:12.883024+0000","last_fullsized":"2024-04-25T15:44:12.883024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911372+0000","last_change":"2024-04-25T15:44:13.909615+0000","last_active":"2024-04-25T15:44:13.911372+0000","last_peered":"2024-04-25T15:44:13.911372+0000","last_clean":"2024-04-25T15:44:13.911372+0000","last_became_active":"2024-04-25T15:44:13.909300+0000","last_became_peered":"2024-04-25T15:44:13.909300+0000","last_unstale":"2024-04-25T15:44:13.911372+0000","last_undegraded":"2024-04-25T15:44:13.911372+0000","last_fullsized":"2024-04-25T15:44:13.911372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.914823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.884168+0000","last_change":"2024-04-25T15:44:12.884168+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.884168+0000","last_undegraded":"2024-04-25T15:44:12.884168+0000","last_fullsized":"2024-04-25T15:44:12.884168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T15:44:12.884693+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:12.884693+0000","last_peered":"2024-04-25T15:44:12.884693+0000","last_clean":"2024-04-25T15:44:12.884693+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:12.884693+0000","last_undegraded":"2024-04-25T15:44:12.884693+0000","last_fullsized":"2024-04-25T15:44:12.884693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":991232,"data_stored":756932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":166564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":166564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:18.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.405+0000 7f0137cd8640 1 Processor -- start 2024-04-25T15:44:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.405+0000 7f0137cd8640 1 -- start start 2024-04-25T15:44:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.406+0000 7f0137cd8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01300cfc40 0x7f0130160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.406+0000 7f0137cd8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0130164690 0x7f01300714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.406+0000 7f0137cd8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0130071df0 con 0x7f01300719e0 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.406+0000 7f0137cd8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f01300b6eb0 con 0x7f0130164690 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.406+0000 7f0137cd8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01300b7150 con 0x7f01300cfc40 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135273640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0130164690 0x7f01300714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0136275640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f01300719e0 0x7f013006c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:37676/0 (socket says 172.21.15.80:37676) 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135a74640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01300cfc40 0x7f0130160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0136275640 1 -- 172.21.15.80:0/1850761122 learned_addr learned my addr 172.21.15.80:0/1850761122 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135273640 1 -- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01300cfc40 msgr2=0x7f0130160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135273640 1 --2- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01300cfc40 0x7f0130160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135273640 1 -- 172.21.15.80:0/1850761122 >> v1:172.21.15.195:6789/0 conn(0x7f01300719e0 legacy=0x7f013006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135273640 1 -- 172.21.15.80:0/1850761122 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01300b51e0 con 0x7f0130164690 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.407+0000 7f0135a74640 1 --2- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01300cfc40 0x7f0130160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.408+0000 7f0135273640 1 --2- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130164690 0x7f01300714a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f01200097a0 tx=0x7f012002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afcb878cf7351745 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.408+0000 7f0134a72640 1 -- 172.21.15.80:0/1850761122 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120037070 con 0x7f0130164690 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.408+0000 7f0134a72640 1 -- 172.21.15.80:0/1850761122 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012002ae50 con 0x7f0130164690 2024-04-25T15:44:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.408+0000 7f0134a72640 1 -- 172.21.15.80:0/1850761122 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120032660 con 0x7f0130164690 2024-04-25T15:44:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 -- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130164690 msgr2=0x7f01300714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 --2- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130164690 0x7f01300714a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f01200097a0 tx=0x7f012002a100 comp rx=0 tx=0).stop 2024-04-25T15:44:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 -- 172.21.15.80:0/1850761122 shutdown_connections 2024-04-25T15:44:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 --2- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0130164690 0x7f01300714a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 --2- 172.21.15.80:0/1850761122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01300cfc40 0x7f0130160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 -- 172.21.15.80:0/1850761122 >> 172.21.15.80:0/1850761122 conn(0x7f01300d2080 msgr2=0x7f01300d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 -- 172.21.15.80:0/1850761122 shutdown_connections 2024-04-25T15:44:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.409+0000 7f0137cd8640 1 -- 172.21.15.80:0/1850761122 wait complete. 2024-04-25T15:44:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.410+0000 7f0137cd8640 1 Processor -- start 2024-04-25T15:44:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.411+0000 7f0137cd8640 1 -- start start 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0137cd8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 0x7f01301fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0137cd8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01300cfc40 0x7f01301fab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0137cd8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0130164690 0x7f0130154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0137cd8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0130072040 con 0x7f01300719e0 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0137cd8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f01300b7430 con 0x7f01300cfc40 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0137cd8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01300b6b70 con 0x7f0130164690 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 0x7f01301fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 0x7f01301fa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41316/0 (socket says 172.21.15.80:41316) 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 -- 172.21.15.80:0/2875046768 learned_addr learned my addr 172.21.15.80:0/2875046768 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135273640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01300cfc40 0x7f01301fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0136275640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0130164690 0x7f0130154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 -- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0130164690 msgr2=0x7f0130154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0130164690 0x7f0130154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 -- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01300cfc40 msgr2=0x7f01301fab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01300cfc40 0x7f01301fab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 -- 172.21.15.80:0/2875046768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0130156ff0 con 0x7f01300719e0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135273640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01300cfc40 0x7f01301fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0136275640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0130164690 0x7f0130154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.412+0000 7f0135a74640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 0x7f01301fa5d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e990 tx=0x7f012c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.413+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c017070 con 0x7f01300719e0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.413+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c00c9e0 con 0x7f01300719e0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.413+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0130162090 con 0x7f01300719e0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.413+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c00cdb0 con 0x7f01300719e0 2024-04-25T15:44:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.413+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01301617f0 con 0x7f01300719e0 2024-04-25T15:44:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.413+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013015cb00 con 0x7f01300719e0 2024-04-25T15:44:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.414+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f012c01a070 con 0x7f01300719e0 2024-04-25T15:44:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.415+0000 7f01267fc640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01140744b0 0x7f01140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.415+0000 7f0135273640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01140744b0 0x7f01140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.415+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f012c095250 con 0x7f01300719e0 2024-04-25T15:44:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.415+0000 7f0135273640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01140744b0 0x7f01140769c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0120034000 tx=0x7f012002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.419+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f013015cb00 con 0x7f01300719e0 2024-04-25T15:44:18.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.590+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0130164aa0 con 0x7f01140744b0 2024-04-25T15:44:18.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.596+0000 7f01267fc640 1 -- 172.21.15.80:0/2875046768 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243928 (secure 0 0 0) 0x7f0130164aa0 con 0x7f01140744b0 2024-04-25T15:44:18.599 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:18.600 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:18.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01140744b0 msgr2=0x7f01140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01140744b0 0x7f01140769c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0120034000 tx=0x7f012002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:18.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 msgr2=0x7f01301fa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 0x7f01301fa5d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e990 tx=0x7f012c00ee50 comp rx=0 tx=0).stop 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 shutdown_connections 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01140744b0 0x7f01140769c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0130164690 0x7f0130154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01300cfc40 0x7f01301fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 --2- 172.21.15.80:0/2875046768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01300719e0 0x7f01301fa5d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 >> 172.21.15.80:0/2875046768 conn(0x7f01300d2080 msgr2=0x7f013015c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 shutdown_connections 2024-04-25T15:44:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.599+0000 7f0137cd8640 1 -- 172.21.15.80:0/2875046768 wait complete. 2024-04-25T15:44:18.610 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-25T15:44:17.014302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237176,"kb_used_data":4336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737544,"statfs":{"total":773094113280,"available":772851245056,"internally_reserved":0,"allocated":4440064,"data_stored":2550960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.131188"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899394+0000","last_change":"2024-04-25T15:44:13.899394+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899394+0000","last_undegraded":"2024-04-25T15:44:13.899394+0000","last_fullsized":"2024-04-25T15:44:13.899394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899886+0000","last_change":"2024-04-25T15:44:13.899886+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899886+0000","last_undegraded":"2024-04-25T15:44:13.899886+0000","last_fullsized":"2024-04-25T15:44:13.899886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896774+0000","last_change":"2024-04-25T15:44:13.896774+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896774+0000","last_undegraded":"2024-04-25T15:44:13.896774+0000","last_fullsized":"2024-04-25T15:44:13.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894686+0000","last_change":"2024-04-25T15:44:13.894686+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894686+0000","last_undegraded":"2024-04-25T15:44:13.894686+0000","last_fullsized":"2024-04-25T15:44:13.894686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894088+0000","last_change":"2024-04-25T15:44:13.894088+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894088+0000","last_undegraded":"2024-04-25T15:44:13.894088+0000","last_fullsized":"2024-04-25T15:44:13.894088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897800+0000","last_change":"2024-04-25T15:44:13.897800+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897800+0000","last_undegraded":"2024-04-25T15:44:13.897800+0000","last_fullsized":"2024-04-25T15:44:13.897800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898398+0000","last_change":"2024-04-25T15:44:13.898398+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898398+0000","last_undegraded":"2024-04-25T15:44:13.898398+0000","last_fullsized":"2024-04-25T15:44:13.898398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898107+0000","last_change":"2024-04-25T15:44:13.898107+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898107+0000","last_undegraded":"2024-04-25T15:44:13.898107+0000","last_fullsized":"2024-04-25T15:44:13.898107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895345+0000","last_change":"2024-04-25T15:44:13.895345+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895345+0000","last_undegraded":"2024-04-25T15:44:13.895345+0000","last_fullsized":"2024-04-25T15:44:13.895345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893087+0000","last_change":"2024-04-25T15:44:13.893087+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893087+0000","last_undegraded":"2024-04-25T15:44:13.893087+0000","last_fullsized":"2024-04-25T15:44:13.893087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894038+0000","last_change":"2024-04-25T15:44:13.894038+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894038+0000","last_undegraded":"2024-04-25T15:44:13.894038+0000","last_fullsized":"2024-04-25T15:44:13.894038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891312+0000","last_change":"2024-04-25T15:44:13.891312+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891312+0000","last_undegraded":"2024-04-25T15:44:13.891312+0000","last_fullsized":"2024-04-25T15:44:13.891312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893968+0000","last_change":"2024-04-25T15:44:13.893968+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893968+0000","last_undegraded":"2024-04-25T15:44:13.893968+0000","last_fullsized":"2024-04-25T15:44:13.893968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894539+0000","last_change":"2024-04-25T15:44:13.894539+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894539+0000","last_undegraded":"2024-04-25T15:44:13.894539+0000","last_fullsized":"2024-04-25T15:44:13.894539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896435+0000","last_change":"2024-04-25T15:44:13.896435+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896435+0000","last_undegraded":"2024-04-25T15:44:13.896435+0000","last_fullsized":"2024-04-25T15:44:13.896435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.892399+0000","last_change":"2024-04-25T15:44:13.892399+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.892399+0000","last_undegraded":"2024-04-25T15:44:13.892399+0000","last_fullsized":"2024-04-25T15:44:13.892399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891667+0000","last_change":"2024-04-25T15:44:13.891667+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891667+0000","last_undegraded":"2024-04-25T15:44:13.891667+0000","last_fullsized":"2024-04-25T15:44:13.891667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891515+0000","last_change":"2024-04-25T15:44:13.891515+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891515+0000","last_undegraded":"2024-04-25T15:44:13.891515+0000","last_fullsized":"2024-04-25T15:44:13.891515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895016+0000","last_change":"2024-04-25T15:44:13.895016+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895016+0000","last_undegraded":"2024-04-25T15:44:13.895016+0000","last_fullsized":"2024-04-25T15:44:13.895016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908563+0000","last_change":"2024-04-25T15:44:13.906044+0000","last_active":"2024-04-25T15:44:13.908563+0000","last_peered":"2024-04-25T15:44:13.908563+0000","last_clean":"2024-04-25T15:44:13.908563+0000","last_became_active":"2024-04-25T15:44:13.905713+0000","last_became_peered":"2024-04-25T15:44:13.905713+0000","last_unstale":"2024-04-25T15:44:13.908563+0000","last_undegraded":"2024-04-25T15:44:13.908563+0000","last_fullsized":"2024-04-25T15:44:13.908563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:51.097674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897266+0000","last_change":"2024-04-25T15:44:13.897266+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897266+0000","last_undegraded":"2024-04-25T15:44:13.897266+0000","last_fullsized":"2024-04-25T15:44:13.897266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908616+0000","last_change":"2024-04-25T15:44:13.905893+0000","last_active":"2024-04-25T15:44:13.908616+0000","last_peered":"2024-04-25T15:44:13.908616+0000","last_clean":"2024-04-25T15:44:13.908616+0000","last_became_active":"2024-04-25T15:44:13.905538+0000","last_became_peered":"2024-04-25T15:44:13.905538+0000","last_unstale":"2024-04-25T15:44:13.908616+0000","last_undegraded":"2024-04-25T15:44:13.908616+0000","last_fullsized":"2024-04-25T15:44:13.908616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:35.713816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912209+0000","last_change":"2024-04-25T15:44:13.910226+0000","last_active":"2024-04-25T15:44:13.912209+0000","last_peered":"2024-04-25T15:44:13.912209+0000","last_clean":"2024-04-25T15:44:13.912209+0000","last_became_active":"2024-04-25T15:44:13.909924+0000","last_became_peered":"2024-04-25T15:44:13.909924+0000","last_unstale":"2024-04-25T15:44:13.912209+0000","last_undegraded":"2024-04-25T15:44:13.912209+0000","last_fullsized":"2024-04-25T15:44:13.912209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899973+0000","last_change":"2024-04-25T15:44:13.899973+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899973+0000","last_undegraded":"2024-04-25T15:44:13.899973+0000","last_fullsized":"2024-04-25T15:44:13.899973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883061+0000","last_change":"2024-04-25T15:44:12.883061+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883061+0000","last_undegraded":"2024-04-25T15:44:12.883061+0000","last_fullsized":"2024-04-25T15:44:12.883061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897152+0000","last_change":"2024-04-25T15:44:13.897152+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897152+0000","last_undegraded":"2024-04-25T15:44:13.897152+0000","last_fullsized":"2024-04-25T15:44:13.897152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888275+0000","last_change":"2024-04-25T15:44:12.888275+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888275+0000","last_undegraded":"2024-04-25T15:44:12.888275+0000","last_fullsized":"2024-04-25T15:44:12.888275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883080+0000","last_change":"2024-04-25T15:44:12.883080+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883080+0000","last_undegraded":"2024-04-25T15:44:12.883080+0000","last_fullsized":"2024-04-25T15:44:12.883080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912134+0000","last_change":"2024-04-25T15:44:13.909660+0000","last_active":"2024-04-25T15:44:13.912134+0000","last_peered":"2024-04-25T15:44:13.912134+0000","last_clean":"2024-04-25T15:44:13.912134+0000","last_became_active":"2024-04-25T15:44:13.909289+0000","last_became_peered":"2024-04-25T15:44:13.909289+0000","last_unstale":"2024-04-25T15:44:13.912134+0000","last_undegraded":"2024-04-25T15:44:13.912134+0000","last_fullsized":"2024-04-25T15:44:13.912134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.900643+0000","last_change":"2024-04-25T15:44:13.900643+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.900643+0000","last_undegraded":"2024-04-25T15:44:13.900643+0000","last_fullsized":"2024-04-25T15:44:13.900643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.884243+0000","last_change":"2024-04-25T15:44:12.884243+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.884243+0000","last_undegraded":"2024-04-25T15:44:12.884243+0000","last_fullsized":"2024-04-25T15:44:12.884243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893591+0000","last_change":"2024-04-25T15:44:13.893591+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893591+0000","last_undegraded":"2024-04-25T15:44:13.893591+0000","last_fullsized":"2024-04-25T15:44:13.893591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911488+0000","last_change":"2024-04-25T15:44:13.909591+0000","last_active":"2024-04-25T15:44:13.911488+0000","last_peered":"2024-04-25T15:44:13.911488+0000","last_clean":"2024-04-25T15:44:13.911488+0000","last_became_active":"2024-04-25T15:44:13.908524+0000","last_became_peered":"2024-04-25T15:44:13.908524+0000","last_unstale":"2024-04-25T15:44:13.911488+0000","last_undegraded":"2024-04-25T15:44:13.911488+0000","last_fullsized":"2024-04-25T15:44:13.911488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:34.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888560+0000","last_change":"2024-04-25T15:44:12.888560+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888560+0000","last_undegraded":"2024-04-25T15:44:12.888560+0000","last_fullsized":"2024-04-25T15:44:12.888560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897616+0000","last_change":"2024-04-25T15:44:13.897616+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897616+0000","last_undegraded":"2024-04-25T15:44:13.897616+0000","last_fullsized":"2024-04-25T15:44:13.897616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.888204+0000","last_change":"2024-04-25T15:44:12.888204+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.888204+0000","last_undegraded":"2024-04-25T15:44:12.888204+0000","last_fullsized":"2024-04-25T15:44:12.888204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910809+0000","last_change":"2024-04-25T15:44:13.905855+0000","last_active":"2024-04-25T15:44:13.910809+0000","last_peered":"2024-04-25T15:44:13.910809+0000","last_clean":"2024-04-25T15:44:13.910809+0000","last_became_active":"2024-04-25T15:44:13.905531+0000","last_became_peered":"2024-04-25T15:44:13.905531+0000","last_unstale":"2024-04-25T15:44:13.910809+0000","last_undegraded":"2024-04-25T15:44:13.910809+0000","last_fullsized":"2024-04-25T15:44:13.910809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.068667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896677+0000","last_change":"2024-04-25T15:44:13.896677+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896677+0000","last_undegraded":"2024-04-25T15:44:13.896677+0000","last_fullsized":"2024-04-25T15:44:13.896677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911331+0000","last_change":"2024-04-25T15:44:13.907599+0000","last_active":"2024-04-25T15:44:13.911331+0000","last_peered":"2024-04-25T15:44:13.911331+0000","last_clean":"2024-04-25T15:44:13.911331+0000","last_became_active":"2024-04-25T15:44:13.907294+0000","last_became_peered":"2024-04-25T15:44:13.907294+0000","last_unstale":"2024-04-25T15:44:13.911331+0000","last_undegraded":"2024-04-25T15:44:13.911331+0000","last_fullsized":"2024-04-25T15:44:13.911331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:27.265598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898457+0000","last_change":"2024-04-25T15:44:13.898457+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898457+0000","last_undegraded":"2024-04-25T15:44:13.898457+0000","last_fullsized":"2024-04-25T15:44:13.898457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912140+0000","last_change":"2024-04-25T15:44:13.909667+0000","last_active":"2024-04-25T15:44:13.912140+0000","last_peered":"2024-04-25T15:44:13.912140+0000","last_clean":"2024-04-25T15:44:13.912140+0000","last_became_active":"2024-04-25T15:44:13.909352+0000","last_became_peered":"2024-04-25T15:44:13.909352+0000","last_unstale":"2024-04-25T15:44:13.912140+0000","last_undegraded":"2024-04-25T15:44:13.912140+0000","last_fullsized":"2024-04-25T15:44:13.912140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.906926+0000","last_change":"2024-04-25T15:44:13.905465+0000","last_active":"2024-04-25T15:44:13.906926+0000","last_peered":"2024-04-25T15:44:13.906926+0000","last_clean":"2024-04-25T15:44:13.906926+0000","last_became_active":"2024-04-25T15:44:13.904934+0000","last_became_peered":"2024-04-25T15:44:13.904934+0000","last_unstale":"2024-04-25T15:44:13.906926+0000","last_undegraded":"2024-04-25T15:44:13.906926+0000","last_fullsized":"2024-04-25T15:44:13.906926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:51.344498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898500+0000","last_change":"2024-04-25T15:44:13.898500+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898500+0000","last_undegraded":"2024-04-25T15:44:13.898500+0000","last_fullsized":"2024-04-25T15:44:13.898500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.882888+0000","last_change":"2024-04-25T15:44:12.882888+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.882888+0000","last_undegraded":"2024-04-25T15:44:12.882888+0000","last_fullsized":"2024-04-25T15:44:12.882888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898925+0000","last_change":"2024-04-25T15:44:13.898925+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898925+0000","last_undegraded":"2024-04-25T15:44:13.898925+0000","last_fullsized":"2024-04-25T15:44:13.898925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.887544+0000","last_change":"2024-04-25T15:44:12.887544+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.887544+0000","last_undegraded":"2024-04-25T15:44:12.887544+0000","last_fullsized":"2024-04-25T15:44:12.887544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883039+0000","last_change":"2024-04-25T15:44:12.883039+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883039+0000","last_undegraded":"2024-04-25T15:44:12.883039+0000","last_fullsized":"2024-04-25T15:44:12.883039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907908+0000","last_change":"2024-04-25T15:44:13.903636+0000","last_active":"2024-04-25T15:44:13.907908+0000","last_peered":"2024-04-25T15:44:13.907908+0000","last_clean":"2024-04-25T15:44:13.907908+0000","last_became_active":"2024-04-25T15:44:13.903324+0000","last_became_peered":"2024-04-25T15:44:13.903324+0000","last_unstale":"2024-04-25T15:44:13.907908+0000","last_undegraded":"2024-04-25T15:44:13.907908+0000","last_fullsized":"2024-04-25T15:44:13.907908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:26.716893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893597+0000","last_change":"2024-04-25T15:44:13.893597+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893597+0000","last_undegraded":"2024-04-25T15:44:13.893597+0000","last_fullsized":"2024-04-25T15:44:13.893597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912073+0000","last_change":"2024-04-25T15:44:13.909055+0000","last_active":"2024-04-25T15:44:13.912073+0000","last_peered":"2024-04-25T15:44:13.912073+0000","last_clean":"2024-04-25T15:44:13.912073+0000","last_became_active":"2024-04-25T15:44:13.908746+0000","last_became_peered":"2024-04-25T15:44:13.908746+0000","last_unstale":"2024-04-25T15:44:13.912073+0000","last_undegraded":"2024-04-25T15:44:13.912073+0000","last_fullsized":"2024-04-25T15:44:13.912073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908887+0000","last_change":"2024-04-25T15:44:13.907027+0000","last_active":"2024-04-25T15:44:13.908887+0000","last_peered":"2024-04-25T15:44:13.908887+0000","last_clean":"2024-04-25T15:44:13.908887+0000","last_became_active":"2024-04-25T15:44:13.906711+0000","last_became_peered":"2024-04-25T15:44:13.906711+0000","last_unstale":"2024-04-25T15:44:13.908887+0000","last_undegraded":"2024-04-25T15:44:13.908887+0000","last_fullsized":"2024-04-25T15:44:13.908887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:53.216515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895897+0000","last_change":"2024-04-25T15:44:13.895897+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895897+0000","last_undegraded":"2024-04-25T15:44:13.895897+0000","last_fullsized":"2024-04-25T15:44:13.895897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907847+0000","last_change":"2024-04-25T15:44:13.905601+0000","last_active":"2024-04-25T15:44:13.907847+0000","last_peered":"2024-04-25T15:44:13.907847+0000","last_clean":"2024-04-25T15:44:13.907847+0000","last_became_active":"2024-04-25T15:44:13.905302+0000","last_became_peered":"2024-04-25T15:44:13.905302+0000","last_unstale":"2024-04-25T15:44:13.907847+0000","last_undegraded":"2024-04-25T15:44:13.907847+0000","last_fullsized":"2024-04-25T15:44:13.907847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:15.516137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883782+0000","last_change":"2024-04-25T15:44:12.883782+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883782+0000","last_undegraded":"2024-04-25T15:44:12.883782+0000","last_fullsized":"2024-04-25T15:44:12.883782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899492+0000","last_change":"2024-04-25T15:44:13.899492+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899492+0000","last_undegraded":"2024-04-25T15:44:13.899492+0000","last_fullsized":"2024-04-25T15:44:13.899492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910812+0000","last_change":"2024-04-25T15:44:13.906914+0000","last_active":"2024-04-25T15:44:13.910812+0000","last_peered":"2024-04-25T15:44:13.910812+0000","last_clean":"2024-04-25T15:44:13.910812+0000","last_became_active":"2024-04-25T15:44:13.906620+0000","last_became_peered":"2024-04-25T15:44:13.906620+0000","last_unstale":"2024-04-25T15:44:13.910812+0000","last_undegraded":"2024-04-25T15:44:13.910812+0000","last_fullsized":"2024-04-25T15:44:13.910812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:22.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895626+0000","last_change":"2024-04-25T15:44:13.895626+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895626+0000","last_undegraded":"2024-04-25T15:44:13.895626+0000","last_fullsized":"2024-04-25T15:44:13.895626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.886909+0000","last_change":"2024-04-25T15:44:12.886909+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.886909+0000","last_undegraded":"2024-04-25T15:44:12.886909+0000","last_fullsized":"2024-04-25T15:44:12.886909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907881+0000","last_change":"2024-04-25T15:44:13.904946+0000","last_active":"2024-04-25T15:44:13.907881+0000","last_peered":"2024-04-25T15:44:13.907881+0000","last_clean":"2024-04-25T15:44:13.907881+0000","last_became_active":"2024-04-25T15:44:13.904600+0000","last_became_peered":"2024-04-25T15:44:13.904600+0000","last_unstale":"2024-04-25T15:44:13.907881+0000","last_undegraded":"2024-04-25T15:44:13.907881+0000","last_fullsized":"2024-04-25T15:44:13.907881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:27:52.502490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899328+0000","last_change":"2024-04-25T15:44:13.899328+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899328+0000","last_undegraded":"2024-04-25T15:44:13.899328+0000","last_fullsized":"2024-04-25T15:44:13.899328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911996+0000","last_change":"2024-04-25T15:44:13.910412+0000","last_active":"2024-04-25T15:44:13.911996+0000","last_peered":"2024-04-25T15:44:13.911996+0000","last_clean":"2024-04-25T15:44:13.911996+0000","last_became_active":"2024-04-25T15:44:13.910110+0000","last_became_peered":"2024-04-25T15:44:13.910110+0000","last_unstale":"2024-04-25T15:44:13.911996+0000","last_undegraded":"2024-04-25T15:44:13.911996+0000","last_fullsized":"2024-04-25T15:44:13.911996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896175+0000","last_change":"2024-04-25T15:44:13.896175+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896175+0000","last_undegraded":"2024-04-25T15:44:13.896175+0000","last_fullsized":"2024-04-25T15:44:13.896175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910915+0000","last_change":"2024-04-25T15:44:13.906655+0000","last_active":"2024-04-25T15:44:13.910915+0000","last_peered":"2024-04-25T15:44:13.910915+0000","last_clean":"2024-04-25T15:44:13.910915+0000","last_became_active":"2024-04-25T15:44:13.906266+0000","last_became_peered":"2024-04-25T15:44:13.906266+0000","last_unstale":"2024-04-25T15:44:13.910915+0000","last_undegraded":"2024-04-25T15:44:13.910915+0000","last_fullsized":"2024-04-25T15:44:13.910915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895531+0000","last_change":"2024-04-25T15:44:13.895531+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895531+0000","last_undegraded":"2024-04-25T15:44:13.895531+0000","last_fullsized":"2024-04-25T15:44:13.895531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910307+0000","last_change":"2024-04-25T15:44:13.907835+0000","last_active":"2024-04-25T15:44:13.910307+0000","last_peered":"2024-04-25T15:44:13.910307+0000","last_clean":"2024-04-25T15:44:13.910307+0000","last_became_active":"2024-04-25T15:44:13.907521+0000","last_became_peered":"2024-04-25T15:44:13.907521+0000","last_unstale":"2024-04-25T15:44:13.910307+0000","last_undegraded":"2024-04-25T15:44:13.910307+0000","last_fullsized":"2024-04-25T15:44:13.910307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:38.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.883024+0000","last_change":"2024-04-25T15:44:12.883024+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.883024+0000","last_undegraded":"2024-04-25T15:44:12.883024+0000","last_fullsized":"2024-04-25T15:44:12.883024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911372+0000","last_change":"2024-04-25T15:44:13.909615+0000","last_active":"2024-04-25T15:44:13.911372+0000","last_peered":"2024-04-25T15:44:13.911372+0000","last_clean":"2024-04-25T15:44:13.911372+0000","last_became_active":"2024-04-25T15:44:13.909300+0000","last_became_peered":"2024-04-25T15:44:13.909300+0000","last_unstale":"2024-04-25T15:44:13.911372+0000","last_undegraded":"2024-04-25T15:44:13.911372+0000","last_fullsized":"2024-04-25T15:44:13.911372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.914823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:13.880566+0000","last_change":"2024-04-25T15:44:13.880566+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.880566+0000","last_undegraded":"2024-04-25T15:44:13.880566+0000","last_fullsized":"2024-04-25T15:44:13.880566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T15:44:12.884168+0000","last_change":"2024-04-25T15:44:12.884168+0000","last_active":"2024-04-25T15:44:12.870716+0000","last_peered":"2024-04-25T15:44:12.870716+0000","last_clean":"2024-04-25T15:44:12.870716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:12.884168+0000","last_undegraded":"2024-04-25T15:44:12.884168+0000","last_fullsized":"2024-04-25T15:44:12.884168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T15:44:12.884693+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:12.884693+0000","last_peered":"2024-04-25T15:44:12.884693+0000","last_clean":"2024-04-25T15:44:12.884693+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:12.884693+0000","last_undegraded":"2024-04-25T15:44:12.884693+0000","last_fullsized":"2024-04-25T15:44:12.884693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":991232,"data_stored":756932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":166564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":166564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-25T15:44:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.899394+0000', 'last_change': '2024-04-25T15:44:13.899394+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.899394+0000', 'last_undegraded': '2024-04-25T15:44:13.899394+0000', 'last_fullsized': '2024-04-25T15:44:13.899394+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-25T15:44:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.899886+0000', 'last_change': '2024-04-25T15:44:13.899886+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.899886+0000', 'last_undegraded': '2024-04-25T15:44:13.899886+0000', 'last_fullsized': '2024-04-25T15:44:13.899886+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.896774+0000', 'last_change': '2024-04-25T15:44:13.896774+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.896774+0000', 'last_undegraded': '2024-04-25T15:44:13.896774+0000', 'last_fullsized': '2024-04-25T15:44:13.896774+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.894686+0000', 'last_change': '2024-04-25T15:44:13.894686+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.894686+0000', 'last_undegraded': '2024-04-25T15:44:13.894686+0000', 'last_fullsized': '2024-04-25T15:44:13.894686+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.894088+0000', 'last_change': '2024-04-25T15:44:13.894088+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.894088+0000', 'last_undegraded': '2024-04-25T15:44:13.894088+0000', 'last_fullsized': '2024-04-25T15:44:13.894088+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.897800+0000', 'last_change': '2024-04-25T15:44:13.897800+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.897800+0000', 'last_undegraded': '2024-04-25T15:44:13.897800+0000', 'last_fullsized': '2024-04-25T15:44:13.897800+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-25T15:44:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.898398+0000', 'last_change': '2024-04-25T15:44:13.898398+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.898398+0000', 'last_undegraded': '2024-04-25T15:44:13.898398+0000', 'last_fullsized': '2024-04-25T15:44:13.898398+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.898107+0000', 'last_change': '2024-04-25T15:44:13.898107+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.898107+0000', 'last_undegraded': '2024-04-25T15:44:13.898107+0000', 'last_fullsized': '2024-04-25T15:44:13.898107+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.895345+0000', 'last_change': '2024-04-25T15:44:13.895345+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.895345+0000', 'last_undegraded': '2024-04-25T15:44:13.895345+0000', 'last_fullsized': '2024-04-25T15:44:13.895345+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-04-25T15:44:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.893087+0000', 'last_change': '2024-04-25T15:44:13.893087+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.893087+0000', 'last_undegraded': '2024-04-25T15:44:13.893087+0000', 'last_fullsized': '2024-04-25T15:44:13.893087+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.894038+0000', 'last_change': '2024-04-25T15:44:13.894038+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.894038+0000', 'last_undegraded': '2024-04-25T15:44:13.894038+0000', 'last_fullsized': '2024-04-25T15:44:13.894038+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-04-25T15:44:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.891312+0000', 'last_change': '2024-04-25T15:44:13.891312+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.891312+0000', 'last_undegraded': '2024-04-25T15:44:13.891312+0000', 'last_fullsized': '2024-04-25T15:44:13.891312+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.893968+0000', 'last_change': '2024-04-25T15:44:13.893968+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.893968+0000', 'last_undegraded': '2024-04-25T15:44:13.893968+0000', 'last_fullsized': '2024-04-25T15:44:13.893968+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.894539+0000', 'last_change': '2024-04-25T15:44:13.894539+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.894539+0000', 'last_undegraded': '2024-04-25T15:44:13.894539+0000', 'last_fullsized': '2024-04-25T15:44:13.894539+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-25T15:44:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.896435+0000', 'last_change': '2024-04-25T15:44:13.896435+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.896435+0000', 'last_undegraded': '2024-04-25T15:44:13.896435+0000', 'last_fullsized': '2024-04-25T15:44:13.896435+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.892399+0000', 'last_change': '2024-04-25T15:44:13.892399+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.892399+0000', 'last_undegraded': '2024-04-25T15:44:13.892399+0000', 'last_fullsized': '2024-04-25T15:44:13.892399+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.891667+0000', 'last_change': '2024-04-25T15:44:13.891667+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.891667+0000', 'last_undegraded': '2024-04-25T15:44:13.891667+0000', 'last_fullsized': '2024-04-25T15:44:13.891667+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.891515+0000', 'last_change': '2024-04-25T15:44:13.891515+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.891515+0000', 'last_undegraded': '2024-04-25T15:44:13.891515+0000', 'last_fullsized': '2024-04-25T15:44:13.891515+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-04-25T15:44:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.895016+0000', 'last_change': '2024-04-25T15:44:13.895016+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.895016+0000', 'last_undegraded': '2024-04-25T15:44:13.895016+0000', 'last_fullsized': '2024-04-25T15:44:13.895016+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.897266+0000', 'last_change': '2024-04-25T15:44:13.897266+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.897266+0000', 'last_undegraded': '2024-04-25T15:44:13.897266+0000', 'last_fullsized': '2024-04-25T15:44:13.897266+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.899973+0000', 'last_change': '2024-04-25T15:44:13.899973+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.899973+0000', 'last_undegraded': '2024-04-25T15:44:13.899973+0000', 'last_fullsized': '2024-04-25T15:44:13.899973+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T15:44:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.883061+0000', 'last_change': '2024-04-25T15:44:12.883061+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.883061+0000', 'last_undegraded': '2024-04-25T15:44:12.883061+0000', 'last_fullsized': '2024-04-25T15:44:12.883061+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.897152+0000', 'last_change': '2024-04-25T15:44:13.897152+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.897152+0000', 'last_undegraded': '2024-04-25T15:44:13.897152+0000', 'last_fullsized': '2024-04-25T15:44:13.897152+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.888275+0000', 'last_change': '2024-04-25T15:44:12.888275+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.888275+0000', 'last_undegraded': '2024-04-25T15:44:12.888275+0000', 'last_fullsized': '2024-04-25T15:44:12.888275+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.883080+0000', 'last_change': '2024-04-25T15:44:12.883080+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.883080+0000', 'last_undegraded': '2024-04-25T15:44:12.883080+0000', 'last_fullsized': '2024-04-25T15:44:12.883080+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.900643+0000', 'last_change': '2024-04-25T15:44:13.900643+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.900643+0000', 'last_undegraded': '2024-04-25T15:44:13.900643+0000', 'last_fullsized': '2024-04-25T15:44:13.900643+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.884243+0000', 'last_change': '2024-04-25T15:44:12.884243+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.884243+0000', 'last_undegraded': '2024-04-25T15:44:12.884243+0000', 'last_fullsized': '2024-04-25T15:44:12.884243+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.893591+0000', 'last_change': '2024-04-25T15:44:13.893591+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.893591+0000', 'last_undegraded': '2024-04-25T15:44:13.893591+0000', 'last_fullsized': '2024-04-25T15:44:13.893591+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.888560+0000', 'last_change': '2024-04-25T15:44:12.888560+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.888560+0000', 'last_undegraded': '2024-04-25T15:44:12.888560+0000', 'last_fullsized': '2024-04-25T15:44:12.888560+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.897616+0000', 'last_change': '2024-04-25T15:44:13.897616+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.897616+0000', 'last_undegraded': '2024-04-25T15:44:13.897616+0000', 'last_fullsized': '2024-04-25T15:44:13.897616+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.888204+0000', 'last_change': '2024-04-25T15:44:12.888204+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.888204+0000', 'last_undegraded': '2024-04-25T15:44:12.888204+0000', 'last_fullsized': '2024-04-25T15:44:12.888204+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-25T15:44:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.896677+0000', 'last_change': '2024-04-25T15:44:13.896677+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.896677+0000', 'last_undegraded': '2024-04-25T15:44:13.896677+0000', 'last_fullsized': '2024-04-25T15:44:13.896677+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.898457+0000', 'last_change': '2024-04-25T15:44:13.898457+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.898457+0000', 'last_undegraded': '2024-04-25T15:44:13.898457+0000', 'last_fullsized': '2024-04-25T15:44:13.898457+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.898500+0000', 'last_change': '2024-04-25T15:44:13.898500+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.898500+0000', 'last_undegraded': '2024-04-25T15:44:13.898500+0000', 'last_fullsized': '2024-04-25T15:44:13.898500+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.882888+0000', 'last_change': '2024-04-25T15:44:12.882888+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.882888+0000', 'last_undegraded': '2024-04-25T15:44:12.882888+0000', 'last_fullsized': '2024-04-25T15:44:12.882888+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:44:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.898925+0000', 'last_change': '2024-04-25T15:44:13.898925+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.898925+0000', 'last_undegraded': '2024-04-25T15:44:13.898925+0000', 'last_fullsized': '2024-04-25T15:44:13.898925+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.887544+0000', 'last_change': '2024-04-25T15:44:12.887544+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.887544+0000', 'last_undegraded': '2024-04-25T15:44:12.887544+0000', 'last_fullsized': '2024-04-25T15:44:12.887544+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.883039+0000', 'last_change': '2024-04-25T15:44:12.883039+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.883039+0000', 'last_undegraded': '2024-04-25T15:44:12.883039+0000', 'last_fullsized': '2024-04-25T15:44:12.883039+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-25T15:44:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.893597+0000', 'last_change': '2024-04-25T15:44:13.893597+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.893597+0000', 'last_undegraded': '2024-04-25T15:44:13.893597+0000', 'last_fullsized': '2024-04-25T15:44:13.893597+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.895897+0000', 'last_change': '2024-04-25T15:44:13.895897+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.895897+0000', 'last_undegraded': '2024-04-25T15:44:13.895897+0000', 'last_fullsized': '2024-04-25T15:44:13.895897+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.883782+0000', 'last_change': '2024-04-25T15:44:12.883782+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.883782+0000', 'last_undegraded': '2024-04-25T15:44:12.883782+0000', 'last_fullsized': '2024-04-25T15:44:12.883782+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.899492+0000', 'last_change': '2024-04-25T15:44:13.899492+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.899492+0000', 'last_undegraded': '2024-04-25T15:44:13.899492+0000', 'last_fullsized': '2024-04-25T15:44:13.899492+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-25T15:44:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.895626+0000', 'last_change': '2024-04-25T15:44:13.895626+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.895626+0000', 'last_undegraded': '2024-04-25T15:44:13.895626+0000', 'last_fullsized': '2024-04-25T15:44:13.895626+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.886909+0000', 'last_change': '2024-04-25T15:44:12.886909+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.886909+0000', 'last_undegraded': '2024-04-25T15:44:12.886909+0000', 'last_fullsized': '2024-04-25T15:44:12.886909+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.899328+0000', 'last_change': '2024-04-25T15:44:13.899328+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.899328+0000', 'last_undegraded': '2024-04-25T15:44:13.899328+0000', 'last_fullsized': '2024-04-25T15:44:13.899328+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.896175+0000', 'last_change': '2024-04-25T15:44:13.896175+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.896175+0000', 'last_undegraded': '2024-04-25T15:44:13.896175+0000', 'last_fullsized': '2024-04-25T15:44:13.896175+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:13.895531+0000', 'last_change': '2024-04-25T15:44:13.895531+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.895531+0000', 'last_undegraded': '2024-04-25T15:44:13.895531+0000', 'last_fullsized': '2024-04-25T15:44:13.895531+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-25T15:44:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.883024+0000', 'last_change': '2024-04-25T15:44:12.883024+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.883024+0000', 'last_undegraded': '2024-04-25T15:44:12.883024+0000', 'last_fullsized': '2024-04-25T15:44:12.883024+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:44:13.880566+0000', 'last_change': '2024-04-25T15:44:13.880566+0000', 'last_active': '2024-04-25T15:44:13.880566+0000', 'last_peered': '2024-04-25T15:44:13.880566+0000', 'last_clean': '2024-04-25T15:44:13.880566+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:13.880566+0000', 'last_undegraded': '2024-04-25T15:44:13.880566+0000', 'last_fullsized': '2024-04-25T15:44:13.880566+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:13.880566+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T15:44:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:44:12.884168+0000', 'last_change': '2024-04-25T15:44:12.884168+0000', 'last_active': '2024-04-25T15:44:12.870716+0000', 'last_peered': '2024-04-25T15:44:12.870716+0000', 'last_clean': '2024-04-25T15:44:12.870716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:44:12.884168+0000', 'last_undegraded': '2024-04-25T15:44:12.884168+0000', 'last_fullsized': '2024-04-25T15:44:12.884168+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'last_clean_scrub_stamp': '2024-04-25T15:44:12.870716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:44:18.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T15:44:18.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.755+0000 7f9fa5d85640 1 Processor -- start 2024-04-25T15:44:18.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.756+0000 7f9fa5d85640 1 -- start start 2024-04-25T15:44:18.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9fa5d85640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa006e0e0 0x7f9fa0168c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9fa5d85640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa006c660 con 0x7f9fa009bea0 2024-04-25T15:44:18.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9fa5d85640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa00cea90 con 0x7f9fa00d2830 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9fa5d85640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa006cc40 con 0x7f9fa006e0e0 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa006e0e0 0x7f9fa0168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9fa009bea0 0x7f9fa00ce380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51114/0 (socket says 172.21.15.80:51114) 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa006e0e0 0x7f9fa0168c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41330/0 (socket says 172.21.15.80:41330) 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9f7fe640 1 -- 172.21.15.80:0/1038064338 learned_addr learned my addr 172.21.15.80:0/1038064338 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9ffff640 1 -- 172.21.15.80:0/1038064338 >> v1:172.21.15.195:6789/0 conn(0x7f9fa00d2830 legacy=0x7f9fa00d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9ffff640 1 -- 172.21.15.80:0/1038064338 >> v1:172.21.15.80:6789/0 conn(0x7f9fa009bea0 legacy=0x7f9fa00ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9ffff640 1 -- 172.21.15.80:0/1038064338 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa00ced60 con 0x7f9fa006e0e0 2024-04-25T15:44:18.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.757+0000 7f9f9e7fc640 1 -- 172.21.15.80:0/1038064338 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441007884 0 0) 0x7f9fa006c660 con 0x7f9fa009bea0 2024-04-25T15:44:18.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.758+0000 7f9f9ffff640 1 --2- 172.21.15.80:0/1038064338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa006e0e0 0x7f9fa0168c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009d90 tx=0x7f9f9802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506bb5865d07a578 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.758+0000 7f9f9e7fc640 1 -- 172.21.15.80:0/1038064338 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98007740 con 0x7f9fa006e0e0 2024-04-25T15:44:18.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.758+0000 7f9f9e7fc640 1 -- 172.21.15.80:0/1038064338 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f980078e0 con 0x7f9fa006e0e0 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.758+0000 7f9f9e7fc640 1 -- 172.21.15.80:0/1038064338 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98007cb0 con 0x7f9fa006e0e0 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 -- 172.21.15.80:0/1038064338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa006e0e0 msgr2=0x7f9fa0168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/1038064338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa006e0e0 0x7f9fa0168c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009d90 tx=0x7f9f9802a6a0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 -- 172.21.15.80:0/1038064338 shutdown_connections 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/1038064338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa006e0e0 0x7f9fa0168c40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 -- 172.21.15.80:0/1038064338 >> 172.21.15.80:0/1038064338 conn(0x7f9fa00b7620 msgr2=0x7f9fa00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 -- 172.21.15.80:0/1038064338 shutdown_connections 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.759+0000 7f9fa5d85640 1 -- 172.21.15.80:0/1038064338 wait complete. 2024-04-25T15:44:18.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.761+0000 7f9fa5d85640 1 Processor -- start 2024-04-25T15:44:18.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.761+0000 7f9fa5d85640 1 -- start start 2024-04-25T15:44:18.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9fa5d85640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fa006e0e0 0x7f9fa0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9fa5d85640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 0x7f9fa01520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9fa5d85640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fa00d2830 0x7f9fa0160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9fa5d85640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa00cf040 con 0x7f9fa009bea0 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9fa5d85640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa015e420 con 0x7f9fa00d2830 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9fa5d85640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa0169180 con 0x7f9fa006e0e0 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 0x7f9fa01520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 0x7f9fa01520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41344/0 (socket says 172.21.15.80:41344) 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 -- 172.21.15.80:0/2185302237 learned_addr learned my addr 172.21.15.80:0/2185302237 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9ffff640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fa00d2830 0x7f9fa0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 -- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fa006e0e0 msgr2=0x7f9fa0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fa006e0e0 0x7f9fa0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 -- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fa00d2830 msgr2=0x7f9fa0160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fa00d2830 0x7f9fa0160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.762+0000 7f9f9effd640 1 -- 172.21.15.80:0/2185302237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa01612c0 con 0x7f9fa009bea0 2024-04-25T15:44:18.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.763+0000 7f9f9effd640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 0x7f9fa01520d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400b420 tx=0x7f9f9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.763+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011830 con 0x7f9fa009bea0 2024-04-25T15:44:18.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.763+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f94016070 con 0x7f9fa009bea0 2024-04-25T15:44:18.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.763+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011c10 con 0x7f9fa009bea0 2024-04-25T15:44:18.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.763+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa0151e90 con 0x7f9fa009bea0 2024-04-25T15:44:18.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.763+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa0153fc0 con 0x7f9fa009bea0 2024-04-25T15:44:18.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.764+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa006a100 con 0x7f9fa009bea0 2024-04-25T15:44:18.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.764+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9f9401b460 con 0x7f9fa009bea0 2024-04-25T15:44:18.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.765+0000 7f9f87fff640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f8c0744b0 0x7f9f8c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:18.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.765+0000 7f9f9f7fe640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f8c0744b0 0x7f9f8c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:18.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.765+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9f94094ec0 con 0x7f9fa009bea0 2024-04-25T15:44:18.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.765+0000 7f9f9f7fe640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f8c0744b0 0x7f9f8c0769c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f90007fd0 tx=0x7f9f90007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:18.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:18.770+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f94020020 con 0x7f9fa009bea0 2024-04-25T15:44:19.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.015+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9fa01541c0 con 0x7f9fa009bea0 2024-04-25T15:44:19.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.015+0000 7f9f87fff640 1 -- 172.21.15.80:0/2185302237 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1271 (secure 0 0 0) 0x7f9fa01612c0 con 0x7f9fa009bea0 2024-04-25T15:44:19.015 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:19.016 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":102,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1714059768,"num_in_osds":8,"osd_in_since":1714059759,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":49},{"state_name":"unknown","count":28},{"state_name":"active+clean","count":20}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242868224,"bytes_avail":772851245056,"bytes_total":773094113280,"unknown_pgs_ratio":0.28865978121757507,"inactive_pgs_ratio":0.50515460968017578},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5373}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-04-25T15:43:57.010641+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f8c0744b0 msgr2=0x7f9f8c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f8c0744b0 0x7f9f8c0769c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f90007fd0 tx=0x7f9f90007960 comp rx=0 tx=0).stop 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 msgr2=0x7f9fa01520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 0x7f9fa01520d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400b420 tx=0x7f9f9400b8e0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 shutdown_connections 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9f8c0744b0 0x7f9f8c0769c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fa00d2830 0x7f9fa0160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa009bea0 0x7f9fa01520d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 --2- 172.21.15.80:0/2185302237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fa006e0e0 0x7f9fa0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 >> 172.21.15.80:0/2185302237 conn(0x7f9fa00b7620 msgr2=0x7f9fa00cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 shutdown_connections 2024-04-25T15:44:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.017+0000 7f9fa5d85640 1 -- 172.21.15.80:0/2185302237 wait complete. 2024-04-25T15:44:19.029 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T15:44:19.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:19.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.136+0000 7f3fd1f96640 1 Processor -- start 2024-04-25T15:44:19.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.136+0000 7f3fd1f96640 1 -- start start 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fd1f96640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3fcc0d2650 0x7f3fcc0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fd1f96640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fcc0b2f30 con 0x7f3fcc0b4b60 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fd1f96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fcc0b2c90 con 0x7f3fcc0b91c0 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fd1f96640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3fcc06eb60 con 0x7f3fcc0d2650 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fcb7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3fcc0b4b60 0x7f3fcc06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51130/0 (socket says 172.21.15.80:51130) 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fcb7fe640 1 -- 172.21.15.80:0/1232228330 learned_addr learned my addr 172.21.15.80:0/1232228330 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745418690 0 0) 0x7f3fcc0b2f30 con 0x7f3fcc0b4b60 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fb4003520 con 0x7f3fcc0b4b60 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fcbfff640 1 --2- 172.21.15.80:0/1232228330 >> v2:172.21.15.195:3300/0 conn(0x7f3fcc0d2650 0x7f3fcc0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1731730829 0 0) 0x7f3fb4003520 con 0x7f3fcc0b4b60 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 >> v2:172.21.15.195:3300/0 conn(0x7f3fcc0d2650 msgr2=0x7f3fcc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:19.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 --2- 172.21.15.80:0/1232228330 >> v2:172.21.15.195:3300/0 conn(0x7f3fcc0d2650 0x7f3fcc0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 >> v1:172.21.15.195:6789/0 conn(0x7f3fcc0b91c0 legacy=0x7f3fcc0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc0d10a0 con 0x7f3fcc0b4b60 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f3fbc0017f0 con 0x7f3fcc0b4b60 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fcbfff640 1 --2- 172.21.15.80:0/1232228330 >> v2:172.21.15.195:3300/0 conn(0x7f3fcc0d2650 0x7f3fcc0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 >> v1:172.21.15.80:6789/0 conn(0x7f3fcc0b4b60 legacy=0x7f3fcc06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.138+0000 7f3fca7fc640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb40039b0 0x7f3fb4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fca7fc640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb4004800 0x7f3fb4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fca7fc640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb4005350 0x7f3fb400b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc06eb60 con 0x7f3fb40039b0 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb400c2c0 con 0x7f3fb4005350 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb400c4c0 con 0x7f3fb4004800 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb40039b0 0x7f3fb4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcbfff640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb4005350 0x7f3fb400b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcaffd640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb4004800 0x7f3fb4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcb7fe640 1 -- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb4004800 msgr2=0x7f3fb4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb4004800 0x7f3fb4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcb7fe640 1 -- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb4005350 msgr2=0x7f3fb400b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb4005350 0x7f3fb400b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcb7fe640 1 -- 172.21.15.80:0/1232228330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb4003520 con 0x7f3fb40039b0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcbfff640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb4005350 0x7f3fb400b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.139+0000 7f3fcbfff640 1 -- 172.21.15.80:0/1232228330 reap_dead start 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb40039b0 0x7f3fb4003e40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0d1810 tx=0x7f3fb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e8f76f4bf64f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc007d20 con 0x7f3fb40039b0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc007290 con 0x7f3fb40039b0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fca7fc640 1 -- 172.21.15.80:0/1232228330 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0057a0 con 0x7f3fb40039b0 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 -- 172.21.15.80:0/1232228330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb40039b0 msgr2=0x7f3fb4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb40039b0 0x7f3fb4003e40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0d1810 tx=0x7f3fb4005830 comp rx=0 tx=0).stop 2024-04-25T15:44:19.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 -- 172.21.15.80:0/1232228330 shutdown_connections 2024-04-25T15:44:19.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/1232228330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb40039b0 0x7f3fb4003e40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 -- 172.21.15.80:0/1232228330 >> 172.21.15.80:0/1232228330 conn(0x7f3fcc0d0450 msgr2=0x7f3fcc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:19.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 -- 172.21.15.80:0/1232228330 shutdown_connections 2024-04-25T15:44:19.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.140+0000 7f3fd1f96640 1 -- 172.21.15.80:0/1232228330 wait complete. 2024-04-25T15:44:19.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.142+0000 7f3fd1f96640 1 Processor -- start 2024-04-25T15:44:19.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.142+0000 7f3fd1f96640 1 -- start start 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb40039b0 0x7f3fcc1f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 0x7f3fcc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fcc0cf590 0x7f3fcc09fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc09d0e0 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc09cbe0 con 0x7f3fcc0cf590 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc09d260 con 0x7f3fb40039b0 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 0x7f3fcc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 0x7f3fcc0cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41362/0 (socket says 172.21.15.80:41362) 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 -- 172.21.15.80:0/2234847067 learned_addr learned my addr 172.21.15.80:0/2234847067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcbfff640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fcc0cf590 0x7f3fcc09fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb40039b0 0x7f3fcc1f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 -- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb40039b0 msgr2=0x7f3fcc1f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb40039b0 0x7f3fcc1f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 -- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fcc0cf590 msgr2=0x7f3fcc09fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fcc0cf590 0x7f3fcc09fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 -- 172.21.15.80:0/2234847067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc0cf9a0 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fcaffd640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 0x7f3fcc0cf050 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000e460 tx=0x7f3fc000e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0019070 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc00053a0 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc1e8f00 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0003810 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.144+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc1e94c0 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.146+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fcc0b4990 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.146+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3fc001c070 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.146+0000 7f3fb3fff640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3fb80744b0 0x7f3fb80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.146+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3fc00949d0 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.146+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3fb80744b0 0x7f3fb80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:19.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.147+0000 7f3fcb7fe640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3fb80744b0 0x7f3fb80769c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc032000 tx=0x7f3fbc02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.151+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3fcc0cf9a0 con 0x7f3fcc1e83c0 2024-04-25T15:44:19.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.321+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3fcc06a100 con 0x7f3fb80744b0 2024-04-25T15:44:19.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.327+0000 7f3fb3fff640 1 -- 172.21.15.80:0/2234847067 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248958 (secure 0 0 0) 0x7f3fcc06a100 con 0x7f3fb80744b0 2024-04-25T15:44:19.329 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3fb80744b0 msgr2=0x7f3fb80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3fb80744b0 0x7f3fb80769c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc032000 tx=0x7f3fbc02d000 comp rx=0 tx=0).stop 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 msgr2=0x7f3fcc0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 0x7f3fcc0cf050 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000e460 tx=0x7f3fc000e920 comp rx=0 tx=0).stop 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 shutdown_connections 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3fb80744b0 0x7f3fb80769c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fcc0cf590 0x7f3fcc09fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fcc1e83c0 0x7f3fcc0cf050 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 --2- 172.21.15.80:0/2234847067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fb40039b0 0x7f3fcc1f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:19.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 >> 172.21.15.80:0/2234847067 conn(0x7f3fcc0d0450 msgr2=0x7f3fcc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:19.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 shutdown_connections 2024-04-25T15:44:19.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:19.330+0000 7f3fd1f96640 1 -- 172.21.15.80:0/2234847067 wait complete. 2024-04-25T15:44:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-25T15:44:19.014685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":127,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237320,"kb_used_data":4512,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737400,"statfs":{"total":773094113280,"available":772851097600,"internally_reserved":0,"allocated":4620288,"data_stored":2633563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000988"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899394+0000","last_change":"2024-04-25T15:44:13.899394+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899394+0000","last_undegraded":"2024-04-25T15:44:13.899394+0000","last_fullsized":"2024-04-25T15:44:13.899394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899886+0000","last_change":"2024-04-25T15:44:13.899886+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899886+0000","last_undegraded":"2024-04-25T15:44:13.899886+0000","last_fullsized":"2024-04-25T15:44:13.899886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896774+0000","last_change":"2024-04-25T15:44:13.896774+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896774+0000","last_undegraded":"2024-04-25T15:44:13.896774+0000","last_fullsized":"2024-04-25T15:44:13.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894686+0000","last_change":"2024-04-25T15:44:13.894686+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894686+0000","last_undegraded":"2024-04-25T15:44:13.894686+0000","last_fullsized":"2024-04-25T15:44:13.894686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894088+0000","last_change":"2024-04-25T15:44:13.894088+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894088+0000","last_undegraded":"2024-04-25T15:44:13.894088+0000","last_fullsized":"2024-04-25T15:44:13.894088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897800+0000","last_change":"2024-04-25T15:44:13.897800+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897800+0000","last_undegraded":"2024-04-25T15:44:13.897800+0000","last_fullsized":"2024-04-25T15:44:13.897800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897395+0000","last_change":"2024-04-25T15:44:14.919576+0000","last_active":"2024-04-25T15:44:16.897395+0000","last_peered":"2024-04-25T15:44:16.897395+0000","last_clean":"2024-04-25T15:44:16.897395+0000","last_became_active":"2024-04-25T15:44:14.919232+0000","last_became_peered":"2024-04-25T15:44:14.919232+0000","last_unstale":"2024-04-25T15:44:16.897395+0000","last_undegraded":"2024-04-25T15:44:16.897395+0000","last_fullsized":"2024-04-25T15:44:16.897395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:04.874124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898398+0000","last_change":"2024-04-25T15:44:13.898398+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898398+0000","last_undegraded":"2024-04-25T15:44:13.898398+0000","last_fullsized":"2024-04-25T15:44:13.898398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898107+0000","last_change":"2024-04-25T15:44:13.898107+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898107+0000","last_undegraded":"2024-04-25T15:44:13.898107+0000","last_fullsized":"2024-04-25T15:44:13.898107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897840+0000","last_change":"2024-04-25T15:44:14.915328+0000","last_active":"2024-04-25T15:44:16.897840+0000","last_peered":"2024-04-25T15:44:16.897840+0000","last_clean":"2024-04-25T15:44:16.897840+0000","last_became_active":"2024-04-25T15:44:14.914887+0000","last_became_peered":"2024-04-25T15:44:14.914887+0000","last_unstale":"2024-04-25T15:44:16.897840+0000","last_undegraded":"2024-04-25T15:44:16.897840+0000","last_fullsized":"2024-04-25T15:44:16.897840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:53.271448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897793+0000","last_change":"2024-04-25T15:44:14.922625+0000","last_active":"2024-04-25T15:44:16.897793+0000","last_peered":"2024-04-25T15:44:16.897793+0000","last_clean":"2024-04-25T15:44:16.897793+0000","last_became_active":"2024-04-25T15:44:14.921856+0000","last_became_peered":"2024-04-25T15:44:14.921856+0000","last_unstale":"2024-04-25T15:44:16.897793+0000","last_undegraded":"2024-04-25T15:44:16.897793+0000","last_fullsized":"2024-04-25T15:44:16.897793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:04.980116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895345+0000","last_change":"2024-04-25T15:44:13.895345+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895345+0000","last_undegraded":"2024-04-25T15:44:13.895345+0000","last_fullsized":"2024-04-25T15:44:13.895345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897440+0000","last_change":"2024-04-25T15:44:14.914526+0000","last_active":"2024-04-25T15:44:16.897440+0000","last_peered":"2024-04-25T15:44:16.897440+0000","last_clean":"2024-04-25T15:44:16.897440+0000","last_became_active":"2024-04-25T15:44:14.914244+0000","last_became_peered":"2024-04-25T15:44:14.914244+0000","last_unstale":"2024-04-25T15:44:16.897440+0000","last_undegraded":"2024-04-25T15:44:16.897440+0000","last_fullsized":"2024-04-25T15:44:16.897440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:07.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.381993+0000","last_change":"2024-04-25T15:44:14.920394+0000","last_active":"2024-04-25T15:44:16.381993+0000","last_peered":"2024-04-25T15:44:16.381993+0000","last_clean":"2024-04-25T15:44:16.381993+0000","last_became_active":"2024-04-25T15:44:14.919946+0000","last_became_peered":"2024-04-25T15:44:14.919946+0000","last_unstale":"2024-04-25T15:44:16.381993+0000","last_undegraded":"2024-04-25T15:44:16.381993+0000","last_fullsized":"2024-04-25T15:44:16.381993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:35.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897508+0000","last_change":"2024-04-25T15:44:14.913890+0000","last_active":"2024-04-25T15:44:16.897508+0000","last_peered":"2024-04-25T15:44:16.897508+0000","last_clean":"2024-04-25T15:44:16.897508+0000","last_became_active":"2024-04-25T15:44:14.913574+0000","last_became_peered":"2024-04-25T15:44:14.913574+0000","last_unstale":"2024-04-25T15:44:16.897508+0000","last_undegraded":"2024-04-25T15:44:16.897508+0000","last_fullsized":"2024-04-25T15:44:16.897508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:51.103852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894334+0000","last_change":"2024-04-25T15:44:14.913473+0000","last_active":"2024-04-25T15:44:15.894334+0000","last_peered":"2024-04-25T15:44:15.894334+0000","last_clean":"2024-04-25T15:44:15.894334+0000","last_became_active":"2024-04-25T15:44:14.913083+0000","last_became_peered":"2024-04-25T15:44:14.913083+0000","last_unstale":"2024-04-25T15:44:15.894334+0000","last_undegraded":"2024-04-25T15:44:15.894334+0000","last_fullsized":"2024-04-25T15:44:15.894334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:40.199591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895907+0000","last_change":"2024-04-25T15:44:14.916939+0000","last_active":"2024-04-25T15:44:15.895907+0000","last_peered":"2024-04-25T15:44:15.895907+0000","last_clean":"2024-04-25T15:44:15.895907+0000","last_became_active":"2024-04-25T15:44:14.916629+0000","last_became_peered":"2024-04-25T15:44:14.916629+0000","last_unstale":"2024-04-25T15:44:15.895907+0000","last_undegraded":"2024-04-25T15:44:15.895907+0000","last_fullsized":"2024-04-25T15:44:15.895907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:06.990539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893087+0000","last_change":"2024-04-25T15:44:13.893087+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893087+0000","last_undegraded":"2024-04-25T15:44:13.893087+0000","last_fullsized":"2024-04-25T15:44:13.893087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894038+0000","last_change":"2024-04-25T15:44:13.894038+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894038+0000","last_undegraded":"2024-04-25T15:44:13.894038+0000","last_fullsized":"2024-04-25T15:44:13.894038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891312+0000","last_change":"2024-04-25T15:44:13.891312+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891312+0000","last_undegraded":"2024-04-25T15:44:13.891312+0000","last_fullsized":"2024-04-25T15:44:13.891312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897566+0000","last_change":"2024-04-25T15:44:14.911473+0000","last_active":"2024-04-25T15:44:16.897566+0000","last_peered":"2024-04-25T15:44:16.897566+0000","last_clean":"2024-04-25T15:44:16.897566+0000","last_became_active":"2024-04-25T15:44:14.911173+0000","last_became_peered":"2024-04-25T15:44:14.911173+0000","last_unstale":"2024-04-25T15:44:16.897566+0000","last_undegraded":"2024-04-25T15:44:16.897566+0000","last_fullsized":"2024-04-25T15:44:16.897566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:03.640679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382488+0000","last_change":"2024-04-25T15:44:14.918990+0000","last_active":"2024-04-25T15:44:16.382488+0000","last_peered":"2024-04-25T15:44:16.382488+0000","last_clean":"2024-04-25T15:44:16.382488+0000","last_became_active":"2024-04-25T15:44:14.918318+0000","last_became_peered":"2024-04-25T15:44:14.918318+0000","last_unstale":"2024-04-25T15:44:16.382488+0000","last_undegraded":"2024-04-25T15:44:16.382488+0000","last_fullsized":"2024-04-25T15:44:16.382488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:39.489336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894433+0000","last_change":"2024-04-25T15:44:14.908530+0000","last_active":"2024-04-25T15:44:15.894433+0000","last_peered":"2024-04-25T15:44:15.894433+0000","last_clean":"2024-04-25T15:44:15.894433+0000","last_became_active":"2024-04-25T15:44:14.907980+0000","last_became_peered":"2024-04-25T15:44:14.907980+0000","last_unstale":"2024-04-25T15:44:15.894433+0000","last_undegraded":"2024-04-25T15:44:15.894433+0000","last_fullsized":"2024-04-25T15:44:15.894433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:32:26.647185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893968+0000","last_change":"2024-04-25T15:44:13.893968+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893968+0000","last_undegraded":"2024-04-25T15:44:13.893968+0000","last_fullsized":"2024-04-25T15:44:13.893968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.894539+0000","last_change":"2024-04-25T15:44:13.894539+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.894539+0000","last_undegraded":"2024-04-25T15:44:13.894539+0000","last_fullsized":"2024-04-25T15:44:13.894539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896435+0000","last_change":"2024-04-25T15:44:13.896435+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896435+0000","last_undegraded":"2024-04-25T15:44:13.896435+0000","last_fullsized":"2024-04-25T15:44:13.896435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.892399+0000","last_change":"2024-04-25T15:44:13.892399+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.892399+0000","last_undegraded":"2024-04-25T15:44:13.892399+0000","last_fullsized":"2024-04-25T15:44:13.892399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897760+0000","last_change":"2024-04-25T15:44:14.924957+0000","last_active":"2024-04-25T15:44:16.897760+0000","last_peered":"2024-04-25T15:44:16.897760+0000","last_clean":"2024-04-25T15:44:16.897760+0000","last_became_active":"2024-04-25T15:44:14.924665+0000","last_became_peered":"2024-04-25T15:44:14.924665+0000","last_unstale":"2024-04-25T15:44:16.897760+0000","last_undegraded":"2024-04-25T15:44:16.897760+0000","last_fullsized":"2024-04-25T15:44:16.897760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:06.990539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891667+0000","last_change":"2024-04-25T15:44:13.891667+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891667+0000","last_undegraded":"2024-04-25T15:44:13.891667+0000","last_fullsized":"2024-04-25T15:44:13.891667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.891515+0000","last_change":"2024-04-25T15:44:13.891515+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.891515+0000","last_undegraded":"2024-04-25T15:44:13.891515+0000","last_fullsized":"2024-04-25T15:44:13.891515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894975+0000","last_change":"2024-04-25T15:44:14.908290+0000","last_active":"2024-04-25T15:44:15.894975+0000","last_peered":"2024-04-25T15:44:15.894975+0000","last_clean":"2024-04-25T15:44:15.894975+0000","last_became_active":"2024-04-25T15:44:14.907558+0000","last_became_peered":"2024-04-25T15:44:14.907558+0000","last_unstale":"2024-04-25T15:44:15.894975+0000","last_undegraded":"2024-04-25T15:44:15.894975+0000","last_fullsized":"2024-04-25T15:44:15.894975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:18.673393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895016+0000","last_change":"2024-04-25T15:44:13.895016+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895016+0000","last_undegraded":"2024-04-25T15:44:13.895016+0000","last_fullsized":"2024-04-25T15:44:13.895016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895525+0000","last_change":"2024-04-25T15:44:14.909405+0000","last_active":"2024-04-25T15:44:15.895525+0000","last_peered":"2024-04-25T15:44:15.895525+0000","last_clean":"2024-04-25T15:44:15.895525+0000","last_became_active":"2024-04-25T15:44:14.909124+0000","last_became_peered":"2024-04-25T15:44:14.909124+0000","last_unstale":"2024-04-25T15:44:15.895525+0000","last_undegraded":"2024-04-25T15:44:15.895525+0000","last_fullsized":"2024-04-25T15:44:15.895525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:07.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908563+0000","last_change":"2024-04-25T15:44:13.906044+0000","last_active":"2024-04-25T15:44:13.908563+0000","last_peered":"2024-04-25T15:44:13.908563+0000","last_clean":"2024-04-25T15:44:13.908563+0000","last_became_active":"2024-04-25T15:44:13.905713+0000","last_became_peered":"2024-04-25T15:44:13.905713+0000","last_unstale":"2024-04-25T15:44:13.908563+0000","last_undegraded":"2024-04-25T15:44:13.908563+0000","last_fullsized":"2024-04-25T15:44:13.908563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:51.097674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897266+0000","last_change":"2024-04-25T15:44:13.897266+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897266+0000","last_undegraded":"2024-04-25T15:44:13.897266+0000","last_fullsized":"2024-04-25T15:44:13.897266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908616+0000","last_change":"2024-04-25T15:44:13.905893+0000","last_active":"2024-04-25T15:44:13.908616+0000","last_peered":"2024-04-25T15:44:13.908616+0000","last_clean":"2024-04-25T15:44:13.908616+0000","last_became_active":"2024-04-25T15:44:13.905538+0000","last_became_peered":"2024-04-25T15:44:13.905538+0000","last_unstale":"2024-04-25T15:44:13.908616+0000","last_undegraded":"2024-04-25T15:44:13.908616+0000","last_fullsized":"2024-04-25T15:44:13.908616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:35.713816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382455+0000","last_change":"2024-04-25T15:44:14.919283+0000","last_active":"2024-04-25T15:44:16.382455+0000","last_peered":"2024-04-25T15:44:16.382455+0000","last_clean":"2024-04-25T15:44:16.382455+0000","last_became_active":"2024-04-25T15:44:14.917053+0000","last_became_peered":"2024-04-25T15:44:14.917053+0000","last_unstale":"2024-04-25T15:44:16.382455+0000","last_undegraded":"2024-04-25T15:44:16.382455+0000","last_fullsized":"2024-04-25T15:44:16.382455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:48.253000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912209+0000","last_change":"2024-04-25T15:44:13.910226+0000","last_active":"2024-04-25T15:44:13.912209+0000","last_peered":"2024-04-25T15:44:13.912209+0000","last_clean":"2024-04-25T15:44:13.912209+0000","last_became_active":"2024-04-25T15:44:13.909924+0000","last_became_peered":"2024-04-25T15:44:13.909924+0000","last_unstale":"2024-04-25T15:44:13.912209+0000","last_undegraded":"2024-04-25T15:44:13.912209+0000","last_fullsized":"2024-04-25T15:44:13.912209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899973+0000","last_change":"2024-04-25T15:44:13.899973+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899973+0000","last_undegraded":"2024-04-25T15:44:13.899973+0000","last_fullsized":"2024-04-25T15:44:13.899973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382293+0000","last_change":"2024-04-25T15:44:13.905547+0000","last_active":"2024-04-25T15:44:16.382293+0000","last_peered":"2024-04-25T15:44:16.382293+0000","last_clean":"2024-04-25T15:44:16.382293+0000","last_became_active":"2024-04-25T15:44:13.905216+0000","last_became_peered":"2024-04-25T15:44:13.905216+0000","last_unstale":"2024-04-25T15:44:16.382293+0000","last_undegraded":"2024-04-25T15:44:16.382293+0000","last_fullsized":"2024-04-25T15:44:16.382293+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:26.724253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897152+0000","last_change":"2024-04-25T15:44:13.897152+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897152+0000","last_undegraded":"2024-04-25T15:44:13.897152+0000","last_fullsized":"2024-04-25T15:44:13.897152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897518+0000","last_change":"2024-04-25T15:44:13.907728+0000","last_active":"2024-04-25T15:44:16.897518+0000","last_peered":"2024-04-25T15:44:16.897518+0000","last_clean":"2024-04-25T15:44:16.897518+0000","last_became_active":"2024-04-25T15:44:13.907408+0000","last_became_peered":"2024-04-25T15:44:13.907408+0000","last_unstale":"2024-04-25T15:44:16.897518+0000","last_undegraded":"2024-04-25T15:44:16.897518+0000","last_fullsized":"2024-04-25T15:44:16.897518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:43.246322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897861+0000","last_change":"2024-04-25T15:44:14.917654+0000","last_active":"2024-04-25T15:44:16.897861+0000","last_peered":"2024-04-25T15:44:16.897861+0000","last_clean":"2024-04-25T15:44:16.897861+0000","last_became_active":"2024-04-25T15:44:14.915460+0000","last_became_peered":"2024-04-25T15:44:14.915460+0000","last_unstale":"2024-04-25T15:44:16.897861+0000","last_undegraded":"2024-04-25T15:44:16.897861+0000","last_fullsized":"2024-04-25T15:44:16.897861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895177+0000","last_change":"2024-04-25T15:44:13.907741+0000","last_active":"2024-04-25T15:44:15.895177+0000","last_peered":"2024-04-25T15:44:15.895177+0000","last_clean":"2024-04-25T15:44:15.895177+0000","last_became_active":"2024-04-25T15:44:13.907422+0000","last_became_peered":"2024-04-25T15:44:13.907422+0000","last_unstale":"2024-04-25T15:44:15.895177+0000","last_undegraded":"2024-04-25T15:44:15.895177+0000","last_fullsized":"2024-04-25T15:44:15.895177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:11.390028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382361+0000","last_change":"2024-04-25T15:44:14.919463+0000","last_active":"2024-04-25T15:44:16.382361+0000","last_peered":"2024-04-25T15:44:16.382361+0000","last_clean":"2024-04-25T15:44:16.382361+0000","last_became_active":"2024-04-25T15:44:14.918660+0000","last_became_peered":"2024-04-25T15:44:14.918660+0000","last_unstale":"2024-04-25T15:44:16.382361+0000","last_undegraded":"2024-04-25T15:44:16.382361+0000","last_fullsized":"2024-04-25T15:44:16.382361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:38.317339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912134+0000","last_change":"2024-04-25T15:44:13.909660+0000","last_active":"2024-04-25T15:44:13.912134+0000","last_peered":"2024-04-25T15:44:13.912134+0000","last_clean":"2024-04-25T15:44:13.912134+0000","last_became_active":"2024-04-25T15:44:13.909289+0000","last_became_peered":"2024-04-25T15:44:13.909289+0000","last_unstale":"2024-04-25T15:44:13.912134+0000","last_undegraded":"2024-04-25T15:44:13.912134+0000","last_fullsized":"2024-04-25T15:44:13.912134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.900643+0000","last_change":"2024-04-25T15:44:13.900643+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.900643+0000","last_undegraded":"2024-04-25T15:44:13.900643+0000","last_fullsized":"2024-04-25T15:44:13.900643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.381794+0000","last_change":"2024-04-25T15:44:13.905184+0000","last_active":"2024-04-25T15:44:16.381794+0000","last_peered":"2024-04-25T15:44:16.381794+0000","last_clean":"2024-04-25T15:44:16.381794+0000","last_became_active":"2024-04-25T15:44:13.904852+0000","last_became_peered":"2024-04-25T15:44:13.904852+0000","last_unstale":"2024-04-25T15:44:16.381794+0000","last_undegraded":"2024-04-25T15:44:16.381794+0000","last_fullsized":"2024-04-25T15:44:16.381794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893591+0000","last_change":"2024-04-25T15:44:13.893591+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893591+0000","last_undegraded":"2024-04-25T15:44:13.893591+0000","last_fullsized":"2024-04-25T15:44:13.893591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911488+0000","last_change":"2024-04-25T15:44:13.909591+0000","last_active":"2024-04-25T15:44:13.911488+0000","last_peered":"2024-04-25T15:44:13.911488+0000","last_clean":"2024-04-25T15:44:13.911488+0000","last_became_active":"2024-04-25T15:44:13.908524+0000","last_became_peered":"2024-04-25T15:44:13.908524+0000","last_unstale":"2024-04-25T15:44:13.911488+0000","last_undegraded":"2024-04-25T15:44:13.911488+0000","last_fullsized":"2024-04-25T15:44:13.911488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:34.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895786+0000","last_change":"2024-04-25T15:44:14.899050+0000","last_active":"2024-04-25T15:44:15.895786+0000","last_peered":"2024-04-25T15:44:15.895786+0000","last_clean":"2024-04-25T15:44:15.895786+0000","last_became_active":"2024-04-25T15:44:14.898757+0000","last_became_peered":"2024-04-25T15:44:14.898757+0000","last_unstale":"2024-04-25T15:44:15.895786+0000","last_undegraded":"2024-04-25T15:44:15.895786+0000","last_fullsized":"2024-04-25T15:44:15.895786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:03.640679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897896+0000","last_change":"2024-04-25T15:44:13.911645+0000","last_active":"2024-04-25T15:44:16.897896+0000","last_peered":"2024-04-25T15:44:16.897896+0000","last_clean":"2024-04-25T15:44:16.897896+0000","last_became_active":"2024-04-25T15:44:13.911339+0000","last_became_peered":"2024-04-25T15:44:13.911339+0000","last_unstale":"2024-04-25T15:44:16.897896+0000","last_undegraded":"2024-04-25T15:44:16.897896+0000","last_fullsized":"2024-04-25T15:44:16.897896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:52.287895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.897616+0000","last_change":"2024-04-25T15:44:13.897616+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.897616+0000","last_undegraded":"2024-04-25T15:44:13.897616+0000","last_fullsized":"2024-04-25T15:44:13.897616+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897888+0000","last_change":"2024-04-25T15:44:13.910756+0000","last_active":"2024-04-25T15:44:16.897888+0000","last_peered":"2024-04-25T15:44:16.897888+0000","last_clean":"2024-04-25T15:44:16.897888+0000","last_became_active":"2024-04-25T15:44:13.910427+0000","last_became_peered":"2024-04-25T15:44:13.910427+0000","last_unstale":"2024-04-25T15:44:16.897888+0000","last_undegraded":"2024-04-25T15:44:16.897888+0000","last_fullsized":"2024-04-25T15:44:16.897888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:15.327679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382365+0000","last_change":"2024-04-25T15:44:14.922844+0000","last_active":"2024-04-25T15:44:16.382365+0000","last_peered":"2024-04-25T15:44:16.382365+0000","last_clean":"2024-04-25T15:44:16.382365+0000","last_became_active":"2024-04-25T15:44:14.922541+0000","last_became_peered":"2024-04-25T15:44:14.922541+0000","last_unstale":"2024-04-25T15:44:16.382365+0000","last_undegraded":"2024-04-25T15:44:16.382365+0000","last_fullsized":"2024-04-25T15:44:16.382365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:39.765601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910809+0000","last_change":"2024-04-25T15:44:13.905855+0000","last_active":"2024-04-25T15:44:13.910809+0000","last_peered":"2024-04-25T15:44:13.910809+0000","last_clean":"2024-04-25T15:44:13.910809+0000","last_became_active":"2024-04-25T15:44:13.905531+0000","last_became_peered":"2024-04-25T15:44:13.905531+0000","last_unstale":"2024-04-25T15:44:13.910809+0000","last_undegraded":"2024-04-25T15:44:13.910809+0000","last_fullsized":"2024-04-25T15:44:13.910809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.068667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896677+0000","last_change":"2024-04-25T15:44:13.896677+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896677+0000","last_undegraded":"2024-04-25T15:44:13.896677+0000","last_fullsized":"2024-04-25T15:44:13.896677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911331+0000","last_change":"2024-04-25T15:44:13.907599+0000","last_active":"2024-04-25T15:44:13.911331+0000","last_peered":"2024-04-25T15:44:13.911331+0000","last_clean":"2024-04-25T15:44:13.911331+0000","last_became_active":"2024-04-25T15:44:13.907294+0000","last_became_peered":"2024-04-25T15:44:13.907294+0000","last_unstale":"2024-04-25T15:44:13.911331+0000","last_undegraded":"2024-04-25T15:44:13.911331+0000","last_fullsized":"2024-04-25T15:44:13.911331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:27.265598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898457+0000","last_change":"2024-04-25T15:44:13.898457+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898457+0000","last_undegraded":"2024-04-25T15:44:13.898457+0000","last_fullsized":"2024-04-25T15:44:13.898457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912140+0000","last_change":"2024-04-25T15:44:13.909667+0000","last_active":"2024-04-25T15:44:13.912140+0000","last_peered":"2024-04-25T15:44:13.912140+0000","last_clean":"2024-04-25T15:44:13.912140+0000","last_became_active":"2024-04-25T15:44:13.909352+0000","last_became_peered":"2024-04-25T15:44:13.909352+0000","last_unstale":"2024-04-25T15:44:13.912140+0000","last_undegraded":"2024-04-25T15:44:13.912140+0000","last_fullsized":"2024-04-25T15:44:13.912140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895339+0000","last_change":"2024-04-25T15:44:14.905962+0000","last_active":"2024-04-25T15:44:15.895339+0000","last_peered":"2024-04-25T15:44:15.895339+0000","last_clean":"2024-04-25T15:44:15.895339+0000","last_became_active":"2024-04-25T15:44:14.905496+0000","last_became_peered":"2024-04-25T15:44:14.905496+0000","last_unstale":"2024-04-25T15:44:15.895339+0000","last_undegraded":"2024-04-25T15:44:15.895339+0000","last_fullsized":"2024-04-25T15:44:15.895339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:04.874124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.906926+0000","last_change":"2024-04-25T15:44:13.905465+0000","last_active":"2024-04-25T15:44:13.906926+0000","last_peered":"2024-04-25T15:44:13.906926+0000","last_clean":"2024-04-25T15:44:13.906926+0000","last_became_active":"2024-04-25T15:44:13.904934+0000","last_became_peered":"2024-04-25T15:44:13.904934+0000","last_unstale":"2024-04-25T15:44:13.906926+0000","last_undegraded":"2024-04-25T15:44:13.906926+0000","last_fullsized":"2024-04-25T15:44:13.906926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:51.344498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898500+0000","last_change":"2024-04-25T15:44:13.898500+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898500+0000","last_undegraded":"2024-04-25T15:44:13.898500+0000","last_fullsized":"2024-04-25T15:44:13.898500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894408+0000","last_change":"2024-04-25T15:44:13.908615+0000","last_active":"2024-04-25T15:44:15.894408+0000","last_peered":"2024-04-25T15:44:15.894408+0000","last_clean":"2024-04-25T15:44:15.894408+0000","last_became_active":"2024-04-25T15:44:13.908271+0000","last_became_peered":"2024-04-25T15:44:13.908271+0000","last_unstale":"2024-04-25T15:44:15.894408+0000","last_undegraded":"2024-04-25T15:44:15.894408+0000","last_fullsized":"2024-04-25T15:44:15.894408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.130047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.898925+0000","last_change":"2024-04-25T15:44:13.898925+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.898925+0000","last_undegraded":"2024-04-25T15:44:13.898925+0000","last_fullsized":"2024-04-25T15:44:13.898925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897962+0000","last_change":"2024-04-25T15:44:13.910139+0000","last_active":"2024-04-25T15:44:16.897962+0000","last_peered":"2024-04-25T15:44:16.897962+0000","last_clean":"2024-04-25T15:44:16.897962+0000","last_became_active":"2024-04-25T15:44:13.909800+0000","last_became_peered":"2024-04-25T15:44:13.909800+0000","last_unstale":"2024-04-25T15:44:16.897962+0000","last_undegraded":"2024-04-25T15:44:16.897962+0000","last_fullsized":"2024-04-25T15:44:16.897962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:27.265598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897857+0000","last_change":"2024-04-25T15:44:14.918337+0000","last_active":"2024-04-25T15:44:16.897857+0000","last_peered":"2024-04-25T15:44:16.897857+0000","last_clean":"2024-04-25T15:44:16.897857+0000","last_became_active":"2024-04-25T15:44:14.918001+0000","last_became_peered":"2024-04-25T15:44:14.918001+0000","last_unstale":"2024-04-25T15:44:16.897857+0000","last_undegraded":"2024-04-25T15:44:16.897857+0000","last_fullsized":"2024-04-25T15:44:16.897857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:08.209450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382408+0000","last_change":"2024-04-25T15:44:13.909158+0000","last_active":"2024-04-25T15:44:16.382408+0000","last_peered":"2024-04-25T15:44:16.382408+0000","last_clean":"2024-04-25T15:44:16.382408+0000","last_became_active":"2024-04-25T15:44:13.908479+0000","last_became_peered":"2024-04-25T15:44:13.908479+0000","last_unstale":"2024-04-25T15:44:16.382408+0000","last_undegraded":"2024-04-25T15:44:16.382408+0000","last_fullsized":"2024-04-25T15:44:16.382408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:15.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382291+0000","last_change":"2024-04-25T15:44:14.919540+0000","last_active":"2024-04-25T15:44:16.382291+0000","last_peered":"2024-04-25T15:44:16.382291+0000","last_clean":"2024-04-25T15:44:16.382291+0000","last_became_active":"2024-04-25T15:44:14.918973+0000","last_became_peered":"2024-04-25T15:44:14.918973+0000","last_unstale":"2024-04-25T15:44:16.382291+0000","last_undegraded":"2024-04-25T15:44:16.382291+0000","last_fullsized":"2024-04-25T15:44:16.382291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:07.907201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907908+0000","last_change":"2024-04-25T15:44:13.903636+0000","last_active":"2024-04-25T15:44:13.907908+0000","last_peered":"2024-04-25T15:44:13.907908+0000","last_clean":"2024-04-25T15:44:13.907908+0000","last_became_active":"2024-04-25T15:44:13.903324+0000","last_became_peered":"2024-04-25T15:44:13.903324+0000","last_unstale":"2024-04-25T15:44:13.907908+0000","last_undegraded":"2024-04-25T15:44:13.907908+0000","last_fullsized":"2024-04-25T15:44:13.907908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:26.716893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.893597+0000","last_change":"2024-04-25T15:44:13.893597+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.893597+0000","last_undegraded":"2024-04-25T15:44:13.893597+0000","last_fullsized":"2024-04-25T15:44:13.893597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.912073+0000","last_change":"2024-04-25T15:44:13.909055+0000","last_active":"2024-04-25T15:44:13.912073+0000","last_peered":"2024-04-25T15:44:13.912073+0000","last_clean":"2024-04-25T15:44:13.912073+0000","last_became_active":"2024-04-25T15:44:13.908746+0000","last_became_peered":"2024-04-25T15:44:13.908746+0000","last_unstale":"2024-04-25T15:44:13.912073+0000","last_undegraded":"2024-04-25T15:44:13.912073+0000","last_fullsized":"2024-04-25T15:44:13.912073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894647+0000","last_change":"2024-04-25T15:44:14.907499+0000","last_active":"2024-04-25T15:44:15.894647+0000","last_peered":"2024-04-25T15:44:15.894647+0000","last_clean":"2024-04-25T15:44:15.894647+0000","last_became_active":"2024-04-25T15:44:14.907132+0000","last_became_peered":"2024-04-25T15:44:14.907132+0000","last_unstale":"2024-04-25T15:44:15.894647+0000","last_undegraded":"2024-04-25T15:44:15.894647+0000","last_fullsized":"2024-04-25T15:44:15.894647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:41.985916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.908887+0000","last_change":"2024-04-25T15:44:13.907027+0000","last_active":"2024-04-25T15:44:13.908887+0000","last_peered":"2024-04-25T15:44:13.908887+0000","last_clean":"2024-04-25T15:44:13.908887+0000","last_became_active":"2024-04-25T15:44:13.906711+0000","last_became_peered":"2024-04-25T15:44:13.906711+0000","last_unstale":"2024-04-25T15:44:13.908887+0000","last_undegraded":"2024-04-25T15:44:13.908887+0000","last_fullsized":"2024-04-25T15:44:13.908887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:53.216515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895897+0000","last_change":"2024-04-25T15:44:13.895897+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895897+0000","last_undegraded":"2024-04-25T15:44:13.895897+0000","last_fullsized":"2024-04-25T15:44:13.895897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907847+0000","last_change":"2024-04-25T15:44:13.905601+0000","last_active":"2024-04-25T15:44:13.907847+0000","last_peered":"2024-04-25T15:44:13.907847+0000","last_clean":"2024-04-25T15:44:13.907847+0000","last_became_active":"2024-04-25T15:44:13.905302+0000","last_became_peered":"2024-04-25T15:44:13.905302+0000","last_unstale":"2024-04-25T15:44:13.907847+0000","last_undegraded":"2024-04-25T15:44:13.907847+0000","last_fullsized":"2024-04-25T15:44:13.907847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:15.516137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897511+0000","last_change":"2024-04-25T15:44:14.914881+0000","last_active":"2024-04-25T15:44:16.897511+0000","last_peered":"2024-04-25T15:44:16.897511+0000","last_clean":"2024-04-25T15:44:16.897511+0000","last_became_active":"2024-04-25T15:44:14.913413+0000","last_became_peered":"2024-04-25T15:44:14.913413+0000","last_unstale":"2024-04-25T15:44:16.897511+0000","last_undegraded":"2024-04-25T15:44:16.897511+0000","last_fullsized":"2024-04-25T15:44:16.897511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:44.147439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895101+0000","last_change":"2024-04-25T15:44:13.903844+0000","last_active":"2024-04-25T15:44:15.895101+0000","last_peered":"2024-04-25T15:44:15.895101+0000","last_clean":"2024-04-25T15:44:15.895101+0000","last_became_active":"2024-04-25T15:44:13.902912+0000","last_became_peered":"2024-04-25T15:44:13.902912+0000","last_unstale":"2024-04-25T15:44:15.895101+0000","last_undegraded":"2024-04-25T15:44:15.895101+0000","last_fullsized":"2024-04-25T15:44:15.895101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:52.287895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899492+0000","last_change":"2024-04-25T15:44:13.899492+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899492+0000","last_undegraded":"2024-04-25T15:44:13.899492+0000","last_fullsized":"2024-04-25T15:44:13.899492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910812+0000","last_change":"2024-04-25T15:44:13.906914+0000","last_active":"2024-04-25T15:44:13.910812+0000","last_peered":"2024-04-25T15:44:13.910812+0000","last_clean":"2024-04-25T15:44:13.910812+0000","last_became_active":"2024-04-25T15:44:13.906620+0000","last_became_peered":"2024-04-25T15:44:13.906620+0000","last_unstale":"2024-04-25T15:44:13.910812+0000","last_undegraded":"2024-04-25T15:44:13.910812+0000","last_fullsized":"2024-04-25T15:44:13.910812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:22.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895626+0000","last_change":"2024-04-25T15:44:13.895626+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895626+0000","last_undegraded":"2024-04-25T15:44:13.895626+0000","last_fullsized":"2024-04-25T15:44:13.895626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.898053+0000","last_change":"2024-04-25T15:44:13.911091+0000","last_active":"2024-04-25T15:44:16.898053+0000","last_peered":"2024-04-25T15:44:16.898053+0000","last_clean":"2024-04-25T15:44:16.898053+0000","last_became_active":"2024-04-25T15:44:13.910731+0000","last_became_peered":"2024-04-25T15:44:13.910731+0000","last_unstale":"2024-04-25T15:44:16.898053+0000","last_undegraded":"2024-04-25T15:44:16.898053+0000","last_fullsized":"2024-04-25T15:44:16.898053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.068667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895766+0000","last_change":"2024-04-25T15:44:14.897805+0000","last_active":"2024-04-25T15:44:15.895766+0000","last_peered":"2024-04-25T15:44:15.895766+0000","last_clean":"2024-04-25T15:44:15.895766+0000","last_became_active":"2024-04-25T15:44:14.897443+0000","last_became_peered":"2024-04-25T15:44:14.897443+0000","last_unstale":"2024-04-25T15:44:15.895766+0000","last_undegraded":"2024-04-25T15:44:15.895766+0000","last_fullsized":"2024-04-25T15:44:15.895766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:51.103852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.907881+0000","last_change":"2024-04-25T15:44:13.904946+0000","last_active":"2024-04-25T15:44:13.907881+0000","last_peered":"2024-04-25T15:44:13.907881+0000","last_clean":"2024-04-25T15:44:13.907881+0000","last_became_active":"2024-04-25T15:44:13.904600+0000","last_became_peered":"2024-04-25T15:44:13.904600+0000","last_unstale":"2024-04-25T15:44:13.907881+0000","last_undegraded":"2024-04-25T15:44:13.907881+0000","last_fullsized":"2024-04-25T15:44:13.907881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:27:52.502490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.899328+0000","last_change":"2024-04-25T15:44:13.899328+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.899328+0000","last_undegraded":"2024-04-25T15:44:13.899328+0000","last_fullsized":"2024-04-25T15:44:13.899328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911996+0000","last_change":"2024-04-25T15:44:13.910412+0000","last_active":"2024-04-25T15:44:13.911996+0000","last_peered":"2024-04-25T15:44:13.911996+0000","last_clean":"2024-04-25T15:44:13.911996+0000","last_became_active":"2024-04-25T15:44:13.910110+0000","last_became_peered":"2024-04-25T15:44:13.910110+0000","last_unstale":"2024-04-25T15:44:13.911996+0000","last_undegraded":"2024-04-25T15:44:13.911996+0000","last_fullsized":"2024-04-25T15:44:13.911996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:02.501485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.896175+0000","last_change":"2024-04-25T15:44:13.896175+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.896175+0000","last_undegraded":"2024-04-25T15:44:13.896175+0000","last_fullsized":"2024-04-25T15:44:13.896175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910915+0000","last_change":"2024-04-25T15:44:13.906655+0000","last_active":"2024-04-25T15:44:13.910915+0000","last_peered":"2024-04-25T15:44:13.910915+0000","last_clean":"2024-04-25T15:44:13.910915+0000","last_became_active":"2024-04-25T15:44:13.906266+0000","last_became_peered":"2024-04-25T15:44:13.906266+0000","last_unstale":"2024-04-25T15:44:13.910915+0000","last_undegraded":"2024-04-25T15:44:13.910915+0000","last_fullsized":"2024-04-25T15:44:13.910915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:26.747000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T15:44:13.895531+0000","last_change":"2024-04-25T15:44:13.895531+0000","last_active":"2024-04-25T15:44:13.880566+0000","last_peered":"2024-04-25T15:44:13.880566+0000","last_clean":"2024-04-25T15:44:13.880566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:13.895531+0000","last_undegraded":"2024-04-25T15:44:13.895531+0000","last_fullsized":"2024-04-25T15:44:13.895531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.910307+0000","last_change":"2024-04-25T15:44:13.907835+0000","last_active":"2024-04-25T15:44:13.910307+0000","last_peered":"2024-04-25T15:44:13.910307+0000","last_clean":"2024-04-25T15:44:13.910307+0000","last_became_active":"2024-04-25T15:44:13.907521+0000","last_became_peered":"2024-04-25T15:44:13.907521+0000","last_unstale":"2024-04-25T15:44:13.910307+0000","last_undegraded":"2024-04-25T15:44:13.910307+0000","last_fullsized":"2024-04-25T15:44:13.910307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:38.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382030+0000","last_change":"2024-04-25T15:44:14.919719+0000","last_active":"2024-04-25T15:44:16.382030+0000","last_peered":"2024-04-25T15:44:16.382030+0000","last_clean":"2024-04-25T15:44:16.382030+0000","last_became_active":"2024-04-25T15:44:14.918684+0000","last_became_peered":"2024-04-25T15:44:14.918684+0000","last_unstale":"2024-04-25T15:44:16.382030+0000","last_undegraded":"2024-04-25T15:44:16.382030+0000","last_fullsized":"2024-04-25T15:44:16.382030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:29.924673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.381820+0000","last_change":"2024-04-25T15:44:13.906383+0000","last_active":"2024-04-25T15:44:16.381820+0000","last_peered":"2024-04-25T15:44:16.381820+0000","last_clean":"2024-04-25T15:44:16.381820+0000","last_became_active":"2024-04-25T15:44:13.905832+0000","last_became_peered":"2024-04-25T15:44:13.905832+0000","last_unstale":"2024-04-25T15:44:16.381820+0000","last_undegraded":"2024-04-25T15:44:16.381820+0000","last_fullsized":"2024-04-25T15:44:16.381820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895576+0000","last_change":"2024-04-25T15:44:14.897819+0000","last_active":"2024-04-25T15:44:15.895576+0000","last_peered":"2024-04-25T15:44:15.895576+0000","last_clean":"2024-04-25T15:44:15.895576+0000","last_became_active":"2024-04-25T15:44:14.897410+0000","last_became_peered":"2024-04-25T15:44:14.897410+0000","last_unstale":"2024-04-25T15:44:15.895576+0000","last_undegraded":"2024-04-25T15:44:15.895576+0000","last_fullsized":"2024-04-25T15:44:15.895576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:44.147439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T15:44:13.911372+0000","last_change":"2024-04-25T15:44:13.909615+0000","last_active":"2024-04-25T15:44:13.911372+0000","last_peered":"2024-04-25T15:44:13.911372+0000","last_clean":"2024-04-25T15:44:13.911372+0000","last_became_active":"2024-04-25T15:44:13.909300+0000","last_became_peered":"2024-04-25T15:44:13.909300+0000","last_unstale":"2024-04-25T15:44:13.911372+0000","last_undegraded":"2024-04-25T15:44:13.911372+0000","last_fullsized":"2024-04-25T15:44:13.911372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.914823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897963+0000","last_change":"2024-04-25T15:44:14.919149+0000","last_active":"2024-04-25T15:44:16.897963+0000","last_peered":"2024-04-25T15:44:16.897963+0000","last_clean":"2024-04-25T15:44:16.897963+0000","last_became_active":"2024-04-25T15:44:14.918845+0000","last_became_peered":"2024-04-25T15:44:14.918845+0000","last_unstale":"2024-04-25T15:44:16.897963+0000","last_undegraded":"2024-04-25T15:44:16.897963+0000","last_fullsized":"2024-04-25T15:44:16.897963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:55.863555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895618+0000","last_change":"2024-04-25T15:44:13.906381+0000","last_active":"2024-04-25T15:44:15.895618+0000","last_peered":"2024-04-25T15:44:15.895618+0000","last_clean":"2024-04-25T15:44:15.895618+0000","last_became_active":"2024-04-25T15:44:13.906021+0000","last_became_peered":"2024-04-25T15:44:13.906021+0000","last_unstale":"2024-04-25T15:44:15.895618+0000","last_undegraded":"2024-04-25T15:44:15.895618+0000","last_fullsized":"2024-04-25T15:44:15.895618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:43.246322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":146,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894712+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:15.894712+0000","last_peered":"2024-04-25T15:44:15.894712+0000","last_clean":"2024-04-25T15:44:15.894712+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:15.894712+0000","last_undegraded":"2024-04-25T15:44:15.894712+0000","last_fullsized":"2024-04-25T15:44:15.894712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":172773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":763141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":785349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":193411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":193903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:19.568 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-25T15:44:19.568+0000 7f384a913640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:44:22.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:22.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.466+0000 7fa68bd1f640 1 Processor -- start 2024-04-25T15:44:22.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.467+0000 7fa68bd1f640 1 -- start start 2024-04-25T15:44:22.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa68bd1f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6840d34a0 0x7fa6840b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa68bd1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6840b3ac0 0x7fa6840b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa68bd1f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6840d1010 con 0x7fa68406da90 2024-04-25T15:44:22.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa68bd1f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa68409cdf0 con 0x7fa6840d34a0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa68bd1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa68409d0d0 con 0x7fa6840b3ac0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa689abb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6840d34a0 0x7fa6840b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa689abb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6840d34a0 0x7fa6840b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41370/0 (socket says 172.21.15.80:41370) 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa689abb640 1 -- 172.21.15.80:0/2990293503 learned_addr learned my addr 172.21.15.80:0/2990293503 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.468+0000 7fa68a2bc640 1 --2- 172.21.15.80:0/2990293503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6840b3ac0 0x7fa6840b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.469+0000 7fa689abb640 1 -- 172.21.15.80:0/2990293503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6840b3ac0 msgr2=0x7fa6840b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.469+0000 7fa689abb640 1 --2- 172.21.15.80:0/2990293503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6840b3ac0 0x7fa6840b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.469+0000 7fa689abb640 1 -- 172.21.15.80:0/2990293503 >> v1:172.21.15.195:6789/0 conn(0x7fa68406da90 legacy=0x7fa68406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.469+0000 7fa689abb640 1 -- 172.21.15.80:0/2990293503 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68406ec70 con 0x7fa6840d34a0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.469+0000 7fa689abb640 1 --2- 172.21.15.80:0/2990293503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840d34a0 0x7fa6840b91b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa680009850 tx=0x7fa68002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14519cdfa2de0d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.469+0000 7fa688ab9640 1 -- 172.21.15.80:0/2990293503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680004030 con 0x7fa6840d34a0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa688ab9640 1 -- 172.21.15.80:0/2990293503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6800041d0 con 0x7fa6840d34a0 2024-04-25T15:44:22.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa688ab9640 1 -- 172.21.15.80:0/2990293503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680003610 con 0x7fa6840d34a0 2024-04-25T15:44:22.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 -- 172.21.15.80:0/2990293503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840d34a0 msgr2=0x7fa6840b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/2990293503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840d34a0 0x7fa6840b91b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa680009850 tx=0x7fa68002a230 comp rx=0 tx=0).stop 2024-04-25T15:44:22.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 -- 172.21.15.80:0/2990293503 shutdown_connections 2024-04-25T15:44:22.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/2990293503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6840b3ac0 0x7fa6840b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/2990293503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840d34a0 0x7fa6840b91b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 -- 172.21.15.80:0/2990293503 >> 172.21.15.80:0/2990293503 conn(0x7fa6840d0450 msgr2=0x7fa6840d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:22.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 -- 172.21.15.80:0/2990293503 shutdown_connections 2024-04-25T15:44:22.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.470+0000 7fa68bd1f640 1 -- 172.21.15.80:0/2990293503 wait complete. 2024-04-25T15:44:22.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.472+0000 7fa68bd1f640 1 Processor -- start 2024-04-25T15:44:22.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.472+0000 7fa68bd1f640 1 -- start start 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.473+0000 7fa68bd1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa68406da90 0x7fa684152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.473+0000 7fa68bd1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 0x7fa68409e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.473+0000 7fa68bd1f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6840d34a0 0x7fa684155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.473+0000 7fa68bd1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa6840b4410 con 0x7fa6840b3ac0 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.473+0000 7fa68bd1f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa68406d7b0 con 0x7fa6840d34a0 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.473+0000 7fa68bd1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa6840b4590 con 0x7fa68406da90 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 0x7fa68409e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 0x7fa68409e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41386/0 (socket says 172.21.15.80:41386) 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 -- 172.21.15.80:0/1652721175 learned_addr learned my addr 172.21.15.80:0/1652721175 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa68a2bc640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6840d34a0 0x7fa684155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa689abb640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa68406da90 0x7fa684152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 -- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa68406da90 msgr2=0x7fa684152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa68406da90 0x7fa684152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 -- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6840d34a0 msgr2=0x7fa684155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6840d34a0 0x7fa684155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 -- 172.21.15.80:0/1652721175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68409d830 con 0x7fa6840b3ac0 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa6892ba640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 0x7fa68409e2a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c400 tx=0x7fa67400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674017070 con 0x7fa6840b3ac0 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6740052d0 con 0x7fa6840b3ac0 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68409e7e0 con 0x7fa6840b3ac0 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674003830 con 0x7fa6840b3ac0 2024-04-25T15:44:22.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.474+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68409daa0 con 0x7fa6840b3ac0 2024-04-25T15:44:22.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.475+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68406a100 con 0x7fa6840b3ac0 2024-04-25T15:44:22.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.476+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa67401a070 con 0x7fa6840b3ac0 2024-04-25T15:44:22.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.476+0000 7fa67a7fc640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa6680744b0 0x7fa6680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.477+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa6740946e0 con 0x7fa6840b3ac0 2024-04-25T15:44:22.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.477+0000 7fa689abb640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa6680744b0 0x7fa6680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.477+0000 7fa689abb640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa6680744b0 0x7fa6680769c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa680033000 tx=0x7fa68002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:22.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.481+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa67405ed70 con 0x7fa6840b3ac0 2024-04-25T15:44:22.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.654+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa68409f4a0 con 0x7fa6680744b0 2024-04-25T15:44:22.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.660+0000 7fa67a7fc640 1 -- 172.21.15.80:0/1652721175 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fa680080840 con 0x7fa6680744b0 2024-04-25T15:44:22.662 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:22.663 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa6680744b0 msgr2=0x7fa6680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa6680744b0 0x7fa6680769c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa680033000 tx=0x7fa68002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 msgr2=0x7fa68409e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 0x7fa68409e2a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c400 tx=0x7fa67400c8c0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 shutdown_connections 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa6680744b0 0x7fa6680769c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6840d34a0 0x7fa684155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6840b3ac0 0x7fa68409e2a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 --2- 172.21.15.80:0/1652721175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa68406da90 0x7fa684152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 >> 172.21.15.80:0/1652721175 conn(0x7fa6840d0450 msgr2=0x7fa684071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:22.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 shutdown_connections 2024-04-25T15:44:22.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.663+0000 7fa68bd1f640 1 -- 172.21.15.80:0/1652721175 wait complete. 2024-04-25T15:44:22.674 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-25T15:44:21.015119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237536,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737184,"statfs":{"total":773094113280,"available":772850876416,"internally_reserved":0,"allocated":4825088,"data_stored":2731948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.126446"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.957019+0000","last_change":"2024-04-25T15:44:14.917983+0000","last_active":"2024-04-25T15:44:16.957019+0000","last_peered":"2024-04-25T15:44:16.957019+0000","last_clean":"2024-04-25T15:44:16.957019+0000","last_became_active":"2024-04-25T15:44:14.917700+0000","last_became_peered":"2024-04-25T15:44:14.917700+0000","last_unstale":"2024-04-25T15:44:16.957019+0000","last_undegraded":"2024-04-25T15:44:16.957019+0000","last_fullsized":"2024-04-25T15:44:16.957019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:20.582258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956805+0000","last_change":"2024-04-25T15:44:14.913349+0000","last_active":"2024-04-25T15:44:16.956805+0000","last_peered":"2024-04-25T15:44:16.956805+0000","last_clean":"2024-04-25T15:44:16.956805+0000","last_became_active":"2024-04-25T15:44:14.912898+0000","last_became_peered":"2024-04-25T15:44:14.912898+0000","last_unstale":"2024-04-25T15:44:16.956805+0000","last_undegraded":"2024-04-25T15:44:16.956805+0000","last_fullsized":"2024-04-25T15:44:16.956805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:22.062967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752379+0000","last_change":"2024-04-25T15:44:14.919423+0000","last_active":"2024-04-25T15:44:16.752379+0000","last_peered":"2024-04-25T15:44:16.752379+0000","last_clean":"2024-04-25T15:44:16.752379+0000","last_became_active":"2024-04-25T15:44:14.919126+0000","last_became_peered":"2024-04-25T15:44:14.919126+0000","last_unstale":"2024-04-25T15:44:16.752379+0000","last_undegraded":"2024-04-25T15:44:16.752379+0000","last_fullsized":"2024-04-25T15:44:16.752379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:38.317339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893783+0000","last_change":"2024-04-25T15:44:14.918189+0000","last_active":"2024-04-25T15:44:15.893783+0000","last_peered":"2024-04-25T15:44:15.893783+0000","last_clean":"2024-04-25T15:44:15.893783+0000","last_became_active":"2024-04-25T15:44:14.917915+0000","last_became_peered":"2024-04-25T15:44:14.917915+0000","last_unstale":"2024-04-25T15:44:15.893783+0000","last_undegraded":"2024-04-25T15:44:15.893783+0000","last_fullsized":"2024-04-25T15:44:15.893783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:00.994710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893581+0000","last_change":"2024-04-25T15:44:14.922477+0000","last_active":"2024-04-25T15:44:15.893581+0000","last_peered":"2024-04-25T15:44:15.893581+0000","last_clean":"2024-04-25T15:44:15.893581+0000","last_became_active":"2024-04-25T15:44:14.922074+0000","last_became_peered":"2024-04-25T15:44:14.922074+0000","last_unstale":"2024-04-25T15:44:15.893581+0000","last_undegraded":"2024-04-25T15:44:15.893581+0000","last_fullsized":"2024-04-25T15:44:15.893581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:15.099497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068117+0000","last_change":"2024-04-25T15:44:14.914080+0000","last_active":"2024-04-25T15:44:16.068117+0000","last_peered":"2024-04-25T15:44:16.068117+0000","last_clean":"2024-04-25T15:44:16.068117+0000","last_became_active":"2024-04-25T15:44:14.913767+0000","last_became_peered":"2024-04-25T15:44:14.913767+0000","last_unstale":"2024-04-25T15:44:16.068117+0000","last_undegraded":"2024-04-25T15:44:16.068117+0000","last_fullsized":"2024-04-25T15:44:16.068117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:29.924673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897395+0000","last_change":"2024-04-25T15:44:14.919576+0000","last_active":"2024-04-25T15:44:16.897395+0000","last_peered":"2024-04-25T15:44:16.897395+0000","last_clean":"2024-04-25T15:44:16.897395+0000","last_became_active":"2024-04-25T15:44:14.919232+0000","last_became_peered":"2024-04-25T15:44:14.919232+0000","last_unstale":"2024-04-25T15:44:16.897395+0000","last_undegraded":"2024-04-25T15:44:16.897395+0000","last_fullsized":"2024-04-25T15:44:16.897395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:04.874124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956463+0000","last_change":"2024-04-25T15:44:14.915728+0000","last_active":"2024-04-25T15:44:16.956463+0000","last_peered":"2024-04-25T15:44:16.956463+0000","last_clean":"2024-04-25T15:44:16.956463+0000","last_became_active":"2024-04-25T15:44:14.915450+0000","last_became_peered":"2024-04-25T15:44:14.915450+0000","last_unstale":"2024-04-25T15:44:16.956463+0000","last_undegraded":"2024-04-25T15:44:16.956463+0000","last_fullsized":"2024-04-25T15:44:16.956463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:04.980116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752633+0000","last_change":"2024-04-25T15:44:14.920141+0000","last_active":"2024-04-25T15:44:16.752633+0000","last_peered":"2024-04-25T15:44:16.752633+0000","last_clean":"2024-04-25T15:44:16.752633+0000","last_became_active":"2024-04-25T15:44:14.919849+0000","last_became_peered":"2024-04-25T15:44:14.919849+0000","last_unstale":"2024-04-25T15:44:16.752633+0000","last_undegraded":"2024-04-25T15:44:16.752633+0000","last_fullsized":"2024-04-25T15:44:16.752633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:40.199591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897840+0000","last_change":"2024-04-25T15:44:14.915328+0000","last_active":"2024-04-25T15:44:16.897840+0000","last_peered":"2024-04-25T15:44:16.897840+0000","last_clean":"2024-04-25T15:44:16.897840+0000","last_became_active":"2024-04-25T15:44:14.914887+0000","last_became_peered":"2024-04-25T15:44:14.914887+0000","last_unstale":"2024-04-25T15:44:16.897840+0000","last_undegraded":"2024-04-25T15:44:16.897840+0000","last_fullsized":"2024-04-25T15:44:16.897840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:53.271448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897793+0000","last_change":"2024-04-25T15:44:14.922625+0000","last_active":"2024-04-25T15:44:16.897793+0000","last_peered":"2024-04-25T15:44:16.897793+0000","last_clean":"2024-04-25T15:44:16.897793+0000","last_became_active":"2024-04-25T15:44:14.921856+0000","last_became_peered":"2024-04-25T15:44:14.921856+0000","last_unstale":"2024-04-25T15:44:16.897793+0000","last_undegraded":"2024-04-25T15:44:16.897793+0000","last_fullsized":"2024-04-25T15:44:16.897793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:04.980116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752422+0000","last_change":"2024-04-25T15:44:14.912779+0000","last_active":"2024-04-25T15:44:16.752422+0000","last_peered":"2024-04-25T15:44:16.752422+0000","last_clean":"2024-04-25T15:44:16.752422+0000","last_became_active":"2024-04-25T15:44:14.912459+0000","last_became_peered":"2024-04-25T15:44:14.912459+0000","last_unstale":"2024-04-25T15:44:16.752422+0000","last_undegraded":"2024-04-25T15:44:16.752422+0000","last_fullsized":"2024-04-25T15:44:16.752422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:39.765601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897440+0000","last_change":"2024-04-25T15:44:14.914526+0000","last_active":"2024-04-25T15:44:16.897440+0000","last_peered":"2024-04-25T15:44:16.897440+0000","last_clean":"2024-04-25T15:44:16.897440+0000","last_became_active":"2024-04-25T15:44:14.914244+0000","last_became_peered":"2024-04-25T15:44:14.914244+0000","last_unstale":"2024-04-25T15:44:16.897440+0000","last_undegraded":"2024-04-25T15:44:16.897440+0000","last_fullsized":"2024-04-25T15:44:16.897440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:07.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.381993+0000","last_change":"2024-04-25T15:44:14.920394+0000","last_active":"2024-04-25T15:44:16.381993+0000","last_peered":"2024-04-25T15:44:16.381993+0000","last_clean":"2024-04-25T15:44:16.381993+0000","last_became_active":"2024-04-25T15:44:14.919946+0000","last_became_peered":"2024-04-25T15:44:14.919946+0000","last_unstale":"2024-04-25T15:44:16.381993+0000","last_undegraded":"2024-04-25T15:44:16.381993+0000","last_fullsized":"2024-04-25T15:44:16.381993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:35.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897508+0000","last_change":"2024-04-25T15:44:14.913890+0000","last_active":"2024-04-25T15:44:16.897508+0000","last_peered":"2024-04-25T15:44:16.897508+0000","last_clean":"2024-04-25T15:44:16.897508+0000","last_became_active":"2024-04-25T15:44:14.913574+0000","last_became_peered":"2024-04-25T15:44:14.913574+0000","last_unstale":"2024-04-25T15:44:16.897508+0000","last_undegraded":"2024-04-25T15:44:16.897508+0000","last_fullsized":"2024-04-25T15:44:16.897508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:51.103852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894334+0000","last_change":"2024-04-25T15:44:14.913473+0000","last_active":"2024-04-25T15:44:15.894334+0000","last_peered":"2024-04-25T15:44:15.894334+0000","last_clean":"2024-04-25T15:44:15.894334+0000","last_became_active":"2024-04-25T15:44:14.913083+0000","last_became_peered":"2024-04-25T15:44:14.913083+0000","last_unstale":"2024-04-25T15:44:15.894334+0000","last_undegraded":"2024-04-25T15:44:15.894334+0000","last_fullsized":"2024-04-25T15:44:15.894334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:40.199591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895907+0000","last_change":"2024-04-25T15:44:14.916939+0000","last_active":"2024-04-25T15:44:15.895907+0000","last_peered":"2024-04-25T15:44:15.895907+0000","last_clean":"2024-04-25T15:44:15.895907+0000","last_became_active":"2024-04-25T15:44:14.916629+0000","last_became_peered":"2024-04-25T15:44:14.916629+0000","last_unstale":"2024-04-25T15:44:15.895907+0000","last_undegraded":"2024-04-25T15:44:15.895907+0000","last_fullsized":"2024-04-25T15:44:15.895907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:06.990539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894976+0000","last_change":"2024-04-25T15:44:14.921805+0000","last_active":"2024-04-25T15:44:15.894976+0000","last_peered":"2024-04-25T15:44:15.894976+0000","last_clean":"2024-04-25T15:44:15.894976+0000","last_became_active":"2024-04-25T15:44:14.921449+0000","last_became_peered":"2024-04-25T15:44:14.921449+0000","last_unstale":"2024-04-25T15:44:15.894976+0000","last_undegraded":"2024-04-25T15:44:15.894976+0000","last_fullsized":"2024-04-25T15:44:15.894976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:16.337529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893774+0000","last_change":"2024-04-25T15:44:14.905841+0000","last_active":"2024-04-25T15:44:15.893774+0000","last_peered":"2024-04-25T15:44:15.893774+0000","last_clean":"2024-04-25T15:44:15.893774+0000","last_became_active":"2024-04-25T15:44:14.905316+0000","last_became_peered":"2024-04-25T15:44:14.905316+0000","last_unstale":"2024-04-25T15:44:15.893774+0000","last_undegraded":"2024-04-25T15:44:15.893774+0000","last_fullsized":"2024-04-25T15:44:15.893774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:27.734102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894536+0000","last_change":"2024-04-25T15:44:14.917657+0000","last_active":"2024-04-25T15:44:15.894536+0000","last_peered":"2024-04-25T15:44:15.894536+0000","last_clean":"2024-04-25T15:44:15.894536+0000","last_became_active":"2024-04-25T15:44:14.917353+0000","last_became_peered":"2024-04-25T15:44:14.917353+0000","last_unstale":"2024-04-25T15:44:15.894536+0000","last_undegraded":"2024-04-25T15:44:15.894536+0000","last_fullsized":"2024-04-25T15:44:15.894536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:53.297744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897566+0000","last_change":"2024-04-25T15:44:14.911473+0000","last_active":"2024-04-25T15:44:16.897566+0000","last_peered":"2024-04-25T15:44:16.897566+0000","last_clean":"2024-04-25T15:44:16.897566+0000","last_became_active":"2024-04-25T15:44:14.911173+0000","last_became_peered":"2024-04-25T15:44:14.911173+0000","last_unstale":"2024-04-25T15:44:16.897566+0000","last_undegraded":"2024-04-25T15:44:16.897566+0000","last_fullsized":"2024-04-25T15:44:16.897566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:03.640679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382488+0000","last_change":"2024-04-25T15:44:14.918990+0000","last_active":"2024-04-25T15:44:16.382488+0000","last_peered":"2024-04-25T15:44:16.382488+0000","last_clean":"2024-04-25T15:44:16.382488+0000","last_became_active":"2024-04-25T15:44:14.918318+0000","last_became_peered":"2024-04-25T15:44:14.918318+0000","last_unstale":"2024-04-25T15:44:16.382488+0000","last_undegraded":"2024-04-25T15:44:16.382488+0000","last_fullsized":"2024-04-25T15:44:16.382488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:39.489336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894433+0000","last_change":"2024-04-25T15:44:14.908530+0000","last_active":"2024-04-25T15:44:15.894433+0000","last_peered":"2024-04-25T15:44:15.894433+0000","last_clean":"2024-04-25T15:44:15.894433+0000","last_became_active":"2024-04-25T15:44:14.907980+0000","last_became_peered":"2024-04-25T15:44:14.907980+0000","last_unstale":"2024-04-25T15:44:15.894433+0000","last_undegraded":"2024-04-25T15:44:15.894433+0000","last_fullsized":"2024-04-25T15:44:15.894433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:32:26.647185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893497+0000","last_change":"2024-04-25T15:44:14.897375+0000","last_active":"2024-04-25T15:44:15.893497+0000","last_peered":"2024-04-25T15:44:15.893497+0000","last_clean":"2024-04-25T15:44:15.893497+0000","last_became_active":"2024-04-25T15:44:14.897046+0000","last_became_peered":"2024-04-25T15:44:14.897046+0000","last_unstale":"2024-04-25T15:44:15.893497+0000","last_undegraded":"2024-04-25T15:44:15.893497+0000","last_fullsized":"2024-04-25T15:44:15.893497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:03.511334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894690+0000","last_change":"2024-04-25T15:44:14.914771+0000","last_active":"2024-04-25T15:44:15.894690+0000","last_peered":"2024-04-25T15:44:15.894690+0000","last_clean":"2024-04-25T15:44:15.894690+0000","last_became_active":"2024-04-25T15:44:14.914476+0000","last_became_peered":"2024-04-25T15:44:14.914476+0000","last_unstale":"2024-04-25T15:44:15.894690+0000","last_undegraded":"2024-04-25T15:44:15.894690+0000","last_fullsized":"2024-04-25T15:44:15.894690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:12.399877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068328+0000","last_change":"2024-04-25T15:44:14.912669+0000","last_active":"2024-04-25T15:44:16.068328+0000","last_peered":"2024-04-25T15:44:16.068328+0000","last_clean":"2024-04-25T15:44:16.068328+0000","last_became_active":"2024-04-25T15:44:14.912323+0000","last_became_peered":"2024-04-25T15:44:14.912323+0000","last_unstale":"2024-04-25T15:44:16.068328+0000","last_undegraded":"2024-04-25T15:44:16.068328+0000","last_fullsized":"2024-04-25T15:44:16.068328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:48.253000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894955+0000","last_change":"2024-04-25T15:44:14.905175+0000","last_active":"2024-04-25T15:44:15.894955+0000","last_peered":"2024-04-25T15:44:15.894955+0000","last_clean":"2024-04-25T15:44:15.894955+0000","last_became_active":"2024-04-25T15:44:14.904854+0000","last_became_peered":"2024-04-25T15:44:14.904854+0000","last_unstale":"2024-04-25T15:44:15.894955+0000","last_undegraded":"2024-04-25T15:44:15.894955+0000","last_fullsized":"2024-04-25T15:44:15.894955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:44.256171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897760+0000","last_change":"2024-04-25T15:44:14.924957+0000","last_active":"2024-04-25T15:44:16.897760+0000","last_peered":"2024-04-25T15:44:16.897760+0000","last_clean":"2024-04-25T15:44:16.897760+0000","last_became_active":"2024-04-25T15:44:14.924665+0000","last_became_peered":"2024-04-25T15:44:14.924665+0000","last_unstale":"2024-04-25T15:44:16.897760+0000","last_undegraded":"2024-04-25T15:44:16.897760+0000","last_fullsized":"2024-04-25T15:44:16.897760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:06.990539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894605+0000","last_change":"2024-04-25T15:44:14.906563+0000","last_active":"2024-04-25T15:44:15.894605+0000","last_peered":"2024-04-25T15:44:15.894605+0000","last_clean":"2024-04-25T15:44:15.894605+0000","last_became_active":"2024-04-25T15:44:14.906259+0000","last_became_peered":"2024-04-25T15:44:14.906259+0000","last_unstale":"2024-04-25T15:44:15.894605+0000","last_undegraded":"2024-04-25T15:44:15.894605+0000","last_fullsized":"2024-04-25T15:44:15.894605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:11.139897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894332+0000","last_change":"2024-04-25T15:44:14.916070+0000","last_active":"2024-04-25T15:44:15.894332+0000","last_peered":"2024-04-25T15:44:15.894332+0000","last_clean":"2024-04-25T15:44:15.894332+0000","last_became_active":"2024-04-25T15:44:14.915798+0000","last_became_peered":"2024-04-25T15:44:14.915798+0000","last_unstale":"2024-04-25T15:44:15.894332+0000","last_undegraded":"2024-04-25T15:44:15.894332+0000","last_fullsized":"2024-04-25T15:44:15.894332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:00.994710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894975+0000","last_change":"2024-04-25T15:44:14.908290+0000","last_active":"2024-04-25T15:44:15.894975+0000","last_peered":"2024-04-25T15:44:15.894975+0000","last_clean":"2024-04-25T15:44:15.894975+0000","last_became_active":"2024-04-25T15:44:14.907558+0000","last_became_peered":"2024-04-25T15:44:14.907558+0000","last_unstale":"2024-04-25T15:44:15.894975+0000","last_undegraded":"2024-04-25T15:44:15.894975+0000","last_fullsized":"2024-04-25T15:44:15.894975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:18.673393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068113+0000","last_change":"2024-04-25T15:44:14.906009+0000","last_active":"2024-04-25T15:44:16.068113+0000","last_peered":"2024-04-25T15:44:16.068113+0000","last_clean":"2024-04-25T15:44:16.068113+0000","last_became_active":"2024-04-25T15:44:14.905634+0000","last_became_peered":"2024-04-25T15:44:14.905634+0000","last_unstale":"2024-04-25T15:44:16.068113+0000","last_undegraded":"2024-04-25T15:44:16.068113+0000","last_fullsized":"2024-04-25T15:44:16.068113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:07.907201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895525+0000","last_change":"2024-04-25T15:44:14.909405+0000","last_active":"2024-04-25T15:44:15.895525+0000","last_peered":"2024-04-25T15:44:15.895525+0000","last_clean":"2024-04-25T15:44:15.895525+0000","last_became_active":"2024-04-25T15:44:14.909124+0000","last_became_peered":"2024-04-25T15:44:14.909124+0000","last_unstale":"2024-04-25T15:44:15.895525+0000","last_undegraded":"2024-04-25T15:44:15.895525+0000","last_fullsized":"2024-04-25T15:44:15.895525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:07.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894787+0000","last_change":"2024-04-25T15:44:13.906044+0000","last_active":"2024-04-25T15:44:15.894787+0000","last_peered":"2024-04-25T15:44:15.894787+0000","last_clean":"2024-04-25T15:44:15.894787+0000","last_became_active":"2024-04-25T15:44:13.905713+0000","last_became_peered":"2024-04-25T15:44:13.905713+0000","last_unstale":"2024-04-25T15:44:15.894787+0000","last_undegraded":"2024-04-25T15:44:15.894787+0000","last_fullsized":"2024-04-25T15:44:15.894787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:59.100465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068439+0000","last_change":"2024-04-25T15:44:14.914589+0000","last_active":"2024-04-25T15:44:16.068439+0000","last_peered":"2024-04-25T15:44:16.068439+0000","last_clean":"2024-04-25T15:44:16.068439+0000","last_became_active":"2024-04-25T15:44:14.914275+0000","last_became_peered":"2024-04-25T15:44:14.914275+0000","last_unstale":"2024-04-25T15:44:16.068439+0000","last_undegraded":"2024-04-25T15:44:16.068439+0000","last_fullsized":"2024-04-25T15:44:16.068439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:39.489336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752382+0000","last_change":"2024-04-25T15:44:13.905893+0000","last_active":"2024-04-25T15:44:16.752382+0000","last_peered":"2024-04-25T15:44:16.752382+0000","last_clean":"2024-04-25T15:44:16.752382+0000","last_became_active":"2024-04-25T15:44:13.905538+0000","last_became_peered":"2024-04-25T15:44:13.905538+0000","last_unstale":"2024-04-25T15:44:16.752382+0000","last_undegraded":"2024-04-25T15:44:16.752382+0000","last_fullsized":"2024-04-25T15:44:16.752382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382455+0000","last_change":"2024-04-25T15:44:14.919283+0000","last_active":"2024-04-25T15:44:16.382455+0000","last_peered":"2024-04-25T15:44:16.382455+0000","last_clean":"2024-04-25T15:44:16.382455+0000","last_became_active":"2024-04-25T15:44:14.917053+0000","last_became_peered":"2024-04-25T15:44:14.917053+0000","last_unstale":"2024-04-25T15:44:16.382455+0000","last_undegraded":"2024-04-25T15:44:16.382455+0000","last_fullsized":"2024-04-25T15:44:16.382455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:48.253000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068480+0000","last_change":"2024-04-25T15:44:13.910226+0000","last_active":"2024-04-25T15:44:16.068480+0000","last_peered":"2024-04-25T15:44:16.068480+0000","last_clean":"2024-04-25T15:44:16.068480+0000","last_became_active":"2024-04-25T15:44:13.909924+0000","last_became_peered":"2024-04-25T15:44:13.909924+0000","last_unstale":"2024-04-25T15:44:16.068480+0000","last_undegraded":"2024-04-25T15:44:16.068480+0000","last_fullsized":"2024-04-25T15:44:16.068480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:26.724253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.957031+0000","last_change":"2024-04-25T15:44:14.921805+0000","last_active":"2024-04-25T15:44:16.957031+0000","last_peered":"2024-04-25T15:44:16.957031+0000","last_clean":"2024-04-25T15:44:16.957031+0000","last_became_active":"2024-04-25T15:44:14.921452+0000","last_became_peered":"2024-04-25T15:44:14.921452+0000","last_unstale":"2024-04-25T15:44:16.957031+0000","last_undegraded":"2024-04-25T15:44:16.957031+0000","last_fullsized":"2024-04-25T15:44:16.957031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:40.213508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382293+0000","last_change":"2024-04-25T15:44:13.905547+0000","last_active":"2024-04-25T15:44:16.382293+0000","last_peered":"2024-04-25T15:44:16.382293+0000","last_clean":"2024-04-25T15:44:16.382293+0000","last_became_active":"2024-04-25T15:44:13.905216+0000","last_became_peered":"2024-04-25T15:44:13.905216+0000","last_unstale":"2024-04-25T15:44:16.382293+0000","last_undegraded":"2024-04-25T15:44:16.382293+0000","last_fullsized":"2024-04-25T15:44:16.382293+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:26.724253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752200+0000","last_change":"2024-04-25T15:44:14.913021+0000","last_active":"2024-04-25T15:44:16.752200+0000","last_peered":"2024-04-25T15:44:16.752200+0000","last_clean":"2024-04-25T15:44:16.752200+0000","last_became_active":"2024-04-25T15:44:14.912721+0000","last_became_peered":"2024-04-25T15:44:14.912721+0000","last_unstale":"2024-04-25T15:44:16.752200+0000","last_undegraded":"2024-04-25T15:44:16.752200+0000","last_fullsized":"2024-04-25T15:44:16.752200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:35.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897518+0000","last_change":"2024-04-25T15:44:13.907728+0000","last_active":"2024-04-25T15:44:16.897518+0000","last_peered":"2024-04-25T15:44:16.897518+0000","last_clean":"2024-04-25T15:44:16.897518+0000","last_became_active":"2024-04-25T15:44:13.907408+0000","last_became_peered":"2024-04-25T15:44:13.907408+0000","last_unstale":"2024-04-25T15:44:16.897518+0000","last_undegraded":"2024-04-25T15:44:16.897518+0000","last_fullsized":"2024-04-25T15:44:16.897518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:43.246322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897861+0000","last_change":"2024-04-25T15:44:14.917654+0000","last_active":"2024-04-25T15:44:16.897861+0000","last_peered":"2024-04-25T15:44:16.897861+0000","last_clean":"2024-04-25T15:44:16.897861+0000","last_became_active":"2024-04-25T15:44:14.915460+0000","last_became_peered":"2024-04-25T15:44:14.915460+0000","last_unstale":"2024-04-25T15:44:16.897861+0000","last_undegraded":"2024-04-25T15:44:16.897861+0000","last_fullsized":"2024-04-25T15:44:16.897861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895177+0000","last_change":"2024-04-25T15:44:13.907741+0000","last_active":"2024-04-25T15:44:15.895177+0000","last_peered":"2024-04-25T15:44:15.895177+0000","last_clean":"2024-04-25T15:44:15.895177+0000","last_became_active":"2024-04-25T15:44:13.907422+0000","last_became_peered":"2024-04-25T15:44:13.907422+0000","last_unstale":"2024-04-25T15:44:15.895177+0000","last_undegraded":"2024-04-25T15:44:15.895177+0000","last_fullsized":"2024-04-25T15:44:15.895177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:11.390028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382361+0000","last_change":"2024-04-25T15:44:14.919463+0000","last_active":"2024-04-25T15:44:16.382361+0000","last_peered":"2024-04-25T15:44:16.382361+0000","last_clean":"2024-04-25T15:44:16.382361+0000","last_became_active":"2024-04-25T15:44:14.918660+0000","last_became_peered":"2024-04-25T15:44:14.918660+0000","last_unstale":"2024-04-25T15:44:16.382361+0000","last_undegraded":"2024-04-25T15:44:16.382361+0000","last_fullsized":"2024-04-25T15:44:16.382361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:38.317339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068084+0000","last_change":"2024-04-25T15:44:13.909660+0000","last_active":"2024-04-25T15:44:16.068084+0000","last_peered":"2024-04-25T15:44:16.068084+0000","last_clean":"2024-04-25T15:44:16.068084+0000","last_became_active":"2024-04-25T15:44:13.909289+0000","last_became_peered":"2024-04-25T15:44:13.909289+0000","last_unstale":"2024-04-25T15:44:16.068084+0000","last_undegraded":"2024-04-25T15:44:16.068084+0000","last_fullsized":"2024-04-25T15:44:16.068084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:15.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956571+0000","last_change":"2024-04-25T15:44:14.913871+0000","last_active":"2024-04-25T15:44:16.956571+0000","last_peered":"2024-04-25T15:44:16.956571+0000","last_clean":"2024-04-25T15:44:16.956571+0000","last_became_active":"2024-04-25T15:44:14.913587+0000","last_became_peered":"2024-04-25T15:44:14.913587+0000","last_unstale":"2024-04-25T15:44:16.956571+0000","last_undegraded":"2024-04-25T15:44:16.956571+0000","last_fullsized":"2024-04-25T15:44:16.956571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:08.209450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.381794+0000","last_change":"2024-04-25T15:44:13.905184+0000","last_active":"2024-04-25T15:44:16.381794+0000","last_peered":"2024-04-25T15:44:16.381794+0000","last_clean":"2024-04-25T15:44:16.381794+0000","last_became_active":"2024-04-25T15:44:13.904852+0000","last_became_peered":"2024-04-25T15:44:13.904852+0000","last_unstale":"2024-04-25T15:44:16.381794+0000","last_undegraded":"2024-04-25T15:44:16.381794+0000","last_fullsized":"2024-04-25T15:44:16.381794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893740+0000","last_change":"2024-04-25T15:44:14.919138+0000","last_active":"2024-04-25T15:44:15.893740+0000","last_peered":"2024-04-25T15:44:15.893740+0000","last_clean":"2024-04-25T15:44:15.893740+0000","last_became_active":"2024-04-25T15:44:14.917524+0000","last_became_peered":"2024-04-25T15:44:14.917524+0000","last_unstale":"2024-04-25T15:44:15.893740+0000","last_undegraded":"2024-04-25T15:44:15.893740+0000","last_fullsized":"2024-04-25T15:44:15.893740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:16.472673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.957084+0000","last_change":"2024-04-25T15:44:13.909591+0000","last_active":"2024-04-25T15:44:16.957084+0000","last_peered":"2024-04-25T15:44:16.957084+0000","last_clean":"2024-04-25T15:44:16.957084+0000","last_became_active":"2024-04-25T15:44:13.908524+0000","last_became_peered":"2024-04-25T15:44:13.908524+0000","last_unstale":"2024-04-25T15:44:16.957084+0000","last_undegraded":"2024-04-25T15:44:16.957084+0000","last_fullsized":"2024-04-25T15:44:16.957084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:37.307489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895786+0000","last_change":"2024-04-25T15:44:14.899050+0000","last_active":"2024-04-25T15:44:15.895786+0000","last_peered":"2024-04-25T15:44:15.895786+0000","last_clean":"2024-04-25T15:44:15.895786+0000","last_became_active":"2024-04-25T15:44:14.898757+0000","last_became_peered":"2024-04-25T15:44:14.898757+0000","last_unstale":"2024-04-25T15:44:15.895786+0000","last_undegraded":"2024-04-25T15:44:15.895786+0000","last_fullsized":"2024-04-25T15:44:15.895786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:03.640679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897896+0000","last_change":"2024-04-25T15:44:13.911645+0000","last_active":"2024-04-25T15:44:16.897896+0000","last_peered":"2024-04-25T15:44:16.897896+0000","last_clean":"2024-04-25T15:44:16.897896+0000","last_became_active":"2024-04-25T15:44:13.911339+0000","last_became_peered":"2024-04-25T15:44:13.911339+0000","last_unstale":"2024-04-25T15:44:16.897896+0000","last_undegraded":"2024-04-25T15:44:16.897896+0000","last_fullsized":"2024-04-25T15:44:16.897896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:52.287895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752510+0000","last_change":"2024-04-25T15:44:14.913329+0000","last_active":"2024-04-25T15:44:16.752510+0000","last_peered":"2024-04-25T15:44:16.752510+0000","last_clean":"2024-04-25T15:44:16.752510+0000","last_became_active":"2024-04-25T15:44:14.913004+0000","last_became_peered":"2024-04-25T15:44:14.913004+0000","last_unstale":"2024-04-25T15:44:16.752510+0000","last_undegraded":"2024-04-25T15:44:16.752510+0000","last_fullsized":"2024-04-25T15:44:16.752510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:39.489336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897888+0000","last_change":"2024-04-25T15:44:13.910756+0000","last_active":"2024-04-25T15:44:16.897888+0000","last_peered":"2024-04-25T15:44:16.897888+0000","last_clean":"2024-04-25T15:44:16.897888+0000","last_became_active":"2024-04-25T15:44:13.910427+0000","last_became_peered":"2024-04-25T15:44:13.910427+0000","last_unstale":"2024-04-25T15:44:16.897888+0000","last_undegraded":"2024-04-25T15:44:16.897888+0000","last_fullsized":"2024-04-25T15:44:16.897888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:15.327679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382365+0000","last_change":"2024-04-25T15:44:14.922844+0000","last_active":"2024-04-25T15:44:16.382365+0000","last_peered":"2024-04-25T15:44:16.382365+0000","last_clean":"2024-04-25T15:44:16.382365+0000","last_became_active":"2024-04-25T15:44:14.922541+0000","last_became_peered":"2024-04-25T15:44:14.922541+0000","last_unstale":"2024-04-25T15:44:16.382365+0000","last_undegraded":"2024-04-25T15:44:16.382365+0000","last_fullsized":"2024-04-25T15:44:16.382365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:39.765601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956766+0000","last_change":"2024-04-25T15:44:13.905855+0000","last_active":"2024-04-25T15:44:16.956766+0000","last_peered":"2024-04-25T15:44:16.956766+0000","last_clean":"2024-04-25T15:44:16.956766+0000","last_became_active":"2024-04-25T15:44:13.905531+0000","last_became_peered":"2024-04-25T15:44:13.905531+0000","last_unstale":"2024-04-25T15:44:16.956766+0000","last_undegraded":"2024-04-25T15:44:16.956766+0000","last_fullsized":"2024-04-25T15:44:16.956766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:47.243151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752211+0000","last_change":"2024-04-25T15:44:14.916812+0000","last_active":"2024-04-25T15:44:16.752211+0000","last_peered":"2024-04-25T15:44:16.752211+0000","last_clean":"2024-04-25T15:44:16.752211+0000","last_became_active":"2024-04-25T15:44:14.915999+0000","last_became_peered":"2024-04-25T15:44:14.915999+0000","last_unstale":"2024-04-25T15:44:16.752211+0000","last_undegraded":"2024-04-25T15:44:16.752211+0000","last_fullsized":"2024-04-25T15:44:16.752211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:29.924673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956866+0000","last_change":"2024-04-25T15:44:13.907599+0000","last_active":"2024-04-25T15:44:16.956866+0000","last_peered":"2024-04-25T15:44:16.956866+0000","last_clean":"2024-04-25T15:44:16.956866+0000","last_became_active":"2024-04-25T15:44:13.907294+0000","last_became_peered":"2024-04-25T15:44:13.907294+0000","last_unstale":"2024-04-25T15:44:16.956866+0000","last_undegraded":"2024-04-25T15:44:16.956866+0000","last_fullsized":"2024-04-25T15:44:16.956866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:38.755752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956547+0000","last_change":"2024-04-25T15:44:14.916914+0000","last_active":"2024-04-25T15:44:16.956547+0000","last_peered":"2024-04-25T15:44:16.956547+0000","last_clean":"2024-04-25T15:44:16.956547+0000","last_became_active":"2024-04-25T15:44:14.916567+0000","last_became_peered":"2024-04-25T15:44:14.916567+0000","last_unstale":"2024-04-25T15:44:16.956547+0000","last_undegraded":"2024-04-25T15:44:16.956547+0000","last_fullsized":"2024-04-25T15:44:16.956547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:53.271448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068099+0000","last_change":"2024-04-25T15:44:13.909667+0000","last_active":"2024-04-25T15:44:16.068099+0000","last_peered":"2024-04-25T15:44:16.068099+0000","last_clean":"2024-04-25T15:44:16.068099+0000","last_became_active":"2024-04-25T15:44:13.909352+0000","last_became_peered":"2024-04-25T15:44:13.909352+0000","last_unstale":"2024-04-25T15:44:16.068099+0000","last_undegraded":"2024-04-25T15:44:16.068099+0000","last_fullsized":"2024-04-25T15:44:16.068099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:59.984860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895339+0000","last_change":"2024-04-25T15:44:14.905962+0000","last_active":"2024-04-25T15:44:15.895339+0000","last_peered":"2024-04-25T15:44:15.895339+0000","last_clean":"2024-04-25T15:44:15.895339+0000","last_became_active":"2024-04-25T15:44:14.905496+0000","last_became_peered":"2024-04-25T15:44:14.905496+0000","last_unstale":"2024-04-25T15:44:15.895339+0000","last_undegraded":"2024-04-25T15:44:15.895339+0000","last_fullsized":"2024-04-25T15:44:15.895339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:04.874124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894103+0000","last_change":"2024-04-25T15:44:13.905465+0000","last_active":"2024-04-25T15:44:15.894103+0000","last_peered":"2024-04-25T15:44:15.894103+0000","last_clean":"2024-04-25T15:44:15.894103+0000","last_became_active":"2024-04-25T15:44:13.904934+0000","last_became_peered":"2024-04-25T15:44:13.904934+0000","last_unstale":"2024-04-25T15:44:15.894103+0000","last_undegraded":"2024-04-25T15:44:15.894103+0000","last_fullsized":"2024-04-25T15:44:15.894103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:08.533417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956748+0000","last_change":"2024-04-25T15:44:14.918137+0000","last_active":"2024-04-25T15:44:16.956748+0000","last_peered":"2024-04-25T15:44:16.956748+0000","last_clean":"2024-04-25T15:44:16.956748+0000","last_became_active":"2024-04-25T15:44:14.917299+0000","last_became_peered":"2024-04-25T15:44:14.917299+0000","last_unstale":"2024-04-25T15:44:16.956748+0000","last_undegraded":"2024-04-25T15:44:16.956748+0000","last_fullsized":"2024-04-25T15:44:16.956748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:55.863555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894408+0000","last_change":"2024-04-25T15:44:13.908615+0000","last_active":"2024-04-25T15:44:15.894408+0000","last_peered":"2024-04-25T15:44:15.894408+0000","last_clean":"2024-04-25T15:44:15.894408+0000","last_became_active":"2024-04-25T15:44:13.908271+0000","last_became_peered":"2024-04-25T15:44:13.908271+0000","last_unstale":"2024-04-25T15:44:15.894408+0000","last_undegraded":"2024-04-25T15:44:15.894408+0000","last_fullsized":"2024-04-25T15:44:15.894408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.130047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956821+0000","last_change":"2024-04-25T15:44:14.919539+0000","last_active":"2024-04-25T15:44:16.956821+0000","last_peered":"2024-04-25T15:44:16.956821+0000","last_clean":"2024-04-25T15:44:16.956821+0000","last_became_active":"2024-04-25T15:44:14.914135+0000","last_became_peered":"2024-04-25T15:44:14.914135+0000","last_unstale":"2024-04-25T15:44:16.956821+0000","last_undegraded":"2024-04-25T15:44:16.956821+0000","last_fullsized":"2024-04-25T15:44:16.956821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:00.796350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897962+0000","last_change":"2024-04-25T15:44:13.910139+0000","last_active":"2024-04-25T15:44:16.897962+0000","last_peered":"2024-04-25T15:44:16.897962+0000","last_clean":"2024-04-25T15:44:16.897962+0000","last_became_active":"2024-04-25T15:44:13.909800+0000","last_became_peered":"2024-04-25T15:44:13.909800+0000","last_unstale":"2024-04-25T15:44:16.897962+0000","last_undegraded":"2024-04-25T15:44:16.897962+0000","last_fullsized":"2024-04-25T15:44:16.897962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:27.265598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897857+0000","last_change":"2024-04-25T15:44:14.918337+0000","last_active":"2024-04-25T15:44:16.897857+0000","last_peered":"2024-04-25T15:44:16.897857+0000","last_clean":"2024-04-25T15:44:16.897857+0000","last_became_active":"2024-04-25T15:44:14.918001+0000","last_became_peered":"2024-04-25T15:44:14.918001+0000","last_unstale":"2024-04-25T15:44:16.897857+0000","last_undegraded":"2024-04-25T15:44:16.897857+0000","last_fullsized":"2024-04-25T15:44:16.897857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:08.209450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382408+0000","last_change":"2024-04-25T15:44:13.909158+0000","last_active":"2024-04-25T15:44:16.382408+0000","last_peered":"2024-04-25T15:44:16.382408+0000","last_clean":"2024-04-25T15:44:16.382408+0000","last_became_active":"2024-04-25T15:44:13.908479+0000","last_became_peered":"2024-04-25T15:44:13.908479+0000","last_unstale":"2024-04-25T15:44:16.382408+0000","last_undegraded":"2024-04-25T15:44:16.382408+0000","last_fullsized":"2024-04-25T15:44:16.382408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:15.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382291+0000","last_change":"2024-04-25T15:44:14.919540+0000","last_active":"2024-04-25T15:44:16.382291+0000","last_peered":"2024-04-25T15:44:16.382291+0000","last_clean":"2024-04-25T15:44:16.382291+0000","last_became_active":"2024-04-25T15:44:14.918973+0000","last_became_peered":"2024-04-25T15:44:14.918973+0000","last_unstale":"2024-04-25T15:44:16.382291+0000","last_undegraded":"2024-04-25T15:44:16.382291+0000","last_fullsized":"2024-04-25T15:44:16.382291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:07.907201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893803+0000","last_change":"2024-04-25T15:44:13.903636+0000","last_active":"2024-04-25T15:44:15.893803+0000","last_peered":"2024-04-25T15:44:15.893803+0000","last_clean":"2024-04-25T15:44:15.893803+0000","last_became_active":"2024-04-25T15:44:13.903324+0000","last_became_peered":"2024-04-25T15:44:13.903324+0000","last_unstale":"2024-04-25T15:44:15.893803+0000","last_undegraded":"2024-04-25T15:44:15.893803+0000","last_fullsized":"2024-04-25T15:44:15.893803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:51.264881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893661+0000","last_change":"2024-04-25T15:44:14.911700+0000","last_active":"2024-04-25T15:44:15.893661+0000","last_peered":"2024-04-25T15:44:15.893661+0000","last_clean":"2024-04-25T15:44:15.893661+0000","last_became_active":"2024-04-25T15:44:14.911378+0000","last_became_peered":"2024-04-25T15:44:14.911378+0000","last_unstale":"2024-04-25T15:44:15.893661+0000","last_undegraded":"2024-04-25T15:44:15.893661+0000","last_fullsized":"2024-04-25T15:44:15.893661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:22.582675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068311+0000","last_change":"2024-04-25T15:44:13.909055+0000","last_active":"2024-04-25T15:44:16.068311+0000","last_peered":"2024-04-25T15:44:16.068311+0000","last_clean":"2024-04-25T15:44:16.068311+0000","last_became_active":"2024-04-25T15:44:13.908746+0000","last_became_peered":"2024-04-25T15:44:13.908746+0000","last_unstale":"2024-04-25T15:44:16.068311+0000","last_undegraded":"2024-04-25T15:44:16.068311+0000","last_fullsized":"2024-04-25T15:44:16.068311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.130047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894647+0000","last_change":"2024-04-25T15:44:14.907499+0000","last_active":"2024-04-25T15:44:15.894647+0000","last_peered":"2024-04-25T15:44:15.894647+0000","last_clean":"2024-04-25T15:44:15.894647+0000","last_became_active":"2024-04-25T15:44:14.907132+0000","last_became_peered":"2024-04-25T15:44:14.907132+0000","last_unstale":"2024-04-25T15:44:15.894647+0000","last_undegraded":"2024-04-25T15:44:15.894647+0000","last_fullsized":"2024-04-25T15:44:15.894647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:41.985916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893585+0000","last_change":"2024-04-25T15:44:13.907027+0000","last_active":"2024-04-25T15:44:15.893585+0000","last_peered":"2024-04-25T15:44:15.893585+0000","last_clean":"2024-04-25T15:44:15.893585+0000","last_became_active":"2024-04-25T15:44:13.906711+0000","last_became_peered":"2024-04-25T15:44:13.906711+0000","last_unstale":"2024-04-25T15:44:15.893585+0000","last_undegraded":"2024-04-25T15:44:15.893585+0000","last_fullsized":"2024-04-25T15:44:15.893585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:15.367316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752285+0000","last_change":"2024-04-25T15:44:14.911721+0000","last_active":"2024-04-25T15:44:16.752285+0000","last_peered":"2024-04-25T15:44:16.752285+0000","last_clean":"2024-04-25T15:44:16.752285+0000","last_became_active":"2024-04-25T15:44:14.911287+0000","last_became_peered":"2024-04-25T15:44:14.911287+0000","last_unstale":"2024-04-25T15:44:16.752285+0000","last_undegraded":"2024-04-25T15:44:16.752285+0000","last_fullsized":"2024-04-25T15:44:16.752285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:07.907201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893491+0000","last_change":"2024-04-25T15:44:13.905601+0000","last_active":"2024-04-25T15:44:15.893491+0000","last_peered":"2024-04-25T15:44:15.893491+0000","last_clean":"2024-04-25T15:44:15.893491+0000","last_became_active":"2024-04-25T15:44:13.905302+0000","last_became_peered":"2024-04-25T15:44:13.905302+0000","last_unstale":"2024-04-25T15:44:15.893491+0000","last_undegraded":"2024-04-25T15:44:15.893491+0000","last_fullsized":"2024-04-25T15:44:15.893491+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:13.304726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897511+0000","last_change":"2024-04-25T15:44:14.914881+0000","last_active":"2024-04-25T15:44:16.897511+0000","last_peered":"2024-04-25T15:44:16.897511+0000","last_clean":"2024-04-25T15:44:16.897511+0000","last_became_active":"2024-04-25T15:44:14.913413+0000","last_became_peered":"2024-04-25T15:44:14.913413+0000","last_unstale":"2024-04-25T15:44:16.897511+0000","last_undegraded":"2024-04-25T15:44:16.897511+0000","last_fullsized":"2024-04-25T15:44:16.897511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:44.147439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895101+0000","last_change":"2024-04-25T15:44:13.903844+0000","last_active":"2024-04-25T15:44:15.895101+0000","last_peered":"2024-04-25T15:44:15.895101+0000","last_clean":"2024-04-25T15:44:15.895101+0000","last_became_active":"2024-04-25T15:44:13.902912+0000","last_became_peered":"2024-04-25T15:44:13.902912+0000","last_unstale":"2024-04-25T15:44:15.895101+0000","last_undegraded":"2024-04-25T15:44:15.895101+0000","last_fullsized":"2024-04-25T15:44:15.895101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:52.287895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956679+0000","last_change":"2024-04-25T15:44:14.915003+0000","last_active":"2024-04-25T15:44:16.956679+0000","last_peered":"2024-04-25T15:44:16.956679+0000","last_clean":"2024-04-25T15:44:16.956679+0000","last_became_active":"2024-04-25T15:44:14.913608+0000","last_became_peered":"2024-04-25T15:44:14.913608+0000","last_unstale":"2024-04-25T15:44:16.956679+0000","last_undegraded":"2024-04-25T15:44:16.956679+0000","last_fullsized":"2024-04-25T15:44:16.956679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:13.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893420+0000","last_change":"2024-04-25T15:44:13.906914+0000","last_active":"2024-04-25T15:44:15.893420+0000","last_peered":"2024-04-25T15:44:15.893420+0000","last_clean":"2024-04-25T15:44:15.893420+0000","last_became_active":"2024-04-25T15:44:13.906620+0000","last_became_peered":"2024-04-25T15:44:13.906620+0000","last_unstale":"2024-04-25T15:44:15.893420+0000","last_undegraded":"2024-04-25T15:44:15.893420+0000","last_fullsized":"2024-04-25T15:44:15.893420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:14.042733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068279+0000","last_change":"2024-04-25T15:44:14.918005+0000","last_active":"2024-04-25T15:44:16.068279+0000","last_peered":"2024-04-25T15:44:16.068279+0000","last_clean":"2024-04-25T15:44:16.068279+0000","last_became_active":"2024-04-25T15:44:14.916869+0000","last_became_peered":"2024-04-25T15:44:14.916869+0000","last_unstale":"2024-04-25T15:44:16.068279+0000","last_undegraded":"2024-04-25T15:44:16.068279+0000","last_fullsized":"2024-04-25T15:44:16.068279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:39.765601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.898053+0000","last_change":"2024-04-25T15:44:13.911091+0000","last_active":"2024-04-25T15:44:16.898053+0000","last_peered":"2024-04-25T15:44:16.898053+0000","last_clean":"2024-04-25T15:44:16.898053+0000","last_became_active":"2024-04-25T15:44:13.910731+0000","last_became_peered":"2024-04-25T15:44:13.910731+0000","last_unstale":"2024-04-25T15:44:16.898053+0000","last_undegraded":"2024-04-25T15:44:16.898053+0000","last_fullsized":"2024-04-25T15:44:16.898053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.068667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895766+0000","last_change":"2024-04-25T15:44:14.897805+0000","last_active":"2024-04-25T15:44:15.895766+0000","last_peered":"2024-04-25T15:44:15.895766+0000","last_clean":"2024-04-25T15:44:15.895766+0000","last_became_active":"2024-04-25T15:44:14.897443+0000","last_became_peered":"2024-04-25T15:44:14.897443+0000","last_unstale":"2024-04-25T15:44:15.895766+0000","last_undegraded":"2024-04-25T15:44:15.895766+0000","last_fullsized":"2024-04-25T15:44:15.895766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:51.103852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.893684+0000","last_change":"2024-04-25T15:44:13.904946+0000","last_active":"2024-04-25T15:44:15.893684+0000","last_peered":"2024-04-25T15:44:15.893684+0000","last_clean":"2024-04-25T15:44:15.893684+0000","last_became_active":"2024-04-25T15:44:13.904600+0000","last_became_peered":"2024-04-25T15:44:13.904600+0000","last_unstale":"2024-04-25T15:44:15.893684+0000","last_undegraded":"2024-04-25T15:44:15.893684+0000","last_fullsized":"2024-04-25T15:44:15.893684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:51.344498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956931+0000","last_change":"2024-04-25T15:44:14.922554+0000","last_active":"2024-04-25T15:44:16.956931+0000","last_peered":"2024-04-25T15:44:16.956931+0000","last_clean":"2024-04-25T15:44:16.956931+0000","last_became_active":"2024-04-25T15:44:14.922231+0000","last_became_peered":"2024-04-25T15:44:14.922231+0000","last_unstale":"2024-04-25T15:44:16.956931+0000","last_undegraded":"2024-04-25T15:44:16.956931+0000","last_fullsized":"2024-04-25T15:44:16.956931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:53.122906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752385+0000","last_change":"2024-04-25T15:44:13.910412+0000","last_active":"2024-04-25T15:44:16.752385+0000","last_peered":"2024-04-25T15:44:16.752385+0000","last_clean":"2024-04-25T15:44:16.752385+0000","last_became_active":"2024-04-25T15:44:13.910110+0000","last_became_peered":"2024-04-25T15:44:13.910110+0000","last_unstale":"2024-04-25T15:44:16.752385+0000","last_undegraded":"2024-04-25T15:44:16.752385+0000","last_fullsized":"2024-04-25T15:44:16.752385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:14.089647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752455+0000","last_change":"2024-04-25T15:44:14.917682+0000","last_active":"2024-04-25T15:44:16.752455+0000","last_peered":"2024-04-25T15:44:16.752455+0000","last_clean":"2024-04-25T15:44:16.752455+0000","last_became_active":"2024-04-25T15:44:14.917391+0000","last_became_peered":"2024-04-25T15:44:14.917391+0000","last_unstale":"2024-04-25T15:44:16.752455+0000","last_undegraded":"2024-04-25T15:44:16.752455+0000","last_fullsized":"2024-04-25T15:44:16.752455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:48.253000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.752421+0000","last_change":"2024-04-25T15:44:13.906655+0000","last_active":"2024-04-25T15:44:16.752421+0000","last_peered":"2024-04-25T15:44:16.752421+0000","last_clean":"2024-04-25T15:44:16.752421+0000","last_became_active":"2024-04-25T15:44:13.906266+0000","last_became_peered":"2024-04-25T15:44:13.906266+0000","last_unstale":"2024-04-25T15:44:16.752421+0000","last_undegraded":"2024-04-25T15:44:16.752421+0000","last_fullsized":"2024-04-25T15:44:16.752421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:15.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.068106+0000","last_change":"2024-04-25T15:44:14.907205+0000","last_active":"2024-04-25T15:44:16.068106+0000","last_peered":"2024-04-25T15:44:16.068106+0000","last_clean":"2024-04-25T15:44:16.068106+0000","last_became_active":"2024-04-25T15:44:14.906898+0000","last_became_peered":"2024-04-25T15:44:14.906898+0000","last_unstale":"2024-04-25T15:44:16.068106+0000","last_undegraded":"2024-04-25T15:44:16.068106+0000","last_fullsized":"2024-04-25T15:44:16.068106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:38.317339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894640+0000","last_change":"2024-04-25T15:44:13.907835+0000","last_active":"2024-04-25T15:44:15.894640+0000","last_peered":"2024-04-25T15:44:15.894640+0000","last_clean":"2024-04-25T15:44:15.894640+0000","last_became_active":"2024-04-25T15:44:13.907521+0000","last_became_peered":"2024-04-25T15:44:13.907521+0000","last_unstale":"2024-04-25T15:44:15.894640+0000","last_undegraded":"2024-04-25T15:44:15.894640+0000","last_fullsized":"2024-04-25T15:44:15.894640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.344763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.382030+0000","last_change":"2024-04-25T15:44:14.919719+0000","last_active":"2024-04-25T15:44:16.382030+0000","last_peered":"2024-04-25T15:44:16.382030+0000","last_clean":"2024-04-25T15:44:16.382030+0000","last_became_active":"2024-04-25T15:44:14.918684+0000","last_became_peered":"2024-04-25T15:44:14.918684+0000","last_unstale":"2024-04-25T15:44:16.382030+0000","last_undegraded":"2024-04-25T15:44:16.382030+0000","last_fullsized":"2024-04-25T15:44:16.382030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:29.924673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.381820+0000","last_change":"2024-04-25T15:44:13.906383+0000","last_active":"2024-04-25T15:44:16.381820+0000","last_peered":"2024-04-25T15:44:16.381820+0000","last_clean":"2024-04-25T15:44:16.381820+0000","last_became_active":"2024-04-25T15:44:13.905832+0000","last_became_peered":"2024-04-25T15:44:13.905832+0000","last_unstale":"2024-04-25T15:44:16.381820+0000","last_undegraded":"2024-04-25T15:44:16.381820+0000","last_fullsized":"2024-04-25T15:44:16.381820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:21.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895576+0000","last_change":"2024-04-25T15:44:14.897819+0000","last_active":"2024-04-25T15:44:15.895576+0000","last_peered":"2024-04-25T15:44:15.895576+0000","last_clean":"2024-04-25T15:44:15.895576+0000","last_became_active":"2024-04-25T15:44:14.897410+0000","last_became_peered":"2024-04-25T15:44:14.897410+0000","last_unstale":"2024-04-25T15:44:15.895576+0000","last_undegraded":"2024-04-25T15:44:15.895576+0000","last_fullsized":"2024-04-25T15:44:15.895576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:44.147439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.956475+0000","last_change":"2024-04-25T15:44:13.909615+0000","last_active":"2024-04-25T15:44:16.956475+0000","last_peered":"2024-04-25T15:44:16.956475+0000","last_clean":"2024-04-25T15:44:16.956475+0000","last_became_active":"2024-04-25T15:44:13.909300+0000","last_became_peered":"2024-04-25T15:44:13.909300+0000","last_unstale":"2024-04-25T15:44:16.956475+0000","last_undegraded":"2024-04-25T15:44:16.956475+0000","last_fullsized":"2024-04-25T15:44:16.956475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:06.897352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:16.897963+0000","last_change":"2024-04-25T15:44:14.919149+0000","last_active":"2024-04-25T15:44:16.897963+0000","last_peered":"2024-04-25T15:44:16.897963+0000","last_clean":"2024-04-25T15:44:16.897963+0000","last_became_active":"2024-04-25T15:44:14.918845+0000","last_became_peered":"2024-04-25T15:44:14.918845+0000","last_unstale":"2024-04-25T15:44:16.897963+0000","last_undegraded":"2024-04-25T15:44:16.897963+0000","last_fullsized":"2024-04-25T15:44:16.897963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:13.880566+0000","last_clean_scrub_stamp":"2024-04-25T15:44:13.880566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:55.863555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.895618+0000","last_change":"2024-04-25T15:44:13.906381+0000","last_active":"2024-04-25T15:44:15.895618+0000","last_peered":"2024-04-25T15:44:15.895618+0000","last_clean":"2024-04-25T15:44:15.895618+0000","last_became_active":"2024-04-25T15:44:13.906021+0000","last_became_peered":"2024-04-25T15:44:13.906021+0000","last_unstale":"2024-04-25T15:44:15.895618+0000","last_undegraded":"2024-04-25T15:44:15.895618+0000","last_fullsized":"2024-04-25T15:44:15.895618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:12.870716+0000","last_clean_scrub_stamp":"2024-04-25T15:44:12.870716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:43.246322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":146,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T15:44:15.894712+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:15.894712+0000","last_peered":"2024-04-25T15:44:15.894712+0000","last_clean":"2024-04-25T15:44:15.894712+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:15.894712+0000","last_undegraded":"2024-04-25T15:44:15.894712+0000","last_fullsized":"2024-04-25T15:44:15.894712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":193881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":194945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1044480,"data_stored":783701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":785349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":193411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":193903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:22.678 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:44:22.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T15:44:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.828+0000 7f52fd5ee640 1 Processor -- start 2024-04-25T15:44:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.828+0000 7f52fd5ee640 1 -- start start 2024-04-25T15:44:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.829+0000 7f52fd5ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52f80d41b0 0x7f52f80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.829+0000 7f52fd5ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f81602a0 0x7f52f80b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.829+0000 7f52fd5ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f80b7fa0 con 0x7f52f80b7b90 2024-04-25T15:44:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.829+0000 7f52fd5ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f52f80d59d0 con 0x7f52f80d41b0 2024-04-25T15:44:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.829+0000 7f52fd5ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f52f8163fb0 con 0x7f52f81602a0 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f6ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52f80d41b0 0x7f52f80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f67fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f81602a0 0x7f52f80b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f77fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f52f80b7b90 0x7f52f80d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:37688/0 (socket says 172.21.15.80:37688) 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f6ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52f80d41b0 0x7f52f80b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:43134/0 (socket says 172.21.15.80:43134) 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f77fe640 1 -- 172.21.15.80:0/2661899460 learned_addr learned my addr 172.21.15.80:0/2661899460 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f6ffd640 1 -- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f81602a0 msgr2=0x7f52f80b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f6ffd640 1 --2- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f81602a0 0x7f52f80b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f6ffd640 1 -- 172.21.15.80:0/2661899460 >> v1:172.21.15.195:6789/0 conn(0x7f52f80b7b90 legacy=0x7f52f80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f6ffd640 1 -- 172.21.15.80:0/2661899460 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f8164270 con 0x7f52f80d41b0 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f5ffb640 1 -- 172.21.15.80:0/2661899460 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654933340 0 0) 0x7f52f0001490 con 0x7f52f80b7b90 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.830+0000 7f52f67fc640 1 --2- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f81602a0 0x7f52f80b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.831+0000 7f52f6ffd640 1 --2- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80d41b0 0x7f52f80b48d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097a0 tx=0x7f52e802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ed1f5ee198becc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.831+0000 7f52f5ffb640 1 -- 172.21.15.80:0/2661899460 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8037070 con 0x7f52f80d41b0 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.831+0000 7f52f5ffb640 1 -- 172.21.15.80:0/2661899460 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e8032440 con 0x7f52f80d41b0 2024-04-25T15:44:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.831+0000 7f52f5ffb640 1 -- 172.21.15.80:0/2661899460 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8032810 con 0x7f52f80d41b0 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 -- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80d41b0 msgr2=0x7f52f80b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80d41b0 0x7f52f80b48d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097a0 tx=0x7f52e802a180 comp rx=0 tx=0).stop 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 -- 172.21.15.80:0/2661899460 shutdown_connections 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f81602a0 0x7f52f80b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/2661899460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80d41b0 0x7f52f80b48d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 -- 172.21.15.80:0/2661899460 >> 172.21.15.80:0/2661899460 conn(0x7f52f806e9f0 msgr2=0x7f52f80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 -- 172.21.15.80:0/2661899460 shutdown_connections 2024-04-25T15:44:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.832+0000 7f52fd5ee640 1 -- 172.21.15.80:0/2661899460 wait complete. 2024-04-25T15:44:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.834+0000 7f52fd5ee640 1 Processor -- start 2024-04-25T15:44:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.834+0000 7f52fd5ee640 1 -- start start 2024-04-25T15:44:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52fd5ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80b7b90 0x7f52f81fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52fd5ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f80d41b0 0x7f52f81548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52fd5ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 0x7f52f8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52fd5ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8164b10 con 0x7f52f81602a0 2024-04-25T15:44:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52fd5ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8164830 con 0x7f52f80b7b90 2024-04-25T15:44:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52fd5ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f52f80b4fd0 con 0x7f52f80d41b0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52f77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 0x7f52f8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52f77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 0x7f52f8155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41398/0 (socket says 172.21.15.80:41398) 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52f77fe640 1 -- 172.21.15.80:0/3959475354 learned_addr learned my addr 172.21.15.80:0/3959475354 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52f6ffd640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80b7b90 0x7f52f81fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.835+0000 7f52f67fc640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f80d41b0 0x7f52f81548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52f77fe640 1 -- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f80d41b0 msgr2=0x7f52f81548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52f77fe640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f80d41b0 0x7f52f81548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52f77fe640 1 -- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80b7b90 msgr2=0x7f52f81fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52f77fe640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80b7b90 0x7f52f81fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52f77fe640 1 -- 172.21.15.80:0/3959475354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f8162440 con 0x7f52f81602a0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52f77fe640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 0x7f52f8155bd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c700 tx=0x7f52f000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0018070 con 0x7f52f81602a0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f000ce10 con 0x7f52f81602a0 2024-04-25T15:44:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f81fae00 con 0x7f52f81602a0 2024-04-25T15:44:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f000a820 con 0x7f52f81602a0 2024-04-25T15:44:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.836+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f81fb3c0 con 0x7f52f81602a0 2024-04-25T15:44:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.837+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f81fab50 con 0x7f52f81602a0 2024-04-25T15:44:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.838+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f52f001b070 con 0x7f52f81602a0 2024-04-25T15:44:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.838+0000 7f52df7fe640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52e40744b0 0x7f52e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.838+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f52f00947a0 con 0x7f52f81602a0 2024-04-25T15:44:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.838+0000 7f52f6ffd640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52e40744b0 0x7f52e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.839+0000 7f52f6ffd640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52e40744b0 0x7f52e40769c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f52e8034000 tx=0x7f52e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:22.843+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52f80b7fa0 con 0x7f52f81602a0 2024-04-25T15:44:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.094+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f52f806a100 con 0x7f52f81602a0 2024-04-25T15:44:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.097+0000 7f52df7fe640 1 -- 172.21.15.80:0/3959475354 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f52f005eec0 con 0x7f52f81602a0 2024-04-25T15:44:23.097 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:44:23.097 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:44:23.097 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-25T15:44:23.097 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-25T15:44:23.097 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T15:44:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-25T15:44:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52e40744b0 msgr2=0x7f52e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52e40744b0 0x7f52e40769c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f52e8034000 tx=0x7f52e802e000 comp rx=0 tx=0).stop 2024-04-25T15:44:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 msgr2=0x7f52f8155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 0x7f52f8155bd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c700 tx=0x7f52f000cbc0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 shutdown_connections 2024-04-25T15:44:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f52e40744b0 0x7f52e40769c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52f81602a0 0x7f52f8155bd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52f80d41b0 0x7f52f81548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 --2- 172.21.15.80:0/3959475354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f80b7b90 0x7f52f81fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 >> 172.21.15.80:0/3959475354 conn(0x7f52f806e9f0 msgr2=0x7f52f80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:23.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 shutdown_connections 2024-04-25T15:44:23.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.100+0000 7f52fd5ee640 1 -- 172.21.15.80:0/3959475354 wait complete. 2024-04-25T15:44:23.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.218+0000 7f92dd5ba640 1 Processor -- start 2024-04-25T15:44:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.218+0000 7f92dd5ba640 1 -- start start 2024-04-25T15:44:23.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92dd5ba640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92d80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92dd5ba640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d8163fb0 con 0x7f92d81602a0 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92dd5ba640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d8164270 con 0x7f92d80b7d60 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92dd5ba640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f92d8164550 con 0x7f92d80d41b0 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d67fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f92d81602a0 0x7f92d80b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51146/0 (socket says 172.21.15.80:51146) 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d67fc640 1 -- 172.21.15.80:0/2089802886 learned_addr learned my addr 172.21.15.80:0/2089802886 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d6ffd640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92d80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405956721 0 0) 0x7f92d8163fb0 con 0x7f92d81602a0 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c0003520 con 0x7f92d81602a0 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3255811637 0 0) 0x7f92c0003520 con 0x7f92d81602a0 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 msgr2=0x7f92d80b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92d80b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 >> v1:172.21.15.195:6789/0 conn(0x7f92d80b7d60 legacy=0x7f92d80d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d8164830 con 0x7f92d81602a0 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f92cc001670 con 0x7f92d81602a0 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 >> v1:172.21.15.80:6789/0 conn(0x7f92d81602a0 legacy=0x7f92d80b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92c00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92c0003f40 0x7f92c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0004d40 0x7f92c0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92d8164550 con 0x7f92c0003f40 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f92c000bad0 con 0x7f92c0004d40 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f92c000bcd0 con 0x7f92d80d41b0 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.220+0000 7f92d67fc640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92c0003f40 0x7f92c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d6ffd640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92c00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d77fe640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0004d40 0x7f92c0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d67fc640 1 -- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 msgr2=0x7f92c00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d67fc640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92c00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d67fc640 1 -- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0004d40 msgr2=0x7f92c0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d67fc640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0004d40 0x7f92c0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d67fc640 1 -- 172.21.15.80:0/2089802886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c0003520 con 0x7f92c0003f40 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d77fe640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0004d40 0x7f92c0005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d6ffd640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80d41b0 0x7f92c00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.221+0000 7f92d67fc640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92c0003f40 0x7f92c0004800 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c240 tx=0x7f92c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e972d873400e74b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc007d30 con 0x7f92c0003f40 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc005af0 con 0x7f92c0003f40 2024-04-25T15:44:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92d5ffb640 1 -- 172.21.15.80:0/2089802886 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc007070 con 0x7f92c0003f40 2024-04-25T15:44:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92dd5ba640 1 -- 172.21.15.80:0/2089802886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92c0003f40 msgr2=0x7f92c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/2089802886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92c0003f40 0x7f92c0004800 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c240 tx=0x7f92c0005830 comp rx=0 tx=0).stop 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92d77fe640 1 -- 172.21.15.80:0/2089802886 reap_dead start 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92dd5ba640 1 -- 172.21.15.80:0/2089802886 shutdown_connections 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92dd5ba640 1 -- 172.21.15.80:0/2089802886 >> 172.21.15.80:0/2089802886 conn(0x7f92d806e9f0 msgr2=0x7f92d80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92dd5ba640 1 -- 172.21.15.80:0/2089802886 shutdown_connections 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.222+0000 7f92dd5ba640 1 -- 172.21.15.80:0/2089802886 wait complete. 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.224+0000 7f92dd5ba640 1 Processor -- start 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.224+0000 7f92dd5ba640 1 -- start start 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.225+0000 7f92dd5ba640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0003f40 0x7f92d80d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.225+0000 7f92dd5ba640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80ccc60 0x7f92d80ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.225+0000 7f92dd5ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 0x7f92d80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.225+0000 7f92dd5ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80b5150 con 0x7f92d80cd070 2024-04-25T15:44:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.225+0000 7f92dd5ba640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80b4fd0 con 0x7f92c0003f40 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.225+0000 7f92dd5ba640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f92d80b9220 con 0x7f92d80ccc60 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 0x7f92d80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 0x7f92d80ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41422/0 (socket says 172.21.15.80:41422) 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 -- 172.21.15.80:0/3722285658 learned_addr learned my addr 172.21.15.80:0/3722285658 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d6ffd640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0003f40 0x7f92d80d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d67fc640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80ccc60 0x7f92d80ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 -- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80ccc60 msgr2=0x7f92d80ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80ccc60 0x7f92d80ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 -- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0003f40 msgr2=0x7f92d80d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0003f40 0x7f92d80d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 -- 172.21.15.80:0/3722285658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d81f5fc0 con 0x7f92d80cd070 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92d77fe640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 0x7f92d80ace80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92d80ccc30 tx=0x7f92d000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0019070 con 0x7f92d80cd070 2024-04-25T15:44:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d00052e0 con 0x7f92d80cd070 2024-04-25T15:44:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d80cd840 con 0x7f92d80cd070 2024-04-25T15:44:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0003850 con 0x7f92d80cd070 2024-04-25T15:44:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.226+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d80cde00 con 0x7f92d80cd070 2024-04-25T15:44:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.227+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d80cd5b0 con 0x7f92d80cd070 2024-04-25T15:44:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.228+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f92d001c070 con 0x7f92d80cd070 2024-04-25T15:44:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.228+0000 7f92bf7fe640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92c40744b0 0x7f92c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.229+0000 7f92d6ffd640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92c40744b0 0x7f92c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.229+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f92d0094960 con 0x7f92d80cd070 2024-04-25T15:44:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.229+0000 7f92d6ffd640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92c40744b0 0x7f92c40769c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007520 tx=0x7f92c800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.233+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92d81f5fc0 con 0x7f92d80cd070 2024-04-25T15:44:23.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.444+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92d806a100 con 0x7f92d80cd070 2024-04-25T15:44:23.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.445+0000 7f92bf7fe640 1 -- 172.21.15.80:0/3722285658 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f92d005ef60 con 0x7f92d80cd070 2024-04-25T15:44:23.445 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:23.445 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:23.445 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92c40744b0 msgr2=0x7f92c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92c40744b0 0x7f92c40769c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007520 tx=0x7f92c800b040 comp rx=0 tx=0).stop 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 msgr2=0x7f92d80ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 0x7f92d80ace80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92d80ccc30 tx=0x7f92d000e890 comp rx=0 tx=0).stop 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 shutdown_connections 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f92c40744b0 0x7f92c40769c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92d80cd070 0x7f92d80ace80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92d80ccc60 0x7f92d80ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 --2- 172.21.15.80:0/3722285658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92c0003f40 0x7f92d80d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 >> 172.21.15.80:0/3722285658 conn(0x7f92d806e9f0 msgr2=0x7f92d80c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 shutdown_connections 2024-04-25T15:44:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.447+0000 7f92dd5ba640 1 -- 172.21.15.80:0/3722285658 wait complete. 2024-04-25T15:44:23.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:44:14.259011+0000', 'modified': '2024-04-25T15:44:16.265577+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5373}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5373': {'gid': 5373, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/3809895897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 3809895897}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 3809895897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5373, 'qdb_cluster': [5373]} 2024-04-25T15:44:23.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:44:23.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:44:23.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.971+0000 7fd165385640 1 Processor -- start 2024-04-25T15:44:23.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.971+0000 7fd165385640 1 -- start start 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd165385640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1600d41b0 0x7fd1600b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd165385640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1600b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd165385640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1600b7fa0 con 0x7fd1600b7b90 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd165385640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd1600d59d0 con 0x7fd1600d41b0 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd165385640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd160163fb0 con 0x7fd1601602a0 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1600b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1600d41b0 0x7fd1600b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1600b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:54008/0 (socket says 172.21.15.80:54008) 2024-04-25T15:44:23.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15e7fc640 1 -- 172.21.15.80:0/1312200204 learned_addr learned my addr 172.21.15.80:0/1312200204 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15effd640 1 -- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 msgr2=0x7fd1600b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15effd640 1 --2- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1600b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.973+0000 7fd15effd640 1 -- 172.21.15.80:0/1312200204 >> v1:172.21.15.195:6789/0 conn(0x7fd1600b7b90 legacy=0x7fd1600d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.974+0000 7fd15dffb640 1 -- 172.21.15.80:0/1312200204 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031245322 0 0) 0x7fd158001110 con 0x7fd1600b7b90 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.974+0000 7fd15effd640 1 -- 172.21.15.80:0/1312200204 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd160164270 con 0x7fd1600d41b0 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.974+0000 7fd15effd640 1 --2- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600d41b0 0x7fd1600b48d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd150009d90 tx=0x7fd15002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557992bdeb3d0332 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.974+0000 7fd15dffb640 1 -- 172.21.15.80:0/1312200204 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150007740 con 0x7fd1600d41b0 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.974+0000 7fd15dffb640 1 -- 172.21.15.80:0/1312200204 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1500078e0 con 0x7fd1600d41b0 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.974+0000 7fd15dffb640 1 -- 172.21.15.80:0/1312200204 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150007cb0 con 0x7fd1600d41b0 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 -- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600d41b0 msgr2=0x7fd1600b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 --2- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600d41b0 0x7fd1600b48d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd150009d90 tx=0x7fd15002a660 comp rx=0 tx=0).stop 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 -- 172.21.15.80:0/1312200204 shutdown_connections 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 --2- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1600b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 --2- 172.21.15.80:0/1312200204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600d41b0 0x7fd1600b48d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 -- 172.21.15.80:0/1312200204 >> 172.21.15.80:0/1312200204 conn(0x7fd16006e9f0 msgr2=0x7fd1600d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 -- 172.21.15.80:0/1312200204 shutdown_connections 2024-04-25T15:44:23.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.975+0000 7fd165385640 1 -- 172.21.15.80:0/1312200204 wait complete. 2024-04-25T15:44:23.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.977+0000 7fd165385640 1 Processor -- start 2024-04-25T15:44:23.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.977+0000 7fd165385640 1 -- start start 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.978+0000 7fd165385640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600b7b90 0x7fd1601452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.978+0000 7fd165385640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 0x7fd160153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.978+0000 7fd165385640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1601eb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.978+0000 7fd165385640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd160164b10 con 0x7fd1600d41b0 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.978+0000 7fd165385640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd160164830 con 0x7fd1600b7b90 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.978+0000 7fd165385640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd1600b4fd0 con 0x7fd1601602a0 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 0x7fd160153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 0x7fd160153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41426/0 (socket says 172.21.15.80:41426) 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 -- 172.21.15.80:0/894636716 learned_addr learned my addr 172.21.15.80:0/894636716 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15f7fe640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1601eb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15effd640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600b7b90 0x7fd1601452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 -- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 msgr2=0x7fd1601eb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1601eb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 -- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600b7b90 msgr2=0x7fd1601452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600b7b90 0x7fd1601452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 -- 172.21.15.80:0/894636716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd160145820 con 0x7fd1600d41b0 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15effd640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600b7b90 0x7fd1601452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 0x7fd160153490 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e870 tx=0x7fd15400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd1477fe640 1 -- 172.21.15.80:0/894636716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154017070 con 0x7fd1600d41b0 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd1477fe640 1 -- 172.21.15.80:0/894636716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15400c8e0 con 0x7fd1600d41b0 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1601f77c0 con 0x7fd1600d41b0 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd1477fe640 1 -- 172.21.15.80:0/894636716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400ccd0 con 0x7fd1600d41b0 2024-04-25T15:44:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.979+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1601f8170 con 0x7fd1600d41b0 2024-04-25T15:44:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.981+0000 7fd1477fe640 1 -- 172.21.15.80:0/894636716 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd15401a070 con 0x7fd1600d41b0 2024-04-25T15:44:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.982+0000 7fd1477fe640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd14c0744b0 0x7fd14c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.982+0000 7fd1477fe640 1 -- 172.21.15.80:0/894636716 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd1540951f0 con 0x7fd1600d41b0 2024-04-25T15:44:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.982+0000 7fd15effd640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd14c0744b0 0x7fd14c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.982+0000 7fd15effd640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd14c0744b0 0x7fd14c0769c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd150034000 tx=0x7fd150033040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.983+0000 7fd16c230740 1 Processor -- start 2024-04-25T15:44:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.983+0000 7fd16c230740 1 -- start start 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 0x558ac5560600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd16c230740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac555cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac5536260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd16c230740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558ac549a740 con 0x558ac516b3b0 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x558ac54363a0 con 0x558ac5173590 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x558ac5496700 con 0x558ac5194270 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac555cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac555cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41440/0 (socket says 172.21.15.80:41440) 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 -- 172.21.15.80:0/2967531797 learned_addr learned my addr 172.21.15.80:0/2967531797 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 -- 172.21.15.80:0/2967531797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 msgr2=0x558ac5560600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 0x558ac5560600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 -- 172.21.15.80:0/2967531797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 msgr2=0x558ac5536260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac5536260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.984+0000 7fd15e7fc640 1 -- 172.21.15.80:0/2967531797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac5452750 con 0x558ac516b3b0 2024-04-25T15:44:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.985+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac555cfa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd1540093a0 tx=0x7fd15405f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d71695c6bb526de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.985+0000 7fd144ff9640 1 -- 172.21.15.80:0/2967531797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154021040 con 0x558ac516b3b0 2024-04-25T15:44:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.985+0000 7fd144ff9640 1 -- 172.21.15.80:0/2967531797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15405f2d0 con 0x558ac516b3b0 2024-04-25T15:44:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.985+0000 7fd144ff9640 1 -- 172.21.15.80:0/2967531797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15405e770 con 0x558ac516b3b0 2024-04-25T15:44:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 -- 172.21.15.80:0/2967531797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 msgr2=0x558ac555cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac555cfa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd1540093a0 tx=0x7fd15405f1d0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 -- 172.21.15.80:0/2967531797 shutdown_connections 2024-04-25T15:44:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac5536260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac555cfa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 --2- 172.21.15.80:0/2967531797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 0x558ac5560600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 -- 172.21.15.80:0/2967531797 >> 172.21.15.80:0/2967531797 conn(0x558ac51883c0 msgr2=0x558ac55359f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 -- 172.21.15.80:0/2967531797 shutdown_connections 2024-04-25T15:44:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.986+0000 7fd16c230740 1 -- 172.21.15.80:0/2967531797 wait complete. 2024-04-25T15:44:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.987+0000 7fd16c230740 1 -- start start 2024-04-25T15:44:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.987+0000 7fd16c230740 1 Processor -- start 2024-04-25T15:44:23.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac5561fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac555c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 0x558ac557b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558ac5421fe0 con 0x558ac516b3b0 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x558ac5562a90 con 0x558ac5173590 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x558ac555aec0 con 0x558ac5194270 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd16c230740 10 client.0 _ll_register_callbacks cb 0x558ac5438150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac5561fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac5561fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41450/0 (socket says 172.21.15.80:41450) 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 -- 172.21.15.80:0/134344439 learned_addr learned my addr 172.21.15.80:0/134344439 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 -- 172.21.15.80:0/134344439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 msgr2=0x558ac557b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 0x558ac557b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 -- 172.21.15.80:0/134344439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 msgr2=0x558ac555c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac555c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 -- 172.21.15.80:0/134344439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac51ac2d0 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd15effd640 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac5561fa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd150007e70 tx=0x7fd150004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48efb3f9be98960 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.988+0000 7fd13dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd13dffb640 1 -- 172.21.15.80:0/134344439 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150049070 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd13dffb640 1 -- 172.21.15.80:0/134344439 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd15003cb20 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd15405f2d0 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd13dffb640 1 -- 172.21.15.80:0/134344439 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd150054050 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 10 client.5565 fetch_fsmap learned FSMap version 15 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x558ac52766b0 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd13dffb640 1 -- 172.21.15.80:0/134344439 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15405f2d0 con 0x558ac516b3b0 2024-04-25T15:44:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd13dffb640 1 -- 172.21.15.80:0/134344439 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7fd150057020 con 0x558ac516b3b0 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 10 client.5565 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 10 client.5565 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 20 client.5565 populate_metadata read hostname 'smithi080' 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac5152e40 0x558ac55985a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 4 client.5565 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 --> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ac54a8350 con 0x558ac5152e40 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac5152e40 0x558ac55985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.989+0000 7fd13dffb640 10 client.5565 ms_handle_connect on v2:172.21.15.80:6836/3809895897 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac5152e40 0x558ac55985a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166ed88cb4db186c server_cookie=e2c850168ee664c3 in_seq=0 out_seq=0 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd13dffb640 1 -- 172.21.15.80:0/134344439 <== mds.0 v2:172.21.15.80:6836/3809895897 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558ac54a8350 con 0x558ac5152e40 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd13dffb640 10 client.5565 handle_command_reply: tid=0 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 client.5565 shutdown 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 msgr2=0x558ac5561fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac5561fa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd150007e70 tx=0x7fd150004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 shutdown_connections 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac5194270 0x558ac557b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac555c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac5152e40 0x558ac55985a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 --2- 172.21.15.80:0/134344439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac516b3b0 0x558ac5561fa0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd13dffb640 0 client.5565 ms_handle_reset on v2:172.21.15.80:6836/3809895897 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.990+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 >> 172.21.15.80:0/134344439 conn(0x558ac51883c0 msgr2=0x558ac55359f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.991+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 shutdown_connections 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.991+0000 7fd16c230740 1 -- 172.21.15.80:0/134344439 wait complete. 2024-04-25T15:44:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:23.991+0000 7fd16c230740 20 client.5565 trim_cache size 0 max 16384 2024-04-25T15:44:24.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.009+0000 7fd16c230740 1 Processor -- start 2024-04-25T15:44:24.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.009+0000 7fd16c230740 1 -- start start 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac557d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac5594020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd16c230740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 0x558ac5594560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd16c230740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd1602023c0 con 0x558ac5194270 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd160155f00 con 0x558ac5173590 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd1601f9680 con 0x558ac516b3b0 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 0x558ac5594560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 0x558ac5594560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41466/0 (socket says 172.21.15.80:41466) 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 -- 172.21.15.80:0/773310292 learned_addr learned my addr 172.21.15.80:0/773310292 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15effd640 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac557d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 -- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 msgr2=0x558ac557d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac557d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 -- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 msgr2=0x558ac5594020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac5594020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 -- 172.21.15.80:0/773310292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac55311b0 con 0x558ac5194270 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd15f7fe640 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 0x558ac5594560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd158001360 tx=0x7fd158001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7888490614c4f19d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd13ffff640 1 -- 172.21.15.80:0/773310292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158019070 con 0x558ac5194270 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd13ffff640 1 -- 172.21.15.80:0/773310292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158005320 con 0x558ac5194270 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.011+0000 7fd13ffff640 1 -- 172.21.15.80:0/773310292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158003810 con 0x558ac5194270 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 -- 172.21.15.80:0/773310292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 msgr2=0x558ac5594560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 0x558ac5594560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd158001360 tx=0x7fd158001820 comp rx=0 tx=0).stop 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 -- 172.21.15.80:0/773310292 shutdown_connections 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5194270 0x558ac5594560 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5173590 0x558ac5594020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 --2- 172.21.15.80:0/773310292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac557d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 -- 172.21.15.80:0/773310292 >> 172.21.15.80:0/773310292 conn(0x558ac51883c0 msgr2=0x558ac5560600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 -- 172.21.15.80:0/773310292 shutdown_connections 2024-04-25T15:44:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.012+0000 7fd16c230740 1 -- 172.21.15.80:0/773310292 wait complete. 2024-04-25T15:44:24.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.013+0000 7fd16c230740 1 -- start start 2024-04-25T15:44:24.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.013+0000 7fd16c230740 1 Processor -- start 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac55decd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 0x558ac55f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5194270 0x558ac55f9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558ac5558b00 con 0x558ac5173590 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x558ac5562600 con 0x558ac5194270 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x558ac5557720 con 0x558ac516b3b0 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd16c230740 10 client.0 _ll_register_callbacks cb 0x7fd1540090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 0x558ac55f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd15e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 0x558ac55f93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41468/0 (socket says 172.21.15.80:41468) 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.014+0000 7fd15e7fc640 1 -- 172.21.15.80:0/1787102787 learned_addr learned my addr 172.21.15.80:0/1787102787 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15e7fc640 1 -- 172.21.15.80:0/1787102787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 msgr2=0x558ac55decd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac55decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15e7fc640 1 -- 172.21.15.80:0/1787102787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5194270 msgr2=0x558ac55f9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5194270 0x558ac55f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15e7fc640 1 -- 172.21.15.80:0/1787102787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac557c7f0 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15e7fc640 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 0x558ac55f93e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd1540935f0 tx=0x7fd15405b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d724a4f5f366cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd13dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd13dffb640 1 -- 172.21.15.80:0/1787102787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15407e060 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd13dffb640 1 -- 172.21.15.80:0/1787102787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd15405b560 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd158005320 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd13dffb640 1 -- 172.21.15.80:0/1787102787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd154021040 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 10 client.5571 fetch_fsmap learned FSMap version 15 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x558ac55949c0 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd13dffb640 1 -- 172.21.15.80:0/1787102787 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158005320 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd13dffb640 1 -- 172.21.15.80:0/1787102787 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7fd154024060 con 0x558ac5173590 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 10 client.5571 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T15:44:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 10 client.5571 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 20 client.5571 populate_metadata read hostname 'smithi080' 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac55714b0 0x558ac5578c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 4 client.5571 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 --> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] -- command(tid 0: {"prefix": "status"}) -- 0x558ac54a21c0 con 0x558ac55714b0 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.015+0000 7fd15effd640 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac55714b0 0x558ac5578c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd13dffb640 10 client.5571 ms_handle_connect on v2:172.21.15.80:6836/3809895897 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd15effd640 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac55714b0 0x558ac5578c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec98c2f18fedb322 server_cookie=b8aa5c440e784244 in_seq=0 out_seq=0 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd13dffb640 1 -- 172.21.15.80:0/1787102787 <== mds.0 v2:172.21.15.80:6836/3809895897 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x558ac54a21c0 con 0x558ac55714b0 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd13dffb640 10 client.5571 handle_command_reply: tid=0 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 client.5571 shutdown 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 msgr2=0x558ac55f93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 0x558ac55f93e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd1540935f0 tx=0x7fd15405b280 comp rx=0 tx=0).stop 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 shutdown_connections 2024-04-25T15:44:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ac5194270 0x558ac55f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:6836/3809895897,v1:172.21.15.80:6837/3809895897] conn(0x558ac55714b0 0x558ac5578c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ac5173590 0x558ac55f93e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 --2- 172.21.15.80:0/1787102787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x558ac516b3b0 0x558ac55decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd13dffb640 0 client.5571 ms_handle_reset on v2:172.21.15.80:6836/3809895897 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 >> 172.21.15.80:0/1787102787 conn(0x558ac51883c0 msgr2=0x558ac5578000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 shutdown_connections 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 1 -- 172.21.15.80:0/1787102787 wait complete. 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.016+0000 7fd16c230740 20 client.5571 trim_cache size 0 max 16384 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:44:24.022 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 5373, 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 9.1264609080000003, 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 15, 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 39, 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 39, 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 16.297406963 2024-04-25T15:44:24.023 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd14c0744b0 msgr2=0x7fd14c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd14c0744b0 0x7fd14c0769c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd150034000 tx=0x7fd150033040 comp rx=0 tx=0).stop 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 msgr2=0x7fd160153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 0x7fd160153490 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e870 tx=0x7fd15400ed30 comp rx=0 tx=0).stop 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 shutdown_connections 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd14c0744b0 0x7fd14c0769c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1601602a0 0x7fd1601eb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1600d41b0 0x7fd160153490 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 --2- 172.21.15.80:0/894636716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1600b7b90 0x7fd1601452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 >> 172.21.15.80:0/894636716 conn(0x7fd16006e9f0 msgr2=0x7fd16015d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:24.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 shutdown_connections 2024-04-25T15:44:24.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.017+0000 7fd165385640 1 -- 172.21.15.80:0/894636716 wait complete. 2024-04-25T15:44:24.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:44:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.136+0000 7f9e17261640 1 Processor -- start 2024-04-25T15:44:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.136+0000 7f9e17261640 1 -- start start 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.137+0000 7f9e17261640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9e100b6ee0 0x7f9e1006c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.137+0000 7f9e17261640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e1015d250 con 0x7f9e100b6320 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.137+0000 7f9e17261640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e100b6870 con 0x7f9e100b72f0 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.137+0000 7f9e17261640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9e100ce510 con 0x7f9e100b6ee0 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e14ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9e100b6320 0x7f9e100cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51154/0 (socket says 172.21.15.80:51154) 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e0ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9e100b6ee0 0x7f9e1006c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e14ffd640 1 -- 172.21.15.80:0/2259204955 learned_addr learned my addr 172.21.15.80:0/2259204955 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e0ffff640 1 -- 172.21.15.80:0/2259204955 >> v1:172.21.15.195:6789/0 conn(0x7f9e100b72f0 legacy=0x7f9e1006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e0ffff640 1 -- 172.21.15.80:0/2259204955 >> v1:172.21.15.80:6789/0 conn(0x7f9e100b6320 legacy=0x7f9e100cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e0ffff640 1 -- 172.21.15.80:0/2259204955 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e100ce760 con 0x7f9e100b6ee0 2024-04-25T15:44:24.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.138+0000 7f9e0f7fe640 1 -- 172.21.15.80:0/2259204955 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957413054 0 0) 0x7f9e1015d250 con 0x7f9e100b6320 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.139+0000 7f9e0ffff640 1 --2- 172.21.15.80:0/2259204955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e1006c5c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9e100ce690 tx=0x7f9dfc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b92b7068c13a680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.139+0000 7f9e0f7fe640 1 -- 172.21.15.80:0/2259204955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc037070 con 0x7f9e100b6ee0 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.139+0000 7f9e0f7fe640 1 -- 172.21.15.80:0/2259204955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dfc032440 con 0x7f9e100b6ee0 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.139+0000 7f9e0f7fe640 1 -- 172.21.15.80:0/2259204955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc032810 con 0x7f9e100b6ee0 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 -- 172.21.15.80:0/2259204955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 msgr2=0x7f9e1006c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 --2- 172.21.15.80:0/2259204955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e1006c5c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9e100ce690 tx=0x7f9dfc02a180 comp rx=0 tx=0).stop 2024-04-25T15:44:24.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 -- 172.21.15.80:0/2259204955 shutdown_connections 2024-04-25T15:44:24.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 --2- 172.21.15.80:0/2259204955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e1006c5c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 -- 172.21.15.80:0/2259204955 >> 172.21.15.80:0/2259204955 conn(0x7f9e100d2080 msgr2=0x7f9e100d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:24.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 -- 172.21.15.80:0/2259204955 shutdown_connections 2024-04-25T15:44:24.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.140+0000 7f9e17261640 1 -- 172.21.15.80:0/2259204955 wait complete. 2024-04-25T15:44:24.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.141+0000 7f9e17261640 1 Processor -- start 2024-04-25T15:44:24.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.141+0000 7f9e17261640 1 -- start start 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e17261640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e100b6320 0x7f9e1015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e17261640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e101588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e17261640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e100b72f0 0x7f9e10158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e17261640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9e100d1190 con 0x7f9e100b6ee0 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e17261640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9e100d1010 con 0x7f9e100b6320 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e17261640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9e100d1310 con 0x7f9e100b72f0 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e101588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e101588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41480/0 (socket says 172.21.15.80:41480) 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 -- 172.21.15.80:0/3517907409 learned_addr learned my addr 172.21.15.80:0/3517907409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e14ffd640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e100b6320 0x7f9e1015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e157fe640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e100b72f0 0x7f9e10158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 -- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e100b72f0 msgr2=0x7f9e10158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e100b72f0 0x7f9e10158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 -- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e100b6320 msgr2=0x7f9e1015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e100b6320 0x7f9e1015b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 -- 172.21.15.80:0/3517907409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e101f46b0 con 0x7f9e100b6ee0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e14ffd640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e100b6320 0x7f9e1015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.143+0000 7f9e0ffff640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e101588d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009890 tx=0x7f9dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.144+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc041070 con 0x7f9e100b6ee0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.144+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dfc03c890 con 0x7f9e100b6ee0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.144+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e101f4990 con 0x7f9e100b6ee0 2024-04-25T15:44:24.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.144+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc037040 con 0x7f9e100b6ee0 2024-04-25T15:44:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.144+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e101f4f50 con 0x7f9e100b6ee0 2024-04-25T15:44:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.145+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e101f4420 con 0x7f9e100b6ee0 2024-04-25T15:44:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.145+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9dfc044070 con 0x7f9e100b6ee0 2024-04-25T15:44:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.146+0000 7f9e0d7fa640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9df40744e0 0x7f9df40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.146+0000 7f9e14ffd640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9df40744e0 0x7f9df40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.146+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9dfc0b5f60 con 0x7f9e100b6ee0 2024-04-25T15:44:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.146+0000 7f9e14ffd640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9df40744e0 0x7f9df40769f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e04007fd0 tx=0x7f9e04007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.151+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9dfc0805f0 con 0x7f9e100b6ee0 2024-04-25T15:44:24.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.362+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9e1006a100 con 0x7f9e100b6ee0 2024-04-25T15:44:24.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.362+0000 7f9e0d7fa640 1 -- 172.21.15.80:0/3517907409 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f9dfc07fef0 con 0x7f9e100b6ee0 2024-04-25T15:44:24.363 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:44:24.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9df40744e0 msgr2=0x7f9df40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9df40744e0 0x7f9df40769f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e04007fd0 tx=0x7f9e04007dc0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 msgr2=0x7f9e101588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e101588d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009890 tx=0x7f9dfc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 shutdown_connections 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9df40744e0 0x7f9df40769f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e100b72f0 0x7f9e10158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e100b6ee0 0x7f9e101588d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 --2- 172.21.15.80:0/3517907409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e100b6320 0x7f9e1015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 >> 172.21.15.80:0/3517907409 conn(0x7f9e100d2080 msgr2=0x7f9e1006c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 shutdown_connections 2024-04-25T15:44:24.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24.364+0000 7f9e17261640 1 -- 172.21.15.80:0/3517907409 wait complete. 2024-04-25T15:44:24.375 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:44:24.375 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:44:24.376 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:24.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.376 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:44:24.391 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:44:24.392 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42692sec preferred_lft 42692sec 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:44:24.393 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:24.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.394 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:44:24.454 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:44:24.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.456 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:44:24.511 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:44:24.511 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:44:24.511 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:44:24.512 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:44:24.512 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:44:24.512 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:44:24.512 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:44:24.512 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:44:24.512 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:44:24.512 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:44:24.512 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:44:24.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:44:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:24.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.635 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:44:24.650 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:44:24.650 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:44:24.650 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:24.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:44:24.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:24.715 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:24.769 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:24.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:24.770 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:24.824 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:44:24.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:24.916 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:24.916 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:24.924 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:24.924 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:24.924 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:44:24.925 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:44:24.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:44:24.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:24.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:24.956 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:44:25.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:44:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:25.057 INFO:teuthology.orchestra.run.smithi080.stdout:client5583 2024-04-25T15:44:25.057 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:25.057 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:25.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:44:25.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.220+0000 7fbf5f59e640 1 Processor -- start 2024-04-25T15:44:25.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.220+0000 7fbf5f59e640 1 -- start start 2024-04-25T15:44:25.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.221+0000 7fbf5f59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbf580b0d80 0x7fbf5815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:25.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5f59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:25.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5f59e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf580703e0 con 0x7fbf5806fe10 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5f59e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbf580affc0 con 0x7fbf580b0d80 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5f59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbf580b02a0 con 0x7fbf580b65a0 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbf580b0d80 0x7fbf5815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbf580b0d80 0x7fbf5815c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37622/0 (socket says 172.21.15.80:37622) 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 -- 172.21.15.80:0/2601695383 learned_addr learned my addr 172.21.15.80:0/2601695383 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5cb39640 1 --2- 172.21.15.80:0/2601695383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 -- 172.21.15.80:0/2601695383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 msgr2=0x7fbf58073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 --2- 172.21.15.80:0/2601695383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 -- 172.21.15.80:0/2601695383 >> v1:172.21.15.195:6789/0 conn(0x7fbf5806fe10 legacy=0x7fbf58160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.222+0000 7fbf5d33a640 1 -- 172.21.15.80:0/2601695383 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf580b0580 con 0x7fbf580b0d80 2024-04-25T15:44:25.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.223+0000 7fbf5d33a640 1 --2- 172.21.15.80:0/2601695383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf5815c670 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009e50 tx=0x7fbf5402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a361fc865e8e4583 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.223+0000 7fbf4ffff640 1 -- 172.21.15.80:0/2601695383 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54036070 con 0x7fbf580b0d80 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.223+0000 7fbf4ffff640 1 -- 172.21.15.80:0/2601695383 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf54031600 con 0x7fbf580b0d80 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.223+0000 7fbf4ffff640 1 -- 172.21.15.80:0/2601695383 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540319d0 con 0x7fbf580b0d80 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 -- 172.21.15.80:0/2601695383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 msgr2=0x7fbf5815c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/2601695383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf5815c670 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009e50 tx=0x7fbf5402a710 comp rx=0 tx=0).stop 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 -- 172.21.15.80:0/2601695383 shutdown_connections 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/2601695383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/2601695383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf5815c670 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 -- 172.21.15.80:0/2601695383 >> 172.21.15.80:0/2601695383 conn(0x7fbf580d1e20 msgr2=0x7fbf58073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:25.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 -- 172.21.15.80:0/2601695383 shutdown_connections 2024-04-25T15:44:25.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.224+0000 7fbf5f59e640 1 -- 172.21.15.80:0/2601695383 wait complete. 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.225+0000 7fbf5f59e640 1 Processor -- start 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.225+0000 7fbf5f59e640 1 -- start start 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5f59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf5806fe10 0x7fbf5815ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf580cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5f59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5f59e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbf58074070 con 0x7fbf580b0d80 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5f59e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbf580ae7c0 con 0x7fbf5806fe10 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5f59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbf580741f0 con 0x7fbf580b65a0 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf580cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf580cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37628/0 (socket says 172.21.15.80:37628) 2024-04-25T15:44:25.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 -- 172.21.15.80:0/3369385001 learned_addr learned my addr 172.21.15.80:0/3369385001 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5d33a640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf5806fe10 0x7fbf5815ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5db3b640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 -- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 msgr2=0x7fbf58145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 -- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf5806fe10 msgr2=0x7fbf5815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf5806fe10 0x7fbf5815ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 -- 172.21.15.80:0/3369385001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf58145660 con 0x7fbf580b0d80 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf5cb39640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf580cba00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800e870 tx=0x7fbf4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.227+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48017070 con 0x7fbf580b0d80 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.228+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4800c940 con 0x7fbf580b0d80 2024-04-25T15:44:25.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.228+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800cd30 con 0x7fbf580b0d80 2024-04-25T15:44:25.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.228+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5815f460 con 0x7fbf580b0d80 2024-04-25T15:44:25.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.228+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf580cc4e0 con 0x7fbf580b0d80 2024-04-25T15:44:25.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.229+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5806a100 con 0x7fbf580b0d80 2024-04-25T15:44:25.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.229+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbf4801a070 con 0x7fbf580b0d80 2024-04-25T15:44:25.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.230+0000 7fbf4dffb640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbf3c0744b0 0x7fbf3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:25.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.230+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbf480955e0 con 0x7fbf580b0d80 2024-04-25T15:44:25.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.230+0000 7fbf5d33a640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbf3c0744b0 0x7fbf3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:25.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.230+0000 7fbf5d33a640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbf3c0744b0 0x7fbf3c0769c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf54033000 tx=0x7fbf54009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:25.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.235+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf4805fc70 con 0x7fbf580b0d80 2024-04-25T15:44:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.448+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbf5815f1f0 con 0x7fbf580b0d80 2024-04-25T15:44:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.448+0000 7fbf4dffb640 1 -- 172.21.15.80:0/3369385001 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fbf4805f570 con 0x7fbf580b0d80 2024-04-25T15:44:25.477 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:44:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbf3c0744b0 msgr2=0x7fbf3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbf3c0744b0 0x7fbf3c0769c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf54033000 tx=0x7fbf54009000 comp rx=0 tx=0).stop 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 msgr2=0x7fbf580cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf580cba00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800e870 tx=0x7fbf4800ed30 comp rx=0 tx=0).stop 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 shutdown_connections 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbf3c0744b0 0x7fbf3c0769c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf580b65a0 0x7fbf58145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf580b0d80 0x7fbf580cba00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 --2- 172.21.15.80:0/3369385001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf5806fe10 0x7fbf5815ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 >> 172.21.15.80:0/3369385001 conn(0x7fbf580d1e20 msgr2=0x7fbf58159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 shutdown_connections 2024-04-25T15:44:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:25.450+0000 7fbf5f59e640 1 -- 172.21.15.80:0/3369385001 wait complete. 2024-04-25T15:44:25.479 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:44:25.480 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:44:25.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:25.480 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:44:25.499 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:44:25.499 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:44:25.499 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:25.500 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42669sec preferred_lft 42669sec 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.501 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:25.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:25.502 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:44:25.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:25.568 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:44:25.626 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:44:25.626 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:44:25.626 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:44:25.626 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:44:25.626 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:44:25.627 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:44:25.627 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:44:25.627 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:44:25.627 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:44:25.627 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:44:25.627 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:44:25.718 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:44:25.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:25.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:25.756 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:44:25.771 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:44:25.771 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:44:25.771 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:44:25.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:25.771 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:44:25.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:25.835 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:25.889 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:44:25.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:25.890 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:25.944 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:44:25.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:25.944 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:26.036 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:26.036 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:26.046 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:26.046 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:44:26.047 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:44:26.049 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:44:26.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:26.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:26.078 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:44:26.166 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:44:26.168 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:26.173 INFO:teuthology.orchestra.run.smithi195.stdout:client5592 2024-04-25T15:44:26.174 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:26.174 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:26.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-04-25T15:44:26.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.305+0000 7f1440af9640 1 Processor -- start 2024-04-25T15:44:26.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.305+0000 7f1440af9640 1 -- start start 2024-04-25T15:44:26.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1440af9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 0x7f143c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1440af9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 0x7f143c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1440af9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143c0b2b00 con 0x7f143c1618b0 2024-04-25T15:44:26.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1440af9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f143c06cb80 con 0x7f143c06c5c0 2024-04-25T15:44:26.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1440af9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f143c06ce60 con 0x7f143c0d26a0 2024-04-25T15:44:26.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f143ad9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 0x7f143c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 0x7f143c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 0x7f143c0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:60820/0 (socket says 172.21.15.80:60820) 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f143ad9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 0x7f143c0b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:41534/0 (socket says 172.21.15.80:41534) 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1439d9b640 1 -- 172.21.15.80:0/1321819371 learned_addr learned my addr 172.21.15.80:0/1321819371 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1439d9b640 1 -- 172.21.15.80:0/1321819371 >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 msgr2=0x7f143c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1439d9b640 1 --2- 172.21.15.80:0/1321819371 >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 0x7f143c0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.307+0000 7f1439d9b640 1 -- 172.21.15.80:0/1321819371 >> v1:172.21.15.195:6789/0 conn(0x7f143c1618b0 legacy=0x7f143c0d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f1439d9b640 1 -- 172.21.15.80:0/1321819371 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c0b2d80 con 0x7f143c0d26a0 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f143959a640 1 -- 172.21.15.80:0/1321819371 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063337505 0 0) 0x7f142c001490 con 0x7f143c1618b0 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f143ad9d640 1 --2- 172.21.15.80:0/1321819371 >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 0x7f143c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f1439d9b640 1 --2- 172.21.15.80:0/1321819371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 0x7f143c0cf530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1430009870 tx=0x7f143002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54baee642608791 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f143959a640 1 -- 172.21.15.80:0/1321819371 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430037070 con 0x7f143c0d26a0 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f143959a640 1 -- 172.21.15.80:0/1321819371 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1430032440 con 0x7f143c0d26a0 2024-04-25T15:44:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.308+0000 7f143959a640 1 -- 172.21.15.80:0/1321819371 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430032810 con 0x7f143c0d26a0 2024-04-25T15:44:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 -- 172.21.15.80:0/1321819371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 msgr2=0x7f143c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 --2- 172.21.15.80:0/1321819371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 0x7f143c0cf530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1430009870 tx=0x7f143002a270 comp rx=0 tx=0).stop 2024-04-25T15:44:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 -- 172.21.15.80:0/1321819371 shutdown_connections 2024-04-25T15:44:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 --2- 172.21.15.80:0/1321819371 >> v2:172.21.15.195:3300/0 conn(0x7f143c06c5c0 0x7f143c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 --2- 172.21.15.80:0/1321819371 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c0d26a0 0x7f143c0cf530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 -- 172.21.15.80:0/1321819371 >> 172.21.15.80:0/1321819371 conn(0x7f143c09b410 msgr2=0x7f143c0b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 -- 172.21.15.80:0/1321819371 shutdown_connections 2024-04-25T15:44:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.309+0000 7f1440af9640 1 -- 172.21.15.80:0/1321819371 wait complete. 2024-04-25T15:44:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.311+0000 7f1440af9640 1 Processor -- start 2024-04-25T15:44:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.311+0000 7f1440af9640 1 -- start start 2024-04-25T15:44:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.312+0000 7f1440af9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f143c06c5c0 0x7f143c0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.312+0000 7f1440af9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 0x7f143c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.312+0000 7f1440af9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c1514d0 0x7f143c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.312+0000 7f1440af9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f143c0cc670 con 0x7f143c1521c0 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.312+0000 7f1440af9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f143c076270 con 0x7f143c06c5c0 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.312+0000 7f1440af9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f143c0cc7f0 con 0x7f143c1514d0 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 0x7f143c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 0x7f143c0c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37636/0 (socket says 172.21.15.80:37636) 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 -- 172.21.15.80:0/2425833284 learned_addr learned my addr 172.21.15.80:0/2425833284 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f143ad9d640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c1514d0 0x7f143c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f143a59c640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f143c06c5c0 0x7f143c0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 -- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c1514d0 msgr2=0x7f143c1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c1514d0 0x7f143c1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 -- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f143c06c5c0 msgr2=0x7f143c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f143c06c5c0 0x7f143c0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 -- 172.21.15.80:0/2425833284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c151e20 con 0x7f143c1521c0 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1439d9b640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 0x7f143c0c7ee0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1430009870 tx=0x7f14300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430037040 con 0x7f143c1521c0 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1430004030 con 0x7f143c1521c0 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c14f140 con 0x7f143c1521c0 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430004420 con 0x7f143c1521c0 2024-04-25T15:44:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.313+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c14f570 con 0x7f143c1521c0 2024-04-25T15:44:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.314+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c06a100 con 0x7f143c1521c0 2024-04-25T15:44:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.315+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f143003a070 con 0x7f143c1521c0 2024-04-25T15:44:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.315+0000 7f142affd640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f141c0744b0 0x7f141c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.316+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f14300b57b0 con 0x7f143c1521c0 2024-04-25T15:44:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.316+0000 7f143a59c640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f141c0744b0 0x7f141c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.316+0000 7f143a59c640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f141c0744b0 0x7f141c0769c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f142c0012e0 tx=0x7f142c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.320+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f143c151e20 con 0x7f143c1521c0 2024-04-25T15:44:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.495+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7f143c09c050 con 0x7f143c1521c0 2024-04-25T15:44:26.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.499+0000 7f142affd640 1 -- 172.21.15.80:0/2425833284 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7f1430041020 con 0x7f143c1521c0 2024-04-25T15:44:26.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f141c0744b0 msgr2=0x7f141c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f141c0744b0 0x7f141c0769c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f142c0012e0 tx=0x7f142c009040 comp rx=0 tx=0).stop 2024-04-25T15:44:26.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 msgr2=0x7f143c0c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 0x7f143c0c7ee0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1430009870 tx=0x7f14300046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 shutdown_connections 2024-04-25T15:44:26.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f141c0744b0 0x7f141c0769c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f143c1514d0 0x7f143c1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c1521c0 0x7f143c0c7ee0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 --2- 172.21.15.80:0/2425833284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f143c06c5c0 0x7f143c0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 >> 172.21.15.80:0/2425833284 conn(0x7f143c09b410 msgr2=0x7f143c0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:26.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 shutdown_connections 2024-04-25T15:44:26.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.501+0000 7f1440af9640 1 -- 172.21.15.80:0/2425833284 wait complete. 2024-04-25T15:44:26.513 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:26.513 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:26.529 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:26.529 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:26.586 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:26.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.733+0000 7f22e713f640 1 Processor -- start 2024-04-25T15:44:26.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.733+0000 7f22e713f640 1 -- start start 2024-04-25T15:44:26.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22e713f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22e0074240 0x7f22e015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22e713f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e00703e0 con 0x7f22e00b0d80 2024-04-25T15:44:26.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22e713f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e00affc0 con 0x7f22e00b65a0 2024-04-25T15:44:26.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22e713f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f22e00b02a0 con 0x7f22e0074240 2024-04-25T15:44:26.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22dffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22e0074240 0x7f22e015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22e4edb640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f22e00b0d80 0x7f22e0073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40264/0 (socket says 172.21.15.80:40264) 2024-04-25T15:44:26.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22e4edb640 1 -- 172.21.15.80:0/249238483 learned_addr learned my addr 172.21.15.80:0/249238483 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:26.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22dffff640 1 -- 172.21.15.80:0/249238483 >> v1:172.21.15.195:6789/0 conn(0x7f22e00b65a0 legacy=0x7f22e00b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22dffff640 1 -- 172.21.15.80:0/249238483 >> v1:172.21.15.80:6789/0 conn(0x7f22e00b0d80 legacy=0x7f22e0073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22df7fe640 1 -- 172.21.15.80:0/249238483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298608020 0 0) 0x7f22e00703e0 con 0x7f22e00b0d80 2024-04-25T15:44:26.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.735+0000 7f22dffff640 1 -- 172.21.15.80:0/249238483 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e00b0580 con 0x7f22e0074240 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.736+0000 7f22dffff640 1 --2- 172.21.15.80:0/249238483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e0074240 0x7f22e015c670 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097a0 tx=0x7f22d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611afe21e1da4608 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.736+0000 7f22df7fe640 1 -- 172.21.15.80:0/249238483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4037070 con 0x7f22e0074240 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.736+0000 7f22df7fe640 1 -- 172.21.15.80:0/249238483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4032440 con 0x7f22e0074240 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.736+0000 7f22df7fe640 1 -- 172.21.15.80:0/249238483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4032810 con 0x7f22e0074240 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 -- 172.21.15.80:0/249238483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e0074240 msgr2=0x7f22e015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 --2- 172.21.15.80:0/249238483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e0074240 0x7f22e015c670 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097a0 tx=0x7f22d402a230 comp rx=0 tx=0).stop 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 -- 172.21.15.80:0/249238483 shutdown_connections 2024-04-25T15:44:26.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 --2- 172.21.15.80:0/249238483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e0074240 0x7f22e015c670 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 -- 172.21.15.80:0/249238483 >> 172.21.15.80:0/249238483 conn(0x7f22e00d1e20 msgr2=0x7f22e0073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:26.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 -- 172.21.15.80:0/249238483 shutdown_connections 2024-04-25T15:44:26.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.737+0000 7f22e713f640 1 -- 172.21.15.80:0/249238483 wait complete. 2024-04-25T15:44:26.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.738+0000 7f22e713f640 1 Processor -- start 2024-04-25T15:44:26.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.738+0000 7f22e713f640 1 -- start start 2024-04-25T15:44:26.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e713f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22e00b0d80 0x7f22e014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e713f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 0x7f22e01f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e713f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22e01f7dd0 0x7f22e015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e713f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22e006fe10 con 0x7f22e00b65a0 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e713f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f22e00ae7c0 con 0x7f22e00b0d80 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e713f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f22e006ff90 con 0x7f22e01f7dd0 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 0x7f22e01f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 0x7f22e01f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37644/0 (socket says 172.21.15.80:37644) 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 -- 172.21.15.80:0/1491562892 learned_addr learned my addr 172.21.15.80:0/1491562892 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e4edb640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22e00b0d80 0x7f22e014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e56dc640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22e01f7dd0 0x7f22e015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 -- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22e01f7dd0 msgr2=0x7f22e015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22e01f7dd0 0x7f22e015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 -- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22e00b0d80 msgr2=0x7f22e014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22e00b0d80 0x7f22e014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 -- 172.21.15.80:0/1491562892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e01f8580 con 0x7f22e00b65a0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22e56dc640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22e01f7dd0 0x7f22e015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.740+0000 7f22dffff640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 0x7f22e01f7890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098c0 tx=0x7f22d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.741+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4037040 con 0x7f22e00b65a0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.741+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4042070 con 0x7f22e00b65a0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.741+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e015c810 con 0x7f22e00b65a0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.741+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4030a70 con 0x7f22e00b65a0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.741+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e015cdd0 con 0x7f22e00b65a0 2024-04-25T15:44:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.742+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e01f82f0 con 0x7f22e00b65a0 2024-04-25T15:44:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.742+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f22d4030c10 con 0x7f22e00b65a0 2024-04-25T15:44:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.743+0000 7f22dd7fa640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22cc0744b0 0x7f22cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.743+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f22d40b5da0 con 0x7f22e00b65a0 2024-04-25T15:44:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.743+0000 7f22e4edb640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22cc0744b0 0x7f22cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:26.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.743+0000 7f22e4edb640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22cc0744b0 0x7f22cc0769c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22d0000f60 tx=0x7f22d0007d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:26.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.748+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22d404c020 con 0x7f22e00b65a0 2024-04-25T15:44:26.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.922+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22e006a100 con 0x7f22e00b65a0 2024-04-25T15:44:26.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.923+0000 7f22dd7fa640 1 -- 172.21.15.80:0/1491562892 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f22d4080380 con 0x7f22e00b65a0 2024-04-25T15:44:26.924 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:26.924 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:26.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22cc0744b0 msgr2=0x7f22cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22cc0744b0 0x7f22cc0769c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22d0000f60 tx=0x7f22d0007d00 comp rx=0 tx=0).stop 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 msgr2=0x7f22e01f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 0x7f22e01f7890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098c0 tx=0x7f22d40046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 shutdown_connections 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22cc0744b0 0x7f22cc0769c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22e01f7dd0 0x7f22e015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e00b65a0 0x7f22e01f7890 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 --2- 172.21.15.80:0/1491562892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22e00b0d80 0x7f22e014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.925+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 >> 172.21.15.80:0/1491562892 conn(0x7f22e00d1e20 msgr2=0x7f22e00b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.926+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 shutdown_connections 2024-04-25T15:44:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:26.926+0000 7f22e713f640 1 -- 172.21.15.80:0/1491562892 wait complete. 2024-04-25T15:44:26.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:12.500873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:13.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:26.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:27.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.049+0000 7ff73cc4c640 1 Processor -- start 2024-04-25T15:44:27.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.049+0000 7ff73cc4c640 1 -- start start 2024-04-25T15:44:27.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.050+0000 7ff73cc4c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 0x7ff73806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.050+0000 7ff73cc4c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff73806db10 0x7ff7380ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73cc4c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff73806df20 con 0x7ff73815f170 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73cc4c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff738071320 con 0x7ff73806db10 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73cc4c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff738162610 con 0x7ff7380d0ff0 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff73815f170 0x7ff738070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40274/0 (socket says 172.21.15.80:40274) 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73659c640 1 -- 172.21.15.80:0/2495617856 learned_addr learned my addr 172.21.15.80:0/2495617856 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff736d9d640 1 --2- 172.21.15.80:0/2495617856 >> v2:172.21.15.195:3300/0 conn(0x7ff73806db10 0x7ff7380ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff735d9b640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 0x7ff73806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180739418 0 0) 0x7ff728001490 con 0x7ff73815f170 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff720003520 con 0x7ff73815f170 2024-04-25T15:44:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 687271137 0 0) 0x7ff720003520 con 0x7ff73815f170 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 msgr2=0x7ff73806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 0x7ff73806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 >> v2:172.21.15.195:3300/0 conn(0x7ff73806db10 msgr2=0x7ff7380ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 --2- 172.21.15.80:0/2495617856 >> v2:172.21.15.195:3300/0 conn(0x7ff73806db10 0x7ff7380ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff738161a00 con 0x7ff73815f170 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7ff728001bc0 con 0x7ff73815f170 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 >> v1:172.21.15.80:6789/0 conn(0x7ff73815f170 legacy=0x7ff738070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7200039b0 0x7ff720003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff720004800 0x7ff720004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 0x7ff720005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff738071320 con 0x7ff720004800 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff738162610 con 0x7ff7200039b0 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff72000b9c0 con 0x7ff7380d0ff0 2024-04-25T15:44:27.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.051+0000 7ff735d9b640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff720004800 0x7ff720004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff73659c640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7200039b0 0x7ff720003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff736d9d640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 0x7ff720005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff735d9b640 1 -- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 msgr2=0x7ff720005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff735d9b640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7380d0ff0 0x7ff720005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff735d9b640 1 -- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7200039b0 msgr2=0x7ff720003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff735d9b640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7200039b0 0x7ff720003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff735d9b640 1 -- 172.21.15.80:0/2495617856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff720003520 con 0x7ff720004800 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.052+0000 7ff735d9b640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff720004800 0x7ff720004c10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009ac0 tx=0x7ff720005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10df483da282ad3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c036070 con 0x7ff720004800 2024-04-25T15:44:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72c031400 con 0x7ff720004800 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73559a640 1 -- 172.21.15.80:0/2495617856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c009690 con 0x7ff720004800 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73cc4c640 1 -- 172.21.15.80:0/2495617856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff720004800 msgr2=0x7ff720004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/2495617856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff720004800 0x7ff720004c10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009ac0 tx=0x7ff720005830 comp rx=0 tx=0).stop 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff736d9d640 1 -- 172.21.15.80:0/2495617856 reap_dead start 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73cc4c640 1 -- 172.21.15.80:0/2495617856 shutdown_connections 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73cc4c640 1 -- 172.21.15.80:0/2495617856 >> 172.21.15.80:0/2495617856 conn(0x7ff7380734b0 msgr2=0x7ff7380738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73cc4c640 1 -- 172.21.15.80:0/2495617856 shutdown_connections 2024-04-25T15:44:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.053+0000 7ff73cc4c640 1 -- 172.21.15.80:0/2495617856 wait complete. 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.055+0000 7ff73cc4c640 1 Processor -- start 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.055+0000 7ff73cc4c640 1 -- start start 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff720004800 0x7ff738150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7381f7ed0 0x7ff7380ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 0x7ff7380aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7381622a0 con 0x7ff738153c10 2024-04-25T15:44:27.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff738161fc0 con 0x7ff7381f7ed0 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380d1400 con 0x7ff720004800 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 0x7ff7380aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 0x7ff7380aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37670/0 (socket says 172.21.15.80:37670) 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 -- 172.21.15.80:0/1770553465 learned_addr learned my addr 172.21.15.80:0/1770553465 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73659c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff720004800 0x7ff738150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff735d9b640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7381f7ed0 0x7ff7380ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 -- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff720004800 msgr2=0x7ff738150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff720004800 0x7ff738150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 -- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7381f7ed0 msgr2=0x7ff7380ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7381f7ed0 0x7ff7380ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 -- 172.21.15.80:0/1770553465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380d0a10 con 0x7ff738153c10 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff736d9d640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 0x7ff7380aed70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff7380cda30 tx=0x7ff730011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730004240 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73001b070 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7381505b0 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73000f7a0 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.057+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7381f8990 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.058+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7380b0950 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.059+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff730012040 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.059+0000 7ff726ffd640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7180744e0 0x7ff7180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.059+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff730095080 con 0x7ff738153c10 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.059+0000 7ff73659c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7180744e0 0x7ff7180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.060+0000 7ff73659c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7180744e0 0x7ff7180769f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff738073090 tx=0x7ff728006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.064+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7380b0950 con 0x7ff738153c10 2024-04-25T15:44:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.236+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff7381f8440 con 0x7ff738153c10 2024-04-25T15:44:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.237+0000 7ff726ffd640 1 -- 172.21.15.80:0/1770553465 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7ff73005f0c0 con 0x7ff738153c10 2024-04-25T15:44:27.237 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7180744e0 msgr2=0x7ff7180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7180744e0 0x7ff7180769f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff738073090 tx=0x7ff728006040 comp rx=0 tx=0).stop 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 msgr2=0x7ff7380aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 0x7ff7380aed70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff7380cda30 tx=0x7ff730011cf0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 shutdown_connections 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7180744e0 0x7ff7180769f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff738153c10 0x7ff7380aed70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7381f7ed0 0x7ff7380ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 --2- 172.21.15.80:0/1770553465 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff720004800 0x7ff738150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 >> 172.21.15.80:0/1770553465 conn(0x7ff7380734b0 msgr2=0x7ff7380b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 shutdown_connections 2024-04-25T15:44:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.239+0000 7ff73cc4c640 1 -- 172.21.15.80:0/1770553465 wait complete. 2024-04-25T15:44:27.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:44:27.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.360+0000 7f3331596640 1 Processor -- start 2024-04-25T15:44:27.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.360+0000 7f3331596640 1 -- start start 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.361+0000 7f3331596640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f332c0d6a00 0x7f332c16b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.361+0000 7f3331596640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c0d3650 con 0x7f332c0d0750 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.361+0000 7f3331596640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c0d25b0 con 0x7f332c0b5260 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.361+0000 7f3331596640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f332c0d31c0 con 0x7f332c0d6a00 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f332a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f332c0d0750 0x7f332c0d62f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40276/0 (socket says 172.21.15.80:40276) 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f332a7fc640 1 -- 172.21.15.80:0/156712664 learned_addr learned my addr 172.21.15.80:0/156712664 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f332b7fe640 1 --2- 172.21.15.80:0/156712664 >> v2:172.21.15.195:3300/0 conn(0x7f332c0d6a00 0x7f332c16b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f3329ffb640 1 -- 172.21.15.80:0/156712664 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680610671 0 0) 0x7f332c0d3650 con 0x7f332c0d0750 2024-04-25T15:44:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f3329ffb640 1 -- 172.21.15.80:0/156712664 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3314003520 con 0x7f332c0d0750 2024-04-25T15:44:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f332b7fe640 1 -- 172.21.15.80:0/156712664 >> v1:172.21.15.195:6789/0 conn(0x7f332c0b5260 legacy=0x7f332c1600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f3329ffb640 1 -- 172.21.15.80:0/156712664 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4135018468 0 0) 0x7f3314003520 con 0x7f332c0d0750 2024-04-25T15:44:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f332b7fe640 1 -- 172.21.15.80:0/156712664 >> v1:172.21.15.80:6789/0 conn(0x7f332c0d0750 legacy=0x7f332c0d62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.362+0000 7f332b7fe640 1 -- 172.21.15.80:0/156712664 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c0d2890 con 0x7f332c0d6a00 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.363+0000 7f332b7fe640 1 --2- 172.21.15.80:0/156712664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c0d6a00 0x7f332c16b070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3324009d90 tx=0x7f332402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92b9f0318fdef1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.363+0000 7f3329ffb640 1 -- 172.21.15.80:0/156712664 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320001670 con 0x7f332c0d6a00 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.363+0000 7f3329ffb640 1 -- 172.21.15.80:0/156712664 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3324007540 con 0x7f332c0d6a00 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.363+0000 7f3329ffb640 1 -- 172.21.15.80:0/156712664 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240078f0 con 0x7f332c0d6a00 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 -- 172.21.15.80:0/156712664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c0d6a00 msgr2=0x7f332c16b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 --2- 172.21.15.80:0/156712664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c0d6a00 0x7f332c16b070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3324009d90 tx=0x7f332402a680 comp rx=0 tx=0).stop 2024-04-25T15:44:27.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 -- 172.21.15.80:0/156712664 shutdown_connections 2024-04-25T15:44:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 --2- 172.21.15.80:0/156712664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c0d6a00 0x7f332c16b070 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 -- 172.21.15.80:0/156712664 >> 172.21.15.80:0/156712664 conn(0x7f332c06ea50 msgr2=0x7f332c06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 -- 172.21.15.80:0/156712664 shutdown_connections 2024-04-25T15:44:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.364+0000 7f3331596640 1 -- 172.21.15.80:0/156712664 wait complete. 2024-04-25T15:44:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.366+0000 7f3331596640 1 Processor -- start 2024-04-25T15:44:27.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.366+0000 7f3331596640 1 -- start start 2024-04-25T15:44:27.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f3331596640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f332c0b5260 0x7f332c15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f3331596640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 0x7f332c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f3331596640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c152780 0x7f332c14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f3331596640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0d2e50 con 0x7f332c0d0750 2024-04-25T15:44:27.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f3331596640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0b5670 con 0x7f332c152780 2024-04-25T15:44:27.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f3331596640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f332c0d0b60 con 0x7f332c0b5260 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 0x7f332c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 0x7f332c14c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37680/0 (socket says 172.21.15.80:37680) 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 -- 172.21.15.80:0/3453240004 learned_addr learned my addr 172.21.15.80:0/3453240004 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332affd640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f332c0b5260 0x7f332c15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332b7fe640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c152780 0x7f332c14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 -- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f332c0b5260 msgr2=0x7f332c15c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f332c0b5260 0x7f332c15c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 -- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c152780 msgr2=0x7f332c14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c152780 0x7f332c14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.367+0000 7f332a7fc640 1 -- 172.21.15.80:0/3453240004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c15b1e0 con 0x7f332c0d0750 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.368+0000 7f332a7fc640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 0x7f332c14c4c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f332000c4d0 tx=0x7f332000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.368+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320017070 con 0x7f332c0d0750 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.368+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320005ce0 con 0x7f332c0d0750 2024-04-25T15:44:27.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.368+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c15b4c0 con 0x7f332c0d0750 2024-04-25T15:44:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.368+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200072b0 con 0x7f332c0d0750 2024-04-25T15:44:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.368+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c15ba80 con 0x7f332c0d0750 2024-04-25T15:44:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.369+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332c06a100 con 0x7f332c0d0750 2024-04-25T15:44:27.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.370+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f332001a070 con 0x7f332c0d0750 2024-04-25T15:44:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.370+0000 7f33137fe640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f33180744b0 0x7f33180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.370+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f33200945c0 con 0x7f332c0d0750 2024-04-25T15:44:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.370+0000 7f332affd640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f33180744b0 0x7f33180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.371+0000 7f332affd640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f33180744b0 0x7f33180769c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f331c000f60 tx=0x7f331c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.375+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f332005e690 con 0x7f332c0d0750 2024-04-25T15:44:27.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.552+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f332c15af70 con 0x7f332c0d0750 2024-04-25T15:44:27.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.552+0000 7f33137fe640 1 -- 172.21.15.80:0/3453240004 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7f3320062990 con 0x7f332c0d0750 2024-04-25T15:44:27.552 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f33180744b0 msgr2=0x7f33180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f33180744b0 0x7f33180769c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f331c000f60 tx=0x7f331c009040 comp rx=0 tx=0).stop 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 msgr2=0x7f332c14c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 0x7f332c14c4c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f332000c4d0 tx=0x7f332000c990 comp rx=0 tx=0).stop 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 shutdown_connections 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f33180744b0 0x7f33180769c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f332c152780 0x7f332c14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f332c0d0750 0x7f332c14c4c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 --2- 172.21.15.80:0/3453240004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f332c0b5260 0x7f332c15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 >> 172.21.15.80:0/3453240004 conn(0x7f332c06ea50 msgr2=0x7f332c159120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 shutdown_connections 2024-04-25T15:44:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.554+0000 7f3331596640 1 -- 172.21.15.80:0/3453240004 wait complete. 2024-04-25T15:44:27.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:44:27.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.675+0000 7f99e1e15640 1 Processor -- start 2024-04-25T15:44:27.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.675+0000 7f99e1e15640 1 -- start start 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.676+0000 7f99e1e15640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99dc06cc10 0x7f99dc06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99e1e15640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99dc0d2980 con 0x7f99dc0d1460 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99e1e15640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99dc0cfc90 con 0x7f99dc0b37b0 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99e1e15640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f99dc06c9a0 con 0x7f99dc06cc10 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99db7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99dc06cc10 0x7f99dc06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99dbfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99dc0d1460 0x7f99dc0d2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40284/0 (socket says 172.21.15.80:40284) 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99dbfff640 1 -- 172.21.15.80:0/1450230111 learned_addr learned my addr 172.21.15.80:0/1450230111 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99db7fe640 1 -- 172.21.15.80:0/1450230111 >> v1:172.21.15.195:6789/0 conn(0x7f99dc0b37b0 legacy=0x7f99dc0d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99db7fe640 1 -- 172.21.15.80:0/1450230111 >> v1:172.21.15.80:6789/0 conn(0x7f99dc0d1460 legacy=0x7f99dc0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.677+0000 7f99db7fe640 1 -- 172.21.15.80:0/1450230111 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc0d2c10 con 0x7f99dc06cc10 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.678+0000 7f99db7fe640 1 --2- 172.21.15.80:0/1450230111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc06cc10 0x7f99dc06d160 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0097a0 tx=0x7f99cc02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8fd762e8cda12b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.678+0000 7f99da7fc640 1 -- 172.21.15.80:0/1450230111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc037070 con 0x7f99dc06cc10 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.678+0000 7f99da7fc640 1 -- 172.21.15.80:0/1450230111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc02ad60 con 0x7f99dc06cc10 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.678+0000 7f99da7fc640 1 -- 172.21.15.80:0/1450230111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc032660 con 0x7f99dc06cc10 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.678+0000 7f99e1e15640 1 -- 172.21.15.80:0/1450230111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc06cc10 msgr2=0x7f99dc06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.678+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1450230111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc06cc10 0x7f99dc06d160 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0097a0 tx=0x7f99cc02a0d0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.679+0000 7f99e1e15640 1 -- 172.21.15.80:0/1450230111 shutdown_connections 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.679+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1450230111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc06cc10 0x7f99dc06d160 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.679+0000 7f99e1e15640 1 -- 172.21.15.80:0/1450230111 >> 172.21.15.80:0/1450230111 conn(0x7f99dc09b410 msgr2=0x7f99dc0b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.679+0000 7f99e1e15640 1 -- 172.21.15.80:0/1450230111 shutdown_connections 2024-04-25T15:44:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.679+0000 7f99e1e15640 1 -- 172.21.15.80:0/1450230111 wait complete. 2024-04-25T15:44:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.680+0000 7f99e1e15640 1 Processor -- start 2024-04-25T15:44:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.680+0000 7f99e1e15640 1 -- start start 2024-04-25T15:44:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99e1e15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99dc06cc10 0x7f99dc154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99e1e15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 0x7f99dc1fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99e1e15640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99dc0d1460 0x7f99dc0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99e1e15640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc06c670 con 0x7f99dc0b37b0 2024-04-25T15:44:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99e1e15640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc0d2ef0 con 0x7f99dc0d1460 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99e1e15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc076230 con 0x7f99dc06cc10 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 0x7f99dc1fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 0x7f99dc1fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37708/0 (socket says 172.21.15.80:37708) 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 -- 172.21.15.80:0/1504568470 learned_addr learned my addr 172.21.15.80:0/1504568470 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99db7fe640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99dc06cc10 0x7f99dc154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99dbfff640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99dc0d1460 0x7f99dc0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 -- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99dc06cc10 msgr2=0x7f99dc154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99dc06cc10 0x7f99dc154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 -- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99dc0d1460 msgr2=0x7f99dc0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99dc0d1460 0x7f99dc0aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 -- 172.21.15.80:0/1504568470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc1fa800 con 0x7f99dc0b37b0 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99dbfff640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99dc0d1460 0x7f99dc0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.682+0000 7f99daffd640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 0x7f99dc1fa2c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f99d000b3f0 tx=0x7f99d000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.683+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0015020 con 0x7f99dc0b37b0 2024-04-25T15:44:27.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.683+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0011830 con 0x7f99dc0b37b0 2024-04-25T15:44:27.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.683+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc0c7830 con 0x7f99dc0b37b0 2024-04-25T15:44:27.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.683+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0011c20 con 0x7f99dc0b37b0 2024-04-25T15:44:27.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.683+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc0c7df0 con 0x7f99dc0b37b0 2024-04-25T15:44:27.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.684+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc06a100 con 0x7f99dc0b37b0 2024-04-25T15:44:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.684+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f99d0018020 con 0x7f99dc0b37b0 2024-04-25T15:44:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.685+0000 7f99c3fff640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99c80744b0 0x7f99c80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.685+0000 7f99db7fe640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99c80744b0 0x7f99c80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.685+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f99d0094fd0 con 0x7f99dc0b37b0 2024-04-25T15:44:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.685+0000 7f99db7fe640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99c80744b0 0x7f99c80769c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99cc034000 tx=0x7f99cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.689+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99d001f030 con 0x7f99dc0b37b0 2024-04-25T15:44:27.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.865+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99dc0716b0 con 0x7f99dc0b37b0 2024-04-25T15:44:27.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.865+0000 7f99c3fff640 1 -- 172.21.15.80:0/1504568470 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7f99dc1fa800 con 0x7f99dc0b37b0 2024-04-25T15:44:27.867 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:44:27.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99c80744b0 msgr2=0x7f99c80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99c80744b0 0x7f99c80769c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99cc034000 tx=0x7f99cc02e000 comp rx=0 tx=0).stop 2024-04-25T15:44:27.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 msgr2=0x7f99dc1fa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 0x7f99dc1fa2c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f99d000b3f0 tx=0x7f99d000b8b0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 shutdown_connections 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99c80744b0 0x7f99c80769c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99dc0d1460 0x7f99dc0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99dc0b37b0 0x7f99dc1fa2c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 --2- 172.21.15.80:0/1504568470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99dc06cc10 0x7f99dc154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 >> 172.21.15.80:0/1504568470 conn(0x7f99dc09b410 msgr2=0x7f99dc162670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 shutdown_connections 2024-04-25T15:44:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.867+0000 7f99e1e15640 1 -- 172.21.15.80:0/1504568470 wait complete. 2024-04-25T15:44:27.880 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:44:27.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.988+0000 7fb4d694d640 1 Processor -- start 2024-04-25T15:44:27.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.988+0000 7fb4d694d640 1 -- start start 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4d694d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4d00b4b60 0x7fb4d00b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4d694d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d00b2f30 con 0x7fb4d006d6d0 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4d694d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d00b2c90 con 0x7fb4d00b3850 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4d694d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d006eb60 con 0x7fb4d00b4b60 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4cffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4d00b4b60 0x7fb4d00b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4cf7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4d006d6d0 0x7fb4d00b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40300/0 (socket says 172.21.15.80:40300) 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4cf7fe640 1 -- 172.21.15.80:0/4035354808 learned_addr learned my addr 172.21.15.80:0/4035354808 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4cffff640 1 -- 172.21.15.80:0/4035354808 >> v1:172.21.15.195:6789/0 conn(0x7fb4d00b3850 legacy=0x7fb4d016a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4cffff640 1 -- 172.21.15.80:0/4035354808 >> v1:172.21.15.80:6789/0 conn(0x7fb4d006d6d0 legacy=0x7fb4d00b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.990+0000 7fb4cffff640 1 -- 172.21.15.80:0/4035354808 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d00d10a0 con 0x7fb4d00b4b60 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.991+0000 7fb4cffff640 1 --2- 172.21.15.80:0/4035354808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b4b60 0x7fb4d00b91c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009790 tx=0x7fb4c002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1806b710619eb691 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.991+0000 7fb4ceffd640 1 -- 172.21.15.80:0/4035354808 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0037070 con 0x7fb4d00b4b60 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.991+0000 7fb4ceffd640 1 -- 172.21.15.80:0/4035354808 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c0032440 con 0x7fb4d00b4b60 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.991+0000 7fb4ceffd640 1 -- 172.21.15.80:0/4035354808 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0032810 con 0x7fb4d00b4b60 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 -- 172.21.15.80:0/4035354808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b4b60 msgr2=0x7fb4d00b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 --2- 172.21.15.80:0/4035354808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b4b60 0x7fb4d00b91c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009790 tx=0x7fb4c002a180 comp rx=0 tx=0).stop 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 -- 172.21.15.80:0/4035354808 shutdown_connections 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 --2- 172.21.15.80:0/4035354808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b4b60 0x7fb4d00b91c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 -- 172.21.15.80:0/4035354808 >> 172.21.15.80:0/4035354808 conn(0x7fb4d00d0450 msgr2=0x7fb4d00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 -- 172.21.15.80:0/4035354808 shutdown_connections 2024-04-25T15:44:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.992+0000 7fb4d694d640 1 -- 172.21.15.80:0/4035354808 wait complete. 2024-04-25T15:44:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.993+0000 7fb4d694d640 1 Processor -- start 2024-04-25T15:44:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.994+0000 7fb4d694d640 1 -- start start 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4d694d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4d006d6d0 0x7fb4d01d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4d694d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 0x7fb4d009e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4d694d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4d00b4b60 0x7fb4d009fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4d694d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d00d2f50 con 0x7fb4d00b3850 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4d694d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d00d13d0 con 0x7fb4d006d6d0 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4d694d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d009d0e0 con 0x7fb4d00b4b60 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 0x7fb4d009e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 0x7fb4d009e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37726/0 (socket says 172.21.15.80:37726) 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 -- 172.21.15.80:0/3346762864 learned_addr learned my addr 172.21.15.80:0/3346762864 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 -- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4d00b4b60 msgr2=0x7fb4d009fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4d00b4b60 0x7fb4d009fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 -- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4d006d6d0 msgr2=0x7fb4d01d7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cffff640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4d006d6d0 0x7fb4d01d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4d006d6d0 0x7fb4d01d7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 -- 172.21.15.80:0/3346762864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d01d80b0 con 0x7fb4d00b3850 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cffff640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4d006d6d0 0x7fb4d01d7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.995+0000 7fb4cf7fe640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 0x7fb4d009e100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400c3c0 tx=0x7fb4c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.996+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4017070 con 0x7fb4d00b3850 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.996+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c4005ce0 con 0x7fb4d00b3850 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.996+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40072d0 con 0x7fb4d00b3850 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.996+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d00a0c30 con 0x7fb4d00b3850 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.996+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d00a11f0 con 0x7fb4d00b3850 2024-04-25T15:44:27.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.997+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d006a100 con 0x7fb4d00b3850 2024-04-25T15:44:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.997+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb4c401a070 con 0x7fb4d00b3850 2024-04-25T15:44:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.998+0000 7fb4ccff9640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4bc0744e0 0x7fb4bc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.998+0000 7fb4cffff640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4bc0744e0 0x7fb4bc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.998+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb4c4094530 con 0x7fb4d00b3850 2024-04-25T15:44:28.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:27.998+0000 7fb4cffff640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4bc0744e0 0x7fb4bc0769f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0034000 tx=0x7fb4c002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.002+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4d01d80b0 con 0x7fb4d00b3850 2024-04-25T15:44:28.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.189+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb4d00d0be0 con 0x7fb4d00b3850 2024-04-25T15:44:28.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.189+0000 7fb4ccff9640 1 -- 172.21.15.80:0/3346762864 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7fb4c405e570 con 0x7fb4d00b3850 2024-04-25T15:44:28.190 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:44:28.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4bc0744e0 msgr2=0x7fb4bc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4bc0744e0 0x7fb4bc0769f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0034000 tx=0x7fb4c002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 msgr2=0x7fb4d009e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 0x7fb4d009e100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400c3c0 tx=0x7fb4c400c880 comp rx=0 tx=0).stop 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 shutdown_connections 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4bc0744e0 0x7fb4bc0769f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4d00b4b60 0x7fb4d009fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d00b3850 0x7fb4d009e100 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 --2- 172.21.15.80:0/3346762864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4d006d6d0 0x7fb4d01d7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 >> 172.21.15.80:0/3346762864 conn(0x7fb4d00d0450 msgr2=0x7fb4d00b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 shutdown_connections 2024-04-25T15:44:28.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.191+0000 7fb4d694d640 1 -- 172.21.15.80:0/3346762864 wait complete. 2024-04-25T15:44:28.204 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:44:28.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:28.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:28.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:44:28.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:28.231 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:44:28.286 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:28.286 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:28.305 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:28.305 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:28.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:28.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.470+0000 7f5785e84640 1 Processor -- start 2024-04-25T15:44:28.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.470+0000 7f5785e84640 1 -- start start 2024-04-25T15:44:28.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f5785e84640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5780153f70 0x7f57800b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f5785e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f578006dce0 0x7f57800b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f5785e84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57800b1180 con 0x7f57800b0c00 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f5785e84640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f578015d4f0 con 0x7f5780153f70 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f5785e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f578015e270 con 0x7f578006dce0 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577effd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f57800b0c00 0x7f578006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40310/0 (socket says 172.21.15.80:40310) 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577effd640 1 -- 172.21.15.80:0/2232326285 learned_addr learned my addr 172.21.15.80:0/2232326285 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577ffff640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f578006dce0 0x7f57800b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577f7fe640 1 --2- 172.21.15.80:0/2232326285 >> v2:172.21.15.195:3300/0 conn(0x7f5780153f70 0x7f57800b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384221828 0 0) 0x7f57800b1180 con 0x7f57800b0c00 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5768003520 con 0x7f57800b0c00 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 493259074 0 0) 0x7f5768003520 con 0x7f57800b0c00 2024-04-25T15:44:28.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f578006dce0 msgr2=0x7f57800b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f578006dce0 0x7f57800b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 >> v2:172.21.15.195:3300/0 conn(0x7f5780153f70 msgr2=0x7f57800b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 --2- 172.21.15.80:0/2232326285 >> v2:172.21.15.195:3300/0 conn(0x7f5780153f70 0x7f57800b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578015d790 con 0x7f57800b0c00 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f5774001670 con 0x7f57800b0c00 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 >> v1:172.21.15.80:6789/0 conn(0x7f57800b0c00 legacy=0x7f578006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680039b0 0x7f5768003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5768004800 0x7f5768004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5768005150 0x7f576800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f578015d4f0 con 0x7f57680039b0 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f578015e270 con 0x7f5768005150 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.472+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f576800bf00 con 0x7f5768004800 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577f7fe640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680039b0 0x7f5768003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577ffff640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5768005150 0x7f576800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577effd640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5768004800 0x7f5768004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577f7fe640 1 -- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5768004800 msgr2=0x7f5768004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577f7fe640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5768004800 0x7f5768004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577f7fe640 1 -- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5768005150 msgr2=0x7f576800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577f7fe640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5768005150 0x7f576800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.473+0000 7f577f7fe640 1 -- 172.21.15.80:0/2232326285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5768003520 con 0x7f57680039b0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f577f7fe640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680039b0 0x7f5768003e20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5770009ac0 tx=0x7f5768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cecbfce02974176 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770036070 con 0x7f57680039b0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770031400 con 0x7f57680039b0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f577e7fc640 1 -- 172.21.15.80:0/2232326285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770009690 con 0x7f57680039b0 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f5785e84640 1 -- 172.21.15.80:0/2232326285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680039b0 msgr2=0x7f5768003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f5785e84640 1 --2- 172.21.15.80:0/2232326285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57680039b0 0x7f5768003e20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5770009ac0 tx=0x7f5768005830 comp rx=0 tx=0).stop 2024-04-25T15:44:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f577ffff640 1 -- 172.21.15.80:0/2232326285 reap_dead start 2024-04-25T15:44:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f5785e84640 1 -- 172.21.15.80:0/2232326285 shutdown_connections 2024-04-25T15:44:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f5785e84640 1 -- 172.21.15.80:0/2232326285 >> 172.21.15.80:0/2232326285 conn(0x7f57800d1e20 msgr2=0x7f5780073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f5785e84640 1 -- 172.21.15.80:0/2232326285 shutdown_connections 2024-04-25T15:44:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.474+0000 7f5785e84640 1 -- 172.21.15.80:0/2232326285 wait complete. 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.476+0000 7f5785e84640 1 Processor -- start 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.476+0000 7f5785e84640 1 -- start start 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57680039b0 0x7f578015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 0x7f578009e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57801f60d0 0x7f578009ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57800af160 con 0x7f57801f71d0 2024-04-25T15:44:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f57800aefe0 con 0x7f57801f60d0 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f578006dce0 con 0x7f57680039b0 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 0x7f578009e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 0x7f578009e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37752/0 (socket says 172.21.15.80:37752) 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 -- 172.21.15.80:0/618979177 learned_addr learned my addr 172.21.15.80:0/618979177 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577ffff640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57801f60d0 0x7f578009ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577f7fe640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57680039b0 0x7f578015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 -- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57680039b0 msgr2=0x7f578015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57680039b0 0x7f578015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 -- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57801f60d0 msgr2=0x7f578009ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57801f60d0 0x7f578009ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 -- 172.21.15.80:0/618979177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578015b460 con 0x7f57801f71d0 2024-04-25T15:44:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f577effd640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 0x7f578009e680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5774007340 tx=0x7f5774007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577400f960 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5774018070 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57801f9be0 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577400fd40 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.478+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57801fa1a0 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.479+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578006a100 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.480+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f577401d460 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.480+0000 7f5767fff640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f576c0744e0 0x7f576c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.480+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5774095450 con 0x7f57801f71d0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.480+0000 7f577f7fe640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f576c0744e0 0x7f576c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.481+0000 7f577f7fe640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f576c0744e0 0x7f576c0769f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5770033000 tx=0x7f5770008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.485+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f577405fae0 con 0x7f57801f71d0 2024-04-25T15:44:28.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.665+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f578015b1b0 con 0x7f57801f71d0 2024-04-25T15:44:28.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.667+0000 7f5767fff640 1 -- 172.21.15.80:0/618979177 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f577405f3e0 con 0x7f57801f71d0 2024-04-25T15:44:28.668 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:28.668 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f576c0744e0 msgr2=0x7f576c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f576c0744e0 0x7f576c0769f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5770033000 tx=0x7f5770008030 comp rx=0 tx=0).stop 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 msgr2=0x7f578009e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 0x7f578009e680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5774007340 tx=0x7f5774007800 comp rx=0 tx=0).stop 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 shutdown_connections 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f576c0744e0 0x7f576c0769f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57801f60d0 0x7f578009ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57801f71d0 0x7f578009e680 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 --2- 172.21.15.80:0/618979177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57680039b0 0x7f578015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 >> 172.21.15.80:0/618979177 conn(0x7f57800d1e20 msgr2=0x7f57801534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:28.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 shutdown_connections 2024-04-25T15:44:28.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.669+0000 7f5785e84640 1 -- 172.21.15.80:0/618979177 wait complete. 2024-04-25T15:44:28.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:12.500873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:13.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:28.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:28.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.791+0000 7f16638d1640 1 Processor -- start 2024-04-25T15:44:28.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.791+0000 7f16638d1640 1 -- start start 2024-04-25T15:44:28.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.792+0000 7f16638d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 0x7f165c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.792+0000 7f16638d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f165c0718d0 0x7f165c071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f16638d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c072220 con 0x7f165c0b2db0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f16638d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f165c0cef30 con 0x7f165c0718d0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f16638d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f165c0b31c0 con 0x7f165c160090 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f166166d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f165c0b2db0 0x7f165c0d2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40322/0 (socket says 172.21.15.80:40322) 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f166166d640 1 -- 172.21.15.80:0/600153830 learned_addr learned my addr 172.21.15.80:0/600153830 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1660e6c640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 0x7f165c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1661e6e640 1 --2- 172.21.15.80:0/600153830 >> v2:172.21.15.195:3300/0 conn(0x7f165c0718d0 0x7f165c071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783533577 0 0) 0x7f1658001110 con 0x7f165c0b2db0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1648003520 con 0x7f165c0b2db0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2645420213 0 0) 0x7f1648003520 con 0x7f165c0b2db0 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 msgr2=0x7f165c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 0x7f165c06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 >> v2:172.21.15.195:3300/0 conn(0x7f165c0718d0 msgr2=0x7f165c071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 --2- 172.21.15.80:0/600153830 >> v2:172.21.15.195:3300/0 conn(0x7f165c0718d0 0x7f165c071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c0ce640 con 0x7f165c0b2db0 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f1658001840 con 0x7f165c0b2db0 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 >> v1:172.21.15.80:6789/0 conn(0x7f165c0b2db0 legacy=0x7f165c0d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16480039b0 0x7f1648003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1648004800 0x7f1648004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 0x7f1648005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0cef30 con 0x7f16480039b0 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0b31c0 con 0x7f1648004800 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f164800ba70 con 0x7f165c160090 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f166166d640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16480039b0 0x7f1648003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1660e6c640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1648004800 0x7f1648004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.793+0000 7f1661e6e640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 0x7f1648005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f166166d640 1 -- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 msgr2=0x7f1648005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f166166d640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c160090 0x7f1648005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f166166d640 1 -- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1648004800 msgr2=0x7f1648004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f166166d640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1648004800 0x7f1648004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f166166d640 1 -- 172.21.15.80:0/600153830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1648003520 con 0x7f16480039b0 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f166166d640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16480039b0 0x7f1648003e20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f165800c3b0 tx=0x7f1648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f026209bedb90990 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.794+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165800c0e0 con 0x7f16480039b0 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658034070 con 0x7f16480039b0 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f1653fff640 1 -- 172.21.15.80:0/600153830 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658005d30 con 0x7f16480039b0 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f16638d1640 1 -- 172.21.15.80:0/600153830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16480039b0 msgr2=0x7f1648003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f16638d1640 1 --2- 172.21.15.80:0/600153830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16480039b0 0x7f1648003e20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f165800c3b0 tx=0x7f1648005830 comp rx=0 tx=0).stop 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f1661e6e640 1 -- 172.21.15.80:0/600153830 reap_dead start 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f16638d1640 1 -- 172.21.15.80:0/600153830 shutdown_connections 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f16638d1640 1 -- 172.21.15.80:0/600153830 >> 172.21.15.80:0/600153830 conn(0x7f165c0d3a30 msgr2=0x7f165c0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f16638d1640 1 -- 172.21.15.80:0/600153830 shutdown_connections 2024-04-25T15:44:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.795+0000 7f16638d1640 1 -- 172.21.15.80:0/600153830 wait complete. 2024-04-25T15:44:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.797+0000 7f16638d1640 1 Processor -- start 2024-04-25T15:44:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.797+0000 7f16638d1640 1 -- start start 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f16638d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16480039b0 0x7f165c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f16638d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 0x7f165c1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f16638d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c0b8da0 0x7f165c0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f16638d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0cebc0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f16638d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0ce8e0 con 0x7f16480039b0 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f16638d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f165c1604a0 con 0x7f165c0b8da0 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f1660e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 0x7f165c1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f1660e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 0x7f165c1f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37782/0 (socket says 172.21.15.80:37782) 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.798+0000 7f1660e6c640 1 -- 172.21.15.80:0/3757352001 learned_addr learned my addr 172.21.15.80:0/3757352001 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1661e6e640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c0b8da0 0x7f165c0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f166166d640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16480039b0 0x7f165c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1660e6c640 1 -- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c0b8da0 msgr2=0x7f165c0b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1660e6c640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c0b8da0 0x7f165c0b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1660e6c640 1 -- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16480039b0 msgr2=0x7f165c0b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1660e6c640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16480039b0 0x7f165c0b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1660e6c640 1 -- 172.21.15.80:0/3757352001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c0b96f0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1661e6e640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c0b8da0 0x7f165c0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f166166d640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16480039b0 0x7f165c0b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1660e6c640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 0x7f165c1f61e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f164c0118e0 tx=0x7f164c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c00faf0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164c00fc90 con 0x7f165c1f5dd0 2024-04-25T15:44:28.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c0b7a60 con 0x7f165c1f5dd0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c014440 con 0x7f165c1f5dd0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.799+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c1e8ad0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.800+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c06a100 con 0x7f165c1f5dd0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.801+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f164c012040 con 0x7f165c1f5dd0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.801+0000 7f1651ffb640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16400744e0 0x7f16400769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.801+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f164c095ac0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.801+0000 7f166166d640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16400744e0 0x7f16400769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.802+0000 7f166166d640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16400744e0 0x7f16400769f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1658033000 tx=0x7f1658009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.806+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f165c0b96f0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.979+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f165c0b99b0 con 0x7f165c1f5dd0 2024-04-25T15:44:28.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.979+0000 7f1651ffb640 1 -- 172.21.15.80:0/3757352001 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f164c019030 con 0x7f165c1f5dd0 2024-04-25T15:44:28.981 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16400744e0 msgr2=0x7f16400769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16400744e0 0x7f16400769f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1658033000 tx=0x7f1658009030 comp rx=0 tx=0).stop 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 msgr2=0x7f165c1f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 0x7f165c1f61e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f164c0118e0 tx=0x7f164c011da0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 shutdown_connections 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16400744e0 0x7f16400769f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f165c0b8da0 0x7f165c0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f165c1f5dd0 0x7f165c1f61e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 --2- 172.21.15.80:0/3757352001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16480039b0 0x7f165c0b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 >> 172.21.15.80:0/3757352001 conn(0x7f165c0d3a30 msgr2=0x7f165c06d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 shutdown_connections 2024-04-25T15:44:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:28.981+0000 7f16638d1640 1 -- 172.21.15.80:0/3757352001 wait complete. 2024-04-25T15:44:28.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:44:29.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.104+0000 7fd47adce640 1 Processor -- start 2024-04-25T15:44:29.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.104+0000 7fd47adce640 1 -- start start 2024-04-25T15:44:29.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.105+0000 7fd47adce640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd4740d0a90 0x7fd474168e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.105+0000 7fd47adce640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd474161b00 con 0x7fd47415e060 2024-04-25T15:44:29.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.105+0000 7fd47adce640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd474161dc0 con 0x7fd4740b2b80 2024-04-25T15:44:29.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.105+0000 7fd47adce640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd4741620a0 con 0x7fd4740d0a90 2024-04-25T15:44:29.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.105+0000 7fd473fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd47415e060 0x7fd4740d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40332/0 (socket says 172.21.15.80:40332) 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.105+0000 7fd473fff640 1 -- 172.21.15.80:0/3914132365 learned_addr learned my addr 172.21.15.80:0/3914132365 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd47936b640 1 --2- 172.21.15.80:0/3914132365 >> v2:172.21.15.195:3300/0 conn(0x7fd4740d0a90 0x7fd474168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108687786 0 0) 0x7fd474161b00 con 0x7fd47415e060 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd464003520 con 0x7fd47415e060 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1775439426 0 0) 0x7fd464003520 con 0x7fd47415e060 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 >> v2:172.21.15.195:3300/0 conn(0x7fd4740d0a90 msgr2=0x7fd474168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 --2- 172.21.15.80:0/3914132365 >> v2:172.21.15.195:3300/0 conn(0x7fd4740d0a90 0x7fd474168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 >> v1:172.21.15.195:6789/0 conn(0x7fd4740b2b80 legacy=0x7fd4740cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd474162380 con 0x7fd47415e060 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fd460001670 con 0x7fd47415e060 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 >> v1:172.21.15.80:6789/0 conn(0x7fd47415e060 legacy=0x7fd4740d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd464003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd464004800 0x7fd464004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd464005250 0x7fd46400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741620a0 con 0x7fd4640039b0 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd46400c1e0 con 0x7fd464005250 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd46400c3e0 con 0x7fd464004800 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd464003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd47936b640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd464005250 0x7fd46400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd473fff640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd464004800 0x7fd464004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd478b6a640 1 -- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd464004800 msgr2=0x7fd464004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd464004800 0x7fd464004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd478b6a640 1 -- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd464005250 msgr2=0x7fd46400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd464005250 0x7fd46400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd478b6a640 1 -- 172.21.15.80:0/3914132365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd464003520 con 0x7fd4640039b0 2024-04-25T15:44:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd47936b640 1 -- 172.21.15.80:0/3914132365 reap_dead start 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.106+0000 7fd473fff640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd464004800 0x7fd464004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.107+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd464003e20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd468001750 tx=0x7fd464005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1662e793154b0d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.107+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468001370 con 0x7fd4640039b0 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.107+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4680052d0 con 0x7fd4640039b0 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.107+0000 7fd4737fe640 1 -- 172.21.15.80:0/3914132365 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46802ab90 con 0x7fd4640039b0 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 -- 172.21.15.80:0/3914132365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 msgr2=0x7fd464003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd464003e20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd468001750 tx=0x7fd464005830 comp rx=0 tx=0).stop 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 -- 172.21.15.80:0/3914132365 shutdown_connections 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 --2- 172.21.15.80:0/3914132365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd464003e20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 -- 172.21.15.80:0/3914132365 >> 172.21.15.80:0/3914132365 conn(0x7fd4740b54a0 msgr2=0x7fd4740b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:29.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 -- 172.21.15.80:0/3914132365 shutdown_connections 2024-04-25T15:44:29.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.108+0000 7fd47adce640 1 -- 172.21.15.80:0/3914132365 wait complete. 2024-04-25T15:44:29.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.110+0000 7fd47adce640 1 Processor -- start 2024-04-25T15:44:29.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.110+0000 7fd47adce640 1 -- start start 2024-04-25T15:44:29.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd47adce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd474155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd47adce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4740caab0 0x7fd47415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd47adce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4740c8ed0 0x7fd47415f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd47adce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd4740cee90 con 0x7fd4640039b0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd47adce640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd474162940 con 0x7fd4740caab0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd47adce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd4740cf010 con 0x7fd4740c8ed0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd478b6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd474155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd478b6a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd474155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37794/0 (socket says 172.21.15.80:37794) 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd478b6a640 1 -- 172.21.15.80:0/3704387440 learned_addr learned my addr 172.21.15.80:0/3704387440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd478b6a640 1 -- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4740c8ed0 msgr2=0x7fd47415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4740c8ed0 0x7fd47415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd473fff640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4740caab0 0x7fd47415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.111+0000 7fd478b6a640 1 -- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4740caab0 msgr2=0x7fd47415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4740caab0 0x7fd47415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd478b6a640 1 -- 172.21.15.80:0/3704387440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4740ca2c0 con 0x7fd4640039b0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd478b6a640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd474155270 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd468000c00 tx=0x7fd468001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468037040 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd468005480 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4741f8120 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468007a30 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.112+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4741f86e0 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.113+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd47406a100 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.114+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd468044030 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.114+0000 7fd4717fa640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4580744b0 0x7fd4580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.114+0000 7fd473fff640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4580744b0 0x7fd4580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.114+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd4680b4f10 con 0x7fd4640039b0 2024-04-25T15:44:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.115+0000 7fd473fff640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4580744b0 0x7fd4580769c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd460001eb0 tx=0x7fd460001c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.119+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd46804b020 con 0x7fd4640039b0 2024-04-25T15:44:29.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.293+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd4740b5d70 con 0x7fd4640039b0 2024-04-25T15:44:29.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.293+0000 7fd4717fa640 1 -- 172.21.15.80:0/3704387440 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7fd46807f5a0 con 0x7fd4640039b0 2024-04-25T15:44:29.294 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:29.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4580744b0 msgr2=0x7fd4580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4580744b0 0x7fd4580769c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd460001eb0 tx=0x7fd460001c10 comp rx=0 tx=0).stop 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 msgr2=0x7fd474155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd474155270 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd468000c00 tx=0x7fd468001120 comp rx=0 tx=0).stop 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 shutdown_connections 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4580744b0 0x7fd4580769c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4740c8ed0 0x7fd47415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4740caab0 0x7fd47415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 --2- 172.21.15.80:0/3704387440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4640039b0 0x7fd474155270 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 >> 172.21.15.80:0/3704387440 conn(0x7fd4740b54a0 msgr2=0x7fd47415d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 shutdown_connections 2024-04-25T15:44:29.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.295+0000 7fd47adce640 1 -- 172.21.15.80:0/3704387440 wait complete. 2024-04-25T15:44:29.307 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:44:29.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.416+0000 7f8ed1acd640 1 Processor -- start 2024-04-25T15:44:29.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.416+0000 7f8ed1acd640 1 -- start start 2024-04-25T15:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ed1acd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ecc15f170 0x7f8ecc0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ed1acd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc070c10 0x7f8ecc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ed1acd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ecc161a00 con 0x7f8ecc071020 2024-04-25T15:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ed1acd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8ecc0d1530 con 0x7f8ecc070c10 2024-04-25T15:44:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ed1acd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8ecc162610 con 0x7f8ecc15f170 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc070c10 0x7f8ecc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc070c10 0x7f8ecc06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37806/0 (socket says 172.21.15.80:37806) 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 -- 172.21.15.80:0/3091186521 learned_addr learned my addr 172.21.15.80:0/3091186521 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecb7fe640 1 --2- 172.21.15.80:0/3091186521 >> v2:172.21.15.195:3300/0 conn(0x7f8ecc15f170 0x7f8ecc0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 -- 172.21.15.80:0/3091186521 >> v2:172.21.15.195:3300/0 conn(0x7f8ecc15f170 msgr2=0x7f8ecc0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 --2- 172.21.15.80:0/3091186521 >> v2:172.21.15.195:3300/0 conn(0x7f8ecc15f170 0x7f8ecc0d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 -- 172.21.15.80:0/3091186521 >> v1:172.21.15.195:6789/0 conn(0x7f8ecc071020 legacy=0x7f8ecc06f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecaffd640 1 -- 172.21.15.80:0/3091186521 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ecc161ce0 con 0x7f8ecc070c10 2024-04-25T15:44:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.418+0000 7f8ecb7fe640 1 --2- 172.21.15.80:0/3091186521 >> v2:172.21.15.195:3300/0 conn(0x7f8ecc15f170 0x7f8ecc0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.419+0000 7f8ecaffd640 1 --2- 172.21.15.80:0/3091186521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc070c10 0x7f8ecc06d5d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc072c80 tx=0x7f8ec002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a637bb78110d5060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.419+0000 7f8eca7fc640 1 -- 172.21.15.80:0/3091186521 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0037070 con 0x7f8ecc070c10 2024-04-25T15:44:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.419+0000 7f8eca7fc640 1 -- 172.21.15.80:0/3091186521 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0032440 con 0x7f8ecc070c10 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.419+0000 7f8eca7fc640 1 -- 172.21.15.80:0/3091186521 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0032810 con 0x7f8ecc070c10 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 -- 172.21.15.80:0/3091186521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc070c10 msgr2=0x7f8ecc06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/3091186521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc070c10 0x7f8ecc06d5d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc072c80 tx=0x7f8ec002a270 comp rx=0 tx=0).stop 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 -- 172.21.15.80:0/3091186521 shutdown_connections 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/3091186521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc070c10 0x7f8ecc06d5d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/3091186521 >> v2:172.21.15.195:3300/0 conn(0x7f8ecc15f170 0x7f8ecc0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 -- 172.21.15.80:0/3091186521 >> 172.21.15.80:0/3091186521 conn(0x7f8ecc0734b0 msgr2=0x7f8ecc0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 -- 172.21.15.80:0/3091186521 shutdown_connections 2024-04-25T15:44:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.420+0000 7f8ed1acd640 1 -- 172.21.15.80:0/3091186521 wait complete. 2024-04-25T15:44:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.421+0000 7f8ed1acd640 1 Processor -- start 2024-04-25T15:44:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.422+0000 7f8ed1acd640 1 -- start start 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ed1acd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ecc070c10 0x7f8ecc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ed1acd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 0x7f8ecc14a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ed1acd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ecc15f170 0x7f8ecc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ed1acd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8ecc0af840 con 0x7f8ecc071020 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ed1acd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8ecc1622a0 con 0x7f8ecc15f170 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ed1acd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8ecc0af9c0 con 0x7f8ecc070c10 2024-04-25T15:44:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 0x7f8ecc14a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 0x7f8ecc14a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37816/0 (socket says 172.21.15.80:37816) 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 -- 172.21.15.80:0/1259873553 learned_addr learned my addr 172.21.15.80:0/1259873553 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecb7fe640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ecc070c10 0x7f8ecc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecbfff640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ecc15f170 0x7f8ecc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 -- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ecc070c10 msgr2=0x7f8ecc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ecc070c10 0x7f8ecc0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 -- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ecc15f170 msgr2=0x7f8ecc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ecc15f170 0x7f8ecc0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 -- 172.21.15.80:0/1259873553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ecc15f650 con 0x7f8ecc071020 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.423+0000 7f8ecaffd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 0x7f8ecc14a460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8ec002a2b0 tx=0x7f8ec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.424+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0041020 con 0x7f8ecc071020 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.424+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec00306c0 con 0x7f8ecc071020 2024-04-25T15:44:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.424+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ecc1e7dd0 con 0x7f8ecc071020 2024-04-25T15:44:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.424+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0037040 con 0x7f8ecc071020 2024-04-25T15:44:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.424+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ecc15f8f0 con 0x7f8ecc071020 2024-04-25T15:44:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.425+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ecc06a100 con 0x7f8ecc071020 2024-04-25T15:44:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.425+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8ec0044020 con 0x7f8ecc071020 2024-04-25T15:44:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.426+0000 7f8eb3fff640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8eb80744b0 0x7f8eb80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.426+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8ec00b5c30 con 0x7f8ecc071020 2024-04-25T15:44:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.426+0000 7f8ecb7fe640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8eb80744b0 0x7f8eb80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.426+0000 7f8ecb7fe640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8eb80744b0 0x7f8eb80769c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006fd0 tx=0x7f8ebc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.430+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ec004b030 con 0x7f8ecc071020 2024-04-25T15:44:29.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.611+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ecc1e7b60 con 0x7f8ecc071020 2024-04-25T15:44:29.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.611+0000 7f8eb3fff640 1 -- 172.21.15.80:0/1259873553 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7f8ec00801d0 con 0x7f8ecc071020 2024-04-25T15:44:29.613 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8eb80744b0 msgr2=0x7f8eb80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8eb80744b0 0x7f8eb80769c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006fd0 tx=0x7f8ebc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 msgr2=0x7f8ecc14a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 0x7f8ecc14a460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8ec002a2b0 tx=0x7f8ec00046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 shutdown_connections 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8eb80744b0 0x7f8eb80769c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ecc15f170 0x7f8ecc0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc071020 0x7f8ecc14a460 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 --2- 172.21.15.80:0/1259873553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ecc070c10 0x7f8ecc0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 >> 172.21.15.80:0/1259873553 conn(0x7f8ecc0734b0 msgr2=0x7f8ecc0ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 shutdown_connections 2024-04-25T15:44:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.613+0000 7f8ed1acd640 1 -- 172.21.15.80:0/1259873553 wait complete. 2024-04-25T15:44:29.626 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:44:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.733+0000 7f438db9e640 1 Processor -- start 2024-04-25T15:44:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.733+0000 7f438db9e640 1 -- start start 2024-04-25T15:44:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f438db9e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43880b0d80 0x7f438815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f438db9e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43880b65a0 0x7f4388073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f438db9e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43880703e0 con 0x7f438806fe10 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f438db9e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f43880affc0 con 0x7f43880b0d80 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f438db9e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43880b02a0 con 0x7f43880b65a0 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f43877fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43880b0d80 0x7f438815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f4387fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f438806fe10 0x7f4388160220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40336/0 (socket says 172.21.15.80:40336) 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f4387fff640 1 -- 172.21.15.80:0/1225415798 learned_addr learned my addr 172.21.15.80:0/1225415798 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f4386ffd640 1 --2- 172.21.15.80:0/1225415798 >> v2:172.21.15.195:3300/0 conn(0x7f43880b65a0 0x7f4388073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f43877fe640 1 -- 172.21.15.80:0/1225415798 >> v2:172.21.15.195:3300/0 conn(0x7f43880b65a0 msgr2=0x7f4388073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f43877fe640 1 --2- 172.21.15.80:0/1225415798 >> v2:172.21.15.195:3300/0 conn(0x7f43880b65a0 0x7f4388073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f43877fe640 1 -- 172.21.15.80:0/1225415798 >> v1:172.21.15.80:6789/0 conn(0x7f438806fe10 legacy=0x7f4388160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f43867fc640 1 -- 172.21.15.80:0/1225415798 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996829687 0 0) 0x7f43880703e0 con 0x7f438806fe10 2024-04-25T15:44:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.735+0000 7f43877fe640 1 -- 172.21.15.80:0/1225415798 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43880b0580 con 0x7f43880b0d80 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.736+0000 7f43877fe640 1 --2- 172.21.15.80:0/1225415798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43880b0d80 0x7f438815c670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f43880b5ae0 tx=0x7f437802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffe4623dd6828a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.736+0000 7f43867fc640 1 -- 172.21.15.80:0/1225415798 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378037070 con 0x7f43880b0d80 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.736+0000 7f43867fc640 1 -- 172.21.15.80:0/1225415798 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378032440 con 0x7f43880b0d80 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.736+0000 7f43867fc640 1 -- 172.21.15.80:0/1225415798 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378032810 con 0x7f43880b0d80 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 -- 172.21.15.80:0/1225415798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43880b0d80 msgr2=0x7f438815c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 --2- 172.21.15.80:0/1225415798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43880b0d80 0x7f438815c670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f43880b5ae0 tx=0x7f437802a1a0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 -- 172.21.15.80:0/1225415798 shutdown_connections 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 --2- 172.21.15.80:0/1225415798 >> v2:172.21.15.195:3300/0 conn(0x7f43880b65a0 0x7f4388073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 --2- 172.21.15.80:0/1225415798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43880b0d80 0x7f438815c670 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 -- 172.21.15.80:0/1225415798 >> 172.21.15.80:0/1225415798 conn(0x7f43880d1e20 msgr2=0x7f4388073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 -- 172.21.15.80:0/1225415798 shutdown_connections 2024-04-25T15:44:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.737+0000 7f438db9e640 1 -- 172.21.15.80:0/1225415798 wait complete. 2024-04-25T15:44:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.738+0000 7f438db9e640 1 Processor -- start 2024-04-25T15:44:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.739+0000 7f438db9e640 1 -- start start 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f438db9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 0x7f4388151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f438db9e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43880b0d80 0x7f438809d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f438db9e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43880b65a0 0x7f438815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f438db9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4388074070 con 0x7f438806fe10 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f438db9e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43880ae7c0 con 0x7f43880b65a0 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f438db9e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43880741f0 con 0x7f43880b0d80 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 0x7f4388151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 0x7f4388151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37834/0 (socket says 172.21.15.80:37834) 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 -- 172.21.15.80:0/627493102 learned_addr learned my addr 172.21.15.80:0/627493102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 -- 172.21.15.80:0/627493102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43880b0d80 msgr2=0x7f438809d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43880b0d80 0x7f438809d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 -- 172.21.15.80:0/627493102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43880b65a0 msgr2=0x7f438815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43880b65a0 0x7f438815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 -- 172.21.15.80:0/627493102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4388151e70 con 0x7f438806fe10 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.740+0000 7f43877fe640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 0x7f4388151400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4378000c00 tx=0x7f43780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.741+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378037040 con 0x7f438806fe10 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.741+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378042070 con 0x7f438806fe10 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.741+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438809f020 con 0x7f438806fe10 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.741+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378030bd0 con 0x7f438806fe10 2024-04-25T15:44:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.741+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4388152430 con 0x7f438806fe10 2024-04-25T15:44:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.742+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438806a100 con 0x7f438806fe10 2024-04-25T15:44:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.742+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4378047460 con 0x7f438806fe10 2024-04-25T15:44:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.743+0000 7f436ffff640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43740744b0 0x7f43740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.743+0000 7f4386ffd640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43740744b0 0x7f43740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.743+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f43780b60b0 con 0x7f438806fe10 2024-04-25T15:44:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.743+0000 7f4386ffd640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43740744b0 0x7f43740769c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.747+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4378032e20 con 0x7f438806fe10 2024-04-25T15:44:29.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.937+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4388068b00 con 0x7f438806fe10 2024-04-25T15:44:29.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.937+0000 7f436ffff640 1 -- 172.21.15.80:0/627493102 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f4378080630 con 0x7f438806fe10 2024-04-25T15:44:29.939 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43740744b0 msgr2=0x7f43740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43740744b0 0x7f43740769c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 msgr2=0x7f4388151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 0x7f4388151400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4378000c00 tx=0x7f43780046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 shutdown_connections 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43740744b0 0x7f43740769c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43880b65a0 0x7f438815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43880b0d80 0x7f438809d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 --2- 172.21.15.80:0/627493102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438806fe10 0x7f4388151400 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 >> 172.21.15.80:0/627493102 conn(0x7f43880d1e20 msgr2=0x7f43880b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.939+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 shutdown_connections 2024-04-25T15:44:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:29.940+0000 7f438db9e640 1 -- 172.21.15.80:0/627493102 wait complete. 2024-04-25T15:44:29.951 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:44:29.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:29.952 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:29.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:44:29.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:29.985 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:44:30.043 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:30.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.149+0000 7f757a134640 1 Processor -- start 2024-04-25T15:44:30.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.150+0000 7f757a134640 1 -- start start 2024-04-25T15:44:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f757a134640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f75740ce220 0x7f757409bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f757a134640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75741607c0 con 0x7f75740cf960 2024-04-25T15:44:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f757a134640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75740d0180 con 0x7f75740cfd70 2024-04-25T15:44:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f757a134640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f75740cf4d0 con 0x7f75740ce220 2024-04-25T15:44:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f7572ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f75740cf960 0x7f75740b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40346/0 (socket says 172.21.15.80:40346) 2024-04-25T15:44:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f7572ffd640 1 -- 172.21.15.80:0/4053052742 learned_addr learned my addr 172.21.15.80:0/4053052742 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3551647543 0 0) 0x7f75741607c0 con 0x7f75740cf960 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f75737fe640 1 --2- 172.21.15.80:0/4053052742 >> v2:172.21.15.195:3300/0 conn(0x7f75740ce220 0x7f757409bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f755c003520 con 0x7f75740cf960 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 139298548 0 0) 0x7f755c003520 con 0x7f75740cf960 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.151+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 >> v2:172.21.15.195:3300/0 conn(0x7f75740ce220 msgr2=0x7f757409bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 --2- 172.21.15.80:0/4053052742 >> v2:172.21.15.195:3300/0 conn(0x7f75740ce220 0x7f757409bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 >> v1:172.21.15.195:6789/0 conn(0x7f75740cfd70 legacy=0x7f75740d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75740ceba0 con 0x7f75740cf960 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f7568001670 con 0x7f75740cf960 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 >> v1:172.21.15.80:6789/0 conn(0x7f75740cf960 legacy=0x7f75740b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f755c0039b0 0x7f755c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f755c004800 0x7f755c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0051c0 0x7f755c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f75740cf4d0 con 0x7f755c0039b0 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f755c00c150 con 0x7f755c0051c0 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f755c00c350 con 0x7f755c004800 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75737fe640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f755c0039b0 0x7f755c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f7573fff640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0051c0 0x7f755c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f7572ffd640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f755c004800 0x7f755c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75737fe640 1 -- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f755c004800 msgr2=0x7f755c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75737fe640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f755c004800 0x7f755c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75737fe640 1 -- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0051c0 msgr2=0x7f755c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75737fe640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0051c0 0x7f755c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f75737fe640 1 -- 172.21.15.80:0/4053052742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c003520 con 0x7f755c0039b0 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f7573fff640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0051c0 0x7f755c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:30.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.152+0000 7f7573fff640 1 -- 172.21.15.80:0/4053052742 reap_dead start 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.153+0000 7f75737fe640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f755c0039b0 0x7f755c003e20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7564009ac0 tx=0x7f755c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ef5e314067f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.153+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564036070 con 0x7f755c0039b0 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.153+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7564031400 con 0x7f755c0039b0 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.153+0000 7f75727fc640 1 -- 172.21.15.80:0/4053052742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564009690 con 0x7f755c0039b0 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.153+0000 7f757a134640 1 -- 172.21.15.80:0/4053052742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f755c0039b0 msgr2=0x7f755c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.153+0000 7f757a134640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f755c0039b0 0x7f755c003e20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7564009ac0 tx=0x7f755c005830 comp rx=0 tx=0).stop 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.154+0000 7f757a134640 1 -- 172.21.15.80:0/4053052742 shutdown_connections 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.154+0000 7f757a134640 1 --2- 172.21.15.80:0/4053052742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f755c0039b0 0x7f755c003e20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.154+0000 7f757a134640 1 -- 172.21.15.80:0/4053052742 >> 172.21.15.80:0/4053052742 conn(0x7f75740b7620 msgr2=0x7f75740b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.154+0000 7f757a134640 1 -- 172.21.15.80:0/4053052742 shutdown_connections 2024-04-25T15:44:30.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.154+0000 7f757a134640 1 -- 172.21.15.80:0/4053052742 wait complete. 2024-04-25T15:44:30.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.155+0000 7f757a134640 1 Processor -- start 2024-04-25T15:44:30.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.156+0000 7f757a134640 1 -- start start 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f757a134640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0039b0 0x7f75740c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f757a134640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7574154190 0x7f75740cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f757a134640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 0x7f75740c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f757a134640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f75740cf160 con 0x7f75740cba90 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f757a134640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f75740ce630 con 0x7f755c0039b0 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f757a134640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f75740d3530 con 0x7f7574154190 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 0x7f75740c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 0x7f75740c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37844/0 (socket says 172.21.15.80:37844) 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 -- 172.21.15.80:0/1247082054 learned_addr learned my addr 172.21.15.80:0/1247082054 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f75737fe640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0039b0 0x7f75740c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 -- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7574154190 msgr2=0x7f75740cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7572ffd640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7574154190 0x7f75740cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7574154190 0x7f75740cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 -- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0039b0 msgr2=0x7f75740c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0039b0 0x7f75740c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 -- 172.21.15.80:0/1247082054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75741f9890 con 0x7f75740cba90 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f75737fe640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0039b0 0x7f75740c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f7573fff640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 0x7f75740c6440 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f75740d0c60 tx=0x7f756c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.157+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c003970 con 0x7f75740cba90 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.158+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756c018070 con 0x7f75740cba90 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.158+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75740cbea0 con 0x7f75740cba90 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.158+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c003d50 con 0x7f75740cba90 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.158+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75741fa070 con 0x7f75740cba90 2024-04-25T15:44:30.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.159+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75740b7a30 con 0x7f75740cba90 2024-04-25T15:44:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.159+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f756c0050d0 con 0x7f75740cba90 2024-04-25T15:44:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.160+0000 7f755bfff640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f75600744b0 0x7f75600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.160+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f756c095050 con 0x7f75740cba90 2024-04-25T15:44:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.160+0000 7f75737fe640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f75600744b0 0x7f75600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.160+0000 7f75737fe640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f75600744b0 0x7f75600769c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7564033000 tx=0x7f7564008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.164+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75740b7a30 con 0x7f75740cba90 2024-04-25T15:44:30.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.377+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f757406a100 con 0x7f75740cba90 2024-04-25T15:44:30.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.378+0000 7f755bfff640 1 -- 172.21.15.80:0/1247082054 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f756c05f650 con 0x7f75740cba90 2024-04-25T15:44:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:30.379 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:30.379 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.379+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f75600744b0 msgr2=0x7f75600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.379+0000 7f757a134640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f75600744b0 0x7f75600769c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7564033000 tx=0x7f7564008030 comp rx=0 tx=0).stop 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.379+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 msgr2=0x7f75740c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.379+0000 7f757a134640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 0x7f75740c6440 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f75740d0c60 tx=0x7f756c00eb90 comp rx=0 tx=0).stop 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 shutdown_connections 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f75600744b0 0x7f75600769c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75740cba90 0x7f75740c6440 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7574154190 0x7f75740cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 --2- 172.21.15.80:0/1247082054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f755c0039b0 0x7f75740c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 >> 172.21.15.80:0/1247082054 conn(0x7f75740b7620 msgr2=0x7f757406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:30.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 shutdown_connections 2024-04-25T15:44:30.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.380+0000 7f757a134640 1 -- 172.21.15.80:0/1247082054 wait complete. 2024-04-25T15:44:30.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-04-25T15:44:30.517 INFO:teuthology.orchestra.run.smithi080.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":37,"msgr_send_messages":35,"msgr_recv_bytes":9779,"msgr_send_bytes":22367,"msgr_created_connections":8,"msgr_active_connections":2,"msgr_running_total_time":0.005564530,"msgr_running_send_time":0.000703233,"msgr_running_recv_time":0.002741745,"msgr_running_fast_dispatch_time":0.000813401,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.073719712,"avgtime":0.002168226},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000002237,"avgtime":0.000000159},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":15,"msgr_send_messages":20,"msgr_recv_bytes":4440,"msgr_send_bytes":100798,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.014107701,"msgr_running_send_time":0.000531633,"msgr_running_recv_time":0.013038238,"msgr_running_fast_dispatch_time":0.000460828,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.176167974,"avgtime":0.009271998},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":96144},"AsyncMessenger::Worker-2":{"msgr_recv_messages":97,"msgr_send_messages":90,"msgr_recv_bytes":129335,"msgr_send_bytes":53375,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.007997850,"msgr_running_send_time":0.002167304,"msgr_running_recv_time":0.009347615,"msgr_running_fast_dispatch_time":0.000365729,"msgr_send_messages_queue_lat":{"avgcount":90,"sum":0.072384783,"avgtime":0.000804275},"msgr_handle_ack_lat":{"avgcount":58,"sum":0.000009134,"avgtime":0.000000157},"msgr_recv_encrypted_bytes":119072,"msgr_send_encrypted_bytes":11712},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":44,"sum":0.002637074,"avgtime":0.000059933}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000013827,"avgtime":0.000006913}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.004147381,"avgtime":0.000143013},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197025,"rdpos":0,"jlat":{"avgcount":5,"sum":0.009979720,"avgtime":0.001995944},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":112908,"heap":231804},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.003495392,"avgtime":0.000134438},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000361976,"avgtime":0.000180988},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000290013,"avgtime":0.000290013},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":2,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":224686,"buffer_anon_items":90,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53784,"mds_co_items":218,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13931,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":1.042976511,"avgtime":0.023704011},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":39,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":144,"get_sum":126232,"get_or_fail_fail":0,"get_or_fail_success":144,"take":0,"take_sum":0,"put":144,"put_sum":126232,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13931,"put":44,"put_sum":13931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x56530410a8f0":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2721,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-25T15:44:30.518 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 1.59e-07, "sum": 2.237e-06 }, "msgr_recv_bytes": 9779, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.000813401, "msgr_running_recv_time": 0.002741745, "msgr_running_send_time": 0.000703233, "msgr_running_total_time": 0.00556453, "msgr_send_bytes": 22367, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 35, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.002168226, "sum": 0.073719712 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 4440, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 15, "msgr_running_fast_dispatch_time": 0.000460828, "msgr_running_recv_time": 0.013038238, "msgr_running_send_time": 0.000531633, "msgr_running_total_time": 0.014107701, "msgr_send_bytes": 100798, "msgr_send_encrypted_bytes": 96144, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.009271998, "sum": 0.176167974 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 58, "avgtime": 1.57e-07, "sum": 9.134e-06 }, "msgr_recv_bytes": 129335, "msgr_recv_encrypted_bytes": 119072, "msgr_recv_messages": 97, "msgr_running_fast_dispatch_time": 0.000365729, "msgr_running_recv_time": 0.009347615, "msgr_running_send_time": 0.002167304, "msgr_running_total_time": 0.00799785, "msgr_send_bytes": 53375, "msgr_send_encrypted_bytes": 11712, "msgr_send_messages": 90, "msgr_send_messages_queue_lat": { "avgcount": 90, "avgtime": 0.000804275, "sum": 0.072384783 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 44, "avgtime": 5.9933e-05, "sum": 0.002637074 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.913e-06, "sum": 1.3827e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000143013, "sum": 0.004147381 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.001995944, "sum": 0.00997972 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197025 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 231804, "ino": 13, "ino+": 13, "ino-": 0, "rss": 112908 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000134438, "sum": 0.003495392 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000180988, "sum": 0.000361976 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000290013, "sum": 0.000290013 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 2, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 224686, "buffer_anon_items": 90, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53784, "mds_co_items": 218, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 39, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.023704011, "sum": 1.042976511 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13931, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 144, "get_or_fail_fail": 0, "get_or_fail_success": 144, "get_started": 0, "get_sum": 126232, "max": 104857600, "put": 144, "put_sum": 126232, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13931, "take": 44, "take_sum": 13931, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x56530410a8f0": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2721, "max": 3758096384, "put": 5, "put_sum": 2721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-25T15:44:30.519 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:44:30.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.626+0000 7ff6799ff640 1 Processor -- start 2024-04-25T15:44:30.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.626+0000 7ff6799ff640 1 -- start start 2024-04-25T15:44:30.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff6799ff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff67406e880 0x7ff6740d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff6799ff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff674163cf0 0x7ff674164100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff6799ff640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67406ed80 con 0x7ff6740b46d0 2024-04-25T15:44:30.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff6799ff640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff6740b4240 con 0x7ff67406e880 2024-04-25T15:44:30.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff6799ff640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff6740b3bf0 con 0x7ff674163cf0 2024-04-25T15:44:30.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff672ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff67406e880 0x7ff6740d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff672ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff67406e880 0x7ff6740d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37848/0 (socket says 172.21.15.80:37848) 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff672ffd640 1 -- 172.21.15.80:0/928149676 learned_addr learned my addr 172.21.15.80:0/928149676 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff672ffd640 1 -- 172.21.15.80:0/928149676 >> v2:172.21.15.195:3300/0 conn(0x7ff674163cf0 msgr2=0x7ff674164100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.627+0000 7ff6737fe640 1 --2- 172.21.15.80:0/928149676 >> v2:172.21.15.195:3300/0 conn(0x7ff674163cf0 0x7ff674164100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff672ffd640 1 --2- 172.21.15.80:0/928149676 >> v2:172.21.15.195:3300/0 conn(0x7ff674163cf0 0x7ff674164100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff672ffd640 1 -- 172.21.15.80:0/928149676 >> v1:172.21.15.195:6789/0 conn(0x7ff6740b46d0 legacy=0x7ff6740b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff672ffd640 1 -- 172.21.15.80:0/928149676 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6740b3ed0 con 0x7ff67406e880 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff6737fe640 1 --2- 172.21.15.80:0/928149676 >> v2:172.21.15.195:3300/0 conn(0x7ff674163cf0 0x7ff674164100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:30.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff672ffd640 1 --2- 172.21.15.80:0/928149676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67406e880 0x7ff6740d1970 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff674163c30 tx=0x7ff66402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7876f94eb3f941a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff671ffb640 1 -- 172.21.15.80:0/928149676 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664037070 con 0x7ff67406e880 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff671ffb640 1 -- 172.21.15.80:0/928149676 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664032440 con 0x7ff67406e880 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.628+0000 7ff671ffb640 1 -- 172.21.15.80:0/928149676 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664032810 con 0x7ff67406e880 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 -- 172.21.15.80:0/928149676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67406e880 msgr2=0x7ff6740d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 --2- 172.21.15.80:0/928149676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67406e880 0x7ff6740d1970 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff674163c30 tx=0x7ff66402a230 comp rx=0 tx=0).stop 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 -- 172.21.15.80:0/928149676 shutdown_connections 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 --2- 172.21.15.80:0/928149676 >> v2:172.21.15.195:3300/0 conn(0x7ff674163cf0 0x7ff674164100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 --2- 172.21.15.80:0/928149676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67406e880 0x7ff6740d1970 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 -- 172.21.15.80:0/928149676 >> 172.21.15.80:0/928149676 conn(0x7ff6740b7960 msgr2=0x7ff67409bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 -- 172.21.15.80:0/928149676 shutdown_connections 2024-04-25T15:44:30.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.629+0000 7ff6799ff640 1 -- 172.21.15.80:0/928149676 wait complete. 2024-04-25T15:44:30.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.631+0000 7ff6799ff640 1 Processor -- start 2024-04-25T15:44:30.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.631+0000 7ff6799ff640 1 -- start start 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6799ff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff67406e880 0x7ff67415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6799ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 0x7ff6740b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6799ff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff674163cf0 0x7ff67415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6799ff640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740d1eb0 con 0x7ff6740b46d0 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6799ff640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740cee30 con 0x7ff67406e880 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6799ff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff6740d2030 con 0x7ff674163cf0 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6727fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 0x7ff6740b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6727fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 0x7ff6740b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37858/0 (socket says 172.21.15.80:37858) 2024-04-25T15:44:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.632+0000 7ff6727fc640 1 -- 172.21.15.80:0/1004990258 learned_addr learned my addr 172.21.15.80:0/1004990258 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6737fe640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff674163cf0 0x7ff67415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff672ffd640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff67406e880 0x7ff67415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6727fc640 1 -- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff674163cf0 msgr2=0x7ff67415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6727fc640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff674163cf0 0x7ff67415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6727fc640 1 -- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff67406e880 msgr2=0x7ff67415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6727fc640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff67406e880 0x7ff67415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6727fc640 1 -- 172.21.15.80:0/1004990258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6740b3040 con 0x7ff6740b46d0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6737fe640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff674163cf0 0x7ff67415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6727fc640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 0x7ff6740b00d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff66800b420 tx=0x7ff66800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668011830 con 0x7ff6740b46d0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff668016070 con 0x7ff6740b46d0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6740b3320 con 0x7ff6740b46d0 2024-04-25T15:44:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668011c10 con 0x7ff6740b46d0 2024-04-25T15:44:30.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.633+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6740af8d0 con 0x7ff6740b46d0 2024-04-25T15:44:30.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.634+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67415de30 con 0x7ff6740b46d0 2024-04-25T15:44:30.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.635+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff66801b460 con 0x7ff6740b46d0 2024-04-25T15:44:30.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.635+0000 7ff65bfff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6600744e0 0x7ff6600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:30.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.635+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff6680950b0 con 0x7ff6740b46d0 2024-04-25T15:44:30.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.635+0000 7ff672ffd640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6600744e0 0x7ff6600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:30.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.636+0000 7ff672ffd640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6600744e0 0x7ff6600769f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff664034000 tx=0x7ff66402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:30.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.640+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff67415de30 con 0x7ff6740b46d0 2024-04-25T15:44:30.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.852+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff6740507b0 con 0x7ff6740b46d0 2024-04-25T15:44:30.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.853+0000 7ff65bfff640 1 -- 172.21.15.80:0/1004990258 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7ff66805f6b0 con 0x7ff6740b46d0 2024-04-25T15:44:30.854 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6600744e0 msgr2=0x7ff6600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6600744e0 0x7ff6600769f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff664034000 tx=0x7ff66402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 msgr2=0x7ff6740b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 0x7ff6740b00d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff66800b420 tx=0x7ff66800b8e0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 shutdown_connections 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6600744e0 0x7ff6600769f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff674163cf0 0x7ff67415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6740b46d0 0x7ff6740b00d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 --2- 172.21.15.80:0/1004990258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff67406e880 0x7ff67415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 >> 172.21.15.80:0/1004990258 conn(0x7ff6740b7960 msgr2=0x7ff6740d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 shutdown_connections 2024-04-25T15:44:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:30.855+0000 7ff6799ff640 1 -- 172.21.15.80:0/1004990258 wait complete. 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:44:30.867 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:30.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:30.868 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:44:30.883 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42686sec preferred_lft 42686sec 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.884 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:30.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:30.885 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:44:30.946 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:44:30.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:30.947 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:44:31.003 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:44:31.003 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:44:31.003 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:44:31.003 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:44:31.003 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:44:31.004 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:44:31.004 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:44:31.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:44:31.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:44:31.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:44:31.004 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:44:31.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:44:31.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:31.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:31.126 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:44:31.141 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:44:31.141 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:44:31.141 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:31.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:31.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:44:31.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:31.206 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:31.260 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:31.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:31.261 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:31.316 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:44:31.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:31.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:31.410 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:31.410 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:31.417 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:31.417 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:31.417 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:44:31.417 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:44:31.417 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:44:31.418 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:44:31.418 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:44:31.418 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:44:31.418 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:44:31.418 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:44:31.419 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:44:31.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:31.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:31.442 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:44:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:44:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:31.538 INFO:teuthology.orchestra.run.smithi080.stdout:client5682 2024-04-25T15:44:31.538 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:31.538 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:31.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-04-25T15:44:31.717 INFO:teuthology.orchestra.run.smithi080.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":38,"msgr_send_messages":36,"msgr_recv_bytes":10025,"msgr_send_bytes":22941,"msgr_created_connections":8,"msgr_active_connections":2,"msgr_running_total_time":0.005700807,"msgr_running_send_time":0.000729044,"msgr_running_recv_time":0.002763521,"msgr_running_fast_dispatch_time":0.000843133,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.073737089,"avgtime":0.002106773},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000002237,"avgtime":0.000000159},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":15,"msgr_send_messages":20,"msgr_recv_bytes":4440,"msgr_send_bytes":100798,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.014107701,"msgr_running_send_time":0.000531633,"msgr_running_recv_time":0.013038238,"msgr_running_fast_dispatch_time":0.000460828,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.176167974,"avgtime":0.009271998},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":96144},"AsyncMessenger::Worker-2":{"msgr_recv_messages":103,"msgr_send_messages":96,"msgr_recv_bytes":130876,"msgr_send_bytes":56254,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.008737898,"msgr_running_send_time":0.002422143,"msgr_running_recv_time":0.009921698,"msgr_running_fast_dispatch_time":0.000381987,"msgr_send_messages_queue_lat":{"avgcount":96,"sum":0.072462932,"avgtime":0.000754822},"msgr_handle_ack_lat":{"avgcount":67,"sum":0.000010954,"avgtime":0.000000163},"msgr_recv_encrypted_bytes":119344,"msgr_send_encrypted_bytes":12352},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":46,"sum":0.002683616,"avgtime":0.000058339}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000013827,"avgtime":0.000006913}},"mds":{"request":33,"reply":33,"reply_latency":{"avgcount":33,"sum":0.004672265,"avgtime":0.000141583},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":62,"traverse_hit":59,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197281,"rdpos":0,"jlat":{"avgcount":6,"sum":0.011926925,"avgtime":0.001987820},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":113036,"heap":231804},"mds_server":{"dispatch_client_request":33,"dispatch_server_request":0,"handle_client_request":33,"handle_client_session":7,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":29,"sum":0.003853353,"avgtime":0.000132874},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":3,"sum":0.000528899,"avgtime":0.000176299},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000290013,"avgtime":0.000290013},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":30,"average_load":30,"avg_session_uptime":2,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":224686,"buffer_anon_items":90,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53784,"mds_co_items":218,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":14187,"op_resend":37,"op_reply":45,"op_latency":{"avgcount":45,"sum":1.044976466,"avgtime":0.023221699},"op_inflight":0,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":39,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":151,"get_sum":127337,"get_or_fail_fail":0,"get_or_fail_success":151,"take":0,"take_sum":0,"put":151,"put_sum":127337,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":14187,"put":45,"put_sum":14187,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x56530410a8f0":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":2977,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":6,"put_sum":2977,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-25T15:44:31.718 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 1.59e-07, "sum": 2.237e-06 }, "msgr_recv_bytes": 10025, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 38, "msgr_running_fast_dispatch_time": 0.000843133, "msgr_running_recv_time": 0.002763521, "msgr_running_send_time": 0.000729044, "msgr_running_total_time": 0.005700807, "msgr_send_bytes": 22941, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.002106773, "sum": 0.073737089 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 4440, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 15, "msgr_running_fast_dispatch_time": 0.000460828, "msgr_running_recv_time": 0.013038238, "msgr_running_send_time": 0.000531633, "msgr_running_total_time": 0.014107701, "msgr_send_bytes": 100798, "msgr_send_encrypted_bytes": 96144, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.009271998, "sum": 0.176167974 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 67, "avgtime": 1.63e-07, "sum": 1.0954e-05 }, "msgr_recv_bytes": 130876, "msgr_recv_encrypted_bytes": 119344, "msgr_recv_messages": 103, "msgr_running_fast_dispatch_time": 0.000381987, "msgr_running_recv_time": 0.009921698, "msgr_running_send_time": 0.002422143, "msgr_running_total_time": 0.008737898, "msgr_send_bytes": 56254, "msgr_send_encrypted_bytes": 12352, "msgr_send_messages": 96, "msgr_send_messages_queue_lat": { "avgcount": 96, "avgtime": 0.000754822, "sum": 0.072462932 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 46, "avgtime": 5.8339e-05, "sum": 0.002683616 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.913e-06, "sum": 1.3827e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 33, "reply_latency": { "avgcount": 33, "avgtime": 0.000141583, "sum": 0.004672265 }, "request": 33, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 62, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 59, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.00198782, "sum": 0.011926925 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197281 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 231804, "ino": 13, "ino+": 13, "ino-": 0, "rss": 113036 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 33, "dispatch_server_request": 0, "handle_client_request": 33, "handle_client_session": 7, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 29, "avgtime": 0.000132874, "sum": 0.003853353 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 3, "avgtime": 0.000176299, "sum": 0.000528899 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000290013, "sum": 0.000290013 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 30, "avg_session_uptime": 2, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 30 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 224686, "buffer_anon_items": 90, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53784, "mds_co_items": 218, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 39, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 45, "avgtime": 0.023221699, "sum": 1.044976466 }, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 14187, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 151, "get_or_fail_fail": 0, "get_or_fail_success": 151, "get_started": 0, "get_sum": 127337, "max": 104857600, "put": 151, "put_sum": 127337, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 14187, "take": 45, "take_sum": 14187, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x56530410a8f0": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 2977, "max": 3758096384, "put": 6, "put_sum": 2977, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-25T15:44:31.718 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:31.718 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:31.734 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:31.734 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:31.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:31.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.936+0000 7f45d9249640 1 Processor -- start 2024-04-25T15:44:31.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.936+0000 7f45d9249640 1 -- start start 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.937+0000 7f45d9249640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45d40d2f60 0x7f45d4168b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.937+0000 7f45d9249640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d415e790 con 0x7f45d415e180 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.937+0000 7f45d9249640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d415ea70 con 0x7f45d409bee0 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.937+0000 7f45d9249640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f45d415f550 con 0x7f45d40d2f60 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d259c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f45d415e180 0x7f45d40d2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40358/0 (socket says 172.21.15.80:40358) 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d259c640 1 -- 172.21.15.80:0/77947113 learned_addr learned my addr 172.21.15.80:0/77947113 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d359e640 1 --2- 172.21.15.80:0/77947113 >> v2:172.21.15.195:3300/0 conn(0x7f45d40d2f60 0x7f45d4168b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189798197 0 0) 0x7f45d415e790 con 0x7f45d415e180 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45bc003520 con 0x7f45d415e180 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 187818514 0 0) 0x7f45bc003520 con 0x7f45d415e180 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 >> v2:172.21.15.195:3300/0 conn(0x7f45d40d2f60 msgr2=0x7f45d4168b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 --2- 172.21.15.80:0/77947113 >> v2:172.21.15.195:3300/0 conn(0x7f45d40d2f60 0x7f45d4168b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 >> v1:172.21.15.195:6789/0 conn(0x7f45d409bee0 legacy=0x7f45d40b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d415ed50 con 0x7f45d415e180 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f45c8001670 con 0x7f45d415e180 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 >> v1:172.21.15.80:6789/0 conn(0x7f45d415e180 legacy=0x7f45d40d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc0039b0 0x7f45bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc004800 0x7f45bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc00c090 con 0x7f45bc005150 2024-04-25T15:44:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc00c240 con 0x7f45bc004800 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f45bc00c440 con 0x7f45bc0039b0 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d359e640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d2d9d640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc0039b0 0x7f45bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.938+0000 7f45d259c640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc004800 0x7f45bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 -- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc0039b0 msgr2=0x7f45bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc0039b0 0x7f45bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 -- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc004800 msgr2=0x7f45bc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc004800 0x7f45bc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 -- 172.21.15.80:0/77947113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45bc003520 con 0x7f45bc005150 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d2d9d640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc0039b0 0x7f45bc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 -- 172.21.15.80:0/77947113 reap_dead start 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d359e640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45bc00b9c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009ac0 tx=0x7f45bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145fb092db049a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.939+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc009690 con 0x7f45bc005150 2024-04-25T15:44:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc004020 con 0x7f45bc005150 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d1d9b640 1 -- 172.21.15.80:0/77947113 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc004410 con 0x7f45bc005150 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 -- 172.21.15.80:0/77947113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 msgr2=0x7f45bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45bc00b9c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009ac0 tx=0x7f45bc005830 comp rx=0 tx=0).stop 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 -- 172.21.15.80:0/77947113 shutdown_connections 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 --2- 172.21.15.80:0/77947113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45bc00b9c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 -- 172.21.15.80:0/77947113 >> 172.21.15.80:0/77947113 conn(0x7f45d40b7620 msgr2=0x7f45d40b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 -- 172.21.15.80:0/77947113 shutdown_connections 2024-04-25T15:44:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.940+0000 7f45d9249640 1 -- 172.21.15.80:0/77947113 wait complete. 2024-04-25T15:44:31.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.942+0000 7f45d9249640 1 Processor -- start 2024-04-25T15:44:31.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.942+0000 7f45d9249640 1 -- start start 2024-04-25T15:44:31.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.943+0000 7f45d9249640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45d415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.943+0000 7f45d9249640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45d40b1ee0 0x7f45d40b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d9249640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d40c7600 0x7f45d40c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d9249640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40d29d0 con 0x7f45bc005150 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d9249640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40d2850 con 0x7f45d40c7600 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d9249640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f45d40d2b50 con 0x7f45d40b1ee0 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45d415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45d415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37880/0 (socket says 172.21.15.80:37880) 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 -- 172.21.15.80:0/1357402443 learned_addr learned my addr 172.21.15.80:0/1357402443 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d259c640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45d40b1ee0 0x7f45d40b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d359e640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d40c7600 0x7f45d40c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 -- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45d40b1ee0 msgr2=0x7f45d40b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45d40b1ee0 0x7f45d40b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 -- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d40c7600 msgr2=0x7f45d40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d40c7600 0x7f45d40c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 -- 172.21.15.80:0/1357402443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40b2c40 con 0x7f45bc005150 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d259c640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45d40b1ee0 0x7f45d40b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:31.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d359e640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d40c7600 0x7f45d40c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d2d9d640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45d415acf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f45c400e940 tx=0x7f45c400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4003b80 con 0x7f45bc005150 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c4018070 con 0x7f45bc005150 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d40c6b20 con 0x7f45bc005150 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c40050d0 con 0x7f45bc005150 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.944+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d40c70e0 con 0x7f45bc005150 2024-04-25T15:44:31.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.946+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d406a100 con 0x7f45bc005150 2024-04-25T15:44:31.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.946+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f45c4005270 con 0x7f45bc005150 2024-04-25T15:44:31.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.946+0000 7f45bb7fe640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45c00744e0 0x7f45c00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:31.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.946+0000 7f45d259c640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45c00744e0 0x7f45c00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:31.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.946+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f45c4095440 con 0x7f45bc005150 2024-04-25T15:44:31.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.947+0000 7f45d259c640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45c00744e0 0x7f45c00769f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f45c8000c00 tx=0x7f45c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:31.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:31.951+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45c405fad0 con 0x7f45bc005150 2024-04-25T15:44:32.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.126+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45d40d33b0 con 0x7f45bc005150 2024-04-25T15:44:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.127+0000 7f45bb7fe640 1 -- 172.21.15.80:0/1357402443 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f45c405f3d0 con 0x7f45bc005150 2024-04-25T15:44:32.129 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:32.129 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45c00744e0 msgr2=0x7f45c00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45c00744e0 0x7f45c00769f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f45c8000c00 tx=0x7f45c8009040 comp rx=0 tx=0).stop 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 msgr2=0x7f45d415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45d415acf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f45c400e940 tx=0x7f45c400ee00 comp rx=0 tx=0).stop 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 shutdown_connections 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45c00744e0 0x7f45c00769f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d40c7600 0x7f45d40c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45d40b1ee0 0x7f45d40b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 --2- 172.21.15.80:0/1357402443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc005150 0x7f45d415acf0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 >> 172.21.15.80:0/1357402443 conn(0x7f45d40b7620 msgr2=0x7f45d4161330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:32.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 shutdown_connections 2024-04-25T15:44:32.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.129+0000 7f45d9249640 1 -- 172.21.15.80:0/1357402443 wait complete. 2024-04-25T15:44:32.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:12.500873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:13.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:32.142 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:32.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.250+0000 7f6d76297640 1 Processor -- start 2024-04-25T15:44:32.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.250+0000 7f6d76297640 1 -- start start 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d76297640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 0x7f6d700d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d76297640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6d70070c10 0x7f6d7006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d76297640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d70161a00 con 0x7f6d70071020 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d76297640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6d700d1530 con 0x7f6d70070c10 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d76297640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d70162610 con 0x7f6d7015f170 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d74834640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6d70071020 0x7f6d7006f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40360/0 (socket says 172.21.15.80:40360) 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d74834640 1 -- 172.21.15.80:0/1015149448 learned_addr learned my addr 172.21.15.80:0/1015149448 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388326298 0 0) 0x7f6d70161a00 con 0x7f6d70071020 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d58003520 con 0x7f6d70071020 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6ffff640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 0x7f6d700d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6f7fe640 1 --2- 172.21.15.80:0/1015149448 >> v2:172.21.15.195:3300/0 conn(0x7f6d70070c10 0x7f6d7006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3864307263 0 0) 0x7f6d58003520 con 0x7f6d70071020 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 msgr2=0x7f6d700d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 0x7f6d700d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 >> v2:172.21.15.195:3300/0 conn(0x7f6d70070c10 msgr2=0x7f6d7006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 --2- 172.21.15.80:0/1015149448 >> v2:172.21.15.195:3300/0 conn(0x7f6d70070c10 0x7f6d7006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d70161ce0 con 0x7f6d70071020 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f6d680019f0 con 0x7f6d70071020 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 >> v1:172.21.15.80:6789/0 conn(0x7f6d70071020 legacy=0x7f6d7006f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 0x7f6d580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d58003f30 0x7f6d58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d58004d40 0x7f6d58005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d700d1530 con 0x7f6d58004d40 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70162610 con 0x7f6d58003f30 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.252+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5800ba10 con 0x7f6d7015f170 2024-04-25T15:44:32.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d74834640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d58004d40 0x7f6d58005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d6ffff640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 0x7f6d580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d6f7fe640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d58003f30 0x7f6d58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d74834640 1 -- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 msgr2=0x7f6d580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d74834640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d7015f170 0x7f6d580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d74834640 1 -- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d58003f30 msgr2=0x7f6d58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d74834640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d58003f30 0x7f6d58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.253+0000 7f6d74834640 1 -- 172.21.15.80:0/1015149448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d58003520 con 0x7f6d58004d40 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d74834640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d58004d40 0x7f6d58005150 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800a850 tx=0x7f6d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886772c6dda51856 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800a4a0 con 0x7f6d58004d40 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6802f070 con 0x7f6d58004d40 2024-04-25T15:44:32.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d6effd640 1 -- 172.21.15.80:0/1015149448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6802bcc0 con 0x7f6d58004d40 2024-04-25T15:44:32.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d76297640 1 -- 172.21.15.80:0/1015149448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d58004d40 msgr2=0x7f6d58005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d76297640 1 --2- 172.21.15.80:0/1015149448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d58004d40 0x7f6d58005150 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800a850 tx=0x7f6d58005830 comp rx=0 tx=0).stop 2024-04-25T15:44:32.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d74834640 1 -- 172.21.15.80:0/1015149448 reap_dead start 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d76297640 1 -- 172.21.15.80:0/1015149448 shutdown_connections 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d76297640 1 -- 172.21.15.80:0/1015149448 >> 172.21.15.80:0/1015149448 conn(0x7f6d700734b0 msgr2=0x7f6d700738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d76297640 1 -- 172.21.15.80:0/1015149448 shutdown_connections 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.254+0000 7f6d76297640 1 -- 172.21.15.80:0/1015149448 wait complete. 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.256+0000 7f6d76297640 1 Processor -- start 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.256+0000 7f6d76297640 1 -- start start 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d58004d40 0x7f6d70149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 0x7f6d701e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d70158cb0 0x7f6d701e8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d700af840 con 0x7f6d701588a0 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6d701622a0 con 0x7f6d70158cb0 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d700af9c0 con 0x7f6d58004d40 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 0x7f6d701e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 0x7f6d701e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37884/0 (socket says 172.21.15.80:37884) 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 -- 172.21.15.80:0/2621947584 learned_addr learned my addr 172.21.15.80:0/2621947584 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6ffff640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d58004d40 0x7f6d70149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d74834640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d70158cb0 0x7f6d701e8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 -- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d58004d40 msgr2=0x7f6d70149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d58004d40 0x7f6d70149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 -- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d70158cb0 msgr2=0x7f6d701e8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d70158cb0 0x7f6d701e8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 -- 172.21.15.80:0/2621947584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d70159790 con 0x7f6d701588a0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6ffff640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d58004d40 0x7f6d70149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6f7fe640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 0x7f6d701e85a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6d64011990 tx=0x7f6d64011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64019070 con 0x7f6d701588a0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d64004240 con 0x7f6d701588a0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400f860 con 0x7f6d701588a0 2024-04-25T15:44:32.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d701594b0 con 0x7f6d701588a0 2024-04-25T15:44:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.258+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d7015f9a0 con 0x7f6d701588a0 2024-04-25T15:44:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.260+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d7006a100 con 0x7f6d701588a0 2024-04-25T15:44:32.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.260+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6d6401c070 con 0x7f6d701588a0 2024-04-25T15:44:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.260+0000 7f6d6cff9640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d5c0744b0 0x7f6d5c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.260+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6d64095820 con 0x7f6d701588a0 2024-04-25T15:44:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.260+0000 7f6d6ffff640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d5c0744b0 0x7f6d5c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.261+0000 7f6d6ffff640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d5c0744b0 0x7f6d5c0769c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6d70073090 tx=0x7f6d60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.265+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d6405feb0 con 0x7f6d701588a0 2024-04-25T15:44:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.438+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d70074570 con 0x7f6d701588a0 2024-04-25T15:44:32.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.439+0000 7f6d6cff9640 1 -- 172.21.15.80:0/2621947584 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f6d6405f7b0 con 0x7f6d701588a0 2024-04-25T15:44:32.440 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d5c0744b0 msgr2=0x7f6d5c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d5c0744b0 0x7f6d5c0769c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6d70073090 tx=0x7f6d60008040 comp rx=0 tx=0).stop 2024-04-25T15:44:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 msgr2=0x7f6d701e85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 0x7f6d701e85a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6d64011990 tx=0x7f6d64011e50 comp rx=0 tx=0).stop 2024-04-25T15:44:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 shutdown_connections 2024-04-25T15:44:32.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d5c0744b0 0x7f6d5c0769c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d70158cb0 0x7f6d701e8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d701588a0 0x7f6d701e85a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 --2- 172.21.15.80:0/2621947584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d58004d40 0x7f6d70149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 >> 172.21.15.80:0/2621947584 conn(0x7f6d700734b0 msgr2=0x7f6d7006c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 shutdown_connections 2024-04-25T15:44:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.441+0000 7f6d76297640 1 -- 172.21.15.80:0/2621947584 wait complete. 2024-04-25T15:44:32.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:44:32.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.562+0000 7fae8a0d8640 1 Processor -- start 2024-04-25T15:44:32.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.562+0000 7fae8a0d8640 1 -- start start 2024-04-25T15:44:32.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae8a0d8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae8406cc10 0x7fae8406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae8a0d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae8a0d8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae840cfc90 con 0x7fae840b37b0 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae8a0d8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fae8406c9a0 con 0x7fae8406cc10 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae8a0d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fae840d2c10 con 0x7fae840d1460 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae8406cc10 0x7fae8406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae8406cc10 0x7fae8406d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37888/0 (socket says 172.21.15.80:37888) 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 -- 172.21.15.80:0/2645096461 learned_addr learned my addr 172.21.15.80:0/2645096461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae83fff640 1 --2- 172.21.15.80:0/2645096461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 -- 172.21.15.80:0/2645096461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 msgr2=0x7fae8406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 --2- 172.21.15.80:0/2645096461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 -- 172.21.15.80:0/2645096461 >> v1:172.21.15.195:6789/0 conn(0x7fae840b37b0 legacy=0x7fae840d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.564+0000 7fae837fe640 1 -- 172.21.15.80:0/2645096461 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840cff30 con 0x7fae8406cc10 2024-04-25T15:44:32.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.565+0000 7fae837fe640 1 --2- 172.21.15.80:0/2645096461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8406cc10 0x7fae8406d160 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fae74009870 tx=0x7fae7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1274bf32939670ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.565+0000 7fae827fc640 1 -- 172.21.15.80:0/2645096461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74037070 con 0x7fae8406cc10 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.565+0000 7fae827fc640 1 -- 172.21.15.80:0/2645096461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae74032440 con 0x7fae8406cc10 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.565+0000 7fae827fc640 1 -- 172.21.15.80:0/2645096461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74032810 con 0x7fae8406cc10 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2645096461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8406cc10 msgr2=0x7fae8406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2645096461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8406cc10 0x7fae8406d160 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fae74009870 tx=0x7fae7402a270 comp rx=0 tx=0).stop 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2645096461 shutdown_connections 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2645096461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2645096461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8406cc10 0x7fae8406d160 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2645096461 >> 172.21.15.80:0/2645096461 conn(0x7fae8409b410 msgr2=0x7fae840b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2645096461 shutdown_connections 2024-04-25T15:44:32.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.566+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2645096461 wait complete. 2024-04-25T15:44:32.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.567+0000 7fae8a0d8640 1 Processor -- start 2024-04-25T15:44:32.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.568+0000 7fae8a0d8640 1 -- start start 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae8a0d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae8406cc10 0x7fae84151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae8a0d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 0x7fae840cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae8a0d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae8a0d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fae84076230 con 0x7fae840b37b0 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae8a0d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fae8406c670 con 0x7fae8406cc10 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae8a0d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fae84163860 con 0x7fae840d1460 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 0x7fae840cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 0x7fae840cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37904/0 (socket says 172.21.15.80:37904) 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 -- 172.21.15.80:0/2302902697 learned_addr learned my addr 172.21.15.80:0/2302902697 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 -- 172.21.15.80:0/2302902697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 msgr2=0x7fae8415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 -- 172.21.15.80:0/2302902697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae8406cc10 msgr2=0x7fae84151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae8406cc10 0x7fae84151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 -- 172.21.15.80:0/2302902697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840c5b50 con 0x7fae840b37b0 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.569+0000 7fae82ffd640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 0x7fae840cc650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c3c0 tx=0x7fae7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.570+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780052d0 con 0x7fae840b37b0 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.570+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae78005490 con 0x7fae840b37b0 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.570+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae840c5e30 con 0x7fae840b37b0 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.570+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae78007260 con 0x7fae840b37b0 2024-04-25T15:44:32.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.570+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae840c63f0 con 0x7fae840b37b0 2024-04-25T15:44:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.571+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae840cd0f0 con 0x7fae840b37b0 2024-04-25T15:44:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.571+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fae78007400 con 0x7fae840b37b0 2024-04-25T15:44:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.572+0000 7fae6bfff640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae700744b0 0x7fae700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.572+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fae780948b0 con 0x7fae840b37b0 2024-04-25T15:44:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.572+0000 7fae837fe640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae700744b0 0x7fae700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.572+0000 7fae837fe640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae700744b0 0x7fae700769c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fae74034000 tx=0x7fae7402c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.576+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae7805ee30 con 0x7fae840b37b0 2024-04-25T15:44:32.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.749+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fae8406a100 con 0x7fae840b37b0 2024-04-25T15:44:32.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.750+0000 7fae6bfff640 1 -- 172.21.15.80:0/2302902697 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7fae7805e730 con 0x7fae840b37b0 2024-04-25T15:44:32.751 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:32.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae700744b0 msgr2=0x7fae700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae700744b0 0x7fae700769c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fae74034000 tx=0x7fae7402c000 comp rx=0 tx=0).stop 2024-04-25T15:44:32.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 msgr2=0x7fae840cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 0x7fae840cc650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c3c0 tx=0x7fae7800c880 comp rx=0 tx=0).stop 2024-04-25T15:44:32.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 shutdown_connections 2024-04-25T15:44:32.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae700744b0 0x7fae700769c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae840d1460 0x7fae8415ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae840b37b0 0x7fae840cc650 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 --2- 172.21.15.80:0/2302902697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae8406cc10 0x7fae84151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 >> 172.21.15.80:0/2302902697 conn(0x7fae8409b410 msgr2=0x7fae841615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:32.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 shutdown_connections 2024-04-25T15:44:32.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.752+0000 7fae8a0d8640 1 -- 172.21.15.80:0/2302902697 wait complete. 2024-04-25T15:44:32.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:44:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.874+0000 7fc0dc4ee640 1 Processor -- start 2024-04-25T15:44:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.874+0000 7fc0dc4ee640 1 -- start start 2024-04-25T15:44:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.875+0000 7fc0dc4ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0d406cc10 0x7fc0d406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.875+0000 7fc0dc4ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc0d40b37b0 0x7fc0d406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0dc4ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d40cfc90 con 0x7fc0d4163860 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0dc4ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d406c9a0 con 0x7fc0d406cc10 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0dc4ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d40d2c10 con 0x7fc0d40b37b0 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0d406cc10 0x7fc0d406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0d406cc10 0x7fc0d406d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37912/0 (socket says 172.21.15.80:37912) 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 -- 172.21.15.80:0/1034568534 learned_addr learned my addr 172.21.15.80:0/1034568534 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0d9a89640 1 --2- 172.21.15.80:0/1034568534 >> v2:172.21.15.195:3300/0 conn(0x7fc0d40b37b0 0x7fc0d406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 -- 172.21.15.80:0/1034568534 >> v2:172.21.15.195:3300/0 conn(0x7fc0d40b37b0 msgr2=0x7fc0d406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 --2- 172.21.15.80:0/1034568534 >> v2:172.21.15.195:3300/0 conn(0x7fc0d40b37b0 0x7fc0d406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 -- 172.21.15.80:0/1034568534 >> v1:172.21.15.195:6789/0 conn(0x7fc0d4163860 legacy=0x7fc0d40d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.876+0000 7fc0da28a640 1 -- 172.21.15.80:0/1034568534 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d40cff30 con 0x7fc0d406cc10 2024-04-25T15:44:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.877+0000 7fc0da28a640 1 --2- 172.21.15.80:0/1034568534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d406cc10 0x7fc0d406d160 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40b4cb0 tx=0x7fc0d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31db21ab8b933483 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.877+0000 7fc0d9288640 1 -- 172.21.15.80:0/1034568534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0037070 con 0x7fc0d406cc10 2024-04-25T15:44:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.877+0000 7fc0d9288640 1 -- 172.21.15.80:0/1034568534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d0032440 con 0x7fc0d406cc10 2024-04-25T15:44:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.877+0000 7fc0d9288640 1 -- 172.21.15.80:0/1034568534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0032810 con 0x7fc0d406cc10 2024-04-25T15:44:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.877+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/1034568534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d406cc10 msgr2=0x7fc0d406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.877+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/1034568534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d406cc10 0x7fc0d406d160 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40b4cb0 tx=0x7fc0d002a270 comp rx=0 tx=0).stop 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.878+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/1034568534 shutdown_connections 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.878+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/1034568534 >> v2:172.21.15.195:3300/0 conn(0x7fc0d40b37b0 0x7fc0d406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.878+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/1034568534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d406cc10 0x7fc0d406d160 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.878+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/1034568534 >> 172.21.15.80:0/1034568534 conn(0x7fc0d409b410 msgr2=0x7fc0d40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.878+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/1034568534 shutdown_connections 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.878+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/1034568534 wait complete. 2024-04-25T15:44:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.879+0000 7fc0dc4ee640 1 Processor -- start 2024-04-25T15:44:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.879+0000 7fc0dc4ee640 1 -- start start 2024-04-25T15:44:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0dc4ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0d406cc10 0x7fc0d40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0dc4ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 0x7fc0d40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0dc4ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0d4163860 0x7fc0d40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0dc4ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4076230 con 0x7fc0d40b37b0 2024-04-25T15:44:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0dc4ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d406c670 con 0x7fc0d406cc10 2024-04-25T15:44:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0dc4ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d40d1460 con 0x7fc0d4163860 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 0x7fc0d40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 0x7fc0d40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37926/0 (socket says 172.21.15.80:37926) 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 -- 172.21.15.80:0/3624708825 learned_addr learned my addr 172.21.15.80:0/3624708825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0da28a640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0d406cc10 0x7fc0d40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0daa8b640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0d4163860 0x7fc0d40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 -- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0d4163860 msgr2=0x7fc0d40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0d4163860 0x7fc0d40ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 -- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0d406cc10 msgr2=0x7fc0d40cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0d406cc10 0x7fc0d40cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 -- 172.21.15.80:0/3624708825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d40cd700 con 0x7fc0d40b37b0 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0d9a89640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 0x7fc0d40cc650 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400d5f0 tx=0x7fc0c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40125f0 con 0x7fc0d40b37b0 2024-04-25T15:44:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.881+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c4019070 con 0x7fc0d40b37b0 2024-04-25T15:44:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.882+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d40cd9e0 con 0x7fc0d40b37b0 2024-04-25T15:44:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.882+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40129d0 con 0x7fc0d40b37b0 2024-04-25T15:44:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.882+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d4154d00 con 0x7fc0d40b37b0 2024-04-25T15:44:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.882+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d406a100 con 0x7fc0d40b37b0 2024-04-25T15:44:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.883+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc0c4012b70 con 0x7fc0d40b37b0 2024-04-25T15:44:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.884+0000 7fc0caffd640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0b80744b0 0x7fc0b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.884+0000 7fc0da28a640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0b80744b0 0x7fc0b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.884+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc0c4095670 con 0x7fc0d40b37b0 2024-04-25T15:44:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.884+0000 7fc0da28a640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0b80744b0 0x7fc0b80769c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0034000 tx=0x7fc0d002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:32.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:32.888+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc0c405f6b0 con 0x7fc0d40b37b0 2024-04-25T15:44:33.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.064+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc0d40d29f0 con 0x7fc0d40b37b0 2024-04-25T15:44:33.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.064+0000 7fc0caffd640 1 -- 172.21.15.80:0/3624708825 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7fc0c40639b0 con 0x7fc0d40b37b0 2024-04-25T15:44:33.065 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:44:33.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0b80744b0 msgr2=0x7fc0b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0b80744b0 0x7fc0b80769c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0034000 tx=0x7fc0d002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 msgr2=0x7fc0d40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 0x7fc0d40cc650 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400d5f0 tx=0x7fc0c400dab0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 shutdown_connections 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc0b80744b0 0x7fc0b80769c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0d4163860 0x7fc0d40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0d40b37b0 0x7fc0d40cc650 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 --2- 172.21.15.80:0/3624708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0d406cc10 0x7fc0d40cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 >> 172.21.15.80:0/3624708825 conn(0x7fc0d409b410 msgr2=0x7fc0d4160750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 shutdown_connections 2024-04-25T15:44:33.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.066+0000 7fc0dc4ee640 1 -- 172.21.15.80:0/3624708825 wait complete. 2024-04-25T15:44:33.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:44:33.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.187+0000 7efc54f3c640 1 Processor -- start 2024-04-25T15:44:33.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.187+0000 7efc54f3c640 1 -- start start 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc54f3c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc500d2ed0 0x7efc50167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc54f3c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5006e990 con 0x7efc5009b950 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc54f3c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5006ec00 con 0x7efc5015d310 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc54f3c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7efc500d0610 con 0x7efc500d2ed0 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc4ed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc500d2ed0 0x7efc50167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc4dd9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc5009b950 0x7efc500d27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40374/0 (socket says 172.21.15.80:40374) 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.188+0000 7efc4dd9b640 1 -- 172.21.15.80:0/871998119 learned_addr learned my addr 172.21.15.80:0/871998119 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4ed9d640 1 -- 172.21.15.80:0/871998119 >> v1:172.21.15.195:6789/0 conn(0x7efc5015d310 legacy=0x7efc500cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4ed9d640 1 -- 172.21.15.80:0/871998119 >> v1:172.21.15.80:6789/0 conn(0x7efc5009b950 legacy=0x7efc500d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4d59a640 1 -- 172.21.15.80:0/871998119 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992966922 0 0) 0x7efc5006e990 con 0x7efc5009b950 2024-04-25T15:44:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4ed9d640 1 -- 172.21.15.80:0/871998119 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5006eee0 con 0x7efc500d2ed0 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4ed9d640 1 --2- 172.21.15.80:0/871998119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc500d2ed0 0x7efc50167cc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7efc48009d90 tx=0x7efc4802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d701023b2a7284bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4d59a640 1 -- 172.21.15.80:0/871998119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48031600 con 0x7efc500d2ed0 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4d59a640 1 -- 172.21.15.80:0/871998119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc480317a0 con 0x7efc500d2ed0 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.189+0000 7efc4d59a640 1 -- 172.21.15.80:0/871998119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48031b70 con 0x7efc500d2ed0 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 -- 172.21.15.80:0/871998119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc500d2ed0 msgr2=0x7efc50167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 --2- 172.21.15.80:0/871998119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc500d2ed0 0x7efc50167cc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7efc48009d90 tx=0x7efc4802a610 comp rx=0 tx=0).stop 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 -- 172.21.15.80:0/871998119 shutdown_connections 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 --2- 172.21.15.80:0/871998119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc500d2ed0 0x7efc50167cc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 -- 172.21.15.80:0/871998119 >> 172.21.15.80:0/871998119 conn(0x7efc500b7750 msgr2=0x7efc500b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 -- 172.21.15.80:0/871998119 shutdown_connections 2024-04-25T15:44:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.190+0000 7efc54f3c640 1 -- 172.21.15.80:0/871998119 wait complete. 2024-04-25T15:44:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.192+0000 7efc54f3c640 1 Processor -- start 2024-04-25T15:44:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.192+0000 7efc54f3c640 1 -- start start 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.193+0000 7efc54f3c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc5009b950 0x7efc500ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.193+0000 7efc54f3c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc5015d310 0x7efc5014b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.193+0000 7efc54f3c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 0x7efc501559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.193+0000 7efc54f3c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc50168200 con 0x7efc5014b960 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.193+0000 7efc54f3c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efc500d2020 con 0x7efc5009b950 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.193+0000 7efc54f3c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efc50168380 con 0x7efc5015d310 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 0x7efc501559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 0x7efc501559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37956/0 (socket says 172.21.15.80:37956) 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 -- 172.21.15.80:0/1943156174 learned_addr learned my addr 172.21.15.80:0/1943156174 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4e59c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc5009b950 0x7efc500ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4dd9b640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc5015d310 0x7efc5014b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 -- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc5015d310 msgr2=0x7efc5014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc5015d310 0x7efc5014b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 -- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc5009b950 msgr2=0x7efc500ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc5009b950 0x7efc500ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 -- 172.21.15.80:0/1943156174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc50157d80 con 0x7efc5014b960 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4dd9b640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc5015d310 0x7efc5014b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc4ed9d640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 0x7efc501559e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efc4802ac00 tx=0x7efc48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48040070 con 0x7efc5014b960 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc48030b60 con 0x7efc5014b960 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48045460 con 0x7efc5014b960 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc50158060 con 0x7efc5014b960 2024-04-25T15:44:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.194+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5014fb40 con 0x7efc5014b960 2024-04-25T15:44:33.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.195+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5006a100 con 0x7efc5014b960 2024-04-25T15:44:33.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.196+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efc48039040 con 0x7efc5014b960 2024-04-25T15:44:33.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.196+0000 7efc3effd640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc300744b0 0x7efc300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.196+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7efc480b6b30 con 0x7efc5014b960 2024-04-25T15:44:33.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.196+0000 7efc4e59c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc300744b0 0x7efc300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.197+0000 7efc4e59c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc300744b0 0x7efc300769c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efc40006fd0 tx=0x7efc40009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:33.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.201+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc480811f0 con 0x7efc5014b960 2024-04-25T15:44:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.389+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efc5009bf80 con 0x7efc5014b960 2024-04-25T15:44:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.390+0000 7efc3effd640 1 -- 172.21.15.80:0/1943156174 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7efc48080af0 con 0x7efc5014b960 2024-04-25T15:44:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc300744b0 msgr2=0x7efc300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc300744b0 0x7efc300769c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efc40006fd0 tx=0x7efc40009060 comp rx=0 tx=0).stop 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 msgr2=0x7efc501559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 0x7efc501559e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efc4802ac00 tx=0x7efc48004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 shutdown_connections 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc300744b0 0x7efc300769c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc5014b960 0x7efc501559e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc5015d310 0x7efc5014b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 --2- 172.21.15.80:0/1943156174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc5009b950 0x7efc500ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 >> 172.21.15.80:0/1943156174 conn(0x7efc500b7750 msgr2=0x7efc500afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:33.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 shutdown_connections 2024-04-25T15:44:33.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.392+0000 7efc54f3c640 1 -- 172.21.15.80:0/1943156174 wait complete. 2024-04-25T15:44:33.404 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:44:33.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:33.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:33.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:44:33.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:33.430 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:44:33.478 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:33.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-04-25T15:44:33.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:44:33.648 INFO:teuthology.orchestra.run.smithi080.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":39,"msgr_send_messages":37,"msgr_recv_bytes":10271,"msgr_send_bytes":23400,"msgr_created_connections":8,"msgr_active_connections":2,"msgr_running_total_time":0.005796697,"msgr_running_send_time":0.000756932,"msgr_running_recv_time":0.002782227,"msgr_running_fast_dispatch_time":0.000870292,"msgr_send_messages_queue_lat":{"avgcount":36,"sum":0.073754906,"avgtime":0.002048747},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000002237,"avgtime":0.000000159},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":15,"msgr_send_messages":20,"msgr_recv_bytes":4440,"msgr_send_bytes":100798,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.014107701,"msgr_running_send_time":0.000531633,"msgr_running_recv_time":0.013038238,"msgr_running_fast_dispatch_time":0.000460828,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.176167974,"avgtime":0.009271998},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":96144},"AsyncMessenger::Worker-2":{"msgr_recv_messages":106,"msgr_send_messages":97,"msgr_recv_bytes":131530,"msgr_send_bytes":56372,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.009006710,"msgr_running_send_time":0.002489222,"msgr_running_recv_time":0.010086234,"msgr_running_fast_dispatch_time":0.000428008,"msgr_send_messages_queue_lat":{"avgcount":97,"sum":0.072475046,"avgtime":0.000747165},"msgr_handle_ack_lat":{"avgcount":70,"sum":0.000011394,"avgtime":0.000000162},"msgr_recv_encrypted_bytes":119344,"msgr_send_encrypted_bytes":12352},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.002741684,"avgtime":0.000057118}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000013827,"avgtime":0.000006913}},"mds":{"request":33,"reply":33,"reply_latency":{"avgcount":33,"sum":0.004672265,"avgtime":0.000141583},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":62,"traverse_hit":59,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":10,"evex":0,"evtrm":0,"ev":10,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197422,"rdpos":0,"jlat":{"avgcount":7,"sum":0.013991202,"avgtime":0.001998743},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":113292,"heap":231804},"mds_server":{"dispatch_client_request":33,"dispatch_server_request":0,"handle_client_request":33,"handle_client_session":9,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":29,"sum":0.003853353,"avgtime":0.000132874},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":3,"sum":0.000528899,"avgtime":0.000176299},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000290013,"avgtime":0.000290013},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":30,"average_load":30,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":232447,"buffer_anon_items":86,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53424,"mds_co_items":217,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":14328,"op_resend":37,"op_reply":46,"op_latency":{"avgcount":46,"sum":1.046976421,"avgtime":0.022760356},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":70},"op":46,"op_r":0,"op_w":46,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":39,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":155,"get_sum":127877,"get_or_fail_fail":0,"get_or_fail_success":155,"take":0,"take_sum":0,"put":155,"put_sum":127877,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":14328,"put":46,"put_sum":14328,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x56530410a8f0":{"val":0,"max":3758096384,"get_started":0,"get":10,"get_sum":3118,"get_or_fail_fail":0,"get_or_fail_success":10,"take":0,"take_sum":0,"put":7,"put_sum":3118,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-25T15:44:33.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 1.59e-07, "sum": 2.237e-06 }, "msgr_recv_bytes": 10271, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 39, "msgr_running_fast_dispatch_time": 0.000870292, "msgr_running_recv_time": 0.002782227, "msgr_running_send_time": 0.000756932, "msgr_running_total_time": 0.005796697, "msgr_send_bytes": 23400, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 36, "avgtime": 0.002048747, "sum": 0.073754906 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 4440, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 15, "msgr_running_fast_dispatch_time": 0.000460828, "msgr_running_recv_time": 0.013038238, "msgr_running_send_time": 0.000531633, "msgr_running_total_time": 0.014107701, "msgr_send_bytes": 100798, "msgr_send_encrypted_bytes": 96144, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.009271998, "sum": 0.176167974 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 70, "avgtime": 1.62e-07, "sum": 1.1394e-05 }, "msgr_recv_bytes": 131530, "msgr_recv_encrypted_bytes": 119344, "msgr_recv_messages": 106, "msgr_running_fast_dispatch_time": 0.000428008, "msgr_running_recv_time": 0.010086234, "msgr_running_send_time": 0.002489222, "msgr_running_total_time": 0.00900671, "msgr_send_bytes": 56372, "msgr_send_encrypted_bytes": 12352, "msgr_send_messages": 97, "msgr_send_messages_queue_lat": { "avgcount": 97, "avgtime": 0.000747165, "sum": 0.072475046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 5.7118e-05, "sum": 0.002741684 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.913e-06, "sum": 1.3827e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 33, "reply_latency": { "avgcount": 33, "avgtime": 0.000141583, "sum": 0.004672265 }, "request": 33, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 62, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 59, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 10, "evadd": 10, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.001998743, "sum": 0.013991202 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197422 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 231804, "ino": 13, "ino+": 13, "ino-": 0, "rss": 113292 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 33, "dispatch_server_request": 0, "handle_client_request": 33, "handle_client_session": 9, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 29, "avgtime": 0.000132874, "sum": 0.003853353 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 3, "avgtime": 0.000176299, "sum": 0.000528899 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000290013, "sum": 0.000290013 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 30, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 30 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 232447, "buffer_anon_items": 86, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53424, "mds_co_items": 217, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 39, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.022760356, "sum": 1.046976421 }, "op_pg": 0, "op_r": 0, "op_reply": 46, "op_resend": 37, "op_rmw": 0, "op_send": 46, "op_send_bytes": 14328, "op_w": 46, "oplen_avg": { "avgcount": 46, "sum": 70 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 155, "get_or_fail_fail": 0, "get_or_fail_success": 155, "get_started": 0, "get_sum": 127877, "max": 104857600, "put": 155, "put_sum": 127877, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 14328, "take": 46, "take_sum": 14328, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x56530410a8f0": { "get": 10, "get_or_fail_fail": 0, "get_or_fail_success": 10, "get_started": 0, "get_sum": 3118, "max": 3758096384, "put": 7, "put_sum": 3118, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-25T15:44:33.649 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T15:44:33.650 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:44:33.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:44:33.686 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:44:33.731 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:44:33.731 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:44:33.732 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:33.732 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:33.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:44:33.747 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:44:33.747 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:33.747 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:33.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:44:33.765 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:44:33.765 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:33.765 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:33.802 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:44:33.802 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:44:33.802 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:33.802 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:33.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:44:33.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:33.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.949+0000 7f8e23005640 1 Processor -- start 2024-04-25T15:44:33.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.949+0000 7f8e23005640 1 -- start start 2024-04-25T15:44:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.950+0000 7f8e23005640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e1c15dfe0 0x7f8e1c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.950+0000 7f8e23005640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e1c0d19c0 0x7f8e1c0b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e23005640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1c0b7600 con 0x7f8e1c154110 2024-04-25T15:44:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e23005640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1c15e3f0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e23005640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1c0d0ff0 con 0x7f8e1c15dfe0 2024-04-25T15:44:33.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e20da1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8e1c154110 0x7f8e1c06c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40390/0 (socket says 172.21.15.80:40390) 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e20da1640 1 -- 172.21.15.80:0/692384544 learned_addr learned my addr 172.21.15.80:0/692384544 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e215a2640 1 --2- 172.21.15.80:0/692384544 >> v2:172.21.15.80:3300/0 conn(0x7f8e1c0d19c0 0x7f8e1c0b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e215a2640 1 -- 172.21.15.80:0/692384544 >> v2:172.21.15.195:3300/0 conn(0x7f8e1c15dfe0 msgr2=0x7f8e1c0d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e215a2640 1 --2- 172.21.15.80:0/692384544 >> v2:172.21.15.195:3300/0 conn(0x7f8e1c15dfe0 0x7f8e1c0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e215a2640 1 -- 172.21.15.80:0/692384544 >> v1:172.21.15.80:6789/0 conn(0x7f8e1c154110 legacy=0x7f8e1c06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e1b7fe640 1 -- 172.21.15.80:0/692384544 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899282041 0 0) 0x7f8e1c0b7600 con 0x7f8e1c154110 2024-04-25T15:44:33.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.951+0000 7f8e215a2640 1 -- 172.21.15.80:0/692384544 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c06ccd0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e215a2640 1 --2- 172.21.15.80:0/692384544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c0b5bd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0d3130 tx=0x7f8e1402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b1a05420640da1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e1b7fe640 1 -- 172.21.15.80:0/692384544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14007740 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e1b7fe640 1 -- 172.21.15.80:0/692384544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e140078e0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e1b7fe640 1 -- 172.21.15.80:0/692384544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14007cb0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e23005640 1 -- 172.21.15.80:0/692384544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 msgr2=0x7f8e1c0b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e23005640 1 --2- 172.21.15.80:0/692384544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c0b5bd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0d3130 tx=0x7f8e1402a680 comp rx=0 tx=0).stop 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e23005640 1 -- 172.21.15.80:0/692384544 shutdown_connections 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e23005640 1 --2- 172.21.15.80:0/692384544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c0b5bd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e23005640 1 --2- 172.21.15.80:0/692384544 >> v2:172.21.15.195:3300/0 conn(0x7f8e1c15dfe0 0x7f8e1c0d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.952+0000 7f8e23005640 1 -- 172.21.15.80:0/692384544 >> 172.21.15.80:0/692384544 conn(0x7f8e1c0d2080 msgr2=0x7f8e1c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.953+0000 7f8e23005640 1 -- 172.21.15.80:0/692384544 shutdown_connections 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.953+0000 7f8e23005640 1 -- 172.21.15.80:0/692384544 wait complete. 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.954+0000 7f8e23005640 1 Processor -- start 2024-04-25T15:44:33.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.954+0000 7f8e23005640 1 -- start start 2024-04-25T15:44:33.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e23005640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e23005640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e1c154110 0x7f8e1c150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e23005640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c15dfe0 0x7f8e1c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e23005640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c0b7320 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e23005640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c0d0cc0 con 0x7f8e1c15dfe0 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e23005640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1c0d1dd0 con 0x7f8e1c154110 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c1519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37966/0 (socket says 172.21.15.80:37966) 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 -- 172.21.15.80:0/1875841248 learned_addr learned my addr 172.21.15.80:0/1875841248 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e215a2640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c15dfe0 0x7f8e1c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e1bfff640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e1c154110 0x7f8e1c150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 -- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e1c154110 msgr2=0x7f8e1c150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e1c154110 0x7f8e1c150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 -- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c15dfe0 msgr2=0x7f8e1c14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:33.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c15dfe0 0x7f8e1c14d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 -- 172.21.15.80:0/1875841248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c150930 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e215a2640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c15dfe0 0x7f8e1c14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.956+0000 7f8e20da1640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c1519d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c430 tx=0x7f8e0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.957+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0074e0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.957+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0047e0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.957+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c150c10 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.957+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c004bd0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.957+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c1511d0 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.958+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c153d00 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.958+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8e0c011070 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.959+0000 7f8e197fa640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e080744b0 0x7f8e080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.959+0000 7f8e1bfff640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e080744b0 0x7f8e080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.959+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8e0c095160 con 0x7f8e1c0d19c0 2024-04-25T15:44:33.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.959+0000 7f8e1bfff640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e080744b0 0x7f8e080769c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0d1860 tx=0x7f8e10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:33.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:33.963+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e1c153d00 con 0x7f8e1c0d19c0 2024-04-25T15:44:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.174+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e1c15efd0 con 0x7f8e1c0d19c0 2024-04-25T15:44:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.174+0000 7f8e197fa640 1 -- 172.21.15.80:0/1875841248 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f8e1c15efd0 con 0x7f8e1c0d19c0 2024-04-25T15:44:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:34.176 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.176+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e080744b0 msgr2=0x7f8e080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.176+0000 7f8e23005640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e080744b0 0x7f8e080769c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0d1860 tx=0x7f8e10008040 comp rx=0 tx=0).stop 2024-04-25T15:44:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.176+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 msgr2=0x7f8e1c1519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.176+0000 7f8e23005640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c1519d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c430 tx=0x7f8e0c00c8f0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.176+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 shutdown_connections 2024-04-25T15:44:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.176+0000 7f8e23005640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e080744b0 0x7f8e080769c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.177+0000 7f8e23005640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c15dfe0 0x7f8e1c14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.177+0000 7f8e23005640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e1c154110 0x7f8e1c150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.177+0000 7f8e23005640 1 --2- 172.21.15.80:0/1875841248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e1c0d19c0 0x7f8e1c1519d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.177+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 >> 172.21.15.80:0/1875841248 conn(0x7f8e1c0d2080 msgr2=0x7f8e1c160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.177+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 shutdown_connections 2024-04-25T15:44:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.177+0000 7f8e23005640 1 -- 172.21.15.80:0/1875841248 wait complete. 2024-04-25T15:44:34.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:34.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.295+0000 7fb2c8d9d640 1 Processor -- start 2024-04-25T15:44:34.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.295+0000 7fb2c8d9d640 1 -- start start 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.296+0000 7fb2c8d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2c4153f70 0x7fb2c40b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.296+0000 7fb2c8d9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c40b1180 con 0x7fb2c40b0c00 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.296+0000 7fb2c8d9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c415d4f0 con 0x7fb2c406dce0 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.296+0000 7fb2c8d9d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c415e270 con 0x7fb2c4153f70 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2c4153f70 0x7fb2c40b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2c4153f70 0x7fb2c40b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37978/0 (socket says 172.21.15.80:37978) 2024-04-25T15:44:34.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c259c640 1 -- 172.21.15.80:0/2473492265 learned_addr learned my addr 172.21.15.80:0/2473492265 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:34.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2bbfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb2c40b0c00 0x7fb2c406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40400/0 (socket says 172.21.15.80:40400) 2024-04-25T15:44:34.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c259c640 1 -- 172.21.15.80:0/2473492265 >> v1:172.21.15.195:6789/0 conn(0x7fb2c406dce0 legacy=0x7fb2c40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:34.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c259c640 1 -- 172.21.15.80:0/2473492265 >> v1:172.21.15.80:6789/0 conn(0x7fb2c40b0c00 legacy=0x7fb2c406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c1d9b640 1 -- 172.21.15.80:0/2473492265 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463899740 0 0) 0x7fb2c40b1180 con 0x7fb2c40b0c00 2024-04-25T15:44:34.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.297+0000 7fb2c259c640 1 -- 172.21.15.80:0/2473492265 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c415d790 con 0x7fb2c4153f70 2024-04-25T15:44:34.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c259c640 1 --2- 172.21.15.80:0/2473492265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c40b06c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009870 tx=0x7fb2b402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ac6b4da0c3157d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c1d9b640 1 -- 172.21.15.80:0/2473492265 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4037070 con 0x7fb2c4153f70 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c1d9b640 1 -- 172.21.15.80:0/2473492265 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b4032440 con 0x7fb2c4153f70 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c1d9b640 1 -- 172.21.15.80:0/2473492265 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4032810 con 0x7fb2c4153f70 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/2473492265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 msgr2=0x7fb2c40b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/2473492265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c40b06c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009870 tx=0x7fb2b402a2a0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/2473492265 shutdown_connections 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/2473492265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c40b06c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/2473492265 >> 172.21.15.80:0/2473492265 conn(0x7fb2c40d1e20 msgr2=0x7fb2c4073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/2473492265 shutdown_connections 2024-04-25T15:44:34.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.298+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/2473492265 wait complete. 2024-04-25T15:44:34.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.300+0000 7fb2c8d9d640 1 Processor -- start 2024-04-25T15:44:34.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.300+0000 7fb2c8d9d640 1 -- start start 2024-04-25T15:44:34.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c8d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2c40b0c00 0x7fb2c414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c8d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c8d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2c415be00 0x7fb2c415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c8d9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c40af160 con 0x7fb2c4153f70 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c8d9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c40aefe0 con 0x7fb2c415be00 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c8d9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c40b4e10 con 0x7fb2c40b0c00 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c4152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37984/0 (socket says 172.21.15.80:37984) 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 -- 172.21.15.80:0/1091281777 learned_addr learned my addr 172.21.15.80:0/1091281777 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c259c640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2c40b0c00 0x7fb2c414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2c2d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2c415be00 0x7fb2c415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 -- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2c40b0c00 msgr2=0x7fb2c414b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2c40b0c00 0x7fb2c414b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 -- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2c415be00 msgr2=0x7fb2c415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2c415be00 0x7fb2c415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 -- 172.21.15.80:0/1091281777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c414cdb0 con 0x7fb2c4153f70 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2bbfff640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c4152b00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c460 tx=0x7fb2ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.302+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0074e0 con 0x7fb2c4153f70 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.303+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0047e0 con 0x7fb2c4153f70 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.303+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c414ba70 con 0x7fb2c4153f70 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.303+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac004bd0 con 0x7fb2c4153f70 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.303+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c4153040 con 0x7fb2c4153f70 2024-04-25T15:44:34.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.304+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c406a100 con 0x7fb2c4153f70 2024-04-25T15:44:34.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.304+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb2ac011070 con 0x7fb2c4153f70 2024-04-25T15:44:34.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.305+0000 7fb2baffd640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2a40744e0 0x7fb2a40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.305+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb2ac094e70 con 0x7fb2c4153f70 2024-04-25T15:44:34.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.305+0000 7fb2c259c640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2a40744e0 0x7fb2a40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.305+0000 7fb2c259c640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2a40744e0 0x7fb2a40769f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4034000 tx=0x7fb2b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.309+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2c414ba70 con 0x7fb2c4153f70 2024-04-25T15:44:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.486+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2c4070570 con 0x7fb2c4153f70 2024-04-25T15:44:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.488+0000 7fb2baffd640 1 -- 172.21.15.80:0/1091281777 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7fb2ac05ee20 con 0x7fb2c4153f70 2024-04-25T15:44:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:34.489 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2a40744e0 msgr2=0x7fb2a40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2a40744e0 0x7fb2a40769f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4034000 tx=0x7fb2b402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 msgr2=0x7fb2c4152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c4152b00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c460 tx=0x7fb2ac00c920 comp rx=0 tx=0).stop 2024-04-25T15:44:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 shutdown_connections 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2a40744e0 0x7fb2a40769f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2c415be00 0x7fb2c415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c4153f70 0x7fb2c4152b00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 --2- 172.21.15.80:0/1091281777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2c40b0c00 0x7fb2c414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 >> 172.21.15.80:0/1091281777 conn(0x7fb2c40d1e20 msgr2=0x7fb2c41533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 shutdown_connections 2024-04-25T15:44:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.490+0000 7fb2c8d9d640 1 -- 172.21.15.80:0/1091281777 wait complete. 2024-04-25T15:44:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:12.500873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:13.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:34.503 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.613+0000 7f939ec51640 1 Processor -- start 2024-04-25T15:44:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.613+0000 7f939ec51640 1 -- start start 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939ec51640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f939806cc10 0x7f939806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939ec51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93980b37b0 0x7f939806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939ec51640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93980cfc90 con 0x7f9398163860 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939ec51640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f939806c9a0 con 0x7f939806cc10 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939ec51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f93980d2c10 con 0x7f93980b37b0 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939c9ed640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f939806cc10 0x7f939806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939c9ed640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f939806cc10 0x7f939806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40228/0 (socket says 172.21.15.80:40228) 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939c9ed640 1 -- 172.21.15.80:0/2716454939 learned_addr learned my addr 172.21.15.80:0/2716454939 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f9397fff640 1 --2- 172.21.15.80:0/2716454939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93980b37b0 0x7f939806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939c9ed640 1 -- 172.21.15.80:0/2716454939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93980b37b0 msgr2=0x7f939806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.614+0000 7f939c9ed640 1 --2- 172.21.15.80:0/2716454939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93980b37b0 0x7f939806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.615+0000 7f939c9ed640 1 -- 172.21.15.80:0/2716454939 >> v1:172.21.15.195:6789/0 conn(0x7f9398163860 legacy=0x7f93980d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.615+0000 7f939c9ed640 1 -- 172.21.15.80:0/2716454939 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980cff30 con 0x7f939806cc10 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.615+0000 7f939c9ed640 1 --2- 172.21.15.80:0/2716454939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f939806d160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9388009870 tx=0x7f938802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a182357ad103d7c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.615+0000 7f93977fe640 1 -- 172.21.15.80:0/2716454939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388037070 con 0x7f939806cc10 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.615+0000 7f93977fe640 1 -- 172.21.15.80:0/2716454939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388032440 con 0x7f939806cc10 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.615+0000 7f93977fe640 1 -- 172.21.15.80:0/2716454939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388032810 con 0x7f939806cc10 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 -- 172.21.15.80:0/2716454939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 msgr2=0x7f939806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 --2- 172.21.15.80:0/2716454939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f939806d160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9388009870 tx=0x7f938802a270 comp rx=0 tx=0).stop 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 -- 172.21.15.80:0/2716454939 shutdown_connections 2024-04-25T15:44:34.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 --2- 172.21.15.80:0/2716454939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93980b37b0 0x7f939806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 --2- 172.21.15.80:0/2716454939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f939806d160 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 -- 172.21.15.80:0/2716454939 >> 172.21.15.80:0/2716454939 conn(0x7f939809b410 msgr2=0x7f93980b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 -- 172.21.15.80:0/2716454939 shutdown_connections 2024-04-25T15:44:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.616+0000 7f939ec51640 1 -- 172.21.15.80:0/2716454939 wait complete. 2024-04-25T15:44:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.618+0000 7f939ec51640 1 Processor -- start 2024-04-25T15:44:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.618+0000 7f939ec51640 1 -- start start 2024-04-25T15:44:34.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939ec51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f93980c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939ec51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93980b37b0 0x7f93980aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939ec51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9398163860 0x7f93980b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939ec51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9398076230 con 0x7f939806cc10 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939ec51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f939806c670 con 0x7f93980b37b0 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939ec51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f93980d1460 con 0x7f9398163860 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.619+0000 7f939c9ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f93980c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f93980c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40230/0 (socket says 172.21.15.80:40230) 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 -- 172.21.15.80:0/1933108286 learned_addr learned my addr 172.21.15.80:0/1933108286 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f9397fff640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93980b37b0 0x7f93980aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939d1ee640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9398163860 0x7f93980b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 -- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9398163860 msgr2=0x7f93980b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9398163860 0x7f93980b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 -- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93980b37b0 msgr2=0x7f93980aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93980b37b0 0x7f93980aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 -- 172.21.15.80:0/1933108286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93981f66b0 con 0x7f939806cc10 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f9397fff640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93980b37b0 0x7f93980aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939c9ed640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f93980c80e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9388000c00 tx=0x7f93880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388041020 con 0x7f939806cc10 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93880306c0 con 0x7f939806cc10 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388037040 con 0x7f939806cc10 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93981f6990 con 0x7f939806cc10 2024-04-25T15:44:34.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.620+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93981f6f50 con 0x7f939806cc10 2024-04-25T15:44:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.621+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939806a100 con 0x7f939806cc10 2024-04-25T15:44:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.622+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9388044020 con 0x7f939806cc10 2024-04-25T15:44:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.622+0000 7f93957fa640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93840744b0 0x7f93840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.622+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f93880b5bc0 con 0x7f939806cc10 2024-04-25T15:44:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.622+0000 7f9397fff640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93840744b0 0x7f93840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.623+0000 7f9397fff640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93840744b0 0x7f93840769c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f938c006fd0 tx=0x7f938c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.627+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f938804b030 con 0x7f939806cc10 2024-04-25T15:44:34.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.802+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9398069af0 con 0x7f939806cc10 2024-04-25T15:44:34.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.803+0000 7f93957fa640 1 -- 172.21.15.80:0/1933108286 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f9388080250 con 0x7f939806cc10 2024-04-25T15:44:34.804 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.804+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93840744b0 msgr2=0x7f93840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.804+0000 7f939ec51640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93840744b0 0x7f93840769c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f938c006fd0 tx=0x7f938c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.804+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 msgr2=0x7f93980c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.804+0000 7f939ec51640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f93980c80e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9388000c00 tx=0x7f93880046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 shutdown_connections 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93840744b0 0x7f93840769c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9398163860 0x7f93980b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93980b37b0 0x7f93980aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 --2- 172.21.15.80:0/1933108286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939806cc10 0x7f93980c80e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 >> 172.21.15.80:0/1933108286 conn(0x7f939809b410 msgr2=0x7f93980d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:34.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 shutdown_connections 2024-04-25T15:44:34.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.805+0000 7f939ec51640 1 -- 172.21.15.80:0/1933108286 wait complete. 2024-04-25T15:44:34.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:44:34.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.926+0000 7f17fde96640 1 Processor -- start 2024-04-25T15:44:34.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.926+0000 7f17fde96640 1 -- start start 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17fde96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f80b3860 0x7f17f80b7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17fde96640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17f806d3d0 0x7f17f806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17fde96640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f806cea0 con 0x7f17f80cc700 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17fde96640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f17f806cbc0 con 0x7f17f806d3d0 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17fde96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f17f80d2100 con 0x7f17f80b3860 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17f6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17f806d3d0 0x7f17f806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17f6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17f806d3d0 0x7f17f806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40246/0 (socket says 172.21.15.80:40246) 2024-04-25T15:44:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17f7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f17f80cc700 0x7f17f80ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40950/0 (socket says 172.21.15.80:40950) 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.927+0000 7f17f6ffd640 1 -- 172.21.15.80:0/3882053006 learned_addr learned my addr 172.21.15.80:0/3882053006 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f77fe640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f80b3860 0x7f17f80b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f6ffd640 1 -- 172.21.15.80:0/3882053006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f80b3860 msgr2=0x7f17f80b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f6ffd640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f80b3860 0x7f17f80b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f6ffd640 1 -- 172.21.15.80:0/3882053006 >> v1:172.21.15.80:6789/0 conn(0x7f17f80cc700 legacy=0x7f17f80ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f6ffd640 1 -- 172.21.15.80:0/3882053006 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f80d23e0 con 0x7f17f806d3d0 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f67fc640 1 -- 172.21.15.80:0/3882053006 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929283649 0 0) 0x7f17f806cea0 con 0x7f17f80cc700 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f77fe640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f80b3860 0x7f17f80b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.928+0000 7f17f6ffd640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f806d3d0 0x7f17f806d7e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009870 tx=0x7f17ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db735f0b78ff8bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17f67fc640 1 -- 172.21.15.80:0/3882053006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec037070 con 0x7f17f806d3d0 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17f67fc640 1 -- 172.21.15.80:0/3882053006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec032440 con 0x7f17f806d3d0 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17f67fc640 1 -- 172.21.15.80:0/3882053006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec032810 con 0x7f17f806d3d0 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 -- 172.21.15.80:0/3882053006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f806d3d0 msgr2=0x7f17f806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f806d3d0 0x7f17f806d7e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009870 tx=0x7f17ec02a270 comp rx=0 tx=0).stop 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 -- 172.21.15.80:0/3882053006 shutdown_connections 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f806d3d0 0x7f17f806d7e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 --2- 172.21.15.80:0/3882053006 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f80b3860 0x7f17f80b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 -- 172.21.15.80:0/3882053006 >> 172.21.15.80:0/3882053006 conn(0x7f17f809b410 msgr2=0x7f17f80b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 -- 172.21.15.80:0/3882053006 shutdown_connections 2024-04-25T15:44:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.929+0000 7f17fde96640 1 -- 172.21.15.80:0/3882053006 wait complete. 2024-04-25T15:44:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.931+0000 7f17fde96640 1 Processor -- start 2024-04-25T15:44:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.931+0000 7f17fde96640 1 -- start start 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.932+0000 7f17fde96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f806d3d0 0x7f17f80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.932+0000 7f17fde96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17f80cc700 0x7f17f8158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.932+0000 7f17fde96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 0x7f17f8156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.932+0000 7f17fde96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f17f806c8d0 con 0x7f17f80aeef0 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.932+0000 7f17fde96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f17f806c750 con 0x7f17f80cc700 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.932+0000 7f17fde96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f17f80cd220 con 0x7f17f806d3d0 2024-04-25T15:44:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 0x7f17f8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 0x7f17f8156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40262/0 (socket says 172.21.15.80:40262) 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 -- 172.21.15.80:0/2239283057 learned_addr learned my addr 172.21.15.80:0/2239283057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f77fe640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f806d3d0 0x7f17f80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f6ffd640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17f80cc700 0x7f17f8158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 -- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f806d3d0 msgr2=0x7f17f80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f806d3d0 0x7f17f80c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 -- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17f80cc700 msgr2=0x7f17f8158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17f80cc700 0x7f17f8158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 -- 172.21.15.80:0/2239283057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f80af490 con 0x7f17f80aeef0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17f7fff640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 0x7f17f8156470 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c780 tx=0x7f17f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0018070 con 0x7f17f80aeef0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f000ce30 con 0x7f17f80aeef0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f80af770 con 0x7f17f80aeef0 2024-04-25T15:44:34.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f000a840 con 0x7f17f80aeef0 2024-04-25T15:44:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.933+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f80afd30 con 0x7f17f80aeef0 2024-04-25T15:44:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.934+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f806a100 con 0x7f17f80aeef0 2024-04-25T15:44:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.935+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f17f001b070 con 0x7f17f80aeef0 2024-04-25T15:44:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.935+0000 7f17dffff640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17e40744b0 0x7f17e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.935+0000 7f17f77fe640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17e40744b0 0x7f17e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.935+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f17f0094900 con 0x7f17f80aeef0 2024-04-25T15:44:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.936+0000 7f17f77fe640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17e40744b0 0x7f17e40769c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f17e800b840 tx=0x7f17e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:34.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:34.940+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17f005ef00 con 0x7f17f80aeef0 2024-04-25T15:44:35.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.116+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f17f8160510 con 0x7f17f80aeef0 2024-04-25T15:44:35.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.116+0000 7f17dffff640 1 -- 172.21.15.80:0/2239283057 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7f17f005e800 con 0x7f17f80aeef0 2024-04-25T15:44:35.117 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:35.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17e40744b0 msgr2=0x7f17e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17e40744b0 0x7f17e40769c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f17e800b840 tx=0x7f17e8008040 comp rx=0 tx=0).stop 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 msgr2=0x7f17f8156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 0x7f17f8156470 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c780 tx=0x7f17f000cc40 comp rx=0 tx=0).stop 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 shutdown_connections 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17e40744b0 0x7f17e40769c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17f80aeef0 0x7f17f8156470 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17f80cc700 0x7f17f8158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 --2- 172.21.15.80:0/2239283057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17f806d3d0 0x7f17f80c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 >> 172.21.15.80:0/2239283057 conn(0x7f17f809b410 msgr2=0x7f17f80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 shutdown_connections 2024-04-25T15:44:35.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.118+0000 7f17fde96640 1 -- 172.21.15.80:0/2239283057 wait complete. 2024-04-25T15:44:35.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:44:35.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.239+0000 7fc97a4b6640 1 Processor -- start 2024-04-25T15:44:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.239+0000 7fc97a4b6640 1 -- start start 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc97a4b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc97406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc97a4b6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9740b37b0 0x7fc97406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc97a4b6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc974163860 0x7fc9740d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc97a4b6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc9740cfc90 con 0x7fc974163860 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc97a4b6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc97406c9a0 con 0x7fc9740b37b0 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc97a4b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9740d2c10 con 0x7fc97406cc10 2024-04-25T15:44:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc974163860 0x7fc9740d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc974163860 0x7fc9740d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40264/0 (socket says 172.21.15.80:40264) 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 -- 172.21.15.80:0/1789799157 learned_addr learned my addr 172.21.15.80:0/1789799157 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc9737fe640 1 --2- 172.21.15.80:0/1789799157 >> v2:172.21.15.195:3300/0 conn(0x7fc9740b37b0 0x7fc97406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc973fff640 1 --2- 172.21.15.80:0/1789799157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc97406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 -- 172.21.15.80:0/1789799157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 msgr2=0x7fc97406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 --2- 172.21.15.80:0/1789799157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc97406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 -- 172.21.15.80:0/1789799157 >> v2:172.21.15.195:3300/0 conn(0x7fc9740b37b0 msgr2=0x7fc97406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 --2- 172.21.15.80:0/1789799157 >> v2:172.21.15.195:3300/0 conn(0x7fc9740b37b0 0x7fc97406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc978a53640 1 -- 172.21.15.80:0/1789799157 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9740cff30 con 0x7fc974163860 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.241+0000 7fc9737fe640 1 --2- 172.21.15.80:0/1789799157 >> v2:172.21.15.195:3300/0 conn(0x7fc9740b37b0 0x7fc97406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.242+0000 7fc978a53640 1 --2- 172.21.15.80:0/1789799157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc974163860 0x7fc9740d1b60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc974074dc0 tx=0x7fc96c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34bd6262287739 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.242+0000 7fc972ffd640 1 -- 172.21.15.80:0/1789799157 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c036070 con 0x7fc974163860 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.242+0000 7fc972ffd640 1 -- 172.21.15.80:0/1789799157 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c031600 con 0x7fc974163860 2024-04-25T15:44:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.242+0000 7fc972ffd640 1 -- 172.21.15.80:0/1789799157 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0319d0 con 0x7fc974163860 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 -- 172.21.15.80:0/1789799157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc974163860 msgr2=0x7fc9740d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/1789799157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc974163860 0x7fc9740d1b60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc974074dc0 tx=0x7fc96c02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 -- 172.21.15.80:0/1789799157 shutdown_connections 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/1789799157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc974163860 0x7fc9740d1b60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/1789799157 >> v2:172.21.15.195:3300/0 conn(0x7fc9740b37b0 0x7fc97406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/1789799157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc97406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 -- 172.21.15.80:0/1789799157 >> 172.21.15.80:0/1789799157 conn(0x7fc97409b410 msgr2=0x7fc9740b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 -- 172.21.15.80:0/1789799157 shutdown_connections 2024-04-25T15:44:35.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.243+0000 7fc97a4b6640 1 -- 172.21.15.80:0/1789799157 wait complete. 2024-04-25T15:44:35.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.245+0000 7fc97a4b6640 1 Processor -- start 2024-04-25T15:44:35.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.245+0000 7fc97a4b6640 1 -- start start 2024-04-25T15:44:35.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc97a4b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc974157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc97a4b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 0x7fc9740caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc97a4b6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc974163860 0x7fc9740b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc97a4b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc974076230 con 0x7fc9740b37b0 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc97a4b6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc97406c670 con 0x7fc974163860 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc97a4b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9740d20a0 con 0x7fc97406cc10 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 0x7fc9740caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 0x7fc9740caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40278/0 (socket says 172.21.15.80:40278) 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 -- 172.21.15.80:0/763009592 learned_addr learned my addr 172.21.15.80:0/763009592 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc978a53640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc974163860 0x7fc9740b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc973fff640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc974157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 -- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 msgr2=0x7fc974157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc974157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 -- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc974163860 msgr2=0x7fc9740b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc974163860 0x7fc9740b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc9737fe640 1 -- 172.21.15.80:0/763009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9741f9940 con 0x7fc9740b37b0 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc973fff640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc974157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.246+0000 7fc978a53640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc974163860 0x7fc9740b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.247+0000 7fc9737fe640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 0x7fc9740caab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc96800d5f0 tx=0x7fc96800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.247+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968004030 con 0x7fc9740b37b0 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.247+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680041d0 con 0x7fc9740b37b0 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.247+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9741f9c20 con 0x7fc9740b37b0 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.247+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968014620 con 0x7fc9740b37b0 2024-04-25T15:44:35.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.247+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741fa1e0 con 0x7fc9740b37b0 2024-04-25T15:44:35.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.248+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9740c5a90 con 0x7fc9740b37b0 2024-04-25T15:44:35.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.249+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc9680147c0 con 0x7fc9740b37b0 2024-04-25T15:44:35.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.249+0000 7fc970ff9640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.249+0000 7fc973fff640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.249+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc968095b80 con 0x7fc9740b37b0 2024-04-25T15:44:35.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.250+0000 7fc973fff640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc964006fd0 tx=0x7fc964008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.254+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc968060180 con 0x7fc9740b37b0 2024-04-25T15:44:35.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.427+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc97406a100 con 0x7fc9740b37b0 2024-04-25T15:44:35.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.428+0000 7fc970ff9640 1 -- 172.21.15.80:0/763009592 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7fc968068030 con 0x7fc9740b37b0 2024-04-25T15:44:35.429 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:44:35.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 msgr2=0x7fc9600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc964006fd0 tx=0x7fc964008040 comp rx=0 tx=0).stop 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 msgr2=0x7fc9740caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 0x7fc9740caab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc96800d5f0 tx=0x7fc96800dab0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 shutdown_connections 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc974163860 0x7fc9740b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9740b37b0 0x7fc9740caab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 --2- 172.21.15.80:0/763009592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc97406cc10 0x7fc974157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 >> 172.21.15.80:0/763009592 conn(0x7fc97409b410 msgr2=0x7fc974162860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 shutdown_connections 2024-04-25T15:44:35.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.430+0000 7fc97a4b6640 1 -- 172.21.15.80:0/763009592 wait complete. 2024-04-25T15:44:35.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.550+0000 7f64a4f00640 1 Processor -- start 2024-04-25T15:44:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.550+0000 7f64a4f00640 1 -- start start 2024-04-25T15:44:35.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f64a4f00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f64a00cfc40 0x7f64a0160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f64a4f00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a0071bb0 0x7f64a00b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f64a4f00640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a00b6eb0 con 0x7f64a0164690 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f64a4f00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f64a00b7150 con 0x7f64a00cfc40 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f64a4f00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f64a00b51e0 con 0x7f64a0071bb0 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649dd9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f64a0164690 0x7f64a00714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40952/0 (socket says 172.21.15.80:40952) 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649dd9b640 1 -- 172.21.15.80:0/3927265468 learned_addr learned my addr 172.21.15.80:0/3927265468 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649e59c640 1 --2- 172.21.15.80:0/3927265468 >> v2:172.21.15.195:3300/0 conn(0x7f64a00cfc40 0x7f64a0160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649ed9d640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a0071bb0 0x7f64a00b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841027107 0 0) 0x7f64a00b6eb0 con 0x7f64a0164690 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6488003520 con 0x7f64a0164690 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1254800079 0 0) 0x7f6488003520 con 0x7f64a0164690 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a0071bb0 msgr2=0x7f64a00b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a0071bb0 0x7f64a00b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 >> v2:172.21.15.195:3300/0 conn(0x7f64a00cfc40 msgr2=0x7f64a0160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 --2- 172.21.15.80:0/3927265468 >> v2:172.21.15.195:3300/0 conn(0x7f64a00cfc40 0x7f64a0160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a00b54c0 con 0x7f64a0164690 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f6494001690 con 0x7f64a0164690 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 >> v1:172.21.15.80:6789/0 conn(0x7f64a0164690 legacy=0x7f64a00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64880039b0 0x7f6488003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6488004800 0x7f6488004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488005150 0x7f648800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f64a00b7150 con 0x7f6488004800 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f64a00b51e0 con 0x7f64880039b0 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.552+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f648800bf00 con 0x7f6488005150 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6488004800 0x7f6488004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649e59c640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64880039b0 0x7f6488003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649ed9d640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488005150 0x7f648800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 -- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488005150 msgr2=0x7f648800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488005150 0x7f648800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 -- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64880039b0 msgr2=0x7f6488003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64880039b0 0x7f6488003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 -- 172.21.15.80:0/3927265468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6488003520 con 0x7f6488004800 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.553+0000 7f649dd9b640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6488004800 0x7f6488004c10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64a006dab0 tx=0x7f6488005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c658355e7a4099 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649402e070 con 0x7f6488004800 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6494005ad0 con 0x7f6488004800 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f649d59a640 1 -- 172.21.15.80:0/3927265468 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494007d90 con 0x7f6488004800 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f64a4f00640 1 -- 172.21.15.80:0/3927265468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6488004800 msgr2=0x7f6488004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f64a4f00640 1 --2- 172.21.15.80:0/3927265468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6488004800 0x7f6488004c10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64a006dab0 tx=0x7f6488005830 comp rx=0 tx=0).stop 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f649ed9d640 1 -- 172.21.15.80:0/3927265468 reap_dead start 2024-04-25T15:44:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f64a4f00640 1 -- 172.21.15.80:0/3927265468 shutdown_connections 2024-04-25T15:44:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f64a4f00640 1 -- 172.21.15.80:0/3927265468 >> 172.21.15.80:0/3927265468 conn(0x7f64a00d2080 msgr2=0x7f64a00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f64a4f00640 1 -- 172.21.15.80:0/3927265468 shutdown_connections 2024-04-25T15:44:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.554+0000 7f64a4f00640 1 -- 172.21.15.80:0/3927265468 wait complete. 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.556+0000 7f64a4f00640 1 Processor -- start 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.556+0000 7f64a4f00640 1 -- start start 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488004800 0x7f64a0146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a00cc1c0 0x7f64a00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 0x7f64a01f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f64a00b6b70 con 0x7f64a00ccb10 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f64a0072040 con 0x7f64a00cc1c0 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f64a0164aa0 con 0x7f6488004800 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 0x7f64a01f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 0x7f64a01f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40306/0 (socket says 172.21.15.80:40306) 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 -- 172.21.15.80:0/2108634412 learned_addr learned my addr 172.21.15.80:0/2108634412 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649e59c640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488004800 0x7f64a0146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649dd9b640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a00cc1c0 0x7f64a00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 -- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488004800 msgr2=0x7f64a0146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488004800 0x7f64a0146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 -- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a00cc1c0 msgr2=0x7f64a00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a00cc1c0 0x7f64a00cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 -- 172.21.15.80:0/2108634412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a01470c0 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649e59c640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488004800 0x7f64a0146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f649ed9d640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 0x7f64a01f9840 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6498011490 tx=0x7f6498011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498003610 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649801b070 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a0161eb0 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980039f0 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.558+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a0162470 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.559+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a0162c70 con 0x7f64a00ccb10 2024-04-25T15:44:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.560+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6498003b90 con 0x7f64a00ccb10 2024-04-25T15:44:35.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.560+0000 7f648effd640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64800744b0 0x7f64800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.561+0000 7f649e59c640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64800744b0 0x7f64800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.561+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6498094ff0 con 0x7f64a00ccb10 2024-04-25T15:44:35.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.561+0000 7f649e59c640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64800744b0 0x7f64800769c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6490007440 tx=0x7f649000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.565+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6498024020 con 0x7f64a00ccb10 2024-04-25T15:44:35.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.774+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64a006a100 con 0x7f64a00ccb10 2024-04-25T15:44:35.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.775+0000 7f648effd640 1 -- 172.21.15.80:0/2108634412 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f64a01470c0 con 0x7f64a00ccb10 2024-04-25T15:44:35.776 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:35.776 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:35.776 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64800744b0 msgr2=0x7f64800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64800744b0 0x7f64800769c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6490007440 tx=0x7f649000b040 comp rx=0 tx=0).stop 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 msgr2=0x7f64a01f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 0x7f64a01f9840 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6498011490 tx=0x7f6498011950 comp rx=0 tx=0).stop 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 shutdown_connections 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64800744b0 0x7f64800769c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a00ccb10 0x7f64a01f9840 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a00cc1c0 0x7f64a00cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 --2- 172.21.15.80:0/2108634412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6488004800 0x7f64a0146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 >> 172.21.15.80:0/2108634412 conn(0x7f64a00d2080 msgr2=0x7f64a006cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:35.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 shutdown_connections 2024-04-25T15:44:35.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.777+0000 7f64a4f00640 1 -- 172.21.15.80:0/2108634412 wait complete. 2024-04-25T15:44:35.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.895+0000 7fb53e69a640 1 Processor -- start 2024-04-25T15:44:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.895+0000 7fb53e69a640 1 -- start start 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53e69a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5381604d0 0x7fb53809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53e69a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380d1ae0 0x7fb5380d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53e69a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb5380ccf60 0x7fb5380cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53e69a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb5380ce6d0 con 0x7fb5381604d0 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53e69a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb5380b3fe0 con 0x7fb5380ccf60 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53e69a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5380ce110 con 0x7fb5380d1ae0 2024-04-25T15:44:35.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5381604d0 0x7fb53809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5381604d0 0x7fb53809bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40314/0 (socket says 172.21.15.80:40314) 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 -- 172.21.15.80:0/2129780147 learned_addr learned my addr 172.21.15.80:0/2129780147 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb53cc37640 1 --2- 172.21.15.80:0/2129780147 >> v2:172.21.15.195:3300/0 conn(0x7fb5380ccf60 0x7fb5380cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb5377fe640 1 --2- 172.21.15.80:0/2129780147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380d1ae0 0x7fb5380d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 -- 172.21.15.80:0/2129780147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380d1ae0 msgr2=0x7fb5380d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 --2- 172.21.15.80:0/2129780147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380d1ae0 0x7fb5380d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 -- 172.21.15.80:0/2129780147 >> v2:172.21.15.195:3300/0 conn(0x7fb5380ccf60 msgr2=0x7fb5380cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 --2- 172.21.15.80:0/2129780147 >> v2:172.21.15.195:3300/0 conn(0x7fb5380ccf60 0x7fb5380cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.897+0000 7fb537fff640 1 -- 172.21.15.80:0/2129780147 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5380ce3f0 con 0x7fb5381604d0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.898+0000 7fb537fff640 1 --2- 172.21.15.80:0/2129780147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5381604d0 0x7fb53809bdf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb538073fc0 tx=0x7fb52802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1742d9f1f04406 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.898+0000 7fb536ffd640 1 -- 172.21.15.80:0/2129780147 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528037070 con 0x7fb5381604d0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.898+0000 7fb536ffd640 1 -- 172.21.15.80:0/2129780147 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb528032440 con 0x7fb5381604d0 2024-04-25T15:44:35.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.898+0000 7fb536ffd640 1 -- 172.21.15.80:0/2129780147 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528032810 con 0x7fb5381604d0 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 -- 172.21.15.80:0/2129780147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5381604d0 msgr2=0x7fb53809bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 --2- 172.21.15.80:0/2129780147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5381604d0 0x7fb53809bdf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb538073fc0 tx=0x7fb52802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 -- 172.21.15.80:0/2129780147 shutdown_connections 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 --2- 172.21.15.80:0/2129780147 >> v2:172.21.15.195:3300/0 conn(0x7fb5380ccf60 0x7fb5380cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 --2- 172.21.15.80:0/2129780147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380d1ae0 0x7fb5380d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 --2- 172.21.15.80:0/2129780147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5381604d0 0x7fb53809bdf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 -- 172.21.15.80:0/2129780147 >> 172.21.15.80:0/2129780147 conn(0x7fb5380b7620 msgr2=0x7fb5380b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 -- 172.21.15.80:0/2129780147 shutdown_connections 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.899+0000 7fb53e69a640 1 -- 172.21.15.80:0/2129780147 wait complete. 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.900+0000 7fb53e69a640 1 Processor -- start 2024-04-25T15:44:35.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.901+0000 7fb53e69a640 1 -- start start 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53e69a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380ccf60 0x7fb53815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53e69a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 0x7fb53806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53e69a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5381604d0 0x7fb5380b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53e69a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb5380b3b70 con 0x7fb5380d1ae0 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53e69a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb5380d2430 con 0x7fb5381604d0 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53e69a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5380b3cf0 con 0x7fb5380ccf60 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 0x7fb53806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 0x7fb53806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40316/0 (socket says 172.21.15.80:40316) 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 -- 172.21.15.80:0/1336737725 learned_addr learned my addr 172.21.15.80:0/1336737725 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb537fff640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380ccf60 0x7fb53815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53cc37640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5381604d0 0x7fb5380b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 -- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380ccf60 msgr2=0x7fb53815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380ccf60 0x7fb53815a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 -- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5381604d0 msgr2=0x7fb5380b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5381604d0 0x7fb5380b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb5377fe640 1 -- 172.21.15.80:0/1336737725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53806d860 con 0x7fb5380d1ae0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.902+0000 7fb53cc37640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5381604d0 0x7fb5380b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.903+0000 7fb5377fe640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 0x7fb53806d320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00e870 tx=0x7fb52c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.903+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c017070 con 0x7fb5380d1ae0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.903+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb52c00c940 con 0x7fb5380d1ae0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.903+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5381f9fb0 con 0x7fb5380d1ae0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.903+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00cd10 con 0x7fb5380d1ae0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.903+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5381fa570 con 0x7fb5380d1ae0 2024-04-25T15:44:35.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.904+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53806a100 con 0x7fb5380d1ae0 2024-04-25T15:44:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.904+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb52c01a070 con 0x7fb5380d1ae0 2024-04-25T15:44:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.905+0000 7fb534ff9640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5240744e0 0x7fb5240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.905+0000 7fb537fff640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5240744e0 0x7fb5240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.905+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb52c095190 con 0x7fb5380d1ae0 2024-04-25T15:44:35.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.905+0000 7fb537fff640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5240744e0 0x7fb5240769f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb528034000 tx=0x7fb52802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:35.910+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb52c05f140 con 0x7fb5380d1ae0 2024-04-25T15:44:36.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.086+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5380c61f0 con 0x7fb5380d1ae0 2024-04-25T15:44:36.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.088+0000 7fb534ff9640 1 -- 172.21.15.80:0/1336737725 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7fb52c063440 con 0x7fb5380d1ae0 2024-04-25T15:44:36.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:36.089 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:36.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5240744e0 msgr2=0x7fb5240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5240744e0 0x7fb5240769f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb528034000 tx=0x7fb52802e000 comp rx=0 tx=0).stop 2024-04-25T15:44:36.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 msgr2=0x7fb53806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 0x7fb53806d320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00e870 tx=0x7fb52c00ed30 comp rx=0 tx=0).stop 2024-04-25T15:44:36.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 shutdown_connections 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb5240744e0 0x7fb5240769f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5381604d0 0x7fb5380b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5380d1ae0 0x7fb53806d320 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 --2- 172.21.15.80:0/1336737725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5380ccf60 0x7fb53815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 >> 172.21.15.80:0/1336737725 conn(0x7fb5380b7620 msgr2=0x7fb538070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 shutdown_connections 2024-04-25T15:44:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.090+0000 7fb53e69a640 1 -- 172.21.15.80:0/1336737725 wait complete. 2024-04-25T15:44:36.102 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:44:36.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:36.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.209+0000 7f5b11b7d640 1 Processor -- start 2024-04-25T15:44:36.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.209+0000 7f5b11b7d640 1 -- start start 2024-04-25T15:44:36.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b11b7d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5b0c071950 0x7f5b0c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b11b7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 0x7f5b0c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b11b7d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c0d33e0 con 0x7f5b0c161c80 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b11b7d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0c072aa0 con 0x7f5b0c071950 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b11b7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c1624d0 con 0x7f5b0c0d2a90 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b0affd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5b0c161c80 0x7f5b0c0b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40964/0 (socket says 172.21.15.80:40964) 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b0affd640 1 -- 172.21.15.80:0/2415726034 learned_addr learned my addr 172.21.15.80:0/2415726034 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b0b7fe640 1 --2- 172.21.15.80:0/2415726034 >> v2:172.21.15.195:3300/0 conn(0x7f5b0c071950 0x7f5b0c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 0x7f5b0c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.210+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840097654 0 0) 0x7f5b00001160 con 0x7f5b0c161c80 2024-04-25T15:44:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af4003520 con 0x7f5b0c161c80 2024-04-25T15:44:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1908150198 0 0) 0x7f5af4003520 con 0x7f5b0c161c80 2024-04-25T15:44:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 msgr2=0x7f5b0c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 0x7f5b0c0d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 >> v2:172.21.15.195:3300/0 conn(0x7f5b0c071950 msgr2=0x7f5b0c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 --2- 172.21.15.80:0/2415726034 >> v2:172.21.15.195:3300/0 conn(0x7f5b0c071950 0x7f5b0c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c1627b0 con 0x7f5b0c161c80 2024-04-25T15:44:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f5b00001890 con 0x7f5b0c161c80 2024-04-25T15:44:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0b7fe640 1 --2- 172.21.15.80:0/2415726034 >> v2:172.21.15.195:3300/0 conn(0x7f5b0c071950 0x7f5b0c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 >> v1:172.21.15.80:6789/0 conn(0x7f5b0c161c80 legacy=0x7f5b0c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 0x7f5af40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af4003f30 0x7f5af4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af4004d40 0x7f5af4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1624d0 con 0x7f5af4004d40 2024-04-25T15:44:36.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5af400ba70 con 0x7f5af4003f30 2024-04-25T15:44:36.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5af400bc40 con 0x7f5b0c0d2a90 2024-04-25T15:44:36.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af4004d40 0x7f5af4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0b7fe640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 0x7f5af40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0affd640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af4003f30 0x7f5af4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0bfff640 1 -- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 msgr2=0x7f5af40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0d2a90 0x7f5af40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0bfff640 1 -- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af4003f30 msgr2=0x7f5af4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af4003f30 0x7f5af4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0bfff640 1 -- 172.21.15.80:0/2415726034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af4003520 con 0x7f5af4004d40 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.211+0000 7f5b0affd640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af4003f30 0x7f5af4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.212+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af4004d40 0x7f5af4005150 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fc0 tx=0x7f5af4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcbd13fb4ff4f33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.212+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04034020 con 0x7f5af4004d40 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.212+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b040305f0 con 0x7f5af4004d40 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.212+0000 7f5b0a7fc640 1 -- 172.21.15.80:0/2415726034 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04009c10 con 0x7f5af4004d40 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b11b7d640 1 -- 172.21.15.80:0/2415726034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af4004d40 msgr2=0x7f5af4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/2415726034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af4004d40 0x7f5af4005150 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fc0 tx=0x7f5af4005830 comp rx=0 tx=0).stop 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b0bfff640 1 -- 172.21.15.80:0/2415726034 reap_dead start 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b11b7d640 1 -- 172.21.15.80:0/2415726034 shutdown_connections 2024-04-25T15:44:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b11b7d640 1 -- 172.21.15.80:0/2415726034 >> 172.21.15.80:0/2415726034 conn(0x7f5b0c0d3ea0 msgr2=0x7f5b0c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b11b7d640 1 -- 172.21.15.80:0/2415726034 shutdown_connections 2024-04-25T15:44:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.213+0000 7f5b11b7d640 1 -- 172.21.15.80:0/2415726034 wait complete. 2024-04-25T15:44:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.215+0000 7f5b11b7d640 1 Processor -- start 2024-04-25T15:44:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.215+0000 7f5b11b7d640 1 -- start start 2024-04-25T15:44:36.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b11b7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 0x7f5b0c1fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b11b7d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c0b1010 0x7f5b0c160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b11b7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0b1420 0x7f5b0c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b11b7d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c0b7690 con 0x7f5b0c0b0350 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b11b7d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c0d2290 con 0x7f5b0c0b1010 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b11b7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0c0b7810 con 0x7f5b0c0b1420 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 0x7f5b0c1fa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 0x7f5b0c1fa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40326/0 (socket says 172.21.15.80:40326) 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 -- 172.21.15.80:0/4126217950 learned_addr learned my addr 172.21.15.80:0/4126217950 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0b1420 0x7f5b0c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0affd640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c0b1010 0x7f5b0c160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 -- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0b1420 msgr2=0x7f5b0c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0b1420 0x7f5b0c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 -- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c0b1010 msgr2=0x7f5b0c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.216+0000 7f5b0b7fe640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c0b1010 0x7f5b0c160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5b0b7fe640 1 -- 172.21.15.80:0/4126217950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c0aefd0 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5b0bfff640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0b1420 0x7f5b0c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5b0affd640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c0b1010 0x7f5b0c160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5b0b7fe640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 0x7f5b0c1fa0e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5afc011cd0 tx=0x7f5afc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc00fd20 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc014440 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c0af2b0 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc014830 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.217+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c0af870 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.218+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c0d16e0 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.218+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5afc012040 con 0x7f5b0c0b0350 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.219+0000 7f5af3fff640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af80744b0 0x7f5af80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.219+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5afc095ca0 con 0x7f5b0c0b0350 2024-04-25T15:44:36.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.219+0000 7f5b0affd640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af80744b0 0x7f5af80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.219+0000 7f5b0affd640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af80744b0 0x7f5af80769c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b00001040 tx=0x7f5b00001d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.223+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b0c0d16e0 con 0x7f5b0c0b0350 2024-04-25T15:44:36.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.433+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b0c06a100 con 0x7f5b0c0b0350 2024-04-25T15:44:36.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.434+0000 7f5af3fff640 1 -- 172.21.15.80:0/4126217950 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f5afc019030 con 0x7f5b0c0b0350 2024-04-25T15:44:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:36.436 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af80744b0 msgr2=0x7f5af80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af80744b0 0x7f5af80769c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b00001040 tx=0x7f5b00001d60 comp rx=0 tx=0).stop 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 msgr2=0x7f5b0c1fa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 0x7f5b0c1fa0e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5afc011cd0 tx=0x7f5afc00f610 comp rx=0 tx=0).stop 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 shutdown_connections 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5af80744b0 0x7f5af80769c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b0c0b1420 0x7f5b0c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c0b1010 0x7f5b0c160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 --2- 172.21.15.80:0/4126217950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b0c0b0350 0x7f5b0c1fa0e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 >> 172.21.15.80:0/4126217950 conn(0x7f5b0c0d3ea0 msgr2=0x7f5b0c0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 shutdown_connections 2024-04-25T15:44:36.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.436+0000 7f5b11b7d640 1 -- 172.21.15.80:0/4126217950 wait complete. 2024-04-25T15:44:36.449 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:36.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.556+0000 7f8b94cf2640 1 Processor -- start 2024-04-25T15:44:36.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.556+0000 7f8b94cf2640 1 -- start start 2024-04-25T15:44:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b94cf2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b9015d310 0x7f8b9009b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b94cf2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b900d2ed0 0x7f8b900d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b94cf2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9006e990 con 0x7f8b900cfcd0 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b94cf2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8b900d0610 con 0x7f8b9015d310 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b94cf2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9006ec00 con 0x7f8b900d2ed0 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b8e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b9015d310 0x7f8b9009b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b8e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b9015d310 0x7f8b9009b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40336/0 (socket says 172.21.15.80:40336) 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b8e59c640 1 -- 172.21.15.80:0/1333634043 learned_addr learned my addr 172.21.15.80:0/1333634043 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.557+0000 7f8b8ed9d640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b900d2ed0 0x7f8b900d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8e59c640 1 -- 172.21.15.80:0/1333634043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b900d2ed0 msgr2=0x7f8b900d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8e59c640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b900d2ed0 0x7f8b900d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8e59c640 1 -- 172.21.15.80:0/1333634043 >> v1:172.21.15.195:6789/0 conn(0x7f8b900cfcd0 legacy=0x7f8b900d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8e59c640 1 -- 172.21.15.80:0/1333634043 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9006eee0 con 0x7f8b9015d310 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8ed9d640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b900d2ed0 0x7f8b900d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8e59c640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b9015d310 0x7f8b9009b950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009870 tx=0x7f8b8002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f542c1150e1d5cc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8d59a640 1 -- 172.21.15.80:0/1333634043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80037070 con 0x7f8b9015d310 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8d59a640 1 -- 172.21.15.80:0/1333634043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80032440 con 0x7f8b9015d310 2024-04-25T15:44:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.558+0000 7f8b8d59a640 1 -- 172.21.15.80:0/1333634043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80032810 con 0x7f8b9015d310 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 -- 172.21.15.80:0/1333634043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b9015d310 msgr2=0x7f8b9009b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b9015d310 0x7f8b9009b950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009870 tx=0x7f8b8002a1c0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 -- 172.21.15.80:0/1333634043 shutdown_connections 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b900d2ed0 0x7f8b900d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/1333634043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b9015d310 0x7f8b9009b950 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 -- 172.21.15.80:0/1333634043 >> 172.21.15.80:0/1333634043 conn(0x7f8b900b7750 msgr2=0x7f8b900b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 -- 172.21.15.80:0/1333634043 shutdown_connections 2024-04-25T15:44:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.559+0000 7f8b94cf2640 1 -- 172.21.15.80:0/1333634043 wait complete. 2024-04-25T15:44:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.561+0000 7f8b94cf2640 1 Processor -- start 2024-04-25T15:44:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.561+0000 7f8b94cf2640 1 -- start start 2024-04-25T15:44:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.562+0000 7f8b94cf2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 0x7f8b900c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.562+0000 7f8b94cf2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b9015d310 0x7f8b9015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.562+0000 7f8b94cf2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b900ca030 0x7f8b9015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.562+0000 7f8b94cf2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900d1440 con 0x7f8b900cfcd0 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.562+0000 7f8b94cf2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900d12c0 con 0x7f8b900ca030 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.562+0000 7f8b94cf2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8b900d15c0 con 0x7f8b9015d310 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 0x7f8b900c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 0x7f8b900c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40340/0 (socket says 172.21.15.80:40340) 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 -- 172.21.15.80:0/515544581 learned_addr learned my addr 172.21.15.80:0/515544581 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8dd9b640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b9015d310 0x7f8b9015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8ed9d640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b900ca030 0x7f8b9015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 -- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b9015d310 msgr2=0x7f8b9015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b9015d310 0x7f8b9015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 -- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b900ca030 msgr2=0x7f8b9015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b900ca030 0x7f8b9015dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 -- 172.21.15.80:0/515544581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9014e8e0 con 0x7f8b900cfcd0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8dd9b640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b9015d310 0x7f8b9015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8ed9d640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b900ca030 0x7f8b9015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b8e59c640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 0x7f8b900c9af0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80039800 con 0x7f8b900cfcd0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b800399a0 con 0x7f8b900cfcd0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b900ca740 con 0x7f8b900cfcd0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80039d90 con 0x7f8b900cfcd0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.563+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b900cad00 con 0x7f8b900cfcd0 2024-04-25T15:44:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.564+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9014eab0 con 0x7f8b900cfcd0 2024-04-25T15:44:36.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.565+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8b8002ad10 con 0x7f8b900cfcd0 2024-04-25T15:44:36.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.565+0000 7f8b7effd640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b700744e0 0x7f8b700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.565+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8b800b77c0 con 0x7f8b900cfcd0 2024-04-25T15:44:36.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.565+0000 7f8b8dd9b640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b700744e0 0x7f8b700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.566+0000 7f8b8dd9b640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b700744e0 0x7f8b700769f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b900ccc10 tx=0x7f8b84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.570+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b80081e50 con 0x7f8b900cfcd0 2024-04-25T15:44:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.780+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b9006a100 con 0x7f8b900cfcd0 2024-04-25T15:44:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.780+0000 7f8b7effd640 1 -- 172.21.15.80:0/515544581 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5184 (secure 0 0 0) 0x7f8b80081750 con 0x7f8b900cfcd0 2024-04-25T15:44:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:36.782 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:14.259011+0000","modified":"2024-04-25T15:44:16.265577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3809895897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3809895897},{"type":"v1","addr":"172.21.15.80:6837","nonce":3809895897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":2}]} 2024-04-25T15:44:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-04-25T15:44:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b700744e0 msgr2=0x7f8b700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b700744e0 0x7f8b700769f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b900ccc10 tx=0x7f8b84009040 comp rx=0 tx=0).stop 2024-04-25T15:44:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 msgr2=0x7f8b900c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 0x7f8b900c9af0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b800046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 shutdown_connections 2024-04-25T15:44:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8b700744e0 0x7f8b700769f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b900ca030 0x7f8b9015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b9015d310 0x7f8b9015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 --2- 172.21.15.80:0/515544581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b900cfcd0 0x7f8b900c9af0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.782+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 >> 172.21.15.80:0/515544581 conn(0x7f8b900b7750 msgr2=0x7f8b900d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.783+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 shutdown_connections 2024-04-25T15:44:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.783+0000 7f8b94cf2640 1 -- 172.21.15.80:0/515544581 wait complete. 2024-04-25T15:44:36.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:36.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.900+0000 7f0515ca8640 1 Processor -- start 2024-04-25T15:44:36.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.900+0000 7f0515ca8640 1 -- start start 2024-04-25T15:44:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.901+0000 7f0515ca8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0510153f70 0x7f05100b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.901+0000 7f0515ca8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f05100b0c00 0x7f051006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.901+0000 7f0515ca8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051006df20 con 0x7f051006db10 2024-04-25T15:44:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.901+0000 7f0515ca8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f05100b1180 con 0x7f0510153f70 2024-04-25T15:44:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.901+0000 7f0515ca8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f051015d4f0 con 0x7f05100b0c00 2024-04-25T15:44:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0510153f70 0x7f05100b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f051006db10 0x7f0510160940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40978/0 (socket says 172.21.15.80:40978) 2024-04-25T15:44:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050ffff640 1 -- 172.21.15.80:0/3059710828 learned_addr learned my addr 172.21.15.80:0/3059710828 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050effd640 1 --2- 172.21.15.80:0/3059710828 >> v2:172.21.15.195:3300/0 conn(0x7f05100b0c00 0x7f051006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050f7fe640 1 -- 172.21.15.80:0/3059710828 >> v2:172.21.15.195:3300/0 conn(0x7f05100b0c00 msgr2=0x7f051006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050f7fe640 1 --2- 172.21.15.80:0/3059710828 >> v2:172.21.15.195:3300/0 conn(0x7f05100b0c00 0x7f051006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050f7fe640 1 -- 172.21.15.80:0/3059710828 >> v1:172.21.15.80:6789/0 conn(0x7f051006db10 legacy=0x7f0510160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.902+0000 7f050f7fe640 1 -- 172.21.15.80:0/3059710828 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051015e270 con 0x7f0510153f70 2024-04-25T15:44:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f050f7fe640 1 --2- 172.21.15.80:0/3059710828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f05100b06c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f05100d2740 tx=0x7f050002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f20ba3a5ec2780d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f050e7fc640 1 -- 172.21.15.80:0/3059710828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500037070 con 0x7f0510153f70 2024-04-25T15:44:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f050e7fc640 1 -- 172.21.15.80:0/3059710828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500032440 con 0x7f0510153f70 2024-04-25T15:44:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f050e7fc640 1 -- 172.21.15.80:0/3059710828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500032810 con 0x7f0510153f70 2024-04-25T15:44:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 -- 172.21.15.80:0/3059710828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 msgr2=0x7f05100b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3059710828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f05100b06c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f05100d2740 tx=0x7f050002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 -- 172.21.15.80:0/3059710828 shutdown_connections 2024-04-25T15:44:36.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3059710828 >> v2:172.21.15.195:3300/0 conn(0x7f05100b0c00 0x7f051006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3059710828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f05100b06c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 -- 172.21.15.80:0/3059710828 >> 172.21.15.80:0/3059710828 conn(0x7f05100d1e20 msgr2=0x7f0510073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:36.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 -- 172.21.15.80:0/3059710828 shutdown_connections 2024-04-25T15:44:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.903+0000 7f0515ca8640 1 -- 172.21.15.80:0/3059710828 wait complete. 2024-04-25T15:44:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.905+0000 7f0515ca8640 1 Processor -- start 2024-04-25T15:44:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.905+0000 7f0515ca8640 1 -- start start 2024-04-25T15:44:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051006db10 0x7f0510141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05100b0c00 0x7f0510150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f051015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05100b5710 con 0x7f0510153f70 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f051015da70 con 0x7f05100b0c00 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f05100aefe0 con 0x7f051006db10 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f051015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f051015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40344/0 (socket says 172.21.15.80:40344) 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 -- 172.21.15.80:0/3299562118 learned_addr learned my addr 172.21.15.80:0/3299562118 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050f7fe640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051006db10 0x7f0510141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050effd640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05100b0c00 0x7f0510150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 -- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051006db10 msgr2=0x7f0510141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051006db10 0x7f0510141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 -- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05100b0c00 msgr2=0x7f0510150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05100b0c00 0x7f0510150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 -- 172.21.15.80:0/3299562118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0510155800 con 0x7f0510153f70 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f050ffff640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f051015be00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f050800cab0 tx=0x7f050800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508017070 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050800ac30 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0510154760 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508012400 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.907+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0510154d20 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.908+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0510147a80 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.909+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f050801a070 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.910+0000 7f04f7fff640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f04fc0744b0 0x7f04fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.910+0000 7f050f7fe640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f04fc0744b0 0x7f04fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.910+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0508094f80 con 0x7f0510153f70 2024-04-25T15:44:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.910+0000 7f050f7fe640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f04fc0744b0 0x7f04fc0769c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0500034000 tx=0x7f050002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:36.914+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0510147a80 con 0x7f0510153f70 2024-04-25T15:44:37.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.092+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0510070570 con 0x7f0510153f70 2024-04-25T15:44:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.093+0000 7f04f7fff640 1 -- 172.21.15.80:0/3299562118 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f051006df20 con 0x7f0510153f70 2024-04-25T15:44:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:37.094 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:15.889629+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:12.500873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:13.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f04fc0744b0 msgr2=0x7f04fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f04fc0744b0 0x7f04fc0769c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0500034000 tx=0x7f050002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 msgr2=0x7f051015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f051015be00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f050800cab0 tx=0x7f050800cf70 comp rx=0 tx=0).stop 2024-04-25T15:44:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 shutdown_connections 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f04fc0744b0 0x7f04fc0769c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0510153f70 0x7f051015be00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05100b0c00 0x7f0510150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 --2- 172.21.15.80:0/3299562118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051006db10 0x7f0510141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 >> 172.21.15.80:0/3299562118 conn(0x7f05100d1e20 msgr2=0x7f051006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 shutdown_connections 2024-04-25T15:44:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.095+0000 7f0515ca8640 1 -- 172.21.15.80:0/3299562118 wait complete. 2024-04-25T15:44:37.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:44:37.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.214+0000 7fe0e9d57640 1 Processor -- start 2024-04-25T15:44:37.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.214+0000 7fe0e9d57640 1 -- start start 2024-04-25T15:44:37.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e9d57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 0x7fe0e406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e9d57640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 0x7fe0e40b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e9d57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40d1010 con 0x7fe0e40d34a0 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e9d57640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e409cdf0 con 0x7fe0e40b3ac0 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e9d57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e409d0d0 con 0x7fe0e40b91b0 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e3fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 0x7fe0e40b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 0x7fe0e406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e3fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 0x7fe0e40b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:51640/0 (socket says 172.21.15.80:51640) 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e37fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe0e40d34a0 0x7fe0e406e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:39552/0 (socket says 172.21.15.80:39552) 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 0x7fe0e406da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:52294/0 (socket says 172.21.15.80:52294) 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e3fff640 1 -- 172.21.15.80:0/1024711976 learned_addr learned my addr 172.21.15.80:0/1024711976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/1024711976 >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 msgr2=0x7fe0e40b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e2ffd640 1 --2- 172.21.15.80:0/1024711976 >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 0x7fe0e40b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/1024711976 >> v1:172.21.15.195:6789/0 conn(0x7fe0e40d34a0 legacy=0x7fe0e406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/1024711976 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e406ec70 con 0x7fe0e40b91b0 2024-04-25T15:44:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.216+0000 7fe0e3fff640 1 --2- 172.21.15.80:0/1024711976 >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 0x7fe0e40b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.217+0000 7fe0e2ffd640 1 --2- 172.21.15.80:0/1024711976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 0x7fe0e406da90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80097a0 tx=0x7fe0d802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae9b81780c5f9cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.217+0000 7fe0e27fc640 1 -- 172.21.15.80:0/1024711976 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8037070 con 0x7fe0e40b91b0 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.217+0000 7fe0e27fc640 1 -- 172.21.15.80:0/1024711976 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d8032440 con 0x7fe0e40b91b0 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.217+0000 7fe0e27fc640 1 -- 172.21.15.80:0/1024711976 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8032810 con 0x7fe0e40b91b0 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 -- 172.21.15.80:0/1024711976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 msgr2=0x7fe0e406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/1024711976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 0x7fe0e406da90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80097a0 tx=0x7fe0d802a180 comp rx=0 tx=0).stop 2024-04-25T15:44:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 -- 172.21.15.80:0/1024711976 shutdown_connections 2024-04-25T15:44:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/1024711976 >> v2:172.21.15.195:3300/0 conn(0x7fe0e40b3ac0 0x7fe0e40b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/1024711976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b91b0 0x7fe0e406da90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 -- 172.21.15.80:0/1024711976 >> 172.21.15.80:0/1024711976 conn(0x7fe0e40d0450 msgr2=0x7fe0e40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 -- 172.21.15.80:0/1024711976 shutdown_connections 2024-04-25T15:44:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.218+0000 7fe0e9d57640 1 -- 172.21.15.80:0/1024711976 wait complete. 2024-04-25T15:44:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.220+0000 7fe0e9d57640 1 Processor -- start 2024-04-25T15:44:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.220+0000 7fe0e9d57640 1 -- start start 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e9d57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b3ac0 0x7fe0e40b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e9d57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 0x7fe0e41f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e9d57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40d34a0 0x7fe0e415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e9d57640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40b4410 con 0x7fe0e40b91b0 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e9d57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e406d7b0 con 0x7fe0e40d34a0 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e9d57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e40b4590 con 0x7fe0e40b3ac0 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 0x7fe0e41f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 0x7fe0e41f75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40348/0 (socket says 172.21.15.80:40348) 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.221+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/2205430994 learned_addr learned my addr 172.21.15.80:0/2205430994 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e37fe640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b3ac0 0x7fe0e40b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e3fff640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40d34a0 0x7fe0e415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b3ac0 msgr2=0x7fe0e40b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e2ffd640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b3ac0 0x7fe0e40b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40d34a0 msgr2=0x7fe0e415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e2ffd640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40d34a0 0x7fe0e415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e2ffd640 1 -- 172.21.15.80:0/2205430994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e415dec0 con 0x7fe0e40b91b0 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e2ffd640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 0x7fe0e41f75e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe0d802a1c0 tx=0x7fe0d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8041020 con 0x7fe0e40b91b0 2024-04-25T15:44:37.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d8030700 con 0x7fe0e40b91b0 2024-04-25T15:44:37.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8037040 con 0x7fe0e40b91b0 2024-04-25T15:44:37.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e415e1a0 con 0x7fe0e40b91b0 2024-04-25T15:44:37.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.222+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e40b0a00 con 0x7fe0e40b91b0 2024-04-25T15:44:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.223+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e406a100 con 0x7fe0e40b91b0 2024-04-25T15:44:37.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.224+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe0d8044020 con 0x7fe0e40b91b0 2024-04-25T15:44:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.224+0000 7fe0cbfff640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0d00744b0 0x7fe0d00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.224+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe0d80b5ab0 con 0x7fe0e40b91b0 2024-04-25T15:44:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.224+0000 7fe0e37fe640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0d00744b0 0x7fe0d00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.225+0000 7fe0e37fe640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0d00744b0 0x7fe0d00769c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000fb0 tx=0x7fe0d4007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.229+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0d804b030 con 0x7fe0e40b91b0 2024-04-25T15:44:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.440+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe0e40d2fa0 con 0x7fe0e40b91b0 2024-04-25T15:44:37.442 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:44:37.441+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:44:37.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.442+0000 7fe0cbfff640 1 -- 172.21.15.80:0/2205430994 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fe0d807fa60 con 0x7fe0e40b91b0 2024-04-25T15:44:37.444 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:44:37.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.445+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0d00744b0 msgr2=0x7fe0d00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.445+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0d00744b0 0x7fe0d00769c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000fb0 tx=0x7fe0d4007e70 comp rx=0 tx=0).stop 2024-04-25T15:44:37.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.445+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 msgr2=0x7fe0e41f75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.445+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 0x7fe0e41f75e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe0d802a1c0 tx=0x7fe0d80046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.445+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 shutdown_connections 2024-04-25T15:44:37.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0d00744b0 0x7fe0d00769c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40d34a0 0x7fe0e415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0e40b91b0 0x7fe0e41f75e0 secure :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe0d802a1c0 tx=0x7fe0d80046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 --2- 172.21.15.80:0/2205430994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0e40b3ac0 0x7fe0e40b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 >> 172.21.15.80:0/2205430994 conn(0x7fe0e40d0450 msgr2=0x7fe0e4071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:37.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 shutdown_connections 2024-04-25T15:44:37.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.446+0000 7fe0e9d57640 1 -- 172.21.15.80:0/2205430994 wait complete. 2024-04-25T15:44:37.449 INFO:tasks.ceph.mds.c.smithi080.stderr: -2578> 2024-04-25T15:44:19.568+0000 7f384a913640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:44:37.459 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:44:37.499 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:44:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.570+0000 7f43ba7a8640 1 Processor -- start 2024-04-25T15:44:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.570+0000 7f43ba7a8640 1 -- start start 2024-04-25T15:44:37.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43ba7a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43b4072060 0x7f43b40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43ba7a8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b415f650 con 0x7f43b4161d30 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43ba7a8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b415f090 con 0x7f43b415e6b0 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43ba7a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40d1d70 con 0x7f43b4072060 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b8d45640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43b4072060 0x7f43b40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b8d45640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43b4072060 0x7f43b40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40372/0 (socket says 172.21.15.80:40372) 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f43b4161d30 0x7f43b415bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40994/0 (socket says 172.21.15.80:40994) 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b8d45640 1 -- 172.21.15.80:0/3410383204 learned_addr learned my addr 172.21.15.80:0/3410383204 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b8d45640 1 -- 172.21.15.80:0/3410383204 >> v1:172.21.15.195:6789/0 conn(0x7f43b415e6b0 legacy=0x7f43b4071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b8d45640 1 -- 172.21.15.80:0/3410383204 >> v1:172.21.15.80:6789/0 conn(0x7f43b4161d30 legacy=0x7f43b415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.571+0000 7f43b8d45640 1 -- 172.21.15.80:0/3410383204 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b415f370 con 0x7f43b4072060 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.572+0000 7f43b8d45640 1 --2- 172.21.15.80:0/3410383204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b4072060 0x7f43b40b2620 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009e50 tx=0x7f43ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0bf49cada22164 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.572+0000 7f43b2ffd640 1 -- 172.21.15.80:0/3410383204 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac036070 con 0x7f43b4072060 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.572+0000 7f43b2ffd640 1 -- 172.21.15.80:0/3410383204 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac031600 con 0x7f43b4072060 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.572+0000 7f43b2ffd640 1 -- 172.21.15.80:0/3410383204 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0319d0 con 0x7f43b4072060 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 -- 172.21.15.80:0/3410383204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b4072060 msgr2=0x7f43b40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/3410383204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b4072060 0x7f43b40b2620 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009e50 tx=0x7f43ac02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 -- 172.21.15.80:0/3410383204 shutdown_connections 2024-04-25T15:44:37.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/3410383204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b4072060 0x7f43b40b2620 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 -- 172.21.15.80:0/3410383204 >> 172.21.15.80:0/3410383204 conn(0x7f43b40d39d0 msgr2=0x7f43b40d3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:37.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 -- 172.21.15.80:0/3410383204 shutdown_connections 2024-04-25T15:44:37.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.573+0000 7f43ba7a8640 1 -- 172.21.15.80:0/3410383204 wait complete. 2024-04-25T15:44:37.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.575+0000 7f43ba7a8640 1 Processor -- start 2024-04-25T15:44:37.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.575+0000 7f43ba7a8640 1 -- start start 2024-04-25T15:44:37.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43ba7a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b415e6b0 0x7f43b41e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43ba7a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161d30 0x7f43b41ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43ba7a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 0x7f43b41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43ba7a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40d3390 con 0x7f43b406f400 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43ba7a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40d3210 con 0x7f43b415e6b0 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43ba7a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43b40d3510 con 0x7f43b4161d30 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43b8d45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 0x7f43b41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43b8d45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 0x7f43b41572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40374/0 (socket says 172.21.15.80:40374) 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.576+0000 7f43b8d45640 1 -- 172.21.15.80:0/2958615026 learned_addr learned my addr 172.21.15.80:0/2958615026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b37fe640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161d30 0x7f43b41ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b3fff640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b415e6b0 0x7f43b41e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b8d45640 1 -- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161d30 msgr2=0x7f43b41ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b8d45640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161d30 0x7f43b41ea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b8d45640 1 -- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b415e6b0 msgr2=0x7f43b41e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:37.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b8d45640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b415e6b0 0x7f43b41e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b8d45640 1 -- 172.21.15.80:0/2958615026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b4158d40 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b37fe640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161d30 0x7f43b41ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b3fff640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b415e6b0 0x7f43b41e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b8d45640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 0x7f43b41572e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009f70 tx=0x7f43ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac03f020 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac037040 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b4159020 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac036070 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.577+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b41595e0 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.578+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b406a100 con 0x7f43b406f400 2024-04-25T15:44:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.579+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f43ac042020 con 0x7f43b406f400 2024-04-25T15:44:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.579+0000 7f43b0ff9640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43a00744b0 0x7f43a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.579+0000 7f43b3fff640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43a00744b0 0x7f43a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.579+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f43ac0b59e0 con 0x7f43b406f400 2024-04-25T15:44:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.580+0000 7f43b3fff640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43a00744b0 0x7f43a00769c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43a4000f60 tx=0x7f43a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:37.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.584+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43ac049030 con 0x7f43b406f400 2024-04-25T15:44:37.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:37.794+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f43b40d4730 con 0x7f43b406f400 2024-04-25T15:44:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.444+0000 7f43b0ff9640 1 -- 172.21.15.80:0/2958615026 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f43ac07f940 con 0x7f43b406f400 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43a00744b0 msgr2=0x7f43a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43a00744b0 0x7f43a00769c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43a4000f60 tx=0x7f43a4009040 comp rx=0 tx=0).stop 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 msgr2=0x7f43b41572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 0x7f43b41572e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009f70 tx=0x7f43ac004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 shutdown_connections 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43a00744b0 0x7f43a00769c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b406f400 0x7f43b41572e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43b4161d30 0x7f43b41ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 --2- 172.21.15.80:0/2958615026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b415e6b0 0x7f43b41e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.446+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 >> 172.21.15.80:0/2958615026 conn(0x7f43b40d39d0 msgr2=0x7f43b40b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.447+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 shutdown_connections 2024-04-25T15:44:38.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.447+0000 7f43ba7a8640 1 -- 172.21.15.80:0/2958615026 wait complete. 2024-04-25T15:44:38.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:44:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.618+0000 7f292c230640 1 Processor -- start 2024-04-25T15:44:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.618+0000 7f292c230640 1 -- start start 2024-04-25T15:44:38.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.619+0000 7f292c230640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 0x7f29240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.619+0000 7f292c230640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f29240b1ef0 0x7f29240b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.619+0000 7f292c230640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29241607c0 con 0x7f29240ce220 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.619+0000 7f292c230640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f29240cf4d0 con 0x7f29240b1ef0 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.619+0000 7f292c230640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f29240ce630 con 0x7f29240cf960 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2929fcc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f29240ce220 0x7f292409bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41006/0 (socket says 172.21.15.80:41006) 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2929fcc640 1 -- 172.21.15.80:0/746660746 learned_addr learned my addr 172.21.15.80:0/746660746 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307231837 0 0) 0x7f29241607c0 con 0x7f29240ce220 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2910003520 con 0x7f29240ce220 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f29297cb640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 0x7f29240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f292a7cd640 1 --2- 172.21.15.80:0/746660746 >> v2:172.21.15.195:3300/0 conn(0x7f29240b1ef0 0x7f29240b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4119977584 0 0) 0x7f2910003520 con 0x7f29240ce220 2024-04-25T15:44:38.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 msgr2=0x7f29240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 0x7f29240cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 >> v2:172.21.15.195:3300/0 conn(0x7f29240b1ef0 msgr2=0x7f29240b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 --2- 172.21.15.80:0/746660746 >> v2:172.21.15.195:3300/0 conn(0x7f29240b1ef0 0x7f29240b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29240ceba0 con 0x7f29240ce220 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f2920001670 con 0x7f29240ce220 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 >> v1:172.21.15.80:6789/0 conn(0x7f29240ce220 legacy=0x7f292409bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2910003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 0x7f2910004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2910004d40 0x7f2910005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f29240cf4d0 con 0x7f29100039b0 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29240ce630 con 0x7f2910004d40 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f291000ba40 con 0x7f29240cf960 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f2929fcc640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2910003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.620+0000 7f292a7cd640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2910004d40 0x7f2910005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f29297cb640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 0x7f2910004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2929fcc640 1 -- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 msgr2=0x7f2910004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2929fcc640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29240cf960 0x7f2910004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2929fcc640 1 -- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2910004d40 msgr2=0x7f2910005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2929fcc640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2910004d40 0x7f2910005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2929fcc640 1 -- 172.21.15.80:0/746660746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2910003520 con 0x7f29100039b0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2929fcc640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2910003e20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2920001eb0 tx=0x7f2910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642dd28367f991de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920007d70 con 0x7f29100039b0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2920005af0 con 0x7f29100039b0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.621+0000 7f2928fca640 1 -- 172.21.15.80:0/746660746 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920007070 con 0x7f29100039b0 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292c230640 1 -- 172.21.15.80:0/746660746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 msgr2=0x7f2910003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292c230640 1 --2- 172.21.15.80:0/746660746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2910003e20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2920001eb0 tx=0x7f2910005830 comp rx=0 tx=0).stop 2024-04-25T15:44:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292a7cd640 1 -- 172.21.15.80:0/746660746 reap_dead start 2024-04-25T15:44:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292c230640 1 -- 172.21.15.80:0/746660746 shutdown_connections 2024-04-25T15:44:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292c230640 1 -- 172.21.15.80:0/746660746 >> 172.21.15.80:0/746660746 conn(0x7f29240b7620 msgr2=0x7f29240b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292c230640 1 -- 172.21.15.80:0/746660746 shutdown_connections 2024-04-25T15:44:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.622+0000 7f292c230640 1 -- 172.21.15.80:0/746660746 wait complete. 2024-04-25T15:44:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.624+0000 7f292c230640 1 Processor -- start 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.624+0000 7f292c230640 1 -- start start 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f292c230640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2924155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f292c230640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29241f9770 0x7f29241f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f292c230640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29240ca060 0x7f29240ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f292c230640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f29240d3530 con 0x7f29100039b0 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f292c230640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29240cf160 con 0x7f29240ca060 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f292c230640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f29240c9bd0 con 0x7f29241f9770 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f2929fcc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2924155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f2929fcc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2924155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40378/0 (socket says 172.21.15.80:40378) 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.625+0000 7f2929fcc640 1 -- 172.21.15.80:0/38830659 learned_addr learned my addr 172.21.15.80:0/38830659 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f2929fcc640 1 -- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29241f9770 msgr2=0x7f29241f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f29297cb640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29241f9770 0x7f29241f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f292a7cd640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29240ca060 0x7f29240ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f2929fcc640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29241f9770 0x7f29241f9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f2929fcc640 1 -- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29240ca060 msgr2=0x7f29240ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f2929fcc640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29240ca060 0x7f29240ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f2929fcc640 1 -- 172.21.15.80:0/38830659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29241fa0c0 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f2929fcc640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2924155de0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2920034040 tx=0x7f2920000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920042070 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2920007480 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920007d50 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29240cc2a0 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.626+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29240cc860 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.627+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292406a100 con 0x7f29100039b0 2024-04-25T15:44:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.628+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2920045070 con 0x7f29100039b0 2024-04-25T15:44:38.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.628+0000 7f291a7fc640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29080744b0 0x7f29080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:38.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.628+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f29200b60c0 con 0x7f29100039b0 2024-04-25T15:44:38.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.628+0000 7f29297cb640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29080744b0 0x7f29080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:38.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.629+0000 7f29297cb640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29080744b0 0x7f29080769c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f29240d0120 tx=0x7f2914008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:38.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.633+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29241fa0c0 con 0x7f29100039b0 2024-04-25T15:44:38.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:38.809+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f29240b4070 con 0x7f29100039b0 2024-04-25T15:44:39.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.544+0000 7f291a7fc640 1 -- 172.21.15.80:0/38830659 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) ==== 181+0+0 (secure 0 0 0) 0x7f2920005ac0 con 0x7f29100039b0 2024-04-25T15:44:39.545 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.547+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29080744b0 msgr2=0x7f29080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.547+0000 7f292c230640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29080744b0 0x7f29080769c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f29240d0120 tx=0x7f2914008040 comp rx=0 tx=0).stop 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.547+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 msgr2=0x7f2924155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.547+0000 7f292c230640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2924155de0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2920034040 tx=0x7f2920000fe0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.547+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 shutdown_connections 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.547+0000 7f292c230640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29080744b0 0x7f29080769c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.548+0000 7f292c230640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29240ca060 0x7f29240ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.548+0000 7f292c230640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29241f9770 0x7f29241f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.548+0000 7f292c230640 1 --2- 172.21.15.80:0/38830659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29100039b0 0x7f2924155de0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.548+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 >> 172.21.15.80:0/38830659 conn(0x7f29240b7620 msgr2=0x7f2924071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:39.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.548+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 shutdown_connections 2024-04-25T15:44:39.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.548+0000 7f292c230640 1 -- 172.21.15.80:0/38830659 wait complete. 2024-04-25T15:44:39.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:44:39.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.674+0000 7f34d6a92640 1 Processor -- start 2024-04-25T15:44:39.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.674+0000 7f34d6a92640 1 -- start start 2024-04-25T15:44:39.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d6a92640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34d00ce220 0x7f34d009bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d6a92640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f34d00cfd70 0x7f34d00d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d6a92640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d01607c0 con 0x7f34d00cf960 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d6a92640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00cf4d0 con 0x7f34d00ce220 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d6a92640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00ce630 con 0x7f34d00cfd70 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34d00ce220 0x7f34d009bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34d00ce220 0x7f34d009bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40384/0 (socket says 172.21.15.80:40384) 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 -- 172.21.15.80:0/624688157 learned_addr learned my addr 172.21.15.80:0/624688157 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 -- 172.21.15.80:0/624688157 >> v2:172.21.15.195:3300/0 conn(0x7f34d00cfd70 msgr2=0x7f34d00d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 --2- 172.21.15.80:0/624688157 >> v2:172.21.15.195:3300/0 conn(0x7f34d00cfd70 0x7f34d00d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 -- 172.21.15.80:0/624688157 >> v1:172.21.15.195:6789/0 conn(0x7f34d00cf960 legacy=0x7f34d00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:39.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.675+0000 7f34d482e640 1 -- 172.21.15.80:0/624688157 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00d0180 con 0x7f34d00ce220 2024-04-25T15:44:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.676+0000 7f34d482e640 1 --2- 172.21.15.80:0/624688157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00ce220 0x7f34d009bb70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f34d0073ce0 tx=0x7f34c802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b9f39c776bd98e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.676+0000 7f34cf7fe640 1 -- 172.21.15.80:0/624688157 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8036070 con 0x7f34d00ce220 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.676+0000 7f34cf7fe640 1 -- 172.21.15.80:0/624688157 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8031600 con 0x7f34d00ce220 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.676+0000 7f34cf7fe640 1 -- 172.21.15.80:0/624688157 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80319d0 con 0x7f34d00ce220 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 -- 172.21.15.80:0/624688157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00ce220 msgr2=0x7f34d009bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 --2- 172.21.15.80:0/624688157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00ce220 0x7f34d009bb70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f34d0073ce0 tx=0x7f34c802a780 comp rx=0 tx=0).stop 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 -- 172.21.15.80:0/624688157 shutdown_connections 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 --2- 172.21.15.80:0/624688157 >> v2:172.21.15.195:3300/0 conn(0x7f34d00cfd70 0x7f34d00d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 --2- 172.21.15.80:0/624688157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00ce220 0x7f34d009bb70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 -- 172.21.15.80:0/624688157 >> 172.21.15.80:0/624688157 conn(0x7f34d00b7620 msgr2=0x7f34d00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 -- 172.21.15.80:0/624688157 shutdown_connections 2024-04-25T15:44:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.677+0000 7f34d6a92640 1 -- 172.21.15.80:0/624688157 wait complete. 2024-04-25T15:44:39.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.679+0000 7f34d6a92640 1 Processor -- start 2024-04-25T15:44:39.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.679+0000 7f34d6a92640 1 -- start start 2024-04-25T15:44:39.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34d6a92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00ce220 0x7f34d015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:39.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34d6a92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 0x7f34d01fa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:39.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34d6a92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d00cfd70 0x7f34d01fa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:39.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34d6a92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00cf160 con 0x7f34d00cf960 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34d6a92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00cee80 con 0x7f34d00cfd70 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34d6a92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34d009c0b0 con 0x7f34d00ce220 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 0x7f34d01fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 0x7f34d01fa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40388/0 (socket says 172.21.15.80:40388) 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.680+0000 7f34cffff640 1 -- 172.21.15.80:0/2831537331 learned_addr learned my addr 172.21.15.80:0/2831537331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34d502f640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d00cfd70 0x7f34d01fa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cffff640 1 -- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00ce220 msgr2=0x7f34d015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34d482e640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00ce220 0x7f34d015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cffff640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00ce220 0x7f34d015c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cffff640 1 -- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d00cfd70 msgr2=0x7f34d01fa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cffff640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d00cfd70 0x7f34d01fa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cffff640 1 -- 172.21.15.80:0/2831537331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d01f7e60 con 0x7f34d00cf960 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34d502f640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d00cfd70 0x7f34d01fa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cffff640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 0x7f34d01fa270 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b410 tx=0x7f34c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4015020 con 0x7f34d00cf960 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4011830 con 0x7f34d00cf960 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4011c20 con 0x7f34d00cf960 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d00cc4c0 con 0x7f34d00cf960 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.681+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d01f7b80 con 0x7f34d00cf960 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.682+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d006a100 con 0x7f34d00cf960 2024-04-25T15:44:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.683+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f34c4018020 con 0x7f34d00cf960 2024-04-25T15:44:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.683+0000 7f34cd7fa640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34bc0744b0 0x7f34bc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.683+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5749+0+0 (secure 0 0 0) 0x7f34c4095110 con 0x7f34d00cf960 2024-04-25T15:44:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.683+0000 7f34d482e640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34bc0744b0 0x7f34bc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.684+0000 7f34d482e640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34bc0744b0 0x7f34bc0769c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34c8033000 tx=0x7f34c8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:39.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.688+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34c401f020 con 0x7f34d00cf960 2024-04-25T15:44:39.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:39.861+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34d0160460 con 0x7f34d00cf960 2024-04-25T15:44:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.551+0000 7f34cd7fa640 1 -- 172.21.15.80:0/2831537331 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) ==== 169+0+0 (secure 0 0 0) 0x7f34c405f990 con 0x7f34d00cf960 2024-04-25T15:44:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:44:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34bc0744b0 msgr2=0x7f34bc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34bc0744b0 0x7f34bc0769c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34c8033000 tx=0x7f34c8009000 comp rx=0 tx=0).stop 2024-04-25T15:44:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 msgr2=0x7f34d01fa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 0x7f34d01fa270 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b410 tx=0x7f34c400b8d0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 shutdown_connections 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34bc0744b0 0x7f34bc0769c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d00cfd70 0x7f34d01fa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34d00cf960 0x7f34d01fa270 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 --2- 172.21.15.80:0/2831537331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00ce220 0x7f34d015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 >> 172.21.15.80:0/2831537331 conn(0x7f34d00b7620 msgr2=0x7f34d0071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 shutdown_connections 2024-04-25T15:44:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.553+0000 7f34d6a92640 1 -- 172.21.15.80:0/2831537331 wait complete. 2024-04-25T15:44:40.566 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T15:44:40.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.676+0000 7f012b04c640 1 Processor -- start 2024-04-25T15:44:40.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.676+0000 7f012b04c640 1 -- start start 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f012b04c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f01240b2b80 0x7f012415e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f012b04c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0124161b00 con 0x7f01240d0a90 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f012b04c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0124161dc0 con 0x7f01240cee90 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f012b04c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f01241620a0 con 0x7f01240b2b80 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f01295e9640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01240d0a90 0x7f01240d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41020/0 (socket says 172.21.15.80:41020) 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f01295e9640 1 -- 172.21.15.80:0/4126245809 learned_addr learned my addr 172.21.15.80:0/4126245809 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984258755 0 0) 0x7f0124161b00 con 0x7f01240d0a90 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0110003520 con 0x7f01240d0a90 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.677+0000 7f0128de8640 1 --2- 172.21.15.80:0/4126245809 >> v2:172.21.15.195:3300/0 conn(0x7f01240b2b80 0x7f012415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 413665414 0 0) 0x7f0110003520 con 0x7f01240d0a90 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 >> v2:172.21.15.195:3300/0 conn(0x7f01240b2b80 msgr2=0x7f012415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 --2- 172.21.15.80:0/4126245809 >> v2:172.21.15.195:3300/0 conn(0x7f01240b2b80 0x7f012415e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 >> v1:172.21.15.195:6789/0 conn(0x7f01240cee90 legacy=0x7f01240d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0124162380 con 0x7f01240d0a90 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f011c0019f0 con 0x7f01240d0a90 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 >> v1:172.21.15.80:6789/0 conn(0x7f01240d0a90 legacy=0x7f01240d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01100039b0 0x7f0110003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0110004800 0x7f0110004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0110005300 0x7f011000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01241620a0 con 0x7f01100039b0 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f011000c2a0 con 0x7f0110005300 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f011000c4a0 con 0x7f0110004800 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0128de8640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01100039b0 0x7f0110003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01295e9640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0110005300 0x7f011000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0123fff640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0110004800 0x7f0110004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0128de8640 1 -- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0110004800 msgr2=0x7f0110004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0128de8640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0110004800 0x7f0110004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0128de8640 1 -- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0110005300 msgr2=0x7f011000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0128de8640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0110005300 0x7f011000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f0128de8640 1 -- 172.21.15.80:0/4126245809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0110003520 con 0x7f01100039b0 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01295e9640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0110005300 0x7f011000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.678+0000 7f01295e9640 1 -- 172.21.15.80:0/4126245809 reap_dead start 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.679+0000 7f0128de8640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01100039b0 0x7f0110003e20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f010c00ba30 tx=0x7f0110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78556ec4808ef4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.679+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c030070 con 0x7f01100039b0 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.679+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c02ade0 con 0x7f01100039b0 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.679+0000 7f01237fe640 1 -- 172.21.15.80:0/4126245809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c00b600 con 0x7f01100039b0 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 -- 172.21.15.80:0/4126245809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01100039b0 msgr2=0x7f0110003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01100039b0 0x7f0110003e20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f010c00ba30 tx=0x7f0110005830 comp rx=0 tx=0).stop 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 -- 172.21.15.80:0/4126245809 shutdown_connections 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 --2- 172.21.15.80:0/4126245809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01100039b0 0x7f0110003e20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 -- 172.21.15.80:0/4126245809 >> 172.21.15.80:0/4126245809 conn(0x7f01240b54a0 msgr2=0x7f01240b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 -- 172.21.15.80:0/4126245809 shutdown_connections 2024-04-25T15:44:40.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.680+0000 7f012b04c640 1 -- 172.21.15.80:0/4126245809 wait complete. 2024-04-25T15:44:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.681+0000 7f012b04c640 1 Processor -- start 2024-04-25T15:44:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.682+0000 7f012b04c640 1 -- start start 2024-04-25T15:44:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f012b04c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01100039b0 0x7f0124158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f012b04c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 0x7f01240c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f012b04c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01240c9a40 0x7f01240c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f012b04c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01240cf2a0 con 0x7f01240cd1c0 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f012b04c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0124162940 con 0x7f01100039b0 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f012b04c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01240cf420 con 0x7f01240c9a40 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 0x7f01240c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 0x7f01240c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40408/0 (socket says 172.21.15.80:40408) 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 -- 172.21.15.80:0/4124259447 learned_addr learned my addr 172.21.15.80:0/4124259447 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f01295e9640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01240c9a40 0x7f01240c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0128de8640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01100039b0 0x7f0124158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 -- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01240c9a40 msgr2=0x7f01240c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01240c9a40 0x7f01240c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 -- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01100039b0 msgr2=0x7f0124158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01100039b0 0x7f0124158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.683+0000 7f0123fff640 1 -- 172.21.15.80:0/4124259447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0124160f10 con 0x7f01240cd1c0 2024-04-25T15:44:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.684+0000 7f0123fff640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 0x7f01240c9500 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f011400e500 tx=0x7f011400e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.684+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01140053a0 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.684+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0114018070 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.684+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01240cb6a0 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.684+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114003810 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.684+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01241609a0 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.685+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0124160c80 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.685+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f01140039b0 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.686+0000 7f01217fa640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01040744b0 0x7f01040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.686+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f0114094cd0 con 0x7f01240cd1c0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.686+0000 7f0128de8640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01040744b0 0x7f01040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.686+0000 7f0128de8640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01040744b0 0x7f01040769c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f010c00ba00 tx=0x7f010c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.690+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f011405f670 con 0x7f01240cd1c0 2024-04-25T15:44:40.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.864+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f012406a100 con 0x7f01240cd1c0 2024-04-25T15:44:40.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.868+0000 7f01217fa640 1 -- 172.21.15.80:0/4124259447 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) ==== 104+0+0 (secure 0 0 0) 0x7f011405ef70 con 0x7f01240cd1c0 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01040744b0 msgr2=0x7f01040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01040744b0 0x7f01040769c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f010c00ba00 tx=0x7f010c030000 comp rx=0 tx=0).stop 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 msgr2=0x7f01240c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 0x7f01240c9500 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f011400e500 tx=0x7f011400e9c0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 shutdown_connections 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01040744b0 0x7f01040769c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01240c9a40 0x7f01240c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01240cd1c0 0x7f01240c9500 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 --2- 172.21.15.80:0/4124259447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01100039b0 0x7f0124158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 >> 172.21.15.80:0/4124259447 conn(0x7f01240b54a0 msgr2=0x7f01240d3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 shutdown_connections 2024-04-25T15:44:40.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.870+0000 7f012b04c640 1 -- 172.21.15.80:0/4124259447 wait complete. 2024-04-25T15:44:40.883 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-04-25T15:44:40.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.991+0000 7f588daf0640 1 Processor -- start 2024-04-25T15:44:40.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.991+0000 7f588daf0640 1 -- start start 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f588daf0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58880b2b80 0x7f588815e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f588daf0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f588daf0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58880d0cd0 con 0x7f58880d08c0 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f588daf0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5888161b00 con 0x7f58880b2b80 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f588daf0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5888161dc0 con 0x7f58880cee90 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f58877fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58880b2b80 0x7f588815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f58877fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58880b2b80 0x7f588815e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40422/0 (socket says 172.21.15.80:40422) 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.992+0000 7f58877fe640 1 -- 172.21.15.80:0/3701529417 learned_addr learned my addr 172.21.15.80:0/3701529417 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58877fe640 1 -- 172.21.15.80:0/3701529417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 msgr2=0x7f58880d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f5886ffd640 1 --2- 172.21.15.80:0/3701529417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:40.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58877fe640 1 --2- 172.21.15.80:0/3701529417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58877fe640 1 -- 172.21.15.80:0/3701529417 >> v1:172.21.15.195:6789/0 conn(0x7f58880d08c0 legacy=0x7f5888071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:40.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58877fe640 1 -- 172.21.15.80:0/3701529417 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58881620a0 con 0x7f58880b2b80 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58877fe640 1 --2- 172.21.15.80:0/3701529417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f588815e060 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f587802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d779479b58f0ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58867fc640 1 -- 172.21.15.80:0/3701529417 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878037070 con 0x7f58880b2b80 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58867fc640 1 -- 172.21.15.80:0/3701529417 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878032440 con 0x7f58880b2b80 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.993+0000 7f58867fc640 1 -- 172.21.15.80:0/3701529417 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878032810 con 0x7f58880b2b80 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 -- 172.21.15.80:0/3701529417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 msgr2=0x7f588815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 --2- 172.21.15.80:0/3701529417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f588815e060 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f587802a180 comp rx=0 tx=0).stop 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 -- 172.21.15.80:0/3701529417 shutdown_connections 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 --2- 172.21.15.80:0/3701529417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 --2- 172.21.15.80:0/3701529417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f588815e060 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:40.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 -- 172.21.15.80:0/3701529417 >> 172.21.15.80:0/3701529417 conn(0x7f58880b54a0 msgr2=0x7f58880b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:40.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 -- 172.21.15.80:0/3701529417 shutdown_connections 2024-04-25T15:44:40.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.994+0000 7f588daf0640 1 -- 172.21.15.80:0/3701529417 wait complete. 2024-04-25T15:44:40.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.996+0000 7f588daf0640 1 Processor -- start 2024-04-25T15:44:40.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.996+0000 7f588daf0640 1 -- start start 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.997+0000 7f588daf0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f58880c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.997+0000 7f588daf0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.997+0000 7f588daf0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880d08c0 0x7f58880c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.997+0000 7f588daf0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5888162940 con 0x7f58880b2b80 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.997+0000 7f588daf0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5888162660 con 0x7f58880d08c0 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.997+0000 7f588daf0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f58880cf2a0 con 0x7f58880cee90 2024-04-25T15:44:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f58880c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f58880c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40426/0 (socket says 172.21.15.80:40426) 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 -- 172.21.15.80:0/2716266568 learned_addr learned my addr 172.21.15.80:0/2716266568 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f5886ffd640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f5887fff640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880d08c0 0x7f58880c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 -- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 msgr2=0x7f58880c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 -- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880d08c0 msgr2=0x7f58880c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880d08c0 0x7f58880c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 -- 172.21.15.80:0/2716266568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58880cb9c0 con 0x7f58880b2b80 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f5886ffd640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f5887fff640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880d08c0 0x7f58880c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f58877fe640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f58880c9190 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f58780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878037040 con 0x7f58880b2b80 2024-04-25T15:44:41.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878042070 con 0x7f58880b2b80 2024-04-25T15:44:41.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58880cbca0 con 0x7f58880b2b80 2024-04-25T15:44:41.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878030bb0 con 0x7f58880b2b80 2024-04-25T15:44:41.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.998+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58880cc260 con 0x7f58880b2b80 2024-04-25T15:44:41.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:40.999+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588806a100 con 0x7f58880b2b80 2024-04-25T15:44:41.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.000+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5878047460 con 0x7f58880b2b80 2024-04-25T15:44:41.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.000+0000 7f586ffff640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58740744b0 0x7f58740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.000+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f58780b5db0 con 0x7f58880b2b80 2024-04-25T15:44:41.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.000+0000 7f5886ffd640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58740744b0 0x7f58740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.001+0000 7f5886ffd640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58740744b0 0x7f58740769c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f58881f7d40 tx=0x7f587c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.005+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5878080060 con 0x7f58880b2b80 2024-04-25T15:44:41.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.194+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) -- 0x7f58880d1c50 con 0x7f58880b2b80 2024-04-25T15:44:41.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.198+0000 7f586ffff640 1 -- 172.21.15.80:0/2716266568 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v13) ==== 106+0+0 (secure 0 0 0) 0x7f5878084360 con 0x7f58880b2b80 2024-04-25T15:44:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58740744b0 msgr2=0x7f58740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58740744b0 0x7f58740769c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f58881f7d40 tx=0x7f587c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 msgr2=0x7f58880c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f58880c9190 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f58780046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 shutdown_connections 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f58740744b0 0x7f58740769c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880d08c0 0x7f58880c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58880cee90 0x7f58880c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 --2- 172.21.15.80:0/2716266568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58880b2b80 0x7f58880c9190 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 >> 172.21.15.80:0/2716266568 conn(0x7f58880b54a0 msgr2=0x7f588815ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 shutdown_connections 2024-04-25T15:44:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.200+0000 7f588daf0640 1 -- 172.21.15.80:0/2716266568 wait complete. 2024-04-25T15:44:41.212 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-04-25T15:44:41.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.319+0000 7f278d30d640 1 Processor -- start 2024-04-25T15:44:41.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.319+0000 7f278d30d640 1 -- start start 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.320+0000 7f278d30d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27880b7d60 0x7f278816b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.320+0000 7f278d30d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27880d59d0 con 0x7f27880b48d0 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.320+0000 7f278d30d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2788163fb0 con 0x7f27880d41b0 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.320+0000 7f278d30d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2788164270 con 0x7f27880b7d60 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.320+0000 7f27877fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27880b7d60 0x7f278816b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f27877fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27880b7d60 0x7f278816b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40438/0 (socket says 172.21.15.80:40438) 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f27867fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27880b48d0 0x7f27880b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41024/0 (socket says 172.21.15.80:41024) 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f27877fe640 1 -- 172.21.15.80:0/3124915697 learned_addr learned my addr 172.21.15.80:0/3124915697 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f27877fe640 1 -- 172.21.15.80:0/3124915697 >> v1:172.21.15.195:6789/0 conn(0x7f27880d41b0 legacy=0x7f27881602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f27877fe640 1 -- 172.21.15.80:0/3124915697 >> v1:172.21.15.80:6789/0 conn(0x7f27880b48d0 legacy=0x7f27880b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f27877fe640 1 -- 172.21.15.80:0/3124915697 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2788164550 con 0x7f27880b7d60 2024-04-25T15:44:41.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.321+0000 7f2785ffb640 1 -- 172.21.15.80:0/3124915697 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865026624 0 0) 0x7f27880d59d0 con 0x7f27880b48d0 2024-04-25T15:44:41.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f27877fe640 1 --2- 172.21.15.80:0/3124915697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880b7d60 0x7f278816b2e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2780009e50 tx=0x7f278002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978a0aa6f15cf042 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:41.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f2785ffb640 1 -- 172.21.15.80:0/3124915697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780036070 con 0x7f27880b7d60 2024-04-25T15:44:41.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f2785ffb640 1 -- 172.21.15.80:0/3124915697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780031600 con 0x7f27880b7d60 2024-04-25T15:44:41.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f2785ffb640 1 -- 172.21.15.80:0/3124915697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27800319d0 con 0x7f27880b7d60 2024-04-25T15:44:41.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 -- 172.21.15.80:0/3124915697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880b7d60 msgr2=0x7f278816b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 --2- 172.21.15.80:0/3124915697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880b7d60 0x7f278816b2e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2780009e50 tx=0x7f278002a730 comp rx=0 tx=0).stop 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 -- 172.21.15.80:0/3124915697 shutdown_connections 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 --2- 172.21.15.80:0/3124915697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880b7d60 0x7f278816b2e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 -- 172.21.15.80:0/3124915697 >> 172.21.15.80:0/3124915697 conn(0x7f278806e9f0 msgr2=0x7f27880d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 -- 172.21.15.80:0/3124915697 shutdown_connections 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.322+0000 7f278d30d640 1 -- 172.21.15.80:0/3124915697 wait complete. 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.324+0000 7f278d30d640 1 Processor -- start 2024-04-25T15:44:41.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.324+0000 7f278d30d640 1 -- start start 2024-04-25T15:44:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880b48d0 0x7f27880cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27880d41b0 0x7f27880cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 0x7f2788151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f27880b4fd0 con 0x7f27880cbfb0 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2788164b10 con 0x7f27880b48d0 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f27880b5150 con 0x7f27880d41b0 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 0x7f2788151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 0x7f2788151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40446/0 (socket says 172.21.15.80:40446) 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 -- 172.21.15.80:0/1663794254 learned_addr learned my addr 172.21.15.80:0/1663794254 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f2786ffd640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880b48d0 0x7f27880cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27867fc640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27880d41b0 0x7f27880cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 -- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27880d41b0 msgr2=0x7f27880cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27880d41b0 0x7f27880cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 -- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880b48d0 msgr2=0x7f27880cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880b48d0 0x7f27880cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 -- 172.21.15.80:0/1663794254 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278815c190 con 0x7f27880cbfb0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f27877fe640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 0x7f2788151950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2780034040 tx=0x7f2780004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780041070 con 0x7f27880cbfb0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780003990 con 0x7f27880cbfb0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27880d10a0 con 0x7f27880cbfb0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.326+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780036040 con 0x7f27880cbfb0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.327+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27880d02e0 con 0x7f27880cbfb0 2024-04-25T15:44:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.328+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27880cfd70 con 0x7f27880cbfb0 2024-04-25T15:44:41.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.328+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f27800077a0 con 0x7f27880cbfb0 2024-04-25T15:44:41.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.329+0000 7f276f7fe640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27740744b0 0x7f27740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:41.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.329+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f27800b5b90 con 0x7f27880cbfb0 2024-04-25T15:44:41.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.329+0000 7f2786ffd640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27740744b0 0x7f27740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:41.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.329+0000 7f2786ffd640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27740744b0 0x7f27740769c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2778000f60 tx=0x7f2778009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:41.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.333+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f278004b020 con 0x7f27880cbfb0 2024-04-25T15:44:41.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:41.584+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7f278806a100 con 0x7f27880cbfb0 2024-04-25T15:44:42.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.554+0000 7f276f7fe640 1 -- 172.21.15.80:0/1663794254 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v120) ==== 144+0+0 (secure 0 0 0) 0x7f278007fed0 con 0x7f27880cbfb0 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.556+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27740744b0 msgr2=0x7f27740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.556+0000 7f278d30d640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27740744b0 0x7f27740769c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2778000f60 tx=0x7f2778009040 comp rx=0 tx=0).stop 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.556+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 msgr2=0x7f2788151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.556+0000 7f278d30d640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 0x7f2788151950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2780034040 tx=0x7f2780004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 shutdown_connections 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f27740744b0 0x7f27740769c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27880cbfb0 0x7f2788151950 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27880d41b0 0x7f27880cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 --2- 172.21.15.80:0/1663794254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880b48d0 0x7f27880cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 >> 172.21.15.80:0/1663794254 conn(0x7f278806e9f0 msgr2=0x7f27880b96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 shutdown_connections 2024-04-25T15:44:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.557+0000 7f278d30d640 1 -- 172.21.15.80:0/1663794254 wait complete. 2024-04-25T15:44:42.571 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2024-04-25T15:44:42.572 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2024-04-25T15:44:42.572 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-25T15:44:42.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:42.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.684+0000 7f2e57661640 1 Processor -- start 2024-04-25T15:44:42.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.685+0000 7f2e57661640 1 -- start start 2024-04-25T15:44:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e57661640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e500cff30 0x7f2e500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:42.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e57661640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5009d2a0 con 0x7f2e500b2a40 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e57661640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e500b9350 con 0x7f2e5009ce90 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e57661640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2e500cfb70 con 0x7f2e500cff30 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e553fd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e500cff30 0x7f2e500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e553fd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e500cff30 0x7f2e500b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40458/0 (socket says 172.21.15.80:40458) 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e553fd640 1 -- 172.21.15.80:0/41209778 learned_addr learned my addr 172.21.15.80:0/41209778 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e54bfc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2e500b2a40 0x7f2e500d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41028/0 (socket says 172.21.15.80:41028) 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e553fd640 1 -- 172.21.15.80:0/41209778 >> v1:172.21.15.195:6789/0 conn(0x7f2e5009ce90 legacy=0x7f2e500d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e553fd640 1 -- 172.21.15.80:0/41209778 >> v1:172.21.15.80:6789/0 conn(0x7f2e500b2a40 legacy=0x7f2e500d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e47fff640 1 -- 172.21.15.80:0/41209778 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970159144 0 0) 0x7f2e40001110 con 0x7f2e500b2a40 2024-04-25T15:44:42.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.686+0000 7f2e553fd640 1 -- 172.21.15.80:0/41209778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e500cf890 con 0x7f2e500cff30 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.687+0000 7f2e553fd640 1 --2- 172.21.15.80:0/41209778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e500b7230 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009ea0 tx=0x7f2e4c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0467390c184010b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.687+0000 7f2e47fff640 1 -- 172.21.15.80:0/41209778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c036070 con 0x7f2e500cff30 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.687+0000 7f2e47fff640 1 -- 172.21.15.80:0/41209778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c031600 con 0x7f2e500cff30 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.687+0000 7f2e47fff640 1 -- 172.21.15.80:0/41209778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0319d0 con 0x7f2e500cff30 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 -- 172.21.15.80:0/41209778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 msgr2=0x7f2e500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 --2- 172.21.15.80:0/41209778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e500b7230 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009ea0 tx=0x7f2e4c02a760 comp rx=0 tx=0).stop 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 -- 172.21.15.80:0/41209778 shutdown_connections 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 --2- 172.21.15.80:0/41209778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e500b7230 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 -- 172.21.15.80:0/41209778 >> 172.21.15.80:0/41209778 conn(0x7f2e500d0450 msgr2=0x7f2e500d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 -- 172.21.15.80:0/41209778 shutdown_connections 2024-04-25T15:44:42.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.688+0000 7f2e57661640 1 -- 172.21.15.80:0/41209778 wait complete. 2024-04-25T15:44:42.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.690+0000 7f2e57661640 1 Processor -- start 2024-04-25T15:44:42.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.690+0000 7f2e57661640 1 -- start start 2024-04-25T15:44:42.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e57661640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e5009ce90 0x7f2e50161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:42.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e57661640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e500b2a40 0x7f2e5006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e57661640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e5006dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e57661640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2e500d1cb0 con 0x7f2e500cff30 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e57661640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2e500b9020 con 0x7f2e5009ce90 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e57661640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2e500cf540 con 0x7f2e500b2a40 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e55bfe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e5006dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e55bfe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e5006dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40460/0 (socket says 172.21.15.80:40460) 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.691+0000 7f2e55bfe640 1 -- 172.21.15.80:0/3924892461 learned_addr learned my addr 172.21.15.80:0/3924892461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e553fd640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e5009ce90 0x7f2e50161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e54bfc640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e500b2a40 0x7f2e5006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e55bfe640 1 -- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e500b2a40 msgr2=0x7f2e5006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e55bfe640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e500b2a40 0x7f2e5006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e55bfe640 1 -- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e5009ce90 msgr2=0x7f2e50161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e55bfe640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e5009ce90 0x7f2e50161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e55bfe640 1 -- 172.21.15.80:0/3924892461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5015ed10 con 0x7f2e500cff30 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e55bfe640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e5006dca0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800b4c0 tx=0x7f2e4800b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48015020 con 0x7f2e500cff30 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e48011850 con 0x7f2e500cff30 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48011c40 con 0x7f2e500cff30 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5015f210 con 0x7f2e500cff30 2024-04-25T15:44:42.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.692+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e500cc440 con 0x7f2e500cff30 2024-04-25T15:44:42.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.693+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e50072d80 con 0x7f2e500cff30 2024-04-25T15:44:42.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.694+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2e48018020 con 0x7f2e500cff30 2024-04-25T15:44:42.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.694+0000 7f2e45ffb640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e340744e0 0x7f2e340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:42.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.694+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f2e48094a60 con 0x7f2e500cff30 2024-04-25T15:44:42.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.694+0000 7f2e553fd640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e340744e0 0x7f2e340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:42.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.695+0000 7f2e553fd640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e340744e0 0x7f2e340769f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c033000 tx=0x7f2e4c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.699+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e50072d80 con 0x7f2e500cff30 2024-04-25T15:44:42.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.877+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e5006a100 con 0x7f2e500cff30 2024-04-25T15:44:42.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.878+0000 7f2e45ffb640 1 -- 172.21.15.80:0/3924892461 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+13281 (secure 0 0 0) 0x7f2e4801f070 con 0x7f2e500cff30 2024-04-25T15:44:42.879 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:42.879 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":42,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:40.545841+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/3809895897":"2024-04-26T15:44:37.442138+0000","172.21.15.80:6836/3809895897":"2024-04-26T15:44:37.442138+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:42.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e340744e0 msgr2=0x7f2e340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e340744e0 0x7f2e340769f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c033000 tx=0x7f2e4c009000 comp rx=0 tx=0).stop 2024-04-25T15:44:42.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 msgr2=0x7f2e5006dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e5006dca0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800b4c0 tx=0x7f2e4800b980 comp rx=0 tx=0).stop 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 shutdown_connections 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e340744e0 0x7f2e340769f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e500cff30 0x7f2e5006dca0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e500b2a40 0x7f2e5006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 --2- 172.21.15.80:0/3924892461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e5009ce90 0x7f2e50161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 >> 172.21.15.80:0/3924892461 conn(0x7f2e500d0450 msgr2=0x7f2e50072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 shutdown_connections 2024-04-25T15:44:42.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:42.880+0000 7f2e57661640 1 -- 172.21.15.80:0/3924892461 wait complete. 2024-04-25T15:44:42.892 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:42.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:43.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.002+0000 7fdf50092640 1 Processor -- start 2024-04-25T15:44:43.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.002+0000 7fdf50092640 1 -- start start 2024-04-25T15:44:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.003+0000 7fdf50092640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480b3cb0 0x7fdf480d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.003+0000 7fdf50092640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf480d02c0 con 0x7fdf4806ece0 2024-04-25T15:44:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.003+0000 7fdf50092640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf480d2160 con 0x7fdf480cf2f0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.003+0000 7fdf50092640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4806cab0 con 0x7fdf480b3cb0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.003+0000 7fdf4e62f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdf4806ece0 0x7fdf4806cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41036/0 (socket says 172.21.15.80:41036) 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.003+0000 7fdf4e62f640 1 -- 172.21.15.80:0/3667448275 learned_addr learned my addr 172.21.15.80:0/3667448275 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480b3cb0 0x7fdf480d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256062111 0 0) 0x7fdf480d02c0 con 0x7fdf4806ece0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf34003520 con 0x7fdf4806ece0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518878103 0 0) 0x7fdf480d2160 con 0x7fdf480cf2f0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf480d02c0 con 0x7fdf480cf2f0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525203303 0 0) 0x7fdf34003520 con 0x7fdf4806ece0 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480b3cb0 msgr2=0x7fdf480d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf480b3cb0 0x7fdf480d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 >> v1:172.21.15.195:6789/0 conn(0x7fdf480cf2f0 legacy=0x7fdf480b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf480d2440 con 0x7fdf4806ece0 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fdf400019f0 con 0x7fdf4806ece0 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 >> v1:172.21.15.80:6789/0 conn(0x7fdf4806ece0 legacy=0x7fdf4806cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34003b70 0x7fdf34003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf34004800 0x7fdf34004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf34005150 0x7fdf3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4806cab0 con 0x7fdf34004800 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3400bfb0 con 0x7fdf34005150 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3400c1b0 con 0x7fdf34003b70 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf34004800 0x7fdf34004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4de2e640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34003b70 0x7fdf34003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4e62f640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf34005150 0x7fdf3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 -- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34003b70 msgr2=0x7fdf34003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34003b70 0x7fdf34003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 -- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf34005150 msgr2=0x7fdf3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf34005150 0x7fdf3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4d62d640 1 -- 172.21.15.80:0/3667448275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf34003520 con 0x7fdf34004800 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.004+0000 7fdf4e62f640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf34005150 0x7fdf3400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.005+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf34004800 0x7fdf34004c10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009ac0 tx=0x7fdf34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8861b3836b5366c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.005+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38036070 con 0x7fdf34004800 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.005+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf38031400 con 0x7fdf34004800 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.005+0000 7fdf4ce2c640 1 -- 172.21.15.80:0/3667448275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38009690 con 0x7fdf34004800 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf50092640 1 -- 172.21.15.80:0/3667448275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf34004800 msgr2=0x7fdf34004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf50092640 1 --2- 172.21.15.80:0/3667448275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf34004800 0x7fdf34004c10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009ac0 tx=0x7fdf34005830 comp rx=0 tx=0).stop 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf4e62f640 1 -- 172.21.15.80:0/3667448275 reap_dead start 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf50092640 1 -- 172.21.15.80:0/3667448275 shutdown_connections 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf50092640 1 -- 172.21.15.80:0/3667448275 >> 172.21.15.80:0/3667448275 conn(0x7fdf480b75f0 msgr2=0x7fdf480b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf50092640 1 -- 172.21.15.80:0/3667448275 shutdown_connections 2024-04-25T15:44:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.006+0000 7fdf50092640 1 -- 172.21.15.80:0/3667448275 wait complete. 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.008+0000 7fdf50092640 1 Processor -- start 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.008+0000 7fdf50092640 1 -- start start 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf50092640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34004800 0x7fdf480b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf50092640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4809c800 0x7fdf4814fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf50092640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 0x7fdf480b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf50092640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480b3e30 con 0x7fdf480b0a40 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf50092640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480b3cb0 con 0x7fdf4809c800 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf50092640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf480d19d0 con 0x7fdf34004800 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf4e62f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 0x7fdf480b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf4e62f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 0x7fdf480b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40478/0 (socket says 172.21.15.80:40478) 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf4e62f640 1 -- 172.21.15.80:0/2476768664 learned_addr learned my addr 172.21.15.80:0/2476768664 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.009+0000 7fdf4de2e640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34004800 0x7fdf480b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4809c800 0x7fdf4814fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4e62f640 1 -- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34004800 msgr2=0x7fdf480b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4e62f640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34004800 0x7fdf480b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4e62f640 1 -- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4809c800 msgr2=0x7fdf4814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4e62f640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4809c800 0x7fdf4814fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4e62f640 1 -- 172.21.15.80:0/2476768664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf48150300 con 0x7fdf480b0a40 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4d62d640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4809c800 0x7fdf4814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf4e62f640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 0x7fdf480b0e50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdf4806ca20 tx=0x7fdf4000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000eb90 con 0x7fdf480b0a40 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf40018070 con 0x7fdf480b0a40 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4815b410 con 0x7fdf480b0a40 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40013420 con 0x7fdf480b0a40 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.010+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4815b9d0 con 0x7fdf480b0a40 2024-04-25T15:44:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.011+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf480b3ad0 con 0x7fdf480b0a40 2024-04-25T15:44:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.012+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdf400135c0 con 0x7fdf480b0a40 2024-04-25T15:44:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.012+0000 7fdf3e7fc640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf2c0744b0 0x7fdf2c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.012+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7fdf400952d0 con 0x7fdf480b0a40 2024-04-25T15:44:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.012+0000 7fdf4de2e640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf2c0744b0 0x7fdf2c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.013+0000 7fdf4de2e640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf2c0744b0 0x7fdf2c0769c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf440055b0 tx=0x7fdf44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.017+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf480b3ad0 con 0x7fdf480b0a40 2024-04-25T15:44:43.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.195+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf4809cd70 con 0x7fdf480b0a40 2024-04-25T15:44:43.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.195+0000 7fdf3e7fc640 1 -- 172.21.15.80:0/2476768664 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7fdf4005fcf0 con 0x7fdf480b0a40 2024-04-25T15:44:43.197 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf2c0744b0 msgr2=0x7fdf2c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf2c0744b0 0x7fdf2c0769c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf440055b0 tx=0x7fdf44009040 comp rx=0 tx=0).stop 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 msgr2=0x7fdf480b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 0x7fdf480b0e50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdf4806ca20 tx=0x7fdf4000e530 comp rx=0 tx=0).stop 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 shutdown_connections 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf2c0744b0 0x7fdf2c0769c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf480b0a40 0x7fdf480b0e50 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf4809c800 0x7fdf4814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 --2- 172.21.15.80:0/2476768664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf34004800 0x7fdf480b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.197+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 >> 172.21.15.80:0/2476768664 conn(0x7fdf480b75f0 msgr2=0x7fdf481605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:43.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.198+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 shutdown_connections 2024-04-25T15:44:43.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.198+0000 7fdf50092640 1 -- 172.21.15.80:0/2476768664 wait complete. 2024-04-25T15:44:43.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-04-25T15:44:43.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.316+0000 7f1cb27b2640 1 Processor -- start 2024-04-25T15:44:43.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.316+0000 7f1cb27b2640 1 -- start start 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.317+0000 7f1cb27b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac160520 0x7f1cac0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.317+0000 7f1cb27b2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac0d1ac0 con 0x7f1cac0d12d0 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.317+0000 7f1cb27b2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac0b94a0 con 0x7f1cac0d63b0 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.317+0000 7f1cb27b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0b9d90 con 0x7f1cac160520 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.317+0000 7f1cab7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1cac0d12d0 0x7f1cac0d5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41040/0 (socket says 172.21.15.80:41040) 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.317+0000 7f1cab7fe640 1 -- 172.21.15.80:0/2280589372 learned_addr learned my addr 172.21.15.80:0/2280589372 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1cabfff640 1 --2- 172.21.15.80:0/2280589372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac160520 0x7f1cac0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437680213 0 0) 0x7f1cac0d1ac0 con 0x7f1cac0d12d0 2024-04-25T15:44:43.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c94003520 con 0x7f1cac0d12d0 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085868630 0 0) 0x7f1cac0b94a0 con 0x7f1cac0d63b0 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cac0d1ac0 con 0x7f1cac0d63b0 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4226639057 0 0) 0x7f1c94003520 con 0x7f1cac0d12d0 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1cabfff640 1 -- 172.21.15.80:0/2280589372 >> v1:172.21.15.195:6789/0 conn(0x7f1cac0d63b0 legacy=0x7f1cac0ba220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1cabfff640 1 -- 172.21.15.80:0/2280589372 >> v1:172.21.15.80:6789/0 conn(0x7f1cac0d12d0 legacy=0x7f1cac0d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.318+0000 7f1cabfff640 1 -- 172.21.15.80:0/2280589372 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac0d17e0 con 0x7f1cac160520 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.319+0000 7f1cabfff640 1 --2- 172.21.15.80:0/2280589372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac160520 0x7f1cac0d0d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0b9f10 tx=0x7f1c9c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28538c1768d731f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.319+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c037070 con 0x7f1cac160520 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.319+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c02ac10 con 0x7f1cac160520 2024-04-25T15:44:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.319+0000 7f1caaffd640 1 -- 172.21.15.80:0/2280589372 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca00015f0 con 0x7f1cac160520 2024-04-25T15:44:43.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.319+0000 7f1cb27b2640 1 -- 172.21.15.80:0/2280589372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac160520 msgr2=0x7f1cac0d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.319+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/2280589372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac160520 0x7f1cac0d0d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0b9f10 tx=0x7f1c9c02a180 comp rx=0 tx=0).stop 2024-04-25T15:44:43.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.320+0000 7f1cb27b2640 1 -- 172.21.15.80:0/2280589372 shutdown_connections 2024-04-25T15:44:43.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.320+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/2280589372 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac160520 0x7f1cac0d0d90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.320+0000 7f1cb27b2640 1 -- 172.21.15.80:0/2280589372 >> 172.21.15.80:0/2280589372 conn(0x7f1cac06e610 msgr2=0x7f1cac06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:43.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.320+0000 7f1cb27b2640 1 -- 172.21.15.80:0/2280589372 shutdown_connections 2024-04-25T15:44:43.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.320+0000 7f1cb27b2640 1 -- 172.21.15.80:0/2280589372 wait complete. 2024-04-25T15:44:43.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.321+0000 7f1cb27b2640 1 Processor -- start 2024-04-25T15:44:43.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.321+0000 7f1cb27b2640 1 -- start start 2024-04-25T15:44:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb27b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cac0d12d0 0x7f1cac1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb27b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 0x7f1cac1fac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb27b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac0cf580 0x7f1cac162a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb27b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0d56e0 con 0x7f1cac160520 2024-04-25T15:44:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb27b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0b9a20 con 0x7f1cac0d12d0 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb27b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0d5860 con 0x7f1cac0cf580 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 0x7f1cac1fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 0x7f1cac1fac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40490/0 (socket says 172.21.15.80:40490) 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 -- 172.21.15.80:0/1960588034 learned_addr learned my addr 172.21.15.80:0/1960588034 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cabfff640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cac0d12d0 0x7f1cac1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cb0d4f640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac0cf580 0x7f1cac162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 -- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac0cf580 msgr2=0x7f1cac162a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac0cf580 0x7f1cac162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 -- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cac0d12d0 msgr2=0x7f1cac1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cac0d12d0 0x7f1cac1f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 -- 172.21.15.80:0/1960588034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac1f7310 con 0x7f1cac160520 2024-04-25T15:44:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1cab7fe640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 0x7f1cac1fac50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000c4d0 tx=0x7f1ca000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:43.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.323+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0005ce0 con 0x7f1cac160520 2024-04-25T15:44:43.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.324+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca0007070 con 0x7f1cac160520 2024-04-25T15:44:43.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.324+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007440 con 0x7f1cac160520 2024-04-25T15:44:43.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.324+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac1f75f0 con 0x7f1cac160520 2024-04-25T15:44:43.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.324+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac157e00 con 0x7f1cac160520 2024-04-25T15:44:43.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.324+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cac06a100 con 0x7f1cac160520 2024-04-25T15:44:43.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.325+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1ca00075e0 con 0x7f1cac160520 2024-04-25T15:44:43.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.325+0000 7f1ca8ff9640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c980744b0 0x7f1c980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:43.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.326+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f1ca0094d10 con 0x7f1cac160520 2024-04-25T15:44:43.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.326+0000 7f1cabfff640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c980744b0 0x7f1c980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:43.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.326+0000 7f1cabfff640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c980744b0 0x7f1c980769c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c034000 tx=0x7f1c9c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:43.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.330+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ca005f7f0 con 0x7f1cac160520 2024-04-25T15:44:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:43.576+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f1cac1f7060 con 0x7f1cac160520 2024-04-25T15:44:44.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.560+0000 7f1ca8ff9640 1 -- 172.21.15.80:0/1960588034 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v122) ==== 156+0+0 (secure 0 0 0) 0x7f1ca005f0f0 con 0x7f1cac160520 2024-04-25T15:44:44.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c980744b0 msgr2=0x7f1c980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c980744b0 0x7f1c980769c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c034000 tx=0x7f1c9c02e000 comp rx=0 tx=0).stop 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 msgr2=0x7f1cac1fac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 0x7f1cac1fac50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000c4d0 tx=0x7f1ca000c990 comp rx=0 tx=0).stop 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 shutdown_connections 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c980744b0 0x7f1c980769c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cac0cf580 0x7f1cac162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cac160520 0x7f1cac1fac50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 --2- 172.21.15.80:0/1960588034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cac0d12d0 0x7f1cac1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 >> 172.21.15.80:0/1960588034 conn(0x7f1cac06e610 msgr2=0x7f1cac06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 shutdown_connections 2024-04-25T15:44:44.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.563+0000 7f1cb27b2640 1 -- 172.21.15.80:0/1960588034 wait complete. 2024-04-25T15:44:44.578 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T15:44:44.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.693+0000 7fb50c86e640 1 Processor -- start 2024-04-25T15:44:44.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.693+0000 7fb50c86e640 1 -- start start 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50c86e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb5080718d0 0x7fb5080d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50c86e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 0x7fb5080ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50c86e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb508072120 con 0x7fb5080727c0 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50c86e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb508072400 con 0x7fb5080718d0 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50c86e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5080d2790 con 0x7fb5080d3160 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5080727c0 0x7fb5080b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40738/0 (socket says 172.21.15.80:40738) 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50659c640 1 -- 172.21.15.80:0/230925825 learned_addr learned my addr 172.21.15.80:0/230925825 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519564470 0 0) 0x7fb508072120 con 0x7fb5080727c0 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb506d9d640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 0x7fb5080ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f0003520 con 0x7fb5080727c0 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb505d9b640 1 --2- 172.21.15.80:0/230925825 >> v2:172.21.15.195:3300/0 conn(0x7fb5080718d0 0x7fb5080d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2859072820 0 0) 0x7fb4f0003520 con 0x7fb5080727c0 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 msgr2=0x7fb5080ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 0x7fb5080ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 >> v2:172.21.15.195:3300/0 conn(0x7fb5080718d0 msgr2=0x7fb5080d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 --2- 172.21.15.80:0/230925825 >> v2:172.21.15.195:3300/0 conn(0x7fb5080718d0 0x7fb5080d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.695+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5080d2140 con 0x7fb5080727c0 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb4f80019f0 con 0x7fb5080727c0 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 >> v1:172.21.15.80:6789/0 conn(0x7fb5080727c0 legacy=0x7fb5080b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb4f0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4f0004800 0x7fb4f0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 0x7fb4f0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb508072400 con 0x7fb4f00039b0 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb5080d2790 con 0x7fb4f0004800 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f000baa0 con 0x7fb5080d3160 2024-04-25T15:44:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50659c640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb4f0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb505d9b640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4f0004800 0x7fb4f0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb506d9d640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 0x7fb4f0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50659c640 1 -- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 msgr2=0x7fb4f0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50659c640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb5080d3160 0x7fb4f0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50659c640 1 -- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4f0004800 msgr2=0x7fb4f0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50659c640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4f0004800 0x7fb4f0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.696+0000 7fb50659c640 1 -- 172.21.15.80:0/230925825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f0003520 con 0x7fb4f00039b0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.697+0000 7fb50659c640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb4f0003e40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800a870 tx=0x7fb4f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9a791dfaa3b977 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.697+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800a4c0 con 0x7fb4f00039b0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.697+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f802f070 con 0x7fb4f00039b0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.697+0000 7fb50559a640 1 -- 172.21.15.80:0/230925825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f802bcc0 con 0x7fb4f00039b0 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb50c86e640 1 -- 172.21.15.80:0/230925825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 msgr2=0x7fb4f0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb50c86e640 1 --2- 172.21.15.80:0/230925825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb4f0003e40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800a870 tx=0x7fb4f0005830 comp rx=0 tx=0).stop 2024-04-25T15:44:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb506d9d640 1 -- 172.21.15.80:0/230925825 reap_dead start 2024-04-25T15:44:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb50c86e640 1 -- 172.21.15.80:0/230925825 shutdown_connections 2024-04-25T15:44:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb50c86e640 1 -- 172.21.15.80:0/230925825 >> 172.21.15.80:0/230925825 conn(0x7fb5080d3a30 msgr2=0x7fb5080d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb50c86e640 1 -- 172.21.15.80:0/230925825 shutdown_connections 2024-04-25T15:44:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.698+0000 7fb50c86e640 1 -- 172.21.15.80:0/230925825 wait complete. 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.700+0000 7fb50c86e640 1 Processor -- start 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.700+0000 7fb50c86e640 1 -- start start 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50c86e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb508157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50c86e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb50814cdd0 0x7fb5081598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50c86e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb508159e00 0x7fb50815a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50c86e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb508071e60 con 0x7fb4f00039b0 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50c86e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb508071ce0 con 0x7fb50814cdd0 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50c86e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb5080ce970 con 0x7fb508159e00 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb508157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb508157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53684/0 (socket says 172.21.15.80:53684) 2024-04-25T15:44:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 -- 172.21.15.80:0/1365311310 learned_addr learned my addr 172.21.15.80:0/1365311310 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb505d9b640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb50814cdd0 0x7fb5081598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb506d9d640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb508159e00 0x7fb50815a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 -- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb508159e00 msgr2=0x7fb50815a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb508159e00 0x7fb50815a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 -- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb50814cdd0 msgr2=0x7fb5081598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb50814cdd0 0x7fb5081598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.701+0000 7fb50659c640 1 -- 172.21.15.80:0/1365311310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50815a750 con 0x7fb4f00039b0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.702+0000 7fb50659c640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb508157a50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800a990 tx=0x7fb4f8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.702+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f802ba80 con 0x7fb4f00039b0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.702+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f802bc20 con 0x7fb4f00039b0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.702+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8004e30 con 0x7fb4f00039b0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.702+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb508158c60 con 0x7fb4f00039b0 2024-04-25T15:44:44.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.702+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5081586a0 con 0x7fb4f00039b0 2024-04-25T15:44:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.703+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50806a100 con 0x7fb4f00039b0 2024-04-25T15:44:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.703+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb4f8034470 con 0x7fb4f00039b0 2024-04-25T15:44:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.704+0000 7fb4f6ffd640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4e80744a0 0x7fb4e80769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.704+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7fb4f80b5830 con 0x7fb4f00039b0 2024-04-25T15:44:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.704+0000 7fb505d9b640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4e80744a0 0x7fb4e80769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:44.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.704+0000 7fb505d9b640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4e80744a0 0x7fb4e80769b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0090e0 tx=0x7fb4fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:44.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.708+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4f8080130 con 0x7fb4f00039b0 2024-04-25T15:44:44.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.886+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb50806a100 con 0x7fb4f00039b0 2024-04-25T15:44:44.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.890+0000 7fb4f6ffd640 1 -- 172.21.15.80:0/1365311310 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fb4f80881b0 con 0x7fb4f00039b0 2024-04-25T15:44:44.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4e80744a0 msgr2=0x7fb4e80769b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4e80744a0 0x7fb4e80769b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0090e0 tx=0x7fb4fc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 msgr2=0x7fb508157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb508157a50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800a990 tx=0x7fb4f8001360 comp rx=0 tx=0).stop 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 shutdown_connections 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb4e80744a0 0x7fb4e80769b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb508159e00 0x7fb50815a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb50814cdd0 0x7fb5081598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 --2- 172.21.15.80:0/1365311310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f00039b0 0x7fb508157a50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 >> 172.21.15.80:0/1365311310 conn(0x7fb5080d3a30 msgr2=0x7fb5080b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 shutdown_connections 2024-04-25T15:44:44.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:44.892+0000 7fb50c86e640 1 -- 172.21.15.80:0/1365311310 wait complete. 2024-04-25T15:44:44.905 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:44:44.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:44:44.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:44:44.979 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:44:44.979 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:44.979 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:44.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:44:44.998 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:44.998 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:45.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:44:45.037 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:45.037 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:45.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:44:45.053 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:45.053 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:45.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:44:45.094 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T15:44:45.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.200+0000 7f090f6e0640 1 Processor -- start 2024-04-25T15:44:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.200+0000 7f090f6e0640 1 -- start start 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090f6e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09080b91b0 0x7f090806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090f6e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090f6e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09080d1010 con 0x7f09080d34a0 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090f6e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f090809cdf0 con 0x7f09080b91b0 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090f6e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f090809d0d0 con 0x7f09080b3ac0 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09080b91b0 0x7f090806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09080b91b0 0x7f090806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53692/0 (socket says 172.21.15.80:53692) 2024-04-25T15:44:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 -- 172.21.15.80:0/2158766442 learned_addr learned my addr 172.21.15.80:0/2158766442 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 -- 172.21.15.80:0/2158766442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 msgr2=0x7f09080b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 --2- 172.21.15.80:0/2158766442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 -- 172.21.15.80:0/2158766442 >> v1:172.21.15.195:6789/0 conn(0x7f09080d34a0 legacy=0x7f090806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:45.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.202+0000 7f090cc7b640 1 -- 172.21.15.80:0/2158766442 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090806ec70 con 0x7f09080b91b0 2024-04-25T15:44:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.203+0000 7f090cc7b640 1 --2- 172.21.15.80:0/2158766442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f090806da90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009870 tx=0x7f08f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fd03dc76205c26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.203+0000 7f08fffff640 1 -- 172.21.15.80:0/2158766442 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8037070 con 0x7f09080b91b0 2024-04-25T15:44:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.203+0000 7f08fffff640 1 -- 172.21.15.80:0/2158766442 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f8032440 con 0x7f09080b91b0 2024-04-25T15:44:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.203+0000 7f08fffff640 1 -- 172.21.15.80:0/2158766442 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8032810 con 0x7f09080b91b0 2024-04-25T15:44:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.203+0000 7f090f6e0640 1 -- 172.21.15.80:0/2158766442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 msgr2=0x7f090806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.203+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2158766442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f090806da90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009870 tx=0x7f08f802a230 comp rx=0 tx=0).stop 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.204+0000 7f090f6e0640 1 -- 172.21.15.80:0/2158766442 shutdown_connections 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.204+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2158766442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.204+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2158766442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f090806da90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.204+0000 7f090f6e0640 1 -- 172.21.15.80:0/2158766442 >> 172.21.15.80:0/2158766442 conn(0x7f09080d0450 msgr2=0x7f09080d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.204+0000 7f090f6e0640 1 -- 172.21.15.80:0/2158766442 shutdown_connections 2024-04-25T15:44:45.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.204+0000 7f090f6e0640 1 -- 172.21.15.80:0/2158766442 wait complete. 2024-04-25T15:44:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.205+0000 7f090f6e0640 1 Processor -- start 2024-04-25T15:44:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.205+0000 7f090f6e0640 1 -- start start 2024-04-25T15:44:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f09080a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09080d34a0 0x7f0908155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09080b4410 con 0x7f09080b91b0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f090806d7b0 con 0x7f09080d34a0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f09080b4590 con 0x7f09080b3ac0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f09080a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f09080a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53704/0 (socket says 172.21.15.80:53704) 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 -- 172.21.15.80:0/2996131151 learned_addr learned my addr 172.21.15.80:0/2996131151 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090d47c640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090dc7d640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09080d34a0 0x7f0908155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 -- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 msgr2=0x7f09080c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 -- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09080d34a0 msgr2=0x7f0908155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09080d34a0 0x7f0908155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 -- 172.21.15.80:0/2996131151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090809fba0 con 0x7f09080b91b0 2024-04-25T15:44:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090d47c640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090cc7b640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f09080a0c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f08f8000c00 tx=0x7f08f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8041070 con 0x7f09080b91b0 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f803c870 con 0x7f09080b91b0 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.207+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090809fe80 con 0x7f09080b91b0 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.208+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8037040 con 0x7f09080b91b0 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.208+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09080a0440 con 0x7f09080b91b0 2024-04-25T15:44:45.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.209+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090809f910 con 0x7f09080b91b0 2024-04-25T15:44:45.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.209+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f08f8044070 con 0x7f09080b91b0 2024-04-25T15:44:45.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.210+0000 7f08fdffb640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08ec0744b0 0x7f08ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.210+0000 7f090d47c640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08ec0744b0 0x7f08ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.210+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f08f80b5bf0 con 0x7f09080b91b0 2024-04-25T15:44:45.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.210+0000 7f090d47c640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08ec0744b0 0x7f08ec0769c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0904009870 tx=0x7f0904008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:45.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.215+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08f80804f0 con 0x7f09080b91b0 2024-04-25T15:44:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.425+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f090806a100 con 0x7f09080b91b0 2024-04-25T15:44:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.425+0000 7f08fdffb640 1 -- 172.21.15.80:0/2996131151 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3869 (secure 0 0 0) 0x7f08f807fdf0 con 0x7f09080b91b0 2024-04-25T15:44:45.427 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:45.427 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/429109163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":429109163},{"type":"v1","addr":"172.21.15.195:6835","nonce":429109163}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3120196618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120196618},{"type":"v1","addr":"172.21.15.195:6834","nonce":3120196618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/2634670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2634670519},{"type":"v1","addr":"172.21.15.80:6835","nonce":2634670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/770030040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":770030040},{"type":"v1","addr":"172.21.15.80:6837","nonce":770030040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-04-25T15:44:45.427 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 17 2024-04-25T15:44:45.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08ec0744b0 msgr2=0x7f08ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08ec0744b0 0x7f08ec0769c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0904009870 tx=0x7f0904008040 comp rx=0 tx=0).stop 2024-04-25T15:44:45.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 msgr2=0x7f09080a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f09080a0c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f08f8000c00 tx=0x7f08f80046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 shutdown_connections 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08ec0744b0 0x7f08ec0769c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09080d34a0 0x7f0908155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09080b91b0 0x7f09080a0c40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.427+0000 7f090f6e0640 1 --2- 172.21.15.80:0/2996131151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09080b3ac0 0x7f09080c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.428+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 >> 172.21.15.80:0/2996131151 conn(0x7f09080d0450 msgr2=0x7f09080cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.428+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 shutdown_connections 2024-04-25T15:44:45.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.428+0000 7f090f6e0640 1 -- 172.21.15.80:0/2996131151 wait complete. 2024-04-25T15:44:45.440 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:44:45.440 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T15:44:45.440 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:44:45.440 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:45.440 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:44:45.441 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T15:44:45.441 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:44:45.441 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:45.441 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:44:45.441 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T15:44:45.441 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:44:45.441 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:45.442 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:44:45.442 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T15:44:45.442 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:44:45.442 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:44:45.452 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:44:45.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:44:45.454 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:44:45.454 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:44:45.455 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:44:45.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:44:45.456 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:44:45.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:44:45.498 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:44:45.499 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:45.499 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:44:45.500 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:44:45.500 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:45.500 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:45.501 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:44:45.501 DEBUG:teuthology.parallel:result is None 2024-04-25T15:44:45.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T15:44:45.583 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:44:45.584 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:44:45.590 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:44:45.590 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:44:45.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.613+0000 7fd6f2692640 1 Processor -- start 2024-04-25T15:44:45.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.613+0000 7fd6f2692640 1 -- start start 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6f2692640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd6ec160520 0x7fd6ec0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6f2692640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd6ec0d12d0 0x7fd6ec0d5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6f2692640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d61e0 0x7fd6ec0d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6f2692640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd6ec0b9d90 con 0x7fd6ec0d12d0 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6f2692640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd6ec160930 con 0x7fd6ec160520 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6f2692640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ec0d65f0 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6eb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd6ec0d12d0 0x7fd6ec0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6eb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd6ec0d12d0 0x7fd6ec0d5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53748/0 (socket says 172.21.15.80:53748) 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.614+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/1663195969 learned_addr learned my addr 172.21.15.80:0/1663195969 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6ebfff640 1 --2- 172.21.15.80:0/1663195969 >> v2:172.21.15.195:3300/0 conn(0x7fd6ec160520 0x7fd6ec0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6f0c2f640 1 --2- 172.21.15.80:0/1663195969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d61e0 0x7fd6ec0d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/1663195969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d61e0 msgr2=0x7fd6ec0d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:45.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6eb7fe640 1 --2- 172.21.15.80:0/1663195969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d61e0 0x7fd6ec0d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/1663195969 >> v2:172.21.15.195:3300/0 conn(0x7fd6ec160520 msgr2=0x7fd6ec0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:45.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6eb7fe640 1 --2- 172.21.15.80:0/1663195969 >> v2:172.21.15.195:3300/0 conn(0x7fd6ec160520 0x7fd6ec0d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/1663195969 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec0d1ac0 con 0x7fd6ec0d12d0 2024-04-25T15:44:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.615+0000 7fd6eb7fe640 1 --2- 172.21.15.80:0/1663195969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d12d0 0x7fd6ec0d5ca0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec08e2f0 tx=0x7fd6e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cd811bce7b0732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6eaffd640 1 -- 172.21.15.80:0/1663195969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0037070 con 0x7fd6ec0d12d0 2024-04-25T15:44:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6eaffd640 1 -- 172.21.15.80:0/1663195969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e0032440 con 0x7fd6ec0d12d0 2024-04-25T15:44:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6eaffd640 1 -- 172.21.15.80:0/1663195969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0032810 con 0x7fd6ec0d12d0 2024-04-25T15:44:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 -- 172.21.15.80:0/1663195969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d12d0 msgr2=0x7fd6ec0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 --2- 172.21.15.80:0/1663195969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d12d0 0x7fd6ec0d5ca0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec08e2f0 tx=0x7fd6e002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 -- 172.21.15.80:0/1663195969 shutdown_connections 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 --2- 172.21.15.80:0/1663195969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d61e0 0x7fd6ec0d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 --2- 172.21.15.80:0/1663195969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d12d0 0x7fd6ec0d5ca0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 --2- 172.21.15.80:0/1663195969 >> v2:172.21.15.195:3300/0 conn(0x7fd6ec160520 0x7fd6ec0d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 -- 172.21.15.80:0/1663195969 >> 172.21.15.80:0/1663195969 conn(0x7fd6ec06e610 msgr2=0x7fd6ec06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 -- 172.21.15.80:0/1663195969 shutdown_connections 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.616+0000 7fd6f2692640 1 -- 172.21.15.80:0/1663195969 wait complete. 2024-04-25T15:44:45.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.618+0000 7fd6f2692640 1 Processor -- start 2024-04-25T15:44:45.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.618+0000 7fd6f2692640 1 -- start start 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.619+0000 7fd6f2692640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d12d0 0x7fd6ec155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.619+0000 7fd6f2692640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 0x7fd6ec15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 0x7fd6ec15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 0x7fd6ec15a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53750/0 (socket says 172.21.15.80:53750) 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f2692640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ec160520 0x7fd6ec1f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/3212836462 learned_addr learned my addr 172.21.15.80:0/3212836462 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec0b9a20 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec0b9740 con 0x7fd6ec160520 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ec0d56e0 con 0x7fd6ec0d12d0 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6ebfff640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d12d0 0x7fd6ec155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f0c2f640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ec160520 0x7fd6ec1f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d12d0 msgr2=0x7fd6ec155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d12d0 0x7fd6ec155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ec160520 msgr2=0x7fd6ec1f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ec160520 0x7fd6ec1f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec1597b0 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6eb7fe640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 0x7fd6ec15a850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009960 tx=0x7fd6e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0037040 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e0042070 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ec159a90 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0030bd0 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.620+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ec15a050 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.622+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd6e0047460 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.622+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ec0d2270 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.623+0000 7fd6e8ff9640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6d80744e0 0x7fd6d80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.623+0000 7fd6ebfff640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6d80744e0 0x7fd6d80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.623+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7fd6e00b5be0 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.623+0000 7fd6ebfff640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6d80744e0 0x7fd6d80769f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0079a0 tx=0x7fd6dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:45.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.628+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6ec0d2270 con 0x7fd6ec0d61e0 2024-04-25T15:44:45.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:45.814+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd6ec06a100 con 0x7fd6ec0d61e0 2024-04-25T15:44:46.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.904+0000 7fd6e8ff9640 1 -- 172.21.15.80:0/3212836462 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) ==== 97+0+0 (secure 0 0 0) 0x7fd6e00804e0 con 0x7fd6ec0d61e0 2024-04-25T15:44:46.905 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6d80744e0 msgr2=0x7fd6d80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6d80744e0 0x7fd6d80769f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0079a0 tx=0x7fd6dc008040 comp rx=0 tx=0).stop 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 msgr2=0x7fd6ec15a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 0x7fd6ec15a850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009960 tx=0x7fd6e00046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 shutdown_connections 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6d80744e0 0x7fd6d80769f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ec160520 0x7fd6ec1f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6ec0d61e0 0x7fd6ec15a850 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 --2- 172.21.15.80:0/3212836462 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6ec0d12d0 0x7fd6ec155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 >> 172.21.15.80:0/3212836462 conn(0x7fd6ec06e610 msgr2=0x7fd6ec162420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 shutdown_connections 2024-04-25T15:44:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:46.907+0000 7fd6f2692640 1 -- 172.21.15.80:0/3212836462 wait complete. 2024-04-25T15:44:46.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T15:44:47.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.035+0000 7f510cebd640 1 Processor -- start 2024-04-25T15:44:47.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.035+0000 7f510cebd640 1 -- start start 2024-04-25T15:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510cebd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51081604d0 0x7f510809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510cebd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51080cee60 0x7f51080cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510cebd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080b3fe0 con 0x7f51080d1ae0 2024-04-25T15:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510cebd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f51080ce6d0 con 0x7f51081604d0 2024-04-25T15:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510cebd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f51080ce110 con 0x7f51080cee60 2024-04-25T15:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51081604d0 0x7f510809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f5105d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f51080d1ae0 0x7f51080d1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40762/0 (socket says 172.21.15.80:40762) 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f5105d9b640 1 -- 172.21.15.80:0/513003748 learned_addr learned my addr 172.21.15.80:0/513003748 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f5106d9d640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51080cee60 0x7f51080cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510659c640 1 -- 172.21.15.80:0/513003748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51080cee60 msgr2=0x7f51080cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510659c640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51080cee60 0x7f51080cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510659c640 1 -- 172.21.15.80:0/513003748 >> v1:172.21.15.80:6789/0 conn(0x7f51080d1ae0 legacy=0x7f51080d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510659c640 1 -- 172.21.15.80:0/513003748 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080ce3f0 con 0x7f51081604d0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f510559a640 1 -- 172.21.15.80:0/513003748 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941391331 0 0) 0x7f51080b3fe0 con 0x7f51080d1ae0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.037+0000 7f5106d9d640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51080cee60 0x7f51080cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.038+0000 7f510659c640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51081604d0 0x7f510809bdf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f50f80097a0 tx=0x7f50f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8fde697e6918ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.038+0000 7f510559a640 1 -- 172.21.15.80:0/513003748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8037070 con 0x7f51081604d0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.038+0000 7f510559a640 1 -- 172.21.15.80:0/513003748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8032440 con 0x7f51081604d0 2024-04-25T15:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.038+0000 7f510559a640 1 -- 172.21.15.80:0/513003748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8032810 con 0x7f51081604d0 2024-04-25T15:44:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 -- 172.21.15.80:0/513003748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51081604d0 msgr2=0x7f510809bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51081604d0 0x7f510809bdf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f50f80097a0 tx=0x7f50f802a180 comp rx=0 tx=0).stop 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 -- 172.21.15.80:0/513003748 shutdown_connections 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51080cee60 0x7f51080cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 --2- 172.21.15.80:0/513003748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51081604d0 0x7f510809bdf0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 -- 172.21.15.80:0/513003748 >> 172.21.15.80:0/513003748 conn(0x7f51080b7620 msgr2=0x7f51080b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 -- 172.21.15.80:0/513003748 shutdown_connections 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.039+0000 7f510cebd640 1 -- 172.21.15.80:0/513003748 wait complete. 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.041+0000 7f510cebd640 1 Processor -- start 2024-04-25T15:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.041+0000 7f510cebd640 1 -- start start 2024-04-25T15:44:47.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510cebd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080cee60 0x7f51080c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510cebd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 0x7f51081576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510cebd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51081604d0 0x7f510815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510cebd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b3cf0 con 0x7f51080d1ae0 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510cebd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b3b70 con 0x7f51080cee60 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510cebd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f51080cf7b0 con 0x7f51081604d0 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f5105d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 0x7f51081576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f5105d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 0x7f51081576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53770/0 (socket says 172.21.15.80:53770) 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f5105d9b640 1 -- 172.21.15.80:0/1634595197 learned_addr learned my addr 172.21.15.80:0/1634595197 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f5106d9d640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51081604d0 0x7f510815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.042+0000 7f510659c640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080cee60 0x7f51080c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f5105d9b640 1 -- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51081604d0 msgr2=0x7f510815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f5105d9b640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51081604d0 0x7f510815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f5105d9b640 1 -- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080cee60 msgr2=0x7f51080c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f5105d9b640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080cee60 0x7f51080c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f5105d9b640 1 -- 172.21.15.80:0/1634595197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080c7370 con 0x7f51080d1ae0 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f510659c640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080cee60 0x7f51080c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f5105d9b640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 0x7f51081576f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00c3e0 tx=0x7f50fc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0074e0 con 0x7f51080d1ae0 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc0047e0 con 0x7f51080d1ae0 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5108157c30 con 0x7f51080d1ae0 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004bd0 con 0x7f51080d1ae0 2024-04-25T15:44:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.043+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51080c7090 con 0x7f51080d1ae0 2024-04-25T15:44:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.044+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51080ce960 con 0x7f51080d1ae0 2024-04-25T15:44:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.045+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f50fc011070 con 0x7f51080d1ae0 2024-04-25T15:44:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.045+0000 7f50f6ffd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50e80744e0 0x7f50e80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.045+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f50fc094ca0 con 0x7f51080d1ae0 2024-04-25T15:44:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.045+0000 7f510659c640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50e80744e0 0x7f50e80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.045+0000 7f510659c640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50e80744e0 0x7f50e80769f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f50f8034000 tx=0x7f50f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.050+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51080ce960 con 0x7f51080d1ae0 2024-04-25T15:44:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.291+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f510806a100 con 0x7f51080d1ae0 2024-04-25T15:44:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.291+0000 7f50f6ffd640 1 -- 172.21.15.80:0/1634595197 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7f50fc05f570 con 0x7f51080d1ae0 2024-04-25T15:44:47.292 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:47.292 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw==", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q==", 2024-04-25T15:44:47.293 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA==", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:47.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw==", 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.295 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g==", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw==", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.296 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw==", 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-25T15:44:47.297 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q==", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw==", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA==", 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA==", 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.299 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.300 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.300 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg==", 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw==", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw==", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.302 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g==", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw==", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDMeSpmVFP1JxAAQ3NwNePUywfB5CkeGWRjfA==", 2024-04-25T15:44:47.304 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA==", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og==", 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:44:47.306 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50e80744e0 msgr2=0x7f50e80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50e80744e0 0x7f50e80769f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f50f8034000 tx=0x7f50f802e000 comp rx=0 tx=0).stop 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 msgr2=0x7f51081576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 0x7f51081576f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00c3e0 tx=0x7f50fc00c8a0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 shutdown_connections 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50e80744e0 0x7f50e80769f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51081604d0 0x7f510815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51080d1ae0 0x7f51081576f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 --2- 172.21.15.80:0/1634595197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080cee60 0x7f51080c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 >> 172.21.15.80:0/1634595197 conn(0x7f51080b7620 msgr2=0x7f51080b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 shutdown_connections 2024-04-25T15:44:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.293+0000 7f510cebd640 1 -- 172.21.15.80:0/1634595197 wait complete. 2024-04-25T15:44:47.309 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.416+0000 7f2e9997d640 1 Processor -- start 2024-04-25T15:44:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.416+0000 7f2e9997d640 1 -- start start 2024-04-25T15:44:47.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.417+0000 7f2e9997d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2e940b7d60 0x7f2e9416b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.417+0000 7f2e9997d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e940d59d0 con 0x7f2e940b48d0 2024-04-25T15:44:47.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.417+0000 7f2e9997d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e94163fb0 con 0x7f2e940d41b0 2024-04-25T15:44:47.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.417+0000 7f2e9997d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2e94164270 con 0x7f2e940b7d60 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.417+0000 7f2e8bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2e940b48d0 0x7f2e940b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40772/0 (socket says 172.21.15.80:40772) 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.417+0000 7f2e8bfff640 1 -- 172.21.15.80:0/1169014352 learned_addr learned my addr 172.21.15.80:0/1169014352 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913042053 0 0) 0x7f2e940d59d0 con 0x7f2e940b48d0 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e80003520 con 0x7f2e940b48d0 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e937fe640 1 --2- 172.21.15.80:0/1169014352 >> v2:172.21.15.195:3300/0 conn(0x7f2e940b7d60 0x7f2e9416b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1620841024 0 0) 0x7f2e80003520 con 0x7f2e940b48d0 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 >> v2:172.21.15.195:3300/0 conn(0x7f2e940b7d60 msgr2=0x7f2e9416b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 --2- 172.21.15.80:0/1169014352 >> v2:172.21.15.195:3300/0 conn(0x7f2e940b7d60 0x7f2e9416b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 >> v1:172.21.15.195:6789/0 conn(0x7f2e940d41b0 legacy=0x7f2e941602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e94164550 con 0x7f2e940b48d0 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f2e7c001670 con 0x7f2e940b48d0 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e937fe640 1 --2- 172.21.15.80:0/1169014352 >> v2:172.21.15.195:3300/0 conn(0x7f2e940b7d60 0x7f2e9416b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 >> v1:172.21.15.80:6789/0 conn(0x7f2e940b48d0 legacy=0x7f2e940b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e800039b0 0x7f2e80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e80004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e80005300 0x7f2e8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94164270 con 0x7f2e80004800 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8000c2a0 con 0x7f2e80005300 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8000c4a0 con 0x7f2e800039b0 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e8bfff640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e80004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e92ffd640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e800039b0 0x7f2e80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e937fe640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e80005300 0x7f2e8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e8bfff640 1 -- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e800039b0 msgr2=0x7f2e80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e8bfff640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e800039b0 0x7f2e80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e8bfff640 1 -- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e80005300 msgr2=0x7f2e8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e8bfff640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e80005300 0x7f2e8000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e8bfff640 1 -- 172.21.15.80:0/1169014352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80003520 con 0x7f2e80004800 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e937fe640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e80005300 0x7f2e8000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.418+0000 7f2e937fe640 1 -- 172.21.15.80:0/1169014352 reap_dead start 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.419+0000 7f2e8bfff640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e80004c10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2e940b9010 tx=0x7f2e80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4928b390f9a86c8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.419+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c007d10 con 0x7f2e80004800 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.419+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c005ad0 con 0x7f2e80004800 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.419+0000 7f2e927fc640 1 -- 172.21.15.80:0/1169014352 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c007070 con 0x7f2e80004800 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 -- 172.21.15.80:0/1169014352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 msgr2=0x7f2e80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e80004c10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2e940b9010 tx=0x7f2e80005830 comp rx=0 tx=0).stop 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 -- 172.21.15.80:0/1169014352 shutdown_connections 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 --2- 172.21.15.80:0/1169014352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e80004c10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 -- 172.21.15.80:0/1169014352 >> 172.21.15.80:0/1169014352 conn(0x7f2e9406e9f0 msgr2=0x7f2e940d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 -- 172.21.15.80:0/1169014352 shutdown_connections 2024-04-25T15:44:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.420+0000 7f2e9997d640 1 -- 172.21.15.80:0/1169014352 wait complete. 2024-04-25T15:44:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.422+0000 7f2e9997d640 1 Processor -- start 2024-04-25T15:44:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.422+0000 7f2e9997d640 1 -- start start 2024-04-25T15:44:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e9997d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e941602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e9997d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e941627c0 0x7f2e94150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e9997d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e9415c070 0x7f2e9415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e9997d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b4fd0 con 0x7f2e80004800 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e9997d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94164b10 con 0x7f2e9415c070 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e9997d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940b5150 con 0x7f2e941627c0 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e92ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e941602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e92ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e941602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53782/0 (socket says 172.21.15.80:53782) 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e92ffd640 1 -- 172.21.15.80:0/2873274422 learned_addr learned my addr 172.21.15.80:0/2873274422 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e92ffd640 1 -- 172.21.15.80:0/2873274422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e941627c0 msgr2=0x7f2e94150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.423+0000 7f2e92ffd640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e941627c0 0x7f2e94150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e92ffd640 1 -- 172.21.15.80:0/2873274422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e9415c070 msgr2=0x7f2e9415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e92ffd640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e9415c070 0x7f2e9415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e92ffd640 1 -- 172.21.15.80:0/2873274422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9415c9c0 con 0x7f2e80004800 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e92ffd640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e941602a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400f850 tx=0x7f2e8400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400fe40 con 0x7f2e80004800 2024-04-25T15:44:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e84018070 con 0x7f2e80004800 2024-04-25T15:44:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400d6b0 con 0x7f2e80004800 2024-04-25T15:44:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e94160ad0 con 0x7f2e80004800 2024-04-25T15:44:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.424+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e94161090 con 0x7f2e80004800 2024-04-25T15:44:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.425+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e940c8ec0 con 0x7f2e80004800 2024-04-25T15:44:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.425+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2e8400d850 con 0x7f2e80004800 2024-04-25T15:44:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.426+0000 7f2e90ff9640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e740744e0 0x7f2e740769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.426+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f2e84094e90 con 0x7f2e80004800 2024-04-25T15:44:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.426+0000 7f2e8bfff640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e740744e0 0x7f2e740769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.426+0000 7f2e8bfff640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e740744e0 0x7f2e740769f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c032000 tx=0x7f2e7c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.431+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e940c8ec0 con 0x7f2e80004800 2024-04-25T15:44:47.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.607+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e9406a100 con 0x7f2e80004800 2024-04-25T15:44:47.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.607+0000 7f2e90ff9640 1 -- 172.21.15.80:0/2873274422 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+13152 (secure 0 0 0) 0x7f2e9415c9c0 con 0x7f2e80004800 2024-04-25T15:44:47.608 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:47.609 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:46.901959+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e740744e0 msgr2=0x7f2e740769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e740744e0 0x7f2e740769f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c032000 tx=0x7f2e7c009030 comp rx=0 tx=0).stop 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 msgr2=0x7f2e941602a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e941602a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400f850 tx=0x7f2e8400fd10 comp rx=0 tx=0).stop 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 shutdown_connections 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e740744e0 0x7f2e740769f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e9415c070 0x7f2e9415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2e941627c0 0x7f2e94150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 --2- 172.21.15.80:0/2873274422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e80004800 0x7f2e941602a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.609+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 >> 172.21.15.80:0/2873274422 conn(0x7f2e9406e9f0 msgr2=0x7f2e9415f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.610+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 shutdown_connections 2024-04-25T15:44:47.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.610+0000 7f2e9997d640 1 -- 172.21.15.80:0/2873274422 wait complete. 2024-04-25T15:44:47.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:47.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:47.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.731+0000 7f6937cbd640 1 Processor -- start 2024-04-25T15:44:47.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.731+0000 7f6937cbd640 1 -- start start 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6937cbd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69300b5490 0x7f6930160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6937cbd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f69300d2d50 0x7f69300d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6937cbd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69301643f0 con 0x7f69300d0b00 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6937cbd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f69301646d0 con 0x7f69300d2d50 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6937cbd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f69301649b0 con 0x7f69300b5490 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6935a59640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69300b5490 0x7f6930160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f693625a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f69300d2d50 0x7f69300d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.732+0000 7f6935258640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f69300d0b00 0x7f69300d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:36478/0 (socket says 172.21.15.80:36478) 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f6935258640 1 -- 172.21.15.80:0/3312337774 learned_addr learned my addr 172.21.15.80:0/3312337774 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f6934a57640 1 -- 172.21.15.80:0/3312337774 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150015095 0 0) 0x7f69301643f0 con 0x7f69300d0b00 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f6934a57640 1 -- 172.21.15.80:0/3312337774 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f691c003520 con 0x7f69300d0b00 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f693625a640 1 -- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69300b5490 msgr2=0x7f6930160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f693625a640 1 --2- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69300b5490 0x7f6930160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f693625a640 1 -- 172.21.15.80:0/3312337774 >> v1:172.21.15.195:6789/0 conn(0x7f69300d0b00 legacy=0x7f69300d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f693625a640 1 -- 172.21.15.80:0/3312337774 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930164c90 con 0x7f69300d2d50 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.733+0000 7f6935a59640 1 --2- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69300b5490 0x7f6930160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.734+0000 7f693625a640 1 --2- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f69300d47d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6928009d90 tx=0x7f692802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3752f659720bbe6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.734+0000 7f6934a57640 1 -- 172.21.15.80:0/3312337774 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928007740 con 0x7f69300d2d50 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.734+0000 7f6934a57640 1 -- 172.21.15.80:0/3312337774 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69280078e0 con 0x7f69300d2d50 2024-04-25T15:44:47.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.734+0000 7f6934a57640 1 -- 172.21.15.80:0/3312337774 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928007cb0 con 0x7f69300d2d50 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.734+0000 7f6937cbd640 1 -- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 msgr2=0x7f69300d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 --2- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f69300d47d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6928009d90 tx=0x7f692802a660 comp rx=0 tx=0).stop 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 -- 172.21.15.80:0/3312337774 shutdown_connections 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 --2- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f69300d47d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 --2- 172.21.15.80:0/3312337774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69300b5490 0x7f6930160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 -- 172.21.15.80:0/3312337774 >> 172.21.15.80:0/3312337774 conn(0x7f693006e650 msgr2=0x7f693006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 -- 172.21.15.80:0/3312337774 shutdown_connections 2024-04-25T15:44:47.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.735+0000 7f6937cbd640 1 -- 172.21.15.80:0/3312337774 wait complete. 2024-04-25T15:44:47.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.736+0000 7f6937cbd640 1 Processor -- start 2024-04-25T15:44:47.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.736+0000 7f6937cbd640 1 -- start start 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 0x7f69300b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f693014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f693014bfd0 0x7f693014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f69300b94e0 con 0x7f69300d0b00 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f69300b9360 con 0x7f69300d2d50 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6930163f80 con 0x7f693014bfd0 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 0x7f69300b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 0x7f69300b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53786/0 (socket says 172.21.15.80:53786) 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 -- 172.21.15.80:0/1974885803 learned_addr learned my addr 172.21.15.80:0/1974885803 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935258640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f693014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f693625a640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f693014bfd0 0x7f693014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 -- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f693014bfd0 msgr2=0x7f693014d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f693014bfd0 0x7f693014d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 -- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 msgr2=0x7f693014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f693014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 -- 172.21.15.80:0/1974885803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693014c700 con 0x7f69300d0b00 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6935a59640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 0x7f69300b4b80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e940 tx=0x7f692c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c017070 con 0x7f69300d0b00 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c00ca00 con 0x7f69300d0b00 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693014c9e0 con 0x7f69300d0b00 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00cdd0 con 0x7f69300d0b00 2024-04-25T15:44:47.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.738+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693014cfa0 con 0x7f69300d0b00 2024-04-25T15:44:47.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.739+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693006a100 con 0x7f69300d0b00 2024-04-25T15:44:47.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.740+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f692c01a070 con 0x7f69300d0b00 2024-04-25T15:44:47.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.741+0000 7f69267fc640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69140744b0 0x7f69140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:47.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.741+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f692c0951b0 con 0x7f69300d0b00 2024-04-25T15:44:47.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.741+0000 7f6935258640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69140744b0 0x7f69140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:47.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.741+0000 7f6935258640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69140744b0 0x7f69140769c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6920005880 tx=0x7f6920009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:47.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.745+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f692c05f540 con 0x7f69300d0b00 2024-04-25T15:44:47.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.919+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f69300d41d0 con 0x7f69300d0b00 2024-04-25T15:44:47.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.920+0000 7f69267fc640 1 -- 172.21.15.80:0/1974885803 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7f692c063840 con 0x7f69300d0b00 2024-04-25T15:44:47.921 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:47.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69140744b0 msgr2=0x7f69140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69140744b0 0x7f69140769c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6920005880 tx=0x7f6920009040 comp rx=0 tx=0).stop 2024-04-25T15:44:47.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 msgr2=0x7f69300b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:47.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 0x7f69300b4b80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e940 tx=0x7f692c00ee00 comp rx=0 tx=0).stop 2024-04-25T15:44:47.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 shutdown_connections 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69140744b0 0x7f69140769c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f693014bfd0 0x7f693014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69300d2d50 0x7f693014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 --2- 172.21.15.80:0/1974885803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69300d0b00 0x7f69300b4b80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 >> 172.21.15.80:0/1974885803 conn(0x7f693006e650 msgr2=0x7f693015f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 shutdown_connections 2024-04-25T15:44:47.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:47.922+0000 7f6937cbd640 1 -- 172.21.15.80:0/1974885803 wait complete. 2024-04-25T15:44:47.934 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:44:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.040+0000 7f99229d7640 1 Processor -- start 2024-04-25T15:44:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.040+0000 7f99229d7640 1 -- start start 2024-04-25T15:44:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f99229d7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f991c0d2650 0x7f991c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f99229d7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c0b2f30 con 0x7f991c0b91c0 2024-04-25T15:44:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f99229d7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c0b2c90 con 0x7f991c0b4b60 2024-04-25T15:44:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f99229d7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f991c06eb60 con 0x7f991c0d2650 2024-04-25T15:44:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f9920f74640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f991c0d2650 0x7f991c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f991b7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f991c0b91c0 0x7f991c0d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40776/0 (socket says 172.21.15.80:40776) 2024-04-25T15:44:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f991b7fe640 1 -- 172.21.15.80:0/3934049500 learned_addr learned my addr 172.21.15.80:0/3934049500 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f9920f74640 1 -- 172.21.15.80:0/3934049500 >> v1:172.21.15.195:6789/0 conn(0x7f991c0b4b60 legacy=0x7f991c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f991affd640 1 -- 172.21.15.80:0/3934049500 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107204077 0 0) 0x7f991c0b2f30 con 0x7f991c0b91c0 2024-04-25T15:44:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f9920f74640 1 -- 172.21.15.80:0/3934049500 >> v1:172.21.15.80:6789/0 conn(0x7f991c0b91c0 legacy=0x7f991c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.042+0000 7f9920f74640 1 -- 172.21.15.80:0/3934049500 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c0d10a0 con 0x7f991c0d2650 2024-04-25T15:44:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.043+0000 7f9920f74640 1 --2- 172.21.15.80:0/3934049500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c0d2a60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f991c0d1270 tx=0x7f991402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1972313af2a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.043+0000 7f991affd640 1 -- 172.21.15.80:0/3934049500 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914007740 con 0x7f991c0d2650 2024-04-25T15:44:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.043+0000 7f991affd640 1 -- 172.21.15.80:0/3934049500 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99140078e0 con 0x7f991c0d2650 2024-04-25T15:44:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.043+0000 7f991affd640 1 -- 172.21.15.80:0/3934049500 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914007cb0 con 0x7f991c0d2650 2024-04-25T15:44:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 -- 172.21.15.80:0/3934049500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 msgr2=0x7f991c0d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 --2- 172.21.15.80:0/3934049500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c0d2a60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f991c0d1270 tx=0x7f991402a630 comp rx=0 tx=0).stop 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 -- 172.21.15.80:0/3934049500 shutdown_connections 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 --2- 172.21.15.80:0/3934049500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c0d2a60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 -- 172.21.15.80:0/3934049500 >> 172.21.15.80:0/3934049500 conn(0x7f991c0d0450 msgr2=0x7f991c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 -- 172.21.15.80:0/3934049500 shutdown_connections 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.044+0000 7f99229d7640 1 -- 172.21.15.80:0/3934049500 wait complete. 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.046+0000 7f99229d7640 1 Processor -- start 2024-04-25T15:44:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.046+0000 7f99229d7640 1 -- start start 2024-04-25T15:44:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f99229d7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f991c0b4b60 0x7f991c1d5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f99229d7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f991c0b91c0 0x7f991c09d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f99229d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c1d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f99229d7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f991c0d2fa0 con 0x7f991c0d2650 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f99229d7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f991c09cbe0 con 0x7f991c0b4b60 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f99229d7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f991c09d0e0 con 0x7f991c0b91c0 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f9920f74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c1d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f9920f74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c1d97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53804/0 (socket says 172.21.15.80:53804) 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f9920f74640 1 -- 172.21.15.80:0/1480630101 learned_addr learned my addr 172.21.15.80:0/1480630101 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f991bfff640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f991c0b4b60 0x7f991c1d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f991b7fe640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f991c0b91c0 0x7f991c09d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f9920f74640 1 -- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f991c0b91c0 msgr2=0x7f991c09d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.047+0000 7f9920f74640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f991c0b91c0 0x7f991c09d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9920f74640 1 -- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f991c0b4b60 msgr2=0x7f991c1d5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9920f74640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f991c0b4b60 0x7f991c1d5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9920f74640 1 -- 172.21.15.80:0/1480630101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c1dc6f0 con 0x7f991c0d2650 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f991bfff640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f991c0b4b60 0x7f991c1d5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f991b7fe640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f991c0b91c0 0x7f991c09d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9920f74640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c1d97f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f991402ac20 tx=0x7f9914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914040070 con 0x7f991c0d2650 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9914031c80 con 0x7f991c0d2650 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991c1d6070 con 0x7f991c0d2650 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914003bb0 con 0x7f991c0d2650 2024-04-25T15:44:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.048+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991c09e630 con 0x7f991c0d2650 2024-04-25T15:44:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.049+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991c06a100 con 0x7f991c0d2650 2024-04-25T15:44:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.050+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9914039040 con 0x7f991c0d2650 2024-04-25T15:44:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.050+0000 7f9918ff9640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99080744b0 0x7f99080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.050+0000 7f991bfff640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99080744b0 0x7f99080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.050+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f99140b67b0 con 0x7f991c0d2650 2024-04-25T15:44:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.051+0000 7f991bfff640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99080744b0 0x7f99080769c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f991c0d1810 tx=0x7f990c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.055+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f991c1dc6f0 con 0x7f991c0d2650 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.231+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f991c06d770 con 0x7f991c0d2650 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.232+0000 7f9918ff9640 1 -- 172.21.15.80:0/1480630101 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7f9914081100 con 0x7f991c0d2650 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:44:48.233 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:44:48.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:44:48.234 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.233+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99080744b0 msgr2=0x7f99080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.233+0000 7f99229d7640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99080744b0 0x7f99080769c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f991c0d1810 tx=0x7f990c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 msgr2=0x7f991c1d97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c1d97f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f991402ac20 tx=0x7f9914004a40 comp rx=0 tx=0).stop 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 shutdown_connections 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99080744b0 0x7f99080769c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f991c0d2650 0x7f991c1d97f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f991c0b91c0 0x7f991c09d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 --2- 172.21.15.80:0/1480630101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f991c0b4b60 0x7f991c1d5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 >> 172.21.15.80:0/1480630101 conn(0x7f991c0d0450 msgr2=0x7f991c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 shutdown_connections 2024-04-25T15:44:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.234+0000 7f99229d7640 1 -- 172.21.15.80:0/1480630101 wait complete. 2024-04-25T15:44:48.246 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:44:48.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:44:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.355+0000 7fe8975ce640 1 Processor -- start 2024-04-25T15:44:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.355+0000 7fe8975ce640 1 -- start start 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe8975ce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe890160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe8975ce640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8900b6eb0 con 0x7fe890071bb0 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe8975ce640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8900b7150 con 0x7fe890164690 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe8975ce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8900b51e0 con 0x7fe8900cfc40 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe895b6b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe890071bb0 0x7fe8900b59e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40786/0 (socket says 172.21.15.80:40786) 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe895b6b640 1 -- 172.21.15.80:0/3566883907 learned_addr learned my addr 172.21.15.80:0/3566883907 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184372087 0 0) 0x7fe8900b6eb0 con 0x7fe890071bb0 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe87c003520 con 0x7fe890071bb0 2024-04-25T15:44:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe89536a640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe890160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 289923733 0 0) 0x7fe87c003520 con 0x7fe890071bb0 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 msgr2=0x7fe890160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe890160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 >> v1:172.21.15.195:6789/0 conn(0x7fe890164690 legacy=0x7fe8900714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8900b54c0 con 0x7fe890071bb0 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe8880019f0 con 0x7fe890071bb0 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 >> v1:172.21.15.80:6789/0 conn(0x7fe890071bb0 legacy=0x7fe8900b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe87c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe87c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c004d40 0x7fe87c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8900b51e0 con 0x7fe87c0039e0 2024-04-25T15:44:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c00bb80 con 0x7fe87c004d40 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.357+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c00bd80 con 0x7fe8900cfc40 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe87c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe895b6b640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c004d40 0x7fe87c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe894b69640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe87c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 -- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 msgr2=0x7fe87c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe87c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 -- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c004d40 msgr2=0x7fe87c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c004d40 0x7fe87c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 -- 172.21.15.80:0/3566883907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c003520 con 0x7fe87c0039e0 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe894b69640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900cfc40 0x7fe87c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe895b6b640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c004d40 0x7fe87c005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.358+0000 7fe89536a640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe87c003e50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009ac0 tx=0x7fe87c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8529c944e0148f6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c036070 con 0x7fe87c0039e0 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88c031400 con 0x7fe87c0039e0 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe887fff640 1 -- 172.21.15.80:0/3566883907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c009690 con 0x7fe87c0039e0 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe8975ce640 1 -- 172.21.15.80:0/3566883907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 msgr2=0x7fe87c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe8975ce640 1 --2- 172.21.15.80:0/3566883907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe87c003e50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009ac0 tx=0x7fe87c005830 comp rx=0 tx=0).stop 2024-04-25T15:44:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe895b6b640 1 -- 172.21.15.80:0/3566883907 reap_dead start 2024-04-25T15:44:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe8975ce640 1 -- 172.21.15.80:0/3566883907 shutdown_connections 2024-04-25T15:44:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe8975ce640 1 -- 172.21.15.80:0/3566883907 >> 172.21.15.80:0/3566883907 conn(0x7fe8900d2080 msgr2=0x7fe8900d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe8975ce640 1 -- 172.21.15.80:0/3566883907 shutdown_connections 2024-04-25T15:44:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.359+0000 7fe8975ce640 1 -- 172.21.15.80:0/3566883907 wait complete. 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.361+0000 7fe8975ce640 1 Processor -- start 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.361+0000 7fe8975ce640 1 -- start start 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.362+0000 7fe8975ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe8901fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.362+0000 7fe8975ce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe890153ec0 0x7fe8900d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe8975ce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900d0590 0x7fe8900cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe8975ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8900b6b70 con 0x7fe87c0039e0 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe8975ce640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe890072040 con 0x7fe890153ec0 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe8975ce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe890164aa0 con 0x7fe8900d0590 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe8901fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe8901fa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53832/0 (socket says 172.21.15.80:53832) 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 -- 172.21.15.80:0/483099463 learned_addr learned my addr 172.21.15.80:0/483099463 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe894b69640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe890153ec0 0x7fe8900d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe895b6b640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900d0590 0x7fe8900cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 -- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900d0590 msgr2=0x7fe8900cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900d0590 0x7fe8900cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 -- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe890153ec0 msgr2=0x7fe8900d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe890153ec0 0x7fe8900d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 -- 172.21.15.80:0/483099463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8900d09a0 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe894b69640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe890153ec0 0x7fe8900d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe89536a640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe8901fa310 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009ac0 tx=0x7fe88c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c040020 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88c003bc0 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8900cd5e0 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.363+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c036040 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.364+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8900cdba0 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.364+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89006a100 con 0x7fe87c0039e0 2024-04-25T15:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.365+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe88c043020 con 0x7fe87c0039e0 2024-04-25T15:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.366+0000 7fe885ffb640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8740744b0 0x7fe8740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.366+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fe88c0b5040 con 0x7fe87c0039e0 2024-04-25T15:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.366+0000 7fe894b69640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8740744b0 0x7fe8740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.366+0000 7fe894b69640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8740744b0 0x7fe8740769c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe890163760 tx=0x7fe880009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.370+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe88c04a070 con 0x7fe87c0039e0 2024-04-25T15:44:48.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.543+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe8900d2500 con 0x7fe87c0039e0 2024-04-25T15:44:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.910+0000 7fe885ffb640 1 -- 172.21.15.80:0/483099463 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7fe8900d09a0 con 0x7fe87c0039e0 2024-04-25T15:44:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.912+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8740744b0 msgr2=0x7fe8740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8740744b0 0x7fe8740769c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe890163760 tx=0x7fe880009040 comp rx=0 tx=0).stop 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 msgr2=0x7fe8901fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe8901fa310 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009ac0 tx=0x7fe88c004730 comp rx=0 tx=0).stop 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 shutdown_connections 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8740744b0 0x7fe8740769c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8900d0590 0x7fe8900cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe890153ec0 0x7fe8900d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 --2- 172.21.15.80:0/483099463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c0039e0 0x7fe8901fa310 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:48.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 >> 172.21.15.80:0/483099463 conn(0x7fe8900d2080 msgr2=0x7fe8900d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:48.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 shutdown_connections 2024-04-25T15:44:48.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:48.913+0000 7fe8975ce640 1 -- 172.21.15.80:0/483099463 wait complete. 2024-04-25T15:44:48.929 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:44:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.044+0000 7f775da42640 1 Processor -- start 2024-04-25T15:44:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.044+0000 7f775da42640 1 -- start start 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f775da42640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f77580b1bb0 0x7f77580d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f775da42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 0x7f77580cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f775da42640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77580d32e0 con 0x7f775806ee50 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f775da42640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f77580d0340 con 0x7f77580b1bb0 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f775da42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f77580b3cc0 con 0x7f77580cedc0 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f7756ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f775806ee50 0x7f77580d2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40792/0 (socket says 172.21.15.80:40792) 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f7756ffd640 1 -- 172.21.15.80:0/129184070 learned_addr learned my addr 172.21.15.80:0/129184070 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:49.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587675828 0 0) 0x7f77580d32e0 con 0x7f775806ee50 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7740003520 con 0x7f775806ee50 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f77577fe640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 0x7f77580cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.045+0000 7f77567fc640 1 --2- 172.21.15.80:0/129184070 >> v2:172.21.15.195:3300/0 conn(0x7f77580b1bb0 0x7f77580d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217135173 0 0) 0x7f7740003520 con 0x7f775806ee50 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 msgr2=0x7f77580cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 0x7f77580cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 >> v2:172.21.15.195:3300/0 conn(0x7f77580b1bb0 msgr2=0x7f77580d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 --2- 172.21.15.80:0/129184070 >> v2:172.21.15.195:3300/0 conn(0x7f77580b1bb0 0x7f77580d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580d0060 con 0x7f775806ee50 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f7748001a10 con 0x7f775806ee50 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 >> v1:172.21.15.80:6789/0 conn(0x7f775806ee50 legacy=0x7f77580d2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 0x7f77400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7740003f30 0x7f7740004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7740004d40 0x7f7740005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f774000b9c0 con 0x7f7740003f30 2024-04-25T15:44:49.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f774000bb40 con 0x7f7740004d40 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f774000bd10 con 0x7f77580cedc0 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77567fc640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7740003f30 0x7f7740004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f7756ffd640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 0x7f77400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77577fe640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7740004d40 0x7f7740005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77567fc640 1 -- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 msgr2=0x7f77400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77567fc640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77580cedc0 0x7f77400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77567fc640 1 -- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7740004d40 msgr2=0x7f7740005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77567fc640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7740004d40 0x7f7740005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.046+0000 7f77567fc640 1 -- 172.21.15.80:0/129184070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7740003520 con 0x7f7740003f30 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.047+0000 7f77567fc640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7740003f30 0x7f7740004800 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7758070520 tx=0x7f7740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828008533d473265 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.047+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c036070 con 0x7f7740003f30 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.047+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c031400 con 0x7f7740003f30 2024-04-25T15:44:49.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.047+0000 7f7755ffb640 1 -- 172.21.15.80:0/129184070 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c009690 con 0x7f7740003f30 2024-04-25T15:44:49.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f775da42640 1 -- 172.21.15.80:0/129184070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7740003f30 msgr2=0x7f7740004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f775da42640 1 --2- 172.21.15.80:0/129184070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7740003f30 0x7f7740004800 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7758070520 tx=0x7f7740005830 comp rx=0 tx=0).stop 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f77577fe640 1 -- 172.21.15.80:0/129184070 reap_dead start 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f775da42640 1 -- 172.21.15.80:0/129184070 shutdown_connections 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f775da42640 1 -- 172.21.15.80:0/129184070 >> 172.21.15.80:0/129184070 conn(0x7f77580b7750 msgr2=0x7f77580b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f775da42640 1 -- 172.21.15.80:0/129184070 shutdown_connections 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.048+0000 7f775da42640 1 -- 172.21.15.80:0/129184070 wait complete. 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.050+0000 7f775da42640 1 Processor -- start 2024-04-25T15:44:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.050+0000 7f775da42640 1 -- start start 2024-04-25T15:44:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f775da42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7740003f30 0x7f7758151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f775da42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 0x7f7758163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f775da42640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7758163580 0x7f77580cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f775da42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77580cd090 con 0x7f775815e230 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f775da42640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f775809c250 con 0x7f7758163580 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f775da42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f77580b4150 con 0x7f7740003f30 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f77567fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 0x7f7758163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f77567fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 0x7f7758163040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53856/0 (socket says 172.21.15.80:53856) 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f77567fc640 1 -- 172.21.15.80:0/550488582 learned_addr learned my addr 172.21.15.80:0/550488582 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f7756ffd640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7740003f30 0x7f7758151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.051+0000 7f77577fe640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7758163580 0x7f77580cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f77567fc640 1 -- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7740003f30 msgr2=0x7f7758151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f77567fc640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7740003f30 0x7f7758151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f77567fc640 1 -- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7758163580 msgr2=0x7f77580cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f77567fc640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7758163580 0x7f77580cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f77567fc640 1 -- 172.21.15.80:0/550488582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7758163990 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f77567fc640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 0x7f7758163040 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f774c009b80 tx=0x7f774c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c040020 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c003a40 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7758161940 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c036040 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.052+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77580cb080 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.053+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77581616b0 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.054+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f774c043020 con 0x7f775815e230 2024-04-25T15:44:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.054+0000 7f773ffff640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77440744b0 0x7f77440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.054+0000 7f7756ffd640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77440744b0 0x7f77440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.054+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7f774c0b54f0 con 0x7f775815e230 2024-04-25T15:44:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.055+0000 7f7756ffd640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77440744b0 0x7f77440769c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77580b55b0 tx=0x7f7748006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:49.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.059+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f774c04a070 con 0x7f775815e230 2024-04-25T15:44:49.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.234+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f775806a100 con 0x7f775815e230 2024-04-25T15:44:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.916+0000 7f773ffff640 1 -- 172.21.15.80:0/550488582 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7f7758163990 con 0x7f775815e230 2024-04-25T15:44:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77440744b0 msgr2=0x7f77440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77440744b0 0x7f77440769c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77580b55b0 tx=0x7f7748006040 comp rx=0 tx=0).stop 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 msgr2=0x7f7758163040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 0x7f7758163040 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f774c009b80 tx=0x7f774c004730 comp rx=0 tx=0).stop 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 shutdown_connections 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77440744b0 0x7f77440769c0 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77580b55b0 tx=0x7f7748006040 comp rx=0 tx=0).stop 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7758163580 0x7f77580cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f775815e230 0x7f7758163040 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 --2- 172.21.15.80:0/550488582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7740003f30 0x7f7758151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:49.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.920+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 >> 172.21.15.80:0/550488582 conn(0x7f77580b7750 msgr2=0x7f775815fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.932+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 shutdown_connections 2024-04-25T15:44:49.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:49.937+0000 7f775da42640 1 -- 172.21.15.80:0/550488582 wait complete. 2024-04-25T15:44:49.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:44:50.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.066+0000 7f3a6d5c7640 1 Processor -- start 2024-04-25T15:44:50.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.066+0000 7f3a6d5c7640 1 -- start start 2024-04-25T15:44:50.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.067+0000 7f3a6d5c7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a680b5490 0x7f3a68160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.067+0000 7f3a6d5c7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a680d0b00 0x7f3a680d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.067+0000 7f3a6d5c7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3a680d2b80 0x7f3a680b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.067+0000 7f3a6d5c7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3a681643f0 con 0x7f3a680b5490 2024-04-25T15:44:50.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.067+0000 7f3a6d5c7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3a681646d0 con 0x7f3a680d2b80 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.067+0000 7f3a6d5c7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a681649b0 con 0x7f3a680d0b00 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a680b5490 0x7f3a68160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a680b5490 0x7f3a68160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53870/0 (socket says 172.21.15.80:53870) 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 -- 172.21.15.80:0/2320296940 learned_addr learned my addr 172.21.15.80:0/2320296940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a667fc640 1 --2- 172.21.15.80:0/2320296940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a680d0b00 0x7f3a680d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a677fe640 1 --2- 172.21.15.80:0/2320296940 >> v2:172.21.15.195:3300/0 conn(0x7f3a680d2b80 0x7f3a680b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 -- 172.21.15.80:0/2320296940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a680d0b00 msgr2=0x7f3a680d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 --2- 172.21.15.80:0/2320296940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a680d0b00 0x7f3a680d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 -- 172.21.15.80:0/2320296940 >> v2:172.21.15.195:3300/0 conn(0x7f3a680d2b80 msgr2=0x7f3a680b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 --2- 172.21.15.80:0/2320296940 >> v2:172.21.15.195:3300/0 conn(0x7f3a680d2b80 0x7f3a680b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.068+0000 7f3a66ffd640 1 -- 172.21.15.80:0/2320296940 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a68164c90 con 0x7f3a680b5490 2024-04-25T15:44:50.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a66ffd640 1 --2- 172.21.15.80:0/2320296940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680b5490 0x7f3a68160300 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3a680d5e20 tx=0x7f3a5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9866eaccb974de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:50.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a65ffb640 1 -- 172.21.15.80:0/2320296940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58037070 con 0x7f3a680b5490 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a65ffb640 1 -- 172.21.15.80:0/2320296940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58032440 con 0x7f3a680b5490 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a65ffb640 1 -- 172.21.15.80:0/2320296940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032810 con 0x7f3a680b5490 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2320296940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680b5490 msgr2=0x7f3a68160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2320296940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680b5490 0x7f3a68160300 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3a680d5e20 tx=0x7f3a5802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2320296940 shutdown_connections 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2320296940 >> v2:172.21.15.195:3300/0 conn(0x7f3a680d2b80 0x7f3a680b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2320296940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a680d0b00 0x7f3a680d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2320296940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680b5490 0x7f3a68160300 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.069+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2320296940 >> 172.21.15.80:0/2320296940 conn(0x7f3a6806e650 msgr2=0x7f3a6806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.070+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2320296940 shutdown_connections 2024-04-25T15:44:50.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.070+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2320296940 wait complete. 2024-04-25T15:44:50.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.071+0000 7f3a6d5c7640 1 Processor -- start 2024-04-25T15:44:50.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.071+0000 7f3a6d5c7640 1 -- start start 2024-04-25T15:44:50.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a6d5c7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a680d0b00 0x7f3a6815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a6d5c7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 0x7f3a680ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a6d5c7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a68148450 0x7f3a68149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a6d5c7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3a680b9360 con 0x7f3a680d2b80 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a6d5c7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3a680d2f90 con 0x7f3a680d0b00 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a6d5c7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a680b94e0 con 0x7f3a68148450 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 0x7f3a680ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 0x7f3a680ac7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53882/0 (socket says 172.21.15.80:53882) 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 -- 172.21.15.80:0/2965237829 learned_addr learned my addr 172.21.15.80:0/2965237829 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a66ffd640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a680d0b00 0x7f3a6815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a677fe640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a68148450 0x7f3a68149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 -- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a68148450 msgr2=0x7f3a68149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a68148450 0x7f3a68149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 -- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a680d0b00 msgr2=0x7f3a6815a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a680d0b00 0x7f3a6815a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 -- 172.21.15.80:0/2965237829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a68148b80 con 0x7f3a680d2b80 2024-04-25T15:44:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a667fc640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 0x7f3a680ac7c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c610 tx=0x7f3a5c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c015070 con 0x7f3a680d2b80 2024-04-25T15:44:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.073+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c004220 con 0x7f3a680d2b80 2024-04-25T15:44:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.074+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c003610 con 0x7f3a680d2b80 2024-04-25T15:44:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.074+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a68148e60 con 0x7f3a680d2b80 2024-04-25T15:44:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.074+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a68149420 con 0x7f3a680d2b80 2024-04-25T15:44:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.075+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6806a100 con 0x7f3a680d2b80 2024-04-25T15:44:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.075+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3a5c0037d0 con 0x7f3a680d2b80 2024-04-25T15:44:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.076+0000 7f3a4f7fe640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a540744b0 0x7f3a540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.076+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7f3a5c095110 con 0x7f3a680d2b80 2024-04-25T15:44:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.076+0000 7f3a66ffd640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a540744b0 0x7f3a540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.076+0000 7f3a66ffd640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a540744b0 0x7f3a540769c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.081+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a5c05f120 con 0x7f3a680d2b80 2024-04-25T15:44:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.294+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3a68148910 con 0x7f3a680d2b80 2024-04-25T15:44:50.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.917+0000 7f3a4f7fe640 1 -- 172.21.15.80:0/2965237829 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) ==== 172+0+0 (secure 0 0 0) 0x7f3a5c063420 con 0x7f3a680d2b80 2024-04-25T15:44:50.919 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 7 and data pool 8 2024-04-25T15:44:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.921+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a540744b0 msgr2=0x7f3a540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.921+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a540744b0 0x7f3a540769c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802e000 comp rx=0 tx=0).stop 2024-04-25T15:44:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.921+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 msgr2=0x7f3a680ac7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.921+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 0x7f3a680ac7c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c610 tx=0x7f3a5c00cad0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 shutdown_connections 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a540744b0 0x7f3a540769c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a68148450 0x7f3a68149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a680d2b80 0x7f3a680ac7c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 --2- 172.21.15.80:0/2965237829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a680d0b00 0x7f3a6815a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 >> 172.21.15.80:0/2965237829 conn(0x7f3a6806e650 msgr2=0x7f3a6806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.922+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 shutdown_connections 2024-04-25T15:44:50.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:50.924+0000 7f3a6d5c7640 1 -- 172.21.15.80:0/2965237829 wait complete. 2024-04-25T15:44:50.963 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.071+0000 7f6983234640 1 Processor -- start 2024-04-25T15:44:51.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.071+0000 7f6983234640 1 -- start start 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6983234640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f697c0b91c0 0x7f697c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6983234640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6983234640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c0b2f30 con 0x7f697c0b4b60 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6983234640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f697c06eb60 con 0x7f697c0b91c0 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6983234640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0b2c90 con 0x7f697c0d2480 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f697bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f697c0b91c0 0x7f697c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6980fd0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f697c0b4b60 0x7f697c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40804/0 (socket says 172.21.15.80:40804) 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f6980fd0640 1 -- 172.21.15.80:0/2739830116 learned_addr learned my addr 172.21.15.80:0/2739830116 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f69817d1640 1 --2- 172.21.15.80:0/2739830116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f697bfff640 1 -- 172.21.15.80:0/2739830116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 msgr2=0x7f697c0d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f697bfff640 1 --2- 172.21.15.80:0/2739830116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c0d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f697bfff640 1 -- 172.21.15.80:0/2739830116 >> v1:172.21.15.80:6789/0 conn(0x7f697c0b4b60 legacy=0x7f697c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f697b7fe640 1 -- 172.21.15.80:0/2739830116 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776797408 0 0) 0x7f697c0b2f30 con 0x7f697c0b4b60 2024-04-25T15:44:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.073+0000 7f697bfff640 1 -- 172.21.15.80:0/2739830116 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c0d10a0 con 0x7f697c0b91c0 2024-04-25T15:44:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.074+0000 7f697bfff640 1 --2- 172.21.15.80:0/2739830116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c0d1f40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f69700097d0 tx=0x7f697002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc86d89d82816e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.074+0000 7f697b7fe640 1 -- 172.21.15.80:0/2739830116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970037070 con 0x7f697c0b91c0 2024-04-25T15:44:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.074+0000 7f697b7fe640 1 -- 172.21.15.80:0/2739830116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697002ae40 con 0x7f697c0b91c0 2024-04-25T15:44:51.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.074+0000 7f697b7fe640 1 -- 172.21.15.80:0/2739830116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970032660 con 0x7f697c0b91c0 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 -- 172.21.15.80:0/2739830116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 msgr2=0x7f697c0d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 --2- 172.21.15.80:0/2739830116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c0d1f40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f69700097d0 tx=0x7f697002a130 comp rx=0 tx=0).stop 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 -- 172.21.15.80:0/2739830116 shutdown_connections 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 --2- 172.21.15.80:0/2739830116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c0d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 --2- 172.21.15.80:0/2739830116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c0d1f40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 -- 172.21.15.80:0/2739830116 >> 172.21.15.80:0/2739830116 conn(0x7f697c0d0450 msgr2=0x7f697c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 -- 172.21.15.80:0/2739830116 shutdown_connections 2024-04-25T15:44:51.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.075+0000 7f6983234640 1 -- 172.21.15.80:0/2739830116 wait complete. 2024-04-25T15:44:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.076+0000 7f6983234640 1 Processor -- start 2024-04-25T15:44:51.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.076+0000 7f6983234640 1 -- start start 2024-04-25T15:44:51.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6983234640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f697c0b4b60 0x7f697c09fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6983234640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c1f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6983234640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c1f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6983234640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f697c09d0e0 con 0x7f697c0b91c0 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6983234640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f697c09cbe0 con 0x7f697c0b4b60 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6983234640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f697c09d260 con 0x7f697c0d2480 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c1f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c1f77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53900/0 (socket says 172.21.15.80:53900) 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 -- 172.21.15.80:0/2155605530 learned_addr learned my addr 172.21.15.80:0/2155605530 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f69817d1640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c1f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6980fd0640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f697c0b4b60 0x7f697c09fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 -- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 msgr2=0x7f697c1f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c1f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 -- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f697c0b4b60 msgr2=0x7f697c09fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f697c0b4b60 0x7f697c09fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 -- 172.21.15.80:0/2155605530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c09e860 con 0x7f697c0b91c0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f6980fd0640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f697c0b4b60 0x7f697c09fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.078+0000 7f697bfff640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c1f77d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f69700098f0 tx=0x7f69700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.079+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970041070 con 0x7f697c0b91c0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.079+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697003c670 con 0x7f697c0b91c0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.079+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c09eb40 con 0x7f697c0b91c0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.079+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970037040 con 0x7f697c0b91c0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.079+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c09f100 con 0x7f697c0b91c0 2024-04-25T15:44:51.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.080+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c09e5d0 con 0x7f697c0b91c0 2024-04-25T15:44:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.080+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6970044070 con 0x7f697c0b91c0 2024-04-25T15:44:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.081+0000 7f69797fa640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69680744e0 0x7f69680769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.081+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f69700b5980 con 0x7f697c0b91c0 2024-04-25T15:44:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.081+0000 7f6980fd0640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69680744e0 0x7f69680769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.081+0000 7f6980fd0640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69680744e0 0x7f69680769f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f696c0010e0 tx=0x7f696c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.085+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f697007f9c0 con 0x7f697c0b91c0 2024-04-25T15:44:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.262+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f697c075c90 con 0x7f697c0b91c0 2024-04-25T15:44:51.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.263+0000 7f69797fa640 1 -- 172.21.15.80:0/2155605530 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16943 (secure 0 0 0) 0x7f6970083cc0 con 0x7f697c0b91c0 2024-04-25T15:44:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:51.265 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:50.296464+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69680744e0 msgr2=0x7f69680769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69680744e0 0x7f69680769f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f696c0010e0 tx=0x7f696c009040 comp rx=0 tx=0).stop 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 msgr2=0x7f697c1f77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c1f77d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f69700098f0 tx=0x7f69700046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 shutdown_connections 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f69680744e0 0x7f69680769f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f697c0d2480 0x7f697c1f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f697c0b91c0 0x7f697c1f77d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 --2- 172.21.15.80:0/2155605530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f697c0b4b60 0x7f697c09fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 >> 172.21.15.80:0/2155605530 conn(0x7f697c0d0450 msgr2=0x7f697c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 shutdown_connections 2024-04-25T15:44:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.265+0000 7f6983234640 1 -- 172.21.15.80:0/2155605530 wait complete. 2024-04-25T15:44:51.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:51.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.383+0000 7f1a01938640 1 Processor -- start 2024-04-25T15:44:51.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.383+0000 7f1a01938640 1 -- start start 2024-04-25T15:44:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f1a01938640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19fc0d41b0 0x7f19fc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f1a01938640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0b7d60 0x7f19fc0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f1a01938640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19fc163fb0 con 0x7f19fc1602a0 2024-04-25T15:44:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f1a01938640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f19fc164270 con 0x7f19fc0d41b0 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f1a01938640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc164550 con 0x7f19fc0b7d60 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19faffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19fc0d41b0 0x7f19fc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0b7d60 0x7f19fc0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19faffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19fc0d41b0 0x7f19fc0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:38822/0 (socket says 172.21.15.80:38822) 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19faffd640 1 -- 172.21.15.80:0/1456852496 learned_addr learned my addr 172.21.15.80:0/1456852496 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19fb7fe640 1 -- 172.21.15.80:0/1456852496 >> v2:172.21.15.195:3300/0 conn(0x7f19fc0d41b0 msgr2=0x7f19fc0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19fb7fe640 1 --2- 172.21.15.80:0/1456852496 >> v2:172.21.15.195:3300/0 conn(0x7f19fc0d41b0 0x7f19fc0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19fb7fe640 1 -- 172.21.15.80:0/1456852496 >> v1:172.21.15.195:6789/0 conn(0x7f19fc1602a0 legacy=0x7f19fc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.385+0000 7f19fb7fe640 1 -- 172.21.15.80:0/1456852496 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc164830 con 0x7f19fc0b7d60 2024-04-25T15:44:51.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.386+0000 7f19fb7fe640 1 --2- 172.21.15.80:0/1456852496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0b7d60 0x7f19fc0d49c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19f40097a0 tx=0x7f19f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=543ce871048e60ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.386+0000 7f19f9ffb640 1 -- 172.21.15.80:0/1456852496 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4037070 con 0x7f19fc0b7d60 2024-04-25T15:44:51.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.386+0000 7f19f9ffb640 1 -- 172.21.15.80:0/1456852496 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f4032440 con 0x7f19fc0b7d60 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.386+0000 7f19f9ffb640 1 -- 172.21.15.80:0/1456852496 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4032810 con 0x7f19fc0b7d60 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 -- 172.21.15.80:0/1456852496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0b7d60 msgr2=0x7f19fc0d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 --2- 172.21.15.80:0/1456852496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0b7d60 0x7f19fc0d49c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19f40097a0 tx=0x7f19f402a180 comp rx=0 tx=0).stop 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 -- 172.21.15.80:0/1456852496 shutdown_connections 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 --2- 172.21.15.80:0/1456852496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0b7d60 0x7f19fc0d49c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 --2- 172.21.15.80:0/1456852496 >> v2:172.21.15.195:3300/0 conn(0x7f19fc0d41b0 0x7f19fc0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 -- 172.21.15.80:0/1456852496 >> 172.21.15.80:0/1456852496 conn(0x7f19fc06e9f0 msgr2=0x7f19fc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 -- 172.21.15.80:0/1456852496 shutdown_connections 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.387+0000 7f1a01938640 1 -- 172.21.15.80:0/1456852496 wait complete. 2024-04-25T15:44:51.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.389+0000 7f1a01938640 1 Processor -- start 2024-04-25T15:44:51.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.389+0000 7f1a01938640 1 -- start start 2024-04-25T15:44:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f1a01938640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0d41b0 0x7f19fc0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f1a01938640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19fc1602a0 0x7f19fc161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f1a01938640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 0x7f19fc1606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f1a01938640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc0b5150 con 0x7f19fc161c70 2024-04-25T15:44:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f1a01938640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc0b4fd0 con 0x7f19fc1602a0 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f1a01938640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc0b9220 con 0x7f19fc0d41b0 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 0x7f19fc1606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 0x7f19fc1606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53916/0 (socket says 172.21.15.80:53916) 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.390+0000 7f19fb7fe640 1 -- 172.21.15.80:0/485597327 learned_addr learned my addr 172.21.15.80:0/485597327 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19faffd640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0d41b0 0x7f19fc0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fa7fc640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19fc1602a0 0x7f19fc161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fb7fe640 1 -- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0d41b0 msgr2=0x7f19fc0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fb7fe640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0d41b0 0x7f19fc0b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fb7fe640 1 -- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19fc1602a0 msgr2=0x7f19fc161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fb7fe640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19fc1602a0 0x7f19fc161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fb7fe640 1 -- 172.21.15.80:0/485597327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc162b60 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fa7fc640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19fc1602a0 0x7f19fc161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19fb7fe640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 0x7f19fc1606b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f19f40098c0 tx=0x7f19f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4037040 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f4042070 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4030860 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc162e40 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.391+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc1634b0 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.393+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc15fa00 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.393+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f19f4030a00 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.393+0000 7f19e3fff640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19e80744b0 0x7f19e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.394+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f19f40b5b40 con 0x7f19fc161c70 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.394+0000 7f19faffd640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19e80744b0 0x7f19e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.394+0000 7f19faffd640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19e80744b0 0x7f19e80769c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009ce0 tx=0x7f19ec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.398+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19fc15fa00 con 0x7f19fc161c70 2024-04-25T15:44:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.573+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19fc0d2e40 con 0x7f19fc161c70 2024-04-25T15:44:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.574+0000 7f19e3fff640 1 -- 172.21.15.80:0/485597327 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16943 (secure 0 0 0) 0x7f19fc0d2e40 con 0x7f19fc161c70 2024-04-25T15:44:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:51.576 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:50.296464+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:51.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19e80744b0 msgr2=0x7f19e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19e80744b0 0x7f19e80769c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009ce0 tx=0x7f19ec00b040 comp rx=0 tx=0).stop 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 msgr2=0x7f19fc1606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 0x7f19fc1606b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f19f40098c0 tx=0x7f19f40046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 shutdown_connections 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f19e80744b0 0x7f19e80769c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19fc161c70 0x7f19fc1606b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19fc1602a0 0x7f19fc161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 --2- 172.21.15.80:0/485597327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19fc0d41b0 0x7f19fc0b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.576+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 >> 172.21.15.80:0/485597327 conn(0x7f19fc06e9f0 msgr2=0x7f19fc0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.577+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 shutdown_connections 2024-04-25T15:44:51.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.577+0000 7f1a01938640 1 -- 172.21.15.80:0/485597327 wait complete. 2024-04-25T15:44:51.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:44:51.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.699+0000 7f6512297640 1 Processor -- start 2024-04-25T15:44:51.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.699+0000 7f6512297640 1 -- start start 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6512297640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06c5c0 0x7f650c0d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6512297640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f650c0d2f40 0x7f650c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6512297640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f650c06ecd0 0x7f650c0b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6512297640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0ce360 con 0x7f650c0d2f40 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6512297640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0ce590 con 0x7f650c06ecd0 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6512297640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f650c09c320 con 0x7f650c06c5c0 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f650c0d2f40 0x7f650c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f650c0d2f40 0x7f650c06e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53932/0 (socket says 172.21.15.80:53932) 2024-04-25T15:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 -- 172.21.15.80:0/1061725485 learned_addr learned my addr 172.21.15.80:0/1061725485 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650bfff640 1 --2- 172.21.15.80:0/1061725485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06c5c0 0x7f650c0d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6510834640 1 --2- 172.21.15.80:0/1061725485 >> v2:172.21.15.195:3300/0 conn(0x7f650c06ecd0 0x7f650c0b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 -- 172.21.15.80:0/1061725485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06c5c0 msgr2=0x7f650c0d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 --2- 172.21.15.80:0/1061725485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06c5c0 0x7f650c0d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 -- 172.21.15.80:0/1061725485 >> v2:172.21.15.195:3300/0 conn(0x7f650c06ecd0 msgr2=0x7f650c0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 --2- 172.21.15.80:0/1061725485 >> v2:172.21.15.195:3300/0 conn(0x7f650c06ecd0 0x7f650c0b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f650b7fe640 1 -- 172.21.15.80:0/1061725485 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c0ce830 con 0x7f650c0d2f40 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.701+0000 7f6510834640 1 --2- 172.21.15.80:0/1061725485 >> v2:172.21.15.195:3300/0 conn(0x7f650c06ecd0 0x7f650c0b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.702+0000 7f650b7fe640 1 --2- 172.21.15.80:0/1061725485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c0d2f40 0x7f650c06e790 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f650c0c9910 tx=0x7f650002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd75d7d5518617de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.702+0000 7f650affd640 1 -- 172.21.15.80:0/1061725485 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500037070 con 0x7f650c0d2f40 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.702+0000 7f650affd640 1 -- 172.21.15.80:0/1061725485 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6500032440 con 0x7f650c0d2f40 2024-04-25T15:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.702+0000 7f650affd640 1 -- 172.21.15.80:0/1061725485 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500032810 con 0x7f650c0d2f40 2024-04-25T15:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.702+0000 7f6512297640 1 -- 172.21.15.80:0/1061725485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c0d2f40 msgr2=0x7f650c06e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.702+0000 7f6512297640 1 --2- 172.21.15.80:0/1061725485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c0d2f40 0x7f650c06e790 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f650c0c9910 tx=0x7f650002a140 comp rx=0 tx=0).stop 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 -- 172.21.15.80:0/1061725485 shutdown_connections 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 --2- 172.21.15.80:0/1061725485 >> v2:172.21.15.195:3300/0 conn(0x7f650c06ecd0 0x7f650c0b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 --2- 172.21.15.80:0/1061725485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c0d2f40 0x7f650c06e790 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 --2- 172.21.15.80:0/1061725485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06c5c0 0x7f650c0d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 -- 172.21.15.80:0/1061725485 >> 172.21.15.80:0/1061725485 conn(0x7f650c0b7620 msgr2=0x7f650c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 -- 172.21.15.80:0/1061725485 shutdown_connections 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.703+0000 7f6512297640 1 -- 172.21.15.80:0/1061725485 wait complete. 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.704+0000 7f6512297640 1 Processor -- start 2024-04-25T15:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.705+0000 7f6512297640 1 -- start start 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6512297640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 0x7f650c161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6512297640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06ecd0 0x7f650c1f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6512297640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f650c0d2f40 0x7f650c1f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6512297640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f650c06c9d0 con 0x7f650c06c5c0 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6512297640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0cedf0 con 0x7f650c0d2f40 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6512297640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f650c06cb50 con 0x7f650c06ecd0 2024-04-25T15:44:51.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 0x7f650c161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 0x7f650c161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53938/0 (socket says 172.21.15.80:53938) 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 -- 172.21.15.80:0/1904529517 learned_addr learned my addr 172.21.15.80:0/1904529517 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650b7fe640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06ecd0 0x7f650c1f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f6510834640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f650c0d2f40 0x7f650c1f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 -- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06ecd0 msgr2=0x7f650c1f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06ecd0 0x7f650c1f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 -- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f650c0d2f40 msgr2=0x7f650c1f9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f650c0d2f40 0x7f650c1f9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 -- 172.21.15.80:0/1904529517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c1f4450 con 0x7f650c06c5c0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.706+0000 7f650bfff640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 0x7f650c161050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d5f0 tx=0x7f64fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.707+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc004240 con 0x7f650c06c5c0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.707+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc0043e0 con 0x7f650c06c5c0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.707+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650c0d13e0 con 0x7f650c06c5c0 2024-04-25T15:44:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.707+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc003610 con 0x7f650c06c5c0 2024-04-25T15:44:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.707+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650c160190 con 0x7f650c06c5c0 2024-04-25T15:44:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.708+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650c06a100 con 0x7f650c06c5c0 2024-04-25T15:44:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.708+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f64fc01b020 con 0x7f650c06c5c0 2024-04-25T15:44:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.709+0000 7f6508ff9640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64f80744b0 0x7f64f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.709+0000 7f650b7fe640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64f80744b0 0x7f64f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:51.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.709+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f64fc095060 con 0x7f650c06c5c0 2024-04-25T15:44:51.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.709+0000 7f650b7fe640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64f80744b0 0x7f64f80769c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6500034000 tx=0x7f650002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.714+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f650c0d13e0 con 0x7f650c06c5c0 2024-04-25T15:44:51.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:51.933+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f650c15de00 con 0x7f650c06c5c0 2024-04-25T15:44:52.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.939+0000 7f6508ff9640 1 -- 172.21.15.80:0/1904529517 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f64fc05f6f0 con 0x7f650c06c5c0 2024-04-25T15:44:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64f80744b0 msgr2=0x7f64f80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64f80744b0 0x7f64f80769c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6500034000 tx=0x7f650002e000 comp rx=0 tx=0).stop 2024-04-25T15:44:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 msgr2=0x7f650c161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 0x7f650c161050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d5f0 tx=0x7f64fc00dab0 comp rx=0 tx=0).stop 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 shutdown_connections 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64f80744b0 0x7f64f80769c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f650c0d2f40 0x7f650c1f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f650c06ecd0 0x7f650c1f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 --2- 172.21.15.80:0/1904529517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f650c06c5c0 0x7f650c161050 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 >> 172.21.15.80:0/1904529517 conn(0x7f650c0b7620 msgr2=0x7f650c071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 shutdown_connections 2024-04-25T15:44:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:52.943+0000 7f6512297640 1 -- 172.21.15.80:0/1904529517 wait complete. 2024-04-25T15:44:52.958 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:44:52.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:44:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.075+0000 7f3aced06640 1 Processor -- start 2024-04-25T15:44:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.075+0000 7f3aced06640 1 -- start start 2024-04-25T15:44:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3aced06640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3ac80727c0 0x7f3ac80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3aced06640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ac80718d0 0x7f3ac80d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3aced06640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac80b3290 con 0x7f3ac80d3160 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3aced06640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac8072400 con 0x7f3ac80718d0 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3aced06640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac80d2790 con 0x7f3ac80727c0 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3ac7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ac80718d0 0x7f3ac80d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3ac7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ac80718d0 0x7f3ac80d2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53942/0 (socket says 172.21.15.80:53942) 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3ac7fff640 1 -- 172.21.15.80:0/3901341583 learned_addr learned my addr 172.21.15.80:0/3901341583 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3accaa2640 1 --2- 172.21.15.80:0/3901341583 >> v2:172.21.15.195:3300/0 conn(0x7f3ac80727c0 0x7f3ac80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3ac7fff640 1 -- 172.21.15.80:0/3901341583 >> v2:172.21.15.195:3300/0 conn(0x7f3ac80727c0 msgr2=0x7f3ac80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3ac7fff640 1 --2- 172.21.15.80:0/3901341583 >> v2:172.21.15.195:3300/0 conn(0x7f3ac80727c0 0x7f3ac80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.076+0000 7f3ac7fff640 1 -- 172.21.15.80:0/3901341583 >> v1:172.21.15.195:6789/0 conn(0x7f3ac80d3160 legacy=0x7f3ac80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.077+0000 7f3ac7fff640 1 -- 172.21.15.80:0/3901341583 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac8072120 con 0x7f3ac80718d0 2024-04-25T15:44:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.077+0000 7f3accaa2640 1 --2- 172.21.15.80:0/3901341583 >> v2:172.21.15.195:3300/0 conn(0x7f3ac80727c0 0x7f3ac80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.077+0000 7f3ac7fff640 1 --2- 172.21.15.80:0/3901341583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80718d0 0x7f3ac80d2c20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8161b40 tx=0x7f3ab802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443dc0545345e0e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.077+0000 7f3ac77fe640 1 -- 172.21.15.80:0/3901341583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8037070 con 0x7f3ac80718d0 2024-04-25T15:44:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.077+0000 7f3ac77fe640 1 -- 172.21.15.80:0/3901341583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab8032440 con 0x7f3ac80718d0 2024-04-25T15:44:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.077+0000 7f3ac77fe640 1 -- 172.21.15.80:0/3901341583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8032810 con 0x7f3ac80718d0 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 -- 172.21.15.80:0/3901341583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80718d0 msgr2=0x7f3ac80d2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 --2- 172.21.15.80:0/3901341583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80718d0 0x7f3ac80d2c20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8161b40 tx=0x7f3ab802a160 comp rx=0 tx=0).stop 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 -- 172.21.15.80:0/3901341583 shutdown_connections 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 --2- 172.21.15.80:0/3901341583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80718d0 0x7f3ac80d2c20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 --2- 172.21.15.80:0/3901341583 >> v2:172.21.15.195:3300/0 conn(0x7f3ac80727c0 0x7f3ac80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 -- 172.21.15.80:0/3901341583 >> 172.21.15.80:0/3901341583 conn(0x7f3ac80d3a30 msgr2=0x7f3ac80d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 -- 172.21.15.80:0/3901341583 shutdown_connections 2024-04-25T15:44:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.078+0000 7f3aced06640 1 -- 172.21.15.80:0/3901341583 wait complete. 2024-04-25T15:44:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.080+0000 7f3aced06640 1 Processor -- start 2024-04-25T15:44:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.080+0000 7f3aced06640 1 -- start start 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3aced06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ac80718d0 0x7f3ac815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3aced06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ac80727c0 0x7f3ac80cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3aced06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 0x7f3ac80cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3aced06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8071ce0 con 0x7f3ac80d3160 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3aced06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac80d2420 con 0x7f3ac80718d0 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3aced06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac8071e60 con 0x7f3ac80727c0 2024-04-25T15:44:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3acd2a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 0x7f3ac80cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3acd2a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 0x7f3ac80cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53952/0 (socket says 172.21.15.80:53952) 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3acd2a3640 1 -- 172.21.15.80:0/3850813304 learned_addr learned my addr 172.21.15.80:0/3850813304 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.081+0000 7f3accaa2640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ac80718d0 0x7f3ac815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3ac7fff640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ac80727c0 0x7f3ac80cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3acd2a3640 1 -- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ac80727c0 msgr2=0x7f3ac80cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3acd2a3640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ac80727c0 0x7f3ac80cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3acd2a3640 1 -- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ac80718d0 msgr2=0x7f3ac815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3acd2a3640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ac80718d0 0x7f3ac815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3acd2a3640 1 -- 172.21.15.80:0/3850813304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac81587d0 con 0x7f3ac80d3160 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3ac7fff640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ac80727c0 0x7f3ac80cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3acd2a3640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 0x7f3ac80cc960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000b970 tx=0x7f3ac000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0019070 con 0x7f3ac80d3160 2024-04-25T15:44:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac000cb40 con 0x7f3ac80d3160 2024-04-25T15:44:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac80cc380 con 0x7f3ac80d3160 2024-04-25T15:44:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0014440 con 0x7f3ac80d3160 2024-04-25T15:44:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.082+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac8158a40 con 0x7f3ac80d3160 2024-04-25T15:44:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.083+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac80cd420 con 0x7f3ac80d3160 2024-04-25T15:44:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.084+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3ac001c070 con 0x7f3ac80d3160 2024-04-25T15:44:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.084+0000 7f3ac57fa640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3aa80744b0 0x7f3aa80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.084+0000 7f3accaa2640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3aa80744b0 0x7f3aa80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.085+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f3ac0094f20 con 0x7f3ac80d3160 2024-04-25T15:44:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.085+0000 7f3accaa2640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3aa80744b0 0x7f3aa80769c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000aac0 tx=0x7f3ab0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:53.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.089+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ac80cc380 con 0x7f3ac80d3160 2024-04-25T15:44:53.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.302+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3ac806a100 con 0x7f3ac80d3160 2024-04-25T15:44:53.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.941+0000 7f3ac57fa640 1 -- 172.21.15.80:0/3850813304 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f3ac005ef60 con 0x7f3ac80d3160 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3aa80744b0 msgr2=0x7f3aa80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3aa80744b0 0x7f3aa80769c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000aac0 tx=0x7f3ab0008040 comp rx=0 tx=0).stop 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 msgr2=0x7f3ac80cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 0x7f3ac80cc960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000b970 tx=0x7f3ac000be30 comp rx=0 tx=0).stop 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 shutdown_connections 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3aa80744b0 0x7f3aa80769c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ac80d3160 0x7f3ac80cc960 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ac80727c0 0x7f3ac80cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 --2- 172.21.15.80:0/3850813304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ac80718d0 0x7f3ac815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:53.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 >> 172.21.15.80:0/3850813304 conn(0x7f3ac80d3a30 msgr2=0x7f3ac80ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:53.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 shutdown_connections 2024-04-25T15:44:53.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:53.943+0000 7f3aced06640 1 -- 172.21.15.80:0/3850813304 wait complete. 2024-04-25T15:44:53.956 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:44:53.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:54.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.063+0000 7f1e6a914640 1 Processor -- start 2024-04-25T15:44:54.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.063+0000 7f1e6a914640 1 -- start start 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.064+0000 7f1e6a914640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e640d34a0 0x7f1e640b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.064+0000 7f1e6a914640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e640d1010 con 0x7f1e640b3ac0 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e6a914640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6409cdf0 con 0x7f1e6406da90 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e6a914640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6409d0d0 con 0x7f1e640d34a0 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e68eb1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1e640b3ac0 0x7f1e640b3ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40820/0 (socket says 172.21.15.80:40820) 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e68eb1640 1 -- 172.21.15.80:0/461944290 learned_addr learned my addr 172.21.15.80:0/461944290 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e63fff640 1 --2- 172.21.15.80:0/461944290 >> v2:172.21.15.195:3300/0 conn(0x7f1e640d34a0 0x7f1e640b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120312856 0 0) 0x7f1e640d1010 con 0x7f1e640b3ac0 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4c003520 con 0x7f1e640b3ac0 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3641418135 0 0) 0x7f1e4c003520 con 0x7f1e640b3ac0 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 >> v2:172.21.15.195:3300/0 conn(0x7f1e640d34a0 msgr2=0x7f1e640b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 --2- 172.21.15.80:0/461944290 >> v2:172.21.15.195:3300/0 conn(0x7f1e640d34a0 0x7f1e640b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 >> v1:172.21.15.195:6789/0 conn(0x7f1e6406da90 legacy=0x7f1e6406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6406ec70 con 0x7f1e640b3ac0 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f1e5c0019f0 con 0x7f1e640b3ac0 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 >> v1:172.21.15.80:6789/0 conn(0x7f1e640b3ac0 legacy=0x7f1e640b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c0039b0 0x7f1e4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c004800 0x7f1e4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e4c0051c0 0x7f1e4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6409d0d0 con 0x7f1e4c004800 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c00c160 con 0x7f1e4c0051c0 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c00c360 con 0x7f1e4c0039b0 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.065+0000 7f1e637fe640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c004800 0x7f1e4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e63fff640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c0039b0 0x7f1e4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e68eb1640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e4c0051c0 0x7f1e4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e637fe640 1 -- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c0039b0 msgr2=0x7f1e4c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e637fe640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c0039b0 0x7f1e4c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e637fe640 1 -- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e4c0051c0 msgr2=0x7f1e4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e637fe640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e4c0051c0 0x7f1e4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e637fe640 1 -- 172.21.15.80:0/461944290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c003520 con 0x7f1e4c004800 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e68eb1640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e4c0051c0 0x7f1e4c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e68eb1640 1 -- 172.21.15.80:0/461944290 reap_dead start 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.066+0000 7f1e637fe640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c004800 0x7f1e4c004c10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1e58001750 tx=0x7f1e4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef031490aa6daa92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58001370 con 0x7f1e4c004800 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e580052d0 con 0x7f1e4c004800 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e62ffd640 1 -- 172.21.15.80:0/461944290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5802abc0 con 0x7f1e4c004800 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 -- 172.21.15.80:0/461944290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c004800 msgr2=0x7f1e4c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c004800 0x7f1e4c004c10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1e58001750 tx=0x7f1e4c005830 comp rx=0 tx=0).stop 2024-04-25T15:44:54.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 -- 172.21.15.80:0/461944290 shutdown_connections 2024-04-25T15:44:54.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 --2- 172.21.15.80:0/461944290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c004800 0x7f1e4c004c10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 -- 172.21.15.80:0/461944290 >> 172.21.15.80:0/461944290 conn(0x7f1e640d0450 msgr2=0x7f1e640d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:54.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 -- 172.21.15.80:0/461944290 shutdown_connections 2024-04-25T15:44:54.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.067+0000 7f1e6a914640 1 -- 172.21.15.80:0/461944290 wait complete. 2024-04-25T15:44:54.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.069+0000 7f1e6a914640 1 Processor -- start 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.069+0000 7f1e6a914640 1 -- start start 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.070+0000 7f1e6a914640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c004800 0x7f1e6415f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.070+0000 7f1e6a914640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640b2930 0x7f1e640b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.070+0000 7f1e6a914640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 0x7f1e641616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.070+0000 7f1e6a914640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640b91b0 con 0x7f1e640b21b0 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.070+0000 7f1e6a914640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6406d7b0 con 0x7f1e640b2930 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.070+0000 7f1e6a914640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640b9330 con 0x7f1e4c004800 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 0x7f1e641616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 0x7f1e641616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53974/0 (socket says 172.21.15.80:53974) 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 -- 172.21.15.80:0/651931487 learned_addr learned my addr 172.21.15.80:0/651931487 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 -- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c004800 msgr2=0x7f1e6415f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c004800 0x7f1e6415f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 -- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640b2930 msgr2=0x7f1e640b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e637fe640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640b2930 0x7f1e640b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640b2930 0x7f1e640b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 -- 172.21.15.80:0/651931487 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e640b25c0 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e68eb1640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 0x7f1e641616a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1e64074570 tx=0x7f1e5c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00eb90 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00ed50 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6409d790 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c014670 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.071+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641608e0 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.072+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e6406a100 con 0x7f1e640b21b0 2024-04-25T15:44:54.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.073+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1e5c014810 con 0x7f1e640b21b0 2024-04-25T15:44:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.073+0000 7f1e60ff9640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e500744b0 0x7f1e500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.073+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1e5c0951f0 con 0x7f1e640b21b0 2024-04-25T15:44:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.073+0000 7f1e63fff640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e500744b0 0x7f1e500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.074+0000 7f1e63fff640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e500744b0 0x7f1e500769c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009b20 tx=0x7f1e540095e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.078+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1e640b25c0 con 0x7f1e640b21b0 2024-04-25T15:44:54.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.289+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e640b52a0 con 0x7f1e640b21b0 2024-04-25T15:44:54.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.290+0000 7f1e60ff9640 1 -- 172.21.15.80:0/651931487 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5187 (secure 0 0 0) 0x7f1e5c05f880 con 0x7f1e640b21b0 2024-04-25T15:44:54.291 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:54.291 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:50.296421+0000","modified":"2024-04-25T15:44:53.303749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5886":{"gid":5886,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3351222677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3351222677},{"type":"v1","addr":"172.21.15.80:6837","nonce":3351222677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5886,"qdb_cluster":[5886]},"id":3}]} 2024-04-25T15:44:54.292 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T15:44:54.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e500744b0 msgr2=0x7f1e500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e500744b0 0x7f1e500769c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009b20 tx=0x7f1e540095e0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 msgr2=0x7f1e641616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 0x7f1e641616a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1e64074570 tx=0x7f1e5c00e530 comp rx=0 tx=0).stop 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 shutdown_connections 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1e500744b0 0x7f1e500769c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e640b21b0 0x7f1e641616a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640b2930 0x7f1e640b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 --2- 172.21.15.80:0/651931487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e4c004800 0x7f1e6415f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 >> 172.21.15.80:0/651931487 conn(0x7f1e640d0450 msgr2=0x7f1e6406e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 shutdown_connections 2024-04-25T15:44:54.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.292+0000 7f1e6a914640 1 -- 172.21.15.80:0/651931487 wait complete. 2024-04-25T15:44:54.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.410+0000 7fce96bb7640 1 Processor -- start 2024-04-25T15:44:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.410+0000 7fce96bb7640 1 -- start start 2024-04-25T15:44:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce96bb7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce9009bea0 0x7fce900ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce96bb7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce900d2830 0x7fce900d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce96bb7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9006c660 con 0x7fce900cf320 2024-04-25T15:44:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce96bb7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fce9006cc40 con 0x7fce900d2830 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce96bb7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce900d3180 con 0x7fce9009bea0 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce900d2830 0x7fce900d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce900d2830 0x7fce900d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53986/0 (socket says 172.21.15.80:53986) 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 -- 172.21.15.80:0/1013155299 learned_addr learned my addr 172.21.15.80:0/1013155299 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce94953640 1 --2- 172.21.15.80:0/1013155299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce9009bea0 0x7fce900ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 -- 172.21.15.80:0/1013155299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce9009bea0 msgr2=0x7fce900ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 --2- 172.21.15.80:0/1013155299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce9009bea0 0x7fce900ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 -- 172.21.15.80:0/1013155299 >> v1:172.21.15.195:6789/0 conn(0x7fce900cf320 legacy=0x7fce900cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.412+0000 7fce8ffff640 1 -- 172.21.15.80:0/1013155299 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce900ced60 con 0x7fce900d2830 2024-04-25T15:44:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.413+0000 7fce8ffff640 1 --2- 172.21.15.80:0/1013155299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce900d2830 0x7fce900d2c40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ecc19f5d86a9e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.413+0000 7fce8f7fe640 1 -- 172.21.15.80:0/1013155299 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84037070 con 0x7fce900d2830 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.413+0000 7fce8f7fe640 1 -- 172.21.15.80:0/1013155299 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84032440 con 0x7fce900d2830 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.413+0000 7fce8f7fe640 1 -- 172.21.15.80:0/1013155299 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84032810 con 0x7fce900d2830 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 -- 172.21.15.80:0/1013155299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce900d2830 msgr2=0x7fce900d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1013155299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce900d2830 0x7fce900d2c40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402a270 comp rx=0 tx=0).stop 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 -- 172.21.15.80:0/1013155299 shutdown_connections 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1013155299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce900d2830 0x7fce900d2c40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1013155299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce9009bea0 0x7fce900ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 -- 172.21.15.80:0/1013155299 >> 172.21.15.80:0/1013155299 conn(0x7fce900b7620 msgr2=0x7fce900b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 -- 172.21.15.80:0/1013155299 shutdown_connections 2024-04-25T15:44:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.414+0000 7fce96bb7640 1 -- 172.21.15.80:0/1013155299 wait complete. 2024-04-25T15:44:54.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.416+0000 7fce96bb7640 1 Processor -- start 2024-04-25T15:44:54.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.416+0000 7fce96bb7640 1 -- start start 2024-04-25T15:44:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce96bb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 0x7fce9014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce96bb7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce900cf320 0x7fce900c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce96bb7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce900d2830 0x7fce900c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce96bb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fce900cf040 con 0x7fce9009bea0 2024-04-25T15:44:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce96bb7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fce9015e420 con 0x7fce900cf320 2024-04-25T15:44:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce96bb7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fce900ce8c0 con 0x7fce900d2830 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 0x7fce9014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 0x7fce9014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34340/0 (socket says 172.21.15.80:34340) 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 -- 172.21.15.80:0/1290354842 learned_addr learned my addr 172.21.15.80:0/1290354842 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce95154640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce900d2830 0x7fce900c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 -- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce900d2830 msgr2=0x7fce900c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce8ffff640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce900cf320 0x7fce900c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce900d2830 0x7fce900c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 -- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce900cf320 msgr2=0x7fce900c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce900cf320 0x7fce900c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.417+0000 7fce94953640 1 -- 172.21.15.80:0/1290354842 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce900c6880 con 0x7fce9009bea0 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.418+0000 7fce94953640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 0x7fce9014f670 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce8000d5d0 tx=0x7fce8000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.418+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800125f0 con 0x7fce9009bea0 2024-04-25T15:44:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.418+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce80019070 con 0x7fce9009bea0 2024-04-25T15:44:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.418+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce900c6af0 con 0x7fce9009bea0 2024-04-25T15:44:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.418+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800129d0 con 0x7fce9009bea0 2024-04-25T15:44:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.418+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce90160490 con 0x7fce9009bea0 2024-04-25T15:44:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.419+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9006a100 con 0x7fce9009bea0 2024-04-25T15:44:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.420+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fce80012b70 con 0x7fce9009bea0 2024-04-25T15:44:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.420+0000 7fce8d7fa640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce7c0744b0 0x7fce7c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.420+0000 7fce8ffff640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce7c0744b0 0x7fce7c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.420+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fce80095870 con 0x7fce9009bea0 2024-04-25T15:44:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.421+0000 7fce8ffff640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce7c0744b0 0x7fce7c0769c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce84034000 tx=0x7fce8402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.425+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce8005fe70 con 0x7fce9009bea0 2024-04-25T15:44:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.600+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce90072190 con 0x7fce9009bea0 2024-04-25T15:44:54.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.602+0000 7fce8d7fa640 1 -- 172.21.15.80:0/1290354842 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16930 (secure 0 0 0) 0x7fce8005f770 con 0x7fce9009bea0 2024-04-25T15:44:54.603 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:54.603 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:51.926717+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.603+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce7c0744b0 msgr2=0x7fce7c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.603+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce7c0744b0 0x7fce7c0769c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce84034000 tx=0x7fce8402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.603+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 msgr2=0x7fce9014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.603+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 0x7fce9014f670 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce8000d5d0 tx=0x7fce8000da90 comp rx=0 tx=0).stop 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 shutdown_connections 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fce7c0744b0 0x7fce7c0769c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce900d2830 0x7fce900c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce900cf320 0x7fce900c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 --2- 172.21.15.80:0/1290354842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce9009bea0 0x7fce9014f670 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 >> 172.21.15.80:0/1290354842 conn(0x7fce900b7620 msgr2=0x7fce9015c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 shutdown_connections 2024-04-25T15:44:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.604+0000 7fce96bb7640 1 -- 172.21.15.80:0/1290354842 wait complete. 2024-04-25T15:44:54.616 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:44:54.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:54.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.723+0000 7f6f91d7d640 1 Processor -- start 2024-04-25T15:44:54.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.723+0000 7f6f91d7d640 1 -- start start 2024-04-25T15:44:54.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f91d7d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f8c0d2670 0x7f6f8c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f91d7d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c0d2a80 con 0x7f6f8c0d2260 2024-04-25T15:44:54.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f91d7d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c0b2fe0 con 0x7f6f8c0ceec0 2024-04-25T15:44:54.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f91d7d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8c0b32c0 con 0x7f6f8c0d2670 2024-04-25T15:44:54.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f8c0d2670 0x7f6f8c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f8c0d2670 0x7f6f8c0b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34356/0 (socket says 172.21.15.80:34356) 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8affd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6f8c0d2260 0x7f6f8c06c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39614/0 (socket says 172.21.15.80:39614) 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8bfff640 1 -- 172.21.15.80:0/859398569 learned_addr learned my addr 172.21.15.80:0/859398569 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8bfff640 1 -- 172.21.15.80:0/859398569 >> v1:172.21.15.195:6789/0 conn(0x7f6f8c0ceec0 legacy=0x7f6f8c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8bfff640 1 -- 172.21.15.80:0/859398569 >> v1:172.21.15.80:6789/0 conn(0x7f6f8c0d2260 legacy=0x7f6f8c06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8a7fc640 1 -- 172.21.15.80:0/859398569 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721445530 0 0) 0x7f6f8c0d2a80 con 0x7f6f8c0d2260 2024-04-25T15:44:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.725+0000 7f6f8bfff640 1 -- 172.21.15.80:0/859398569 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c0b35a0 con 0x7f6f8c0d2670 2024-04-25T15:44:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.726+0000 7f6f8bfff640 1 --2- 172.21.15.80:0/859398569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0b0bb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009e50 tx=0x7f6f8402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae77a7e3a9987e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.726+0000 7f6f8a7fc640 1 -- 172.21.15.80:0/859398569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84036070 con 0x7f6f8c0d2670 2024-04-25T15:44:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.726+0000 7f6f8a7fc640 1 -- 172.21.15.80:0/859398569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84031600 con 0x7f6f8c0d2670 2024-04-25T15:44:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.726+0000 7f6f8a7fc640 1 -- 172.21.15.80:0/859398569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f840319d0 con 0x7f6f8c0d2670 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 -- 172.21.15.80:0/859398569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2670 msgr2=0x7f6f8c0b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/859398569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0b0bb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009e50 tx=0x7f6f8402a640 comp rx=0 tx=0).stop 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 -- 172.21.15.80:0/859398569 shutdown_connections 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/859398569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0b0bb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 -- 172.21.15.80:0/859398569 >> 172.21.15.80:0/859398569 conn(0x7f6f8c09b410 msgr2=0x7f6f8c0b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 -- 172.21.15.80:0/859398569 shutdown_connections 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.727+0000 7f6f91d7d640 1 -- 172.21.15.80:0/859398569 wait complete. 2024-04-25T15:44:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.729+0000 7f6f91d7d640 1 Processor -- start 2024-04-25T15:44:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.729+0000 7f6f91d7d640 1 -- start start 2024-04-25T15:44:54.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f91d7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f8c0ceec0 0x7f6f8c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f91d7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 0x7f6f8c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f91d7d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f91d7d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c0cf2d0 con 0x7f6f8c0d2260 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f91d7d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c0d1d40 con 0x7f6f8c0d2670 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f91d7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8c0cf450 con 0x7f6f8c0ceec0 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f8affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 0x7f6f8c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f8affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 0x7f6f8c0cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34368/0 (socket says 172.21.15.80:34368) 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f8affd640 1 -- 172.21.15.80:0/240485648 learned_addr learned my addr 172.21.15.80:0/240485648 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f8bfff640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.730+0000 7f6f8b7fe640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f8c0ceec0 0x7f6f8c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f8affd640 1 -- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f8c0ceec0 msgr2=0x7f6f8c1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f8affd640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f8c0ceec0 0x7f6f8c1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f8affd640 1 -- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0d2670 msgr2=0x7f6f8c0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f8affd640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f8affd640 1 -- 172.21.15.80:0/240485648 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c153ce0 con 0x7f6f8c0d2260 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f8affd640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 0x7f6f8c0cacf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000c440 tx=0x7f6f8000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80018070 con 0x7f6f8c0d2260 2024-04-25T15:44:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f800074e0 con 0x7f6f8c0d2260 2024-04-25T15:44:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c0c9050 con 0x7f6f8c0d2260 2024-04-25T15:44:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80004a20 con 0x7f6f8c0d2260 2024-04-25T15:44:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.731+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c0c9610 con 0x7f6f8c0d2260 2024-04-25T15:44:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.732+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8c06a100 con 0x7f6f8c0d2260 2024-04-25T15:44:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.733+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6f8001b070 con 0x7f6f8c0d2260 2024-04-25T15:44:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.733+0000 7f6f73fff640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6f780744b0 0x7f6f780769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.733+0000 7f6f8b7fe640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6f780744b0 0x7f6f780769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.733+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6f80094660 con 0x7f6f8c0d2260 2024-04-25T15:44:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.734+0000 7f6f8b7fe640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6f780744b0 0x7f6f780769c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c006fd0 tx=0x7f6f7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:54.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.738+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f8005ec60 con 0x7f6f8c0d2260 2024-04-25T15:44:54.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.908+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f8c06c660 con 0x7f6f780744b0 2024-04-25T15:44:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.913+0000 7f6f73fff640 1 -- 172.21.15.80:0/240485648 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239065 (secure 0 0 0) 0x7f6f8c06c660 con 0x7f6f780744b0 2024-04-25T15:44:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:54.918 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6f780744b0 msgr2=0x7f6f780769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6f780744b0 0x7f6f780769c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c006fd0 tx=0x7f6f7c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 msgr2=0x7f6f8c0cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 0x7f6f8c0cacf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000c440 tx=0x7f6f8000c900 comp rx=0 tx=0).stop 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 shutdown_connections 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6f780744b0 0x7f6f780769c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0d2670 0x7f6f8c0cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f8c0d2260 0x7f6f8c0cacf0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 --2- 172.21.15.80:0/240485648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f8c0ceec0 0x7f6f8c1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:54.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.916+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 >> 172.21.15.80:0/240485648 conn(0x7f6f8c09b410 msgr2=0x7f6f8c0cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:54.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.917+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 shutdown_connections 2024-04-25T15:44:54.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:54.917+0000 7f6f91d7d640 1 -- 172.21.15.80:0/240485648 wait complete. 2024-04-25T15:44:54.929 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-04-25T15:44:53.021069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238316,"kb_used_data":5492,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736404,"statfs":{"total":773094113280,"available":772850077696,"internally_reserved":0,"allocated":5623808,"data_stored":3105209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.106359"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.918156+0000","last_change":"2024-04-25T15:44:48.918156+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.918156+0000","last_undegraded":"2024-04-25T15:44:48.918156+0000","last_fullsized":"2024-04-25T15:44:48.918156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.915512+0000","last_change":"2024-04-25T15:44:48.915512+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.915512+0000","last_undegraded":"2024-04-25T15:44:48.915512+0000","last_fullsized":"2024-04-25T15:44:48.915512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.914925+0000","last_change":"2024-04-25T15:44:48.914925+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.914925+0000","last_undegraded":"2024-04-25T15:44:48.914925+0000","last_fullsized":"2024-04-25T15:44:48.914925+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.922258+0000","last_change":"2024-04-25T15:44:48.922258+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.922258+0000","last_undegraded":"2024-04-25T15:44:48.922258+0000","last_fullsized":"2024-04-25T15:44:48.922258+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.917740+0000","last_change":"2024-04-25T15:44:48.917740+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.917740+0000","last_undegraded":"2024-04-25T15:44:48.917740+0000","last_fullsized":"2024-04-25T15:44:48.917740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.919871+0000","last_change":"2024-04-25T15:44:48.919871+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.919871+0000","last_undegraded":"2024-04-25T15:44:48.919871+0000","last_fullsized":"2024-04-25T15:44:48.919871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.919133+0000","last_change":"2024-04-25T15:44:48.919133+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.919133+0000","last_undegraded":"2024-04-25T15:44:48.919133+0000","last_fullsized":"2024-04-25T15:44:48.919133+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.920776+0000","last_change":"2024-04-25T15:44:48.920776+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.920776+0000","last_undegraded":"2024-04-25T15:44:48.920776+0000","last_fullsized":"2024-04-25T15:44:48.920776+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.917565+0000","last_change":"2024-04-25T15:44:48.917565+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.917565+0000","last_undegraded":"2024-04-25T15:44:48.917565+0000","last_fullsized":"2024-04-25T15:44:48.917565+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.919028+0000","last_change":"2024-04-25T15:44:48.919028+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.919028+0000","last_undegraded":"2024-04-25T15:44:48.919028+0000","last_fullsized":"2024-04-25T15:44:48.919028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.920690+0000","last_change":"2024-04-25T15:44:48.920690+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.920690+0000","last_undegraded":"2024-04-25T15:44:48.920690+0000","last_fullsized":"2024-04-25T15:44:48.920690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.918430+0000","last_change":"2024-04-25T15:44:48.918430+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.918430+0000","last_undegraded":"2024-04-25T15:44:48.918430+0000","last_fullsized":"2024-04-25T15:44:48.918430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.917548+0000","last_change":"2024-04-25T15:44:48.917548+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.917548+0000","last_undegraded":"2024-04-25T15:44:48.917548+0000","last_fullsized":"2024-04-25T15:44:48.917548+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.917522+0000","last_change":"2024-04-25T15:44:48.917522+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.917522+0000","last_undegraded":"2024-04-25T15:44:48.917522+0000","last_fullsized":"2024-04-25T15:44:48.917522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.915424+0000","last_change":"2024-04-25T15:44:48.915424+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.915424+0000","last_undegraded":"2024-04-25T15:44:48.915424+0000","last_fullsized":"2024-04-25T15:44:48.915424+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.919023+0000","last_change":"2024-04-25T15:44:48.919023+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.919023+0000","last_undegraded":"2024-04-25T15:44:48.919023+0000","last_fullsized":"2024-04-25T15:44:48.919023+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.920416+0000","last_change":"2024-04-25T15:44:48.920416+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.920416+0000","last_undegraded":"2024-04-25T15:44:48.920416+0000","last_fullsized":"2024-04-25T15:44:48.920416+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.918434+0000","last_change":"2024-04-25T15:44:48.918434+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.918434+0000","last_undegraded":"2024-04-25T15:44:48.918434+0000","last_fullsized":"2024-04-25T15:44:48.918434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.917548+0000","last_change":"2024-04-25T15:44:48.917548+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.917548+0000","last_undegraded":"2024-04-25T15:44:48.917548+0000","last_fullsized":"2024-04-25T15:44:48.917548+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.920686+0000","last_change":"2024-04-25T15:44:48.920686+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.920686+0000","last_undegraded":"2024-04-25T15:44:48.920686+0000","last_fullsized":"2024-04-25T15:44:48.920686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.919500+0000","last_change":"2024-04-25T15:44:48.919500+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.919500+0000","last_undegraded":"2024-04-25T15:44:48.919500+0000","last_fullsized":"2024-04-25T15:44:48.919500+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.918494+0000","last_change":"2024-04-25T15:44:48.918494+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.918494+0000","last_undegraded":"2024-04-25T15:44:48.918494+0000","last_fullsized":"2024-04-25T15:44:48.918494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:48.908447+0000","last_change":"2024-04-25T15:44:48.908447+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.908447+0000","last_undegraded":"2024-04-25T15:44:48.908447+0000","last_fullsized":"2024-04-25T15:44:48.908447+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:44:49.912306+0000","last_change":"2024-04-25T15:44:49.912306+0000","last_active":"2024-04-25T15:44:49.912306+0000","last_peered":"2024-04-25T15:44:49.912306+0000","last_clean":"2024-04-25T15:44:49.912306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:49.912306+0000","last_undegraded":"2024-04-25T15:44:49.912306+0000","last_fullsized":"2024-04-25T15:44:49.912306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-04-25T15:44:48.920822+0000","last_change":"2024-04-25T15:44:48.920822+0000","last_active":"2024-04-25T15:44:48.908447+0000","last_peered":"2024-04-25T15:44:48.908447+0000","last_clean":"2024-04-25T15:44:48.908447+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:44:48.920822+0000","last_undegraded":"2024-04-25T15:44:48.920822+0000","last_fullsized":"2024-04-25T15:44:48.920822+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":162,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T15:44:46.907724+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:46.907724+0000","last_peered":"2024-04-25T15:44:46.907724+0000","last_clean":"2024-04-25T15:44:46.907724+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:46.907724+0000","last_undegraded":"2024-04-25T15:44:46.907724+0000","last_fullsized":"2024-04-25T15:44:46.907724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":552960,"data_stored":239783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":239783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":239783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":239783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":836360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1146880,"data_stored":830151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":239783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":239783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:54.933 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:44:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.077+0000 7fadd3114640 1 Processor -- start 2024-04-25T15:44:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.077+0000 7fadd3114640 1 -- start start 2024-04-25T15:44:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadd3114640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadd3114640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadcc0d2830 0x7fadcc0d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadd3114640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc06c660 con 0x7fadcc0cf320 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadd3114640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc06cc40 con 0x7fadcc0d2830 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadd3114640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc0d3180 con 0x7fadcc09bea0 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadcbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadcc0d2830 0x7fadcc0d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadcbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadcc0d2830 0x7fadcc0d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34376/0 (socket says 172.21.15.80:34376) 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.078+0000 7fadcbfff640 1 -- 172.21.15.80:0/3947955763 learned_addr learned my addr 172.21.15.80:0/3947955763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadd0eb0640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadcbfff640 1 -- 172.21.15.80:0/3947955763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 msgr2=0x7fadcc0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadcbfff640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadcbfff640 1 -- 172.21.15.80:0/3947955763 >> v1:172.21.15.195:6789/0 conn(0x7fadcc0cf320 legacy=0x7fadcc0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadcbfff640 1 -- 172.21.15.80:0/3947955763 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0ced60 con 0x7fadcc0d2830 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadd0eb0640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.079+0000 7fadcbfff640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0d2c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009870 tx=0x7fadb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c237519473709a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadcb7fe640 1 -- 172.21.15.80:0/3947955763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8037070 con 0x7fadcc0d2830 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadcb7fe640 1 -- 172.21.15.80:0/3947955763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb8032440 con 0x7fadcc0d2830 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadcb7fe640 1 -- 172.21.15.80:0/3947955763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8032810 con 0x7fadcc0d2830 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 -- 172.21.15.80:0/3947955763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 msgr2=0x7fadcc0d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0d2c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009870 tx=0x7fadb802a270 comp rx=0 tx=0).stop 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 -- 172.21.15.80:0/3947955763 shutdown_connections 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0d2c40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 --2- 172.21.15.80:0/3947955763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 -- 172.21.15.80:0/3947955763 >> 172.21.15.80:0/3947955763 conn(0x7fadcc0b7620 msgr2=0x7fadcc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 -- 172.21.15.80:0/3947955763 shutdown_connections 2024-04-25T15:44:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.080+0000 7fadd3114640 1 -- 172.21.15.80:0/3947955763 wait complete. 2024-04-25T15:44:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.082+0000 7fadd3114640 1 Processor -- start 2024-04-25T15:44:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.082+0000 7fadd3114640 1 -- start start 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.083+0000 7fadd3114640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.083+0000 7fadd3114640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadcc0cf320 0x7fadcc1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.083+0000 7fadd3114640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.083+0000 7fadd3114640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0cf040 con 0x7fadcc0d2830 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.083+0000 7fadd3114640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc15e420 con 0x7fadcc0cf320 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.083+0000 7fadd3114640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc0ce8c0 con 0x7fadcc09bea0 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34384/0 (socket says 172.21.15.80:34384) 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 -- 172.21.15.80:0/617303026 learned_addr learned my addr 172.21.15.80:0/617303026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd0eb0640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadcbfff640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadcc0cf320 0x7fadcc1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 -- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 msgr2=0x7fadcc0c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 -- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadcc0cf320 msgr2=0x7fadcc1545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadcc0cf320 0x7fadcc1545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 -- 172.21.15.80:0/617303026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc160320 con 0x7fadcc0d2830 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd16b1640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0cb0e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fadc400c760 tx=0x7fadc400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4003b70 con 0x7fadcc0d2830 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc4003d10 con 0x7fadcc0d2830 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1f4580 con 0x7fadcc0d2830 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc400aa90 con 0x7fadcc0d2830 2024-04-25T15:44:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.084+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1f4b20 con 0x7fadcc0d2830 2024-04-25T15:44:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.085+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc1f5520 con 0x7fadcc0d2830 2024-04-25T15:44:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.086+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fadc400ac30 con 0x7fadcc0d2830 2024-04-25T15:44:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.087+0000 7fadc97fa640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadb00744b0 0x7fadb00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.087+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fadc4095050 con 0x7fadcc0d2830 2024-04-25T15:44:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.087+0000 7fadd0eb0640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadb00744b0 0x7fadb00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.087+0000 7fadd0eb0640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadb00744b0 0x7fadb00769c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fadc0006fd0 tx=0x7fadc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.091+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fadcc160320 con 0x7fadcc0d2830 2024-04-25T15:44:55.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.264+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadcc0cdf30 con 0x7fadb00744b0 2024-04-25T15:44:55.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.270+0000 7fadc97fa640 1 -- 172.21.15.80:0/617303026 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251968 (secure 0 0 0) 0x7fadcc0cdf30 con 0x7fadb00744b0 2024-04-25T15:44:55.274 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:55.275 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadb00744b0 msgr2=0x7fadb00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadb00744b0 0x7fadb00769c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fadc0006fd0 tx=0x7fadc0008040 comp rx=0 tx=0).stop 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 msgr2=0x7fadcc0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0cb0e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fadc400c760 tx=0x7fadc400cc20 comp rx=0 tx=0).stop 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 shutdown_connections 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadb00744b0 0x7fadb00769c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadcc0d2830 0x7fadcc0cb0e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fadcc0cf320 0x7fadcc1545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 --2- 172.21.15.80:0/617303026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fadcc09bea0 0x7fadcc0c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 >> 172.21.15.80:0/617303026 conn(0x7fadcc0b7620 msgr2=0x7fadcc0cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 shutdown_connections 2024-04-25T15:44:55.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.273+0000 7fadd3114640 1 -- 172.21.15.80:0/617303026 wait complete. 2024-04-25T15:44:55.285 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-04-25T15:44:55.021412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238768,"kb_used_data":5928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735952,"statfs":{"total":773094113280,"available":772849614848,"internally_reserved":0,"allocated":6070272,"data_stored":3317700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000950"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373461+0000","last_change":"2024-04-25T15:44:50.941778+0000","last_active":"2024-04-25T15:44:52.373461+0000","last_peered":"2024-04-25T15:44:52.373461+0000","last_clean":"2024-04-25T15:44:52.373461+0000","last_became_active":"2024-04-25T15:44:50.941477+0000","last_became_peered":"2024-04-25T15:44:50.941477+0000","last_unstale":"2024-04-25T15:44:52.373461+0000","last_undegraded":"2024-04-25T15:44:52.373461+0000","last_fullsized":"2024-04-25T15:44:52.373461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:39.013167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935948+0000","last_change":"2024-04-25T15:44:50.933859+0000","last_active":"2024-04-25T15:44:51.935948+0000","last_peered":"2024-04-25T15:44:51.935948+0000","last_clean":"2024-04-25T15:44:51.935948+0000","last_became_active":"2024-04-25T15:44:50.933545+0000","last_became_peered":"2024-04-25T15:44:50.933545+0000","last_unstale":"2024-04-25T15:44:51.935948+0000","last_undegraded":"2024-04-25T15:44:51.935948+0000","last_fullsized":"2024-04-25T15:44:51.935948+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:02.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375045+0000","last_change":"2024-04-25T15:44:50.943281+0000","last_active":"2024-04-25T15:44:52.375045+0000","last_peered":"2024-04-25T15:44:52.375045+0000","last_clean":"2024-04-25T15:44:52.375045+0000","last_became_active":"2024-04-25T15:44:50.942930+0000","last_became_peered":"2024-04-25T15:44:50.942930+0000","last_unstale":"2024-04-25T15:44:52.375045+0000","last_undegraded":"2024-04-25T15:44:52.375045+0000","last_fullsized":"2024-04-25T15:44:52.375045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:04.073941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935568+0000","last_change":"2024-04-25T15:44:50.942764+0000","last_active":"2024-04-25T15:44:51.935568+0000","last_peered":"2024-04-25T15:44:51.935568+0000","last_clean":"2024-04-25T15:44:51.935568+0000","last_became_active":"2024-04-25T15:44:50.942248+0000","last_became_peered":"2024-04-25T15:44:50.942248+0000","last_unstale":"2024-04-25T15:44:51.935568+0000","last_undegraded":"2024-04-25T15:44:51.935568+0000","last_fullsized":"2024-04-25T15:44:51.935568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:54.860983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934716+0000","last_change":"2024-04-25T15:44:50.938268+0000","last_active":"2024-04-25T15:44:51.934716+0000","last_peered":"2024-04-25T15:44:51.934716+0000","last_clean":"2024-04-25T15:44:51.934716+0000","last_became_active":"2024-04-25T15:44:50.937922+0000","last_became_peered":"2024-04-25T15:44:50.937922+0000","last_unstale":"2024-04-25T15:44:51.934716+0000","last_undegraded":"2024-04-25T15:44:51.934716+0000","last_fullsized":"2024-04-25T15:44:51.934716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:20.862314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373278+0000","last_change":"2024-04-25T15:44:50.943119+0000","last_active":"2024-04-25T15:44:52.373278+0000","last_peered":"2024-04-25T15:44:52.373278+0000","last_clean":"2024-04-25T15:44:52.373278+0000","last_became_active":"2024-04-25T15:44:50.942620+0000","last_became_peered":"2024-04-25T15:44:50.942620+0000","last_unstale":"2024-04-25T15:44:52.373278+0000","last_undegraded":"2024-04-25T15:44:52.373278+0000","last_fullsized":"2024-04-25T15:44:52.373278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:42.324165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374543+0000","last_change":"2024-04-25T15:44:50.946320+0000","last_active":"2024-04-25T15:44:52.374543+0000","last_peered":"2024-04-25T15:44:52.374543+0000","last_clean":"2024-04-25T15:44:52.374543+0000","last_became_active":"2024-04-25T15:44:50.946003+0000","last_became_peered":"2024-04-25T15:44:50.946003+0000","last_unstale":"2024-04-25T15:44:52.374543+0000","last_undegraded":"2024-04-25T15:44:52.374543+0000","last_fullsized":"2024-04-25T15:44:52.374543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:49.189847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373810+0000","last_change":"2024-04-25T15:44:50.948188+0000","last_active":"2024-04-25T15:44:52.373810+0000","last_peered":"2024-04-25T15:44:52.373810+0000","last_clean":"2024-04-25T15:44:52.373810+0000","last_became_active":"2024-04-25T15:44:50.947138+0000","last_became_peered":"2024-04-25T15:44:50.947138+0000","last_unstale":"2024-04-25T15:44:52.373810+0000","last_undegraded":"2024-04-25T15:44:52.373810+0000","last_fullsized":"2024-04-25T15:44:52.373810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:57.117639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373778+0000","last_change":"2024-04-25T15:44:50.950947+0000","last_active":"2024-04-25T15:44:52.373778+0000","last_peered":"2024-04-25T15:44:52.373778+0000","last_clean":"2024-04-25T15:44:52.373778+0000","last_became_active":"2024-04-25T15:44:50.950118+0000","last_became_peered":"2024-04-25T15:44:50.950118+0000","last_unstale":"2024-04-25T15:44:52.373778+0000","last_undegraded":"2024-04-25T15:44:52.373778+0000","last_fullsized":"2024-04-25T15:44:52.373778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:55.988340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373439+0000","last_change":"2024-04-25T15:44:50.939652+0000","last_active":"2024-04-25T15:44:52.373439+0000","last_peered":"2024-04-25T15:44:52.373439+0000","last_clean":"2024-04-25T15:44:52.373439+0000","last_became_active":"2024-04-25T15:44:50.939342+0000","last_became_peered":"2024-04-25T15:44:50.939342+0000","last_unstale":"2024-04-25T15:44:52.373439+0000","last_undegraded":"2024-04-25T15:44:52.373439+0000","last_fullsized":"2024-04-25T15:44:52.373439+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:55.090765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.262253+0000","last_change":"2024-04-25T15:44:50.931197+0000","last_active":"2024-04-25T15:44:52.262253+0000","last_peered":"2024-04-25T15:44:52.262253+0000","last_clean":"2024-04-25T15:44:52.262253+0000","last_became_active":"2024-04-25T15:44:50.930895+0000","last_became_peered":"2024-04-25T15:44:50.930895+0000","last_unstale":"2024-04-25T15:44:52.262253+0000","last_undegraded":"2024-04-25T15:44:52.262253+0000","last_fullsized":"2024-04-25T15:44:52.262253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:27.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373862+0000","last_change":"2024-04-25T15:44:50.952005+0000","last_active":"2024-04-25T15:44:52.373862+0000","last_peered":"2024-04-25T15:44:52.373862+0000","last_clean":"2024-04-25T15:44:52.373862+0000","last_became_active":"2024-04-25T15:44:50.951710+0000","last_became_peered":"2024-04-25T15:44:50.951710+0000","last_unstale":"2024-04-25T15:44:52.373862+0000","last_undegraded":"2024-04-25T15:44:52.373862+0000","last_fullsized":"2024-04-25T15:44:52.373862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:44.182604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373950+0000","last_change":"2024-04-25T15:44:50.942320+0000","last_active":"2024-04-25T15:44:52.373950+0000","last_peered":"2024-04-25T15:44:52.373950+0000","last_clean":"2024-04-25T15:44:52.373950+0000","last_became_active":"2024-04-25T15:44:50.941718+0000","last_became_peered":"2024-04-25T15:44:50.941718+0000","last_unstale":"2024-04-25T15:44:52.373950+0000","last_undegraded":"2024-04-25T15:44:52.373950+0000","last_fullsized":"2024-04-25T15:44:52.373950+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:33.110600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374812+0000","last_change":"2024-04-25T15:44:50.941766+0000","last_active":"2024-04-25T15:44:52.374812+0000","last_peered":"2024-04-25T15:44:52.374812+0000","last_clean":"2024-04-25T15:44:52.374812+0000","last_became_active":"2024-04-25T15:44:50.941449+0000","last_became_peered":"2024-04-25T15:44:50.941449+0000","last_unstale":"2024-04-25T15:44:52.374812+0000","last_undegraded":"2024-04-25T15:44:52.374812+0000","last_fullsized":"2024-04-25T15:44:52.374812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:57.372248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934895+0000","last_change":"2024-04-25T15:44:50.948180+0000","last_active":"2024-04-25T15:44:51.934895+0000","last_peered":"2024-04-25T15:44:51.934895+0000","last_clean":"2024-04-25T15:44:51.934895+0000","last_became_active":"2024-04-25T15:44:50.947833+0000","last_became_peered":"2024-04-25T15:44:50.947833+0000","last_unstale":"2024-04-25T15:44:51.934895+0000","last_undegraded":"2024-04-25T15:44:51.934895+0000","last_fullsized":"2024-04-25T15:44:51.934895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:23.307589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373103+0000","last_change":"2024-04-25T15:44:50.939764+0000","last_active":"2024-04-25T15:44:52.373103+0000","last_peered":"2024-04-25T15:44:52.373103+0000","last_clean":"2024-04-25T15:44:52.373103+0000","last_became_active":"2024-04-25T15:44:50.939461+0000","last_became_peered":"2024-04-25T15:44:50.939461+0000","last_unstale":"2024-04-25T15:44:52.373103+0000","last_undegraded":"2024-04-25T15:44:52.373103+0000","last_fullsized":"2024-04-25T15:44:52.373103+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:45.299066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375171+0000","last_change":"2024-04-25T15:44:50.942954+0000","last_active":"2024-04-25T15:44:52.375171+0000","last_peered":"2024-04-25T15:44:52.375171+0000","last_clean":"2024-04-25T15:44:52.375171+0000","last_became_active":"2024-04-25T15:44:50.942119+0000","last_became_peered":"2024-04-25T15:44:50.942119+0000","last_unstale":"2024-04-25T15:44:52.375171+0000","last_undegraded":"2024-04-25T15:44:52.375171+0000","last_fullsized":"2024-04-25T15:44:52.375171+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:55.988340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.936140+0000","last_change":"2024-04-25T15:44:50.934668+0000","last_active":"2024-04-25T15:44:51.936140+0000","last_peered":"2024-04-25T15:44:51.936140+0000","last_clean":"2024-04-25T15:44:51.936140+0000","last_became_active":"2024-04-25T15:44:50.934351+0000","last_became_peered":"2024-04-25T15:44:50.934351+0000","last_unstale":"2024-04-25T15:44:51.936140+0000","last_undegraded":"2024-04-25T15:44:51.936140+0000","last_fullsized":"2024-04-25T15:44:51.936140+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:49.189847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375102+0000","last_change":"2024-04-25T15:44:50.942190+0000","last_active":"2024-04-25T15:44:52.375102+0000","last_peered":"2024-04-25T15:44:52.375102+0000","last_clean":"2024-04-25T15:44:52.375102+0000","last_became_active":"2024-04-25T15:44:50.941856+0000","last_became_peered":"2024-04-25T15:44:50.941856+0000","last_unstale":"2024-04-25T15:44:52.375102+0000","last_undegraded":"2024-04-25T15:44:52.375102+0000","last_fullsized":"2024-04-25T15:44:52.375102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:27.457466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373402+0000","last_change":"2024-04-25T15:44:50.942348+0000","last_active":"2024-04-25T15:44:52.373402+0000","last_peered":"2024-04-25T15:44:52.373402+0000","last_clean":"2024-04-25T15:44:52.373402+0000","last_became_active":"2024-04-25T15:44:50.942037+0000","last_became_peered":"2024-04-25T15:44:50.942037+0000","last_unstale":"2024-04-25T15:44:52.373402+0000","last_undegraded":"2024-04-25T15:44:52.373402+0000","last_fullsized":"2024-04-25T15:44:52.373402+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:13.925115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373370+0000","last_change":"2024-04-25T15:44:50.944880+0000","last_active":"2024-04-25T15:44:52.373370+0000","last_peered":"2024-04-25T15:44:52.373370+0000","last_clean":"2024-04-25T15:44:52.373370+0000","last_became_active":"2024-04-25T15:44:50.944525+0000","last_became_peered":"2024-04-25T15:44:50.944525+0000","last_unstale":"2024-04-25T15:44:52.373370+0000","last_undegraded":"2024-04-25T15:44:52.373370+0000","last_fullsized":"2024-04-25T15:44:52.373370+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.443200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373414+0000","last_change":"2024-04-25T15:44:50.949089+0000","last_active":"2024-04-25T15:44:52.373414+0000","last_peered":"2024-04-25T15:44:52.373414+0000","last_clean":"2024-04-25T15:44:52.373414+0000","last_became_active":"2024-04-25T15:44:50.948684+0000","last_became_peered":"2024-04-25T15:44:50.948684+0000","last_unstale":"2024-04-25T15:44:52.373414+0000","last_undegraded":"2024-04-25T15:44:52.373414+0000","last_fullsized":"2024-04-25T15:44:52.373414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:27.457466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.262026+0000","last_change":"2024-04-25T15:44:50.931361+0000","last_active":"2024-04-25T15:44:52.262026+0000","last_peered":"2024-04-25T15:44:52.262026+0000","last_clean":"2024-04-25T15:44:52.262026+0000","last_became_active":"2024-04-25T15:44:50.931024+0000","last_became_peered":"2024-04-25T15:44:50.931024+0000","last_unstale":"2024-04-25T15:44:52.262026+0000","last_undegraded":"2024-04-25T15:44:52.262026+0000","last_fullsized":"2024-04-25T15:44:52.262026+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:20.179180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374474+0000","last_change":"2024-04-25T15:44:50.939791+0000","last_active":"2024-04-25T15:44:52.374474+0000","last_peered":"2024-04-25T15:44:52.374474+0000","last_clean":"2024-04-25T15:44:52.374474+0000","last_became_active":"2024-04-25T15:44:50.939468+0000","last_became_peered":"2024-04-25T15:44:50.939468+0000","last_unstale":"2024-04-25T15:44:52.374474+0000","last_undegraded":"2024-04-25T15:44:52.374474+0000","last_fullsized":"2024-04-25T15:44:52.374474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:02.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375305+0000","last_change":"2024-04-25T15:44:50.947218+0000","last_active":"2024-04-25T15:44:52.375305+0000","last_peered":"2024-04-25T15:44:52.375305+0000","last_clean":"2024-04-25T15:44:52.375305+0000","last_became_active":"2024-04-25T15:44:50.946937+0000","last_became_peered":"2024-04-25T15:44:50.946937+0000","last_unstale":"2024-04-25T15:44:52.375305+0000","last_undegraded":"2024-04-25T15:44:52.375305+0000","last_fullsized":"2024-04-25T15:44:52.375305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:40.563320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373981+0000","last_change":"2024-04-25T15:44:50.955635+0000","last_active":"2024-04-25T15:44:52.373981+0000","last_peered":"2024-04-25T15:44:52.373981+0000","last_clean":"2024-04-25T15:44:52.373981+0000","last_became_active":"2024-04-25T15:44:50.954912+0000","last_became_peered":"2024-04-25T15:44:50.954912+0000","last_unstale":"2024-04-25T15:44:52.373981+0000","last_undegraded":"2024-04-25T15:44:52.373981+0000","last_fullsized":"2024-04-25T15:44:52.373981+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:15.157063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373713+0000","last_change":"2024-04-25T15:44:50.948403+0000","last_active":"2024-04-25T15:44:52.373713+0000","last_peered":"2024-04-25T15:44:52.373713+0000","last_clean":"2024-04-25T15:44:52.373713+0000","last_became_active":"2024-04-25T15:44:50.947749+0000","last_became_peered":"2024-04-25T15:44:50.947749+0000","last_unstale":"2024-04-25T15:44:52.373713+0000","last_undegraded":"2024-04-25T15:44:52.373713+0000","last_fullsized":"2024-04-25T15:44:52.373713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.484155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373625+0000","last_change":"2024-04-25T15:44:50.946491+0000","last_active":"2024-04-25T15:44:52.373625+0000","last_peered":"2024-04-25T15:44:52.373625+0000","last_clean":"2024-04-25T15:44:52.373625+0000","last_became_active":"2024-04-25T15:44:50.945838+0000","last_became_peered":"2024-04-25T15:44:50.945838+0000","last_unstale":"2024-04-25T15:44:52.373625+0000","last_undegraded":"2024-04-25T15:44:52.373625+0000","last_fullsized":"2024-04-25T15:44:52.373625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:07.951750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374676+0000","last_change":"2024-04-25T15:44:50.943383+0000","last_active":"2024-04-25T15:44:52.374676+0000","last_peered":"2024-04-25T15:44:52.374676+0000","last_clean":"2024-04-25T15:44:52.374676+0000","last_became_active":"2024-04-25T15:44:50.943062+0000","last_became_peered":"2024-04-25T15:44:50.943062+0000","last_unstale":"2024-04-25T15:44:52.374676+0000","last_undegraded":"2024-04-25T15:44:52.374676+0000","last_fullsized":"2024-04-25T15:44:52.374676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:14.208760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935394+0000","last_change":"2024-04-25T15:44:50.940505+0000","last_active":"2024-04-25T15:44:51.935394+0000","last_peered":"2024-04-25T15:44:51.935394+0000","last_clean":"2024-04-25T15:44:51.935394+0000","last_became_active":"2024-04-25T15:44:50.940177+0000","last_became_peered":"2024-04-25T15:44:50.940177+0000","last_unstale":"2024-04-25T15:44:51.935394+0000","last_undegraded":"2024-04-25T15:44:51.935394+0000","last_fullsized":"2024-04-25T15:44:51.935394+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:22.870713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374727+0000","last_change":"2024-04-25T15:44:50.944134+0000","last_active":"2024-04-25T15:44:52.374727+0000","last_peered":"2024-04-25T15:44:52.374727+0000","last_clean":"2024-04-25T15:44:52.374727+0000","last_became_active":"2024-04-25T15:44:50.943797+0000","last_became_peered":"2024-04-25T15:44:50.943797+0000","last_unstale":"2024-04-25T15:44:52.374727+0000","last_undegraded":"2024-04-25T15:44:52.374727+0000","last_fullsized":"2024-04-25T15:44:52.374727+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:44.244585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.933915+0000","last_change":"2024-04-25T15:44:50.935970+0000","last_active":"2024-04-25T15:44:51.933915+0000","last_peered":"2024-04-25T15:44:51.933915+0000","last_clean":"2024-04-25T15:44:51.933915+0000","last_became_active":"2024-04-25T15:44:50.935635+0000","last_became_peered":"2024-04-25T15:44:50.935635+0000","last_unstale":"2024-04-25T15:44:51.933915+0000","last_undegraded":"2024-04-25T15:44:51.933915+0000","last_fullsized":"2024-04-25T15:44:51.933915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:33.110600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934439+0000","last_change":"2024-04-25T15:44:50.933018+0000","last_active":"2024-04-25T15:44:51.934439+0000","last_peered":"2024-04-25T15:44:51.934439+0000","last_clean":"2024-04-25T15:44:51.934439+0000","last_became_active":"2024-04-25T15:44:50.932716+0000","last_became_peered":"2024-04-25T15:44:50.932716+0000","last_unstale":"2024-04-25T15:44:51.934439+0000","last_undegraded":"2024-04-25T15:44:51.934439+0000","last_fullsized":"2024-04-25T15:44:51.934439+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:01.751029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373538+0000","last_change":"2024-04-25T15:44:49.932195+0000","last_active":"2024-04-25T15:44:52.373538+0000","last_peered":"2024-04-25T15:44:52.373538+0000","last_clean":"2024-04-25T15:44:52.373538+0000","last_became_active":"2024-04-25T15:44:49.931879+0000","last_became_peered":"2024-04-25T15:44:49.931879+0000","last_unstale":"2024-04-25T15:44:52.373538+0000","last_undegraded":"2024-04-25T15:44:52.373538+0000","last_fullsized":"2024-04-25T15:44:52.373538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:38.668560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934614+0000","last_change":"2024-04-25T15:44:50.940063+0000","last_active":"2024-04-25T15:44:51.934614+0000","last_peered":"2024-04-25T15:44:51.934614+0000","last_clean":"2024-04-25T15:44:51.934614+0000","last_became_active":"2024-04-25T15:44:50.939770+0000","last_became_peered":"2024-04-25T15:44:50.939770+0000","last_unstale":"2024-04-25T15:44:51.934614+0000","last_undegraded":"2024-04-25T15:44:51.934614+0000","last_fullsized":"2024-04-25T15:44:51.934614+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:22.870713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373299+0000","last_change":"2024-04-25T15:44:49.930498+0000","last_active":"2024-04-25T15:44:52.373299+0000","last_peered":"2024-04-25T15:44:52.373299+0000","last_clean":"2024-04-25T15:44:52.373299+0000","last_became_active":"2024-04-25T15:44:49.930115+0000","last_became_peered":"2024-04-25T15:44:49.930115+0000","last_unstale":"2024-04-25T15:44:52.373299+0000","last_undegraded":"2024-04-25T15:44:52.373299+0000","last_fullsized":"2024-04-25T15:44:52.373299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:35.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373441+0000","last_change":"2024-04-25T15:44:50.945371+0000","last_active":"2024-04-25T15:44:52.373441+0000","last_peered":"2024-04-25T15:44:52.373441+0000","last_clean":"2024-04-25T15:44:52.373441+0000","last_became_active":"2024-04-25T15:44:50.944854+0000","last_became_peered":"2024-04-25T15:44:50.944854+0000","last_unstale":"2024-04-25T15:44:52.373441+0000","last_undegraded":"2024-04-25T15:44:52.373441+0000","last_fullsized":"2024-04-25T15:44:52.373441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:20.862314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373773+0000","last_change":"2024-04-25T15:44:49.930294+0000","last_active":"2024-04-25T15:44:52.373773+0000","last_peered":"2024-04-25T15:44:52.373773+0000","last_clean":"2024-04-25T15:44:52.373773+0000","last_became_active":"2024-04-25T15:44:49.929970+0000","last_became_peered":"2024-04-25T15:44:49.929970+0000","last_unstale":"2024-04-25T15:44:52.373773+0000","last_undegraded":"2024-04-25T15:44:52.373773+0000","last_fullsized":"2024-04-25T15:44:52.373773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:30.891437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373723+0000","last_change":"2024-04-25T15:44:50.940717+0000","last_active":"2024-04-25T15:44:52.373723+0000","last_peered":"2024-04-25T15:44:52.373723+0000","last_clean":"2024-04-25T15:44:52.373723+0000","last_became_active":"2024-04-25T15:44:50.940094+0000","last_became_peered":"2024-04-25T15:44:50.940094+0000","last_unstale":"2024-04-25T15:44:52.373723+0000","last_undegraded":"2024-04-25T15:44:52.373723+0000","last_fullsized":"2024-04-25T15:44:52.373723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:13.232596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935706+0000","last_change":"2024-04-25T15:44:49.931908+0000","last_active":"2024-04-25T15:44:51.935706+0000","last_peered":"2024-04-25T15:44:51.935706+0000","last_clean":"2024-04-25T15:44:51.935706+0000","last_became_active":"2024-04-25T15:44:49.931576+0000","last_became_peered":"2024-04-25T15:44:49.931576+0000","last_unstale":"2024-04-25T15:44:51.935706+0000","last_undegraded":"2024-04-25T15:44:51.935706+0000","last_fullsized":"2024-04-25T15:44:51.935706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:59.368463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935606+0000","last_change":"2024-04-25T15:44:50.947330+0000","last_active":"2024-04-25T15:44:51.935606+0000","last_peered":"2024-04-25T15:44:51.935606+0000","last_clean":"2024-04-25T15:44:51.935606+0000","last_became_active":"2024-04-25T15:44:50.947005+0000","last_became_peered":"2024-04-25T15:44:50.947005+0000","last_unstale":"2024-04-25T15:44:51.935606+0000","last_undegraded":"2024-04-25T15:44:51.935606+0000","last_fullsized":"2024-04-25T15:44:51.935606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:07.951750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374613+0000","last_change":"2024-04-25T15:44:49.938649+0000","last_active":"2024-04-25T15:44:52.374613+0000","last_peered":"2024-04-25T15:44:52.374613+0000","last_clean":"2024-04-25T15:44:52.374613+0000","last_became_active":"2024-04-25T15:44:49.938353+0000","last_became_peered":"2024-04-25T15:44:49.938353+0000","last_unstale":"2024-04-25T15:44:52.374613+0000","last_undegraded":"2024-04-25T15:44:52.374613+0000","last_fullsized":"2024-04-25T15:44:52.374613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:58.067103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.936297+0000","last_change":"2024-04-25T15:44:50.941036+0000","last_active":"2024-04-25T15:44:51.936297+0000","last_peered":"2024-04-25T15:44:51.936297+0000","last_clean":"2024-04-25T15:44:51.936297+0000","last_became_active":"2024-04-25T15:44:50.940722+0000","last_became_peered":"2024-04-25T15:44:50.940722+0000","last_unstale":"2024-04-25T15:44:51.936297+0000","last_undegraded":"2024-04-25T15:44:51.936297+0000","last_fullsized":"2024-04-25T15:44:51.936297+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:14.208760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934230+0000","last_change":"2024-04-25T15:44:49.933298+0000","last_active":"2024-04-25T15:44:51.934230+0000","last_peered":"2024-04-25T15:44:51.934230+0000","last_clean":"2024-04-25T15:44:51.934230+0000","last_became_active":"2024-04-25T15:44:49.932956+0000","last_became_peered":"2024-04-25T15:44:49.932956+0000","last_unstale":"2024-04-25T15:44:51.934230+0000","last_undegraded":"2024-04-25T15:44:51.934230+0000","last_fullsized":"2024-04-25T15:44:51.934230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:35.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374183+0000","last_change":"2024-04-25T15:44:50.955329+0000","last_active":"2024-04-25T15:44:52.374183+0000","last_peered":"2024-04-25T15:44:52.374183+0000","last_clean":"2024-04-25T15:44:52.374183+0000","last_became_active":"2024-04-25T15:44:50.954523+0000","last_became_peered":"2024-04-25T15:44:50.954523+0000","last_unstale":"2024-04-25T15:44:52.374183+0000","last_undegraded":"2024-04-25T15:44:52.374183+0000","last_fullsized":"2024-04-25T15:44:52.374183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:51.023336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373249+0000","last_change":"2024-04-25T15:44:49.933337+0000","last_active":"2024-04-25T15:44:52.373249+0000","last_peered":"2024-04-25T15:44:52.373249+0000","last_clean":"2024-04-25T15:44:52.373249+0000","last_became_active":"2024-04-25T15:44:49.933019+0000","last_became_peered":"2024-04-25T15:44:49.933019+0000","last_unstale":"2024-04-25T15:44:52.373249+0000","last_undegraded":"2024-04-25T15:44:52.373249+0000","last_fullsized":"2024-04-25T15:44:52.373249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:48.710087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935582+0000","last_change":"2024-04-25T15:44:50.947358+0000","last_active":"2024-04-25T15:44:51.935582+0000","last_peered":"2024-04-25T15:44:51.935582+0000","last_clean":"2024-04-25T15:44:51.935582+0000","last_became_active":"2024-04-25T15:44:50.947005+0000","last_became_peered":"2024-04-25T15:44:50.947005+0000","last_unstale":"2024-04-25T15:44:51.935582+0000","last_undegraded":"2024-04-25T15:44:51.935582+0000","last_fullsized":"2024-04-25T15:44:51.935582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:14.407120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374430+0000","last_change":"2024-04-25T15:44:49.939249+0000","last_active":"2024-04-25T15:44:52.374430+0000","last_peered":"2024-04-25T15:44:52.374430+0000","last_clean":"2024-04-25T15:44:52.374430+0000","last_became_active":"2024-04-25T15:44:49.938925+0000","last_became_peered":"2024-04-25T15:44:49.938925+0000","last_unstale":"2024-04-25T15:44:52.374430+0000","last_undegraded":"2024-04-25T15:44:52.374430+0000","last_fullsized":"2024-04-25T15:44:52.374430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:15.241390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934144+0000","last_change":"2024-04-25T15:44:50.932664+0000","last_active":"2024-04-25T15:44:51.934144+0000","last_peered":"2024-04-25T15:44:51.934144+0000","last_clean":"2024-04-25T15:44:51.934144+0000","last_became_active":"2024-04-25T15:44:50.930257+0000","last_became_peered":"2024-04-25T15:44:50.930257+0000","last_unstale":"2024-04-25T15:44:51.934144+0000","last_undegraded":"2024-04-25T15:44:51.934144+0000","last_fullsized":"2024-04-25T15:44:51.934144+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:13.925115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935709+0000","last_change":"2024-04-25T15:44:49.931339+0000","last_active":"2024-04-25T15:44:51.935709+0000","last_peered":"2024-04-25T15:44:51.935709+0000","last_clean":"2024-04-25T15:44:51.935709+0000","last_became_active":"2024-04-25T15:44:49.930338+0000","last_became_peered":"2024-04-25T15:44:49.930338+0000","last_unstale":"2024-04-25T15:44:51.935709+0000","last_undegraded":"2024-04-25T15:44:51.935709+0000","last_fullsized":"2024-04-25T15:44:51.935709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:33.483428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934404+0000","last_change":"2024-04-25T15:44:50.930078+0000","last_active":"2024-04-25T15:44:51.934404+0000","last_peered":"2024-04-25T15:44:51.934404+0000","last_clean":"2024-04-25T15:44:51.934404+0000","last_became_active":"2024-04-25T15:44:50.929743+0000","last_became_peered":"2024-04-25T15:44:50.929743+0000","last_unstale":"2024-04-25T15:44:51.934404+0000","last_undegraded":"2024-04-25T15:44:51.934404+0000","last_fullsized":"2024-04-25T15:44:51.934404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:23.307589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935188+0000","last_change":"2024-04-25T15:44:49.940492+0000","last_active":"2024-04-25T15:44:51.935188+0000","last_peered":"2024-04-25T15:44:51.935188+0000","last_clean":"2024-04-25T15:44:51.935188+0000","last_became_active":"2024-04-25T15:44:49.940198+0000","last_became_peered":"2024-04-25T15:44:49.940198+0000","last_unstale":"2024-04-25T15:44:51.935188+0000","last_undegraded":"2024-04-25T15:44:51.935188+0000","last_fullsized":"2024-04-25T15:44:51.935188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:57.090848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375039+0000","last_change":"2024-04-25T15:44:50.945377+0000","last_active":"2024-04-25T15:44:52.375039+0000","last_peered":"2024-04-25T15:44:52.375039+0000","last_clean":"2024-04-25T15:44:52.375039+0000","last_became_active":"2024-04-25T15:44:50.943921+0000","last_became_peered":"2024-04-25T15:44:50.943921+0000","last_unstale":"2024-04-25T15:44:52.375039+0000","last_undegraded":"2024-04-25T15:44:52.375039+0000","last_fullsized":"2024-04-25T15:44:52.375039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:23.486925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.936379+0000","last_change":"2024-04-25T15:44:49.932095+0000","last_active":"2024-04-25T15:44:51.936379+0000","last_peered":"2024-04-25T15:44:51.936379+0000","last_clean":"2024-04-25T15:44:51.936379+0000","last_became_active":"2024-04-25T15:44:49.931592+0000","last_became_peered":"2024-04-25T15:44:49.931592+0000","last_unstale":"2024-04-25T15:44:51.936379+0000","last_undegraded":"2024-04-25T15:44:51.936379+0000","last_fullsized":"2024-04-25T15:44:51.936379+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:06.947891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934863+0000","last_change":"2024-04-25T15:44:50.926171+0000","last_active":"2024-04-25T15:44:51.934863+0000","last_peered":"2024-04-25T15:44:51.934863+0000","last_clean":"2024-04-25T15:44:51.934863+0000","last_became_active":"2024-04-25T15:44:50.924739+0000","last_became_peered":"2024-04-25T15:44:50.924739+0000","last_unstale":"2024-04-25T15:44:51.934863+0000","last_undegraded":"2024-04-25T15:44:51.934863+0000","last_fullsized":"2024-04-25T15:44:51.934863+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:34.487287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374088+0000","last_change":"2024-04-25T15:44:49.933580+0000","last_active":"2024-04-25T15:44:52.374088+0000","last_peered":"2024-04-25T15:44:52.374088+0000","last_clean":"2024-04-25T15:44:52.374088+0000","last_became_active":"2024-04-25T15:44:49.931082+0000","last_became_peered":"2024-04-25T15:44:49.931082+0000","last_unstale":"2024-04-25T15:44:52.374088+0000","last_undegraded":"2024-04-25T15:44:52.374088+0000","last_fullsized":"2024-04-25T15:44:52.374088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:22.303730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934741+0000","last_change":"2024-04-25T15:44:50.939148+0000","last_active":"2024-04-25T15:44:51.934741+0000","last_peered":"2024-04-25T15:44:51.934741+0000","last_clean":"2024-04-25T15:44:51.934741+0000","last_became_active":"2024-04-25T15:44:50.938841+0000","last_became_peered":"2024-04-25T15:44:50.938841+0000","last_unstale":"2024-04-25T15:44:51.934741+0000","last_undegraded":"2024-04-25T15:44:51.934741+0000","last_fullsized":"2024-04-25T15:44:51.934741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:54.860983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374740+0000","last_change":"2024-04-25T15:44:49.940478+0000","last_active":"2024-04-25T15:44:52.374740+0000","last_peered":"2024-04-25T15:44:52.374740+0000","last_clean":"2024-04-25T15:44:52.374740+0000","last_became_active":"2024-04-25T15:44:49.940119+0000","last_became_peered":"2024-04-25T15:44:49.940119+0000","last_unstale":"2024-04-25T15:44:52.374740+0000","last_undegraded":"2024-04-25T15:44:52.374740+0000","last_fullsized":"2024-04-25T15:44:52.374740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:12.921255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375215+0000","last_change":"2024-04-25T15:44:50.941496+0000","last_active":"2024-04-25T15:44:52.375215+0000","last_peered":"2024-04-25T15:44:52.375215+0000","last_clean":"2024-04-25T15:44:52.375215+0000","last_became_active":"2024-04-25T15:44:50.940656+0000","last_became_peered":"2024-04-25T15:44:50.940656+0000","last_unstale":"2024-04-25T15:44:52.375215+0000","last_undegraded":"2024-04-25T15:44:52.375215+0000","last_fullsized":"2024-04-25T15:44:52.375215+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:57.117639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373283+0000","last_change":"2024-04-25T15:44:49.941132+0000","last_active":"2024-04-25T15:44:52.373283+0000","last_peered":"2024-04-25T15:44:52.373283+0000","last_clean":"2024-04-25T15:44:52.373283+0000","last_became_active":"2024-04-25T15:44:49.940609+0000","last_became_peered":"2024-04-25T15:44:49.940609+0000","last_unstale":"2024-04-25T15:44:52.373283+0000","last_undegraded":"2024-04-25T15:44:52.373283+0000","last_fullsized":"2024-04-25T15:44:52.373283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:43.237332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374309+0000","last_change":"2024-04-25T15:44:50.943700+0000","last_active":"2024-04-25T15:44:52.374309+0000","last_peered":"2024-04-25T15:44:52.374309+0000","last_clean":"2024-04-25T15:44:52.374309+0000","last_became_active":"2024-04-25T15:44:50.943405+0000","last_became_peered":"2024-04-25T15:44:50.943405+0000","last_unstale":"2024-04-25T15:44:52.374309+0000","last_undegraded":"2024-04-25T15:44:52.374309+0000","last_fullsized":"2024-04-25T15:44:52.374309+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:07.568922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935019+0000","last_change":"2024-04-25T15:44:49.930318+0000","last_active":"2024-04-25T15:44:51.935019+0000","last_peered":"2024-04-25T15:44:51.935019+0000","last_clean":"2024-04-25T15:44:51.935019+0000","last_became_active":"2024-04-25T15:44:49.929956+0000","last_became_peered":"2024-04-25T15:44:49.929956+0000","last_unstale":"2024-04-25T15:44:51.935019+0000","last_undegraded":"2024-04-25T15:44:51.935019+0000","last_fullsized":"2024-04-25T15:44:51.935019+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:59.368463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375240+0000","last_change":"2024-04-25T15:44:50.942761+0000","last_active":"2024-04-25T15:44:52.375240+0000","last_peered":"2024-04-25T15:44:52.375240+0000","last_clean":"2024-04-25T15:44:52.375240+0000","last_became_active":"2024-04-25T15:44:50.942443+0000","last_became_peered":"2024-04-25T15:44:50.942443+0000","last_unstale":"2024-04-25T15:44:52.375240+0000","last_undegraded":"2024-04-25T15:44:52.375240+0000","last_fullsized":"2024-04-25T15:44:52.375240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:44.182604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373591+0000","last_change":"2024-04-25T15:44:49.934823+0000","last_active":"2024-04-25T15:44:52.373591+0000","last_peered":"2024-04-25T15:44:52.373591+0000","last_clean":"2024-04-25T15:44:52.373591+0000","last_became_active":"2024-04-25T15:44:49.934322+0000","last_became_peered":"2024-04-25T15:44:49.934322+0000","last_unstale":"2024-04-25T15:44:52.373591+0000","last_undegraded":"2024-04-25T15:44:52.373591+0000","last_fullsized":"2024-04-25T15:44:52.373591+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:45.080443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373419+0000","last_change":"2024-04-25T15:44:50.934138+0000","last_active":"2024-04-25T15:44:52.373419+0000","last_peered":"2024-04-25T15:44:52.373419+0000","last_clean":"2024-04-25T15:44:52.373419+0000","last_became_active":"2024-04-25T15:44:50.933838+0000","last_became_peered":"2024-04-25T15:44:50.933838+0000","last_unstale":"2024-04-25T15:44:52.373419+0000","last_undegraded":"2024-04-25T15:44:52.373419+0000","last_fullsized":"2024-04-25T15:44:52.373419+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:33.104851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375301+0000","last_change":"2024-04-25T15:44:49.935821+0000","last_active":"2024-04-25T15:44:52.375301+0000","last_peered":"2024-04-25T15:44:52.375301+0000","last_clean":"2024-04-25T15:44:52.375301+0000","last_became_active":"2024-04-25T15:44:49.935523+0000","last_became_peered":"2024-04-25T15:44:49.935523+0000","last_unstale":"2024-04-25T15:44:52.375301+0000","last_undegraded":"2024-04-25T15:44:52.375301+0000","last_fullsized":"2024-04-25T15:44:52.375301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:33.483428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373164+0000","last_change":"2024-04-25T15:44:50.948089+0000","last_active":"2024-04-25T15:44:52.373164+0000","last_peered":"2024-04-25T15:44:52.373164+0000","last_clean":"2024-04-25T15:44:52.373164+0000","last_became_active":"2024-04-25T15:44:50.947780+0000","last_became_peered":"2024-04-25T15:44:50.947780+0000","last_unstale":"2024-04-25T15:44:52.373164+0000","last_undegraded":"2024-04-25T15:44:52.373164+0000","last_fullsized":"2024-04-25T15:44:52.373164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:00.372323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.262273+0000","last_change":"2024-04-25T15:44:49.935365+0000","last_active":"2024-04-25T15:44:52.262273+0000","last_peered":"2024-04-25T15:44:52.262273+0000","last_clean":"2024-04-25T15:44:52.262273+0000","last_became_active":"2024-04-25T15:44:49.934988+0000","last_became_peered":"2024-04-25T15:44:49.934988+0000","last_unstale":"2024-04-25T15:44:52.262273+0000","last_undegraded":"2024-04-25T15:44:52.262273+0000","last_fullsized":"2024-04-25T15:44:52.262273+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:17.013797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934105+0000","last_change":"2024-04-25T15:44:50.949663+0000","last_active":"2024-04-25T15:44:51.934105+0000","last_peered":"2024-04-25T15:44:51.934105+0000","last_clean":"2024-04-25T15:44:51.934105+0000","last_became_active":"2024-04-25T15:44:50.949348+0000","last_became_peered":"2024-04-25T15:44:50.949348+0000","last_unstale":"2024-04-25T15:44:51.934105+0000","last_undegraded":"2024-04-25T15:44:51.934105+0000","last_fullsized":"2024-04-25T15:44:51.934105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:18.443200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373615+0000","last_change":"2024-04-25T15:44:49.937562+0000","last_active":"2024-04-25T15:44:52.373615+0000","last_peered":"2024-04-25T15:44:52.373615+0000","last_clean":"2024-04-25T15:44:52.373615+0000","last_became_active":"2024-04-25T15:44:49.937088+0000","last_became_peered":"2024-04-25T15:44:49.937088+0000","last_unstale":"2024-04-25T15:44:52.373615+0000","last_undegraded":"2024-04-25T15:44:52.373615+0000","last_fullsized":"2024-04-25T15:44:52.373615+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:28.299329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373380+0000","last_change":"2024-04-25T15:44:50.938735+0000","last_active":"2024-04-25T15:44:52.373380+0000","last_peered":"2024-04-25T15:44:52.373380+0000","last_clean":"2024-04-25T15:44:52.373380+0000","last_became_active":"2024-04-25T15:44:50.938409+0000","last_became_peered":"2024-04-25T15:44:50.938409+0000","last_unstale":"2024-04-25T15:44:52.373380+0000","last_undegraded":"2024-04-25T15:44:52.373380+0000","last_fullsized":"2024-04-25T15:44:52.373380+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:26.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373494+0000","last_change":"2024-04-25T15:44:49.936604+0000","last_active":"2024-04-25T15:44:52.373494+0000","last_peered":"2024-04-25T15:44:52.373494+0000","last_clean":"2024-04-25T15:44:52.373494+0000","last_became_active":"2024-04-25T15:44:49.936189+0000","last_became_peered":"2024-04-25T15:44:49.936189+0000","last_unstale":"2024-04-25T15:44:52.373494+0000","last_undegraded":"2024-04-25T15:44:52.373494+0000","last_fullsized":"2024-04-25T15:44:52.373494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:40.007998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934931+0000","last_change":"2024-04-25T15:44:50.931536+0000","last_active":"2024-04-25T15:44:51.934931+0000","last_peered":"2024-04-25T15:44:51.934931+0000","last_clean":"2024-04-25T15:44:51.934931+0000","last_became_active":"2024-04-25T15:44:50.931243+0000","last_became_peered":"2024-04-25T15:44:50.931243+0000","last_unstale":"2024-04-25T15:44:51.934931+0000","last_undegraded":"2024-04-25T15:44:51.934931+0000","last_fullsized":"2024-04-25T15:44:51.934931+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:14.407120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373442+0000","last_change":"2024-04-25T15:44:49.927965+0000","last_active":"2024-04-25T15:44:52.373442+0000","last_peered":"2024-04-25T15:44:52.373442+0000","last_clean":"2024-04-25T15:44:52.373442+0000","last_became_active":"2024-04-25T15:44:49.927644+0000","last_became_peered":"2024-04-25T15:44:49.927644+0000","last_unstale":"2024-04-25T15:44:52.373442+0000","last_undegraded":"2024-04-25T15:44:52.373442+0000","last_fullsized":"2024-04-25T15:44:52.373442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:57.090848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373580+0000","last_change":"2024-04-25T15:44:50.943198+0000","last_active":"2024-04-25T15:44:52.373580+0000","last_peered":"2024-04-25T15:44:52.373580+0000","last_clean":"2024-04-25T15:44:52.373580+0000","last_became_active":"2024-04-25T15:44:50.942889+0000","last_became_peered":"2024-04-25T15:44:50.942889+0000","last_unstale":"2024-04-25T15:44:52.373580+0000","last_undegraded":"2024-04-25T15:44:52.373580+0000","last_fullsized":"2024-04-25T15:44:52.373580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:34.487287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373481+0000","last_change":"2024-04-25T15:44:49.931636+0000","last_active":"2024-04-25T15:44:52.373481+0000","last_peered":"2024-04-25T15:44:52.373481+0000","last_clean":"2024-04-25T15:44:52.373481+0000","last_became_active":"2024-04-25T15:44:49.930851+0000","last_became_peered":"2024-04-25T15:44:49.930851+0000","last_unstale":"2024-04-25T15:44:52.373481+0000","last_undegraded":"2024-04-25T15:44:52.373481+0000","last_fullsized":"2024-04-25T15:44:52.373481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:00.747170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375158+0000","last_change":"2024-04-25T15:44:50.945427+0000","last_active":"2024-04-25T15:44:52.375158+0000","last_peered":"2024-04-25T15:44:52.375158+0000","last_clean":"2024-04-25T15:44:52.375158+0000","last_became_active":"2024-04-25T15:44:50.945084+0000","last_became_peered":"2024-04-25T15:44:50.945084+0000","last_unstale":"2024-04-25T15:44:52.375158+0000","last_undegraded":"2024-04-25T15:44:52.375158+0000","last_fullsized":"2024-04-25T15:44:52.375158+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:13.232596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374603+0000","last_change":"2024-04-25T15:44:49.937723+0000","last_active":"2024-04-25T15:44:52.374603+0000","last_peered":"2024-04-25T15:44:52.374603+0000","last_clean":"2024-04-25T15:44:52.374603+0000","last_became_active":"2024-04-25T15:44:49.937417+0000","last_became_peered":"2024-04-25T15:44:49.937417+0000","last_unstale":"2024-04-25T15:44:52.374603+0000","last_undegraded":"2024-04-25T15:44:52.374603+0000","last_fullsized":"2024-04-25T15:44:52.374603+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:19.858454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373897+0000","last_change":"2024-04-25T15:44:50.937341+0000","last_active":"2024-04-25T15:44:52.373897+0000","last_peered":"2024-04-25T15:44:52.373897+0000","last_clean":"2024-04-25T15:44:52.373897+0000","last_became_active":"2024-04-25T15:44:50.937043+0000","last_became_peered":"2024-04-25T15:44:50.937043+0000","last_unstale":"2024-04-25T15:44:52.373897+0000","last_undegraded":"2024-04-25T15:44:52.373897+0000","last_fullsized":"2024-04-25T15:44:52.373897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:46.084302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.261879+0000","last_change":"2024-04-25T15:44:49.934079+0000","last_active":"2024-04-25T15:44:52.261879+0000","last_peered":"2024-04-25T15:44:52.261879+0000","last_clean":"2024-04-25T15:44:52.261879+0000","last_became_active":"2024-04-25T15:44:49.933802+0000","last_became_peered":"2024-04-25T15:44:49.933802+0000","last_unstale":"2024-04-25T15:44:52.261879+0000","last_undegraded":"2024-04-25T15:44:52.261879+0000","last_fullsized":"2024-04-25T15:44:52.261879+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:01.675067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934078+0000","last_change":"2024-04-25T15:44:50.935872+0000","last_active":"2024-04-25T15:44:51.934078+0000","last_peered":"2024-04-25T15:44:51.934078+0000","last_clean":"2024-04-25T15:44:51.934078+0000","last_became_active":"2024-04-25T15:44:50.935533+0000","last_became_peered":"2024-04-25T15:44:50.935533+0000","last_unstale":"2024-04-25T15:44:51.934078+0000","last_undegraded":"2024-04-25T15:44:51.934078+0000","last_fullsized":"2024-04-25T15:44:51.934078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:01.751029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373598+0000","last_change":"2024-04-25T15:44:49.940873+0000","last_active":"2024-04-25T15:44:52.373598+0000","last_peered":"2024-04-25T15:44:52.373598+0000","last_clean":"2024-04-25T15:44:52.373598+0000","last_became_active":"2024-04-25T15:44:49.940543+0000","last_became_peered":"2024-04-25T15:44:49.940543+0000","last_unstale":"2024-04-25T15:44:52.373598+0000","last_undegraded":"2024-04-25T15:44:52.373598+0000","last_fullsized":"2024-04-25T15:44:52.373598+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:42.018421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373351+0000","last_change":"2024-04-25T15:44:50.949456+0000","last_active":"2024-04-25T15:44:52.373351+0000","last_peered":"2024-04-25T15:44:52.373351+0000","last_clean":"2024-04-25T15:44:52.373351+0000","last_became_active":"2024-04-25T15:44:50.949164+0000","last_became_peered":"2024-04-25T15:44:50.949164+0000","last_unstale":"2024-04-25T15:44:52.373351+0000","last_undegraded":"2024-04-25T15:44:52.373351+0000","last_fullsized":"2024-04-25T15:44:52.373351+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:10.907816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.936382+0000","last_change":"2024-04-25T15:44:49.932616+0000","last_active":"2024-04-25T15:44:51.936382+0000","last_peered":"2024-04-25T15:44:51.936382+0000","last_clean":"2024-04-25T15:44:51.936382+0000","last_became_active":"2024-04-25T15:44:49.932299+0000","last_became_peered":"2024-04-25T15:44:49.932299+0000","last_unstale":"2024-04-25T15:44:51.936382+0000","last_undegraded":"2024-04-25T15:44:51.936382+0000","last_fullsized":"2024-04-25T15:44:51.936382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:44.295207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373899+0000","last_change":"2024-04-25T15:44:50.940191+0000","last_active":"2024-04-25T15:44:52.373899+0000","last_peered":"2024-04-25T15:44:52.373899+0000","last_clean":"2024-04-25T15:44:52.373899+0000","last_became_active":"2024-04-25T15:44:50.939824+0000","last_became_peered":"2024-04-25T15:44:50.939824+0000","last_unstale":"2024-04-25T15:44:52.373899+0000","last_undegraded":"2024-04-25T15:44:52.373899+0000","last_fullsized":"2024-04-25T15:44:52.373899+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:40.563320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374854+0000","last_change":"2024-04-25T15:44:49.938128+0000","last_active":"2024-04-25T15:44:52.374854+0000","last_peered":"2024-04-25T15:44:52.374854+0000","last_clean":"2024-04-25T15:44:52.374854+0000","last_became_active":"2024-04-25T15:44:49.937188+0000","last_became_peered":"2024-04-25T15:44:49.937188+0000","last_unstale":"2024-04-25T15:44:52.374854+0000","last_undegraded":"2024-04-25T15:44:52.374854+0000","last_fullsized":"2024-04-25T15:44:52.374854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:17.439341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374933+0000","last_change":"2024-04-25T15:44:50.947282+0000","last_active":"2024-04-25T15:44:52.374933+0000","last_peered":"2024-04-25T15:44:52.374933+0000","last_clean":"2024-04-25T15:44:52.374933+0000","last_became_active":"2024-04-25T15:44:50.946983+0000","last_became_peered":"2024-04-25T15:44:50.946983+0000","last_unstale":"2024-04-25T15:44:52.374933+0000","last_undegraded":"2024-04-25T15:44:52.374933+0000","last_fullsized":"2024-04-25T15:44:52.374933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:01.124524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373954+0000","last_change":"2024-04-25T15:44:49.933257+0000","last_active":"2024-04-25T15:44:52.373954+0000","last_peered":"2024-04-25T15:44:52.373954+0000","last_clean":"2024-04-25T15:44:52.373954+0000","last_became_active":"2024-04-25T15:44:49.932941+0000","last_became_peered":"2024-04-25T15:44:49.932941+0000","last_unstale":"2024-04-25T15:44:52.373954+0000","last_undegraded":"2024-04-25T15:44:52.373954+0000","last_fullsized":"2024-04-25T15:44:52.373954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:32.106741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.935766+0000","last_change":"2024-04-25T15:44:50.941031+0000","last_active":"2024-04-25T15:44:51.935766+0000","last_peered":"2024-04-25T15:44:51.935766+0000","last_clean":"2024-04-25T15:44:51.935766+0000","last_became_active":"2024-04-25T15:44:50.940710+0000","last_became_peered":"2024-04-25T15:44:50.940710+0000","last_unstale":"2024-04-25T15:44:51.935766+0000","last_undegraded":"2024-04-25T15:44:51.935766+0000","last_fullsized":"2024-04-25T15:44:51.935766+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:02.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373547+0000","last_change":"2024-04-25T15:44:49.937230+0000","last_active":"2024-04-25T15:44:52.373547+0000","last_peered":"2024-04-25T15:44:52.373547+0000","last_clean":"2024-04-25T15:44:52.373547+0000","last_became_active":"2024-04-25T15:44:49.936926+0000","last_became_peered":"2024-04-25T15:44:49.936926+0000","last_unstale":"2024-04-25T15:44:52.373547+0000","last_undegraded":"2024-04-25T15:44:52.373547+0000","last_fullsized":"2024-04-25T15:44:52.373547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:21.866854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375142+0000","last_change":"2024-04-25T15:44:50.940496+0000","last_active":"2024-04-25T15:44:52.375142+0000","last_peered":"2024-04-25T15:44:52.375142+0000","last_clean":"2024-04-25T15:44:52.375142+0000","last_became_active":"2024-04-25T15:44:50.940200+0000","last_became_peered":"2024-04-25T15:44:50.940200+0000","last_unstale":"2024-04-25T15:44:52.375142+0000","last_undegraded":"2024-04-25T15:44:52.375142+0000","last_fullsized":"2024-04-25T15:44:52.375142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:22:33.104851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934085+0000","last_change":"2024-04-25T15:44:49.933541+0000","last_active":"2024-04-25T15:44:51.934085+0000","last_peered":"2024-04-25T15:44:51.934085+0000","last_clean":"2024-04-25T15:44:51.934085+0000","last_became_active":"2024-04-25T15:44:49.933239+0000","last_became_peered":"2024-04-25T15:44:49.933239+0000","last_unstale":"2024-04-25T15:44:51.934085+0000","last_undegraded":"2024-04-25T15:44:51.934085+0000","last_fullsized":"2024-04-25T15:44:51.934085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:30.891437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.374039+0000","last_change":"2024-04-25T15:44:50.948913+0000","last_active":"2024-04-25T15:44:52.374039+0000","last_peered":"2024-04-25T15:44:52.374039+0000","last_clean":"2024-04-25T15:44:52.374039+0000","last_became_active":"2024-04-25T15:44:50.945673+0000","last_became_peered":"2024-04-25T15:44:50.945673+0000","last_unstale":"2024-04-25T15:44:52.374039+0000","last_undegraded":"2024-04-25T15:44:52.374039+0000","last_fullsized":"2024-04-25T15:44:52.374039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:39.569344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934206+0000","last_change":"2024-04-25T15:44:49.929394+0000","last_active":"2024-04-25T15:44:51.934206+0000","last_peered":"2024-04-25T15:44:51.934206+0000","last_clean":"2024-04-25T15:44:51.934206+0000","last_became_active":"2024-04-25T15:44:49.929080+0000","last_became_peered":"2024-04-25T15:44:49.929080+0000","last_unstale":"2024-04-25T15:44:51.934206+0000","last_undegraded":"2024-04-25T15:44:51.934206+0000","last_fullsized":"2024-04-25T15:44:51.934206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:44.295207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.373305+0000","last_change":"2024-04-25T15:44:50.941587+0000","last_active":"2024-04-25T15:44:52.373305+0000","last_peered":"2024-04-25T15:44:52.373305+0000","last_clean":"2024-04-25T15:44:52.373305+0000","last_became_active":"2024-04-25T15:44:50.941235+0000","last_became_peered":"2024-04-25T15:44:50.941235+0000","last_unstale":"2024-04-25T15:44:52.373305+0000","last_undegraded":"2024-04-25T15:44:52.373305+0000","last_fullsized":"2024-04-25T15:44:52.373305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:49.912306+0000","last_clean_scrub_stamp":"2024-04-25T15:44:49.912306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:59.070962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:52.375208+0000","last_change":"2024-04-25T15:44:49.940102+0000","last_active":"2024-04-25T15:44:52.375208+0000","last_peered":"2024-04-25T15:44:52.375208+0000","last_clean":"2024-04-25T15:44:52.375208+0000","last_became_active":"2024-04-25T15:44:49.939692+0000","last_became_peered":"2024-04-25T15:44:49.939692+0000","last_unstale":"2024-04-25T15:44:52.375208+0000","last_undegraded":"2024-04-25T15:44:52.375208+0000","last_fullsized":"2024-04-25T15:44:52.375208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:44:48.908447+0000","last_clean_scrub_stamp":"2024-04-25T15:44:48.908447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:58.526393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":171,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T15:44:51.934497+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:44:51.934497+0000","last_peered":"2024-04-25T15:44:51.934497+0000","last_clean":"2024-04-25T15:44:51.934497+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:44:51.934497+0000","last_undegraded":"2024-04-25T15:44:51.934497+0000","last_fullsized":"2024-04-25T15:44:51.934497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":267170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":268152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":266678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1204224,"data_stored":856942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":857010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":602112,"data_stored":266518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":267100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:44:55.290 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:44:55.291 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T15:44:55.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.439+0000 7f6fccb6c640 1 Processor -- start 2024-04-25T15:44:55.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.439+0000 7f6fccb6c640 1 -- start start 2024-04-25T15:44:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fccb6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc8153f70 0x7f6fc80b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fccb6c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6fc80b0c00 0x7f6fc806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fccb6c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc806df20 con 0x7f6fc806db10 2024-04-25T15:44:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fccb6c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc80b1180 con 0x7f6fc80b0c00 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fccb6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc815d4f0 con 0x7f6fc8153f70 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc5d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6fc80b0c00 0x7f6fc806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc6d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6fc806db10 0x7f6fc8160940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39618/0 (socket says 172.21.15.80:39618) 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc6d9d640 1 -- 172.21.15.80:0/3418752800 learned_addr learned my addr 172.21.15.80:0/3418752800 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc659c640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc8153f70 0x7f6fc80b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc5d9b640 1 -- 172.21.15.80:0/3418752800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc8153f70 msgr2=0x7f6fc80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc5d9b640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc8153f70 0x7f6fc80b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc5d9b640 1 -- 172.21.15.80:0/3418752800 >> v1:172.21.15.80:6789/0 conn(0x7f6fc806db10 legacy=0x7f6fc8160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc5d9b640 1 -- 172.21.15.80:0/3418752800 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc815e270 con 0x7f6fc80b0c00 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc559a640 1 -- 172.21.15.80:0/3418752800 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435303186 0 0) 0x7f6fc0001490 con 0x7f6fc806db10 2024-04-25T15:44:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.441+0000 7f6fc659c640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc8153f70 0x7f6fc80b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:55.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.442+0000 7f6fc5d9b640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc80b0c00 0x7f6fc806d5d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097a0 tx=0x7f6fbc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b900c3f2de866c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.442+0000 7f6fc559a640 1 -- 172.21.15.80:0/3418752800 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc037070 con 0x7f6fc80b0c00 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.442+0000 7f6fc559a640 1 -- 172.21.15.80:0/3418752800 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc032440 con 0x7f6fc80b0c00 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.442+0000 7f6fc559a640 1 -- 172.21.15.80:0/3418752800 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc032810 con 0x7f6fc80b0c00 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 -- 172.21.15.80:0/3418752800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc80b0c00 msgr2=0x7f6fc806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc80b0c00 0x7f6fc806d5d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097a0 tx=0x7f6fbc02a180 comp rx=0 tx=0).stop 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 -- 172.21.15.80:0/3418752800 shutdown_connections 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc80b0c00 0x7f6fc806d5d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/3418752800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc8153f70 0x7f6fc80b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 -- 172.21.15.80:0/3418752800 >> 172.21.15.80:0/3418752800 conn(0x7f6fc80d1e20 msgr2=0x7f6fc8073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 -- 172.21.15.80:0/3418752800 shutdown_connections 2024-04-25T15:44:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.443+0000 7f6fccb6c640 1 -- 172.21.15.80:0/3418752800 wait complete. 2024-04-25T15:44:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.445+0000 7f6fccb6c640 1 Processor -- start 2024-04-25T15:44:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.445+0000 7f6fccb6c640 1 -- start start 2024-04-25T15:44:55.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fccb6c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806db10 0x7f6fc8141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fccb6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80b0c00 0x7f6fc8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fccb6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 0x7f6fc81401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fccb6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc80b5710 con 0x7f6fc8153f70 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fccb6c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc815da70 con 0x7f6fc806db10 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fccb6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc80aefe0 con 0x7f6fc80b0c00 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 0x7f6fc81401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 0x7f6fc81401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34400/0 (socket says 172.21.15.80:34400) 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 -- 172.21.15.80:0/1369049714 learned_addr learned my addr 172.21.15.80:0/1369049714 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc5d9b640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80b0c00 0x7f6fc8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc659c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806db10 0x7f6fc8141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 -- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80b0c00 msgr2=0x7f6fc8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80b0c00 0x7f6fc8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 -- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806db10 msgr2=0x7f6fc8141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806db10 0x7f6fc8141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.446+0000 7f6fc6d9d640 1 -- 172.21.15.80:0/1369049714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc81423c0 con 0x7f6fc8153f70 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.447+0000 7f6fc6d9d640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 0x7f6fc81401a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c6d0 tx=0x7f6fc000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.447+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0018070 con 0x7f6fc8153f70 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.447+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc0004d60 con 0x7f6fc8153f70 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.447+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc81426a0 con 0x7f6fc8153f70 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.447+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000a880 con 0x7f6fc8153f70 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.447+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc8142c60 con 0x7f6fc8153f70 2024-04-25T15:44:55.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.448+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc8144610 con 0x7f6fc8153f70 2024-04-25T15:44:55.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.448+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6fc001b070 con 0x7f6fc8153f70 2024-04-25T15:44:55.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.449+0000 7f6fb6ffd640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6fa80744b0 0x7f6fa80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.449+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6fc0094b50 con 0x7f6fc8153f70 2024-04-25T15:44:55.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.449+0000 7f6fc659c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6fa80744b0 0x7f6fa80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.449+0000 7f6fc659c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6fa80744b0 0x7f6fa80769c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800a950 tx=0x7f6fb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.453+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fc806df20 con 0x7f6fc8153f70 2024-04-25T15:44:55.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.694+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6fc806a100 con 0x7f6fc8153f70 2024-04-25T15:44:55.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.696+0000 7f6fb6ffd640 1 -- 172.21.15.80:0/1369049714 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f6fc005f150 con 0x7f6fc8153f70 2024-04-25T15:44:55.697 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:44:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:44:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-25T15:44:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-25T15:44:55.697 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T15:44:55.698 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-25T15:44:55.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6fa80744b0 msgr2=0x7f6fa80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6fa80744b0 0x7f6fa80769c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800a950 tx=0x7f6fb8008040 comp rx=0 tx=0).stop 2024-04-25T15:44:55.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 msgr2=0x7f6fc81401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 0x7f6fc81401a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c6d0 tx=0x7f6fc000cb90 comp rx=0 tx=0).stop 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 shutdown_connections 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6fa80744b0 0x7f6fa80769c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fc8153f70 0x7f6fc81401a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc80b0c00 0x7f6fc8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 --2- 172.21.15.80:0/1369049714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806db10 0x7f6fc8141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 >> 172.21.15.80:0/1369049714 conn(0x7f6fc80d1e20 msgr2=0x7f6fc814a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 shutdown_connections 2024-04-25T15:44:55.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.698+0000 7f6fccb6c640 1 -- 172.21.15.80:0/1369049714 wait complete. 2024-04-25T15:44:55.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:44:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.818+0000 7f6c51182640 1 Processor -- start 2024-04-25T15:44:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.818+0000 7f6c51182640 1 -- start start 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c51182640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 0x7f6c4c09b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c51182640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c4c0cfcd0 0x7f6c4c0d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c51182640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4c06e990 con 0x7f6c4c0d2d00 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c51182640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4c0d0610 con 0x7f6c4c0cfcd0 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c51182640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d3110 con 0x7f6c4c15d310 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c4b59e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c4c0d2d00 0x7f6c4c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39620/0 (socket says 172.21.15.80:39620) 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c4b59e640 1 -- 172.21.15.80:0/1658743791 learned_addr learned my addr 172.21.15.80:0/1658743791 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808569745 0 0) 0x7f6c4c06e990 con 0x7f6c4c0d2d00 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c38003520 con 0x7f6c4c0d2d00 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c4a59c640 1 --2- 172.21.15.80:0/1658743791 >> v2:172.21.15.195:3300/0 conn(0x7f6c4c0cfcd0 0x7f6c4c0d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c4ad9d640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 0x7f6c4c09b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.819+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1760595940 0 0) 0x7f6c38003520 con 0x7f6c4c0d2d00 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 msgr2=0x7f6c4c09b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 0x7f6c4c09b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 >> v2:172.21.15.195:3300/0 conn(0x7f6c4c0cfcd0 msgr2=0x7f6c4c0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 --2- 172.21.15.80:0/1658743791 >> v2:172.21.15.195:3300/0 conn(0x7f6c4c0cfcd0 0x7f6c4c0d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c06ec00 con 0x7f6c4c0d2d00 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f6c440019f0 con 0x7f6c4c0d2d00 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 >> v1:172.21.15.80:6789/0 conn(0x7f6c4c0d2d00 legacy=0x7f6c4c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 0x7f6c380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38003f30 0x7f6c38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c38004d40 0x7f6c38005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d0610 con 0x7f6c38004d40 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d3110 con 0x7f6c38003f30 2024-04-25T15:44:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3800ba10 con 0x7f6c4c15d310 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4b59e640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c38004d40 0x7f6c38005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4ad9d640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 0x7f6c380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4a59c640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38003f30 0x7f6c38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4b59e640 1 -- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 msgr2=0x7f6c380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4b59e640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c15d310 0x7f6c380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4b59e640 1 -- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38003f30 msgr2=0x7f6c38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4b59e640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38003f30 0x7f6c38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.820+0000 7f6c4b59e640 1 -- 172.21.15.80:0/1658743791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38003520 con 0x7f6c38004d40 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.821+0000 7f6c4b59e640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c38004d40 0x7f6c38005150 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c44002230 tx=0x7f6c38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98936cb50b40735e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.821+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400a4e0 con 0x7f6c38004d40 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.821+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4402f070 con 0x7f6c38004d40 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.821+0000 7f6c49d9b640 1 -- 172.21.15.80:0/1658743791 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4402bc50 con 0x7f6c38004d40 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c51182640 1 -- 172.21.15.80:0/1658743791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c38004d40 msgr2=0x7f6c38005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c51182640 1 --2- 172.21.15.80:0/1658743791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c38004d40 0x7f6c38005150 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c44002230 tx=0x7f6c38005830 comp rx=0 tx=0).stop 2024-04-25T15:44:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c4b59e640 1 -- 172.21.15.80:0/1658743791 reap_dead start 2024-04-25T15:44:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c51182640 1 -- 172.21.15.80:0/1658743791 shutdown_connections 2024-04-25T15:44:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c51182640 1 -- 172.21.15.80:0/1658743791 >> 172.21.15.80:0/1658743791 conn(0x7f6c4c0b7750 msgr2=0x7f6c4c0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c51182640 1 -- 172.21.15.80:0/1658743791 shutdown_connections 2024-04-25T15:44:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.822+0000 7f6c51182640 1 -- 172.21.15.80:0/1658743791 wait complete. 2024-04-25T15:44:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.824+0000 7f6c51182640 1 Processor -- start 2024-04-25T15:44:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.824+0000 7f6c51182640 1 -- start start 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c51182640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38004d40 0x7f6c4c160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c51182640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 0x7f6c4c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c51182640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c14a2c0 0x7f6c4c14adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c51182640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d0260 con 0x7f6c4c149970 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c51182640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d00e0 con 0x7f6c38004d40 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c51182640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d1d90 con 0x7f6c4c14a2c0 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 0x7f6c4c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 0x7f6c4c149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34432/0 (socket says 172.21.15.80:34432) 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4a59c640 1 -- 172.21.15.80:0/2674087426 learned_addr learned my addr 172.21.15.80:0/2674087426 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4a59c640 1 -- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c14a2c0 msgr2=0x7f6c4c14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4a59c640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c14a2c0 0x7f6c4c14adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4ad9d640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38004d40 0x7f6c4c160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.825+0000 7f6c4a59c640 1 -- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38004d40 msgr2=0x7f6c4c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c4a59c640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38004d40 0x7f6c4c160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c4a59c640 1 -- 172.21.15.80:0/2674087426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c0cc1a0 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c4ad9d640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38004d40 0x7f6c4c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c4a59c640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 0x7f6c4c149d80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c074050 tx=0x7f6c34011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34019070 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34004240 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c148e90 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400f7f0 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.826+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c149450 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.827+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c0cbef0 con 0x7f6c4c149970 2024-04-25T15:44:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.828+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6c3401c070 con 0x7f6c4c149970 2024-04-25T15:44:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.828+0000 7f6c437fe640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6c2c0744b0 0x7f6c2c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.828+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6c340956a0 con 0x7f6c4c149970 2024-04-25T15:44:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.828+0000 7f6c4ad9d640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6c2c0744b0 0x7f6c2c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.829+0000 7f6c4ad9d640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6c2c0744b0 0x7f6c2c0769c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009ab0 tx=0x7f6c3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:55.833+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c3405fd30 con 0x7f6c4c149970 2024-04-25T15:44:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.047+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c4c06a100 con 0x7f6c4c149970 2024-04-25T15:44:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.048+0000 7f6c437fe640 1 -- 172.21.15.80:0/2674087426 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5187 (secure 0 0 0) 0x7f6c3405f630 con 0x7f6c4c149970 2024-04-25T15:44:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:56.049 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:50.296421+0000","modified":"2024-04-25T15:44:53.303749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5886":{"gid":5886,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3351222677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3351222677},{"type":"v1","addr":"172.21.15.80:6837","nonce":3351222677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5886,"qdb_cluster":[5886]},"id":3}]} 2024-04-25T15:44:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.049+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6c2c0744b0 msgr2=0x7f6c2c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.049+0000 7f6c51182640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6c2c0744b0 0x7f6c2c0769c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009ab0 tx=0x7f6c3c008040 comp rx=0 tx=0).stop 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.049+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 msgr2=0x7f6c4c149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.049+0000 7f6c51182640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 0x7f6c4c149d80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c074050 tx=0x7f6c34011d40 comp rx=0 tx=0).stop 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 shutdown_connections 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6c2c0744b0 0x7f6c2c0769c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c4c14a2c0 0x7f6c4c14adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c4c149970 0x7f6c4c149d80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 --2- 172.21.15.80:0/2674087426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c38004d40 0x7f6c4c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 >> 172.21.15.80:0/2674087426 conn(0x7f6c4c0b7750 msgr2=0x7f6c4c15c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 shutdown_connections 2024-04-25T15:44:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.050+0000 7f6c51182640 1 -- 172.21.15.80:0/2674087426 wait complete. 2024-04-25T15:44:56.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:44:50.296421+0000', 'modified': '2024-04-25T15:44:53.303749+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5886}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5886': {'gid': 5886, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/3351222677', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 3351222677}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 3351222677}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5886, 'qdb_cluster': [5886]} 2024-04-25T15:44:56.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:44:56.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:44:56.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.574+0000 7faa9e7b2640 1 Processor -- start 2024-04-25T15:44:56.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.574+0000 7faa9e7b2640 1 -- start start 2024-04-25T15:44:56.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9e7b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa980d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9e7b2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 0x7faa980d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9e7b2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa980b2f30 con 0x7faa980b4b60 2024-04-25T15:44:56.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9e7b2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7faa9806eb60 con 0x7faa980d2480 2024-04-25T15:44:56.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9e7b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa980b2c90 con 0x7faa980b91c0 2024-04-25T15:44:56.577 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-25T15:44:56.576+0000 7f3b61fdf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:44:56.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9cd4f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 0x7faa980d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9cd4f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 0x7faa980d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:41782/0 (socket says 172.21.15.80:41782) 2024-04-25T15:44:56.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa97fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7faa980b4b60 0x7faa9806d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:56038/0 (socket says 172.21.15.80:56038) 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3253683273 learned_addr learned my addr 172.21.15.80:0/3253683273 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa977fe640 1 --2- 172.21.15.80:0/3253683273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa980d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa977fe640 1 -- 172.21.15.80:0/3253683273 >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 msgr2=0x7faa980d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.576+0000 7faa977fe640 1 --2- 172.21.15.80:0/3253683273 >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 0x7faa980d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa977fe640 1 -- 172.21.15.80:0/3253683273 >> v1:172.21.15.195:6789/0 conn(0x7faa980b4b60 legacy=0x7faa9806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa977fe640 1 -- 172.21.15.80:0/3253683273 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa980d10a0 con 0x7faa980b91c0 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa96ffd640 1 -- 172.21.15.80:0/3253683273 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500344092 0 0) 0x7faa980b2f30 con 0x7faa980b4b60 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3253683273 >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 0x7faa980d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa977fe640 1 --2- 172.21.15.80:0/3253683273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa980d1f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0097a0 tx=0x7faa8c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452d7520421488ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa96ffd640 1 -- 172.21.15.80:0/3253683273 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c037070 con 0x7faa980b91c0 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa96ffd640 1 -- 172.21.15.80:0/3253683273 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c02ae50 con 0x7faa980b91c0 2024-04-25T15:44:56.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.577+0000 7faa96ffd640 1 -- 172.21.15.80:0/3253683273 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c032660 con 0x7faa980b91c0 2024-04-25T15:44:56.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3253683273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 msgr2=0x7faa980d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3253683273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa980d1f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0097a0 tx=0x7faa8c02a100 comp rx=0 tx=0).stop 2024-04-25T15:44:56.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3253683273 shutdown_connections 2024-04-25T15:44:56.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3253683273 >> v2:172.21.15.195:3300/0 conn(0x7faa980d2480 0x7faa980d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3253683273 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa980d1f40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3253683273 >> 172.21.15.80:0/3253683273 conn(0x7faa980d0450 msgr2=0x7faa980d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3253683273 shutdown_connections 2024-04-25T15:44:56.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.578+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3253683273 wait complete. 2024-04-25T15:44:56.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.580+0000 7faa9e7b2640 1 Processor -- start 2024-04-25T15:44:56.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.580+0000 7faa9e7b2640 1 -- start start 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.581+0000 7faa9e7b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa980b4b60 0x7faa981f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.581+0000 7faa9e7b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa981e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.581+0000 7faa9e7b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 0x7faa981f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.581+0000 7faa9e7b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa9809d0e0 con 0x7faa980d2480 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.581+0000 7faa9e7b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faa9809cbe0 con 0x7faa980b4b60 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.581+0000 7faa9e7b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa9809d260 con 0x7faa980b91c0 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 0x7faa981f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 0x7faa981f9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34434/0 (socket says 172.21.15.80:34434) 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3754856671 learned_addr learned my addr 172.21.15.80:0/3754856671 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa97fff640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa980b4b60 0x7faa981f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa977fe640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa981e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 msgr2=0x7faa981e9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa981e9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa980b4b60 msgr2=0x7faa981f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa980b4b60 0x7faa981f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3754856671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa981ea700 con 0x7faa980d2480 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 0x7faa981f9cd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7faa90009e70 tx=0x7faa9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa94ff9640 1 -- 172.21.15.80:0/3754856671 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9000cb80 con 0x7faa980d2480 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa94ff9640 1 -- 172.21.15.80:0/3754856671 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9000cd20 con 0x7faa980d2480 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa981ea9e0 con 0x7faa980d2480 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa94ff9640 1 -- 172.21.15.80:0/3754856671 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90003bb0 con 0x7faa980d2480 2024-04-25T15:44:56.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.582+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa981eafa0 con 0x7faa980d2480 2024-04-25T15:44:56.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.584+0000 7faa94ff9640 1 -- 172.21.15.80:0/3754856671 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faa9001b030 con 0x7faa980d2480 2024-04-25T15:44:56.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.584+0000 7faa94ff9640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa840744b0 0x7faa840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.585+0000 7faa94ff9640 1 -- 172.21.15.80:0/3754856671 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7faa90095770 con 0x7faa980d2480 2024-04-25T15:44:56.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.585+0000 7faa97fff640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa840744b0 0x7faa840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.585+0000 7faa97fff640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa840744b0 0x7faa840769c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa88000fb0 tx=0x7faa88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.586+0000 7faaa5667740 1 Processor -- start 2024-04-25T15:44:56.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.586+0000 7faaa5667740 1 -- start start 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ece270 0x564e3829a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ea53b0 0x564e38296fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faaa5667740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e38270260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faaa5667740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564e381d4740 con 0x564e37ead590 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x564e381703a0 con 0x564e37ea53b0 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564e381d0700 con 0x564e37ece270 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e38270260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e38270260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34446/0 (socket says 172.21.15.80:34446) 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4222880802 learned_addr learned my addr 172.21.15.80:0/4222880802 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ece270 msgr2=0x564e3829a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa97fff640 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ece270 0x564e3829a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa977fe640 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ea53b0 0x564e38296fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ece270 0x564e3829a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ea53b0 msgr2=0x564e38296fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ea53b0 0x564e38296fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4222880802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e3818c750 con 0x564e37ead590 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.587+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e38270260 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faa9005bc70 tx=0x7faa9005be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7204e6657b3543 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faa7dffb640 1 -- 172.21.15.80:0/4222880802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9005f680 con 0x564e37ead590 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faa7dffb640 1 -- 172.21.15.80:0/4222880802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90063a30 con 0x564e37ead590 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faa7dffb640 1 -- 172.21.15.80:0/4222880802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90064dc0 con 0x564e37ead590 2024-04-25T15:44:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 -- 172.21.15.80:0/4222880802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 msgr2=0x564e38270260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e38270260 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faa9005bc70 tx=0x7faa9005be00 comp rx=0 tx=0).stop 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 -- 172.21.15.80:0/4222880802 shutdown_connections 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e38270260 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ea53b0 0x564e38296fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 --2- 172.21.15.80:0/4222880802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ece270 0x564e3829a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 -- 172.21.15.80:0/4222880802 >> 172.21.15.80:0/4222880802 conn(0x564e37ec23c0 msgr2=0x564e3826f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 -- 172.21.15.80:0/4222880802 shutdown_connections 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.588+0000 7faaa5667740 1 -- 172.21.15.80:0/4222880802 wait complete. 2024-04-25T15:44:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.589+0000 7faaa5667740 1 -- start start 2024-04-25T15:44:56.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.589+0000 7faaa5667740 1 Processor -- start 2024-04-25T15:44:56.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e382b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 0x564e382b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564e3815bfe0 con 0x564e37ece270 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x564e382c4bf0 con 0x564e37ead590 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564e382b5ca0 con 0x564e37ea53b0 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faaa5667740 10 client.0 _ll_register_callbacks cb 0x564e38172150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 0x564e382b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 0x564e382b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34454/0 (socket says 172.21.15.80:34454) 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4170383088 learned_addr learned my addr 172.21.15.80:0/4170383088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa97fff640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e382b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa977fe640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 msgr2=0x564e382b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e382b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 msgr2=0x564e382c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 -- 172.21.15.80:0/4170383088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e37ee62d0 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa977fe640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 0x564e382b3d30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faa90093a80 tx=0x7faa90011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868361af9cf960c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.591+0000 7faa76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa76ffd640 1 -- 172.21.15.80:0/4170383088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90068450 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa76ffd640 1 -- 172.21.15.80:0/4170383088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7faa9007f290 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa90063a30 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa76ffd640 1 -- 172.21.15.80:0/4170383088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faa900092e0 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 10 client.6018 fetch_fsmap learned FSMap version 22 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x564e37fb06b0 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa76ffd640 1 -- 172.21.15.80:0/4170383088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90063a30 con 0x564e37ece270 2024-04-25T15:44:56.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa76ffd640 1 -- 172.21.15.80:0/4170383088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7faa9005aff0 con 0x564e37ece270 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 10 client.6018 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 10 client.6018 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 20 client.6018 populate_metadata read hostname 'smithi080' 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e8ce40 0x564e3829bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 4 client.6018 mds_command: new command op to 5886 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 --> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e381e2350 con 0x564e37e8ce40 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa97fff640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e8ce40 0x564e3829bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.592+0000 7faa76ffd640 10 client.6018 ms_handle_connect on v2:172.21.15.80:6836/3351222677 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faa97fff640 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e8ce40 0x564e3829bc60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aabbb69569732 server_cookie=cdffaff662f7648c in_seq=0 out_seq=0 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faa76ffd640 1 -- 172.21.15.80:0/4170383088 <== mds.0 v2:172.21.15.80:6836/3351222677 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564e381e2350 con 0x564e37e8ce40 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faa76ffd640 10 client.6018 handle_command_reply: tid=0 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 client.6018 shutdown 2024-04-25T15:44:56.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 msgr2=0x564e382b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 0x564e382b3d30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faa90093a80 tx=0x7faa90011000 comp rx=0 tx=0).stop 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 shutdown_connections 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e8ce40 0x564e3829bc60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ece270 0x564e382b3d30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faa76ffd640 0 client.6018 ms_handle_reset on v2:172.21.15.80:6836/3351222677 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 --2- 172.21.15.80:0/4170383088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e382b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.593+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 >> 172.21.15.80:0/4170383088 conn(0x564e37ec23c0 msgr2=0x564e3826f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.594+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 shutdown_connections 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.594+0000 7faaa5667740 1 -- 172.21.15.80:0/4170383088 wait complete. 2024-04-25T15:44:56.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.594+0000 7faaa5667740 20 client.6018 trim_cache size 0 max 16384 2024-04-25T15:44:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.612+0000 7faaa5667740 1 Processor -- start 2024-04-25T15:44:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.612+0000 7faaa5667740 1 -- start start 2024-04-25T15:44:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.613+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37e8ce40 0x564e382934d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.613+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e38297d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.613+0000 7faaa5667740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e382b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.613+0000 7faaa5667740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa982021c0 con 0x564e37ead590 2024-04-25T15:44:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.613+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faa981f8cf0 con 0x564e37e8ce40 2024-04-25T15:44:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.613+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa981f6fa0 con 0x564e37ea53b0 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e382b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e382b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34462/0 (socket says 172.21.15.80:34462) 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3330484676 learned_addr learned my addr 172.21.15.80:0/3330484676 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa97fff640 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37e8ce40 0x564e382934d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa977fe640 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e38297d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 msgr2=0x564e38297d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e38297d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37e8ce40 msgr2=0x564e382934d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37e8ce40 0x564e382934d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 -- 172.21.15.80:0/3330484676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e3826bc90 con 0x564e37ead590 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa97fff640 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37e8ce40 0x564e382934d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e382b2c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7faa90093b60 tx=0x7faa9007d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337cb348b1caa491 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa7d7fa640 1 -- 172.21.15.80:0/3330484676 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90063a30 con 0x564e37ead590 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa7d7fa640 1 -- 172.21.15.80:0/3330484676 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90068450 con 0x564e37ead590 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.614+0000 7faa7d7fa640 1 -- 172.21.15.80:0/3330484676 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9005f680 con 0x564e37ead590 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 -- 172.21.15.80:0/3330484676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 msgr2=0x564e382b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e382b2c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7faa90093b60 tx=0x7faa9007d000 comp rx=0 tx=0).stop 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 -- 172.21.15.80:0/3330484676 shutdown_connections 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ead590 0x564e382b2c00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37ea53b0 0x564e38297d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 --2- 172.21.15.80:0/3330484676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37e8ce40 0x564e382934d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 -- 172.21.15.80:0/3330484676 >> 172.21.15.80:0/3330484676 conn(0x564e37ec23c0 msgr2=0x564e38269300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 -- 172.21.15.80:0/3330484676 shutdown_connections 2024-04-25T15:44:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.615+0000 7faaa5667740 1 -- 172.21.15.80:0/3330484676 wait complete. 2024-04-25T15:44:56.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.616+0000 7faaa5667740 1 -- start start 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.616+0000 7faaa5667740 1 Processor -- start 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37e8ce40 0x564e38330d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 0x564e382ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382ac540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564e3829dbc0 con 0x564e37ea53b0 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x564e3829d810 con 0x564e37ead590 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564e3829e1b0 con 0x564e37e8ce40 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faaa5667740 10 client.0 _ll_register_callbacks cb 0x7faa9005f4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faa977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 0x564e382ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faa977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 0x564e382ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34466/0 (socket says 172.21.15.80:34466) 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.617+0000 7faa977fe640 1 -- 172.21.15.80:0/2878746962 learned_addr learned my addr 172.21.15.80:0/2878746962 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa9cd4f640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa97fff640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37e8ce40 0x564e38330d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa977fe640 1 -- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37e8ce40 msgr2=0x564e38330d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa977fe640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37e8ce40 0x564e38330d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa977fe640 1 -- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 msgr2=0x564e382ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa977fe640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa977fe640 1 -- 172.21.15.80:0/2878746962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e383317f0 con 0x564e37ea53b0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa97fff640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37e8ce40 0x564e38330d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa977fe640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 0x564e382ac000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0097a0 tx=0x7faa8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de98bd2280f2c84a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa76ffd640 1 -- 172.21.15.80:0/2878746962 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c043030 con 0x564e37ea53b0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa76ffd640 1 -- 172.21.15.80:0/2878746962 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7faa8c003820 con 0x564e37ea53b0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa90068450 con 0x564e37ea53b0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa76ffd640 1 -- 172.21.15.80:0/2878746962 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faa8c037040 con 0x564e37ea53b0 2024-04-25T15:44:56.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faaa5667740 10 client.6024 fetch_fsmap learned FSMap version 22 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x564e38332090 con 0x564e37ea53b0 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa76ffd640 1 -- 172.21.15.80:0/2878746962 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90068450 con 0x564e37ea53b0 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.618+0000 7faa76ffd640 1 -- 172.21.15.80:0/2878746962 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 3494+0+0 (secure 0 0 0) 0x7faa8c03d040 con 0x564e37ea53b0 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 10 client.6024 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 10 client.6024 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 20 client.6024 populate_metadata read hostname 'smithi080' 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e62280 0x564e38292280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 4 client.6024 mds_command: new command op to 5886 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 --> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] -- command(tid 0: {"prefix": "status"}) -- 0x564e382b5310 con 0x564e37e62280 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faa97fff640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e62280 0x564e38292280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faa76ffd640 10 client.6024 ms_handle_connect on v2:172.21.15.80:6836/3351222677 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faa97fff640 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e62280 0x564e38292280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c2bcc25ae28122 server_cookie=206903e69b5ab8ac in_seq=0 out_seq=0 2024-04-25T15:44:56.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faa76ffd640 1 -- 172.21.15.80:0/2878746962 <== mds.0 v2:172.21.15.80:6836/3351222677 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564e382b5310 con 0x564e37e62280 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faa76ffd640 10 client.6024 handle_command_reply: tid=0 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 1 client.6024 shutdown 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 msgr2=0x564e382ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 0x564e382ac000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0097a0 tx=0x7faa8c004730 comp rx=0 tx=0).stop 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.619+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 shutdown_connections 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:6836/3351222677,v1:172.21.15.80:6837/3351222677] conn(0x564e37e62280 0x564e38292280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e37ead590 0x564e382ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564e37ea53b0 0x564e382ac000 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 --2- 172.21.15.80:0/2878746962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564e37e8ce40 0x564e38330d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa76ffd640 0 client.6024 ms_handle_reset on v2:172.21.15.80:6836/3351222677 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 >> 172.21.15.80:0/2878746962 conn(0x564e37ec23c0 msgr2=0x564e382b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 shutdown_connections 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 1 -- 172.21.15.80:0/2878746962 wait complete. 2024-04-25T15:44:56.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faaa5667740 20 client.6024 trim_cache size 0 max 16384 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 5886, 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 5.7012553920000002, 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 22, 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 51, 2024-04-25T15:44:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 51, 2024-04-25T15:44:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 11.034150603000001 2024-04-25T15:44:56.629 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:44:56.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa840744b0 msgr2=0x7faa840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa840744b0 0x7faa840769c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa88000fb0 tx=0x7faa88009040 comp rx=0 tx=0).stop 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 msgr2=0x7faa981f9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 0x7faa981f9cd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7faa90009e70 tx=0x7faa9000c490 comp rx=0 tx=0).stop 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 shutdown_connections 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa840744b0 0x7faa840769c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa980d2480 0x7faa981f9cd0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa980b91c0 0x7faa981e9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 --2- 172.21.15.80:0/3754856671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa980b4b60 0x7faa981f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 >> 172.21.15.80:0/3754856671 conn(0x7faa980d0450 msgr2=0x7faa98071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 shutdown_connections 2024-04-25T15:44:56.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.620+0000 7faa9e7b2640 1 -- 172.21.15.80:0/3754856671 wait complete. 2024-04-25T15:44:56.632 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:44:56.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.739+0000 7f3539a13640 1 Processor -- start 2024-04-25T15:44:56.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.739+0000 7f3539a13640 1 -- start start 2024-04-25T15:44:56.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f3539a13640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f35340d41b0 0x7f35340b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f3539a13640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35341602a0 0x7f35340b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f3539a13640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35340b7fa0 con 0x7f35340b7b90 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f3539a13640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f35340d59d0 con 0x7f35341602a0 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f3539a13640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3534163fb0 con 0x7f35340d41b0 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f35327fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35341602a0 0x7f35340b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f35327fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35341602a0 0x7f35340b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34476/0 (socket says 172.21.15.80:34476) 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.740+0000 7f35327fc640 1 -- 172.21.15.80:0/2449762641 learned_addr learned my addr 172.21.15.80:0/2449762641 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f3532ffd640 1 --2- 172.21.15.80:0/2449762641 >> v2:172.21.15.195:3300/0 conn(0x7f35340d41b0 0x7f35340b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f35327fc640 1 -- 172.21.15.80:0/2449762641 >> v2:172.21.15.195:3300/0 conn(0x7f35340d41b0 msgr2=0x7f35340b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f35327fc640 1 --2- 172.21.15.80:0/2449762641 >> v2:172.21.15.195:3300/0 conn(0x7f35340d41b0 0x7f35340b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f35327fc640 1 -- 172.21.15.80:0/2449762641 >> v1:172.21.15.195:6789/0 conn(0x7f35340b7b90 legacy=0x7f35340d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f35327fc640 1 -- 172.21.15.80:0/2449762641 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3534164270 con 0x7f35341602a0 2024-04-25T15:44:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f35327fc640 1 --2- 172.21.15.80:0/2449762641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35341602a0 0x7f35340b7650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f353408eaf0 tx=0x7f352802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3aa5db81d600c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.741+0000 7f3531ffb640 1 -- 172.21.15.80:0/2449762641 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528037070 con 0x7f35341602a0 2024-04-25T15:44:56.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3531ffb640 1 -- 172.21.15.80:0/2449762641 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3528032440 con 0x7f35341602a0 2024-04-25T15:44:56.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3531ffb640 1 -- 172.21.15.80:0/2449762641 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528032810 con 0x7f35341602a0 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 -- 172.21.15.80:0/2449762641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35341602a0 msgr2=0x7f35340b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 --2- 172.21.15.80:0/2449762641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35341602a0 0x7f35340b7650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f353408eaf0 tx=0x7f352802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 -- 172.21.15.80:0/2449762641 shutdown_connections 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 --2- 172.21.15.80:0/2449762641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35341602a0 0x7f35340b7650 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 --2- 172.21.15.80:0/2449762641 >> v2:172.21.15.195:3300/0 conn(0x7f35340d41b0 0x7f35340b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 -- 172.21.15.80:0/2449762641 >> 172.21.15.80:0/2449762641 conn(0x7f353406e9f0 msgr2=0x7f35340d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 -- 172.21.15.80:0/2449762641 shutdown_connections 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.742+0000 7f3539a13640 1 -- 172.21.15.80:0/2449762641 wait complete. 2024-04-25T15:44:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.744+0000 7f3539a13640 1 Processor -- start 2024-04-25T15:44:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.744+0000 7f3539a13640 1 -- start start 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.745+0000 7f3539a13640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35340b7b90 0x7f35340ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.745+0000 7f3539a13640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 0x7f353414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.745+0000 7f3539a13640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35341602a0 0x7f35340cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.745+0000 7f3539a13640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3534164b10 con 0x7f35340d41b0 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.745+0000 7f3539a13640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3534164830 con 0x7f35341602a0 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.745+0000 7f3539a13640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f35340b4fd0 con 0x7f35340b7b90 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 0x7f353414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 0x7f353414d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34484/0 (socket says 172.21.15.80:34484) 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 -- 172.21.15.80:0/2979299739 learned_addr learned my addr 172.21.15.80:0/2979299739 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:56.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35337fe640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35341602a0 0x7f35340cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f3532ffd640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35340b7b90 0x7f35340ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 -- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35340b7b90 msgr2=0x7f35340ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35340b7b90 0x7f35340ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 -- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35341602a0 msgr2=0x7f35340cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35341602a0 0x7f35340cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 -- 172.21.15.80:0/2979299739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3534160c70 con 0x7f35340d41b0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f35327fc640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 0x7f353414d050 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f352802a220 tx=0x7f35280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528041020 con 0x7f35340d41b0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35280306c0 con 0x7f35340d41b0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3534160f50 con 0x7f35340d41b0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528037040 con 0x7f35340d41b0 2024-04-25T15:44:56.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.746+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3534161510 con 0x7f35340d41b0 2024-04-25T15:44:56.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.747+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353406a100 con 0x7f35340d41b0 2024-04-25T15:44:56.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.748+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3528044020 con 0x7f35340d41b0 2024-04-25T15:44:56.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.748+0000 7f351bfff640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f35200744b0 0x7f35200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:56.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.748+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f35280b5b00 con 0x7f35340d41b0 2024-04-25T15:44:56.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.748+0000 7f3532ffd640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f35200744b0 0x7f35200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:56.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.749+0000 7f3532ffd640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f35200744b0 0x7f35200769c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35240079a0 tx=0x7f3524008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:56.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.753+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f352804b030 con 0x7f35340d41b0 2024-04-25T15:44:56.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.964+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35340d3070 con 0x7f35340d41b0 2024-04-25T15:44:56.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.965+0000 7f351bfff640 1 -- 172.21.15.80:0/2979299739 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f3528088180 con 0x7f35340d41b0 2024-04-25T15:44:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:44:56.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f35200744b0 msgr2=0x7f35200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f35200744b0 0x7f35200769c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35240079a0 tx=0x7f3524008040 comp rx=0 tx=0).stop 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 msgr2=0x7f353414d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 0x7f353414d050 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f352802a220 tx=0x7f35280046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 shutdown_connections 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f35200744b0 0x7f35200769c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35341602a0 0x7f35340cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35340d41b0 0x7f353414d050 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 --2- 172.21.15.80:0/2979299739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35340b7b90 0x7f35340ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 >> 172.21.15.80:0/2979299739 conn(0x7f353406e9f0 msgr2=0x7f35340babb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 shutdown_connections 2024-04-25T15:44:56.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:56.967+0000 7f3539a13640 1 -- 172.21.15.80:0/2979299739 wait complete. 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:44:56.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:44:56.980 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:56.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:56.980 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:44:56.995 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:44:56.995 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:44:56.995 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:56.996 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42660sec preferred_lft 42660sec 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:44:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.998 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:56.998 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:44:56.998 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:44:56.998 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:56.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:56.998 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:44:57.058 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:44:57.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:57.059 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:44:57.115 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:44:57.115 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:44:57.115 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:44:57.115 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:44:57.115 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:44:57.116 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:44:57.116 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:44:57.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:44:57.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:44:57.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:44:57.116 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:44:57.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:44:57.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:57.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:57.238 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:44:57.253 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:44:57.253 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:44:57.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:57.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:57.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:44:57.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:57.316 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:57.371 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:44:57.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:57.372 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:57.426 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:44:57.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:57.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:57.518 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:57.519 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:44:57.526 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:44:57.527 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:44:57.527 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:44:57.527 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:44:57.528 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:44:57.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:57.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:44:57.551 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:44:57.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:44:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:57.651 INFO:teuthology.orchestra.run.smithi080.stdout:client6033 2024-04-25T15:44:57.652 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:57.652 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:57.667 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:44:57.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.813+0000 7f5e5f2e0640 1 Processor -- start 2024-04-25T15:44:57.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.813+0000 7f5e5f2e0640 1 -- start start 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.814+0000 7f5e5f2e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e58153f70 0x7f5e580b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.814+0000 7f5e5f2e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e580b0c00 0x7f5e5806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.814+0000 7f5e5f2e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5806df20 con 0x7f5e5806db10 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.814+0000 7f5e5f2e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5e580b1180 con 0x7f5e58153f70 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.814+0000 7f5e5f2e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5815d4f0 con 0x7f5e580b0c00 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.814+0000 7f5e5d07c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e58153f70 0x7f5e580b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5d07c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e58153f70 0x7f5e580b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34490/0 (socket says 172.21.15.80:34490) 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5d07c640 1 -- 172.21.15.80:0/2461466559 learned_addr learned my addr 172.21.15.80:0/2461466559 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5c87b640 1 --2- 172.21.15.80:0/2461466559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e580b0c00 0x7f5e5806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5d07c640 1 -- 172.21.15.80:0/2461466559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e580b0c00 msgr2=0x7f5e5806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5d07c640 1 --2- 172.21.15.80:0/2461466559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e580b0c00 0x7f5e5806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:57.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5d07c640 1 -- 172.21.15.80:0/2461466559 >> v1:172.21.15.195:6789/0 conn(0x7f5e5806db10 legacy=0x7f5e58160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:57.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.815+0000 7f5e5d07c640 1 -- 172.21.15.80:0/2461466559 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5815e270 con 0x7f5e58153f70 2024-04-25T15:44:57.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5d07c640 1 --2- 172.21.15.80:0/2461466559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e580b06c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009870 tx=0x7f5e5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85899df1859c90d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:57.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e4ffff640 1 -- 172.21.15.80:0/2461466559 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54037070 con 0x7f5e58153f70 2024-04-25T15:44:57.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e4ffff640 1 -- 172.21.15.80:0/2461466559 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e54032440 con 0x7f5e58153f70 2024-04-25T15:44:57.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e4ffff640 1 -- 172.21.15.80:0/2461466559 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032810 con 0x7f5e58153f70 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/2461466559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 msgr2=0x7f5e580b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/2461466559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e580b06c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009870 tx=0x7f5e5402a270 comp rx=0 tx=0).stop 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/2461466559 shutdown_connections 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/2461466559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e580b0c00 0x7f5e5806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/2461466559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e580b06c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.816+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/2461466559 >> 172.21.15.80:0/2461466559 conn(0x7f5e580d1e20 msgr2=0x7f5e58073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:57.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.817+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/2461466559 shutdown_connections 2024-04-25T15:44:57.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.817+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/2461466559 wait complete. 2024-04-25T15:44:57.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.818+0000 7f5e5f2e0640 1 Processor -- start 2024-04-25T15:44:57.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.818+0000 7f5e5f2e0640 1 -- start start 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e5806db10 0x7f5e58148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e580b0c00 0x7f5e5814a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e58169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5e580b5710 con 0x7f5e58153f70 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5815da70 con 0x7f5e580b0c00 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5e580aefe0 con 0x7f5e5806db10 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e58169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e58169f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34500/0 (socket says 172.21.15.80:34500) 2024-04-25T15:44:57.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 -- 172.21.15.80:0/1781212164 learned_addr learned my addr 172.21.15.80:0/1781212164 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d07c640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e5806db10 0x7f5e58148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5c87b640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e580b0c00 0x7f5e5814a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 -- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e5806db10 msgr2=0x7f5e58148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e5806db10 0x7f5e58148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 -- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e580b0c00 msgr2=0x7f5e5814a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e580b0c00 0x7f5e5814a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 -- 172.21.15.80:0/1781212164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e58168ef0 con 0x7f5e58153f70 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5c87b640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e580b0c00 0x7f5e5814a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5d87d640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e58169f90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c6e0 tx=0x7f5e5000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50003b70 con 0x7f5e58153f70 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e50003d30 con 0x7f5e58153f70 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50005310 con 0x7f5e58153f70 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.820+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e581691d0 con 0x7f5e58153f70 2024-04-25T15:44:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.821+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e58169790 con 0x7f5e58153f70 2024-04-25T15:44:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.822+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5806a100 con 0x7f5e58153f70 2024-04-25T15:44:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.822+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5e500054b0 con 0x7f5e58153f70 2024-04-25T15:44:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.822+0000 7f5e4dffb640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e3c0744e0 0x7f5e3c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.823+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f5e50095230 con 0x7f5e58153f70 2024-04-25T15:44:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.823+0000 7f5e5d07c640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e3c0744e0 0x7f5e3c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.823+0000 7f5e5d07c640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e3c0744e0 0x7f5e3c0769f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e54034000 tx=0x7f5e5402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:57.827+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e5806df20 con 0x7f5e58153f70 2024-04-25T15:44:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.046+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5e58070570 con 0x7f5e58153f70 2024-04-25T15:44:58.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.046+0000 7f5e4dffb640 1 -- 172.21.15.80:0/1781212164 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f5e5005f830 con 0x7f5e58153f70 2024-04-25T15:44:58.048 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e3c0744e0 msgr2=0x7f5e3c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e3c0744e0 0x7f5e3c0769f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e54034000 tx=0x7f5e5402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 msgr2=0x7f5e58169f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e58169f90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c6e0 tx=0x7f5e5000cba0 comp rx=0 tx=0).stop 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 shutdown_connections 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5e3c0744e0 0x7f5e3c0769f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:58.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e58153f70 0x7f5e58169f90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:58.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e580b0c00 0x7f5e5814a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:58.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 --2- 172.21.15.80:0/1781212164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e5806db10 0x7f5e58148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:58.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 >> 172.21.15.80:0/1781212164 conn(0x7f5e580d1e20 msgr2=0x7f5e581608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:58.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 shutdown_connections 2024-04-25T15:44:58.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:58.049+0000 7f5e5f2e0640 1 -- 172.21.15.80:0/1781212164 wait complete. 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:44:58.061 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:44:58.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.062 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:44:58.080 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42637sec preferred_lft 42637sec 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:44:58.081 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:44:58.082 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:44:58.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.083 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:44:58.146 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:44:58.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.147 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:44:58.206 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:44:58.206 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:44:58.206 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:44:58.206 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:44:58.206 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:44:58.207 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:44:58.207 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:44:58.207 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:44:58.207 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:44:58.207 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:44:58.207 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:44:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:44:58.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:58.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.336 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:44:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:44:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:44:58.351 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:44:58.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.351 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:44:58.414 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:58.414 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:58.469 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:44:58.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:44:58.470 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:58.524 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:44:58.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.524 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:58.616 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:58.616 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:58.627 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:44:58.628 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:44:58.628 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:44:58.628 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:44:58.628 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:44:58.629 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:44:58.629 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:44:58.629 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:44:58.629 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:44:58.629 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:44:58.630 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:44:58.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:44:58.630 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:44:58.653 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:44:58.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:44:58.746 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:44:58.748 INFO:teuthology.orchestra.run.smithi195.stdout:client5198 2024-04-25T15:44:58.749 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:44:58.749 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:58.764 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:44:58.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:44:58.816 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:44:58.848 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:44:58.848 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:44:58.848 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:58.849 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:58.865 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:44:58.865 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:44:58.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:44:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.069+0000 7efc3c092640 1 Processor -- start 2024-04-25T15:44:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.069+0000 7efc3c092640 1 -- start start 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3c092640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efc340b2a40 0x7efc340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3c092640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc3409ce90 0x7efc340d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3c092640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3409d2a0 con 0x7efc340cff30 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3c092640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7efc340cfb70 con 0x7efc3409ce90 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3c092640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7efc340b9350 con 0x7efc340b2a40 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc3409ce90 0x7efc340d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc3409ce90 0x7efc340d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34504/0 (socket says 172.21.15.80:34504) 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 -- 172.21.15.80:0/4176856088 learned_addr learned my addr 172.21.15.80:0/4176856088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3962d640 1 --2- 172.21.15.80:0/4176856088 >> v2:172.21.15.195:3300/0 conn(0x7efc340b2a40 0x7efc340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 -- 172.21.15.80:0/4176856088 >> v2:172.21.15.195:3300/0 conn(0x7efc340b2a40 msgr2=0x7efc340b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 --2- 172.21.15.80:0/4176856088 >> v2:172.21.15.195:3300/0 conn(0x7efc340b2a40 0x7efc340b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 -- 172.21.15.80:0/4176856088 >> v1:172.21.15.195:6789/0 conn(0x7efc340cff30 legacy=0x7efc340d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.071+0000 7efc3a62f640 1 -- 172.21.15.80:0/4176856088 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc340cf890 con 0x7efc3409ce90 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.072+0000 7efc3a62f640 1 --2- 172.21.15.80:0/4176856088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc340d15a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efc34073e30 tx=0x7efc2c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f315c173e64c1303 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.072+0000 7efc38e2c640 1 -- 172.21.15.80:0/4176856088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c037070 con 0x7efc3409ce90 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.072+0000 7efc38e2c640 1 -- 172.21.15.80:0/4176856088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c032440 con 0x7efc3409ce90 2024-04-25T15:44:59.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.072+0000 7efc38e2c640 1 -- 172.21.15.80:0/4176856088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c032810 con 0x7efc3409ce90 2024-04-25T15:44:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 -- 172.21.15.80:0/4176856088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 msgr2=0x7efc340d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 --2- 172.21.15.80:0/4176856088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc340d15a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efc34073e30 tx=0x7efc2c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 -- 172.21.15.80:0/4176856088 shutdown_connections 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 --2- 172.21.15.80:0/4176856088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc340d15a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 --2- 172.21.15.80:0/4176856088 >> v2:172.21.15.195:3300/0 conn(0x7efc340b2a40 0x7efc340b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 -- 172.21.15.80:0/4176856088 >> 172.21.15.80:0/4176856088 conn(0x7efc340d0450 msgr2=0x7efc340d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 -- 172.21.15.80:0/4176856088 shutdown_connections 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.073+0000 7efc3c092640 1 -- 172.21.15.80:0/4176856088 wait complete. 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.075+0000 7efc3c092640 1 Processor -- start 2024-04-25T15:44:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.075+0000 7efc3c092640 1 -- start start 2024-04-25T15:44:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3c092640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc3415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3c092640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc340b2a40 0x7efc3406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3c092640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc340cff30 0x7efc3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3c092640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc340d0f70 con 0x7efc3409ce90 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3c092640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efc340b9020 con 0x7efc340b2a40 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3c092640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efc340d10f0 con 0x7efc340cff30 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc3415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc3415f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34516/0 (socket says 172.21.15.80:34516) 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 -- 172.21.15.80:0/4059573088 learned_addr learned my addr 172.21.15.80:0/4059573088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3962d640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc340b2a40 0x7efc3406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc3a62f640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc340cff30 0x7efc3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 -- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc340cff30 msgr2=0x7efc3406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc340cff30 0x7efc3406e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 -- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc340b2a40 msgr2=0x7efc3406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc340b2a40 0x7efc3406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 -- 172.21.15.80:0/4059573088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc340cca30 con 0x7efc3409ce90 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc39e2e640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc3415f9a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c6e0 tx=0x7efc3000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.076+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30016020 con 0x7efc3409ce90 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.077+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30006dc0 con 0x7efc3409ce90 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.077+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc340ccd10 con 0x7efc3409ce90 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.077+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30003c00 con 0x7efc3409ce90 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.077+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3406da30 con 0x7efc3409ce90 2024-04-25T15:44:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.078+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3406a100 con 0x7efc3409ce90 2024-04-25T15:44:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.078+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efc300050d0 con 0x7efc3409ce90 2024-04-25T15:44:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.079+0000 7efc2a7fc640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc180744e0 0x7efc180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.079+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7efc30094e90 con 0x7efc3409ce90 2024-04-25T15:44:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.079+0000 7efc3962d640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc180744e0 0x7efc180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.079+0000 7efc3962d640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc180744e0 0x7efc180769f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efc341f9e10 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.083+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc30020020 con 0x7efc3409ce90 2024-04-25T15:44:59.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.260+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc340b4aa0 con 0x7efc3409ce90 2024-04-25T15:44:59.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.262+0000 7efc2a7fc640 1 -- 172.21.15.80:0/4059573088 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16930 (secure 0 0 0) 0x7efc3409d2a0 con 0x7efc3409ce90 2024-04-25T15:44:59.263 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:44:59.263 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:51.926717+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:44:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc180744e0 msgr2=0x7efc180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc180744e0 0x7efc180769f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efc341f9e10 tx=0x7efc24008040 comp rx=0 tx=0).stop 2024-04-25T15:44:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 msgr2=0x7efc3415f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc3415f9a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c6e0 tx=0x7efc3000cba0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 shutdown_connections 2024-04-25T15:44:59.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc180744e0 0x7efc180769f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc340cff30 0x7efc3406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc340b2a40 0x7efc3406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 --2- 172.21.15.80:0/4059573088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc3409ce90 0x7efc3415f9a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 >> 172.21.15.80:0/4059573088 conn(0x7efc340d0450 msgr2=0x7efc34071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:59.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 shutdown_connections 2024-04-25T15:44:59.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.264+0000 7efc3c092640 1 -- 172.21.15.80:0/4059573088 wait complete. 2024-04-25T15:44:59.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:48.548707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:49.239267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:44:59.277 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:44:59.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.387+0000 7fcf553f8640 1 Processor -- start 2024-04-25T15:44:59.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.387+0000 7fcf553f8640 1 -- start start 2024-04-25T15:44:59.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf553f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcf500b5490 0x7fcf50160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf553f8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf500d0b00 0x7fcf500d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf553f8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf500d57e0 con 0x7fcf500d2b80 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf553f8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcf501643f0 con 0x7fcf500d0b00 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf553f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcf501646d0 con 0x7fcf500b5490 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4e7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf500d0b00 0x7fcf500d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcf500d2b80 0x7fcf500b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39628/0 (socket says 172.21.15.80:39628) 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4f7fe640 1 -- 172.21.15.80:0/409259704 learned_addr learned my addr 172.21.15.80:0/409259704 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4effd640 1 --2- 172.21.15.80:0/409259704 >> v2:172.21.15.195:3300/0 conn(0x7fcf500b5490 0x7fcf50160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/409259704 >> v2:172.21.15.195:3300/0 conn(0x7fcf500b5490 msgr2=0x7fcf50160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4e7fc640 1 --2- 172.21.15.80:0/409259704 >> v2:172.21.15.195:3300/0 conn(0x7fcf500b5490 0x7fcf50160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/409259704 >> v1:172.21.15.80:6789/0 conn(0x7fcf500d2b80 legacy=0x7fcf500b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/409259704 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf501649b0 con 0x7fcf500d0b00 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.389+0000 7fcf4dffb640 1 -- 172.21.15.80:0/409259704 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050941176 0 0) 0x7fcf500d57e0 con 0x7fcf500d2b80 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.390+0000 7fcf4e7fc640 1 --2- 172.21.15.80:0/409259704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d0b00 0x7fcf500d2640 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcf5008ed90 tx=0x7fcf4402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aefaa6eed807b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.390+0000 7fcf4dffb640 1 -- 172.21.15.80:0/409259704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037070 con 0x7fcf500d0b00 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.390+0000 7fcf4dffb640 1 -- 172.21.15.80:0/409259704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44032440 con 0x7fcf500d0b00 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.390+0000 7fcf4dffb640 1 -- 172.21.15.80:0/409259704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032810 con 0x7fcf500d0b00 2024-04-25T15:44:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 -- 172.21.15.80:0/409259704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d0b00 msgr2=0x7fcf500d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 --2- 172.21.15.80:0/409259704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d0b00 0x7fcf500d2640 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcf5008ed90 tx=0x7fcf4402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 -- 172.21.15.80:0/409259704 shutdown_connections 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 --2- 172.21.15.80:0/409259704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d0b00 0x7fcf500d2640 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 --2- 172.21.15.80:0/409259704 >> v2:172.21.15.195:3300/0 conn(0x7fcf500b5490 0x7fcf50160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 -- 172.21.15.80:0/409259704 >> 172.21.15.80:0/409259704 conn(0x7fcf5006e650 msgr2=0x7fcf5006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 -- 172.21.15.80:0/409259704 shutdown_connections 2024-04-25T15:44:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.391+0000 7fcf553f8640 1 -- 172.21.15.80:0/409259704 wait complete. 2024-04-25T15:44:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.393+0000 7fcf553f8640 1 Processor -- start 2024-04-25T15:44:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.393+0000 7fcf553f8640 1 -- start start 2024-04-25T15:44:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf553f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf500d0b00 0x7fcf5014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf553f8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 0x7fcf501f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf553f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf501f5370 0x7fcf501f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf553f8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500d2f90 con 0x7fcf500d2b80 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf553f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcf50160840 con 0x7fcf500d0b00 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf553f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf500b9360 con 0x7fcf501f5370 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 0x7fcf501f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 0x7fcf501f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34534/0 (socket says 172.21.15.80:34534) 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/3654836856 learned_addr learned my addr 172.21.15.80:0/3654836856 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4effd640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf500d0b00 0x7fcf5014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4f7fe640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf501f5370 0x7fcf501f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf501f5370 msgr2=0x7fcf501f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf501f5370 0x7fcf501f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf500d0b00 msgr2=0x7fcf5014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf500d0b00 0x7fcf5014bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 -- 172.21.15.80:0/3654836856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf501529a0 con 0x7fcf500d2b80 2024-04-25T15:44:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.394+0000 7fcf4e7fc640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 0x7fcf501f4e30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000c00 tx=0x7fcf440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.395+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037040 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.395+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44042070 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.395+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf500b73d0 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.395+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44030920 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.395+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5014c870 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.396+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5006a100 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.396+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcf44030ac0 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.397+0000 7fcf377fe640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf3c0744e0 0x7fcf3c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.397+0000 7fcf4effd640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf3c0744e0 0x7fcf3c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.397+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fcf440b5980 con 0x7fcf500d2b80 2024-04-25T15:44:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.397+0000 7fcf4effd640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf3c0744e0 0x7fcf3c0769f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcf500d08c0 tx=0x7fcf4000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.402+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf4407f9c0 con 0x7fcf500d2b80 2024-04-25T15:44:59.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.575+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf500d41d0 con 0x7fcf500d2b80 2024-04-25T15:44:59.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.575+0000 7fcf377fe640 1 -- 172.21.15.80:0/3654836856 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fcf44083cc0 con 0x7fcf500d2b80 2024-04-25T15:44:59.577 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf3c0744e0 msgr2=0x7fcf3c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf3c0744e0 0x7fcf3c0769f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcf500d08c0 tx=0x7fcf4000b040 comp rx=0 tx=0).stop 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 msgr2=0x7fcf501f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 0x7fcf501f4e30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000c00 tx=0x7fcf440046c0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 shutdown_connections 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf3c0744e0 0x7fcf3c0769f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf501f5370 0x7fcf501f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf500d2b80 0x7fcf501f4e30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 --2- 172.21.15.80:0/3654836856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf500d0b00 0x7fcf5014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 >> 172.21.15.80:0/3654836856 conn(0x7fcf5006e650 msgr2=0x7fcf500ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 shutdown_connections 2024-04-25T15:44:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.577+0000 7fcf553f8640 1 -- 172.21.15.80:0/3654836856 wait complete. 2024-04-25T15:44:59.590 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.699+0000 7faf39538640 1 Processor -- start 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.699+0000 7faf39538640 1 -- start start 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.700+0000 7faf39538640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faf340b5490 0x7faf34160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.700+0000 7faf39538640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d0b00 0x7faf340d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.700+0000 7faf39538640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf340d57e0 con 0x7faf340d2b80 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.700+0000 7faf39538640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7faf341643f0 con 0x7faf340b5490 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.700+0000 7faf39538640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf341646d0 con 0x7faf340d0b00 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.700+0000 7faf32ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faf340b5490 0x7faf34160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf337fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7faf340d2b80 0x7faf340b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:56074/0 (socket says 172.21.15.80:56074) 2024-04-25T15:44:59.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf327fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d0b00 0x7faf340d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf337fe640 1 -- 172.21.15.80:0/1406261763 learned_addr learned my addr 172.21.15.80:0/1406261763 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf32ffd640 1 -- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d0b00 msgr2=0x7faf340d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf32ffd640 1 --2- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d0b00 0x7faf340d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf32ffd640 1 -- 172.21.15.80:0/1406261763 >> v1:172.21.15.195:6789/0 conn(0x7faf340d2b80 legacy=0x7faf340b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf32ffd640 1 -- 172.21.15.80:0/1406261763 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf341649b0 con 0x7faf340b5490 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.701+0000 7faf31ffb640 1 -- 172.21.15.80:0/1406261763 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812709487 0 0) 0x7faf340d57e0 con 0x7faf340d2b80 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.702+0000 7faf32ffd640 1 --2- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340b5490 0x7faf34160300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf240097a0 tx=0x7faf2402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c455b4f41c628469 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.702+0000 7faf31ffb640 1 -- 172.21.15.80:0/1406261763 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24037070 con 0x7faf340b5490 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.702+0000 7faf31ffb640 1 -- 172.21.15.80:0/1406261763 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf24032440 con 0x7faf340b5490 2024-04-25T15:44:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.702+0000 7faf31ffb640 1 -- 172.21.15.80:0/1406261763 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24032810 con 0x7faf340b5490 2024-04-25T15:44:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 -- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340b5490 msgr2=0x7faf34160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 --2- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340b5490 0x7faf34160300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf240097a0 tx=0x7faf2402a180 comp rx=0 tx=0).stop 2024-04-25T15:44:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 -- 172.21.15.80:0/1406261763 shutdown_connections 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 --2- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d0b00 0x7faf340d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 --2- 172.21.15.80:0/1406261763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340b5490 0x7faf34160300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 -- 172.21.15.80:0/1406261763 >> 172.21.15.80:0/1406261763 conn(0x7faf3406e650 msgr2=0x7faf3406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 -- 172.21.15.80:0/1406261763 shutdown_connections 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.703+0000 7faf39538640 1 -- 172.21.15.80:0/1406261763 wait complete. 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.704+0000 7faf39538640 1 Processor -- start 2024-04-25T15:44:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.705+0000 7faf39538640 1 -- start start 2024-04-25T15:44:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf39538640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340d0b00 0x7faf341597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf39538640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d2b80 0x7faf341532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf39538640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 0x7faf34162610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf39538640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faf340d2f90 con 0x7faf34162200 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf39538640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faf34160840 con 0x7faf340d0b00 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf39538640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf340b9360 con 0x7faf340d2b80 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 0x7faf34162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 0x7faf34162610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34546/0 (socket says 172.21.15.80:34546) 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 -- 172.21.15.80:0/4270353970 learned_addr learned my addr 172.21.15.80:0/4270353970 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf32ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340d0b00 0x7faf341597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf327fc640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d2b80 0x7faf341532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 -- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d2b80 msgr2=0x7faf341532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d2b80 0x7faf341532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 -- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340d0b00 msgr2=0x7faf341597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340d0b00 0x7faf341597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 -- 172.21.15.80:0/4270353970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf34159d30 con 0x7faf34162200 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf32ffd640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340d0b00 0x7faf341597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:44:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.706+0000 7faf337fe640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 0x7faf34162610 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c700 tx=0x7faf2c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.707+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c018070 con 0x7faf34162200 2024-04-25T15:44:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.707+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2c00ce10 con 0x7faf34162200 2024-04-25T15:44:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.707+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00a860 con 0x7faf34162200 2024-04-25T15:44:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.707+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf34162b50 con 0x7faf34162200 2024-04-25T15:44:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.707+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf34153e50 con 0x7faf34162200 2024-04-25T15:44:59.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.708+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf34159f80 con 0x7faf34162200 2024-04-25T15:44:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.708+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faf2c01b070 con 0x7faf34162200 2024-04-25T15:44:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.709+0000 7faf1b7fe640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf200744b0 0x7faf200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:44:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.709+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7faf2c0948c0 con 0x7faf34162200 2024-04-25T15:44:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.709+0000 7faf32ffd640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf200744b0 0x7faf200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:44:59.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.709+0000 7faf32ffd640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf200744b0 0x7faf200769c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf24034000 tx=0x7faf2402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:44:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.713+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf34162b50 con 0x7faf34162200 2024-04-25T15:44:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.888+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faf340d41d0 con 0x7faf34162200 2024-04-25T15:44:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.888+0000 7faf1b7fe640 1 -- 172.21.15.80:0/4270353970 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7faf34159d30 con 0x7faf34162200 2024-04-25T15:44:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:44:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf200744b0 msgr2=0x7faf200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf200744b0 0x7faf200769c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf24034000 tx=0x7faf2402e000 comp rx=0 tx=0).stop 2024-04-25T15:44:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 msgr2=0x7faf34162610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 0x7faf34162610 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c700 tx=0x7faf2c00cbc0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 shutdown_connections 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf200744b0 0x7faf200769c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf34162200 0x7faf34162610 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf340d2b80 0x7faf341532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 --2- 172.21.15.80:0/4270353970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf340d0b00 0x7faf341597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 >> 172.21.15.80:0/4270353970 conn(0x7faf3406e650 msgr2=0x7faf340b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 shutdown_connections 2024-04-25T15:44:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:44:59.890+0000 7faf39538640 1 -- 172.21.15.80:0/4270353970 wait complete. 2024-04-25T15:44:59.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:45:00.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.012+0000 7fd2e3972640 1 Processor -- start 2024-04-25T15:45:00.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.012+0000 7fd2e3972640 1 -- start start 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e3972640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2dc06c5c0 0x7fd2dc0d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e3972640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e3972640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2dc0ce590 con 0x7fd2dc0d2f40 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e3972640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd2dc0ce360 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e3972640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd2dc09c320 con 0x7fd2dc0b25e0 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e170e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2dc06c5c0 0x7fd2dc0d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e170e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2dc06c5c0 0x7fd2dc0d2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34560/0 (socket says 172.21.15.80:34560) 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.013+0000 7fd2e170e640 1 -- 172.21.15.80:0/1481214633 learned_addr learned my addr 172.21.15.80:0/1481214633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.014+0000 7fd2e1f0f640 1 --2- 172.21.15.80:0/1481214633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.014+0000 7fd2e170e640 1 -- 172.21.15.80:0/1481214633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 msgr2=0x7fd2dc0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.014+0000 7fd2e170e640 1 --2- 172.21.15.80:0/1481214633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc0b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.014+0000 7fd2e170e640 1 -- 172.21.15.80:0/1481214633 >> v1:172.21.15.195:6789/0 conn(0x7fd2dc0d2f40 legacy=0x7fd2dc06e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.014+0000 7fd2e170e640 1 -- 172.21.15.80:0/1481214633 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc0ce830 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.014+0000 7fd2e170e640 1 --2- 172.21.15.80:0/1481214633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc0d2a00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009870 tx=0x7fd2d802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dce87686d1250a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2d3fff640 1 -- 172.21.15.80:0/1481214633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8037070 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2d3fff640 1 -- 172.21.15.80:0/1481214633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d8032440 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2d3fff640 1 -- 172.21.15.80:0/1481214633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8032810 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 -- 172.21.15.80:0/1481214633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 msgr2=0x7fd2dc0d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 --2- 172.21.15.80:0/1481214633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc0d2a00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009870 tx=0x7fd2d802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 -- 172.21.15.80:0/1481214633 shutdown_connections 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 --2- 172.21.15.80:0/1481214633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 --2- 172.21.15.80:0/1481214633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc0d2a00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 -- 172.21.15.80:0/1481214633 >> 172.21.15.80:0/1481214633 conn(0x7fd2dc0b7620 msgr2=0x7fd2dc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:00.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 -- 172.21.15.80:0/1481214633 shutdown_connections 2024-04-25T15:45:00.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.015+0000 7fd2e3972640 1 -- 172.21.15.80:0/1481214633 wait complete. 2024-04-25T15:45:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.017+0000 7fd2e3972640 1 Processor -- start 2024-04-25T15:45:00.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.017+0000 7fd2e3972640 1 -- start start 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e3972640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e3972640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e3972640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2dc0d2f40 0x7fd2dc14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e3972640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc06c9d0 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e3972640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc0cedf0 con 0x7fd2dc0d2f40 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e3972640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd2dc06cb50 con 0x7fd2dc0b25e0 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.018+0000 7fd2e170e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc160cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34564/0 (socket says 172.21.15.80:34564) 2024-04-25T15:45:00.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 -- 172.21.15.80:0/541933765 learned_addr learned my addr 172.21.15.80:0/541933765 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e0f0d640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e1f0f640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2dc0d2f40 0x7fd2dc14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 -- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 msgr2=0x7fd2dc14d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc14d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 -- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2dc0d2f40 msgr2=0x7fd2dc14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2dc0d2f40 0x7fd2dc14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 -- 172.21.15.80:0/541933765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc0c9b90 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e170e640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc160cc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8000c00 tx=0x7fd2d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8037040 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d8042070 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2dc0c9e70 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8030880 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.019+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2dc15eec0 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.020+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2dc06a100 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.021+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd2d802ad10 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.021+0000 7fd2d1ffb640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2c00744b0 0x7fd2c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.022+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd2d80b5790 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.022+0000 7fd2e0f0d640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2c00744b0 0x7fd2c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.022+0000 7fd2e0f0d640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2c00744b0 0x7fd2c00769c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0c5c60 tx=0x7fd2cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.026+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd2d807f7d0 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.199+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd2dc0b34a0 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.200+0000 7fd2d1ffb640 1 -- 172.21.15.80:0/541933765 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7fd2d8083ad0 con 0x7fd2dc06c5c0 2024-04-25T15:45:00.201 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:45:00.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2c00744b0 msgr2=0x7fd2c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2c00744b0 0x7fd2c00769c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0c5c60 tx=0x7fd2cc009040 comp rx=0 tx=0).stop 2024-04-25T15:45:00.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 msgr2=0x7fd2dc160cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc160cc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8000c00 tx=0x7fd2d80046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 shutdown_connections 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2c00744b0 0x7fd2c00769c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2dc0d2f40 0x7fd2dc14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2dc0b25e0 0x7fd2dc14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 --2- 172.21.15.80:0/541933765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2dc06c5c0 0x7fd2dc160cc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 >> 172.21.15.80:0/541933765 conn(0x7fd2dc0b7620 msgr2=0x7fd2dc070730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 shutdown_connections 2024-04-25T15:45:00.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.202+0000 7fd2e3972640 1 -- 172.21.15.80:0/541933765 wait complete. 2024-04-25T15:45:00.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:45:00.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.322+0000 7f99d22b6640 1 Processor -- start 2024-04-25T15:45:00.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.322+0000 7f99d22b6640 1 -- start start 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d22b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d22b6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99cc0d2480 0x7f99cc0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d22b6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc0b2f30 con 0x7f99cc0b4b60 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d22b6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f99cc06eb60 con 0x7f99cc0d2480 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d22b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99cc0b2c90 con 0x7f99cc0b91c0 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d0853640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99cc0d2480 0x7f99cc0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d0853640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99cc0d2480 0x7f99cc0d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34572/0 (socket says 172.21.15.80:34572) 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99d0853640 1 -- 172.21.15.80:0/452049402 learned_addr learned my addr 172.21.15.80:0/452049402 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.323+0000 7f99cb7fe640 1 --2- 172.21.15.80:0/452049402 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99d0853640 1 -- 172.21.15.80:0/452049402 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 msgr2=0x7f99cc0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:00.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99d0853640 1 --2- 172.21.15.80:0/452049402 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc0d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99d0853640 1 -- 172.21.15.80:0/452049402 >> v1:172.21.15.195:6789/0 conn(0x7f99cc0b4b60 legacy=0x7f99cc06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99d0853640 1 -- 172.21.15.80:0/452049402 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc0d10a0 con 0x7f99cc0d2480 2024-04-25T15:45:00.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99d0853640 1 --2- 172.21.15.80:0/452049402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0d2480 0x7f99cc0d2890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009e50 tx=0x7f99c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ecab6ffc26a733 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99caffd640 1 -- 172.21.15.80:0/452049402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4036070 con 0x7f99cc0d2480 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99caffd640 1 -- 172.21.15.80:0/452049402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c4031600 con 0x7f99cc0d2480 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.324+0000 7f99caffd640 1 -- 172.21.15.80:0/452049402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c40319d0 con 0x7f99cc0d2480 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 -- 172.21.15.80:0/452049402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0d2480 msgr2=0x7f99cc0d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 --2- 172.21.15.80:0/452049402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0d2480 0x7f99cc0d2890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009e50 tx=0x7f99c402a680 comp rx=0 tx=0).stop 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 -- 172.21.15.80:0/452049402 shutdown_connections 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 --2- 172.21.15.80:0/452049402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0d2480 0x7f99cc0d2890 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 --2- 172.21.15.80:0/452049402 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc0d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 -- 172.21.15.80:0/452049402 >> 172.21.15.80:0/452049402 conn(0x7f99cc0d0450 msgr2=0x7f99cc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:00.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 -- 172.21.15.80:0/452049402 shutdown_connections 2024-04-25T15:45:00.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.325+0000 7f99d22b6640 1 -- 172.21.15.80:0/452049402 wait complete. 2024-04-25T15:45:00.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.327+0000 7f99d22b6640 1 Processor -- start 2024-04-25T15:45:00.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.327+0000 7f99d22b6640 1 -- start start 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.328+0000 7f99d22b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 0x7f99cc1fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.328+0000 7f99d22b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc1d7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.328+0000 7f99d22b6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99cc0d2480 0x7f99cc1d9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.328+0000 7f99d22b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc09d0e0 con 0x7f99cc0b4b60 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.328+0000 7f99d22b6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc09cbe0 con 0x7f99cc0d2480 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.328+0000 7f99d22b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99cc09d260 con 0x7f99cc0b91c0 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 0x7f99cc1fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 0x7f99cc1fa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34582/0 (socket says 172.21.15.80:34582) 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 -- 172.21.15.80:0/1100907858 learned_addr learned my addr 172.21.15.80:0/1100907858 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cb7fe640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc1d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99d0853640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99cc0d2480 0x7f99cc1d9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 -- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 msgr2=0x7f99cc1d7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc1d7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 -- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99cc0d2480 msgr2=0x7f99cc1d9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99cc0d2480 0x7f99cc1d9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 -- 172.21.15.80:0/1100907858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc1daf30 con 0x7f99cc0b4b60 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cb7fe640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc1d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99cbfff640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 0x7f99cc1fa6b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c3c0 tx=0x7f99c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c00052d0 con 0x7f99cc0b4b60 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c0005490 con 0x7f99cc0b4b60 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99cc1dac50 con 0x7f99cc0b4b60 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0006a20 con 0x7f99cc0b4b60 2024-04-25T15:45:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.329+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99cc1f9eb0 con 0x7f99cc0b4b60 2024-04-25T15:45:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.330+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99cc075c90 con 0x7f99cc0b4b60 2024-04-25T15:45:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.331+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f99c0003640 con 0x7f99cc0b4b60 2024-04-25T15:45:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.331+0000 7f99c8ff9640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99b80744b0 0x7f99b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.332+0000 7f99cb7fe640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99b80744b0 0x7f99b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.332+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f99c00947c0 con 0x7f99cc0b4b60 2024-04-25T15:45:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.332+0000 7f99cb7fe640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99b80744b0 0x7f99b80769c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f99cc073300 tx=0x7f99bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.336+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99c005ee50 con 0x7f99cc0b4b60 2024-04-25T15:45:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.522+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f99cc06a100 con 0x7f99cc0b4b60 2024-04-25T15:45:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.522+0000 7f99c8ff9640 1 -- 172.21.15.80:0/1100907858 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f99c005e750 con 0x7f99cc0b4b60 2024-04-25T15:45:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:45:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99b80744b0 msgr2=0x7f99b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99b80744b0 0x7f99b80769c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f99cc073300 tx=0x7f99bc008040 comp rx=0 tx=0).stop 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 msgr2=0x7f99cc1fa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 0x7f99cc1fa6b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c3c0 tx=0x7f99c000c880 comp rx=0 tx=0).stop 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 shutdown_connections 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99b80744b0 0x7f99b80769c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99cc0d2480 0x7f99cc1d9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99cc0b91c0 0x7f99cc1d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 --2- 172.21.15.80:0/1100907858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99cc0b4b60 0x7f99cc1fa6b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 >> 172.21.15.80:0/1100907858 conn(0x7f99cc0d0450 msgr2=0x7f99cc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 shutdown_connections 2024-04-25T15:45:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.524+0000 7f99d22b6640 1 -- 172.21.15.80:0/1100907858 wait complete. 2024-04-25T15:45:00.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:45:00.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:00.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:00.563 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:45:00.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:00.563 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:45:00.619 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:00.619 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:00.619 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:00.638 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:00.638 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:00.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.802+0000 7f9aa3c61640 1 Processor -- start 2024-04-25T15:45:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.802+0000 7f9aa3c61640 1 -- start start 2024-04-25T15:45:00.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa3c61640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a9c0b91c0 0x7f9a9c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa3c61640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a9c0d2480 0x7f9a9c0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa3c61640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9c0b2f30 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa3c61640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c06eb60 con 0x7f9a9c0b91c0 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa3c61640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c0b2c90 con 0x7f9a9c0d2480 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a9c0b91c0 0x7f9a9c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa19fd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a9c0b4b60 0x7f9a9c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39630/0 (socket says 172.21.15.80:39630) 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a9c0b91c0 0x7f9a9c0d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34586/0 (socket says 172.21.15.80:34586) 2024-04-25T15:45:00.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa19fd640 1 -- 172.21.15.80:0/2427096730 learned_addr learned my addr 172.21.15.80:0/2427096730 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa21fe640 1 --2- 172.21.15.80:0/2427096730 >> v2:172.21.15.195:3300/0 conn(0x7f9a9c0d2480 0x7f9a9c0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 -- 172.21.15.80:0/2427096730 >> v2:172.21.15.195:3300/0 conn(0x7f9a9c0d2480 msgr2=0x7f9a9c0d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 --2- 172.21.15.80:0/2427096730 >> v2:172.21.15.195:3300/0 conn(0x7f9a9c0d2480 0x7f9a9c0d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 -- 172.21.15.80:0/2427096730 >> v1:172.21.15.80:6789/0 conn(0x7f9a9c0b4b60 legacy=0x7f9a9c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 -- 172.21.15.80:0/2427096730 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c0d10a0 con 0x7f9a9c0b91c0 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa09fb640 1 -- 172.21.15.80:0/2427096730 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040052430 0 0) 0x7f9a9c0b2f30 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa11fc640 1 --2- 172.21.15.80:0/2427096730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c0d1f40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0097a0 tx=0x7f9a8c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9846b95db54f16ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa09fb640 1 -- 172.21.15.80:0/2427096730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c037070 con 0x7f9a9c0b91c0 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa09fb640 1 -- 172.21.15.80:0/2427096730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8c02ae50 con 0x7f9a9c0b91c0 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.805+0000 7f9aa09fb640 1 -- 172.21.15.80:0/2427096730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c032660 con 0x7f9a9c0b91c0 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 -- 172.21.15.80:0/2427096730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b91c0 msgr2=0x7f9a9c0d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/2427096730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c0d1f40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0097a0 tx=0x7f9a8c02a140 comp rx=0 tx=0).stop 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 -- 172.21.15.80:0/2427096730 shutdown_connections 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/2427096730 >> v2:172.21.15.195:3300/0 conn(0x7f9a9c0d2480 0x7f9a9c0d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/2427096730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c0d1f40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 -- 172.21.15.80:0/2427096730 >> 172.21.15.80:0/2427096730 conn(0x7f9a9c0d0450 msgr2=0x7f9a9c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:00.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 -- 172.21.15.80:0/2427096730 shutdown_connections 2024-04-25T15:45:00.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.806+0000 7f9aa3c61640 1 -- 172.21.15.80:0/2427096730 wait complete. 2024-04-25T15:45:00.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.808+0000 7f9aa3c61640 1 Processor -- start 2024-04-25T15:45:00.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.808+0000 7f9aa3c61640 1 -- start start 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa3c61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 0x7f9a9c0a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa3c61640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c1f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa3c61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a9c0d2480 0x7f9a9c1f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa3c61640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c09d0e0 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa3c61640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c09cbe0 con 0x7f9a9c0b91c0 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa3c61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c09d260 con 0x7f9a9c0d2480 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 0x7f9a9c0a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 0x7f9a9c0a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34590/0 (socket says 172.21.15.80:34590) 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 -- 172.21.15.80:0/866178092 learned_addr learned my addr 172.21.15.80:0/866178092 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa21fe640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a9c0d2480 0x7f9a9c1f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 -- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a9c0d2480 msgr2=0x7f9a9c1f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a9c0d2480 0x7f9a9c1f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 -- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a9c0b91c0 msgr2=0x7f9a9c1f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa11fc640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c1f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c1f9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa19fd640 1 -- 172.21.15.80:0/866178092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c0a0b30 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa21fe640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a9c0d2480 0x7f9a9c1f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.809+0000 7f9aa11fc640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c1f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.810+0000 7f9aa19fd640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 0x7f9a9c0a0370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c770 tx=0x7f9a9800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.810+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800a640 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.810+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9800a7e0 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.810+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c0a0e10 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.810+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800abd0 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.810+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c1f7580 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.811+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9c075c90 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.811+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9a98007070 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.812+0000 7f9a927fc640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a800744e0 0x7f9a800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:00.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.812+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f9a98095300 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.812+0000 7f9aa11fc640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a800744e0 0x7f9a800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:00.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.812+0000 7f9aa11fc640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a800744e0 0x7f9a800769f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c034000 tx=0x7f9a8c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:00.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.816+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a9805f900 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.993+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a9c0a1330 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.994+0000 7f9a927fc640 1 -- 172.21.15.80:0/866178092 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16930 (secure 0 0 0) 0x7f9a9c0a1330 con 0x7f9a9c0b4b60 2024-04-25T15:45:00.996 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:51.926717+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a800744e0 msgr2=0x7f9a800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a800744e0 0x7f9a800769f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c034000 tx=0x7f9a8c02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 msgr2=0x7f9a9c0a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 0x7f9a9c0a0370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c770 tx=0x7f9a9800cc30 comp rx=0 tx=0).stop 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 shutdown_connections 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9a800744e0 0x7f9a800769f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a9c0d2480 0x7f9a9c1f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a9c0b91c0 0x7f9a9c1f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 --2- 172.21.15.80:0/866178092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a9c0b4b60 0x7f9a9c0a0370 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:00.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 >> 172.21.15.80:0/866178092 conn(0x7f9a9c0d0450 msgr2=0x7f9a9c0b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:00.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 shutdown_connections 2024-04-25T15:45:00.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:00.997+0000 7f9aa3c61640 1 -- 172.21.15.80:0/866178092 wait complete. 2024-04-25T15:45:01.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:48.548707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:49.239267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:01.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:01.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.118+0000 7f6d37396640 1 Processor -- start 2024-04-25T15:45:01.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.119+0000 7f6d37396640 1 -- start start 2024-04-25T15:45:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d37396640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d300b2f90 0x7f6d300ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d37396640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d300d3870 0x7f6d300d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d37396640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d30164670 con 0x7f6d30163e40 2024-04-25T15:45:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d37396640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6d30164950 con 0x7f6d300d3870 2024-04-25T15:45:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d37396640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d30164c30 con 0x7f6d300b2f90 2024-04-25T15:45:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d300d3870 0x7f6d300d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d300d3870 0x7f6d300d3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34600/0 (socket says 172.21.15.80:34600) 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 -- 172.21.15.80:0/1380663681 learned_addr learned my addr 172.21.15.80:0/1380663681 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d34931640 1 --1- 172.21.15.80:0/1380663681 >> v1:172.21.15.80:6789/0 conn(0x7f6d30163e40 0x7f6d30160140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39646/0 (socket says 172.21.15.80:39646) 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35132640 1 --2- 172.21.15.80:0/1380663681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d300b2f90 0x7f6d300ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 -- 172.21.15.80:0/1380663681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d300b2f90 msgr2=0x7f6d300ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 --2- 172.21.15.80:0/1380663681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d300b2f90 0x7f6d300ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 -- 172.21.15.80:0/1380663681 >> v1:172.21.15.80:6789/0 conn(0x7f6d30163e40 legacy=0x7f6d30160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d27fff640 1 -- 172.21.15.80:0/1380663681 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038070521 0 0) 0x7f6d30164670 con 0x7f6d30163e40 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 -- 172.21.15.80:0/1380663681 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3006db50 con 0x7f6d300d3870 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d35933640 1 --2- 172.21.15.80:0/1380663681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300d3870 0x7f6d300d3c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009e50 tx=0x7f6d2802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ac702bef420532 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d27fff640 1 -- 172.21.15.80:0/1380663681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28036070 con 0x7f6d300d3870 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d27fff640 1 -- 172.21.15.80:0/1380663681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d28031600 con 0x7f6d300d3870 2024-04-25T15:45:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.121+0000 7f6d27fff640 1 -- 172.21.15.80:0/1380663681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d280319d0 con 0x7f6d300d3870 2024-04-25T15:45:01.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 -- 172.21.15.80:0/1380663681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300d3870 msgr2=0x7f6d300d3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 --2- 172.21.15.80:0/1380663681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300d3870 0x7f6d300d3c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009e50 tx=0x7f6d2802a680 comp rx=0 tx=0).stop 2024-04-25T15:45:01.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 -- 172.21.15.80:0/1380663681 shutdown_connections 2024-04-25T15:45:01.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 --2- 172.21.15.80:0/1380663681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300d3870 0x7f6d300d3c80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 --2- 172.21.15.80:0/1380663681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d300b2f90 0x7f6d300ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 -- 172.21.15.80:0/1380663681 >> 172.21.15.80:0/1380663681 conn(0x7f6d300b5510 msgr2=0x7f6d300b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:01.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 -- 172.21.15.80:0/1380663681 shutdown_connections 2024-04-25T15:45:01.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.122+0000 7f6d37396640 1 -- 172.21.15.80:0/1380663681 wait complete. 2024-04-25T15:45:01.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.124+0000 7f6d37396640 1 Processor -- start 2024-04-25T15:45:01.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.124+0000 7f6d37396640 1 -- start start 2024-04-25T15:45:01.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d37396640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 0x7f6d30154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d37396640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d300d3870 0x7f6d301f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d37396640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d30163e40 0x7f6d301553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d37396640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d301643d0 con 0x7f6d300b2f90 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d37396640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6d30164250 con 0x7f6d300d3870 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d37396640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3006e350 con 0x7f6d30163e40 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d35132640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 0x7f6d30154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d35132640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 0x7f6d30154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34614/0 (socket says 172.21.15.80:34614) 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.125+0000 7f6d35132640 1 -- 172.21.15.80:0/2177065096 learned_addr learned my addr 172.21.15.80:0/2177065096 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d35132640 1 -- 172.21.15.80:0/2177065096 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d30163e40 msgr2=0x7f6d301553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d35132640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d30163e40 0x7f6d301553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d35132640 1 -- 172.21.15.80:0/2177065096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d300d3870 msgr2=0x7f6d301f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d35132640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d300d3870 0x7f6d301f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d35132640 1 -- 172.21.15.80:0/2177065096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d301f7ef0 con 0x7f6d300b2f90 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d35132640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 0x7f6d30154d00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00d5d0 tx=0x7f6d2c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c004240 con 0x7f6d300b2f90 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0043e0 con 0x7f6d300b2f90 2024-04-25T15:45:01.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d301f81d0 con 0x7f6d300b2f90 2024-04-25T15:45:01.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c003830 con 0x7f6d300b2f90 2024-04-25T15:45:01.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.126+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d301f8790 con 0x7f6d300b2f90 2024-04-25T15:45:01.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.127+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3006a100 con 0x7f6d300b2f90 2024-04-25T15:45:01.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.128+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6d2c0039d0 con 0x7f6d300b2f90 2024-04-25T15:45:01.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.128+0000 7f6d25ffb640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.128+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6d2c0956c0 con 0x7f6d300b2f90 2024-04-25T15:45:01.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.128+0000 7f6d34931640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.129+0000 7f6d34931640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007fd0 tx=0x7f6d20007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.134+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d2c05fcc0 con 0x7f6d300b2f90 2024-04-25T15:45:01.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.303+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d300b9960 con 0x7f6d300b2f90 2024-04-25T15:45:01.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.304+0000 7f6d25ffb640 1 -- 172.21.15.80:0/2177065096 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f6d2c05f5c0 con 0x7f6d300b2f90 2024-04-25T15:45:01.305 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 msgr2=0x7f6d140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007fd0 tx=0x7f6d20007960 comp rx=0 tx=0).stop 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 msgr2=0x7f6d30154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 0x7f6d30154d00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00d5d0 tx=0x7f6d2c00da90 comp rx=0 tx=0).stop 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 shutdown_connections 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d30163e40 0x7f6d301553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d300d3870 0x7f6d301f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 --2- 172.21.15.80:0/2177065096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d300b2f90 0x7f6d30154d00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 >> 172.21.15.80:0/2177065096 conn(0x7f6d300b5510 msgr2=0x7f6d300d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:01.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 shutdown_connections 2024-04-25T15:45:01.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.306+0000 7f6d37396640 1 -- 172.21.15.80:0/2177065096 wait complete. 2024-04-25T15:45:01.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:45:01.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.427+0000 7fd459df8640 1 Processor -- start 2024-04-25T15:45:01.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.427+0000 7fd459df8640 1 -- start start 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd459df8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4540cf930 0x7fd454160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd459df8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd4540718d0 0x7fd454071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd459df8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4540ce890 con 0x7fd4540d1600 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd459df8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540cf4a0 con 0x7fd4540cf930 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd459df8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540cfd40 con 0x7fd4540718d0 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4537fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4540cf930 0x7fd454160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd452ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4540d1600 0x7fd4540d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39654/0 (socket says 172.21.15.80:39654) 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4537fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4540cf930 0x7fd454160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34626/0 (socket says 172.21.15.80:34626) 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd452ffd640 1 -- 172.21.15.80:0/544109238 learned_addr learned my addr 172.21.15.80:0/544109238 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4537fe640 1 -- 172.21.15.80:0/544109238 >> v2:172.21.15.195:3300/0 conn(0x7fd4540718d0 msgr2=0x7fd454071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd453fff640 1 --2- 172.21.15.80:0/544109238 >> v2:172.21.15.195:3300/0 conn(0x7fd4540718d0 0x7fd454071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4537fe640 1 --2- 172.21.15.80:0/544109238 >> v2:172.21.15.195:3300/0 conn(0x7fd4540718d0 0x7fd454071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4537fe640 1 -- 172.21.15.80:0/544109238 >> v1:172.21.15.80:6789/0 conn(0x7fd4540d1600 legacy=0x7fd4540d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4527fc640 1 -- 172.21.15.80:0/544109238 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148576533 0 0) 0x7fd4540ce890 con 0x7fd4540d1600 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd4537fe640 1 -- 172.21.15.80:0/544109238 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540ceb70 con 0x7fd4540cf930 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.429+0000 7fd453fff640 1 --2- 172.21.15.80:0/544109238 >> v2:172.21.15.195:3300/0 conn(0x7fd4540718d0 0x7fd454071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.430+0000 7fd4537fe640 1 --2- 172.21.15.80:0/544109238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540cf930 0x7fd454160120 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd45406d0a0 tx=0x7fd44402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2990b9db12f1783d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.430+0000 7fd4527fc640 1 -- 172.21.15.80:0/544109238 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444037070 con 0x7fd4540cf930 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.430+0000 7fd4527fc640 1 -- 172.21.15.80:0/544109238 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444032440 con 0x7fd4540cf930 2024-04-25T15:45:01.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.430+0000 7fd4527fc640 1 -- 172.21.15.80:0/544109238 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444032810 con 0x7fd4540cf930 2024-04-25T15:45:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 -- 172.21.15.80:0/544109238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540cf930 msgr2=0x7fd454160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 --2- 172.21.15.80:0/544109238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540cf930 0x7fd454160120 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd45406d0a0 tx=0x7fd44402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 -- 172.21.15.80:0/544109238 shutdown_connections 2024-04-25T15:45:01.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 --2- 172.21.15.80:0/544109238 >> v2:172.21.15.195:3300/0 conn(0x7fd4540718d0 0x7fd454071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 --2- 172.21.15.80:0/544109238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540cf930 0x7fd454160120 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 -- 172.21.15.80:0/544109238 >> 172.21.15.80:0/544109238 conn(0x7fd4540d3a30 msgr2=0x7fd4540d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 -- 172.21.15.80:0/544109238 shutdown_connections 2024-04-25T15:45:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.431+0000 7fd459df8640 1 -- 172.21.15.80:0/544109238 wait complete. 2024-04-25T15:45:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.433+0000 7fd459df8640 1 Processor -- start 2024-04-25T15:45:01.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.433+0000 7fd459df8640 1 -- start start 2024-04-25T15:45:01.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd459df8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4540718d0 0x7fd454150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd459df8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4540cf930 0x7fd4540b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd459df8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 0x7fd4540b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd459df8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd454160660 con 0x7fd4540d1600 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd459df8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540cf130 con 0x7fd4540718d0 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd459df8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd454072220 con 0x7fd4540cf930 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 0x7fd4540b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 0x7fd4540b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34634/0 (socket says 172.21.15.80:34634) 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd453fff640 1 -- 172.21.15.80:0/1239255633 learned_addr learned my addr 172.21.15.80:0/1239255633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd452ffd640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4540cf930 0x7fd4540b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.434+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4540718d0 0x7fd454150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd453fff640 1 -- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4540cf930 msgr2=0x7fd4540b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd453fff640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4540cf930 0x7fd4540b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd453fff640 1 -- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4540718d0 msgr2=0x7fd454150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd453fff640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4540718d0 0x7fd454150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd453fff640 1 -- 172.21.15.80:0/1239255633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540b3800 con 0x7fd4540d1600 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4540718d0 0x7fd454150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd453fff640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 0x7fd4540b21c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00cd10 tx=0x7fd44c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c003b90 con 0x7fd4540d1600 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44c003d50 con 0x7fd4540d1600 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c004260 con 0x7fd4540d1600 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45415b2e0 con 0x7fd4540d1600 2024-04-25T15:45:01.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.435+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4540b0ec0 con 0x7fd4540d1600 2024-04-25T15:45:01.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.436+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4540af4d0 con 0x7fd4540d1600 2024-04-25T15:45:01.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.436+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd44c004400 con 0x7fd4540d1600 2024-04-25T15:45:01.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.437+0000 7fd43bfff640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4400744e0 0x7fd4400769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.437+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd44c095c50 con 0x7fd4540d1600 2024-04-25T15:45:01.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.437+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4400744e0 0x7fd4400769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.437+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4400744e0 0x7fd4400769f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd444034000 tx=0x7fd44402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.442+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd44c09b020 con 0x7fd4540d1600 2024-04-25T15:45:01.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.617+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd45406a100 con 0x7fd4540d1600 2024-04-25T15:45:01.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.617+0000 7fd43bfff640 1 -- 172.21.15.80:0/1239255633 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7fd44c066020 con 0x7fd4540d1600 2024-04-25T15:45:01.618 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:45:01.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4400744e0 msgr2=0x7fd4400769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4400744e0 0x7fd4400769f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd444034000 tx=0x7fd44402e000 comp rx=0 tx=0).stop 2024-04-25T15:45:01.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 msgr2=0x7fd4540b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 0x7fd4540b21c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00cd10 tx=0x7fd44c00a650 comp rx=0 tx=0).stop 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 shutdown_connections 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4400744e0 0x7fd4400769f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540d1600 0x7fd4540b21c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4540cf930 0x7fd4540b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 --2- 172.21.15.80:0/1239255633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4540718d0 0x7fd454150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 >> 172.21.15.80:0/1239255633 conn(0x7fd4540d3a30 msgr2=0x7fd45415f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 shutdown_connections 2024-04-25T15:45:01.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.619+0000 7fd459df8640 1 -- 172.21.15.80:0/1239255633 wait complete. 2024-04-25T15:45:01.631 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:45:01.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.741+0000 7efdc7296640 1 Processor -- start 2024-04-25T15:45:01.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.741+0000 7efdc7296640 1 -- start start 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc7296640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efdc009b410 0x7efdc009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc7296640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efdc00d3110 0x7efdc00d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc7296640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc0160760 con 0x7efdc00d1fc0 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc7296640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7efdc009b920 con 0x7efdc00d3110 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc7296640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7efdc00b3410 con 0x7efdc009b410 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efdc00d3110 0x7efdc00d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efdc00d3110 0x7efdc00d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34636/0 (socket says 172.21.15.80:34636) 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 -- 172.21.15.80:0/3438163446 learned_addr learned my addr 172.21.15.80:0/3438163446 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc5032640 1 --2- 172.21.15.80:0/3438163446 >> v2:172.21.15.195:3300/0 conn(0x7efdc009b410 0x7efdc009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 -- 172.21.15.80:0/3438163446 >> v2:172.21.15.195:3300/0 conn(0x7efdc009b410 msgr2=0x7efdc009bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 --2- 172.21.15.80:0/3438163446 >> v2:172.21.15.195:3300/0 conn(0x7efdc009b410 0x7efdc009bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 -- 172.21.15.80:0/3438163446 >> v1:172.21.15.195:6789/0 conn(0x7efdc00d1fc0 legacy=0x7efdc00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.743+0000 7efdc4831640 1 -- 172.21.15.80:0/3438163446 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc00b3c00 con 0x7efdc00d3110 2024-04-25T15:45:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.744+0000 7efdc4831640 1 --2- 172.21.15.80:0/3438163446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00d1a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efdc00d03c0 tx=0x7efdb002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba30f456df31f253 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.744+0000 7efdb7fff640 1 -- 172.21.15.80:0/3438163446 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0037070 con 0x7efdc00d3110 2024-04-25T15:45:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.744+0000 7efdb7fff640 1 -- 172.21.15.80:0/3438163446 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0032440 con 0x7efdc00d3110 2024-04-25T15:45:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.744+0000 7efdb7fff640 1 -- 172.21.15.80:0/3438163446 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0032810 con 0x7efdc00d3110 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 -- 172.21.15.80:0/3438163446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 msgr2=0x7efdc00d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 --2- 172.21.15.80:0/3438163446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00d1a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efdc00d03c0 tx=0x7efdb002a200 comp rx=0 tx=0).stop 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 -- 172.21.15.80:0/3438163446 shutdown_connections 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 --2- 172.21.15.80:0/3438163446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00d1a80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 --2- 172.21.15.80:0/3438163446 >> v2:172.21.15.195:3300/0 conn(0x7efdc009b410 0x7efdc009bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 -- 172.21.15.80:0/3438163446 >> 172.21.15.80:0/3438163446 conn(0x7efdc00b7620 msgr2=0x7efdc00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 -- 172.21.15.80:0/3438163446 shutdown_connections 2024-04-25T15:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.745+0000 7efdc7296640 1 -- 172.21.15.80:0/3438163446 wait complete. 2024-04-25T15:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.747+0000 7efdc7296640 1 Processor -- start 2024-04-25T15:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.747+0000 7efdc7296640 1 -- start start 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc7296640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc009b410 0x7efdc01632d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc7296640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc00d1fc0 0x7efdc00af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc7296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc7296640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efdc00cea40 con 0x7efdc00d3110 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc7296640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efdc00b41a0 con 0x7efdc009b410 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc7296640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efdc00d23d0 con 0x7efdc00d1fc0 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00afca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34652/0 (socket says 172.21.15.80:34652) 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 -- 172.21.15.80:0/2902526959 learned_addr learned my addr 172.21.15.80:0/2902526959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5032640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc009b410 0x7efdc01632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc4831640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc00d1fc0 0x7efdc00af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 -- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc00d1fc0 msgr2=0x7efdc00af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc00d1fc0 0x7efdc00af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 -- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc009b410 msgr2=0x7efdc01632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc009b410 0x7efdc01632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5833640 1 -- 172.21.15.80:0/2902526959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc0161010 con 0x7efdc00d3110 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc4831640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc00d1fc0 0x7efdc00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.748+0000 7efdc5032640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc009b410 0x7efdc01632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.749+0000 7efdc5833640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00afca0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b440 tx=0x7efdb800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.749+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8015020 con 0x7efdc00d3110 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.749+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8011830 con 0x7efdc00d3110 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.749+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc01612f0 con 0x7efdc00d3110 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.749+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8011c20 con 0x7efdc00d3110 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.749+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc01618b0 con 0x7efdc00d3110 2024-04-25T15:45:01.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.750+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc006a100 con 0x7efdc00d3110 2024-04-25T15:45:01.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.750+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efdb8018020 con 0x7efdc00d3110 2024-04-25T15:45:01.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.751+0000 7efdb5ffb640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efda40744b0 0x7efda40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:01.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.751+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7efdb8094fb0 con 0x7efdc00d3110 2024-04-25T15:45:01.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.751+0000 7efdc5032640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efda40744b0 0x7efda40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:01.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.751+0000 7efdc5032640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efda40744b0 0x7efda40769c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009a80 tx=0x7efdbc0039d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.756+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efdb801f030 con 0x7efdc00d3110 2024-04-25T15:45:01.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.932+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efdc00cdb90 con 0x7efdc00d3110 2024-04-25T15:45:01.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.932+0000 7efdb5ffb640 1 -- 172.21.15.80:0/2902526959 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7efdb805f5b0 con 0x7efdc00d3110 2024-04-25T15:45:01.932 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:45:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efda40744b0 msgr2=0x7efda40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efda40744b0 0x7efda40769c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009a80 tx=0x7efdbc0039d0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 msgr2=0x7efdc00afca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00afca0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b440 tx=0x7efdb800b900 comp rx=0 tx=0).stop 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 shutdown_connections 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efda40744b0 0x7efda40769c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdc00d3110 0x7efdc00afca0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efdc00d1fc0 0x7efdc00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 --2- 172.21.15.80:0/2902526959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc009b410 0x7efdc01632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 >> 172.21.15.80:0/2902526959 conn(0x7efdc00b7620 msgr2=0x7efdc009bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 shutdown_connections 2024-04-25T15:45:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:01.934+0000 7efdc7296640 1 -- 172.21.15.80:0/2902526959 wait complete. 2024-04-25T15:45:01.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:45:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.055+0000 7fbcadf34640 1 Processor -- start 2024-04-25T15:45:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.055+0000 7fbcadf34640 1 -- start start 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbcadf34640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbca80cf960 0x7fbca80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbcadf34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80b1ef0 0x7fbca80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbcadf34640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca81607c0 con 0x7fbca80ce220 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbcadf34640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbca80cf4d0 con 0x7fbca80cf960 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbcadf34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbca80ce630 con 0x7fbca80b1ef0 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbca80cf960 0x7fbca80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbca80cf960 0x7fbca80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34654/0 (socket says 172.21.15.80:34654) 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 -- 172.21.15.80:0/2652511147 learned_addr learned my addr 172.21.15.80:0/2652511147 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca7fff640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80b1ef0 0x7fbca80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 -- 172.21.15.80:0/2652511147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80b1ef0 msgr2=0x7fbca80b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:02.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80b1ef0 0x7fbca80b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 -- 172.21.15.80:0/2652511147 >> v1:172.21.15.195:6789/0 conn(0x7fbca80ce220 legacy=0x7fbca809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca6ffd640 1 -- 172.21.15.80:0/2652511147 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80ceba0 con 0x7fbca80cf960 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.057+0000 7fbca7fff640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80b1ef0 0x7fbca80b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.058+0000 7fbca6ffd640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca80cfd70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009870 tx=0x7fbc9c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7430cc228fd60a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.058+0000 7fbca67fc640 1 -- 172.21.15.80:0/2652511147 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c037070 con 0x7fbca80cf960 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.058+0000 7fbca67fc640 1 -- 172.21.15.80:0/2652511147 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9c02ae50 con 0x7fbca80cf960 2024-04-25T15:45:02.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.058+0000 7fbca67fc640 1 -- 172.21.15.80:0/2652511147 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c032860 con 0x7fbca80cf960 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 -- 172.21.15.80:0/2652511147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 msgr2=0x7fbca80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca80cfd70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009870 tx=0x7fbc9c02a300 comp rx=0 tx=0).stop 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 -- 172.21.15.80:0/2652511147 shutdown_connections 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80b1ef0 0x7fbca80b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2652511147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca80cfd70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 -- 172.21.15.80:0/2652511147 >> 172.21.15.80:0/2652511147 conn(0x7fbca80b7620 msgr2=0x7fbca80b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 -- 172.21.15.80:0/2652511147 shutdown_connections 2024-04-25T15:45:02.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.059+0000 7fbcadf34640 1 -- 172.21.15.80:0/2652511147 wait complete. 2024-04-25T15:45:02.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.060+0000 7fbcadf34640 1 Processor -- start 2024-04-25T15:45:02.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.061+0000 7fbcadf34640 1 -- start start 2024-04-25T15:45:02.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbcadf34640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbca80b1ef0 0x7fbca81f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbcadf34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80ce220 0x7fbca815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbcadf34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca81f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbcadf34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80d3530 con 0x7fbca80cf960 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbcadf34640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80cf160 con 0x7fbca80b1ef0 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbcadf34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbca80ccaa0 con 0x7fbca80ce220 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca81f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca81f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34660/0 (socket says 172.21.15.80:34660) 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 -- 172.21.15.80:0/2789149447 learned_addr learned my addr 172.21.15.80:0/2789149447 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca77fe640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbca80b1ef0 0x7fbca81f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca6ffd640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80ce220 0x7fbca815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 -- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80ce220 msgr2=0x7fbca815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80ce220 0x7fbca815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 -- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbca80b1ef0 msgr2=0x7fbca81f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbca80b1ef0 0x7fbca81f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 -- 172.21.15.80:0/2789149447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca81f75f0 con 0x7fbca80cf960 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.062+0000 7fbca7fff640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca81f77f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007dc0 tx=0x7fbca000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.063+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca001a070 con 0x7fbca80cf960 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.063+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca0003990 con 0x7fbca80cf960 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.063+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca80c9b60 con 0x7fbca80cf960 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.063+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0003d80 con 0x7fbca80cf960 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.063+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca81f68b0 con 0x7fbca80cf960 2024-04-25T15:45:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.064+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca806a100 con 0x7fbca80cf960 2024-04-25T15:45:02.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.064+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbca001d070 con 0x7fbca80cf960 2024-04-25T15:45:02.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.065+0000 7fbc8ffff640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbc940744b0 0x7fbc940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.065+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fbca0095510 con 0x7fbca80cf960 2024-04-25T15:45:02.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.065+0000 7fbca77fe640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbc940744b0 0x7fbc940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.065+0000 7fbca77fe640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbc940744b0 0x7fbc940769c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbc980016e0 tx=0x7fbc98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.069+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbca81f75f0 con 0x7fbca80cf960 2024-04-25T15:45:02.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.255+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbca80cfd70 con 0x7fbca80cf960 2024-04-25T15:45:02.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.255+0000 7fbc8ffff640 1 -- 172.21.15.80:0/2789149447 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7fbca0010070 con 0x7fbca80cf960 2024-04-25T15:45:02.255 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:45:02.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbc940744b0 msgr2=0x7fbc940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbc940744b0 0x7fbc940769c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbc980016e0 tx=0x7fbc98009040 comp rx=0 tx=0).stop 2024-04-25T15:45:02.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 msgr2=0x7fbca81f77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca81f77f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007dc0 tx=0x7fbca000d4a0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 shutdown_connections 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbc940744b0 0x7fbc940769c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca80cf960 0x7fbca81f77f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbca80ce220 0x7fbca815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 --2- 172.21.15.80:0/2789149447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbca80b1ef0 0x7fbca81f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 >> 172.21.15.80:0/2789149447 conn(0x7fbca80b7620 msgr2=0x7fbca80b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 shutdown_connections 2024-04-25T15:45:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.257+0000 7fbcadf34640 1 -- 172.21.15.80:0/2789149447 wait complete. 2024-04-25T15:45:02.268 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:45:02.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:02.269 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:02.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:45:02.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:02.301 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:45:02.358 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:02.359 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:02.359 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:02.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:45:02.374 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:02.374 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:02.374 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:02.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:45:02.416 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:02.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.523+0000 7f4dd2049640 1 Processor -- start 2024-04-25T15:45:02.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.523+0000 7f4dd2049640 1 -- start start 2024-04-25T15:45:02.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dd2049640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4dcc0d41b0 0x7f4dcc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dd2049640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0b7d60 0x7f4dcc0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dd2049640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dcc163fb0 con 0x7f4dcc1602a0 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dd2049640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4dcc164270 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dd2049640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4dcc164550 con 0x7f4dcc0b7d60 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dcb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4dcc0d41b0 0x7f4dcc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dcaffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4dcc1602a0 0x7f4dcc0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39666/0 (socket says 172.21.15.80:39666) 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dcb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4dcc0d41b0 0x7f4dcc0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34676/0 (socket says 172.21.15.80:34676) 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.524+0000 7f4dcaffd640 1 -- 172.21.15.80:0/1067676359 learned_addr learned my addr 172.21.15.80:0/1067676359 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dcbfff640 1 --2- 172.21.15.80:0/1067676359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0b7d60 0x7f4dcc0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1067676359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0b7d60 msgr2=0x7f4dcc0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:02.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dcb7fe640 1 --2- 172.21.15.80:0/1067676359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0b7d60 0x7f4dcc0d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1067676359 >> v1:172.21.15.80:6789/0 conn(0x7f4dcc1602a0 legacy=0x7f4dcc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dca7fc640 1 -- 172.21.15.80:0/1067676359 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272133884 0 0) 0x7f4dcc163fb0 con 0x7f4dcc1602a0 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1067676359 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc164830 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.525+0000 7f4dcb7fe640 1 --2- 172.21.15.80:0/1067676359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc0b48d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0097a0 tx=0x7f4dbc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7ff47801167299 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dca7fc640 1 -- 172.21.15.80:0/1067676359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037070 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dca7fc640 1 -- 172.21.15.80:0/1067676359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc032440 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dca7fc640 1 -- 172.21.15.80:0/1067676359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc032810 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 -- 172.21.15.80:0/1067676359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 msgr2=0x7f4dcc0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1067676359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc0b48d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0097a0 tx=0x7f4dbc02a180 comp rx=0 tx=0).stop 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 -- 172.21.15.80:0/1067676359 shutdown_connections 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1067676359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0b7d60 0x7f4dcc0d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1067676359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc0b48d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 -- 172.21.15.80:0/1067676359 >> 172.21.15.80:0/1067676359 conn(0x7f4dcc06e9f0 msgr2=0x7f4dcc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 -- 172.21.15.80:0/1067676359 shutdown_connections 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.526+0000 7f4dd2049640 1 -- 172.21.15.80:0/1067676359 wait complete. 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.528+0000 7f4dd2049640 1 Processor -- start 2024-04-25T15:45:02.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.528+0000 7f4dd2049640 1 -- start start 2024-04-25T15:45:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc162ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dcc1602a0 0x7f4dcc1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0cfa10 0x7f4dcc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc0b5150 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc0b4fd0 con 0x7f4dcc1602a0 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4dcc0b9220 con 0x7f4dcc0cfa10 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc162ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc162ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34684/0 (socket says 172.21.15.80:34684) 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1521670485 learned_addr learned my addr 172.21.15.80:0/1521670485 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcbfff640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0cfa10 0x7f4dcc0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcaffd640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dcc1602a0 0x7f4dcc1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0cfa10 msgr2=0x7f4dcc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0cfa10 0x7f4dcc0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dcc1602a0 msgr2=0x7f4dcc1f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dcc1602a0 0x7f4dcc1f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 -- 172.21.15.80:0/1521670485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc0d0360 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dcb7fe640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc162ad0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000c00 tx=0x7f4dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037050 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc038040 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dcc163010 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc004490 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.530+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dcc0ce7c0 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.531+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dcc06a100 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.532+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4dbc030900 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.532+0000 7f4db3fff640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4db80744b0 0x7f4db80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.533+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f4dbc0b5c70 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.533+0000 7f4dcaffd640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4db80744b0 0x7f4db80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.533+0000 7f4dcaffd640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4db80744b0 0x7f4db80769c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc15c830 tx=0x7f4dc0007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.537+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4dcc0d0360 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.746+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dcc0d3070 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.746+0000 7f4db3fff640 1 -- 172.21.15.80:0/1521670485 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5187 (secure 0 0 0) 0x7f4dbc088380 con 0x7f4dcc0d41b0 2024-04-25T15:45:02.746 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:02.746 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:50.296421+0000","modified":"2024-04-25T15:44:53.303749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5886":{"gid":5886,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3351222677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3351222677},{"type":"v1","addr":"172.21.15.80:6837","nonce":3351222677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5886,"qdb_cluster":[5886]},"id":3}]} 2024-04-25T15:45:02.747 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T15:45:02.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4db80744b0 msgr2=0x7f4db80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4db80744b0 0x7f4db80769c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc15c830 tx=0x7f4dc0007de0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 msgr2=0x7f4dcc162ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc162ad0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000c00 tx=0x7f4dbc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 shutdown_connections 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4db80744b0 0x7f4db80769c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dcc0cfa10 0x7f4dcc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dcc1602a0 0x7f4dcc1f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 --2- 172.21.15.80:0/1521670485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dcc0d41b0 0x7f4dcc162ad0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 >> 172.21.15.80:0/1521670485 conn(0x7f4dcc06e9f0 msgr2=0x7f4dcc0b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 shutdown_connections 2024-04-25T15:45:02.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.748+0000 7f4dd2049640 1 -- 172.21.15.80:0/1521670485 wait complete. 2024-04-25T15:45:02.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.869+0000 7fa2c9f6c640 1 Processor -- start 2024-04-25T15:45:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.869+0000 7fa2c9f6c640 1 -- start start 2024-04-25T15:45:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c9f6c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2c40d22c0 0x7fa2c40d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c9f6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c41626e0 0x7fa2c4162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c9f6c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa2c4163030 0x7fa2c40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c9f6c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c409cd00 con 0x7fa2c40d22c0 2024-04-25T15:45:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c9f6c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c40cfe50 con 0x7fa2c4163030 2024-04-25T15:45:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c9f6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c40d37e0 con 0x7fa2c41626e0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2c40d22c0 0x7fa2c40d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2c40d22c0 0x7fa2c40d26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34698/0 (socket says 172.21.15.80:34698) 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 -- 172.21.15.80:0/1575923648 learned_addr learned my addr 172.21.15.80:0/1575923648 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c2ffd640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c41626e0 0x7fa2c4162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c3fff640 1 --2- 172.21.15.80:0/1575923648 >> v2:172.21.15.195:3300/0 conn(0x7fa2c4163030 0x7fa2c40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 -- 172.21.15.80:0/1575923648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c41626e0 msgr2=0x7fa2c4162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c41626e0 0x7fa2c4162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 -- 172.21.15.80:0/1575923648 >> v2:172.21.15.195:3300/0 conn(0x7fa2c4163030 msgr2=0x7fa2c40b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 --2- 172.21.15.80:0/1575923648 >> v2:172.21.15.195:3300/0 conn(0x7fa2c4163030 0x7fa2c40b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c37fe640 1 -- 172.21.15.80:0/1575923648 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c40b91c0 con 0x7fa2c40d22c0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.870+0000 7fa2c2ffd640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c41626e0 0x7fa2c4162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.871+0000 7fa2c37fe640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c40d22c0 0x7fa2c40d26d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4074330 tx=0x7fa2b402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df28db5c6a3862b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.871+0000 7fa2c27fc640 1 -- 172.21.15.80:0/1575923648 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b402ade0 con 0x7fa2c40d22c0 2024-04-25T15:45:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.871+0000 7fa2c27fc640 1 -- 172.21.15.80:0/1575923648 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b4004030 con 0x7fa2c40d22c0 2024-04-25T15:45:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.871+0000 7fa2c27fc640 1 -- 172.21.15.80:0/1575923648 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4004460 con 0x7fa2c40d22c0 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1575923648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c40d22c0 msgr2=0x7fa2c40d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c40d22c0 0x7fa2c40d26d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4074330 tx=0x7fa2b402a0d0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1575923648 shutdown_connections 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1575923648 >> v2:172.21.15.195:3300/0 conn(0x7fa2c4163030 0x7fa2c40b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c41626e0 0x7fa2c4162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1575923648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c40d22c0 0x7fa2c40d26d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1575923648 >> 172.21.15.80:0/1575923648 conn(0x7fa2c40d0450 msgr2=0x7fa2c40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1575923648 shutdown_connections 2024-04-25T15:45:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.872+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1575923648 wait complete. 2024-04-25T15:45:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.874+0000 7fa2c9f6c640 1 Processor -- start 2024-04-25T15:45:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.874+0000 7fa2c9f6c640 1 -- start start 2024-04-25T15:45:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c9f6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c40d22c0 0x7fa2c4153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c9f6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 0x7fa2c415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c9f6c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c4163030 0x7fa2c41577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c9f6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c409d190 con 0x7fa2c41626e0 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c9f6c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4163440 con 0x7fa2c4163030 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c9f6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c40d47e0 con 0x7fa2c40d22c0 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 0x7fa2c415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 0x7fa2c415a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34708/0 (socket says 172.21.15.80:34708) 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.875+0000 7fa2c2ffd640 1 -- 172.21.15.80:0/1148895517 learned_addr learned my addr 172.21.15.80:0/1148895517 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c2ffd640 1 -- 172.21.15.80:0/1148895517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c40d22c0 msgr2=0x7fa2c4153760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c2ffd640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c40d22c0 0x7fa2c4153760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c2ffd640 1 -- 172.21.15.80:0/1148895517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c4163030 msgr2=0x7fa2c41577e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c2ffd640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c4163030 0x7fa2c41577e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c2ffd640 1 -- 172.21.15.80:0/1148895517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c40cc310 con 0x7fa2c41626e0 2024-04-25T15:45:02.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c2ffd640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 0x7fa2c415a290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800d830 tx=0x7fa2b800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8018070 con 0x7fa2c41626e0 2024-04-25T15:45:02.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b800be10 con 0x7fa2c41626e0 2024-04-25T15:45:02.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8004250 con 0x7fa2c41626e0 2024-04-25T15:45:02.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c4153ca0 con 0x7fa2c41626e0 2024-04-25T15:45:02.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.876+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c40cc8d0 con 0x7fa2c41626e0 2024-04-25T15:45:02.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.877+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c406a100 con 0x7fa2c41626e0 2024-04-25T15:45:02.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.877+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa2b80098b0 con 0x7fa2c41626e0 2024-04-25T15:45:02.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.878+0000 7fa2abfff640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2b00744b0 0x7fa2b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:02.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.878+0000 7fa2c37fe640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2b00744b0 0x7fa2b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:02.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.878+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fa2b8095620 con 0x7fa2c41626e0 2024-04-25T15:45:02.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.879+0000 7fa2c37fe640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2b00744b0 0x7fa2b00769c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4033000 tx=0x7fa2b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:02.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:02.883+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2b805fc20 con 0x7fa2c41626e0 2024-04-25T15:45:03.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.061+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2c40c7060 con 0x7fa2c41626e0 2024-04-25T15:45:03.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.062+0000 7fa2abfff640 1 -- 172.21.15.80:0/1148895517 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16930 (secure 0 0 0) 0x7fa2b805f520 con 0x7fa2c41626e0 2024-04-25T15:45:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:03.062 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:51.926717+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2b00744b0 msgr2=0x7fa2b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2b00744b0 0x7fa2b00769c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4033000 tx=0x7fa2b402e000 comp rx=0 tx=0).stop 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 msgr2=0x7fa2c415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 0x7fa2c415a290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800d830 tx=0x7fa2b800dcf0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 shutdown_connections 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2b00744b0 0x7fa2b00769c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c4163030 0x7fa2c41577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2c41626e0 0x7fa2c415a290 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 --2- 172.21.15.80:0/1148895517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2c40d22c0 0x7fa2c4153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 >> 172.21.15.80:0/1148895517 conn(0x7fa2c40d0450 msgr2=0x7fa2c40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 shutdown_connections 2024-04-25T15:45:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.064+0000 7fa2c9f6c640 1 -- 172.21.15.80:0/1148895517 wait complete. 2024-04-25T15:45:03.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:44:48.548707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:44:49.239267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:03.076 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:03.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.186+0000 7fb28795f640 1 Processor -- start 2024-04-25T15:45:03.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.186+0000 7fb28795f640 1 -- start start 2024-04-25T15:45:03.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.187+0000 7fb28795f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb28015d760 0x7fb280156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.187+0000 7fb28795f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2800b6b50 con 0x7fb280160ad0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.187+0000 7fb28795f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2800b6870 con 0x7fb28006dce0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.187+0000 7fb28795f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb28015cc80 con 0x7fb28015d760 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb284efa640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb280160ad0 0x7fb28006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39676/0 (socket says 172.21.15.80:39676) 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb284efa640 1 -- 172.21.15.80:0/1449085327 learned_addr learned my addr 172.21.15.80:0/1449085327 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb2856fb640 1 --2- 172.21.15.80:0/1449085327 >> v2:172.21.15.195:3300/0 conn(0x7fb28015d760 0x7fb280156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295631074 0 0) 0x7fb2800b6b50 con 0x7fb280160ad0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb26c003520 con 0x7fb280160ad0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 822938733 0 0) 0x7fb26c003520 con 0x7fb280160ad0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 >> v2:172.21.15.195:3300/0 conn(0x7fb28015d760 msgr2=0x7fb280156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 --2- 172.21.15.80:0/1449085327 >> v2:172.21.15.195:3300/0 conn(0x7fb28015d760 0x7fb280156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 >> v1:172.21.15.195:6789/0 conn(0x7fb28006dce0 legacy=0x7fb2800b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28015cf60 con 0x7fb280160ad0 2024-04-25T15:45:03.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb270001670 con 0x7fb280160ad0 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 >> v1:172.21.15.80:6789/0 conn(0x7fb280160ad0 legacy=0x7fb28006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb26c0039b0 0x7fb26c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb26c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb26c0051c0 0x7fb26c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb28015cc80 con 0x7fb26c004800 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c00c160 con 0x7fb26c0051c0 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb26c00c360 con 0x7fb26c0039b0 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb284efa640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb26c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb285efc640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb26c0051c0 0x7fb26c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.188+0000 7fb2856fb640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb26c0039b0 0x7fb26c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb284efa640 1 -- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb26c0039b0 msgr2=0x7fb26c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb284efa640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb26c0039b0 0x7fb26c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb284efa640 1 -- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb26c0051c0 msgr2=0x7fb26c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb284efa640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb26c0051c0 0x7fb26c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb285efc640 1 -- 172.21.15.80:0/1449085327 reap_dead start 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb284efa640 1 -- 172.21.15.80:0/1449085327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c003520 con 0x7fb26c004800 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.189+0000 7fb284efa640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb26c004c10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb2800748e0 tx=0x7fb26c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f4736d37bce007 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270007d10 con 0x7fb26c004800 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb270005ad0 con 0x7fb26c004800 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb277fff640 1 -- 172.21.15.80:0/1449085327 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270007070 con 0x7fb26c004800 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 -- 172.21.15.80:0/1449085327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 msgr2=0x7fb26c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb26c004c10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb2800748e0 tx=0x7fb26c005830 comp rx=0 tx=0).stop 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 -- 172.21.15.80:0/1449085327 shutdown_connections 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 --2- 172.21.15.80:0/1449085327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb26c004c10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 -- 172.21.15.80:0/1449085327 >> 172.21.15.80:0/1449085327 conn(0x7fb2800734b0 msgr2=0x7fb2800738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 -- 172.21.15.80:0/1449085327 shutdown_connections 2024-04-25T15:45:03.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.190+0000 7fb28795f640 1 -- 172.21.15.80:0/1449085327 wait complete. 2024-04-25T15:45:03.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.192+0000 7fb28795f640 1 Processor -- start 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.192+0000 7fb28795f640 1 -- start start 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb28795f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb28009bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb28795f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb280150f80 0x7fb28009ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb28795f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb280151390 0x7fb28009f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb28795f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800b6510 con 0x7fb26c004800 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb28795f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800711f0 con 0x7fb280150f80 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb28795f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb280160ee0 con 0x7fb280151390 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb2856fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb28009bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb2856fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb28009bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34726/0 (socket says 172.21.15.80:34726) 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.193+0000 7fb2856fb640 1 -- 172.21.15.80:0/1375086964 learned_addr learned my addr 172.21.15.80:0/1375086964 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb2856fb640 1 -- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb280151390 msgr2=0x7fb28009f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb285efc640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb280151390 0x7fb28009f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb284efa640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb280150f80 0x7fb28009ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb2856fb640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb280151390 0x7fb28009f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb2856fb640 1 -- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb280150f80 msgr2=0x7fb28009ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb2856fb640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb280150f80 0x7fb28009ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb2856fb640 1 -- 172.21.15.80:0/1375086964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb280152a90 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb285efc640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb280151390 0x7fb28009f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb2856fb640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb28009bb00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb27c012ab0 tx=0x7fb27c012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00b040 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c017070 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb280152d70 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c013660 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.194+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb280153330 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.195+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28006a100 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.196+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb27c019030 con 0x7fb26c004800 2024-04-25T15:45:03.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.196+0000 7fb275ffb640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2640744e0 0x7fb2640769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.196+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fb27c096d30 con 0x7fb26c004800 2024-04-25T15:45:03.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.196+0000 7fb284efa640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2640744e0 0x7fb2640769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.197+0000 7fb284efa640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2640744e0 0x7fb2640769f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb270032000 tx=0x7fb270034040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.201+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb27c061330 con 0x7fb26c004800 2024-04-25T15:45:03.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.378+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2800b2c40 con 0x7fb26c004800 2024-04-25T15:45:03.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.379+0000 7fb275ffb640 1 -- 172.21.15.80:0/1375086964 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fb27c060c30 con 0x7fb26c004800 2024-04-25T15:45:03.379 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2640744e0 msgr2=0x7fb2640769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2640744e0 0x7fb2640769f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb270032000 tx=0x7fb270034040 comp rx=0 tx=0).stop 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 msgr2=0x7fb28009bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb28009bb00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb27c012ab0 tx=0x7fb27c012f70 comp rx=0 tx=0).stop 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 shutdown_connections 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2640744e0 0x7fb2640769f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb280151390 0x7fb28009f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb280150f80 0x7fb28009ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 --2- 172.21.15.80:0/1375086964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26c004800 0x7fb28009bb00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 >> 172.21.15.80:0/1375086964 conn(0x7fb2800734b0 msgr2=0x7fb280154980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:03.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 shutdown_connections 2024-04-25T15:45:03.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.381+0000 7fb28795f640 1 -- 172.21.15.80:0/1375086964 wait complete. 2024-04-25T15:45:03.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:45:03.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.502+0000 7f6113f72640 1 Processor -- start 2024-04-25T15:45:03.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.502+0000 7f6113f72640 1 -- start start 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f6113f72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f6113f72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f610c0718d0 0x7f610c071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f6113f72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c072220 con 0x7f610c0d2010 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f6113f72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f610c0cef30 con 0x7f610c0718d0 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f6113f72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0b31c0 con 0x7f610c0b2db0 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f610c0718d0 0x7f610c071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f610c0718d0 0x7f610c071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34734/0 (socket says 172.21.15.80:34734) 2024-04-25T15:45:03.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 -- 172.21.15.80:0/2268600015 learned_addr learned my addr 172.21.15.80:0/2268600015 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f6111d0e640 1 --2- 172.21.15.80:0/2268600015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 -- 172.21.15.80:0/2268600015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 msgr2=0x7f610c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 --2- 172.21.15.80:0/2268600015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 -- 172.21.15.80:0/2268600015 >> v1:172.21.15.195:6789/0 conn(0x7f610c0d2010 legacy=0x7f610c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.504+0000 7f611250f640 1 -- 172.21.15.80:0/2268600015 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c0ce640 con 0x7f610c0718d0 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.505+0000 7f611250f640 1 --2- 172.21.15.80:0/2268600015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c071ce0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6104009870 tx=0x7f610402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6acfe4eb42f601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.505+0000 7f6110d0c640 1 -- 172.21.15.80:0/2268600015 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104037070 con 0x7f610c0718d0 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.505+0000 7f6110d0c640 1 -- 172.21.15.80:0/2268600015 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104032440 con 0x7f610c0718d0 2024-04-25T15:45:03.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.505+0000 7f6110d0c640 1 -- 172.21.15.80:0/2268600015 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104032810 con 0x7f610c0718d0 2024-04-25T15:45:03.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 -- 172.21.15.80:0/2268600015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 msgr2=0x7f610c071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 --2- 172.21.15.80:0/2268600015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c071ce0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6104009870 tx=0x7f610402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 -- 172.21.15.80:0/2268600015 shutdown_connections 2024-04-25T15:45:03.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 --2- 172.21.15.80:0/2268600015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c071ce0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 --2- 172.21.15.80:0/2268600015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 -- 172.21.15.80:0/2268600015 >> 172.21.15.80:0/2268600015 conn(0x7f610c0d3a30 msgr2=0x7f610c0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:03.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 -- 172.21.15.80:0/2268600015 shutdown_connections 2024-04-25T15:45:03.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.506+0000 7f6113f72640 1 -- 172.21.15.80:0/2268600015 wait complete. 2024-04-25T15:45:03.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.507+0000 7f6113f72640 1 Processor -- start 2024-04-25T15:45:03.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.508+0000 7f6113f72640 1 -- start start 2024-04-25T15:45:03.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6113f72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6113f72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c0b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6113f72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610c0d2010 0x7f610c0b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6113f72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0d2840 con 0x7f610c0718d0 2024-04-25T15:45:03.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6113f72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1605d0 con 0x7f610c0d2010 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6113f72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0ce8e0 con 0x7f610c0b2db0 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c1590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34738/0 (socket says 172.21.15.80:34738) 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 -- 172.21.15.80:0/3623358325 learned_addr learned my addr 172.21.15.80:0/3623358325 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f611250f640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610c0d2010 0x7f610c0b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f611150d640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c0b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 -- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 msgr2=0x7f610c0b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c0b7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 -- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610c0d2010 msgr2=0x7f610c0b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610c0d2010 0x7f610c0b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 -- 172.21.15.80:0/3623358325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c0b0d90 con 0x7f610c0718d0 2024-04-25T15:45:03.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f6111d0e640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c1590c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6108007e30 tx=0x7f610800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.509+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108014620 con 0x7f610c0718d0 2024-04-25T15:45:03.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.510+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6108019070 con 0x7f610c0718d0 2024-04-25T15:45:03.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.510+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c0b1030 con 0x7f610c0718d0 2024-04-25T15:45:03.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.510+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108014a00 con 0x7f610c0718d0 2024-04-25T15:45:03.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.510+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c0b15f0 con 0x7f610c0718d0 2024-04-25T15:45:03.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.510+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c06a100 con 0x7f610c0718d0 2024-04-25T15:45:03.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.511+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6108014ba0 con 0x7f610c0718d0 2024-04-25T15:45:03.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.511+0000 7f61027fc640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.512+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f61080959c0 con 0x7f610c0718d0 2024-04-25T15:45:03.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.512+0000 7f611150d640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.512+0000 7f611150d640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f610c15e850 tx=0x7f60fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.516+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6108097e20 con 0x7f610c0718d0 2024-04-25T15:45:03.654 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:03.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:03.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.695+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f610c0b99b0 con 0x7f610c0718d0 2024-04-25T15:45:03.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.696+0000 7f61027fc640 1 -- 172.21.15.80:0/3623358325 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f6108023020 con 0x7f610c0718d0 2024-04-25T15:45:03.696 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.697+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 msgr2=0x7f60f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.697+0000 7f6113f72640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f610c15e850 tx=0x7f60fc009040 comp rx=0 tx=0).stop 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.697+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 msgr2=0x7f610c1590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.697+0000 7f6113f72640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c1590c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6108007e30 tx=0x7f610800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 shutdown_connections 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60f00744b0 0x7f60f00769c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f610c0d2010 0x7f610c0b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f610c0b2db0 0x7f610c0b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 --2- 172.21.15.80:0/3623358325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f610c0718d0 0x7f610c1590c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 >> 172.21.15.80:0/3623358325 conn(0x7f610c0d3a30 msgr2=0x7f610c161800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 shutdown_connections 2024-04-25T15:45:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.698+0000 7f6113f72640 1 -- 172.21.15.80:0/3623358325 wait complete. 2024-04-25T15:45:03.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:45:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.859+0000 7f4b11c27640 1 Processor -- start 2024-04-25T15:45:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.859+0000 7f4b11c27640 1 -- start start 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b11c27640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b0c0b2b80 0x7f4b0c15e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b11c27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cee90 0x7f4b0c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b11c27640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0c0d0cd0 con 0x7f4b0c0d08c0 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b11c27640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4b0c161b00 con 0x7f4b0c0b2b80 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b11c27640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0c161dc0 con 0x7f4b0c0cee90 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b0b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b0c0b2b80 0x7f4b0c15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b0b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b0c0b2b80 0x7f4b0c15e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34740/0 (socket says 172.21.15.80:34740) 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b0b7fe640 1 -- 172.21.15.80:0/4075996617 learned_addr learned my addr 172.21.15.80:0/4075996617 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b0affd640 1 --2- 172.21.15.80:0/4075996617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cee90 0x7f4b0c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b0b7fe640 1 -- 172.21.15.80:0/4075996617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cee90 msgr2=0x7f4b0c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.860+0000 7f4b0b7fe640 1 --2- 172.21.15.80:0/4075996617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cee90 0x7f4b0c0d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.861+0000 7f4b0b7fe640 1 -- 172.21.15.80:0/4075996617 >> v1:172.21.15.195:6789/0 conn(0x7f4b0c0d08c0 legacy=0x7f4b0c071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:03.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.861+0000 7f4b0b7fe640 1 -- 172.21.15.80:0/4075996617 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c1620a0 con 0x7f4b0c0b2b80 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.861+0000 7f4b0b7fe640 1 --2- 172.21.15.80:0/4075996617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c15e060 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dc1eb6495b0e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.861+0000 7f4b0a7fc640 1 -- 172.21.15.80:0/4075996617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc037070 con 0x7f4b0c0b2b80 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.861+0000 7f4b0a7fc640 1 -- 172.21.15.80:0/4075996617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc032440 con 0x7f4b0c0b2b80 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.861+0000 7f4b0a7fc640 1 -- 172.21.15.80:0/4075996617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc032810 con 0x7f4b0c0b2b80 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 -- 172.21.15.80:0/4075996617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0b2b80 msgr2=0x7f4b0c15e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 --2- 172.21.15.80:0/4075996617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c15e060 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc02a180 comp rx=0 tx=0).stop 2024-04-25T15:45:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 -- 172.21.15.80:0/4075996617 shutdown_connections 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 --2- 172.21.15.80:0/4075996617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cee90 0x7f4b0c0d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 --2- 172.21.15.80:0/4075996617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c15e060 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 -- 172.21.15.80:0/4075996617 >> 172.21.15.80:0/4075996617 conn(0x7f4b0c0b54a0 msgr2=0x7f4b0c0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 -- 172.21.15.80:0/4075996617 shutdown_connections 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.862+0000 7f4b11c27640 1 -- 172.21.15.80:0/4075996617 wait complete. 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.864+0000 7f4b11c27640 1 Processor -- start 2024-04-25T15:45:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.864+0000 7f4b11c27640 1 -- start start 2024-04-25T15:45:03.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.865+0000 7f4b11c27640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.865+0000 7f4b11c27640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 0x7f4b0c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.865+0000 7f4b11c27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0d08c0 0x7f4b0c1f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.865+0000 7f4b11c27640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c162940 con 0x7f4b0c0cee90 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.865+0000 7f4b11c27640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c162660 con 0x7f4b0c0b2b80 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.865+0000 7f4b11c27640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0c0cf2a0 con 0x7f4b0c0d08c0 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 0x7f4b0c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 0x7f4b0c151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34748/0 (socket says 172.21.15.80:34748) 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 -- 172.21.15.80:0/3265288652 learned_addr learned my addr 172.21.15.80:0/3265288652 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0b7fe640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0bfff640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0d08c0 0x7f4b0c1f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 -- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0d08c0 msgr2=0x7f4b0c1f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0d08c0 0x7f4b0c1f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 -- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c0b2b80 msgr2=0x7f4b0c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 -- 172.21.15.80:0/3265288652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c160bd0 con 0x7f4b0c0cee90 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b0affd640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 0x7f4b0c151ac0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000d5f0 tx=0x7f4b0000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000125f0 con 0x7f4b0c0cee90 2024-04-25T15:45:03.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00019070 con 0x7f4b0c0cee90 2024-04-25T15:45:03.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c0cab70 con 0x7f4b0c0cee90 2024-04-25T15:45:03.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000129d0 con 0x7f4b0c0cee90 2024-04-25T15:45:03.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.866+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c0cb130 con 0x7f4b0c0cee90 2024-04-25T15:45:03.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.867+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0c06a100 con 0x7f4b0c0cee90 2024-04-25T15:45:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.868+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4b00012b70 con 0x7f4b0c0cee90 2024-04-25T15:45:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.869+0000 7f4af3fff640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4af80744e0 0x7f4af80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.869+0000 7f4b0b7fe640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4af80744e0 0x7f4af80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.869+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f4b00095580 con 0x7f4b0c0cee90 2024-04-25T15:45:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.869+0000 7f4b0b7fe640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4af80744e0 0x7f4af80769f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4afc034000 tx=0x7f4afc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:03.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:03.873+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b0005f650 con 0x7f4b0c0cee90 2024-04-25T15:45:04.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.051+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4b0c160960 con 0x7f4b0c0cee90 2024-04-25T15:45:04.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.051+0000 7f4af3fff640 1 -- 172.21.15.80:0/3265288652 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f4b00063950 con 0x7f4b0c0cee90 2024-04-25T15:45:04.052 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4af80744e0 msgr2=0x7f4af80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4af80744e0 0x7f4af80769f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4afc034000 tx=0x7f4afc02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 msgr2=0x7f4b0c151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 0x7f4b0c151ac0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000d5f0 tx=0x7f4b0000dab0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 shutdown_connections 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4af80744e0 0x7f4af80769f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0d08c0 0x7f4b0c1f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b0c0cee90 0x7f4b0c151ac0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 --2- 172.21.15.80:0/3265288652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c0b2b80 0x7f4b0c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 >> 172.21.15.80:0/3265288652 conn(0x7f4b0c0b54a0 msgr2=0x7f4b0c15c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:04.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 shutdown_connections 2024-04-25T15:45:04.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.053+0000 7f4b11c27640 1 -- 172.21.15.80:0/3265288652 wait complete. 2024-04-25T15:45:04.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:04.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.171+0000 7fca10b06640 1 Processor -- start 2024-04-25T15:45:04.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.171+0000 7fca10b06640 1 -- start start 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca10b06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 0x7fca0c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca10b06640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 0x7fca0c0d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca10b06640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca0c06c660 con 0x7fca0c0cf320 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca10b06640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fca0c06cc40 con 0x7fca0c0d2830 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca10b06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c0d3180 con 0x7fca0c09bea0 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca09d9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 0x7fca0c0d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca0a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 0x7fca0c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca0a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 0x7fca0c0ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:58152/0 (socket says 172.21.15.80:58152) 2024-04-25T15:45:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca09d9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 0x7fca0c0d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:42052/0 (socket says 172.21.15.80:42052) 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca0a59c640 1 -- 172.21.15.80:0/1456182233 learned_addr learned my addr 172.21.15.80:0/1456182233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.173+0000 7fca0ad9d640 1 --1- 172.21.15.80:0/1456182233 >> v1:172.21.15.195:6789/0 conn(0x7fca0c0cf320 0x7fca0c0cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:56150/0 (socket says 172.21.15.80:56150) 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.174+0000 7fca0a59c640 1 -- 172.21.15.80:0/1456182233 >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 msgr2=0x7fca0c0d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.174+0000 7fca0a59c640 1 --2- 172.21.15.80:0/1456182233 >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 0x7fca0c0d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.174+0000 7fca0a59c640 1 -- 172.21.15.80:0/1456182233 >> v1:172.21.15.195:6789/0 conn(0x7fca0c0cf320 legacy=0x7fca0c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.174+0000 7fca0a59c640 1 -- 172.21.15.80:0/1456182233 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c0ced60 con 0x7fca0c09bea0 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.174+0000 7fca0959a640 1 -- 172.21.15.80:0/1456182233 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985793497 0 0) 0x7fca0c06c660 con 0x7fca0c0cf320 2024-04-25T15:45:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.174+0000 7fca09d9b640 1 --2- 172.21.15.80:0/1456182233 >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 0x7fca0c0d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca0a59c640 1 --2- 172.21.15.80:0/1456182233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 0x7fca0c0ce380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009e50 tx=0x7fc9fc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae5e9f36d30abe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca0959a640 1 -- 172.21.15.80:0/1456182233 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc036070 con 0x7fca0c09bea0 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca0959a640 1 -- 172.21.15.80:0/1456182233 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc031600 con 0x7fca0c09bea0 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca0959a640 1 -- 172.21.15.80:0/1456182233 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0319d0 con 0x7fca0c09bea0 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 -- 172.21.15.80:0/1456182233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 msgr2=0x7fca0c0ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 --2- 172.21.15.80:0/1456182233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 0x7fca0c0ce380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009e50 tx=0x7fc9fc02a710 comp rx=0 tx=0).stop 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 -- 172.21.15.80:0/1456182233 shutdown_connections 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 --2- 172.21.15.80:0/1456182233 >> v2:172.21.15.195:3300/0 conn(0x7fca0c0d2830 0x7fca0c0d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 --2- 172.21.15.80:0/1456182233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c09bea0 0x7fca0c0ce380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 -- 172.21.15.80:0/1456182233 >> 172.21.15.80:0/1456182233 conn(0x7fca0c0b7620 msgr2=0x7fca0c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.175+0000 7fca10b06640 1 -- 172.21.15.80:0/1456182233 shutdown_connections 2024-04-25T15:45:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.176+0000 7fca10b06640 1 -- 172.21.15.80:0/1456182233 wait complete. 2024-04-25T15:45:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.177+0000 7fca10b06640 1 Processor -- start 2024-04-25T15:45:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.177+0000 7fca10b06640 1 -- start start 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca10b06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 0x7fca0c09e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca10b06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c0cf320 0x7fca0c160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca10b06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca0c0d2830 0x7fca0c1f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca10b06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c0cf040 con 0x7fca0c09bea0 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca10b06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c15e420 con 0x7fca0c0d2830 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca10b06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c0ce8c0 con 0x7fca0c0cf320 2024-04-25T15:45:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 0x7fca0c09e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 0x7fca0c09e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34752/0 (socket says 172.21.15.80:34752) 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 -- 172.21.15.80:0/3259405073 learned_addr learned my addr 172.21.15.80:0/3259405073 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca09d9b640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c0cf320 0x7fca0c160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0ad9d640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca0c0d2830 0x7fca0c1f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 -- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c0cf320 msgr2=0x7fca0c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c0cf320 0x7fca0c160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 -- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca0c0d2830 msgr2=0x7fca0c1f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca0c0d2830 0x7fca0c1f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 -- 172.21.15.80:0/3259405073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c09e5b0 con 0x7fca0c09bea0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fca0a59c640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 0x7fca0c09e070 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009e50 tx=0x7fc9fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.179+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc041030 con 0x7fca0c09bea0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.180+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc031400 con 0x7fca0c09bea0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.180+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c15ef70 con 0x7fca0c09bea0 2024-04-25T15:45:04.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.180+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc036040 con 0x7fca0c09bea0 2024-04-25T15:45:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.180+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c15f530 con 0x7fca0c09bea0 2024-04-25T15:45:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.180+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca0c06a100 con 0x7fca0c09bea0 2024-04-25T15:45:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.181+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc9fc044070 con 0x7fca0c09bea0 2024-04-25T15:45:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.181+0000 7fc9faffd640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9ec0744e0 0x7fc9ec0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.182+0000 7fca09d9b640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9ec0744e0 0x7fc9ec0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.182+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fc9fc0b5eb0 con 0x7fca0c09bea0 2024-04-25T15:45:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.182+0000 7fca09d9b640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9ec0744e0 0x7fc9ec0769f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0c9420 tx=0x7fca00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.186+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9fc04b070 con 0x7fca0c09bea0 2024-04-25T15:45:04.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.396+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca0c0b7db0 con 0x7fca0c09bea0 2024-04-25T15:45:04.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.397+0000 7fc9faffd640 1 -- 172.21.15.80:0/3259405073 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5187 (secure 0 0 0) 0x7fc9fc0804f0 con 0x7fca0c09bea0 2024-04-25T15:45:04.397 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:04.397 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:50.296421+0000","modified":"2024-04-25T15:44:53.303749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5886":{"gid":5886,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3351222677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3351222677},{"type":"v1","addr":"172.21.15.80:6837","nonce":3351222677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5886,"qdb_cluster":[5886]},"id":3}]} 2024-04-25T15:45:04.397 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9ec0744e0 msgr2=0x7fc9ec0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9ec0744e0 0x7fc9ec0769f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0c9420 tx=0x7fca00008040 comp rx=0 tx=0).stop 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 msgr2=0x7fca0c09e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 0x7fca0c09e070 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009e50 tx=0x7fc9fc004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 shutdown_connections 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9ec0744e0 0x7fc9ec0769f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.398+0000 7fca10b06640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca0c0d2830 0x7fca0c1f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.399+0000 7fca10b06640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca0c0cf320 0x7fca0c160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.399+0000 7fca10b06640 1 --2- 172.21.15.80:0/3259405073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0c09bea0 0x7fca0c09e070 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.399+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 >> 172.21.15.80:0/3259405073 conn(0x7fca0c0b7620 msgr2=0x7fca0c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:04.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.399+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 shutdown_connections 2024-04-25T15:45:04.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.399+0000 7fca10b06640 1 -- 172.21.15.80:0/3259405073 wait complete. 2024-04-25T15:45:04.410 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.517+0000 7f2843e25640 1 Processor -- start 2024-04-25T15:45:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.517+0000 7f2843e25640 1 -- start start 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f2843e25640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f283c0d41b0 0x7f283c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f2843e25640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c1602a0 0x7f283c0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f2843e25640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283c0b7fa0 con 0x7f283c0b7b90 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f2843e25640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f283c0d59d0 con 0x7f283c0d41b0 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f2843e25640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f283c163fb0 con 0x7f283c1602a0 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f2841bc1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f283c0d41b0 0x7f283c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f28413c0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c1602a0 0x7f283c0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.518+0000 7f28423c2640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f283c0b7b90 0x7f283c0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54346/0 (socket says 172.21.15.80:54346) 2024-04-25T15:45:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.519+0000 7f28423c2640 1 -- 172.21.15.80:0/2005727652 learned_addr learned my addr 172.21.15.80:0/2005727652 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.519+0000 7f28413c0640 1 -- 172.21.15.80:0/2005727652 >> v2:172.21.15.195:3300/0 conn(0x7f283c0d41b0 msgr2=0x7f283c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.519+0000 7f28413c0640 1 --2- 172.21.15.80:0/2005727652 >> v2:172.21.15.195:3300/0 conn(0x7f283c0d41b0 0x7f283c0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.519+0000 7f28413c0640 1 -- 172.21.15.80:0/2005727652 >> v1:172.21.15.195:6789/0 conn(0x7f283c0b7b90 legacy=0x7f283c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.519+0000 7f28413c0640 1 -- 172.21.15.80:0/2005727652 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c164270 con 0x7f283c1602a0 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.520+0000 7f28413c0640 1 --2- 172.21.15.80:0/2005727652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c1602a0 0x7f283c0b7650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f282c0097a0 tx=0x7f282c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a816f97a5b09c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.520+0000 7f2840bbf640 1 -- 172.21.15.80:0/2005727652 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c037070 con 0x7f283c1602a0 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.520+0000 7f2840bbf640 1 -- 172.21.15.80:0/2005727652 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c032440 con 0x7f283c1602a0 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.520+0000 7f2840bbf640 1 -- 172.21.15.80:0/2005727652 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c032810 con 0x7f283c1602a0 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.520+0000 7f2843e25640 1 -- 172.21.15.80:0/2005727652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c1602a0 msgr2=0x7f283c0b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.520+0000 7f2843e25640 1 --2- 172.21.15.80:0/2005727652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c1602a0 0x7f283c0b7650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f282c0097a0 tx=0x7f282c02a180 comp rx=0 tx=0).stop 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.521+0000 7f2843e25640 1 -- 172.21.15.80:0/2005727652 shutdown_connections 2024-04-25T15:45:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.521+0000 7f2843e25640 1 --2- 172.21.15.80:0/2005727652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c1602a0 0x7f283c0b7650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.521+0000 7f2843e25640 1 --2- 172.21.15.80:0/2005727652 >> v2:172.21.15.195:3300/0 conn(0x7f283c0d41b0 0x7f283c0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.521+0000 7f2843e25640 1 -- 172.21.15.80:0/2005727652 >> 172.21.15.80:0/2005727652 conn(0x7f283c06e9f0 msgr2=0x7f283c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.521+0000 7f2843e25640 1 -- 172.21.15.80:0/2005727652 shutdown_connections 2024-04-25T15:45:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.521+0000 7f2843e25640 1 -- 172.21.15.80:0/2005727652 wait complete. 2024-04-25T15:45:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.522+0000 7f2843e25640 1 Processor -- start 2024-04-25T15:45:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.522+0000 7f2843e25640 1 -- start start 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 0x7f283c14a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c0d41b0 0x7f283c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f283c1602a0 0x7f283c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f283c164b10 con 0x7f283c0b7b90 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f283c164830 con 0x7f283c1602a0 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f283c0b4fd0 con 0x7f283c0d41b0 2024-04-25T15:45:04.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 0x7f283c14a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 0x7f283c14a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58056/0 (socket says 172.21.15.80:58056) 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 -- 172.21.15.80:0/839381891 learned_addr learned my addr 172.21.15.80:0/839381891 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f28413c0640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c0d41b0 0x7f283c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f28423c2640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f283c1602a0 0x7f283c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 -- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c0d41b0 msgr2=0x7f283c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c0d41b0 0x7f283c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 -- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f283c1602a0 msgr2=0x7f283c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f283c1602a0 0x7f283c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 -- 172.21.15.80:0/839381891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c155e30 con 0x7f283c0b7b90 2024-04-25T15:45:04.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2841bc1640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 0x7f283c14a3c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f283800e8a0 tx=0x7f283800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838017070 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283800c940 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.524+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c156110 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.525+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283800cd30 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.525+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c1566d0 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.526+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283c06a100 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.526+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f283801a070 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.527+0000 7f28327fc640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28200744e0 0x7f28200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.527+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f2838095550 con 0x7f283c0b7b90 2024-04-25T15:45:04.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.527+0000 7f28413c0640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28200744e0 0x7f28200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.527+0000 7f28413c0640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28200744e0 0x7f28200769f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f282c034000 tx=0x7f282c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.531+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f283805f510 con 0x7f283c0b7b90 2024-04-25T15:45:04.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.706+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f283c0b7470 con 0x7f283c0b7b90 2024-04-25T15:45:04.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.707+0000 7f28327fc640 1 -- 172.21.15.80:0/839381891 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16930 (secure 0 0 0) 0x7f2838063810 con 0x7f283c0b7b90 2024-04-25T15:45:04.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:04.707 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:51.926717+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:04.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28200744e0 msgr2=0x7f28200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28200744e0 0x7f28200769f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f282c034000 tx=0x7f282c02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:04.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 msgr2=0x7f283c14a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 0x7f283c14a3c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f283800e8a0 tx=0x7f283800ed60 comp rx=0 tx=0).stop 2024-04-25T15:45:04.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 shutdown_connections 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28200744e0 0x7f28200769f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f283c1602a0 0x7f283c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f283c0d41b0 0x7f283c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 --2- 172.21.15.80:0/839381891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c0b7b90 0x7f283c14a3c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 >> 172.21.15.80:0/839381891 conn(0x7f283c06e9f0 msgr2=0x7f283c162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 shutdown_connections 2024-04-25T15:45:04.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.709+0000 7f2843e25640 1 -- 172.21.15.80:0/839381891 wait complete. 2024-04-25T15:45:04.720 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:45:04.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:04.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.828+0000 7fe4c679f640 1 Processor -- start 2024-04-25T15:45:04.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.828+0000 7fe4c679f640 1 -- start start 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c679f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c00d35f0 0x7fe4c00d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c679f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe4c0160060 0x7fe4c00d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c679f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c00d3c20 con 0x7fe4c00d51e0 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c679f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c00d3a00 con 0x7fe4c0160060 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c679f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00d3050 con 0x7fe4c00d35f0 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c579d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c00d35f0 0x7fe4c00d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c4f9c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe4c0160060 0x7fe4c00d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c5f9e640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe4c00d51e0 0x7fe4c006df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54358/0 (socket says 172.21.15.80:54358) 2024-04-25T15:45:04.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c5f9e640 1 -- 172.21.15.80:0/687153116 learned_addr learned my addr 172.21.15.80:0/687153116 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:04.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c4f9c640 1 -- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c00d35f0 msgr2=0x7fe4c00d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:04.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c4f9c640 1 --2- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c00d35f0 0x7fe4c00d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c4f9c640 1 -- 172.21.15.80:0/687153116 >> v1:172.21.15.195:6789/0 conn(0x7fe4c00d51e0 legacy=0x7fe4c006df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4b7fff640 1 -- 172.21.15.80:0/687153116 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340126681 0 0) 0x7fe4c00d3c20 con 0x7fe4c00d51e0 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.830+0000 7fe4c4f9c640 1 -- 172.21.15.80:0/687153116 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c00d3ee0 con 0x7fe4c0160060 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.831+0000 7fe4c579d640 1 --2- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c00d35f0 0x7fe4c00d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.831+0000 7fe4c4f9c640 1 --2- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c0160060 0x7fe4c00d4ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00097a0 tx=0x7fe4b002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb9e095dfa904b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.831+0000 7fe4b7fff640 1 -- 172.21.15.80:0/687153116 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0037070 con 0x7fe4c0160060 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.831+0000 7fe4b7fff640 1 -- 172.21.15.80:0/687153116 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b002ae50 con 0x7fe4c0160060 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.831+0000 7fe4b7fff640 1 -- 172.21.15.80:0/687153116 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0032660 con 0x7fe4c0160060 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 -- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c0160060 msgr2=0x7fe4c00d4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 --2- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c0160060 0x7fe4c00d4ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00097a0 tx=0x7fe4b002a100 comp rx=0 tx=0).stop 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 -- 172.21.15.80:0/687153116 shutdown_connections 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 --2- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c0160060 0x7fe4c00d4ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 --2- 172.21.15.80:0/687153116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c00d35f0 0x7fe4c00d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 -- 172.21.15.80:0/687153116 >> 172.21.15.80:0/687153116 conn(0x7fe4c00d6050 msgr2=0x7fe4c00d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 -- 172.21.15.80:0/687153116 shutdown_connections 2024-04-25T15:45:04.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.832+0000 7fe4c679f640 1 -- 172.21.15.80:0/687153116 wait complete. 2024-04-25T15:45:04.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.834+0000 7fe4c679f640 1 Processor -- start 2024-04-25T15:45:04.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.834+0000 7fe4c679f640 1 -- start start 2024-04-25T15:45:04.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c679f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 0x7fe4c00cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c679f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c00d51e0 0x7fe4c0157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c679f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c0160060 0x7fe4c0158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c679f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00d4780 con 0x7fe4c00d35f0 2024-04-25T15:45:04.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c679f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00d44a0 con 0x7fe4c00d51e0 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c679f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c0160470 con 0x7fe4c0160060 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c579d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 0x7fe4c00cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c579d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 0x7fe4c00cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58072/0 (socket says 172.21.15.80:58072) 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c579d640 1 -- 172.21.15.80:0/217519474 learned_addr learned my addr 172.21.15.80:0/217519474 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c5f9e640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c0160060 0x7fe4c0158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.835+0000 7fe4c4f9c640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c00d51e0 0x7fe4c0157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c579d640 1 -- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c0160060 msgr2=0x7fe4c0158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c579d640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c0160060 0x7fe4c0158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c579d640 1 -- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c00d51e0 msgr2=0x7fe4c0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c579d640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c00d51e0 0x7fe4c0157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c579d640 1 -- 172.21.15.80:0/217519474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c00cbf10 con 0x7fe4c00d35f0 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c5f9e640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c0160060 0x7fe4c0158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c579d640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 0x7fe4c00cb9d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ec0 tx=0x7fe4bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc018020 con 0x7fe4c00d35f0 2024-04-25T15:45:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc014680 con 0x7fe4c00d35f0 2024-04-25T15:45:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc014a50 con 0x7fe4c00d35f0 2024-04-25T15:45:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c01f96d0 con 0x7fe4c00d35f0 2024-04-25T15:45:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.836+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01f9c90 con 0x7fe4c00d35f0 2024-04-25T15:45:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.837+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c0050740 con 0x7fe4c00d35f0 2024-04-25T15:45:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.838+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe4bc005d10 con 0x7fe4c00d35f0 2024-04-25T15:45:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.838+0000 7fe4b5ffb640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4a40744b0 0x7fe4a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.839+0000 7fe4c4f9c640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4a40744b0 0x7fe4a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.839+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe4bc096110 con 0x7fe4c00d35f0 2024-04-25T15:45:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.839+0000 7fe4c4f9c640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4a40744b0 0x7fe4a40769c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0034000 tx=0x7fe4b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:04.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:04.843+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4bc022030 con 0x7fe4c00d35f0 2024-04-25T15:45:05.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.055+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c006ea10 con 0x7fe4c00d35f0 2024-04-25T15:45:05.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.056+0000 7fe4b5ffb640 1 -- 172.21.15.80:0/217519474 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5187 (secure 0 0 0) 0x7fe4c00cbf10 con 0x7fe4c00d35f0 2024-04-25T15:45:05.056 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:05.057 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:50.296421+0000","modified":"2024-04-25T15:44:53.303749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5886":{"gid":5886,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3351222677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3351222677},{"type":"v1","addr":"172.21.15.80:6837","nonce":3351222677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5886,"qdb_cluster":[5886]},"id":3}]} 2024-04-25T15:45:05.057 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T15:45:05.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4a40744b0 msgr2=0x7fe4a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4a40744b0 0x7fe4a40769c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0034000 tx=0x7fe4b002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:05.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 msgr2=0x7fe4c00cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 0x7fe4c00cb9d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ec0 tx=0x7fe4bc00c490 comp rx=0 tx=0).stop 2024-04-25T15:45:05.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 shutdown_connections 2024-04-25T15:45:05.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4a40744b0 0x7fe4a40769c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4c0160060 0x7fe4c0158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4c00d51e0 0x7fe4c0157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 --2- 172.21.15.80:0/217519474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4c00d35f0 0x7fe4c00cb9d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 >> 172.21.15.80:0/217519474 conn(0x7fe4c00d6050 msgr2=0x7fe4c00cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:05.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 shutdown_connections 2024-04-25T15:45:05.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.058+0000 7fe4c679f640 1 -- 172.21.15.80:0/217519474 wait complete. 2024-04-25T15:45:05.070 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:05.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.178+0000 7fe355670640 1 Processor -- start 2024-04-25T15:45:05.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.178+0000 7fe355670640 1 -- start start 2024-04-25T15:45:05.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.179+0000 7fe355670640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 0x7fe3500d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.179+0000 7fe355670640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3500d33e0 con 0x7fe350072560 2024-04-25T15:45:05.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.179+0000 7fe355670640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3501624d0 con 0x7fe350071950 2024-04-25T15:45:05.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.179+0000 7fe355670640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3501627b0 con 0x7fe3500d2a90 2024-04-25T15:45:05.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.179+0000 7fe34e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe350072560 0x7fe3500b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59778/0 (socket says 172.21.15.80:59778) 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.179+0000 7fe34e7fc640 1 -- 172.21.15.80:0/1728254205 learned_addr learned my addr 172.21.15.80:0/1728254205 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34f7fe640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 0x7fe3500d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073851556 0 0) 0x7fe344001290 con 0x7fe350072560 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe338003520 con 0x7fe350072560 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4065952834 0 0) 0x7fe338003520 con 0x7fe350072560 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 msgr2=0x7fe3500d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 0x7fe3500d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 >> v1:172.21.15.195:6789/0 conn(0x7fe350071950 legacy=0x7fe350161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350162a90 con 0x7fe350072560 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe3440019c0 con 0x7fe350072560 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 >> v1:172.21.15.80:6789/0 conn(0x7fe350072560 legacy=0x7fe3500b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3380039e0 0x7fe338003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe338004800 0x7fe338004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 0x7fe3380052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe3501627b0 con 0x7fe3380039e0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe33800bbb0 con 0x7fe338004800 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe33800bdb0 con 0x7fe3500d2a90 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34effd640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3380039e0 0x7fe338003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34e7fc640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe338004800 0x7fe338004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34f7fe640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 0x7fe3380052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34effd640 1 -- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 msgr2=0x7fe3380052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34effd640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500d2a90 0x7fe3380052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34effd640 1 -- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe338004800 msgr2=0x7fe338004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34effd640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe338004800 0x7fe338004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.180+0000 7fe34effd640 1 -- 172.21.15.80:0/1728254205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338003520 con 0x7fe3380039e0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.181+0000 7fe34effd640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3380039e0 0x7fe338003e50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe340001720 tx=0x7fe338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec19563bb6772403 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.181+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340001370 con 0x7fe3380039e0 2024-04-25T15:45:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.181+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3400052d0 con 0x7fe3380039e0 2024-04-25T15:45:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.181+0000 7fe34dffb640 1 -- 172.21.15.80:0/1728254205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34002abc0 con 0x7fe3380039e0 2024-04-25T15:45:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe355670640 1 -- 172.21.15.80:0/1728254205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3380039e0 msgr2=0x7fe338003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe355670640 1 --2- 172.21.15.80:0/1728254205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3380039e0 0x7fe338003e50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe340001720 tx=0x7fe338005830 comp rx=0 tx=0).stop 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe34f7fe640 1 -- 172.21.15.80:0/1728254205 reap_dead start 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe355670640 1 -- 172.21.15.80:0/1728254205 shutdown_connections 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe355670640 1 -- 172.21.15.80:0/1728254205 >> 172.21.15.80:0/1728254205 conn(0x7fe3500d3ea0 msgr2=0x7fe3500d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe355670640 1 -- 172.21.15.80:0/1728254205 shutdown_connections 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.182+0000 7fe355670640 1 -- 172.21.15.80:0/1728254205 wait complete. 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.184+0000 7fe355670640 1 Processor -- start 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.184+0000 7fe355670640 1 -- start start 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe355670640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3380039e0 0x7fe3500ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe355670640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3500aad20 0x7fe350153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe355670640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 0x7fe3501f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe355670640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500b7690 con 0x7fe3501f4560 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe355670640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe350072970 con 0x7fe3500aad20 2024-04-25T15:45:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe355670640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3500b7810 con 0x7fe3380039e0 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 0x7fe3501f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 0x7fe3501f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58088/0 (socket says 172.21.15.80:58088) 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe34f7fe640 1 -- 172.21.15.80:0/1868985243 learned_addr learned my addr 172.21.15.80:0/1868985243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe34effd640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3380039e0 0x7fe3500ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.185+0000 7fe34e7fc640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3500aad20 0x7fe350153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34f7fe640 1 -- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3380039e0 msgr2=0x7fe3500ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34f7fe640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3380039e0 0x7fe3500ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34f7fe640 1 -- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3500aad20 msgr2=0x7fe350153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34f7fe640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3500aad20 0x7fe350153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34f7fe640 1 -- 172.21.15.80:0/1868985243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350154470 con 0x7fe3501f4560 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34e7fc640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3500aad20 0x7fe350153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe34f7fe640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 0x7fe3501f4970 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe3500d01f0 tx=0x7fe34800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348015430 con 0x7fe3501f4560 2024-04-25T15:45:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34801d070 con 0x7fe3501f4560 2024-04-25T15:45:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348015830 con 0x7fe3501f4560 2024-04-25T15:45:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3500cd890 con 0x7fe3501f4560 2024-04-25T15:45:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.186+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3500cde50 con 0x7fe3501f4560 2024-04-25T15:45:05.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.187+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3500cd600 con 0x7fe3501f4560 2024-04-25T15:45:05.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.188+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe3480159d0 con 0x7fe3501f4560 2024-04-25T15:45:05.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.188+0000 7fe3377fe640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe33c0744e0 0x7fe33c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.188+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe348095c10 con 0x7fe3501f4560 2024-04-25T15:45:05.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.188+0000 7fe34effd640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe33c0744e0 0x7fe33c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.189+0000 7fe34effd640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe33c0744e0 0x7fe33c0769f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe340032000 tx=0x7fe34002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.193+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe348010040 con 0x7fe3501f4560 2024-04-25T15:45:05.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.407+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3500d1e40 con 0x7fe3501f4560 2024-04-25T15:45:05.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.408+0000 7fe3377fe640 1 -- 172.21.15.80:0/1868985243 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5187 (secure 0 0 0) 0x7fe348060210 con 0x7fe3501f4560 2024-04-25T15:45:05.408 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:05.408 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:44:50.296421+0000","modified":"2024-04-25T15:44:53.303749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5886},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5886":{"gid":5886,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3351222677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3351222677},{"type":"v1","addr":"172.21.15.80:6837","nonce":3351222677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5886,"qdb_cluster":[5886]},"id":3}]} 2024-04-25T15:45:05.408 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe33c0744e0 msgr2=0x7fe33c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe33c0744e0 0x7fe33c0769f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe340032000 tx=0x7fe34002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 msgr2=0x7fe3501f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 0x7fe3501f4970 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe3500d01f0 tx=0x7fe34800f580 comp rx=0 tx=0).stop 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 shutdown_connections 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe33c0744e0 0x7fe33c0769f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3501f4560 0x7fe3501f4970 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3500aad20 0x7fe350153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 --2- 172.21.15.80:0/1868985243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3380039e0 0x7fe3500ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 >> 172.21.15.80:0/1868985243 conn(0x7fe3500d3ea0 msgr2=0x7fe3500b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 shutdown_connections 2024-04-25T15:45:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.410+0000 7fe355670640 1 -- 172.21.15.80:0/1868985243 wait complete. 2024-04-25T15:45:05.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:05.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.529+0000 7f6eeb251640 1 Processor -- start 2024-04-25T15:45:05.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.529+0000 7f6eeb251640 1 -- start start 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6eeb251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee415b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6eeb251640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee40ae960 con 0x7f6ee406dce0 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6eeb251640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee40aec40 con 0x7f6ee40d1090 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6eeb251640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee4070470 con 0x7f6ee40afe30 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6ee3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ee406dce0 0x7f6ee40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59788/0 (socket says 172.21.15.80:59788) 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6ee3fff640 1 -- 172.21.15.80:0/3394317146 learned_addr learned my addr 172.21.15.80:0/3394317146 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6ee97ee640 1 --2- 172.21.15.80:0/3394317146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591452723 0 0) 0x7f6ee40ae960 con 0x7f6ee406dce0 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.530+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ecc003520 con 0x7f6ee406dce0 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 278528275 0 0) 0x7f6ee40aec40 con 0x7f6ee40d1090 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ee40ae960 con 0x7f6ee40d1090 2024-04-25T15:45:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092156391 0 0) 0x7f6ecc003520 con 0x7f6ee406dce0 2024-04-25T15:45:05.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee97ee640 1 -- 172.21.15.80:0/3394317146 >> v1:172.21.15.195:6789/0 conn(0x7f6ee40d1090 legacy=0x7f6ee406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee97ee640 1 -- 172.21.15.80:0/3394317146 >> v1:172.21.15.80:6789/0 conn(0x7f6ee406dce0 legacy=0x7f6ee40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee97ee640 1 -- 172.21.15.80:0/3394317146 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee40aef20 con 0x7f6ee40afe30 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.531+0000 7f6ee97ee640 1 --2- 172.21.15.80:0/3394317146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee415b020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009df0 tx=0x7f6edc02a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b75438d597707774 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8001670 con 0x7f6ee40afe30 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc007540 con 0x7f6ee40afe30 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6ee37fe640 1 -- 172.21.15.80:0/3394317146 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0078f0 con 0x7f6ee40afe30 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 -- 172.21.15.80:0/3394317146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 msgr2=0x7f6ee415b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 --2- 172.21.15.80:0/3394317146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee415b020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009df0 tx=0x7f6edc02a610 comp rx=0 tx=0).stop 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 -- 172.21.15.80:0/3394317146 shutdown_connections 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 --2- 172.21.15.80:0/3394317146 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee415b020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 -- 172.21.15.80:0/3394317146 >> 172.21.15.80:0/3394317146 conn(0x7f6ee40d1e20 msgr2=0x7f6ee4073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 -- 172.21.15.80:0/3394317146 shutdown_connections 2024-04-25T15:45:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.532+0000 7f6eeb251640 1 -- 172.21.15.80:0/3394317146 wait complete. 2024-04-25T15:45:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.534+0000 7f6eeb251640 1 Processor -- start 2024-04-25T15:45:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.534+0000 7f6eeb251640 1 -- start start 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.535+0000 7f6eeb251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee409c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.535+0000 7f6eeb251640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40d1090 0x7f6ee415d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6eeb251640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 0x7f6ee413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6eeb251640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40d1620 con 0x7f6ee413fa60 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6eeb251640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40d14a0 con 0x7f6ee40d1090 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6eeb251640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee415f1d0 con 0x7f6ee40afe30 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 0x7f6ee413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 0x7f6ee413fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58096/0 (socket says 172.21.15.80:58096) 2024-04-25T15:45:05.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 -- 172.21.15.80:0/1434930911 learned_addr learned my addr 172.21.15.80:0/1434930911 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee3fff640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40d1090 0x7f6ee415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee8fed640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee409c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 -- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 msgr2=0x7f6ee409c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee409c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 -- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40d1090 msgr2=0x7f6ee415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40d1090 0x7f6ee415d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 -- 172.21.15.80:0/1434930911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee41403b0 con 0x7f6ee413fa60 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee8fed640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee409c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee97ee640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 0x7f6ee413fe70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009d90 tx=0x7f6edc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc040070 con 0x7f6ee413fa60 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc031c40 con 0x7f6ee413fa60 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee41f8810 con 0x7f6ee413fa60 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc009450 con 0x7f6ee413fa60 2024-04-25T15:45:05.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.536+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee413eca0 con 0x7f6ee413fa60 2024-04-25T15:45:05.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.538+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee406a100 con 0x7f6ee413fa60 2024-04-25T15:45:05.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.538+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6edc039040 con 0x7f6ee413fa60 2024-04-25T15:45:05.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.539+0000 7f6ee17fa640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ed00744b0 0x7f6ed00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.539+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6edc0b6770 con 0x7f6ee413fa60 2024-04-25T15:45:05.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.539+0000 7f6ee8fed640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ed00744b0 0x7f6ed00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.539+0000 7f6ee8fed640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ed00744b0 0x7f6ed00769c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4147cb0 tx=0x7f6ed4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.543+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6edc080d70 con 0x7f6ee413fa60 2024-04-25T15:45:05.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.719+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ee40af7c0 con 0x7f6ee413fa60 2024-04-25T15:45:05.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.720+0000 7f6ee17fa640 1 -- 172.21.15.80:0/1434930911 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16930 (secure 0 0 0) 0x7f6edc080670 con 0x7f6ee413fa60 2024-04-25T15:45:05.720 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:05.720 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:44:51.926717+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:44:48.548707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T15:44:49.239267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:05.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ed00744b0 msgr2=0x7f6ed00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ed00744b0 0x7f6ed00769c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4147cb0 tx=0x7f6ed4009040 comp rx=0 tx=0).stop 2024-04-25T15:45:05.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 msgr2=0x7f6ee413fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 0x7f6ee413fe70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009d90 tx=0x7f6edc004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:05.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 shutdown_connections 2024-04-25T15:45:05.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ed00744b0 0x7f6ed00769c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ee413fa60 0x7f6ee413fe70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40d1090 0x7f6ee415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 --2- 172.21.15.80:0/1434930911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ee40afe30 0x7f6ee409c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 >> 172.21.15.80:0/1434930911 conn(0x7f6ee40d1e20 msgr2=0x7f6ee406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:05.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 shutdown_connections 2024-04-25T15:45:05.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.722+0000 7f6eeb251640 1 -- 172.21.15.80:0/1434930911 wait complete. 2024-04-25T15:45:05.734 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:45:05.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.842+0000 7fed4f6e2640 1 Processor -- start 2024-04-25T15:45:05.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.842+0000 7fed4f6e2640 1 -- start start 2024-04-25T15:45:05.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4f6e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480cff30 0x7fed480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4f6e2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed480b2a40 0x7fed4809ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4f6e2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed480b9350 con 0x7fed480d2120 2024-04-25T15:45:05.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4f6e2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fed480cfb70 con 0x7fed480b2a40 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4f6e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed480cf890 con 0x7fed480cff30 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed480b2a40 0x7fed4809ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed480b2a40 0x7fed4809ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58108/0 (socket says 172.21.15.80:58108) 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 -- 172.21.15.80:0/2994947207 learned_addr learned my addr 172.21.15.80:0/2994947207 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4d47e640 1 --2- 172.21.15.80:0/2994947207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480cff30 0x7fed480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 -- 172.21.15.80:0/2994947207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480cff30 msgr2=0x7fed480b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 --2- 172.21.15.80:0/2994947207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480cff30 0x7fed480b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 -- 172.21.15.80:0/2994947207 >> v1:172.21.15.195:6789/0 conn(0x7fed480d2120 legacy=0x7fed480d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.844+0000 7fed4cc7d640 1 -- 172.21.15.80:0/2994947207 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed480b9020 con 0x7fed480b2a40 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.845+0000 7fed4cc7d640 1 --2- 172.21.15.80:0/2994947207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480b2a40 0x7fed4809ce90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fed38009870 tx=0x7fed3802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883e5bfecb1c2a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.845+0000 7fed3ffff640 1 -- 172.21.15.80:0/2994947207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38037070 con 0x7fed480b2a40 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.845+0000 7fed3ffff640 1 -- 172.21.15.80:0/2994947207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed38032440 con 0x7fed480b2a40 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.845+0000 7fed3ffff640 1 -- 172.21.15.80:0/2994947207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38032810 con 0x7fed480b2a40 2024-04-25T15:45:05.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2994947207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480b2a40 msgr2=0x7fed4809ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2994947207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480b2a40 0x7fed4809ce90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fed38009870 tx=0x7fed3802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2994947207 shutdown_connections 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2994947207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480b2a40 0x7fed4809ce90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2994947207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480cff30 0x7fed480b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2994947207 >> 172.21.15.80:0/2994947207 conn(0x7fed480d0450 msgr2=0x7fed480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2994947207 shutdown_connections 2024-04-25T15:45:05.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.846+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2994947207 wait complete. 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.847+0000 7fed4f6e2640 1 Processor -- start 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.847+0000 7fed4f6e2640 1 -- start start 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480b2a40 0x7fed48154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed480cff30 0x7fed4806f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 0x7fed4815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed480d10f0 con 0x7fed480d2120 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed480d0f70 con 0x7fed480cff30 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed480d2530 con 0x7fed480b2a40 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 0x7fed4815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 0x7fed4815bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58124/0 (socket says 172.21.15.80:58124) 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 -- 172.21.15.80:0/2223792141 learned_addr learned my addr 172.21.15.80:0/2223792141 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4cc7d640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed480cff30 0x7fed4806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4d47e640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480b2a40 0x7fed48154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 -- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480b2a40 msgr2=0x7fed48154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480b2a40 0x7fed48154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 -- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed480cff30 msgr2=0x7fed4806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed480cff30 0x7fed4806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 -- 172.21.15.80:0/2223792141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4806db00 con 0x7fed480d2120 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4dc7f640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 0x7fed4815bea0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c6e0 tx=0x7fed4000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40003b70 con 0x7fed480d2120 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40003d30 con 0x7fed480d2120 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.849+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4806dde0 con 0x7fed480d2120 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.850+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40005310 con 0x7fed480d2120 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.850+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4806e3a0 con 0x7fed480d2120 2024-04-25T15:45:05.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.851+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4806a100 con 0x7fed480d2120 2024-04-25T15:45:05.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.851+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed400054b0 con 0x7fed480d2120 2024-04-25T15:45:05.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.852+0000 7fed3dffb640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed2c0744e0 0x7fed2c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:05.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.852+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fed40095190 con 0x7fed480d2120 2024-04-25T15:45:05.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.852+0000 7fed4d47e640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed2c0744e0 0x7fed2c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:05.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.852+0000 7fed4d47e640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed2c0744e0 0x7fed2c0769f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed44009a90 tx=0x7fed44009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:05.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:05.856+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed4005f140 con 0x7fed480d2120 2024-04-25T15:45:06.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.071+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fed4815e430 con 0x7fed480d2120 2024-04-25T15:45:06.071 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:45:06.072+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:45:06.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.073+0000 7fed3dffb640 1 -- 172.21.15.80:0/2223792141 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7fed40063440 con 0x7fed480d2120 2024-04-25T15:45:06.073 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:45:06.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed2c0744e0 msgr2=0x7fed2c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed2c0744e0 0x7fed2c0769f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed44009a90 tx=0x7fed44009110 comp rx=0 tx=0).stop 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 msgr2=0x7fed4815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 0x7fed4815bea0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c6e0 tx=0x7fed4000cba0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 shutdown_connections 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed2c0744e0 0x7fed2c0769f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed480d2120 0x7fed4815bea0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed480cff30 0x7fed4806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 --2- 172.21.15.80:0/2223792141 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed480b2a40 0x7fed48154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.076+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 >> 172.21.15.80:0/2223792141 conn(0x7fed480d0450 msgr2=0x7fed480b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.077+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 shutdown_connections 2024-04-25T15:45:06.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.077+0000 7fed4f6e2640 1 -- 172.21.15.80:0/2223792141 wait complete. 2024-04-25T15:45:06.078 INFO:tasks.ceph.mds.c.smithi080.stderr: -2087> 2024-04-25T15:44:56.576+0000 7f3b61fdf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:45:06.092 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:45:06.132 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:45:06.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.205+0000 7fcf46134640 1 Processor -- start 2024-04-25T15:45:06.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.205+0000 7fcf46134640 1 -- start start 2024-04-25T15:45:06.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.206+0000 7fcf46134640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400b2db0 0x7fcf40160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.206+0000 7fcf46134640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf400718d0 0x7fcf40071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.206+0000 7fcf46134640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf40072220 con 0x7fcf400d2010 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.206+0000 7fcf46134640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcf400cef30 con 0x7fcf400718d0 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.206+0000 7fcf46134640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf400b31c0 con 0x7fcf400b2db0 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf400718d0 0x7fcf40071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3effd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcf400d2010 0x7fcf4006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59790/0 (socket says 172.21.15.80:59790) 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3effd640 1 -- 172.21.15.80:0/1461992933 learned_addr learned my addr 172.21.15.80:0/1461992933 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3f7fe640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400b2db0 0x7fcf40160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3ffff640 1 -- 172.21.15.80:0/1461992933 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400b2db0 msgr2=0x7fcf40160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3ffff640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400b2db0 0x7fcf40160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3ffff640 1 -- 172.21.15.80:0/1461992933 >> v1:172.21.15.80:6789/0 conn(0x7fcf400d2010 legacy=0x7fcf4006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3ffff640 1 -- 172.21.15.80:0/1461992933 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf400ce640 con 0x7fcf400718d0 2024-04-25T15:45:06.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3e7fc640 1 -- 172.21.15.80:0/1461992933 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674961543 0 0) 0x7fcf34001110 con 0x7fcf400d2010 2024-04-25T15:45:06.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.207+0000 7fcf3f7fe640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400b2db0 0x7fcf40160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:06.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf3ffff640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400718d0 0x7fcf40071ce0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009d90 tx=0x7fcf3802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af85880f913c0436 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:06.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf3e7fc640 1 -- 172.21.15.80:0/1461992933 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38031600 con 0x7fcf400718d0 2024-04-25T15:45:06.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf3e7fc640 1 -- 172.21.15.80:0/1461992933 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf380317a0 con 0x7fcf400718d0 2024-04-25T15:45:06.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf3e7fc640 1 -- 172.21.15.80:0/1461992933 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38031b70 con 0x7fcf400718d0 2024-04-25T15:45:06.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 -- 172.21.15.80:0/1461992933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400718d0 msgr2=0x7fcf40071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:06.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400718d0 0x7fcf40071ce0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009d90 tx=0x7fcf3802a5d0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 -- 172.21.15.80:0/1461992933 shutdown_connections 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400718d0 0x7fcf40071ce0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 --2- 172.21.15.80:0/1461992933 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400b2db0 0x7fcf40160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 -- 172.21.15.80:0/1461992933 >> 172.21.15.80:0/1461992933 conn(0x7fcf400d3a30 msgr2=0x7fcf400d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 -- 172.21.15.80:0/1461992933 shutdown_connections 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.208+0000 7fcf46134640 1 -- 172.21.15.80:0/1461992933 wait complete. 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.210+0000 7fcf46134640 1 Processor -- start 2024-04-25T15:45:06.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.210+0000 7fcf46134640 1 -- start start 2024-04-25T15:45:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400718d0 0x7fcf400b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 0x7fcf4014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf400d2010 0x7fcf400b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcf400d2840 con 0x7fcf400b2db0 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcf401605d0 con 0x7fcf400d2010 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf400ce8e0 con 0x7fcf400718d0 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 0x7fcf4014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 0x7fcf4014f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58170/0 (socket says 172.21.15.80:58170) 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 -- 172.21.15.80:0/1401651193 learned_addr learned my addr 172.21.15.80:0/1401651193 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3f7fe640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400718d0 0x7fcf400b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3ffff640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf400d2010 0x7fcf400b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 -- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400718d0 msgr2=0x7fcf400b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400718d0 0x7fcf400b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 -- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf400d2010 msgr2=0x7fcf400b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf400d2010 0x7fcf400b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 -- 172.21.15.80:0/1401651193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf401f9e90 con 0x7fcf400b2db0 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf3effd640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 0x7fcf4014f760 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c420 tx=0x7fcf3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf340074e0 con 0x7fcf400b2db0 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf340047e0 con 0x7fcf400b2db0 2024-04-25T15:45:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf401fa100 con 0x7fcf400b2db0 2024-04-25T15:45:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34004c10 con 0x7fcf400b2db0 2024-04-25T15:45:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.212+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf400af720 con 0x7fcf400b2db0 2024-04-25T15:45:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.213+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf40160f80 con 0x7fcf400b2db0 2024-04-25T15:45:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.214+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcf34011070 con 0x7fcf400b2db0 2024-04-25T15:45:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.214+0000 7fcf27fff640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf2c0744b0 0x7fcf2c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.215+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7fcf34094f20 con 0x7fcf400b2db0 2024-04-25T15:45:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.215+0000 7fcf3f7fe640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf2c0744b0 0x7fcf2c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.215+0000 7fcf3f7fe640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf2c0744b0 0x7fcf2c0769c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf400c7360 tx=0x7fcf30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.219+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf40160f80 con 0x7fcf400b2db0 2024-04-25T15:45:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:06.431+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcf4006a100 con 0x7fcf400b2db0 2024-04-25T15:45:07.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.074+0000 7fcf27fff640 1 -- 172.21.15.80:0/1401651193 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7fcf40072220 con 0x7fcf400b2db0 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf2c0744b0 msgr2=0x7fcf2c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf2c0744b0 0x7fcf2c0769c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf400c7360 tx=0x7fcf30008040 comp rx=0 tx=0).stop 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 msgr2=0x7fcf4014f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 0x7fcf4014f760 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c420 tx=0x7fcf3400c8e0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 shutdown_connections 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcf2c0744b0 0x7fcf2c0769c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf400d2010 0x7fcf400b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf400b2db0 0x7fcf4014f760 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 --2- 172.21.15.80:0/1401651193 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf400718d0 0x7fcf400b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 >> 172.21.15.80:0/1401651193 conn(0x7fcf400d3a30 msgr2=0x7fcf40162aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:07.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 shutdown_connections 2024-04-25T15:45:07.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.077+0000 7fcf46134640 1 -- 172.21.15.80:0/1401651193 wait complete. 2024-04-25T15:45:07.089 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:45:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.244+0000 7f2f62ee7640 1 Processor -- start 2024-04-25T15:45:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.244+0000 7f2f62ee7640 1 -- start start 2024-04-25T15:45:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f62ee7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f5c0ce220 0x7f2f5c09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f62ee7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f62ee7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c1607c0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f62ee7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c0cf4d0 con 0x7f2f5c0ce220 2024-04-25T15:45:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f62ee7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c0ce630 con 0x7f2f5c0cfd70 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f60c83640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f5c0ce220 0x7f2f5c09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f5bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2f5c0cf960 0x7f2f5c0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59796/0 (socket says 172.21.15.80:59796) 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f5bfff640 1 -- 172.21.15.80:0/362443295 learned_addr learned my addr 172.21.15.80:0/362443295 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f61484640 1 --2- 172.21.15.80:0/362443295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f60c83640 1 -- 172.21.15.80:0/362443295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 msgr2=0x7f2f5c0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f60c83640 1 --2- 172.21.15.80:0/362443295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c0d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f60c83640 1 -- 172.21.15.80:0/362443295 >> v1:172.21.15.80:6789/0 conn(0x7f2f5c0cf960 legacy=0x7f2f5c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f60c83640 1 -- 172.21.15.80:0/362443295 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c0d0180 con 0x7f2f5c0ce220 2024-04-25T15:45:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.246+0000 7f2f5b7fe640 1 -- 172.21.15.80:0/362443295 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048780684 0 0) 0x7f2f5c1607c0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.247+0000 7f2f60c83640 1 --2- 172.21.15.80:0/362443295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c09bb70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0097a0 tx=0x7f2f4c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1422df1f2a41b244 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.247+0000 7f2f5b7fe640 1 -- 172.21.15.80:0/362443295 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c037070 con 0x7f2f5c0ce220 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.247+0000 7f2f5b7fe640 1 -- 172.21.15.80:0/362443295 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c032440 con 0x7f2f5c0ce220 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.247+0000 7f2f5b7fe640 1 -- 172.21.15.80:0/362443295 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c032810 con 0x7f2f5c0ce220 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 -- 172.21.15.80:0/362443295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0ce220 msgr2=0x7f2f5c09bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/362443295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c09bb70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0097a0 tx=0x7f2f4c02a210 comp rx=0 tx=0).stop 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 -- 172.21.15.80:0/362443295 shutdown_connections 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/362443295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c0d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/362443295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c09bb70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 -- 172.21.15.80:0/362443295 >> 172.21.15.80:0/362443295 conn(0x7f2f5c0b7620 msgr2=0x7f2f5c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 -- 172.21.15.80:0/362443295 shutdown_connections 2024-04-25T15:45:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.248+0000 7f2f62ee7640 1 -- 172.21.15.80:0/362443295 wait complete. 2024-04-25T15:45:07.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.249+0000 7f2f62ee7640 1 Processor -- start 2024-04-25T15:45:07.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.249+0000 7f2f62ee7640 1 -- start start 2024-04-25T15:45:07.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f62ee7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c1f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f62ee7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 0x7f2f5c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f62ee7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c1f9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f62ee7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0cf160 con 0x7f2f5c0cf960 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f62ee7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0cee80 con 0x7f2f5c0ce220 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f62ee7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c09c0b0 con 0x7f2f5c0cfd70 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 0x7f2f5c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 0x7f2f5c1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58182/0 (socket says 172.21.15.80:58182) 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 -- 172.21.15.80:0/1971127705 learned_addr learned my addr 172.21.15.80:0/1971127705 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f61484640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c1f9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f60c83640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c1f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 -- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 msgr2=0x7f2f5c1f9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c1f9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 -- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f5c0ce220 msgr2=0x7f2f5c1f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c1f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 -- 172.21.15.80:0/1971127705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1faaf0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f61484640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c1f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f60c83640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c1f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.251+0000 7f2f5bfff640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 0x7f2f5c1560e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c430 tx=0x7f2f5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.252+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f500074e0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.252+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f500047e0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.252+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1fadd0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.252+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50004bd0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.252+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1f6d80 con 0x7f2f5c0cf960 2024-04-25T15:45:07.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.253+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c06a100 con 0x7f2f5c0cf960 2024-04-25T15:45:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.253+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2f50011070 con 0x7f2f5c0cf960 2024-04-25T15:45:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.254+0000 7f2f597fa640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f480744b0 0x7f2f480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.254+0000 7f2f60c83640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f480744b0 0x7f2f480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.254+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7f2f500950c0 con 0x7f2f5c0cf960 2024-04-25T15:45:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.254+0000 7f2f60c83640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f480744b0 0x7f2f480769c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c034000 tx=0x7f2f4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:07.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.259+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f5005f670 con 0x7f2f5c0cf960 2024-04-25T15:45:07.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:07.434+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2f5c06d2c0 con 0x7f2f5c0cf960 2024-04-25T15:45:08.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.076+0000 7f2f597fa640 1 -- 172.21.15.80:0/1971127705 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7f2f5005ef70 con 0x7f2f5c0cf960 2024-04-25T15:45:08.076 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.079+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f480744b0 msgr2=0x7f2f480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.079+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f480744b0 0x7f2f480769c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c034000 tx=0x7f2f4c02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.079+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 msgr2=0x7f2f5c1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.079+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 0x7f2f5c1560e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c430 tx=0x7f2f5000c8f0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 shutdown_connections 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2f480744b0 0x7f2f480769c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f5c0cfd70 0x7f2f5c1f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f5c0cf960 0x7f2f5c1560e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 --2- 172.21.15.80:0/1971127705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f5c0ce220 0x7f2f5c1f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 >> 172.21.15.80:0/1971127705 conn(0x7f2f5c0b7620 msgr2=0x7f2f5c071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 shutdown_connections 2024-04-25T15:45:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.080+0000 7f2f62ee7640 1 -- 172.21.15.80:0/1971127705 wait complete. 2024-04-25T15:45:08.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:45:08.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.207+0000 7fa081461640 1 Processor -- start 2024-04-25T15:45:08.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.207+0000 7fa081461640 1 -- start start 2024-04-25T15:45:08.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa081461640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa07c1604d0 0x7fa07c09bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa081461640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa07c0cee60 0x7fa07c0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa081461640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07c0b3fe0 con 0x7fa07c0d1ae0 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa081461640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa07c0ce6d0 con 0x7fa07c0cee60 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa081461640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa07c0ce110 con 0x7fa07c1604d0 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa07b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa07c0cee60 0x7fa07c0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa07a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa07c0d1ae0 0x7fa07c0d1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59798/0 (socket says 172.21.15.80:59798) 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.208+0000 7fa07a7fc640 1 -- 172.21.15.80:0/2078284967 learned_addr learned my addr 172.21.15.80:0/2078284967 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.209+0000 7fa07b7fe640 1 -- 172.21.15.80:0/2078284967 >> v2:172.21.15.195:3300/0 conn(0x7fa07c1604d0 msgr2=0x7fa07c09bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.209+0000 7fa07b7fe640 1 --2- 172.21.15.80:0/2078284967 >> v2:172.21.15.195:3300/0 conn(0x7fa07c1604d0 0x7fa07c09bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.209+0000 7fa07b7fe640 1 -- 172.21.15.80:0/2078284967 >> v1:172.21.15.80:6789/0 conn(0x7fa07c0d1ae0 legacy=0x7fa07c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.209+0000 7fa07b7fe640 1 -- 172.21.15.80:0/2078284967 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c0ce3f0 con 0x7fa07c0cee60 2024-04-25T15:45:08.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.209+0000 7fa079ffb640 1 -- 172.21.15.80:0/2078284967 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025144003 0 0) 0x7fa07c0b3fe0 con 0x7fa07c0d1ae0 2024-04-25T15:45:08.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.209+0000 7fa07b7fe640 1 --2- 172.21.15.80:0/2078284967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c0cee60 0x7fa07c0cf270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0d3560 tx=0x7fa07402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a54122701998db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa079ffb640 1 -- 172.21.15.80:0/2078284967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074007740 con 0x7fa07c0cee60 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa079ffb640 1 -- 172.21.15.80:0/2078284967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0740078e0 con 0x7fa07c0cee60 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa079ffb640 1 -- 172.21.15.80:0/2078284967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074007cb0 con 0x7fa07c0cee60 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 -- 172.21.15.80:0/2078284967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c0cee60 msgr2=0x7fa07c0cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 --2- 172.21.15.80:0/2078284967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c0cee60 0x7fa07c0cf270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0d3560 tx=0x7fa07402a680 comp rx=0 tx=0).stop 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 -- 172.21.15.80:0/2078284967 shutdown_connections 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 --2- 172.21.15.80:0/2078284967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c0cee60 0x7fa07c0cf270 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 --2- 172.21.15.80:0/2078284967 >> v2:172.21.15.195:3300/0 conn(0x7fa07c1604d0 0x7fa07c09bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 -- 172.21.15.80:0/2078284967 >> 172.21.15.80:0/2078284967 conn(0x7fa07c0b7620 msgr2=0x7fa07c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 -- 172.21.15.80:0/2078284967 shutdown_connections 2024-04-25T15:45:08.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.210+0000 7fa081461640 1 -- 172.21.15.80:0/2078284967 wait complete. 2024-04-25T15:45:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.212+0000 7fa081461640 1 Processor -- start 2024-04-25T15:45:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.212+0000 7fa081461640 1 -- start start 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.213+0000 7fa081461640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa07c0cee60 0x7fa07c1f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.213+0000 7fa081461640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa07c0d1ae0 0x7fa07c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.213+0000 7fa081461640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 0x7fa07c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa081461640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c0b3cf0 con 0x7fa07c1604d0 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa081461640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c0b3b70 con 0x7fa07c0d1ae0 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa081461640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa07c0cf7b0 con 0x7fa07c0cee60 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 0x7fa07c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 0x7fa07c15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58208/0 (socket says 172.21.15.80:58208) 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 -- 172.21.15.80:0/1747819222 learned_addr learned my addr 172.21.15.80:0/1747819222 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07a7fc640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa07c0d1ae0 0x7fa07c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07affd640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa07c0cee60 0x7fa07c1f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 -- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa07c0cee60 msgr2=0x7fa07c1f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa07c0cee60 0x7fa07c1f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 -- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa07c0d1ae0 msgr2=0x7fa07c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa07c0d1ae0 0x7fa07c159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 -- 172.21.15.80:0/1747819222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c1fa3a0 con 0x7fa07c1604d0 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07affd640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa07c0cee60 0x7fa07c1f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa07b7fe640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 0x7fa07c15c630 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e50 tx=0x7fa074004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074040070 con 0x7fa07c1604d0 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa074031c70 con 0x7fa07c1604d0 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c1fa680 con 0x7fa07c1604d0 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07403c620 con 0x7fa07c1604d0 2024-04-25T15:45:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.214+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c1fac40 con 0x7fa07c1604d0 2024-04-25T15:45:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.215+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07c06a100 con 0x7fa07c1604d0 2024-04-25T15:45:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.216+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa074039040 con 0x7fa07c1604d0 2024-04-25T15:45:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.216+0000 7fa0637fe640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0680744e0 0x7fa0680769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.216+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5749+0+0 (secure 0 0 0) 0x7fa0740b6770 con 0x7fa07c1604d0 2024-04-25T15:45:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.216+0000 7fa07affd640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0680744e0 0x7fa0680769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.217+0000 7fa07affd640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0680744e0 0x7fa0680769f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009890 tx=0x7fa06c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.221+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa074031e20 con 0x7fa07c1604d0 2024-04-25T15:45:08.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:08.400+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa07c0ccca0 con 0x7fa07c1604d0 2024-04-25T15:45:09.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.081+0000 7fa0637fe640 1 -- 172.21.15.80:0/1747819222 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7fa074080ed0 con 0x7fa07c1604d0 2024-04-25T15:45:09.082 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:45:09.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0680744e0 msgr2=0x7fa0680769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0680744e0 0x7fa0680769f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009890 tx=0x7fa06c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 msgr2=0x7fa07c15c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 0x7fa07c15c630 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e50 tx=0x7fa074004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 shutdown_connections 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0680744e0 0x7fa0680769f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa07c1604d0 0x7fa07c15c630 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa07c0d1ae0 0x7fa07c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 --2- 172.21.15.80:0/1747819222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa07c0cee60 0x7fa07c1f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 >> 172.21.15.80:0/1747819222 conn(0x7fa07c0b7620 msgr2=0x7fa07c0d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:09.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 shutdown_connections 2024-04-25T15:45:09.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.085+0000 7fa081461640 1 -- 172.21.15.80:0/1747819222 wait complete. 2024-04-25T15:45:09.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T15:45:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.207+0000 7faad4005640 1 Processor -- start 2024-04-25T15:45:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.207+0000 7faad4005640 1 -- start start 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad4005640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faacc0d0b00 0x7faacc0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad4005640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc0d2b80 0x7faacc0d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad4005640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faacc1643f0 con 0x7faacc0b5490 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad4005640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7faacc1646d0 con 0x7faacc0d0b00 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad4005640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faacc1649b0 con 0x7faacc0d2b80 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad15a0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faacc0d0b00 0x7faacc0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad1da1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faacc0b5490 0x7faacc160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59812/0 (socket says 172.21.15.80:59812) 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad1da1640 1 -- 172.21.15.80:0/3807719261 learned_addr learned my addr 172.21.15.80:0/3807719261 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:09.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad15a0640 1 -- 172.21.15.80:0/3807719261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc0d2b80 msgr2=0x7faacc0d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad25a2640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc0d2b80 0x7faacc0d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad0d9f640 1 -- 172.21.15.80:0/3807719261 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135388605 0 0) 0x7faacc1643f0 con 0x7faacc0b5490 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad15a0640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc0d2b80 0x7faacc0d47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad15a0640 1 -- 172.21.15.80:0/3807719261 >> v1:172.21.15.80:6789/0 conn(0x7faacc0b5490 legacy=0x7faacc160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad15a0640 1 -- 172.21.15.80:0/3807719261 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc164c90 con 0x7faacc0d0b00 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.209+0000 7faad25a2640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc0d2b80 0x7faacc0d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.210+0000 7faad15a0640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d0b00 0x7faacc0d2640 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7faabc0097a0 tx=0x7faabc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d3d126db44da33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.210+0000 7faad0d9f640 1 -- 172.21.15.80:0/3807719261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc037070 con 0x7faacc0d0b00 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.210+0000 7faad0d9f640 1 -- 172.21.15.80:0/3807719261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc032440 con 0x7faacc0d0b00 2024-04-25T15:45:09.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.210+0000 7faad0d9f640 1 -- 172.21.15.80:0/3807719261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc032810 con 0x7faacc0d0b00 2024-04-25T15:45:09.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 -- 172.21.15.80:0/3807719261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d0b00 msgr2=0x7faacc0d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d0b00 0x7faacc0d2640 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7faabc0097a0 tx=0x7faabc02a180 comp rx=0 tx=0).stop 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 -- 172.21.15.80:0/3807719261 shutdown_connections 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc0d2b80 0x7faacc0d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 --2- 172.21.15.80:0/3807719261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d0b00 0x7faacc0d2640 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 -- 172.21.15.80:0/3807719261 >> 172.21.15.80:0/3807719261 conn(0x7faacc06e650 msgr2=0x7faacc06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 -- 172.21.15.80:0/3807719261 shutdown_connections 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.211+0000 7faad4005640 1 -- 172.21.15.80:0/3807719261 wait complete. 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.212+0000 7faad4005640 1 Processor -- start 2024-04-25T15:45:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.213+0000 7faad4005640 1 -- start start 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad4005640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faacc0d0b00 0x7faacc1f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad4005640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 0x7faacc160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad4005640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc160960 0x7faacc1626d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad4005640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0b94e0 con 0x7faacc0d2b80 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad4005640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0b9360 con 0x7faacc0d0b00 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad4005640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faacc163f80 con 0x7faacc160960 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 0x7faacc160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 0x7faacc160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58234/0 (socket says 172.21.15.80:58234) 2024-04-25T15:45:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 -- 172.21.15.80:0/2176941818 learned_addr learned my addr 172.21.15.80:0/2176941818 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 -- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc160960 msgr2=0x7faacc1626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc160960 0x7faacc1626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 -- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faacc0d0b00 msgr2=0x7faacc1f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad1da1640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faacc0d0b00 0x7faacc1f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faacc0d0b00 0x7faacc1f8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 -- 172.21.15.80:0/2176941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc1611c0 con 0x7faacc0d2b80 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.214+0000 7faad15a0640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 0x7faacc160420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7faabc035040 tx=0x7faabc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.215+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc037050 con 0x7faacc0d2b80 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.215+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc038040 con 0x7faacc0d2b80 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.215+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc1614a0 con 0x7faacc0d2b80 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.215+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc004470 con 0x7faacc0d2b80 2024-04-25T15:45:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.215+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc161a60 con 0x7faacc0d2b80 2024-04-25T15:45:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.216+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc06a100 con 0x7faacc0d2b80 2024-04-25T15:45:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.217+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faabc030980 con 0x7faacc0d2b80 2024-04-25T15:45:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.217+0000 7faac27fc640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faab00744b0 0x7faab00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.217+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7faabc0b6850 con 0x7faacc0d2b80 2024-04-25T15:45:09.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.217+0000 7faad1da1640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faab00744b0 0x7faab00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.217+0000 7faad1da1640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faab00744b0 0x7faab00769c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faac80012e0 tx=0x7faac8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.221+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faabc081230 con 0x7faacc0d2b80 2024-04-25T15:45:09.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.396+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7faacc160f50 con 0x7faacc0d2b80 2024-04-25T15:45:09.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.399+0000 7faac27fc640 1 -- 172.21.15.80:0/2176941818 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7faabc080b30 con 0x7faacc0d2b80 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faab00744b0 msgr2=0x7faab00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faab00744b0 0x7faab00769c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faac80012e0 tx=0x7faac8009040 comp rx=0 tx=0).stop 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 msgr2=0x7faacc160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 0x7faacc160420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7faabc035040 tx=0x7faabc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 shutdown_connections 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faab00744b0 0x7faab00769c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faacc160960 0x7faacc1626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faacc0d2b80 0x7faacc160420 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 --2- 172.21.15.80:0/2176941818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faacc0d0b00 0x7faacc1f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 >> 172.21.15.80:0/2176941818 conn(0x7faacc06e650 msgr2=0x7faacc0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:09.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 shutdown_connections 2024-04-25T15:45:09.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.401+0000 7faad4005640 1 -- 172.21.15.80:0/2176941818 wait complete. 2024-04-25T15:45:09.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-04-25T15:45:09.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.519+0000 7f63b990d640 1 Processor -- start 2024-04-25T15:45:09.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.519+0000 7f63b990d640 1 -- start start 2024-04-25T15:45:09.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b990d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 0x7f63b41604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b990d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b40b9620 con 0x7f63b40b7de0 2024-04-25T15:45:09.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b990d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b40d4640 con 0x7f63b40d12e0 2024-04-25T15:45:09.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b990d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f63b40d16f0 con 0x7f63b40d4230 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b27fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f63b40b7de0 0x7f63b40ba380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59826/0 (socket says 172.21.15.80:59826) 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b27fc640 1 -- 172.21.15.80:0/2652070370 learned_addr learned my addr 172.21.15.80:0/2652070370 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b37fe640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 0x7f63b41604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411703030 0 0) 0x7f63a8001110 con 0x7f63b40b7de0 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f639c003520 con 0x7f63b40b7de0 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2688028685 0 0) 0x7f639c003520 con 0x7f63b40b7de0 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 msgr2=0x7f63b41604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 0x7f63b41604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 >> v1:172.21.15.195:6789/0 conn(0x7f63b40d12e0 legacy=0x7f63b40b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b40d1930 con 0x7f63b40b7de0 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f63a8001840 con 0x7f63b40b7de0 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 >> v1:172.21.15.80:6789/0 conn(0x7f63b40b7de0 legacy=0x7f63b40ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f639c0039e0 0x7f639c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 0x7f639c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c004d40 0x7f639c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40d16f0 con 0x7f639c0039e0 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f639c00ba70 con 0x7f639c004d40 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f639c00bc70 con 0x7f63b40d4230 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.521+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f639c0039e0 0x7f639c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b37fe640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c004d40 0x7f639c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b27fc640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 0x7f639c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b2ffd640 1 -- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 msgr2=0x7f639c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b40d4230 0x7f639c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b2ffd640 1 -- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c004d40 msgr2=0x7f639c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c004d40 0x7f639c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b2ffd640 1 -- 172.21.15.80:0/2652070370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c003520 con 0x7f639c0039e0 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b37fe640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c004d40 0x7f639c005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.522+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f639c0039e0 0x7f639c003e10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f63a4002010 tx=0x7f639c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81c271800274e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:09.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4036070 con 0x7f639c0039e0 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a4031600 con 0x7f639c0039e0 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b1ffb640 1 -- 172.21.15.80:0/2652070370 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4001be0 con 0x7f639c0039e0 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b990d640 1 -- 172.21.15.80:0/2652070370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f639c0039e0 msgr2=0x7f639c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b990d640 1 --2- 172.21.15.80:0/2652070370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f639c0039e0 0x7f639c003e10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f63a4002010 tx=0x7f639c005830 comp rx=0 tx=0).stop 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b37fe640 1 -- 172.21.15.80:0/2652070370 reap_dead start 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b990d640 1 -- 172.21.15.80:0/2652070370 shutdown_connections 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b990d640 1 -- 172.21.15.80:0/2652070370 >> 172.21.15.80:0/2652070370 conn(0x7f63b406e7c0 msgr2=0x7f63b406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b990d640 1 -- 172.21.15.80:0/2652070370 shutdown_connections 2024-04-25T15:45:09.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.523+0000 7f63b990d640 1 -- 172.21.15.80:0/2652070370 wait complete. 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.525+0000 7f63b990d640 1 Processor -- start 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.525+0000 7f63b990d640 1 -- start start 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.526+0000 7f63b990d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c0039e0 0x7f63b40ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.526+0000 7f63b990d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b41530c0 0x7f63b41f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.526+0000 7f63b990d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 0x7f63b41f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.526+0000 7f63b990d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40b9b80 con 0x7f63b41534d0 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.526+0000 7f63b990d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40d1c10 con 0x7f639c0039e0 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.526+0000 7f63b990d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f63b40b9e60 con 0x7f63b41530c0 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 0x7f63b41f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 0x7f63b41f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58256/0 (socket says 172.21.15.80:58256) 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 -- 172.21.15.80:0/683041166 learned_addr learned my addr 172.21.15.80:0/683041166 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c0039e0 0x7f63b40ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b27fc640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b41530c0 0x7f63b41f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 -- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b41530c0 msgr2=0x7f63b41f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b41530c0 0x7f63b41f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 -- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c0039e0 msgr2=0x7f63b40ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c0039e0 0x7f63b40ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 -- 172.21.15.80:0/683041166 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b40cfca0 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b27fc640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b41530c0 0x7f63b41f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b37fe640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 0x7f63b41f67b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f63b40d6c60 tx=0x7f63ac011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac003610 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac01b070 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac003a10 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b40cff80 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.527+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b40d0540 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.528+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b40cfa10 con 0x7f63b41534d0 2024-04-25T15:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.529+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f63ac003bb0 con 0x7f63b41534d0 2024-04-25T15:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.529+0000 7f639bfff640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63a00744b0 0x7f63a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.529+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63a00744b0 0x7f63a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.529+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f63ac094cf0 con 0x7f63b41534d0 2024-04-25T15:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.530+0000 7f63b2ffd640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63a00744b0 0x7f63a00769c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f63a4033000 tx=0x7f63a4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:09.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.534+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f63ac099070 con 0x7f63b41534d0 2024-04-25T15:45:09.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:09.781+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f63b406a100 con 0x7f63b41534d0 2024-04-25T15:45:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.083+0000 7f639bfff640 1 -- 172.21.15.80:0/683041166 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v147) ==== 153+0+0 (secure 0 0 0) 0x7f63ac024020 con 0x7f63b41534d0 2024-04-25T15:45:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63a00744b0 msgr2=0x7f63a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63a00744b0 0x7f63a00769c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f63a4033000 tx=0x7f63a4009030 comp rx=0 tx=0).stop 2024-04-25T15:45:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 msgr2=0x7f63b41f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 0x7f63b41f67b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f63b40d6c60 tx=0x7f63ac011920 comp rx=0 tx=0).stop 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 shutdown_connections 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f63a00744b0 0x7f63a00769c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b41534d0 0x7f63b41f67b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f63b41530c0 0x7f63b41f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 --2- 172.21.15.80:0/683041166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c0039e0 0x7f63b40ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 >> 172.21.15.80:0/683041166 conn(0x7f63b406e7c0 msgr2=0x7f63b4160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 shutdown_connections 2024-04-25T15:45:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.085+0000 7f63b990d640 1 -- 172.21.15.80:0/683041166 wait complete. 2024-04-25T15:45:10.097 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... skipped 'Requires FUSE client to use mds_cluster.is_addr_blocklisted()' 2024-04-25T15:45:10.097 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-25T15:45:10.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:10.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.205+0000 7f76c5251640 1 Processor -- start 2024-04-25T15:45:10.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.205+0000 7f76c5251640 1 -- start start 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.206+0000 7f76c5251640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76c00d1090 0x7f76c006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.206+0000 7f76c5251640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f76c006db10 0x7f76c00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76c5251640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c006df20 con 0x7f76c00afc60 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76c5251640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f76c0070470 con 0x7f76c00d1090 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76c5251640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f76c00ae960 con 0x7f76c006db10 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76c00d1090 0x7f76c006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76c00d1090 0x7f76c006d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58258/0 (socket says 172.21.15.80:58258) 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 -- 172.21.15.80:0/2176751714 learned_addr learned my addr 172.21.15.80:0/2176751714 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76be59c640 1 --2- 172.21.15.80:0/2176751714 >> v2:172.21.15.195:3300/0 conn(0x7f76c006db10 0x7f76c00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 -- 172.21.15.80:0/2176751714 >> v2:172.21.15.195:3300/0 conn(0x7f76c006db10 msgr2=0x7f76c00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 --2- 172.21.15.80:0/2176751714 >> v2:172.21.15.195:3300/0 conn(0x7f76c006db10 0x7f76c00af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 -- 172.21.15.80:0/2176751714 >> v1:172.21.15.195:6789/0 conn(0x7f76c00afc60 legacy=0x7f76c015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.207+0000 7f76bed9d640 1 -- 172.21.15.80:0/2176751714 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c00aec40 con 0x7f76c00d1090 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.208+0000 7f76bed9d640 1 --2- 172.21.15.80:0/2176751714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00d1090 0x7f76c006d5d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009e50 tx=0x7f76b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece4e1ae99a94d12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.208+0000 7f76bdd9b640 1 -- 172.21.15.80:0/2176751714 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0036070 con 0x7f76c00d1090 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.208+0000 7f76bdd9b640 1 -- 172.21.15.80:0/2176751714 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0031600 con 0x7f76c00d1090 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.208+0000 7f76bdd9b640 1 -- 172.21.15.80:0/2176751714 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b002ae60 con 0x7f76c00d1090 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 -- 172.21.15.80:0/2176751714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00d1090 msgr2=0x7f76c006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 --2- 172.21.15.80:0/2176751714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00d1090 0x7f76c006d5d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009e50 tx=0x7f76b002a680 comp rx=0 tx=0).stop 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 -- 172.21.15.80:0/2176751714 shutdown_connections 2024-04-25T15:45:10.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 --2- 172.21.15.80:0/2176751714 >> v2:172.21.15.195:3300/0 conn(0x7f76c006db10 0x7f76c00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 --2- 172.21.15.80:0/2176751714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00d1090 0x7f76c006d5d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 -- 172.21.15.80:0/2176751714 >> 172.21.15.80:0/2176751714 conn(0x7f76c00d1e20 msgr2=0x7f76c0073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 -- 172.21.15.80:0/2176751714 shutdown_connections 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.209+0000 7f76c5251640 1 -- 172.21.15.80:0/2176751714 wait complete. 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.211+0000 7f76c5251640 1 Processor -- start 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.211+0000 7f76c5251640 1 -- start start 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76c5251640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c006db10 0x7f76c014d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76c5251640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 0x7f76c01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76c5251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76c00d1090 0x7f76c0159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76c5251640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00b0070 con 0x7f76c00afc60 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76c5251640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00af200 con 0x7f76c006db10 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76c5251640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f76c00b01f0 con 0x7f76c00d1090 2024-04-25T15:45:10.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76be59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 0x7f76c01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76be59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 0x7f76c01593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58268/0 (socket says 172.21.15.80:58268) 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76be59c640 1 -- 172.21.15.80:0/3520815763 learned_addr learned my addr 172.21.15.80:0/3520815763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76bed9d640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c006db10 0x7f76c014d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.212+0000 7f76bf59e640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76c00d1090 0x7f76c0159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76be59c640 1 -- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76c00d1090 msgr2=0x7f76c0159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76be59c640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76c00d1090 0x7f76c0159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76be59c640 1 -- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c006db10 msgr2=0x7f76c014d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76be59c640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c006db10 0x7f76c014d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76be59c640 1 -- 172.21.15.80:0/3520815763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c00b5780 con 0x7f76c00afc60 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76bed9d640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c006db10 0x7f76c014d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76be59c640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 0x7f76c01593d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c820 tx=0x7f76b400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4015070 con 0x7f76c00afc60 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b4004020 con 0x7f76c00afc60 2024-04-25T15:45:10.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c00b5a60 con 0x7f76c00afc60 2024-04-25T15:45:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40043f0 con 0x7f76c00afc60 2024-04-25T15:45:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.213+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c00b6020 con 0x7f76c00afc60 2024-04-25T15:45:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.214+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c006a100 con 0x7f76c00afc60 2024-04-25T15:45:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.214+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f76b4007830 con 0x7f76c00afc60 2024-04-25T15:45:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.215+0000 7f76a77fe640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76ac0744b0 0x7f76ac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.215+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f76b4094d60 con 0x7f76c00afc60 2024-04-25T15:45:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.215+0000 7f76bed9d640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76ac0744b0 0x7f76ac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.215+0000 7f76bed9d640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76ac0744b0 0x7f76ac0769c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f76b0033000 tx=0x7f76b0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.219+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76b405f0a0 con 0x7f76c00afc60 2024-04-25T15:45:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.400+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76c0074510 con 0x7f76c00afc60 2024-04-25T15:45:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.401+0000 7f76a77fe640 1 -- 172.21.15.80:0/3520815763 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13281 (secure 0 0 0) 0x7f76b40633a0 con 0x7f76c00afc60 2024-04-25T15:45:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:10.403 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":54,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:09.077187+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/3351222677":"2024-04-26T15:45:06.071947+0000","172.21.15.80:6836/3351222677":"2024-04-26T15:45:06.071947+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:10.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76ac0744b0 msgr2=0x7f76ac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76ac0744b0 0x7f76ac0769c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f76b0033000 tx=0x7f76b0009000 comp rx=0 tx=0).stop 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 msgr2=0x7f76c01593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 0x7f76c01593d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c820 tx=0x7f76b400cce0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 shutdown_connections 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f76ac0744b0 0x7f76ac0769c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76c00d1090 0x7f76c0159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76c00afc60 0x7f76c01593d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 --2- 172.21.15.80:0/3520815763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c006db10 0x7f76c014d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 >> 172.21.15.80:0/3520815763 conn(0x7f76c00d1e20 msgr2=0x7f76c0153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 shutdown_connections 2024-04-25T15:45:10.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.403+0000 7f76c5251640 1 -- 172.21.15.80:0/3520815763 wait complete. 2024-04-25T15:45:10.414 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:10.415 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:10.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.524+0000 7f4ad5fb2640 1 Processor -- start 2024-04-25T15:45:10.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.524+0000 7f4ad5fb2640 1 -- start start 2024-04-25T15:45:10.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4ad5fb2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ad015f170 0x7f4ad00d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4ad5fb2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad0161a00 con 0x7f4ad006dce0 2024-04-25T15:45:10.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4ad5fb2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad0161ce0 con 0x7f4ad0070c10 2024-04-25T15:45:10.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4ad5fb2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad00d1530 con 0x7f4ad015f170 2024-04-25T15:45:10.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4acffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4ad006dce0 0x7f4ad00ae830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59840/0 (socket says 172.21.15.80:59840) 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4acffff640 1 -- 172.21.15.80:0/2232179489 learned_addr learned my addr 172.21.15.80:0/2232179489 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/2232179489 >> v2:172.21.15.195:3300/0 conn(0x7f4ad015f170 0x7f4ad00d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4ace7fc640 1 -- 172.21.15.80:0/2232179489 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074811789 0 0) 0x7f4ad0161a00 con 0x7f4ad006dce0 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4ace7fc640 1 -- 172.21.15.80:0/2232179489 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ab8003520 con 0x7f4ad006dce0 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4acf7fe640 1 -- 172.21.15.80:0/2232179489 >> v1:172.21.15.195:6789/0 conn(0x7f4ad0070c10 legacy=0x7f4ad006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4acf7fe640 1 -- 172.21.15.80:0/2232179489 >> v1:172.21.15.80:6789/0 conn(0x7f4ad006dce0 legacy=0x7f4ad00ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.526+0000 7f4acf7fe640 1 -- 172.21.15.80:0/2232179489 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad0161fc0 con 0x7f4ad015f170 2024-04-25T15:45:10.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.527+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/2232179489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f170 0x7f4ad00d0ff0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00097a0 tx=0x7f4ac002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e5cc758c0de4a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.527+0000 7f4ace7fc640 1 -- 172.21.15.80:0/2232179489 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0037070 con 0x7f4ad015f170 2024-04-25T15:45:10.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.527+0000 7f4ace7fc640 1 -- 172.21.15.80:0/2232179489 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0032440 con 0x7f4ad015f170 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.527+0000 7f4ace7fc640 1 -- 172.21.15.80:0/2232179489 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00327f0 con 0x7f4ad015f170 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/2232179489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f170 msgr2=0x7f4ad00d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/2232179489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f170 0x7f4ad00d0ff0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00097a0 tx=0x7f4ac002a230 comp rx=0 tx=0).stop 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/2232179489 shutdown_connections 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/2232179489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f170 0x7f4ad00d0ff0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/2232179489 >> 172.21.15.80:0/2232179489 conn(0x7f4ad00734b0 msgr2=0x7f4ad00738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/2232179489 shutdown_connections 2024-04-25T15:45:10.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.528+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/2232179489 wait complete. 2024-04-25T15:45:10.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.530+0000 7f4ad5fb2640 1 Processor -- start 2024-04-25T15:45:10.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.530+0000 7f4ad5fb2640 1 -- start start 2024-04-25T15:45:10.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4ad5fb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ad0070c10 0x7f4ad0149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4ad5fb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 0x7f4ad00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4ad5fb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad014a600 0x7f4ad00b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4ad5fb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0071020 con 0x7f4ad015f170 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4ad5fb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0162610 con 0x7f4ad014a600 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4ad5fb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad00711a0 con 0x7f4ad0070c10 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4aceffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 0x7f4ad00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4aceffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 0x7f4ad00b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58278/0 (socket says 172.21.15.80:58278) 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.531+0000 7f4aceffd640 1 -- 172.21.15.80:0/3541006823 learned_addr learned my addr 172.21.15.80:0/3541006823 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ad0070c10 0x7f4ad0149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4acffff640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad014a600 0x7f4ad00b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4aceffd640 1 -- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ad0070c10 msgr2=0x7f4ad0149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4aceffd640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ad0070c10 0x7f4ad0149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4aceffd640 1 -- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad014a600 msgr2=0x7f4ad00b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4aceffd640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad014a600 0x7f4ad00b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4aceffd640 1 -- 172.21.15.80:0/3541006823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad0152c20 con 0x7f4ad015f170 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ad0070c10 0x7f4ad0149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:10.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4aceffd640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 0x7f4ad00b2170 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c3c0 tx=0x7f4ac400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40052d0 con 0x7f4ad015f170 2024-04-25T15:45:10.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac4005490 con 0x7f4ad015f170 2024-04-25T15:45:10.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4007260 con 0x7f4ad015f170 2024-04-25T15:45:10.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad014a3c0 con 0x7f4ad015f170 2024-04-25T15:45:10.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.532+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad0154770 con 0x7f4ad015f170 2024-04-25T15:45:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.533+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad006a100 con 0x7f4ad015f170 2024-04-25T15:45:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.534+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ac4007400 con 0x7f4ad015f170 2024-04-25T15:45:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.534+0000 7f4ab7fff640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.534+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.534+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f4ac4094600 con 0x7f4ad015f170 2024-04-25T15:45:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.535+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0034000 tx=0x7f4ac002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.539+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ac405ee80 con 0x7f4ad015f170 2024-04-25T15:45:10.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.712+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ad0152eb0 con 0x7f4ad015f170 2024-04-25T15:45:10.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.712+0000 7f4ab7fff640 1 -- 172.21.15.80:0/3541006823 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f4ac405e780 con 0x7f4ad015f170 2024-04-25T15:45:10.712 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:10.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 msgr2=0x7f4abc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0034000 tx=0x7f4ac002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 msgr2=0x7f4ad00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 0x7f4ad00b2170 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c3c0 tx=0x7f4ac400c880 comp rx=0 tx=0).stop 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 shutdown_connections 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad014a600 0x7f4ad00b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad015f170 0x7f4ad00b2170 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 --2- 172.21.15.80:0/3541006823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ad0070c10 0x7f4ad0149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 >> 172.21.15.80:0/3541006823 conn(0x7f4ad00734b0 msgr2=0x7f4ad015b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:10.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 shutdown_connections 2024-04-25T15:45:10.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.714+0000 7f4ad5fb2640 1 -- 172.21.15.80:0/3541006823 wait complete. 2024-04-25T15:45:10.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-04-25T15:45:10.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.831+0000 7fa172cb6640 1 Processor -- start 2024-04-25T15:45:10.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.831+0000 7fa172cb6640 1 -- start start 2024-04-25T15:45:10.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa172cb6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa16c0d1df0 0x7fa16c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa172cb6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa172cb6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa16c0ce8a0 con 0x7fa16c0738d0 2024-04-25T15:45:10.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa172cb6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa16c073ce0 con 0x7fa16c0d1df0 2024-04-25T15:45:10.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa172cb6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c163fb0 con 0x7fa16c160230 2024-04-25T15:45:10.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa16bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa170a52640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa16c0d1df0 0x7fa16c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.832+0000 7fa171253640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa16c0738d0 0x7fa16c071950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54424/0 (socket says 172.21.15.80:54424) 2024-04-25T15:45:10.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.833+0000 7fa171253640 1 -- 172.21.15.80:0/831281734 learned_addr learned my addr 172.21.15.80:0/831281734 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:10.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.833+0000 7fa16bfff640 1 -- 172.21.15.80:0/831281734 >> v2:172.21.15.195:3300/0 conn(0x7fa16c0d1df0 msgr2=0x7fa16c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:10.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.833+0000 7fa16bfff640 1 --2- 172.21.15.80:0/831281734 >> v2:172.21.15.195:3300/0 conn(0x7fa16c0d1df0 0x7fa16c0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.833+0000 7fa16bfff640 1 -- 172.21.15.80:0/831281734 >> v1:172.21.15.195:6789/0 conn(0x7fa16c0738d0 legacy=0x7fa16c071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.833+0000 7fa16bfff640 1 -- 172.21.15.80:0/831281734 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c164290 con 0x7fa16c160230 2024-04-25T15:45:10.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa16bfff640 1 --2- 172.21.15.80:0/831281734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c073390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa154009790 tx=0x7fa15402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33444412c0942ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa16b7fe640 1 -- 172.21.15.80:0/831281734 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa154037070 con 0x7fa16c160230 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa16b7fe640 1 -- 172.21.15.80:0/831281734 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15402ae50 con 0x7fa16c160230 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa16b7fe640 1 -- 172.21.15.80:0/831281734 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa154032660 con 0x7fa16c160230 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 -- 172.21.15.80:0/831281734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 msgr2=0x7fa16c073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 --2- 172.21.15.80:0/831281734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c073390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa154009790 tx=0x7fa15402a100 comp rx=0 tx=0).stop 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 -- 172.21.15.80:0/831281734 shutdown_connections 2024-04-25T15:45:10.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 --2- 172.21.15.80:0/831281734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c073390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 --2- 172.21.15.80:0/831281734 >> v2:172.21.15.195:3300/0 conn(0x7fa16c0d1df0 0x7fa16c0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 -- 172.21.15.80:0/831281734 >> 172.21.15.80:0/831281734 conn(0x7fa16c0d3ea0 msgr2=0x7fa16c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:10.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 -- 172.21.15.80:0/831281734 shutdown_connections 2024-04-25T15:45:10.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.834+0000 7fa172cb6640 1 -- 172.21.15.80:0/831281734 wait complete. 2024-04-25T15:45:10.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.836+0000 7fa172cb6640 1 Processor -- start 2024-04-25T15:45:10.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.836+0000 7fa172cb6640 1 -- start start 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 0x7fa16c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa16c0d1df0 0x7fa16c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c1f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c164b30 con 0x7fa16c0738d0 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c164850 con 0x7fa16c0d1df0 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c160640 con 0x7fa16c160230 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 0x7fa16c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 0x7fa16c0c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58292/0 (socket says 172.21.15.80:58292) 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 -- 172.21.15.80:0/2024444151 learned_addr learned my addr 172.21.15.80:0/2024444151 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa16bfff640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa16c0d1df0 0x7fa16c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa171253640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c1f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 -- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 msgr2=0x7fa16c1f9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c1f9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 -- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa16c0d1df0 msgr2=0x7fa16c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa16c0d1df0 0x7fa16c0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 -- 172.21.15.80:0/2024444151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c0cd500 con 0x7fa16c0738d0 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa16bfff640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa16c0d1df0 0x7fa16c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa170a52640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 0x7fa16c0c7f60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00e870 tx=0x7fa15c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c017070 con 0x7fa16c0738d0 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15c00c940 con 0x7fa16c0738d0 2024-04-25T15:45:10.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c0b0cf0 con 0x7fa16c0738d0 2024-04-25T15:45:10.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00cd30 con 0x7fa16c0738d0 2024-04-25T15:45:10.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.838+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c0b12b0 con 0x7fa16c0738d0 2024-04-25T15:45:10.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.840+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c06a100 con 0x7fa16c0738d0 2024-04-25T15:45:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.840+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa15c01a070 con 0x7fa16c0738d0 2024-04-25T15:45:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.840+0000 7fa1697fa640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa14c0744b0 0x7fa14c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.841+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fa15c094eb0 con 0x7fa16c0738d0 2024-04-25T15:45:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.841+0000 7fa16bfff640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa14c0744b0 0x7fa14c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.841+0000 7fa16bfff640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa14c0744b0 0x7fa14c0769c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa154034000 tx=0x7fa15402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:10.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:10.845+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa15c05f1f0 con 0x7fa16c0738d0 2024-04-25T15:45:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:11.092+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7fa16c06deb0 con 0x7fa16c0738d0 2024-04-25T15:45:12.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.090+0000 7fa1697fa640 1 -- 172.21.15.80:0/2024444151 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v149) ==== 145+0+0 (secure 0 0 0) 0x7fa15c0634f0 con 0x7fa16c0738d0 2024-04-25T15:45:12.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa14c0744b0 msgr2=0x7fa14c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa14c0744b0 0x7fa14c0769c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa154034000 tx=0x7fa15402e000 comp rx=0 tx=0).stop 2024-04-25T15:45:12.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 msgr2=0x7fa16c0c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 0x7fa16c0c7f60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00e870 tx=0x7fa15c00ed30 comp rx=0 tx=0).stop 2024-04-25T15:45:12.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 shutdown_connections 2024-04-25T15:45:12.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa14c0744b0 0x7fa14c0769c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa16c160230 0x7fa16c1f9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa16c0d1df0 0x7fa16c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 --2- 172.21.15.80:0/2024444151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa16c0738d0 0x7fa16c0c7f60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 >> 172.21.15.80:0/2024444151 conn(0x7fa16c0d3ea0 msgr2=0x7fa16c0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 shutdown_connections 2024-04-25T15:45:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.093+0000 7fa172cb6640 1 -- 172.21.15.80:0/2024444151 wait complete. 2024-04-25T15:45:12.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T15:45:12.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.218+0000 7fa7b256c640 1 Processor -- start 2024-04-25T15:45:12.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.218+0000 7fa7b256c640 1 -- start start 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b256c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0b2db0 0x7fa7ac160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b256c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7ac0718d0 0x7fa7ac071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b256c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac072220 con 0x7fa7ac0d2010 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b256c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa7ac0cef30 con 0x7fa7ac0718d0 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b256c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ac0b31c0 con 0x7fa7ac0b2db0 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7ac0718d0 0x7fa7ac071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7ac0718d0 0x7fa7ac071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58306/0 (socket says 172.21.15.80:58306) 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 -- 172.21.15.80:0/3518174439 learned_addr learned my addr 172.21.15.80:0/3518174439 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7abfff640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0b2db0 0x7fa7ac160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 -- 172.21.15.80:0/3518174439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0b2db0 msgr2=0x7fa7ac160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:12.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0b2db0 0x7fa7ac160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 -- 172.21.15.80:0/3518174439 >> v1:172.21.15.195:6789/0 conn(0x7fa7ac0d2010 legacy=0x7fa7ac06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7b0b09640 1 -- 172.21.15.80:0/3518174439 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac0ce640 con 0x7fa7ac0718d0 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.220+0000 7fa7abfff640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0b2db0 0x7fa7ac160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.221+0000 7fa7b0b09640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0718d0 0x7fa7ac071ce0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009e50 tx=0x7fa7a402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5842235c5b37ef5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.221+0000 7fa7aaffd640 1 -- 172.21.15.80:0/3518174439 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4036070 con 0x7fa7ac0718d0 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.221+0000 7fa7aaffd640 1 -- 172.21.15.80:0/3518174439 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a4031600 con 0x7fa7ac0718d0 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.221+0000 7fa7aaffd640 1 -- 172.21.15.80:0/3518174439 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40319d0 con 0x7fa7ac0718d0 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 -- 172.21.15.80:0/3518174439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0718d0 msgr2=0x7fa7ac071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0718d0 0x7fa7ac071ce0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009e50 tx=0x7fa7a402a630 comp rx=0 tx=0).stop 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 -- 172.21.15.80:0/3518174439 shutdown_connections 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0718d0 0x7fa7ac071ce0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 --2- 172.21.15.80:0/3518174439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0b2db0 0x7fa7ac160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 -- 172.21.15.80:0/3518174439 >> 172.21.15.80:0/3518174439 conn(0x7fa7ac0d3a30 msgr2=0x7fa7ac0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:12.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 -- 172.21.15.80:0/3518174439 shutdown_connections 2024-04-25T15:45:12.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.222+0000 7fa7b256c640 1 -- 172.21.15.80:0/3518174439 wait complete. 2024-04-25T15:45:12.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.223+0000 7fa7b256c640 1 Processor -- start 2024-04-25T15:45:12.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.224+0000 7fa7b256c640 1 -- start start 2024-04-25T15:45:12.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b256c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0718d0 0x7fa7ac1f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b256c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7ac0b2db0 0x7fa7ac0b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b256c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 0x7fa7ac15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b256c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac0d2840 con 0x7fa7ac0d2010 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b256c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1605d0 con 0x7fa7ac0b2db0 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b256c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ac0ce8e0 con 0x7fa7ac0718d0 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 0x7fa7ac15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 0x7fa7ac15c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58316/0 (socket says 172.21.15.80:58316) 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 -- 172.21.15.80:0/445101915 learned_addr learned my addr 172.21.15.80:0/445101915 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7ab7fe640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7ac0b2db0 0x7fa7ac0b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7abfff640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0718d0 0x7fa7ac1f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 -- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0718d0 msgr2=0x7fa7ac1f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0718d0 0x7fa7ac1f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 -- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7ac0b2db0 msgr2=0x7fa7ac0b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7ac0b2db0 0x7fa7ac0b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 -- 172.21.15.80:0/445101915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac159b50 con 0x7fa7ac0d2010 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7abfff640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0718d0 0x7fa7ac1f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.225+0000 7fa7b0b09640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 0x7fa7ac15c050 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009f70 tx=0x7fa7a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.226+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4036050 con 0x7fa7ac0d2010 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.226+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a4042070 con 0x7fa7ac0d2010 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.226+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac159e30 con 0x7fa7ac0d2010 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.226+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4009510 con 0x7fa7ac0d2010 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.226+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac15a3f0 con 0x7fa7ac0d2010 2024-04-25T15:45:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.227+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac06a100 con 0x7fa7ac0d2010 2024-04-25T15:45:12.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.228+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa7a4007c50 con 0x7fa7ac0d2010 2024-04-25T15:45:12.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.228+0000 7fa7a8ff9640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7980744b0 0x7fa7980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.228+0000 7fa7abfff640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7980744b0 0x7fa7980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.228+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fa7a40b6150 con 0x7fa7ac0d2010 2024-04-25T15:45:12.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.228+0000 7fa7abfff640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7980744b0 0x7fa7980769c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa79c006fd0 tx=0x7fa79c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:12.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.233+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7ac072220 con 0x7fa7ac0d2010 2024-04-25T15:45:12.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.406+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa7ac0689a0 con 0x7fa7ac0d2010 2024-04-25T15:45:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.409+0000 7fa7a8ff9640 1 -- 172.21.15.80:0/445101915 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fa7a4080a50 con 0x7fa7ac0d2010 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7980744b0 msgr2=0x7fa7980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7980744b0 0x7fa7980769c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa79c006fd0 tx=0x7fa79c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 msgr2=0x7fa7ac15c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 0x7fa7ac15c050 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009f70 tx=0x7fa7a4004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 shutdown_connections 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa7980744b0 0x7fa7980769c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7ac0d2010 0x7fa7ac15c050 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7ac0b2db0 0x7fa7ac0b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 --2- 172.21.15.80:0/445101915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7ac0718d0 0x7fa7ac1f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.411+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 >> 172.21.15.80:0/445101915 conn(0x7fa7ac0d3a30 msgr2=0x7fa7ac06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.412+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 shutdown_connections 2024-04-25T15:45:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.412+0000 7fa7b256c640 1 -- 172.21.15.80:0/445101915 wait complete. 2024-04-25T15:45:12.424 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:45:12.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:45:12.456 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:45:12.497 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:45:12.497 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:12.498 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:12.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:45:12.513 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:12.513 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:12.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:45:12.555 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:12.556 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:12.570 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:45:12.570 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:12.570 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:12.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:45:12.613 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T15:45:12.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:12.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.719+0000 7f573ad46640 1 Processor -- start 2024-04-25T15:45:12.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.719+0000 7f573ad46640 1 -- start start 2024-04-25T15:45:12.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f573ad46640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f573406dce0 0x7f57340af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f573ad46640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57340ae960 con 0x7f57340d1090 2024-04-25T15:45:12.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f573ad46640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57340aec40 con 0x7f57340afc60 2024-04-25T15:45:12.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f573ad46640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5734070470 con 0x7f573406dce0 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f5738ae2640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f57340d1090 0x7f573406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59854/0 (socket says 172.21.15.80:59854) 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f5738ae2640 1 -- 172.21.15.80:0/3186800539 learned_addr learned my addr 172.21.15.80:0/3186800539 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f5733fff640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f573406dce0 0x7f57340af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405420846 0 0) 0x7f57340ae960 con 0x7f57340d1090 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f571c003520 con 0x7f57340d1090 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325948317 0 0) 0x7f57340aec40 con 0x7f57340afc60 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57340ae960 con 0x7f57340afc60 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2954826845 0 0) 0x7f571c003520 con 0x7f57340d1090 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f573406dce0 msgr2=0x7f57340af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f573406dce0 0x7f57340af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 >> v1:172.21.15.195:6789/0 conn(0x7f57340afc60 legacy=0x7f573415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57340aef20 con 0x7f57340d1090 2024-04-25T15:45:12.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f5724001670 con 0x7f57340d1090 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 >> v1:172.21.15.80:6789/0 conn(0x7f57340d1090 legacy=0x7f573406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f571c003b70 0x7f571c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c004800 0x7f571c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c005210 0x7f571c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.721+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f571c00bfb0 con 0x7f571c004800 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f571c00c130 con 0x7f571c003b70 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f571c00c330 con 0x7f571c005210 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5733fff640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c004800 0x7f571c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5738ae2640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f571c003b70 0x7f571c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f57392e3640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c005210 0x7f571c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5733fff640 1 -- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c005210 msgr2=0x7f571c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5733fff640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c005210 0x7f571c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5733fff640 1 -- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f571c003b70 msgr2=0x7f571c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5733fff640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f571c003b70 0x7f571c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f5733fff640 1 -- 172.21.15.80:0/3186800539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c003520 con 0x7f571c004800 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.722+0000 7f57392e3640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c005210 0x7f571c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f5733fff640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c004800 0x7f571c004c10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5728009ac0 tx=0x7f571c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36c2899961366f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728036070 con 0x7f571c004800 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5728031400 con 0x7f571c004800 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f57337fe640 1 -- 172.21.15.80:0/3186800539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728009690 con 0x7f571c004800 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f573ad46640 1 -- 172.21.15.80:0/3186800539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c004800 msgr2=0x7f571c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f573ad46640 1 --2- 172.21.15.80:0/3186800539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f571c004800 0x7f571c004c10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5728009ac0 tx=0x7f571c005830 comp rx=0 tx=0).stop 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f57392e3640 1 -- 172.21.15.80:0/3186800539 reap_dead start 2024-04-25T15:45:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f573ad46640 1 -- 172.21.15.80:0/3186800539 shutdown_connections 2024-04-25T15:45:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f573ad46640 1 -- 172.21.15.80:0/3186800539 >> 172.21.15.80:0/3186800539 conn(0x7f57340d1e20 msgr2=0x7f5734073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f573ad46640 1 -- 172.21.15.80:0/3186800539 shutdown_connections 2024-04-25T15:45:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.723+0000 7f573ad46640 1 -- 172.21.15.80:0/3186800539 wait complete. 2024-04-25T15:45:12.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.725+0000 7f573ad46640 1 Processor -- start 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.725+0000 7f573ad46640 1 -- start start 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c004800 0x7f57341f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 0x7f573409b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57341426d0 0x7f5734145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57340b01f0 con 0x7f573409d0e0 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f57340b0070 con 0x7f57341426d0 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f57340d14a0 con 0x7f571c004800 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 0x7f573409b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 0x7f573409b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58328/0 (socket says 172.21.15.80:58328) 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 -- 172.21.15.80:0/1521107169 learned_addr learned my addr 172.21.15.80:0/1521107169 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 -- 172.21.15.80:0/1521107169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c004800 msgr2=0x7f57341f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c004800 0x7f57341f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 -- 172.21.15.80:0/1521107169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57341426d0 msgr2=0x7f5734145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57341426d0 0x7f5734145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 -- 172.21.15.80:0/1521107169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57341449e0 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f5733fff640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 0x7f573409b990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5728034040 tx=0x7f5728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728041020 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572803c470 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5734144cc0 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728036040 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.727+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734145280 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.728+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57340ce410 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.729+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5728044020 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.729+0000 7f57317fa640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f57200744b0 0x7f57200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.730+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f57280b5810 con 0x7f573409d0e0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.730+0000 7f5738ae2640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f57200744b0 0x7f57200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.730+0000 7f5738ae2640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f57200744b0 0x7f57200769c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5724000f60 tx=0x7f5724000ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:12.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.734+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f57340ce410 con 0x7f573409d0e0 2024-04-25T15:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.943+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f573406a100 con 0x7f573409d0e0 2024-04-25T15:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.944+0000 7f57317fa640 1 -- 172.21.15.80:0/1521107169 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3872 (secure 0 0 0) 0x7f572804b030 con 0x7f573409d0e0 2024-04-25T15:45:12.945 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:12.945 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3862612916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3862612916},{"type":"v1","addr":"172.21.15.195:6834","nonce":3862612916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3672655399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3672655399},{"type":"v1","addr":"172.21.15.195:6835","nonce":3672655399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1185330516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1185330516},{"type":"v1","addr":"172.21.15.80:6835","nonce":1185330516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":6174,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/489000137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":489000137},{"type":"v1","addr":"172.21.15.80:6837","nonce":489000137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[]} 2024-04-25T15:45:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T15:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f57200744b0 msgr2=0x7f57200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f57200744b0 0x7f57200769c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5724000f60 tx=0x7f5724000ef0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 msgr2=0x7f573409b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 0x7f573409b990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5728034040 tx=0x7f5728004730 comp rx=0 tx=0).stop 2024-04-25T15:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 shutdown_connections 2024-04-25T15:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f57200744b0 0x7f57200769c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57341426d0 0x7f5734145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f573409d0e0 0x7f573409b990 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 --2- 172.21.15.80:0/1521107169 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f571c004800 0x7f57341f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 >> 172.21.15.80:0/1521107169 conn(0x7f57340d1e20 msgr2=0x7f5734160ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 shutdown_connections 2024-04-25T15:45:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:12.946+0000 7f573ad46640 1 -- 172.21.15.80:0/1521107169 wait complete. 2024-04-25T15:45:12.958 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:45:12.958 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T15:45:12.959 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:45:12.959 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:12.959 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:45:12.959 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T15:45:12.959 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:45:12.959 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:12.959 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:45:12.960 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T15:45:12.960 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:45:12.960 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:12.960 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:45:12.960 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T15:45:12.960 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:45:12.960 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:12.968 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:45:12.968 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:45:12.971 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:45:12.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:45:12.973 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:45:12.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:45:12.973 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:45:12.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:45:13.014 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:45:13.014 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:13.015 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:45:13.015 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:13.016 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:45:13.016 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:13.017 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:45:13.017 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:13.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T15:45:13.100 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:45:13.100 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:45:13.107 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:45:13.108 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:45:13.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.131+0000 7ff4608d8640 1 Processor -- start 2024-04-25T15:45:13.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.131+0000 7ff4608d8640 1 -- start start 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff4608d8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff45c0d41b0 0x7ff45c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff4608d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0b7d60 0x7ff45c0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff4608d8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c163fb0 con 0x7ff45c1602a0 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff4608d8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c164270 con 0x7ff45c0d41b0 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff45c0d41b0 0x7ff45c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff4608d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c164550 con 0x7ff45c0b7d60 2024-04-25T15:45:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff45c0d41b0 0x7ff45c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58374/0 (socket says 172.21.15.80:58374) 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 -- 172.21.15.80:0/1068822304 learned_addr learned my addr 172.21.15.80:0/1068822304 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45ad9d640 1 --2- 172.21.15.80:0/1068822304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0b7d60 0x7ff45c0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 -- 172.21.15.80:0/1068822304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0b7d60 msgr2=0x7ff45c0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 --2- 172.21.15.80:0/1068822304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0b7d60 0x7ff45c0d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 -- 172.21.15.80:0/1068822304 >> v1:172.21.15.195:6789/0 conn(0x7ff45c1602a0 legacy=0x7ff45c0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.133+0000 7ff45a59c640 1 -- 172.21.15.80:0/1068822304 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c164830 con 0x7ff45c0d41b0 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.134+0000 7ff45a59c640 1 --2- 172.21.15.80:0/1068822304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c0d41b0 0x7ff45c0b48d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009870 tx=0x7ff44c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d4107fd3bfa3a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.134+0000 7ff459d9b640 1 -- 172.21.15.80:0/1068822304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c037070 con 0x7ff45c0d41b0 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.134+0000 7ff459d9b640 1 -- 172.21.15.80:0/1068822304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c032440 con 0x7ff45c0d41b0 2024-04-25T15:45:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.134+0000 7ff459d9b640 1 -- 172.21.15.80:0/1068822304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c032810 con 0x7ff45c0d41b0 2024-04-25T15:45:13.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 -- 172.21.15.80:0/1068822304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c0d41b0 msgr2=0x7ff45c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:13.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1068822304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c0d41b0 0x7ff45c0b48d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009870 tx=0x7ff44c02a270 comp rx=0 tx=0).stop 2024-04-25T15:45:13.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 -- 172.21.15.80:0/1068822304 shutdown_connections 2024-04-25T15:45:13.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1068822304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0b7d60 0x7ff45c0d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:13.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1068822304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c0d41b0 0x7ff45c0b48d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:13.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 -- 172.21.15.80:0/1068822304 >> 172.21.15.80:0/1068822304 conn(0x7ff45c06e9f0 msgr2=0x7ff45c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:13.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 -- 172.21.15.80:0/1068822304 shutdown_connections 2024-04-25T15:45:13.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.135+0000 7ff4608d8640 1 -- 172.21.15.80:0/1068822304 wait complete. 2024-04-25T15:45:13.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.137+0000 7ff4608d8640 1 Processor -- start 2024-04-25T15:45:13.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.137+0000 7ff4608d8640 1 -- start start 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff4608d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0d41b0 0x7ff45c15be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff4608d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 0x7ff45c162880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff4608d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff45c162dc0 0x7ff45c1f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff4608d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c0b5150 con 0x7ff45c1602a0 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff4608d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c0b4fd0 con 0x7ff45c162dc0 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff4608d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c0b9220 con 0x7ff45c0d41b0 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 0x7ff45c162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 0x7ff45c162880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58382/0 (socket says 172.21.15.80:58382) 2024-04-25T15:45:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.138+0000 7ff453fff640 1 -- 172.21.15.80:0/1263338856 learned_addr learned my addr 172.21.15.80:0/1263338856 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff45ad9d640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff45c162dc0 0x7ff45c1f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff45a59c640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0d41b0 0x7ff45c15be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff453fff640 1 -- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0d41b0 msgr2=0x7ff45c15be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff453fff640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0d41b0 0x7ff45c15be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff453fff640 1 -- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff45c162dc0 msgr2=0x7ff45c1f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff453fff640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff45c162dc0 0x7ff45c1f69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff453fff640 1 -- 172.21.15.80:0/1263338856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c1631d0 con 0x7ff45c1602a0 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff45a59c640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0d41b0 0x7ff45c15be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff45ad9d640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff45c162dc0 0x7ff45c1f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:13.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff453fff640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 0x7ff45c162880 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff44400c3f0 tx=0x7ff44400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444017070 con 0x7ff45c1602a0 2024-04-25T15:45:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4440052d0 con 0x7ff45c1602a0 2024-04-25T15:45:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444003830 con 0x7ff45c1602a0 2024-04-25T15:45:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c0ce730 con 0x7ff45c1602a0 2024-04-25T15:45:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.139+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c0cecf0 con 0x7ff45c1602a0 2024-04-25T15:45:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.140+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c06a100 con 0x7ff45c1602a0 2024-04-25T15:45:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.141+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff44401a070 con 0x7ff45c1602a0 2024-04-25T15:45:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.141+0000 7ff452ffd640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff43c0744b0 0x7ff43c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.141+0000 7ff45a59c640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff43c0744b0 0x7ff43c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.141+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7ff444094280 con 0x7ff45c1602a0 2024-04-25T15:45:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.142+0000 7ff45a59c640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff43c0744b0 0x7ff43c0769c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff44c034000 tx=0x7ff44c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:13.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.146+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff45c1631d0 con 0x7ff45c1602a0 2024-04-25T15:45:13.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:13.332+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff45c0d3070 con 0x7ff45c1602a0 2024-04-25T15:45:14.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.422+0000 7ff452ffd640 1 -- 172.21.15.80:0/1263338856 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) ==== 97+0+0 (secure 0 0 0) 0x7ff44405ec10 con 0x7ff45c1602a0 2024-04-25T15:45:14.423 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-25T15:45:14.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff43c0744b0 msgr2=0x7ff43c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff43c0744b0 0x7ff43c0769c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff44c034000 tx=0x7ff44c02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 msgr2=0x7ff45c162880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 0x7ff45c162880 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff44400c3f0 tx=0x7ff44400c8b0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 shutdown_connections 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff43c0744b0 0x7ff43c0769c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff45c162dc0 0x7ff45c1f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff45c1602a0 0x7ff45c162880 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 --2- 172.21.15.80:0/1263338856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff45c0d41b0 0x7ff45c15be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 >> 172.21.15.80:0/1263338856 conn(0x7ff45c06e9f0 msgr2=0x7ff45c0cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 shutdown_connections 2024-04-25T15:45:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.425+0000 7ff4608d8640 1 -- 172.21.15.80:0/1263338856 wait complete. 2024-04-25T15:45:14.439 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T15:45:14.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.548+0000 7fdf69e92640 1 Processor -- start 2024-04-25T15:45:14.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.548+0000 7fdf69e92640 1 -- start start 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.549+0000 7fdf69e92640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdf640cfc40 0x7fdf64160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.549+0000 7fdf69e92640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf64164690 0x7fdf640714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.549+0000 7fdf69e92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf64071df0 con 0x7fdf640719e0 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.549+0000 7fdf69e92640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fdf640b6eb0 con 0x7fdf64164690 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.549+0000 7fdf69e92640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdf640b7150 con 0x7fdf640cfc40 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf62ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf64164690 0x7fdf640714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf63fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdf640719e0 0x7fdf6406c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49406/0 (socket says 172.21.15.80:49406) 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf63fff640 1 -- 172.21.15.80:0/3448027339 learned_addr learned my addr 172.21.15.80:0/3448027339 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf637fe640 1 --2- 172.21.15.80:0/3448027339 >> v2:172.21.15.195:3300/0 conn(0x7fdf640cfc40 0x7fdf64160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf62ffd640 1 -- 172.21.15.80:0/3448027339 >> v2:172.21.15.195:3300/0 conn(0x7fdf640cfc40 msgr2=0x7fdf64160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf62ffd640 1 --2- 172.21.15.80:0/3448027339 >> v2:172.21.15.195:3300/0 conn(0x7fdf640cfc40 0x7fdf64160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf62ffd640 1 -- 172.21.15.80:0/3448027339 >> v1:172.21.15.80:6789/0 conn(0x7fdf640719e0 legacy=0x7fdf6406c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf627fc640 1 -- 172.21.15.80:0/3448027339 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089289125 0 0) 0x7fdf5c001490 con 0x7fdf640719e0 2024-04-25T15:45:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf62ffd640 1 -- 172.21.15.80:0/3448027339 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf640b51e0 con 0x7fdf64164690 2024-04-25T15:45:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.550+0000 7fdf637fe640 1 --2- 172.21.15.80:0/3448027339 >> v2:172.21.15.195:3300/0 conn(0x7fdf640cfc40 0x7fdf64160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf62ffd640 1 --2- 172.21.15.80:0/3448027339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf64164690 0x7fdf640714a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdf64073c60 tx=0x7fdf5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf267f49f44ca24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf627fc640 1 -- 172.21.15.80:0/3448027339 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58037070 con 0x7fdf64164690 2024-04-25T15:45:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf627fc640 1 -- 172.21.15.80:0/3448027339 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf58032440 con 0x7fdf64164690 2024-04-25T15:45:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf627fc640 1 -- 172.21.15.80:0/3448027339 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5802ae60 con 0x7fdf64164690 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf69e92640 1 -- 172.21.15.80:0/3448027339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf64164690 msgr2=0x7fdf640714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf69e92640 1 --2- 172.21.15.80:0/3448027339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf64164690 0x7fdf640714a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdf64073c60 tx=0x7fdf5802a110 comp rx=0 tx=0).stop 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf69e92640 1 -- 172.21.15.80:0/3448027339 shutdown_connections 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf69e92640 1 --2- 172.21.15.80:0/3448027339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf64164690 0x7fdf640714a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf69e92640 1 --2- 172.21.15.80:0/3448027339 >> v2:172.21.15.195:3300/0 conn(0x7fdf640cfc40 0x7fdf64160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.551+0000 7fdf69e92640 1 -- 172.21.15.80:0/3448027339 >> 172.21.15.80:0/3448027339 conn(0x7fdf640d2080 msgr2=0x7fdf640d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.552+0000 7fdf69e92640 1 -- 172.21.15.80:0/3448027339 shutdown_connections 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.552+0000 7fdf69e92640 1 -- 172.21.15.80:0/3448027339 wait complete. 2024-04-25T15:45:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.553+0000 7fdf69e92640 1 Processor -- start 2024-04-25T15:45:14.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.553+0000 7fdf69e92640 1 -- start start 2024-04-25T15:45:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 0x7fdf64158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf640cfc40 0x7fdf64161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf64164690 0x7fdf64161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdf64072040 con 0x7fdf640719e0 2024-04-25T15:45:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdf640b7430 con 0x7fdf64164690 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdf640b6b70 con 0x7fdf640cfc40 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 0x7fdf64158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 0x7fdf64158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60170/0 (socket says 172.21.15.80:60170) 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 -- 172.21.15.80:0/189619003 learned_addr learned my addr 172.21.15.80:0/189619003 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf63fff640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf64164690 0x7fdf64161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf62ffd640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf640cfc40 0x7fdf64161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 -- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf640cfc40 msgr2=0x7fdf64161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf640cfc40 0x7fdf64161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 -- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf64164690 msgr2=0x7fdf64161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf64164690 0x7fdf64161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 -- 172.21.15.80:0/189619003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf64161300 con 0x7fdf640719e0 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf62ffd640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf640cfc40 0x7fdf64161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf637fe640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 0x7fdf64158d00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c7f0 tx=0x7fdf5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:14.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54015070 con 0x7fdf640719e0 2024-04-25T15:45:14.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf54007820 con 0x7fdf640719e0 2024-04-25T15:45:14.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.555+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf641615e0 con 0x7fdf640719e0 2024-04-25T15:45:14.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.556+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54007bd0 con 0x7fdf640719e0 2024-04-25T15:45:14.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.556+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf640cd760 con 0x7fdf640719e0 2024-04-25T15:45:14.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.556+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6406a100 con 0x7fdf640719e0 2024-04-25T15:45:14.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.557+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdf54018070 con 0x7fdf640719e0 2024-04-25T15:45:14.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.557+0000 7fdf4bfff640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf500744b0 0x7fdf500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.558+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7fdf54095240 con 0x7fdf640719e0 2024-04-25T15:45:14.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.558+0000 7fdf62ffd640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf500744b0 0x7fdf500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.558+0000 7fdf62ffd640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf500744b0 0x7fdf500769c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdf58034000 tx=0x7fdf5802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:14.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.562+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf5405fb90 con 0x7fdf640719e0 2024-04-25T15:45:14.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.804+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdf64072570 con 0x7fdf640719e0 2024-04-25T15:45:14.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.804+0000 7fdf4bfff640 1 -- 172.21.15.80:0/189619003 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7fdf5405f490 con 0x7fdf640719e0 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw==", 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:14.806 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q==", 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-25T15:45:14.807 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA==", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw==", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:14.808 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g==", 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-25T15:45:14.809 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw==", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw==", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q==", 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw==", 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.811 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA==", 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA==", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg==", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:14.813 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw==", 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw==", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g==", 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.815 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw==", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:45:14.816 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDMeSpmVFP1JxAAQ3NwNePUywfB5CkeGWRjfA==", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA==", 2024-04-25T15:45:14.817 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og==", 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:14.819 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:45:14.819 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:45:14.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf500744b0 msgr2=0x7fdf500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf500744b0 0x7fdf500769c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdf58034000 tx=0x7fdf5802e000 comp rx=0 tx=0).stop 2024-04-25T15:45:14.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 msgr2=0x7fdf64158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 0x7fdf64158d00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c7f0 tx=0x7fdf5400ccb0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 shutdown_connections 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdf500744b0 0x7fdf500769c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf64164690 0x7fdf64161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf640cfc40 0x7fdf64161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 --2- 172.21.15.80:0/189619003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf640719e0 0x7fdf64158d00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.806+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 >> 172.21.15.80:0/189619003 conn(0x7fdf640d2080 msgr2=0x7fdf640d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.807+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 shutdown_connections 2024-04-25T15:45:14.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.807+0000 7fdf69e92640 1 -- 172.21.15.80:0/189619003 wait complete. 2024-04-25T15:45:14.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:14.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.928+0000 7f8ef0d72640 1 Processor -- start 2024-04-25T15:45:14.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.928+0000 7f8ef0d72640 1 -- start start 2024-04-25T15:45:14.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ef0d72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8eec153f70 0x7f8eec0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ef0d72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8eec06dce0 0x7f8eec0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ef0d72640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eec0b1180 con 0x7f8eec0b0c00 2024-04-25T15:45:14.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ef0d72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8eec15d4f0 con 0x7f8eec06dce0 2024-04-25T15:45:14.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ef0d72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8eec15e270 con 0x7f8eec153f70 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8eead9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8eec06dce0 0x7f8eec0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ee9d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8eec0b0c00 0x7f8eec06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49410/0 (socket says 172.21.15.80:49410) 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ee9d9b640 1 -- 172.21.15.80:0/3551078804 learned_addr learned my addr 172.21.15.80:0/3551078804 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8eea59c640 1 --2- 172.21.15.80:0/3551078804 >> v2:172.21.15.195:3300/0 conn(0x7f8eec153f70 0x7f8eec0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8eead9d640 1 -- 172.21.15.80:0/3551078804 >> v2:172.21.15.195:3300/0 conn(0x7f8eec153f70 msgr2=0x7f8eec0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8eead9d640 1 --2- 172.21.15.80:0/3551078804 >> v2:172.21.15.195:3300/0 conn(0x7f8eec153f70 0x7f8eec0b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8eead9d640 1 -- 172.21.15.80:0/3551078804 >> v1:172.21.15.80:6789/0 conn(0x7f8eec0b0c00 legacy=0x7f8eec06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8ee959a640 1 -- 172.21.15.80:0/3551078804 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866504018 0 0) 0x7f8eec0b1180 con 0x7f8eec0b0c00 2024-04-25T15:45:14.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.930+0000 7f8eead9d640 1 -- 172.21.15.80:0/3551078804 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eec15d790 con 0x7f8eec06dce0 2024-04-25T15:45:14.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.931+0000 7f8eead9d640 1 --2- 172.21.15.80:0/3551078804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec06dce0 0x7f8eec0b4700 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8eec072bf0 tx=0x7f8ee402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547f1966f6be6a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.931+0000 7f8ee959a640 1 -- 172.21.15.80:0/3551078804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4037070 con 0x7f8eec06dce0 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.931+0000 7f8ee959a640 1 -- 172.21.15.80:0/3551078804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee4032440 con 0x7f8eec06dce0 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.931+0000 7f8ee959a640 1 -- 172.21.15.80:0/3551078804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4032810 con 0x7f8eec06dce0 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3551078804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec06dce0 msgr2=0x7f8eec0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3551078804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec06dce0 0x7f8eec0b4700 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8eec072bf0 tx=0x7f8ee402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3551078804 shutdown_connections 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3551078804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec06dce0 0x7f8eec0b4700 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3551078804 >> v2:172.21.15.195:3300/0 conn(0x7f8eec153f70 0x7f8eec0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3551078804 >> 172.21.15.80:0/3551078804 conn(0x7f8eec0d1e20 msgr2=0x7f8eec073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3551078804 shutdown_connections 2024-04-25T15:45:14.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.932+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3551078804 wait complete. 2024-04-25T15:45:14.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.934+0000 7f8ef0d72640 1 Processor -- start 2024-04-25T15:45:14.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.934+0000 7f8ef0d72640 1 -- start start 2024-04-25T15:45:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8ef0d72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8eec0b0c00 0x7f8eec157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8ef0d72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eec153f70 0x7f8eec15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8ef0d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 0x7f8eec09de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8ef0d72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec0af160 con 0x7f8eec15fbf0 2024-04-25T15:45:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8ef0d72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec0aefe0 con 0x7f8eec153f70 2024-04-25T15:45:14.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8ef0d72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8eec0b4c40 con 0x7f8eec0b0c00 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 0x7f8eec09de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 0x7f8eec09de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60186/0 (socket says 172.21.15.80:60186) 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 -- 172.21.15.80:0/3226150555 learned_addr learned my addr 172.21.15.80:0/3226150555 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 -- 172.21.15.80:0/3226150555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8eec0b0c00 msgr2=0x7f8eec157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8eec0b0c00 0x7f8eec157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 -- 172.21.15.80:0/3226150555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eec153f70 msgr2=0x7f8eec15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eec153f70 0x7f8eec15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.935+0000 7f8eead9d640 1 -- 172.21.15.80:0/3226150555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eec1f6bd0 con 0x7f8eec15fbf0 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.936+0000 7f8eead9d640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 0x7f8eec09de20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009890 tx=0x7f8ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.936+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4037050 con 0x7f8eec15fbf0 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.936+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee4038040 con 0x7f8eec15fbf0 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.936+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eec1585f0 con 0x7f8eec15fbf0 2024-04-25T15:45:14.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.936+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4004450 con 0x7f8eec15fbf0 2024-04-25T15:45:14.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.936+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eec158bb0 con 0x7f8eec15fbf0 2024-04-25T15:45:14.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.937+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eec06a100 con 0x7f8eec15fbf0 2024-04-25T15:45:14.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.938+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8ee403c6d0 con 0x7f8eec15fbf0 2024-04-25T15:45:14.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.938+0000 7f8edaffd640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ecc0744b0 0x7f8ecc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:14.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.938+0000 7f8eea59c640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ecc0744b0 0x7f8ecc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:14.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.938+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f8ee40b5a40 con 0x7f8eec15fbf0 2024-04-25T15:45:14.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.938+0000 7f8eea59c640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ecc0744b0 0x7f8ecc0769c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009fa0 tx=0x7f8edc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:14.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:14.943+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ee4080420 con 0x7f8eec15fbf0 2024-04-25T15:45:15.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.121+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8eec1573b0 con 0x7f8eec15fbf0 2024-04-25T15:45:15.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.122+0000 7f8edaffd640 1 -- 172.21.15.80:0/3226150555 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+13152 (secure 0 0 0) 0x7f8ee40b5e20 con 0x7f8eec15fbf0 2024-04-25T15:45:15.123 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:15.123 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":59,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:14.421320+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ecc0744b0 msgr2=0x7f8ecc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ecc0744b0 0x7f8ecc0769c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009fa0 tx=0x7f8edc00b040 comp rx=0 tx=0).stop 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 msgr2=0x7f8eec09de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 0x7f8eec09de20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009890 tx=0x7f8ee40046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 shutdown_connections 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ecc0744b0 0x7f8ecc0769c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8eec15fbf0 0x7f8eec09de20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eec153f70 0x7f8eec15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 --2- 172.21.15.80:0/3226150555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8eec0b0c00 0x7f8eec157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 >> 172.21.15.80:0/3226150555 conn(0x7f8eec0d1e20 msgr2=0x7f8eec0b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:15.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 shutdown_connections 2024-04-25T15:45:15.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.124+0000 7f8ef0d72640 1 -- 172.21.15.80:0/3226150555 wait complete. 2024-04-25T15:45:15.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:15.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:15.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.248+0000 7f4ef26e0640 1 Processor -- start 2024-04-25T15:45:15.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.248+0000 7f4ef26e0640 1 -- start start 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4ef26e0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4eec0d0b00 0x7f4eec0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4ef26e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4eec0d2b80 0x7f4eec0d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4ef26e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eec1643f0 con 0x7f4eec0b5490 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4ef26e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4eec1646d0 con 0x7f4eec0d2b80 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4ef26e0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4eec1649b0 con 0x7f4eec0d0b00 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4ef0c7d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4eec0d2b80 0x7f4eec0d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4eebfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4eec0b5490 0x7f4eec160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49422/0 (socket says 172.21.15.80:49422) 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.249+0000 7f4eebfff640 1 -- 172.21.15.80:0/2252006201 learned_addr learned my addr 172.21.15.80:0/2252006201 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.250+0000 7f4ef0c7d640 1 -- 172.21.15.80:0/2252006201 >> v2:172.21.15.195:3300/0 conn(0x7f4eec0d0b00 msgr2=0x7f4eec0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:15.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.250+0000 7f4ef0c7d640 1 --2- 172.21.15.80:0/2252006201 >> v2:172.21.15.195:3300/0 conn(0x7f4eec0d0b00 0x7f4eec0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.250+0000 7f4ef0c7d640 1 -- 172.21.15.80:0/2252006201 >> v1:172.21.15.80:6789/0 conn(0x7f4eec0b5490 legacy=0x7f4eec160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.250+0000 7f4ef0c7d640 1 -- 172.21.15.80:0/2252006201 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec164c90 con 0x7f4eec0d2b80 2024-04-25T15:45:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.250+0000 7f4eeaffd640 1 -- 172.21.15.80:0/2252006201 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816706487 0 0) 0x7f4eec1643f0 con 0x7f4eec0b5490 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.250+0000 7f4ef0c7d640 1 --2- 172.21.15.80:0/2252006201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0d47d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4eec163ee0 tx=0x7f4ee402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4eddd0fe4e491f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4eeaffd640 1 -- 172.21.15.80:0/2252006201 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4007740 con 0x7f4eec0d2b80 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4eeaffd640 1 -- 172.21.15.80:0/2252006201 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee40078e0 con 0x7f4eec0d2b80 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4eeaffd640 1 -- 172.21.15.80:0/2252006201 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4007cb0 con 0x7f4eec0d2b80 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 -- 172.21.15.80:0/2252006201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d2b80 msgr2=0x7f4eec0d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/2252006201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0d47d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4eec163ee0 tx=0x7f4ee402a680 comp rx=0 tx=0).stop 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 -- 172.21.15.80:0/2252006201 shutdown_connections 2024-04-25T15:45:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/2252006201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0d47d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/2252006201 >> v2:172.21.15.195:3300/0 conn(0x7f4eec0d0b00 0x7f4eec0d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 -- 172.21.15.80:0/2252006201 >> 172.21.15.80:0/2252006201 conn(0x7f4eec06e650 msgr2=0x7f4eec06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 -- 172.21.15.80:0/2252006201 shutdown_connections 2024-04-25T15:45:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.251+0000 7f4ef26e0640 1 -- 172.21.15.80:0/2252006201 wait complete. 2024-04-25T15:45:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.253+0000 7f4ef26e0640 1 Processor -- start 2024-04-25T15:45:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.253+0000 7f4ef26e0640 1 -- start start 2024-04-25T15:45:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.254+0000 7f4ef26e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 0x7f4eec0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4eec0ac830 0x7f4eec1f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec0b94e0 con 0x7f4eec0d0b00 2024-04-25T15:45:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec0b9360 con 0x7f4eec0d2b80 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec163f80 con 0x7f4eec0ac830 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 0x7f4eec0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 0x7f4eec0cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60200/0 (socket says 172.21.15.80:60200) 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 -- 172.21.15.80:0/1150545584 learned_addr learned my addr 172.21.15.80:0/1150545584 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eeb7fe640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef0c7d640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4eec0ac830 0x7f4eec1f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 -- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4eec0ac830 msgr2=0x7f4eec1f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4eec0ac830 0x7f4eec1f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 -- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eec0d2b80 msgr2=0x7f4eec0c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 -- 172.21.15.80:0/1150545584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec1f7880 con 0x7f4eec0d0b00 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eeb7fe640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef0c7d640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4eec0ac830 0x7f4eec1f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4eebfff640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 0x7f4eec0cc4f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c440 tx=0x7f4edc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc018070 con 0x7f4eec0d0b00 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc0074e0 con 0x7f4eec0d0b00 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eec1f7b10 con 0x7f4eec0d0b00 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc004a20 con 0x7f4eec0d0b00 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.255+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eec1f80d0 con 0x7f4eec0d0b00 2024-04-25T15:45:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.256+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eec06a100 con 0x7f4eec0d0b00 2024-04-25T15:45:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.257+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4edc01b070 con 0x7f4eec0d0b00 2024-04-25T15:45:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.257+0000 7f4ee8ff9640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ed80744b0 0x7f4ed80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.258+0000 7f4eeb7fe640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ed80744b0 0x7f4ed80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.258+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f4edc094200 con 0x7f4eec0d0b00 2024-04-25T15:45:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.258+0000 7f4eeb7fe640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ed80744b0 0x7f4ed80769c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0b4910 tx=0x7f4ee0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.262+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4edc05ec70 con 0x7f4eec0d0b00 2024-04-25T15:45:15.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.436+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4eec0d41d0 con 0x7f4eec0d0b00 2024-04-25T15:45:15.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.436+0000 7f4ee8ff9640 1 -- 172.21.15.80:0/1150545584 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7f4edc05e570 con 0x7f4eec0d0b00 2024-04-25T15:45:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:15.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ed80744b0 msgr2=0x7f4ed80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ed80744b0 0x7f4ed80769c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0b4910 tx=0x7f4ee0008040 comp rx=0 tx=0).stop 2024-04-25T15:45:15.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 msgr2=0x7f4eec0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 0x7f4eec0cc4f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c440 tx=0x7f4edc00c900 comp rx=0 tx=0).stop 2024-04-25T15:45:15.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 shutdown_connections 2024-04-25T15:45:15.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ed80744b0 0x7f4ed80769c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4eec0ac830 0x7f4eec1f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eec0d2b80 0x7f4eec0c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 --2- 172.21.15.80:0/1150545584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4eec0d0b00 0x7f4eec0cc4f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 >> 172.21.15.80:0/1150545584 conn(0x7f4eec06e650 msgr2=0x7f4eec0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 shutdown_connections 2024-04-25T15:45:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.438+0000 7f4ef26e0640 1 -- 172.21.15.80:0/1150545584 wait complete. 2024-04-25T15:45:15.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:45:15.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.556+0000 7f1304bd6640 1 Processor -- start 2024-04-25T15:45:15.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.556+0000 7f1304bd6640 1 -- start start 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f1304bd6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 0x7f13000b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f1304bd6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f13000b0c00 0x7f130006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f1304bd6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130006df20 con 0x7f130006db10 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f1304bd6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f13000b1180 con 0x7f13000b0c00 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f1304bd6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f130015d4f0 con 0x7f1300153f70 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f12fe59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 0x7f13000b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f12fdd9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f13000b0c00 0x7f130006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f12fe59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 0x7f13000b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:45398/0 (socket says 172.21.15.80:45398) 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.558+0000 7f12fe59c640 1 -- 172.21.15.80:0/3520043215 learned_addr learned my addr 172.21.15.80:0/3520043215 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.559+0000 7f12fe59c640 1 -- 172.21.15.80:0/3520043215 >> v2:172.21.15.195:3300/0 conn(0x7f13000b0c00 msgr2=0x7f130006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.559+0000 7f12fe59c640 1 --2- 172.21.15.80:0/3520043215 >> v2:172.21.15.195:3300/0 conn(0x7f13000b0c00 0x7f130006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.559+0000 7f12fe59c640 1 -- 172.21.15.80:0/3520043215 >> v1:172.21.15.195:6789/0 conn(0x7f130006db10 legacy=0x7f1300160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.559+0000 7f12fe59c640 1 -- 172.21.15.80:0/3520043215 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130015e270 con 0x7f1300153f70 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.560+0000 7f12fe59c640 1 --2- 172.21.15.80:0/3520043215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 0x7f13000b06c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30b5525eddb81c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.560+0000 7f12fd59a640 1 -- 172.21.15.80:0/3520043215 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0036070 con 0x7f1300153f70 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.560+0000 7f12fd59a640 1 -- 172.21.15.80:0/3520043215 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f0031600 con 0x7f1300153f70 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.560+0000 7f12fd59a640 1 -- 172.21.15.80:0/3520043215 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00319d0 con 0x7f1300153f70 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.560+0000 7f1304bd6640 1 -- 172.21.15.80:0/3520043215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 msgr2=0x7f13000b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.560+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3520043215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 0x7f13000b06c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f002a710 comp rx=0 tx=0).stop 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.561+0000 7f1304bd6640 1 -- 172.21.15.80:0/3520043215 shutdown_connections 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.561+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3520043215 >> v2:172.21.15.195:3300/0 conn(0x7f13000b0c00 0x7f130006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.561+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3520043215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1300153f70 0x7f13000b06c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.561+0000 7f1304bd6640 1 -- 172.21.15.80:0/3520043215 >> 172.21.15.80:0/3520043215 conn(0x7f13000d1e20 msgr2=0x7f1300073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:15.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.561+0000 7f1304bd6640 1 -- 172.21.15.80:0/3520043215 shutdown_connections 2024-04-25T15:45:15.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.561+0000 7f1304bd6640 1 -- 172.21.15.80:0/3520043215 wait complete. 2024-04-25T15:45:15.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.562+0000 7f1304bd6640 1 Processor -- start 2024-04-25T15:45:15.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.563+0000 7f1304bd6640 1 -- start start 2024-04-25T15:45:15.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f1304bd6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f130006db10 0x7f130014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f1304bd6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13000b0c00 0x7f130014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f1304bd6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 0x7f130014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f1304bd6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f13000b5710 con 0x7f1300153f70 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f1304bd6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f130015da70 con 0x7f130006db10 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f1304bd6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f13000aefe0 con 0x7f13000b0c00 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 0x7f130014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 0x7f130014f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60212/0 (socket says 172.21.15.80:60212) 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 -- 172.21.15.80:0/3265958552 learned_addr learned my addr 172.21.15.80:0/3265958552 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fe59c640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f130006db10 0x7f130014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fdd9b640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13000b0c00 0x7f130014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 -- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13000b0c00 msgr2=0x7f130014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13000b0c00 0x7f130014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 -- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f130006db10 msgr2=0x7f130014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f130006db10 0x7f130014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 -- 172.21.15.80:0/3265958552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130014ff40 con 0x7f1300153f70 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.564+0000 7f12fed9d640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 0x7f130014f3d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c3f0 tx=0x7f12f800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.565+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8017070 con 0x7f1300153f70 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.565+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f80052d0 con 0x7f1300153f70 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.565+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8003830 con 0x7f1300153f70 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.565+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1300150220 con 0x7f1300153f70 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.565+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13001507e0 con 0x7f1300153f70 2024-04-25T15:45:15.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.566+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130006a100 con 0x7f1300153f70 2024-04-25T15:45:15.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.566+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f12f801a070 con 0x7f1300153f70 2024-04-25T15:45:15.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.567+0000 7f12eeffd640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12e00744e0 0x7f12e00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.567+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f12f80941f0 con 0x7f1300153f70 2024-04-25T15:45:15.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.567+0000 7f12fe59c640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12e00744e0 0x7f12e00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.567+0000 7f12fe59c640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12e00744e0 0x7f12e00769f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12f0033000 tx=0x7f12f0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.572+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f130006df20 con 0x7f1300153f70 2024-04-25T15:45:15.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.745+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1300070570 con 0x7f1300153f70 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.745+0000 7f12eeffd640 1 -- 172.21.15.80:0/3265958552 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) ==== 84+0+65 (secure 0 0 0) 0x7f12f805e5b0 con 0x7f1300153f70 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:15.747 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:45:15.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12e00744e0 msgr2=0x7f12e00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12e00744e0 0x7f12e00769f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12f0033000 tx=0x7f12f0009000 comp rx=0 tx=0).stop 2024-04-25T15:45:15.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 msgr2=0x7f130014f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 0x7f130014f3d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c3f0 tx=0x7f12f800c7f0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 shutdown_connections 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12e00744e0 0x7f12e00769f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1300153f70 0x7f130014f3d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13000b0c00 0x7f130014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 --2- 172.21.15.80:0/3265958552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f130006db10 0x7f130014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 >> 172.21.15.80:0/3265958552 conn(0x7f13000d1e20 msgr2=0x7f130006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 shutdown_connections 2024-04-25T15:45:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.747+0000 7f1304bd6640 1 -- 172.21.15.80:0/3265958552 wait complete. 2024-04-25T15:45:15.759 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:45:15.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:45:15.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.869+0000 7f2155c97640 1 Processor -- start 2024-04-25T15:45:15.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.869+0000 7f2155c97640 1 -- start start 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f2155c97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215006dce0 0x7f21500af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f2155c97640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21500ae960 con 0x7f21500d1090 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f2155c97640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21500aec40 con 0x7f21500afc60 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f2155c97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2150070470 con 0x7f215006dce0 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f21500d1090 0x7f215006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49428/0 (socket says 172.21.15.80:49428) 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214f7fe640 1 -- 172.21.15.80:0/3911564200 learned_addr learned my addr 172.21.15.80:0/3911564200 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214effd640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215006dce0 0x7f21500af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642030042 0 0) 0x7f21500ae960 con 0x7f21500d1090 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2138003520 con 0x7f21500d1090 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74087478 0 0) 0x7f21500aec40 con 0x7f21500afc60 2024-04-25T15:45:15.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21500ae960 con 0x7f21500afc60 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717663627 0 0) 0x7f2138003520 con 0x7f21500d1090 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215006dce0 msgr2=0x7f21500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215006dce0 0x7f21500af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 >> v1:172.21.15.195:6789/0 conn(0x7f21500afc60 legacy=0x7f215015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21500aef20 con 0x7f21500d1090 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f2140001670 con 0x7f21500d1090 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214effd640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215006dce0 0x7f21500af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.871+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 >> v1:172.21.15.80:6789/0 conn(0x7f21500d1090 legacy=0x7f215006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214e7fc640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f2138003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214e7fc640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2138004800 0x7f2138004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214e7fc640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2138005150 0x7f213800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f213800bfb0 con 0x7f2138003b70 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f213800c130 con 0x7f2138005150 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f213800c300 con 0x7f2138004800 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f2138003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214effd640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2138004800 0x7f2138004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214ffff640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2138005150 0x7f213800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214f7fe640 1 -- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2138004800 msgr2=0x7f2138004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2138004800 0x7f2138004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214f7fe640 1 -- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2138005150 msgr2=0x7f213800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2138005150 0x7f213800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214f7fe640 1 -- 172.21.15.80:0/3911564200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2138003520 con 0x7f2138003b70 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.872+0000 7f214ffff640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2138005150 0x7f213800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f2138003fc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f214000c210 tx=0x7f2138005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ad4876322f0ec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140007ce0 con 0x7f2138003b70 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2140005ad0 con 0x7f2138003b70 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f214e7fc640 1 -- 172.21.15.80:0/3911564200 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140007070 con 0x7f2138003b70 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f2155c97640 1 -- 172.21.15.80:0/3911564200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 msgr2=0x7f2138003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f2155c97640 1 --2- 172.21.15.80:0/3911564200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f2138003fc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f214000c210 tx=0x7f2138005830 comp rx=0 tx=0).stop 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f214ffff640 1 -- 172.21.15.80:0/3911564200 reap_dead start 2024-04-25T15:45:15.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f2155c97640 1 -- 172.21.15.80:0/3911564200 shutdown_connections 2024-04-25T15:45:15.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.873+0000 7f2155c97640 1 -- 172.21.15.80:0/3911564200 >> 172.21.15.80:0/3911564200 conn(0x7f21500d1e20 msgr2=0x7f2150073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:15.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.874+0000 7f2155c97640 1 -- 172.21.15.80:0/3911564200 shutdown_connections 2024-04-25T15:45:15.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.874+0000 7f2155c97640 1 -- 172.21.15.80:0/3911564200 wait complete. 2024-04-25T15:45:15.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.875+0000 7f2155c97640 1 Processor -- start 2024-04-25T15:45:15.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.875+0000 7f2155c97640 1 -- start start 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f21501438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215009cd60 0x7f215006c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f215006cb00 0x7f215009daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21500b01f0 con 0x7f2138003b70 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f21500b0070 con 0x7f215006cb00 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f21500d14a0 con 0x7f215009cd60 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f21501438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f21501438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60224/0 (socket says 172.21.15.80:60224) 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 -- 172.21.15.80:0/3571851188 learned_addr learned my addr 172.21.15.80:0/3571851188 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214effd640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215009cd60 0x7f215006c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214ffff640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f215006cb00 0x7f215009daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 -- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215009cd60 msgr2=0x7f215006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215009cd60 0x7f215006c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 -- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f215006cb00 msgr2=0x7f215009daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f215006cb00 0x7f215009daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 -- 172.21.15.80:0/3571851188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215006cf10 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f214f7fe640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f21501438e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f214000c330 tx=0x7f21500aee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140001670 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2140042070 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215009b9f0 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140007290 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.877+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215009bfb0 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.878+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215006a100 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.879+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2140007430 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.879+0000 7f2137fff640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f213c0744b0 0x7f213c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.880+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f21400b4fd0 con 0x7f2138003b70 2024-04-25T15:45:15.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.880+0000 7f214effd640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f213c0744b0 0x7f213c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:15.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.880+0000 7f214effd640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f213c0744b0 0x7f213c0769c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f215006d770 tx=0x7f2144008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:15.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:15.884+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f215006cf10 con 0x7f2138003b70 2024-04-25T15:45:16.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.062+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2150074510 con 0x7f2138003b70 2024-04-25T15:45:16.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.425+0000 7f2137fff640 1 -- 172.21.15.80:0/3571851188 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) ==== 138+0+0 (secure 0 0 0) 0x7f214007f9b0 con 0x7f2138003b70 2024-04-25T15:45:16.426 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:45:16.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f213c0744b0 msgr2=0x7f213c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:16.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f213c0744b0 0x7f213c0769c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f215006d770 tx=0x7f2144008040 comp rx=0 tx=0).stop 2024-04-25T15:45:16.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 msgr2=0x7f21501438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:16.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f21501438e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f214000c330 tx=0x7f21500aee10 comp rx=0 tx=0).stop 2024-04-25T15:45:16.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 shutdown_connections 2024-04-25T15:45:16.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f213c0744b0 0x7f213c0769c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f215006cb00 0x7f215009daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f215009cd60 0x7f215006c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 --2- 172.21.15.80:0/3571851188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2138003b70 0x7f21501438e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 >> 172.21.15.80:0/3571851188 conn(0x7f21500d1e20 msgr2=0x7f2150160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:16.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 shutdown_connections 2024-04-25T15:45:16.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.427+0000 7f2155c97640 1 -- 172.21.15.80:0/3571851188 wait complete. 2024-04-25T15:45:16.443 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:45:16.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.557+0000 7f556789a640 1 Processor -- start 2024-04-25T15:45:16.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.557+0000 7f556789a640 1 -- start start 2024-04-25T15:45:16.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f556789a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5560165cc0 0x7f55601680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f556789a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55600b1180 con 0x7f556006d5d0 2024-04-25T15:45:16.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f556789a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556015d4f0 con 0x7f5560153f70 2024-04-25T15:45:16.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f556789a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f556015e270 con 0x7f5560165cc0 2024-04-25T15:45:16.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5564e35640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f556006d5d0 0x7f556006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49430/0 (socket says 172.21.15.80:49430) 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5564e35640 1 -- 172.21.15.80:0/3620855570 learned_addr learned my addr 172.21.15.80:0/3620855570 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643375018 0 0) 0x7f55600b1180 con 0x7f556006d5d0 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003520 con 0x7f556006d5d0 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5565e37640 1 --2- 172.21.15.80:0/3620855570 >> v2:172.21.15.195:3300/0 conn(0x7f5560165cc0 0x7f55601680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2427671937 0 0) 0x7f554c003520 con 0x7f556006d5d0 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 >> v2:172.21.15.195:3300/0 conn(0x7f5560165cc0 msgr2=0x7f55601680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 --2- 172.21.15.80:0/3620855570 >> v2:172.21.15.195:3300/0 conn(0x7f5560165cc0 0x7f55601680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 >> v1:172.21.15.195:6789/0 conn(0x7f5560153f70 legacy=0x7f55600b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556015d790 con 0x7f556006d5d0 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f5550001670 con 0x7f556006d5d0 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 >> v1:172.21.15.80:6789/0 conn(0x7f556006d5d0 legacy=0x7f556006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f554c0039b0 0x7f554c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f554c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.559+0000 7f5557fff640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f554c005270 0x7f554c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f556015e270 con 0x7f554c004800 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f554c00c1e0 con 0x7f554c0039b0 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f554c00c3e0 con 0x7f554c005270 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5564e35640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f554c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5565636640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f554c0039b0 0x7f554c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5565e37640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f554c005270 0x7f554c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5564e35640 1 -- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f554c005270 msgr2=0x7f554c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5564e35640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f554c005270 0x7f554c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5564e35640 1 -- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f554c0039b0 msgr2=0x7f554c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5564e35640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f554c0039b0 0x7f554c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5565e37640 1 -- 172.21.15.80:0/3620855570 reap_dead start 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.560+0000 7f5564e35640 1 -- 172.21.15.80:0/3620855570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c003520 con 0x7f554c004800 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f5564e35640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f554c004c10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f555000c240 tx=0x7f554c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d61204b119b0ca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:16.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550007d30 con 0x7f554c004800 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5550005af0 con 0x7f554c004800 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f5557fff640 1 -- 172.21.15.80:0/3620855570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550007070 con 0x7f554c004800 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f556789a640 1 -- 172.21.15.80:0/3620855570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 msgr2=0x7f554c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f556789a640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f554c004c10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f555000c240 tx=0x7f554c005830 comp rx=0 tx=0).stop 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f556789a640 1 -- 172.21.15.80:0/3620855570 shutdown_connections 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f556789a640 1 --2- 172.21.15.80:0/3620855570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f554c004c10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.561+0000 7f556789a640 1 -- 172.21.15.80:0/3620855570 >> 172.21.15.80:0/3620855570 conn(0x7f55600d1e20 msgr2=0x7f5560073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.562+0000 7f556789a640 1 -- 172.21.15.80:0/3620855570 shutdown_connections 2024-04-25T15:45:16.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.562+0000 7f556789a640 1 -- 172.21.15.80:0/3620855570 wait complete. 2024-04-25T15:45:16.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.563+0000 7f556789a640 1 Processor -- start 2024-04-25T15:45:16.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.563+0000 7f556789a640 1 -- start start 2024-04-25T15:45:16.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.564+0000 7f556789a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f5560163c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.564+0000 7f556789a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5560150570 0x7f5560143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.564+0000 7f556789a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5560165620 0x7f556009c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.564+0000 7f556789a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f55600af160 con 0x7f554c004800 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.564+0000 7f556789a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f55600aefe0 con 0x7f5560150570 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.564+0000 7f556789a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f556006d9e0 con 0x7f5560165620 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f5560163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f5560163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60232/0 (socket says 172.21.15.80:60232) 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 -- 172.21.15.80:0/3225188727 learned_addr learned my addr 172.21.15.80:0/3225188727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5564e35640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5560150570 0x7f5560143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565e37640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5560165620 0x7f556009c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 -- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5560165620 msgr2=0x7f556009c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5560165620 0x7f556009c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 -- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5560150570 msgr2=0x7f5560143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:16.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5560150570 0x7f5560143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 -- 172.21.15.80:0/3225188727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5560164580 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5564e35640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5560150570 0x7f5560143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565e37640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5560165620 0x7f556009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5565636640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f5560163c80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f555c00fbb0 tx=0x7f555c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c018020 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c00dc30 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c014470 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5560164860 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.565+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5560164e20 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.566+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556006a100 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.567+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f555c01b020 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.567+0000 7f5555ffb640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55440744b0 0x7f55440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.568+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5619+0+0 (secure 0 0 0) 0x7f555c095a60 con 0x7f554c004800 2024-04-25T15:45:16.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.568+0000 7f5564e35640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55440744b0 0x7f55440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:16.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.568+0000 7f5564e35640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55440744b0 0x7f55440769c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f555000c210 tx=0x7f555002d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:16.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.572+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f555c022020 con 0x7f554c004800 2024-04-25T15:45:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:16.747+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f556015fc50 con 0x7f554c004800 2024-04-25T15:45:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.431+0000 7f5555ffb640 1 -- 172.21.15.80:0/3225188727 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) ==== 170+0+0 (secure 0 0 0) 0x7f555c060240 con 0x7f554c004800 2024-04-25T15:45:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:45:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55440744b0 msgr2=0x7f55440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55440744b0 0x7f55440769c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f555000c210 tx=0x7f555002d000 comp rx=0 tx=0).stop 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 msgr2=0x7f5560163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f5560163c80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f555c00fbb0 tx=0x7f555c00d520 comp rx=0 tx=0).stop 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 shutdown_connections 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f55440744b0 0x7f55440769c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5560165620 0x7f556009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5560150570 0x7f5560143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 --2- 172.21.15.80:0/3225188727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c004800 0x7f5560163c80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.435+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 >> 172.21.15.80:0/3225188727 conn(0x7f55600d1e20 msgr2=0x7f55600b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.436+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 shutdown_connections 2024-04-25T15:45:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.436+0000 7f556789a640 1 -- 172.21.15.80:0/3225188727 wait complete. 2024-04-25T15:45:17.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:45:17.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.572+0000 7f9ead0e9640 1 Processor -- start 2024-04-25T15:45:17.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.572+0000 7f9ead0e9640 1 -- start start 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.573+0000 7f9ead0e9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ea81618b0 0x7f9ea80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.573+0000 7f9ead0e9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9ea806c5c0 0x7f9ea80d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.573+0000 7f9ead0e9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea80d24d0 0x7f9ea80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.573+0000 7f9ead0e9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea80b2b00 con 0x7f9ea81618b0 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.573+0000 7f9ead0e9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea80d28e0 con 0x7f9ea806c5c0 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.573+0000 7f9ead0e9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea806cb80 con 0x7f9ea80d24d0 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ea81618b0 0x7f9ea80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ea81618b0 0x7f9ea80b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60236/0 (socket says 172.21.15.80:60236) 2024-04-25T15:45:17.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 -- 172.21.15.80:0/2515795376 learned_addr learned my addr 172.21.15.80:0/2515795376 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea659c640 1 --2- 172.21.15.80:0/2515795376 >> v2:172.21.15.195:3300/0 conn(0x7f9ea806c5c0 0x7f9ea80d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea759e640 1 --2- 172.21.15.80:0/2515795376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea80d24d0 0x7f9ea80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 -- 172.21.15.80:0/2515795376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea80d24d0 msgr2=0x7f9ea80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 --2- 172.21.15.80:0/2515795376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea80d24d0 0x7f9ea80cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 -- 172.21.15.80:0/2515795376 >> v2:172.21.15.195:3300/0 conn(0x7f9ea806c5c0 msgr2=0x7f9ea80d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 --2- 172.21.15.80:0/2515795376 >> v2:172.21.15.195:3300/0 conn(0x7f9ea806c5c0 0x7f9ea80d1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea6d9d640 1 -- 172.21.15.80:0/2515795376 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea806ce60 con 0x7f9ea81618b0 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.574+0000 7f9ea659c640 1 --2- 172.21.15.80:0/2515795376 >> v2:172.21.15.195:3300/0 conn(0x7f9ea806c5c0 0x7f9ea80d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ea6d9d640 1 --2- 172.21.15.80:0/2515795376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea81618b0 0x7f9ea80b3580 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80d1e70 tx=0x7f9e9802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdb9d2276e7792c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ea5d9b640 1 -- 172.21.15.80:0/2515795376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98036070 con 0x7f9ea81618b0 2024-04-25T15:45:17.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ea5d9b640 1 -- 172.21.15.80:0/2515795376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e98031600 con 0x7f9ea81618b0 2024-04-25T15:45:17.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ea5d9b640 1 -- 172.21.15.80:0/2515795376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e980319d0 con 0x7f9ea81618b0 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 -- 172.21.15.80:0/2515795376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea81618b0 msgr2=0x7f9ea80b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/2515795376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea81618b0 0x7f9ea80b3580 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80d1e70 tx=0x7f9e9802a6a0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 -- 172.21.15.80:0/2515795376 shutdown_connections 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/2515795376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea80d24d0 0x7f9ea80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/2515795376 >> v2:172.21.15.195:3300/0 conn(0x7f9ea806c5c0 0x7f9ea80d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/2515795376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea81618b0 0x7f9ea80b3580 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.575+0000 7f9ead0e9640 1 -- 172.21.15.80:0/2515795376 >> 172.21.15.80:0/2515795376 conn(0x7f9ea809b410 msgr2=0x7f9ea80b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.576+0000 7f9ead0e9640 1 -- 172.21.15.80:0/2515795376 shutdown_connections 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.576+0000 7f9ead0e9640 1 -- 172.21.15.80:0/2515795376 wait complete. 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.578+0000 7f9ead0e9640 1 Processor -- start 2024-04-25T15:45:17.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.578+0000 7f9ead0e9640 1 -- start start 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ead0e9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea806c5c0 0x7f9ea814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ead0e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 0x7f9ea814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ead0e9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea8151c60 0x7f9ea8152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ead0e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8076270 con 0x7f9ea80d24d0 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ead0e9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80b3060 con 0x7f9ea8151c60 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ead0e9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80ccbb0 con 0x7f9ea806c5c0 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 0x7f9ea814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 0x7f9ea814fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60242/0 (socket says 172.21.15.80:60242) 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 -- 172.21.15.80:0/698307854 learned_addr learned my addr 172.21.15.80:0/698307854 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea759e640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea8151c60 0x7f9ea8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea6d9d640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea806c5c0 0x7f9ea814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 -- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea806c5c0 msgr2=0x7f9ea814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea806c5c0 0x7f9ea814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 -- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea8151c60 msgr2=0x7f9ea8152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea8151c60 0x7f9ea8152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea659c640 1 -- 172.21.15.80:0/698307854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea81525b0 con 0x7f9ea80d24d0 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.579+0000 7f9ea759e640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea8151c60 0x7f9ea8152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.580+0000 7f9ea659c640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 0x7f9ea814fbd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00d830 tx=0x7f9e9c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.580+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c018070 con 0x7f9ea80d24d0 2024-04-25T15:45:17.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.580+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c00be10 con 0x7f9ea80d24d0 2024-04-25T15:45:17.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.580+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea8150740 con 0x7f9ea80d24d0 2024-04-25T15:45:17.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.580+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004250 con 0x7f9ea80d24d0 2024-04-25T15:45:17.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.580+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea8150d00 con 0x7f9ea80d24d0 2024-04-25T15:45:17.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.581+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea81504b0 con 0x7f9ea80d24d0 2024-04-25T15:45:17.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.581+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9e9c0098b0 con 0x7f9ea80d24d0 2024-04-25T15:45:17.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.582+0000 7f9e8f7fe640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9e940744b0 0x7f9e940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:17.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.582+0000 7f9ea6d9d640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9e940744b0 0x7f9e940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:17.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.582+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6001+0+0 (secure 0 0 0) 0x7f9e9c095510 con 0x7f9ea80d24d0 2024-04-25T15:45:17.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.582+0000 7f9ea6d9d640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9e940744b0 0x7f9e940769c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e98033000 tx=0x7f9e98009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:17.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.587+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ea81525b0 con 0x7f9ea80d24d0 2024-04-25T15:45:17.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:17.798+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9ea806a100 con 0x7f9ea80d24d0 2024-04-25T15:45:18.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.433+0000 7f9e8f7fe640 1 -- 172.21.15.80:0/698307854 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v26) ==== 173+0+0 (secure 0 0 0) 0x7f9e9c05fc00 con 0x7f9ea80d24d0 2024-04-25T15:45:18.434 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 9 and data pool 10 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9e940744b0 msgr2=0x7f9e940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9e940744b0 0x7f9e940769c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e98033000 tx=0x7f9e98009000 comp rx=0 tx=0).stop 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 msgr2=0x7f9ea814fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 0x7f9ea814fbd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00d830 tx=0x7f9e9c00dcf0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 shutdown_connections 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9e940744b0 0x7f9e940769c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea8151c60 0x7f9ea8152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ea80d24d0 0x7f9ea814fbd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 --2- 172.21.15.80:0/698307854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ea806c5c0 0x7f9ea814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 >> 172.21.15.80:0/698307854 conn(0x7f9ea809b410 msgr2=0x7f9ea80cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:18.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 shutdown_connections 2024-04-25T15:45:18.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.436+0000 7f9ead0e9640 1 -- 172.21.15.80:0/698307854 wait complete. 2024-04-25T15:45:18.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.580+0000 7fe88097d640 1 Processor -- start 2024-04-25T15:45:18.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.580+0000 7fe88097d640 1 -- start start 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe88097d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe87c0b7230 0x7fe87c09ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe88097d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0b9350 con 0x7fe87c0cff30 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe88097d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0cf890 con 0x7fe87c0b2a40 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe88097d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0cfb70 con 0x7fe87c0b7230 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87a59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe87c0cff30 0x7fe87c0d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49432/0 (socket says 172.21.15.80:49432) 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87a59c640 1 -- 172.21.15.80:0/1653770441 learned_addr learned my addr 172.21.15.80:0/1653770441 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87ad9d640 1 --2- 172.21.15.80:0/1653770441 >> v2:172.21.15.195:3300/0 conn(0x7fe87c0b7230 0x7fe87c09ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236498806 0 0) 0x7fe87c0b9350 con 0x7fe87c0cff30 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe864003520 con 0x7fe87c0cff30 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487159210 0 0) 0x7fe864003520 con 0x7fe87c0cff30 2024-04-25T15:45:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 >> v2:172.21.15.195:3300/0 conn(0x7fe87c0b7230 msgr2=0x7fe87c09ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 --2- 172.21.15.80:0/1653770441 >> v2:172.21.15.195:3300/0 conn(0x7fe87c0b7230 0x7fe87c09ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 >> v1:172.21.15.195:6789/0 conn(0x7fe87c0b2a40 legacy=0x7fe87c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.582+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0d2830 con 0x7fe87c0cff30 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe86c001b70 con 0x7fe87c0cff30 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 >> v1:172.21.15.80:6789/0 conn(0x7fe87c0cff30 legacy=0x7fe87c0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8640039b0 0x7fe864003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe864004800 0x7fe864004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864005270 0x7fe86400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0cfb70 con 0x7fe864004800 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe86400c190 con 0x7fe8640039b0 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe86400c390 con 0x7fe864005270 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87ad9d640 1 --2- 172.21.15.80:0/1653770441 >> v2:172.21.15.195:3300/0 conn(0x7fe87c0b7230 0x7fe87c09ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe879d9b640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe864004800 0x7fe864004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87a59c640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8640039b0 0x7fe864003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87ad9d640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864005270 0x7fe86400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe879d9b640 1 -- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864005270 msgr2=0x7fe86400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe879d9b640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864005270 0x7fe86400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe879d9b640 1 -- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8640039b0 msgr2=0x7fe864003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe879d9b640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8640039b0 0x7fe864003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe879d9b640 1 -- 172.21.15.80:0/1653770441 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe864003520 con 0x7fe864004800 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.583+0000 7fe87ad9d640 1 -- 172.21.15.80:0/1653770441 reap_dead start 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe879d9b640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe864004800 0x7fe864004c10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0740f0 tx=0x7fe864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f3bba72f7cb93b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870037070 con 0x7fe864004800 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87002ab90 con 0x7fe864004800 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe87959a640 1 -- 172.21.15.80:0/1653770441 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870001430 con 0x7fe864004800 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe88097d640 1 -- 172.21.15.80:0/1653770441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe864004800 msgr2=0x7fe864004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe88097d640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe864004800 0x7fe864004c10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0740f0 tx=0x7fe864005830 comp rx=0 tx=0).stop 2024-04-25T15:45:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe88097d640 1 -- 172.21.15.80:0/1653770441 shutdown_connections 2024-04-25T15:45:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe88097d640 1 --2- 172.21.15.80:0/1653770441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe864004800 0x7fe864004c10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.584+0000 7fe88097d640 1 -- 172.21.15.80:0/1653770441 >> 172.21.15.80:0/1653770441 conn(0x7fe87c0d0450 msgr2=0x7fe87c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.585+0000 7fe88097d640 1 -- 172.21.15.80:0/1653770441 shutdown_connections 2024-04-25T15:45:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.585+0000 7fe88097d640 1 -- 172.21.15.80:0/1653770441 wait complete. 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.586+0000 7fe88097d640 1 Processor -- start 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.587+0000 7fe88097d640 1 -- start start 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe88097d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864004800 0x7fe87c072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe88097d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 0x7fe87c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe88097d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c150df0 0x7fe87c09ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe88097d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0d10f0 con 0x7fe87c1504a0 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe88097d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0d0f70 con 0x7fe87c150df0 2024-04-25T15:45:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe88097d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c09ce90 con 0x7fe864004800 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 0x7fe87c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 0x7fe87c1508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60260/0 (socket says 172.21.15.80:60260) 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 -- 172.21.15.80:0/2080635417 learned_addr learned my addr 172.21.15.80:0/2080635417 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe87ad9d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c150df0 0x7fe87c09ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe87a59c640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864004800 0x7fe87c072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 -- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864004800 msgr2=0x7fe87c072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864004800 0x7fe87c072390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 -- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c150df0 msgr2=0x7fe87c09ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c150df0 0x7fe87c09ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 -- 172.21.15.80:0/2080635417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c14f6e0 con 0x7fe87c1504a0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe879d9b640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 0x7fe87c1508b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe870035040 tx=0x7fe870001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.588+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870040020 con 0x7fe87c1504a0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.589+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870038040 con 0x7fe87c1504a0 2024-04-25T15:45:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.589+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870037070 con 0x7fe87c1504a0 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.589+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c14f9c0 con 0x7fe87c1504a0 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.589+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c151520 con 0x7fe87c1504a0 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.590+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c06a100 con 0x7fe87c1504a0 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.590+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe870043020 con 0x7fe87c1504a0 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.591+0000 7fe86affd640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe85c0744b0 0x7fe85c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.591+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fe8700b5340 con 0x7fe87c1504a0 2024-04-25T15:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.591+0000 7fe87a59c640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe85c0744b0 0x7fe85c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.591+0000 7fe87a59c640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe85c0744b0 0x7fe85c0769c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe86c001270 tx=0x7fe86c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:18.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.596+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe87004a030 con 0x7fe87c1504a0 2024-04-25T15:45:18.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.773+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe87c150080 con 0x7fe87c1504a0 2024-04-25T15:45:18.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.774+0000 7fe86affd640 1 -- 172.21.15.80:0/2080635417 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16885 (secure 0 0 0) 0x7fe87007f380 con 0x7fe87c1504a0 2024-04-25T15:45:18.775 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:18.776 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":62,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:17.799806+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:18.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe85c0744b0 msgr2=0x7fe85c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe85c0744b0 0x7fe85c0769c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe86c001270 tx=0x7fe86c009040 comp rx=0 tx=0).stop 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 msgr2=0x7fe87c1508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 0x7fe87c1508b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe870035040 tx=0x7fe870001230 comp rx=0 tx=0).stop 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 shutdown_connections 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe85c0744b0 0x7fe85c0769c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe87c150df0 0x7fe87c09ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87c1504a0 0x7fe87c1508b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 --2- 172.21.15.80:0/2080635417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe864004800 0x7fe87c072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 >> 172.21.15.80:0/2080635417 conn(0x7fe87c0d0450 msgr2=0x7fe87c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 shutdown_connections 2024-04-25T15:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.776+0000 7fe88097d640 1 -- 172.21.15.80:0/2080635417 wait complete. 2024-04-25T15:45:18.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:18.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.895+0000 7f09ca814640 1 Processor -- start 2024-04-25T15:45:18.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.895+0000 7f09ca814640 1 -- start start 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.896+0000 7f09ca814640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09c4074240 0x7f09c415c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.896+0000 7f09ca814640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f09c40b65a0 0x7f09c406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.896+0000 7f09ca814640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c40703e0 con 0x7f09c40b0d80 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.896+0000 7f09ca814640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40affc0 con 0x7f09c4074240 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.896+0000 7f09ca814640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40b02a0 con 0x7f09c40b65a0 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09c4074240 0x7f09c415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09c4074240 0x7f09c415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60274/0 (socket says 172.21.15.80:60274) 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 -- 172.21.15.80:0/461256917 learned_addr learned my addr 172.21.15.80:0/461256917 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:18.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c8db1640 1 --2- 172.21.15.80:0/461256917 >> v2:172.21.15.195:3300/0 conn(0x7f09c40b65a0 0x7f09c406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 -- 172.21.15.80:0/461256917 >> v2:172.21.15.195:3300/0 conn(0x7f09c40b65a0 msgr2=0x7f09c406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:18.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 --2- 172.21.15.80:0/461256917 >> v2:172.21.15.195:3300/0 conn(0x7f09c40b65a0 0x7f09c406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 -- 172.21.15.80:0/461256917 >> v1:172.21.15.195:6789/0 conn(0x7f09c40b0d80 legacy=0x7f09c4073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:18.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.897+0000 7f09c37fe640 1 -- 172.21.15.80:0/461256917 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c40b0580 con 0x7f09c4074240 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09c37fe640 1 --2- 172.21.15.80:0/461256917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c4074240 0x7f09c415c670 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f09c40b5ae0 tx=0x7f09b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5e49b650fa977 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09c2ffd640 1 -- 172.21.15.80:0/461256917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8037070 con 0x7f09c4074240 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09c2ffd640 1 -- 172.21.15.80:0/461256917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8032440 con 0x7f09c4074240 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09c2ffd640 1 -- 172.21.15.80:0/461256917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8032810 con 0x7f09c4074240 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 -- 172.21.15.80:0/461256917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c4074240 msgr2=0x7f09c415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 --2- 172.21.15.80:0/461256917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c4074240 0x7f09c415c670 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f09c40b5ae0 tx=0x7f09b802a210 comp rx=0 tx=0).stop 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 -- 172.21.15.80:0/461256917 shutdown_connections 2024-04-25T15:45:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 --2- 172.21.15.80:0/461256917 >> v2:172.21.15.195:3300/0 conn(0x7f09c40b65a0 0x7f09c406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 --2- 172.21.15.80:0/461256917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c4074240 0x7f09c415c670 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 -- 172.21.15.80:0/461256917 >> 172.21.15.80:0/461256917 conn(0x7f09c40d1e20 msgr2=0x7f09c4073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:18.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.898+0000 7f09ca814640 1 -- 172.21.15.80:0/461256917 shutdown_connections 2024-04-25T15:45:18.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.899+0000 7f09ca814640 1 -- 172.21.15.80:0/461256917 wait complete. 2024-04-25T15:45:18.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.900+0000 7f09ca814640 1 Processor -- start 2024-04-25T15:45:18.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.900+0000 7f09ca814640 1 -- start start 2024-04-25T15:45:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09c40b0d80 0x7f09c41516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09c40b65a0 0x7f09c415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 0x7f09c40d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09c406db10 con 0x7f09c40cfe00 2024-04-25T15:45:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40ae7c0 con 0x7f09c40b0d80 2024-04-25T15:45:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f09c406dc90 con 0x7f09c40b65a0 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 0x7f09c40d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 0x7f09c40d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60282/0 (socket says 172.21.15.80:60282) 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 -- 172.21.15.80:0/3878351588 learned_addr learned my addr 172.21.15.80:0/3878351588 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c3fff640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09c40b0d80 0x7f09c41516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c37fe640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09c40b65a0 0x7f09c415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 -- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09c40b65a0 msgr2=0x7f09c415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09c40b65a0 0x7f09c415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 -- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09c40b0d80 msgr2=0x7f09c41516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09c40b0d80 0x7f09c41516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 -- 172.21.15.80:0/3878351588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c40d0750 con 0x7f09c40cfe00 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c3fff640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09c40b0d80 0x7f09c41516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c8db1640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 0x7f09c40d0210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f09bc007e90 tx=0x7f09bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc014420 con 0x7f09c40cfe00 2024-04-25T15:45:18.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09bc019070 con 0x7f09c40cfe00 2024-04-25T15:45:18.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc014800 con 0x7f09c40cfe00 2024-04-25T15:45:18.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c415e520 con 0x7f09c40cfe00 2024-04-25T15:45:18.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.902+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c414ec70 con 0x7f09c40cfe00 2024-04-25T15:45:18.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.903+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c406a100 con 0x7f09c40cfe00 2024-04-25T15:45:18.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.904+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f09bc0149a0 con 0x7f09c40cfe00 2024-04-25T15:45:18.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.904+0000 7f09c0ff9640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09b00744b0 0x7f09b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:18.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.904+0000 7f09c3fff640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09b00744b0 0x7f09b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:18.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.904+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f09bc095b90 con 0x7f09c40cfe00 2024-04-25T15:45:18.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.905+0000 7f09c3fff640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09b00744b0 0x7f09b00769c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f09b4006fd0 tx=0x7f09b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:18.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:18.909+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09c40d0750 con 0x7f09c40cfe00 2024-04-25T15:45:19.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.086+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09c409f760 con 0x7f09c40cfe00 2024-04-25T15:45:19.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.088+0000 7f09c0ff9640 1 -- 172.21.15.80:0/3878351588 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16885 (secure 0 0 0) 0x7f09bc05fbd0 con 0x7f09c40cfe00 2024-04-25T15:45:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:19.089 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":62,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:17.799806+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09b00744b0 msgr2=0x7f09b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09b00744b0 0x7f09b00769c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f09b4006fd0 tx=0x7f09b4008040 comp rx=0 tx=0).stop 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 msgr2=0x7f09c40d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 0x7f09c40d0210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f09bc007e90 tx=0x7f09bc00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 shutdown_connections 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09b00744b0 0x7f09b00769c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c40cfe00 0x7f09c40d0210 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09c40b65a0 0x7f09c415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 --2- 172.21.15.80:0/3878351588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09c40b0d80 0x7f09c41516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 >> 172.21.15.80:0/3878351588 conn(0x7f09c40d1e20 msgr2=0x7f09c415b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 shutdown_connections 2024-04-25T15:45:19.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.090+0000 7f09ca814640 1 -- 172.21.15.80:0/3878351588 wait complete. 2024-04-25T15:45:19.102 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:45:19.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.211+0000 7fd3e617d640 1 Processor -- start 2024-04-25T15:45:19.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.211+0000 7fd3e617d640 1 -- start start 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3e617d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3e009b410 0x7fd3e009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3e617d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3e00cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3e617d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e0160760 con 0x7fd3e00d3110 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3e617d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e009b920 con 0x7fd3e009b410 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3e617d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e00b3410 con 0x7fd3e00d2190 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3deffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd3e00d3110 0x7fd3e00d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49448/0 (socket says 172.21.15.80:49448) 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3deffd640 1 -- 172.21.15.80:0/3942906654 learned_addr learned my addr 172.21.15.80:0/3942906654 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3df7fe640 1 --2- 172.21.15.80:0/3942906654 >> v2:172.21.15.195:3300/0 conn(0x7fd3e009b410 0x7fd3e009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3dffff640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3e00cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 431848545 0 0) 0x7fd3e0160760 con 0x7fd3e00d3110 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c8003520 con 0x7fd3e00d3110 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 657759632 0 0) 0x7fd3c8003520 con 0x7fd3e00d3110 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 msgr2=0x7fd3e00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3e00cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 >> v2:172.21.15.195:3300/0 conn(0x7fd3e009b410 msgr2=0x7fd3e009bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 --2- 172.21.15.80:0/3942906654 >> v2:172.21.15.195:3300/0 conn(0x7fd3e009b410 0x7fd3e009bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e00b3c00 con 0x7fd3e00d3110 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fd3d4001690 con 0x7fd3e00d3110 2024-04-25T15:45:19.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 >> v1:172.21.15.80:6789/0 conn(0x7fd3e00d3110 legacy=0x7fd3e00d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80039b0 0x7fd3c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3c8004d40 0x7fd3c8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e009b920 con 0x7fd3c8004d40 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e00b3410 con 0x7fd3c80039b0 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.213+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c800b9f0 con 0x7fd3e00d2190 2024-04-25T15:45:19.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3dffff640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3c8004d40 0x7fd3c8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3df7fe640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80039b0 0x7fd3c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3deffd640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3dffff640 1 -- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 msgr2=0x7fd3c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3dffff640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3dffff640 1 -- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80039b0 msgr2=0x7fd3c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3dffff640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3c80039b0 0x7fd3c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3dffff640 1 -- 172.21.15.80:0/3942906654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c8003520 con 0x7fd3c8004d40 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.214+0000 7fd3deffd640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e00d2190 0x7fd3c8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3dffff640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3c8004d40 0x7fd3c8005150 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd3e006ee00 tx=0x7fd3c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed88470767c6a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8037070 con 0x7fd3c8004d40 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d8032410 con 0x7fd3c8004d40 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3de7fc640 1 -- 172.21.15.80:0/3942906654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8009c10 con 0x7fd3c8004d40 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3e617d640 1 -- 172.21.15.80:0/3942906654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3c8004d40 msgr2=0x7fd3c8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3e617d640 1 --2- 172.21.15.80:0/3942906654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3c8004d40 0x7fd3c8005150 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd3e006ee00 tx=0x7fd3c8005830 comp rx=0 tx=0).stop 2024-04-25T15:45:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3dffff640 1 -- 172.21.15.80:0/3942906654 reap_dead start 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3e617d640 1 -- 172.21.15.80:0/3942906654 shutdown_connections 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3e617d640 1 -- 172.21.15.80:0/3942906654 >> 172.21.15.80:0/3942906654 conn(0x7fd3e00b7620 msgr2=0x7fd3e00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3e617d640 1 -- 172.21.15.80:0/3942906654 shutdown_connections 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.215+0000 7fd3e617d640 1 -- 172.21.15.80:0/3942906654 wait complete. 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.217+0000 7fd3e617d640 1 Processor -- start 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.217+0000 7fd3e617d640 1 -- start start 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 0x7fd3e014f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e014f620 0x7fd3e009fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3e00a0310 0x7fd3e0152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e00cea40 con 0x7fd3e014fd30 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e00b41a0 con 0x7fd3e00a0310 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e00cef60 con 0x7fd3e014f620 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 0x7fd3e014f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 0x7fd3e014f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60308/0 (socket says 172.21.15.80:60308) 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 -- 172.21.15.80:0/932289657 learned_addr learned my addr 172.21.15.80:0/932289657 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3dffff640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3e00a0310 0x7fd3e0152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3deffd640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e014f620 0x7fd3e009fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 -- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e014f620 msgr2=0x7fd3e009fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e014f620 0x7fd3e009fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 -- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3e00a0310 msgr2=0x7fd3e0152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3e00a0310 0x7fd3e0152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 -- 172.21.15.80:0/932289657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e014fa30 con 0x7fd3e014fd30 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3dffff640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3e00a0310 0x7fd3e0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3df7fe640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 0x7fd3e014f0e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00118e0 tx=0x7fd3d0011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000faf0 con 0x7fd3e014fd30 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d000fc90 con 0x7fd3e014fd30 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e00a0720 con 0x7fd3e014fd30 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0014440 con 0x7fd3e014fd30 2024-04-25T15:45:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.219+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e014d3d0 con 0x7fd3e014fd30 2024-04-25T15:45:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.220+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e006a100 con 0x7fd3e014fd30 2024-04-25T15:45:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.221+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd3d0012040 con 0x7fd3e014fd30 2024-04-25T15:45:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.221+0000 7fd3c7fff640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3cc0744b0 0x7fd3cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.221+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fd3d0095aa0 con 0x7fd3e014fd30 2024-04-25T15:45:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.221+0000 7fd3deffd640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3cc0744b0 0x7fd3cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.222+0000 7fd3deffd640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3cc0744b0 0x7fd3cc0769c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4001eb0 tx=0x7fd3d4001b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.226+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3e014fa30 con 0x7fd3e014fd30 2024-04-25T15:45:19.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.438+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd3e00ccff0 con 0x7fd3e014fd30 2024-04-25T15:45:19.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.451+0000 7fd3c7fff640 1 -- 172.21.15.80:0/932289657 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fd3d0019030 con 0x7fd3e014fd30 2024-04-25T15:45:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3cc0744b0 msgr2=0x7fd3cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3cc0744b0 0x7fd3cc0769c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4001eb0 tx=0x7fd3d4001b50 comp rx=0 tx=0).stop 2024-04-25T15:45:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 msgr2=0x7fd3e014f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 0x7fd3e014f0e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00118e0 tx=0x7fd3d0011da0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 shutdown_connections 2024-04-25T15:45:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3cc0744b0 0x7fd3cc0769c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3e00a0310 0x7fd3e0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3e014f620 0x7fd3e009fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 --2- 172.21.15.80:0/932289657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3e014fd30 0x7fd3e014f0e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 >> 172.21.15.80:0/932289657 conn(0x7fd3e00b7620 msgr2=0x7fd3e00cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 shutdown_connections 2024-04-25T15:45:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.453+0000 7fd3e617d640 1 -- 172.21.15.80:0/932289657 wait complete. 2024-04-25T15:45:19.465 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:45:19.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:45:19.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.574+0000 7fd18ce97640 1 Processor -- start 2024-04-25T15:45:19.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.574+0000 7fd18ce97640 1 -- start start 2024-04-25T15:45:19.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.575+0000 7fd18ce97640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1880b2b80 0x7fd18815e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.575+0000 7fd18ce97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.575+0000 7fd18ce97640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1880d0cd0 con 0x7fd1880d08c0 2024-04-25T15:45:19.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.575+0000 7fd18ce97640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd188161b00 con 0x7fd1880b2b80 2024-04-25T15:45:19.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.575+0000 7fd18ce97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd188161dc0 con 0x7fd1880cee90 2024-04-25T15:45:19.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd18659c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1880b2b80 0x7fd18815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd186d9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd1880d08c0 0x7fd188071970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:37874/0 (socket says 172.21.15.80:37874) 2024-04-25T15:45:19.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd186d9d640 1 -- 172.21.15.80:0/4146234686 learned_addr learned my addr 172.21.15.80:0/4146234686 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd18659c640 1 -- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 msgr2=0x7fd1880d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd18659c640 1 --2- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd18659c640 1 -- 172.21.15.80:0/4146234686 >> v1:172.21.15.195:6789/0 conn(0x7fd1880d08c0 legacy=0x7fd188071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd18659c640 1 -- 172.21.15.80:0/4146234686 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1881620a0 con 0x7fd1880b2b80 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd185d9b640 1 -- 172.21.15.80:0/4146234686 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136002382 0 0) 0x7fd1880d0cd0 con 0x7fd1880d08c0 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.576+0000 7fd17ffff640 1 --2- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:19.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.577+0000 7fd18659c640 1 --2- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880b2b80 0x7fd18815e060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1780097a0 tx=0x7fd17802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd591a73f485457 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:19.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.577+0000 7fd185d9b640 1 -- 172.21.15.80:0/4146234686 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178037070 con 0x7fd1880b2b80 2024-04-25T15:45:19.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.577+0000 7fd185d9b640 1 -- 172.21.15.80:0/4146234686 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17802ae50 con 0x7fd1880b2b80 2024-04-25T15:45:19.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.577+0000 7fd185d9b640 1 -- 172.21.15.80:0/4146234686 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178032660 con 0x7fd1880b2b80 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 -- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880b2b80 msgr2=0x7fd18815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 --2- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880b2b80 0x7fd18815e060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1780097a0 tx=0x7fd17802a100 comp rx=0 tx=0).stop 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 -- 172.21.15.80:0/4146234686 shutdown_connections 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 --2- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 --2- 172.21.15.80:0/4146234686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880b2b80 0x7fd18815e060 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 -- 172.21.15.80:0/4146234686 >> 172.21.15.80:0/4146234686 conn(0x7fd1880b54a0 msgr2=0x7fd1880b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 -- 172.21.15.80:0/4146234686 shutdown_connections 2024-04-25T15:45:19.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.578+0000 7fd18ce97640 1 -- 172.21.15.80:0/4146234686 wait complete. 2024-04-25T15:45:19.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.580+0000 7fd18ce97640 1 Processor -- start 2024-04-25T15:45:19.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.580+0000 7fd18ce97640 1 -- start start 2024-04-25T15:45:19.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18ce97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 0x7fd1881f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18ce97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18ce97640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880d08c0 0x7fd1880d2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18ce97640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd188162940 con 0x7fd1880b2b80 2024-04-25T15:45:19.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18ce97640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd188162660 con 0x7fd1880d08c0 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18ce97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880cf2a0 con 0x7fd1880cee90 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 0x7fd1881f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 0x7fd1881f6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60320/0 (socket says 172.21.15.80:60320) 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 -- 172.21.15.80:0/1645852625 learned_addr learned my addr 172.21.15.80:0/1645852625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd186d9d640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880d08c0 0x7fd1880d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd17ffff640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 -- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 msgr2=0x7fd1880b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 -- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880d08c0 msgr2=0x7fd1880d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880d08c0 0x7fd1880d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd18659c640 1 -- 172.21.15.80:0/1645852625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1880b23b0 con 0x7fd1880b2b80 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.581+0000 7fd17ffff640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.582+0000 7fd18659c640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 0x7fd1881f6f80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd178035040 tx=0x7fd1780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.582+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178037040 con 0x7fd1880b2b80 2024-04-25T15:45:19.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.582+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178004030 con 0x7fd1880b2b80 2024-04-25T15:45:19.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.582+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178004400 con 0x7fd1880b2b80 2024-04-25T15:45:19.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.582+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18806dcb0 con 0x7fd1880b2b80 2024-04-25T15:45:19.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.582+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18806e270 con 0x7fd1880b2b80 2024-04-25T15:45:19.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.583+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18815c580 con 0x7fd1880b2b80 2024-04-25T15:45:19.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.583+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd178003610 con 0x7fd1880b2b80 2024-04-25T15:45:19.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.584+0000 7fd17effd640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd1680744e0 0x7fd1680769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:19.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.584+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fd1780b5fc0 con 0x7fd1880b2b80 2024-04-25T15:45:19.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.584+0000 7fd17ffff640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd1680744e0 0x7fd1680769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:19.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.584+0000 7fd17ffff640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd1680744e0 0x7fd1680769f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1880d2400 tx=0x7fd170008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:19.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.588+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd18815c580 con 0x7fd1880b2b80 2024-04-25T15:45:19.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:19.803+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd18806a100 con 0x7fd1880b2b80 2024-04-25T15:45:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.452+0000 7fd17effd640 1 -- 172.21.15.80:0/1645852625 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fd1780805c0 con 0x7fd1880b2b80 2024-04-25T15:45:20.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd1680744e0 msgr2=0x7fd1680769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd1680744e0 0x7fd1680769f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1880d2400 tx=0x7fd170008040 comp rx=0 tx=0).stop 2024-04-25T15:45:20.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 msgr2=0x7fd1881f6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 0x7fd1881f6f80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd178035040 tx=0x7fd1780046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 shutdown_connections 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd1680744e0 0x7fd1680769f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1880d08c0 0x7fd1880d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1880cee90 0x7fd1880b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 --2- 172.21.15.80:0/1645852625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1880b2b80 0x7fd1881f6f80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 >> 172.21.15.80:0/1645852625 conn(0x7fd1880b54a0 msgr2=0x7fd1880b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 shutdown_connections 2024-04-25T15:45:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.455+0000 7fd18ce97640 1 -- 172.21.15.80:0/1645852625 wait complete. 2024-04-25T15:45:20.469 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:45:20.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.580+0000 7f45642d8640 1 Processor -- start 2024-04-25T15:45:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.580+0000 7f45642d8640 1 -- start start 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f45642d8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f455c0d2650 0x7f455c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f45642d8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c0b2f30 con 0x7f455c0b4b60 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f45642d8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c0b2c90 con 0x7f455c0b91c0 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f45642d8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f455c06eb60 con 0x7f455c0d2650 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f4562875640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f455c0d2650 0x7f455c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f4562074640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f455c0b4b60 0x7f455c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49458/0 (socket says 172.21.15.80:49458) 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.581+0000 7f4562074640 1 -- 172.21.15.80:0/2731363755 learned_addr learned my addr 172.21.15.80:0/2731363755 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.582+0000 7f4562875640 1 -- 172.21.15.80:0/2731363755 >> v1:172.21.15.195:6789/0 conn(0x7f455c0b91c0 legacy=0x7f455c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.582+0000 7f4562875640 1 -- 172.21.15.80:0/2731363755 >> v1:172.21.15.80:6789/0 conn(0x7f455c0b4b60 legacy=0x7f455c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.582+0000 7f4561072640 1 -- 172.21.15.80:0/2731363755 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827675434 0 0) 0x7f455c0b2f30 con 0x7f455c0b4b60 2024-04-25T15:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.582+0000 7f4562875640 1 -- 172.21.15.80:0/2731363755 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c0d10a0 con 0x7f455c0d2650 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.582+0000 7f4562875640 1 --2- 172.21.15.80:0/2731363755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c0d2a60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f455c0d1270 tx=0x7f455402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133d93f092812a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f4561072640 1 -- 172.21.15.80:0/2731363755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455402ae60 con 0x7f455c0d2650 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f4561072640 1 -- 172.21.15.80:0/2731363755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554007740 con 0x7f455c0d2650 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f4561072640 1 -- 172.21.15.80:0/2731363755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554007b10 con 0x7f455c0d2650 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 -- 172.21.15.80:0/2731363755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 msgr2=0x7f455c0d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 --2- 172.21.15.80:0/2731363755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c0d2a60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f455c0d1270 tx=0x7f455402a680 comp rx=0 tx=0).stop 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 -- 172.21.15.80:0/2731363755 shutdown_connections 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 --2- 172.21.15.80:0/2731363755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c0d2a60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 -- 172.21.15.80:0/2731363755 >> 172.21.15.80:0/2731363755 conn(0x7f455c0d0450 msgr2=0x7f455c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 -- 172.21.15.80:0/2731363755 shutdown_connections 2024-04-25T15:45:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.583+0000 7f45642d8640 1 -- 172.21.15.80:0/2731363755 wait complete. 2024-04-25T15:45:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.585+0000 7f45642d8640 1 Processor -- start 2024-04-25T15:45:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.585+0000 7f45642d8640 1 -- start start 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.586+0000 7f45642d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f455c0b4b60 0x7f455c1d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.586+0000 7f45642d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f455c0b91c0 0x7f455c09d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.586+0000 7f45642d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c09dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.586+0000 7f45642d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0d2fa0 con 0x7f455c0d2650 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.586+0000 7f45642d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f455c09cbe0 con 0x7f455c0b91c0 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.586+0000 7f45642d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f455c09d0e0 con 0x7f455c0b4b60 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c09dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c09dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60338/0 (socket says 172.21.15.80:60338) 2024-04-25T15:45:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 -- 172.21.15.80:0/3328892342 learned_addr learned my addr 172.21.15.80:0/3328892342 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4561873640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f455c0b91c0 0x7f455c09d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562074640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f455c0b4b60 0x7f455c1d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 -- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f455c0b4b60 msgr2=0x7f455c1d95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f455c0b4b60 0x7f455c1d95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 -- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f455c0b91c0 msgr2=0x7f455c09d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f455c0b91c0 0x7f455c09d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 -- 172.21.15.80:0/3328892342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c1d9e20 con 0x7f455c0d2650 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4561873640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f455c0b91c0 0x7f455c09d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4562875640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c09dcd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4554009eb0 tx=0x7f4554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554040070 con 0x7f455c0d2650 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455402ae60 con 0x7f455c0d2650 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554045460 con 0x7f455c0d2650 2024-04-25T15:45:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c1da100 con 0x7f455c0d2650 2024-04-25T15:45:20.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.587+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1da6c0 con 0x7f455c0d2650 2024-04-25T15:45:20.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.588+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c06a100 con 0x7f455c0d2650 2024-04-25T15:45:20.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.589+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4554039040 con 0x7f455c0d2650 2024-04-25T15:45:20.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.589+0000 7f4552ffd640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45400744b0 0x7f45400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.589+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f45540b6c90 con 0x7f455c0d2650 2024-04-25T15:45:20.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.589+0000 7f4562074640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45400744b0 0x7f45400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.590+0000 7f4562074640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45400744b0 0x7f45400769c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4558007a50 tx=0x7f4558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:20.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.594+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4554081350 con 0x7f455c0d2650 2024-04-25T15:45:20.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.804+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f455c071400 con 0x7f455c0d2650 2024-04-25T15:45:20.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.805+0000 7f4552ffd640 1 -- 172.21.15.80:0/3328892342 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5188 (secure 0 0 0) 0x7f4554080c50 con 0x7f455c0d2650 2024-04-25T15:45:20.806 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:20.806 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:17.799767+0000","modified":"2024-04-25T15:45:19.804939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4035847402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4035847402},{"type":"v1","addr":"172.21.15.80:6837","nonce":4035847402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":4}]} 2024-04-25T15:45:20.807 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45400744b0 msgr2=0x7f45400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45400744b0 0x7f45400769c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4558007a50 tx=0x7f4558009040 comp rx=0 tx=0).stop 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 msgr2=0x7f455c09dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c09dcd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4554009eb0 tx=0x7f4554004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 shutdown_connections 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f45400744b0 0x7f45400769c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455c0d2650 0x7f455c09dcd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f455c0b91c0 0x7f455c09d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 --2- 172.21.15.80:0/3328892342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f455c0b4b60 0x7f455c1d95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 >> 172.21.15.80:0/3328892342 conn(0x7f455c0d0450 msgr2=0x7f455c0b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:20.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 shutdown_connections 2024-04-25T15:45:20.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.807+0000 7f45642d8640 1 -- 172.21.15.80:0/3328892342 wait complete. 2024-04-25T15:45:20.819 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:20.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.925+0000 7f942870d640 1 Processor -- start 2024-04-25T15:45:20.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.925+0000 7f942870d640 1 -- start start 2024-04-25T15:45:20.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f942870d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9420074240 0x7f942015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f942870d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f94200b65a0 0x7f94200b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f942870d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94200703e0 con 0x7f94200b0d80 2024-04-25T15:45:20.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f942870d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f94200affc0 con 0x7f9420074240 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f942870d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f94200b02a0 con 0x7f94200b65a0 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f9425ca8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9420074240 0x7f942015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f9425ca8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9420074240 0x7f942015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60346/0 (socket says 172.21.15.80:60346) 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f9425ca8640 1 -- 172.21.15.80:0/2965960980 learned_addr learned my addr 172.21.15.80:0/2965960980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.926+0000 7f9426caa640 1 --2- 172.21.15.80:0/2965960980 >> v2:172.21.15.195:3300/0 conn(0x7f94200b65a0 0x7f94200b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.927+0000 7f9425ca8640 1 -- 172.21.15.80:0/2965960980 >> v2:172.21.15.195:3300/0 conn(0x7f94200b65a0 msgr2=0x7f94200b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.927+0000 7f9425ca8640 1 --2- 172.21.15.80:0/2965960980 >> v2:172.21.15.195:3300/0 conn(0x7f94200b65a0 0x7f94200b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.927+0000 7f9425ca8640 1 -- 172.21.15.80:0/2965960980 >> v1:172.21.15.195:6789/0 conn(0x7f94200b0d80 legacy=0x7f9420073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.927+0000 7f9425ca8640 1 -- 172.21.15.80:0/2965960980 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94200b0580 con 0x7f9420074240 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.927+0000 7f9425ca8640 1 --2- 172.21.15.80:0/2965960980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9420074240 0x7f942015c670 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9420160150 tx=0x7f941002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92239e84f86c42e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f94254a7640 1 -- 172.21.15.80:0/2965960980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410037070 con 0x7f9420074240 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f94254a7640 1 -- 172.21.15.80:0/2965960980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9410032440 con 0x7f9420074240 2024-04-25T15:45:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f94254a7640 1 -- 172.21.15.80:0/2965960980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410032810 con 0x7f9420074240 2024-04-25T15:45:20.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 -- 172.21.15.80:0/2965960980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9420074240 msgr2=0x7f942015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 --2- 172.21.15.80:0/2965960980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9420074240 0x7f942015c670 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9420160150 tx=0x7f941002a270 comp rx=0 tx=0).stop 2024-04-25T15:45:20.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 -- 172.21.15.80:0/2965960980 shutdown_connections 2024-04-25T15:45:20.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 --2- 172.21.15.80:0/2965960980 >> v2:172.21.15.195:3300/0 conn(0x7f94200b65a0 0x7f94200b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 --2- 172.21.15.80:0/2965960980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9420074240 0x7f942015c670 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 -- 172.21.15.80:0/2965960980 >> 172.21.15.80:0/2965960980 conn(0x7f94200d1e20 msgr2=0x7f9420073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 -- 172.21.15.80:0/2965960980 shutdown_connections 2024-04-25T15:45:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.928+0000 7f942870d640 1 -- 172.21.15.80:0/2965960980 wait complete. 2024-04-25T15:45:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.930+0000 7f942870d640 1 Processor -- start 2024-04-25T15:45:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.930+0000 7f942870d640 1 -- start start 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.931+0000 7f942870d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94200b0d80 0x7f9420143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.931+0000 7f942870d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 0x7f9420145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.931+0000 7f942870d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94201463c0 0x7f94200b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.931+0000 7f942870d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f942006fe10 con 0x7f94200b65a0 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.931+0000 7f942870d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f94200ae7c0 con 0x7f94200b0d80 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.931+0000 7f942870d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f942006ff90 con 0x7f94201463c0 2024-04-25T15:45:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 0x7f9420145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 0x7f9420145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60354/0 (socket says 172.21.15.80:60354) 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 -- 172.21.15.80:0/1811472543 learned_addr learned my addr 172.21.15.80:0/1811472543 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f94264a9640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94200b0d80 0x7f9420143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9426caa640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94201463c0 0x7f94200b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 -- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94201463c0 msgr2=0x7f94200b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94201463c0 0x7f94200b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 -- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94200b0d80 msgr2=0x7f9420143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94200b0d80 0x7f9420143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 -- 172.21.15.80:0/1811472543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94200b2e30 con 0x7f94200b65a0 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9426caa640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94201463c0 0x7f94200b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9425ca8640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 0x7f9420145cf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f941002a2b0 tx=0x7f94100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410037040 con 0x7f94200b65a0 2024-04-25T15:45:20.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9410042070 con 0x7f94200b65a0 2024-04-25T15:45:20.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94200b3110 con 0x7f94200b65a0 2024-04-25T15:45:20.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410030880 con 0x7f94200b65a0 2024-04-25T15:45:20.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.932+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942014de50 con 0x7f94200b65a0 2024-04-25T15:45:20.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.933+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942006a100 con 0x7f94200b65a0 2024-04-25T15:45:20.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.934+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9410030a20 con 0x7f94200b65a0 2024-04-25T15:45:20.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.935+0000 7f9416ffd640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94040744e0 0x7f94040769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:20.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.935+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f94100b5c10 con 0x7f94200b65a0 2024-04-25T15:45:20.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.935+0000 7f94264a9640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94040744e0 0x7f94040769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:20.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.935+0000 7f94264a9640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94040744e0 0x7f94040769f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f94200b1240 tx=0x7f941c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:20.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:20.939+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9410080210 con 0x7f94200b65a0 2024-04-25T15:45:21.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.115+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94200b2b50 con 0x7f94200b65a0 2024-04-25T15:45:21.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.117+0000 7f9416ffd640 1 -- 172.21.15.80:0/1811472543 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16872 (secure 0 0 0) 0x7f9410088290 con 0x7f94200b65a0 2024-04-25T15:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:21.118 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:19.434303+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94040744e0 msgr2=0x7f94040769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94040744e0 0x7f94040769f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f94200b1240 tx=0x7f941c009040 comp rx=0 tx=0).stop 2024-04-25T15:45:21.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 msgr2=0x7f9420145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 0x7f9420145cf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f941002a2b0 tx=0x7f94100046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 shutdown_connections 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94040744e0 0x7f94040769f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94201463c0 0x7f94200b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94200b65a0 0x7f9420145cf0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 --2- 172.21.15.80:0/1811472543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94200b0d80 0x7f9420143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 >> 172.21.15.80:0/1811472543 conn(0x7f94200d1e20 msgr2=0x7f94201506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 shutdown_connections 2024-04-25T15:45:21.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.119+0000 7f942870d640 1 -- 172.21.15.80:0/1811472543 wait complete. 2024-04-25T15:45:21.131 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:45:21.131 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:21.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.237+0000 7fd442d9f640 1 Processor -- start 2024-04-25T15:45:21.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.237+0000 7fd442d9f640 1 -- start start 2024-04-25T15:45:21.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd442d9f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd43c0b4e90 0x7fd43c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd442d9f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd43c0b7e80 0x7fd43c163f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd442d9f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c0d5310 con 0x7fd43c163af0 2024-04-25T15:45:21.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd442d9f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd43c164440 con 0x7fd43c0b7e80 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd442d9f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd43c164940 con 0x7fd43c0b4e90 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44259e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd43c0b7e80 0x7fd43c163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44159c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd43c163af0 0x7fd43c0b7770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49470/0 (socket says 172.21.15.80:49470) 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44159c640 1 -- 172.21.15.80:0/2650097205 learned_addr learned my addr 172.21.15.80:0/2650097205 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd441d9d640 1 --2- 172.21.15.80:0/2650097205 >> v2:172.21.15.195:3300/0 conn(0x7fd43c0b4e90 0x7fd43c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44259e640 1 -- 172.21.15.80:0/2650097205 >> v2:172.21.15.195:3300/0 conn(0x7fd43c0b4e90 msgr2=0x7fd43c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44259e640 1 --2- 172.21.15.80:0/2650097205 >> v2:172.21.15.195:3300/0 conn(0x7fd43c0b4e90 0x7fd43c0d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44259e640 1 -- 172.21.15.80:0/2650097205 >> v1:172.21.15.80:6789/0 conn(0x7fd43c163af0 legacy=0x7fd43c0b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.239+0000 7fd44259e640 1 -- 172.21.15.80:0/2650097205 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c164660 con 0x7fd43c0b7e80 2024-04-25T15:45:21.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.240+0000 7fd44259e640 1 --2- 172.21.15.80:0/2650097205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c0b7e80 0x7fd43c163f00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd43c06f020 tx=0x7fd43402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88a237e481b6cac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.240+0000 7fd440d9b640 1 -- 172.21.15.80:0/2650097205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434037070 con 0x7fd43c0b7e80 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.240+0000 7fd440d9b640 1 -- 172.21.15.80:0/2650097205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd434032440 con 0x7fd43c0b7e80 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.240+0000 7fd440d9b640 1 -- 172.21.15.80:0/2650097205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434032810 con 0x7fd43c0b7e80 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 -- 172.21.15.80:0/2650097205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c0b7e80 msgr2=0x7fd43c163f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 --2- 172.21.15.80:0/2650097205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c0b7e80 0x7fd43c163f00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd43c06f020 tx=0x7fd43402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 -- 172.21.15.80:0/2650097205 shutdown_connections 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 --2- 172.21.15.80:0/2650097205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c0b7e80 0x7fd43c163f00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 --2- 172.21.15.80:0/2650097205 >> v2:172.21.15.195:3300/0 conn(0x7fd43c0b4e90 0x7fd43c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 -- 172.21.15.80:0/2650097205 >> 172.21.15.80:0/2650097205 conn(0x7fd43c0d27f0 msgr2=0x7fd43c0d2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 -- 172.21.15.80:0/2650097205 shutdown_connections 2024-04-25T15:45:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.241+0000 7fd442d9f640 1 -- 172.21.15.80:0/2650097205 wait complete. 2024-04-25T15:45:21.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.242+0000 7fd442d9f640 1 Processor -- start 2024-04-25T15:45:21.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.243+0000 7fd442d9f640 1 -- start start 2024-04-25T15:45:21.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd442d9f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0b4e90 0x7fd43c0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd442d9f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c163af0 0x7fd43c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd442d9f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 0x7fd43c162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd442d9f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c0d48b0 con 0x7fd43c162860 2024-04-25T15:45:21.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd442d9f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c0d45d0 con 0x7fd43c163af0 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd442d9f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c0d0990 con 0x7fd43c0b4e90 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 0x7fd43c162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 0x7fd43c162c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60368/0 (socket says 172.21.15.80:60368) 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 -- 172.21.15.80:0/4125254619 learned_addr learned my addr 172.21.15.80:0/4125254619 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44159c640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c163af0 0x7fd43c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd441d9d640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0b4e90 0x7fd43c0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 -- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0b4e90 msgr2=0x7fd43c0ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0b4e90 0x7fd43c0ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 -- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c163af0 msgr2=0x7fd43c14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c163af0 0x7fd43c14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 -- 172.21.15.80:0/4125254619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c14f990 con 0x7fd43c162860 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd44259e640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 0x7fd43c162c70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd434009890 tx=0x7fd4340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.244+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434037040 con 0x7fd43c162860 2024-04-25T15:45:21.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.245+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd434042070 con 0x7fd43c162860 2024-04-25T15:45:21.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.245+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c15b9d0 con 0x7fd43c162860 2024-04-25T15:45:21.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.245+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434030b30 con 0x7fd43c162860 2024-04-25T15:45:21.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.245+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c15bf90 con 0x7fd43c162860 2024-04-25T15:45:21.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.245+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c15b740 con 0x7fd43c162860 2024-04-25T15:45:21.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.246+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd434030cd0 con 0x7fd43c162860 2024-04-25T15:45:21.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.247+0000 7fd4327fc640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4200744e0 0x7fd4200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.247+0000 7fd441d9d640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4200744e0 0x7fd4200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.247+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fd4340b5d90 con 0x7fd43c162860 2024-04-25T15:45:21.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.247+0000 7fd441d9d640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4200744e0 0x7fd4200769f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd438003aa0 tx=0x7fd438009830 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.251+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd434032e20 con 0x7fd43c162860 2024-04-25T15:45:21.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.423+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd43c0d3750 con 0x7fd4200744e0 2024-04-25T15:45:21.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.429+0000 7fd4327fc640 1 -- 172.21.15.80:0/4125254619 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249561 (secure 0 0 0) 0x7fd43c0d3750 con 0x7fd4200744e0 2024-04-25T15:45:21.433 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:21.435 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4200744e0 msgr2=0x7fd4200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4200744e0 0x7fd4200769f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd438003aa0 tx=0x7fd438009830 comp rx=0 tx=0).stop 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 msgr2=0x7fd43c162c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 0x7fd43c162c70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd434009890 tx=0x7fd4340046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 shutdown_connections 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd4200744e0 0x7fd4200769f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd43c162860 0x7fd43c162c70 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c163af0 0x7fd43c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 --2- 172.21.15.80:0/4125254619 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0b4e90 0x7fd43c0ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.432+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 >> 172.21.15.80:0/4125254619 conn(0x7fd43c0d27f0 msgr2=0x7fd43c0d54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.433+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 shutdown_connections 2024-04-25T15:45:21.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.433+0000 7fd442d9f640 1 -- 172.21.15.80:0/4125254619 wait complete. 2024-04-25T15:45:21.445 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-04-25T15:45:21.026219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":118,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239728,"kb_used_data":6904,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734992,"statfs":{"total":773094113280,"available":772848631808,"internally_reserved":0,"allocated":7069696,"data_stored":3795913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599442"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470858+0000","last_change":"2024-04-25T15:45:18.463164+0000","last_active":"2024-04-25T15:45:18.470858+0000","last_peered":"2024-04-25T15:45:18.470858+0000","last_clean":"2024-04-25T15:45:18.470858+0000","last_became_active":"2024-04-25T15:45:18.462876+0000","last_became_peered":"2024-04-25T15:45:18.462876+0000","last_unstale":"2024-04-25T15:45:18.470858+0000","last_undegraded":"2024-04-25T15:45:18.470858+0000","last_fullsized":"2024-04-25T15:45:18.470858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.619090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473708+0000","last_change":"2024-04-25T15:45:18.471522+0000","last_active":"2024-04-25T15:45:18.473708+0000","last_peered":"2024-04-25T15:45:18.473708+0000","last_clean":"2024-04-25T15:45:18.473708+0000","last_became_active":"2024-04-25T15:45:18.471222+0000","last_became_peered":"2024-04-25T15:45:18.471222+0000","last_unstale":"2024-04-25T15:45:18.473708+0000","last_undegraded":"2024-04-25T15:45:18.473708+0000","last_fullsized":"2024-04-25T15:45:18.473708+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:07.083583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445527+0000","last_change":"2024-04-25T15:45:17.445527+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445527+0000","last_undegraded":"2024-04-25T15:45:17.445527+0000","last_fullsized":"2024-04-25T15:45:17.445527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457899+0000","last_change":"2024-04-25T15:45:18.456533+0000","last_active":"2024-04-25T15:45:18.457899+0000","last_peered":"2024-04-25T15:45:18.457899+0000","last_clean":"2024-04-25T15:45:18.457899+0000","last_became_active":"2024-04-25T15:45:18.456174+0000","last_became_peered":"2024-04-25T15:45:18.456174+0000","last_unstale":"2024-04-25T15:45:18.457899+0000","last_undegraded":"2024-04-25T15:45:18.457899+0000","last_fullsized":"2024-04-25T15:45:18.457899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:50.821828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.462989+0000","last_change":"2024-04-25T15:45:18.458070+0000","last_active":"2024-04-25T15:45:18.462989+0000","last_peered":"2024-04-25T15:45:18.462989+0000","last_clean":"2024-04-25T15:45:18.462989+0000","last_became_active":"2024-04-25T15:45:18.457484+0000","last_became_peered":"2024-04-25T15:45:18.457484+0000","last_unstale":"2024-04-25T15:45:18.462989+0000","last_undegraded":"2024-04-25T15:45:18.462989+0000","last_fullsized":"2024-04-25T15:45:18.462989+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:00.413348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467170+0000","last_change":"2024-04-25T15:45:18.456510+0000","last_active":"2024-04-25T15:45:18.467170+0000","last_peered":"2024-04-25T15:45:18.467170+0000","last_clean":"2024-04-25T15:45:18.467170+0000","last_became_active":"2024-04-25T15:45:18.456074+0000","last_became_peered":"2024-04-25T15:45:18.456074+0000","last_unstale":"2024-04-25T15:45:18.467170+0000","last_undegraded":"2024-04-25T15:45:18.467170+0000","last_fullsized":"2024-04-25T15:45:18.467170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:43.759488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445774+0000","last_change":"2024-04-25T15:45:17.445774+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445774+0000","last_undegraded":"2024-04-25T15:45:17.445774+0000","last_fullsized":"2024-04-25T15:45:17.445774+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436021+0000","last_change":"2024-04-25T15:45:17.436021+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436021+0000","last_undegraded":"2024-04-25T15:45:17.436021+0000","last_fullsized":"2024-04-25T15:45:17.436021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436489+0000","last_change":"2024-04-25T15:45:17.436489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436489+0000","last_undegraded":"2024-04-25T15:45:17.436489+0000","last_fullsized":"2024-04-25T15:45:17.436489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442162+0000","last_change":"2024-04-25T15:45:17.442162+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442162+0000","last_undegraded":"2024-04-25T15:45:17.442162+0000","last_fullsized":"2024-04-25T15:45:17.442162+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443910+0000","last_change":"2024-04-25T15:45:17.443910+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443910+0000","last_undegraded":"2024-04-25T15:45:17.443910+0000","last_fullsized":"2024-04-25T15:45:17.443910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.446326+0000","last_change":"2024-04-25T15:45:17.446326+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.446326+0000","last_undegraded":"2024-04-25T15:45:17.446326+0000","last_fullsized":"2024-04-25T15:45:17.446326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435716+0000","last_change":"2024-04-25T15:45:17.435716+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435716+0000","last_undegraded":"2024-04-25T15:45:17.435716+0000","last_fullsized":"2024-04-25T15:45:17.435716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436552+0000","last_change":"2024-04-25T15:45:17.436552+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436552+0000","last_undegraded":"2024-04-25T15:45:17.436552+0000","last_fullsized":"2024-04-25T15:45:17.436552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463682+0000","last_change":"2024-04-25T15:45:18.455213+0000","last_active":"2024-04-25T15:45:18.463682+0000","last_peered":"2024-04-25T15:45:18.463682+0000","last_clean":"2024-04-25T15:45:18.463682+0000","last_became_active":"2024-04-25T15:45:18.454775+0000","last_became_peered":"2024-04-25T15:45:18.454775+0000","last_unstale":"2024-04-25T15:45:18.463682+0000","last_undegraded":"2024-04-25T15:45:18.463682+0000","last_fullsized":"2024-04-25T15:45:18.463682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:24.128238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473633+0000","last_change":"2024-04-25T15:45:18.470969+0000","last_active":"2024-04-25T15:45:18.473633+0000","last_peered":"2024-04-25T15:45:18.473633+0000","last_clean":"2024-04-25T15:45:18.473633+0000","last_became_active":"2024-04-25T15:45:18.470257+0000","last_became_peered":"2024-04-25T15:45:18.470257+0000","last_unstale":"2024-04-25T15:45:18.473633+0000","last_undegraded":"2024-04-25T15:45:18.473633+0000","last_fullsized":"2024-04-25T15:45:18.473633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:42.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443489+0000","last_change":"2024-04-25T15:45:17.443489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443489+0000","last_undegraded":"2024-04-25T15:45:17.443489+0000","last_fullsized":"2024-04-25T15:45:17.443489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455289+0000","last_change":"2024-04-25T15:45:18.454437+0000","last_active":"2024-04-25T15:45:18.455289+0000","last_peered":"2024-04-25T15:45:18.455289+0000","last_clean":"2024-04-25T15:45:18.455289+0000","last_became_active":"2024-04-25T15:45:18.454136+0000","last_became_peered":"2024-04-25T15:45:18.454136+0000","last_unstale":"2024-04-25T15:45:18.455289+0000","last_undegraded":"2024-04-25T15:45:18.455289+0000","last_fullsized":"2024-04-25T15:45:18.455289+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:29.265268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461927+0000","last_change":"2024-04-25T15:45:18.457308+0000","last_active":"2024-04-25T15:45:18.461927+0000","last_peered":"2024-04-25T15:45:18.461927+0000","last_clean":"2024-04-25T15:45:18.461927+0000","last_became_active":"2024-04-25T15:45:18.456857+0000","last_became_peered":"2024-04-25T15:45:18.456857+0000","last_unstale":"2024-04-25T15:45:18.461927+0000","last_undegraded":"2024-04-25T15:45:18.461927+0000","last_fullsized":"2024-04-25T15:45:18.461927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:53.453597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445841+0000","last_change":"2024-04-25T15:45:17.445841+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445841+0000","last_undegraded":"2024-04-25T15:45:17.445841+0000","last_fullsized":"2024-04-25T15:45:17.445841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470602+0000","last_change":"2024-04-25T15:45:18.467343+0000","last_active":"2024-04-25T15:45:18.470602+0000","last_peered":"2024-04-25T15:45:18.470602+0000","last_clean":"2024-04-25T15:45:18.470602+0000","last_became_active":"2024-04-25T15:45:18.467005+0000","last_became_peered":"2024-04-25T15:45:18.467005+0000","last_unstale":"2024-04-25T15:45:18.470602+0000","last_undegraded":"2024-04-25T15:45:18.470602+0000","last_fullsized":"2024-04-25T15:45:18.470602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:32.165550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468031+0000","last_change":"2024-04-25T15:45:18.466266+0000","last_active":"2024-04-25T15:45:18.468031+0000","last_peered":"2024-04-25T15:45:18.468031+0000","last_clean":"2024-04-25T15:45:18.468031+0000","last_became_active":"2024-04-25T15:45:18.465937+0000","last_became_peered":"2024-04-25T15:45:18.465937+0000","last_unstale":"2024-04-25T15:45:18.468031+0000","last_undegraded":"2024-04-25T15:45:18.468031+0000","last_fullsized":"2024-04-25T15:45:18.468031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:03.990617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435673+0000","last_change":"2024-04-25T15:45:17.435673+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435673+0000","last_undegraded":"2024-04-25T15:45:17.435673+0000","last_fullsized":"2024-04-25T15:45:17.435673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445064+0000","last_change":"2024-04-25T15:45:17.445064+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445064+0000","last_undegraded":"2024-04-25T15:45:17.445064+0000","last_fullsized":"2024-04-25T15:45:17.445064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443182+0000","last_change":"2024-04-25T15:45:17.443182+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443182+0000","last_undegraded":"2024-04-25T15:45:17.443182+0000","last_fullsized":"2024-04-25T15:45:17.443182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441639+0000","last_change":"2024-04-25T15:45:17.441639+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441639+0000","last_undegraded":"2024-04-25T15:45:17.441639+0000","last_fullsized":"2024-04-25T15:45:17.441639+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472508+0000","last_change":"2024-04-25T15:45:18.468839+0000","last_active":"2024-04-25T15:45:18.472508+0000","last_peered":"2024-04-25T15:45:18.472508+0000","last_clean":"2024-04-25T15:45:18.472508+0000","last_became_active":"2024-04-25T15:45:18.467727+0000","last_became_peered":"2024-04-25T15:45:18.467727+0000","last_unstale":"2024-04-25T15:45:18.472508+0000","last_undegraded":"2024-04-25T15:45:18.472508+0000","last_fullsized":"2024-04-25T15:45:18.472508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:23.502579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442604+0000","last_change":"2024-04-25T15:45:17.442604+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442604+0000","last_undegraded":"2024-04-25T15:45:17.442604+0000","last_fullsized":"2024-04-25T15:45:17.442604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443084+0000","last_change":"2024-04-25T15:45:17.443084+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443084+0000","last_undegraded":"2024-04-25T15:45:17.443084+0000","last_fullsized":"2024-04-25T15:45:17.443084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468155+0000","last_change":"2024-04-25T15:45:18.461593+0000","last_active":"2024-04-25T15:45:18.468155+0000","last_peered":"2024-04-25T15:45:18.468155+0000","last_clean":"2024-04-25T15:45:18.468155+0000","last_became_active":"2024-04-25T15:45:18.460991+0000","last_became_peered":"2024-04-25T15:45:18.460991+0000","last_unstale":"2024-04-25T15:45:18.468155+0000","last_undegraded":"2024-04-25T15:45:18.468155+0000","last_fullsized":"2024-04-25T15:45:18.468155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:14.574983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471531+0000","last_change":"2024-04-25T15:45:18.470892+0000","last_active":"2024-04-25T15:45:18.471531+0000","last_peered":"2024-04-25T15:45:18.471531+0000","last_clean":"2024-04-25T15:45:18.471531+0000","last_became_active":"2024-04-25T15:45:18.470554+0000","last_became_peered":"2024-04-25T15:45:18.470554+0000","last_unstale":"2024-04-25T15:45:18.471531+0000","last_undegraded":"2024-04-25T15:45:18.471531+0000","last_fullsized":"2024-04-25T15:45:18.471531+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:11.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470500+0000","last_change":"2024-04-25T15:45:17.450209+0000","last_active":"2024-04-25T15:45:18.470500+0000","last_peered":"2024-04-25T15:45:18.470500+0000","last_clean":"2024-04-25T15:45:18.470500+0000","last_became_active":"2024-04-25T15:45:17.449955+0000","last_became_peered":"2024-04-25T15:45:17.449955+0000","last_unstale":"2024-04-25T15:45:18.470500+0000","last_undegraded":"2024-04-25T15:45:18.470500+0000","last_fullsized":"2024-04-25T15:45:18.470500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:49.999228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441117+0000","last_change":"2024-04-25T15:45:17.441117+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441117+0000","last_undegraded":"2024-04-25T15:45:17.441117+0000","last_fullsized":"2024-04-25T15:45:17.441117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468359+0000","last_change":"2024-04-25T15:45:17.452008+0000","last_active":"2024-04-25T15:45:18.468359+0000","last_peered":"2024-04-25T15:45:18.468359+0000","last_clean":"2024-04-25T15:45:18.468359+0000","last_became_active":"2024-04-25T15:45:17.451635+0000","last_became_peered":"2024-04-25T15:45:17.451635+0000","last_unstale":"2024-04-25T15:45:18.468359+0000","last_undegraded":"2024-04-25T15:45:18.468359+0000","last_fullsized":"2024-04-25T15:45:18.468359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464096+0000","last_change":"2024-04-25T15:45:18.460858+0000","last_active":"2024-04-25T15:45:18.464096+0000","last_peered":"2024-04-25T15:45:18.464096+0000","last_clean":"2024-04-25T15:45:18.464096+0000","last_became_active":"2024-04-25T15:45:18.460430+0000","last_became_peered":"2024-04-25T15:45:18.460430+0000","last_unstale":"2024-04-25T15:45:18.464096+0000","last_undegraded":"2024-04-25T15:45:18.464096+0000","last_fullsized":"2024-04-25T15:45:18.464096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:09.832403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468632+0000","last_change":"2024-04-25T15:45:17.448435+0000","last_active":"2024-04-25T15:45:18.468632+0000","last_peered":"2024-04-25T15:45:18.468632+0000","last_clean":"2024-04-25T15:45:18.468632+0000","last_became_active":"2024-04-25T15:45:17.448082+0000","last_became_peered":"2024-04-25T15:45:17.448082+0000","last_unstale":"2024-04-25T15:45:18.468632+0000","last_undegraded":"2024-04-25T15:45:18.468632+0000","last_fullsized":"2024-04-25T15:45:18.468632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:44.683965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436744+0000","last_change":"2024-04-25T15:45:17.436744+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436744+0000","last_undegraded":"2024-04-25T15:45:17.436744+0000","last_fullsized":"2024-04-25T15:45:17.436744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472823+0000","last_change":"2024-04-25T15:45:17.441391+0000","last_active":"2024-04-25T15:45:18.472823+0000","last_peered":"2024-04-25T15:45:18.472823+0000","last_clean":"2024-04-25T15:45:18.472823+0000","last_became_active":"2024-04-25T15:45:17.441059+0000","last_became_peered":"2024-04-25T15:45:17.441059+0000","last_unstale":"2024-04-25T15:45:18.472823+0000","last_undegraded":"2024-04-25T15:45:18.472823+0000","last_fullsized":"2024-04-25T15:45:18.472823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467444+0000","last_change":"2024-04-25T15:45:18.461108+0000","last_active":"2024-04-25T15:45:18.467444+0000","last_peered":"2024-04-25T15:45:18.467444+0000","last_clean":"2024-04-25T15:45:18.467444+0000","last_became_active":"2024-04-25T15:45:18.460693+0000","last_became_peered":"2024-04-25T15:45:18.460693+0000","last_unstale":"2024-04-25T15:45:18.467444+0000","last_undegraded":"2024-04-25T15:45:18.467444+0000","last_fullsized":"2024-04-25T15:45:18.467444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:27.044492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.469081+0000","last_change":"2024-04-25T15:45:17.453653+0000","last_active":"2024-04-25T15:45:18.469081+0000","last_peered":"2024-04-25T15:45:18.469081+0000","last_clean":"2024-04-25T15:45:18.469081+0000","last_became_active":"2024-04-25T15:45:17.453292+0000","last_became_peered":"2024-04-25T15:45:17.453292+0000","last_unstale":"2024-04-25T15:45:18.469081+0000","last_undegraded":"2024-04-25T15:45:18.469081+0000","last_fullsized":"2024-04-25T15:45:18.469081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:12.590842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472180+0000","last_change":"2024-04-25T15:45:18.469156+0000","last_active":"2024-04-25T15:45:18.472180+0000","last_peered":"2024-04-25T15:45:18.472180+0000","last_clean":"2024-04-25T15:45:18.472180+0000","last_became_active":"2024-04-25T15:45:18.468808+0000","last_became_peered":"2024-04-25T15:45:18.468808+0000","last_unstale":"2024-04-25T15:45:18.472180+0000","last_undegraded":"2024-04-25T15:45:18.472180+0000","last_fullsized":"2024-04-25T15:45:18.472180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:11.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473211+0000","last_change":"2024-04-25T15:45:17.448087+0000","last_active":"2024-04-25T15:45:18.473211+0000","last_peered":"2024-04-25T15:45:18.473211+0000","last_clean":"2024-04-25T15:45:18.473211+0000","last_became_active":"2024-04-25T15:45:17.447741+0000","last_became_peered":"2024-04-25T15:45:17.447741+0000","last_unstale":"2024-04-25T15:45:18.473211+0000","last_undegraded":"2024-04-25T15:45:18.473211+0000","last_fullsized":"2024-04-25T15:45:18.473211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:13.573046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.466578+0000","last_change":"2024-04-25T15:45:18.463919+0000","last_active":"2024-04-25T15:45:18.466578+0000","last_peered":"2024-04-25T15:45:18.466578+0000","last_clean":"2024-04-25T15:45:18.466578+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.466578+0000","last_undegraded":"2024-04-25T15:45:18.466578+0000","last_fullsized":"2024-04-25T15:45:18.466578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.704086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446311+0000","last_change":"2024-04-25T15:45:17.456424+0000","last_active":"2024-04-25T15:45:18.446311+0000","last_peered":"2024-04-25T15:45:18.446311+0000","last_clean":"2024-04-25T15:45:18.446311+0000","last_became_active":"2024-04-25T15:45:17.456094+0000","last_became_peered":"2024-04-25T15:45:17.456094+0000","last_unstale":"2024-04-25T15:45:18.446311+0000","last_undegraded":"2024-04-25T15:45:18.446311+0000","last_fullsized":"2024-04-25T15:45:18.446311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:59.411412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.453962+0000","last_change":"2024-04-25T15:45:18.450549+0000","last_active":"2024-04-25T15:45:18.453962+0000","last_peered":"2024-04-25T15:45:18.453962+0000","last_clean":"2024-04-25T15:45:18.453962+0000","last_became_active":"2024-04-25T15:45:18.450220+0000","last_became_peered":"2024-04-25T15:45:18.450220+0000","last_unstale":"2024-04-25T15:45:18.453962+0000","last_undegraded":"2024-04-25T15:45:18.453962+0000","last_fullsized":"2024-04-25T15:45:18.453962+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445943+0000","last_change":"2024-04-25T15:45:17.453235+0000","last_active":"2024-04-25T15:45:18.445943+0000","last_peered":"2024-04-25T15:45:18.445943+0000","last_clean":"2024-04-25T15:45:18.445943+0000","last_became_active":"2024-04-25T15:45:17.452866+0000","last_became_peered":"2024-04-25T15:45:17.452866+0000","last_unstale":"2024-04-25T15:45:18.445943+0000","last_undegraded":"2024-04-25T15:45:18.445943+0000","last_fullsized":"2024-04-25T15:45:18.445943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472543+0000","last_change":"2024-04-25T15:45:18.469147+0000","last_active":"2024-04-25T15:45:18.472543+0000","last_peered":"2024-04-25T15:45:18.472543+0000","last_clean":"2024-04-25T15:45:18.472543+0000","last_became_active":"2024-04-25T15:45:18.467937+0000","last_became_peered":"2024-04-25T15:45:18.467937+0000","last_unstale":"2024-04-25T15:45:18.472543+0000","last_undegraded":"2024-04-25T15:45:18.472543+0000","last_fullsized":"2024-04-25T15:45:18.472543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:24.631878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452522+0000","last_change":"2024-04-25T15:45:17.447439+0000","last_active":"2024-04-25T15:45:17.452522+0000","last_peered":"2024-04-25T15:45:17.452522+0000","last_clean":"2024-04-25T15:45:17.452522+0000","last_became_active":"2024-04-25T15:45:17.446486+0000","last_became_peered":"2024-04-25T15:45:17.446486+0000","last_unstale":"2024-04-25T15:45:17.452522+0000","last_undegraded":"2024-04-25T15:45:17.452522+0000","last_fullsized":"2024-04-25T15:45:17.452522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461897+0000","last_change":"2024-04-25T15:45:18.456089+0000","last_active":"2024-04-25T15:45:18.461897+0000","last_peered":"2024-04-25T15:45:18.461897+0000","last_clean":"2024-04-25T15:45:18.461897+0000","last_became_active":"2024-04-25T15:45:18.455775+0000","last_became_peered":"2024-04-25T15:45:18.455775+0000","last_unstale":"2024-04-25T15:45:18.461897+0000","last_undegraded":"2024-04-25T15:45:18.461897+0000","last_fullsized":"2024-04-25T15:45:18.461897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451366+0000","last_change":"2024-04-25T15:45:17.447523+0000","last_active":"2024-04-25T15:45:17.451366+0000","last_peered":"2024-04-25T15:45:17.451366+0000","last_clean":"2024-04-25T15:45:17.451366+0000","last_became_active":"2024-04-25T15:45:17.447092+0000","last_became_peered":"2024-04-25T15:45:17.447092+0000","last_unstale":"2024-04-25T15:45:17.451366+0000","last_undegraded":"2024-04-25T15:45:17.451366+0000","last_fullsized":"2024-04-25T15:45:17.451366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:21.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460793+0000","last_change":"2024-04-25T15:45:18.458720+0000","last_active":"2024-04-25T15:45:18.460793+0000","last_peered":"2024-04-25T15:45:18.460793+0000","last_clean":"2024-04-25T15:45:18.460793+0000","last_became_active":"2024-04-25T15:45:18.458419+0000","last_became_peered":"2024-04-25T15:45:18.458419+0000","last_unstale":"2024-04-25T15:45:18.460793+0000","last_undegraded":"2024-04-25T15:45:18.460793+0000","last_fullsized":"2024-04-25T15:45:18.460793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:22.375221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452009+0000","last_change":"2024-04-25T15:45:17.445901+0000","last_active":"2024-04-25T15:45:17.452009+0000","last_peered":"2024-04-25T15:45:17.452009+0000","last_clean":"2024-04-25T15:45:17.452009+0000","last_became_active":"2024-04-25T15:45:17.445519+0000","last_became_peered":"2024-04-25T15:45:17.445519+0000","last_unstale":"2024-04-25T15:45:17.452009+0000","last_undegraded":"2024-04-25T15:45:17.452009+0000","last_fullsized":"2024-04-25T15:45:17.452009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440758+0000","last_change":"2024-04-25T15:45:17.440758+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440758+0000","last_undegraded":"2024-04-25T15:45:17.440758+0000","last_fullsized":"2024-04-25T15:45:17.440758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.476351+0000","last_change":"2024-04-25T15:45:17.452349+0000","last_active":"2024-04-25T15:45:18.476351+0000","last_peered":"2024-04-25T15:45:18.476351+0000","last_clean":"2024-04-25T15:45:18.476351+0000","last_became_active":"2024-04-25T15:45:17.452038+0000","last_became_peered":"2024-04-25T15:45:17.452038+0000","last_unstale":"2024-04-25T15:45:18.476351+0000","last_undegraded":"2024-04-25T15:45:18.476351+0000","last_fullsized":"2024-04-25T15:45:18.476351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:30.586243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442657+0000","last_change":"2024-04-25T15:45:17.442657+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442657+0000","last_undegraded":"2024-04-25T15:45:17.442657+0000","last_fullsized":"2024-04-25T15:45:17.442657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457374+0000","last_change":"2024-04-25T15:45:17.456603+0000","last_active":"2024-04-25T15:45:17.457374+0000","last_peered":"2024-04-25T15:45:17.457374+0000","last_clean":"2024-04-25T15:45:17.457374+0000","last_became_active":"2024-04-25T15:45:17.456120+0000","last_became_peered":"2024-04-25T15:45:17.456120+0000","last_unstale":"2024-04-25T15:45:17.457374+0000","last_undegraded":"2024-04-25T15:45:17.457374+0000","last_fullsized":"2024-04-25T15:45:17.457374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:27.077156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441982+0000","last_change":"2024-04-25T15:45:17.441982+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441982+0000","last_undegraded":"2024-04-25T15:45:17.441982+0000","last_fullsized":"2024-04-25T15:45:17.441982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456027+0000","last_change":"2024-04-25T15:45:17.454916+0000","last_active":"2024-04-25T15:45:17.456027+0000","last_peered":"2024-04-25T15:45:17.456027+0000","last_clean":"2024-04-25T15:45:17.456027+0000","last_became_active":"2024-04-25T15:45:17.454350+0000","last_became_peered":"2024-04-25T15:45:17.454350+0000","last_unstale":"2024-04-25T15:45:17.456027+0000","last_undegraded":"2024-04-25T15:45:17.456027+0000","last_fullsized":"2024-04-25T15:45:17.456027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455222+0000","last_change":"2024-04-25T15:45:18.448588+0000","last_active":"2024-04-25T15:45:18.455222+0000","last_peered":"2024-04-25T15:45:18.455222+0000","last_clean":"2024-04-25T15:45:18.455222+0000","last_became_active":"2024-04-25T15:45:18.448287+0000","last_became_peered":"2024-04-25T15:45:18.448287+0000","last_unstale":"2024-04-25T15:45:18.455222+0000","last_undegraded":"2024-04-25T15:45:18.455222+0000","last_fullsized":"2024-04-25T15:45:18.455222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:58.998394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452843+0000","last_change":"2024-04-25T15:45:17.450515+0000","last_active":"2024-04-25T15:45:17.452843+0000","last_peered":"2024-04-25T15:45:17.452843+0000","last_clean":"2024-04-25T15:45:17.452843+0000","last_became_active":"2024-04-25T15:45:17.450214+0000","last_became_peered":"2024-04-25T15:45:17.450214+0000","last_unstale":"2024-04-25T15:45:17.452843+0000","last_undegraded":"2024-04-25T15:45:17.452843+0000","last_fullsized":"2024-04-25T15:45:17.452843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:17.535639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470412+0000","last_change":"2024-04-25T15:45:18.465099+0000","last_active":"2024-04-25T15:45:18.470412+0000","last_peered":"2024-04-25T15:45:18.470412+0000","last_clean":"2024-04-25T15:45:18.470412+0000","last_became_active":"2024-04-25T15:45:18.464807+0000","last_became_peered":"2024-04-25T15:45:18.464807+0000","last_unstale":"2024-04-25T15:45:18.470412+0000","last_undegraded":"2024-04-25T15:45:18.470412+0000","last_fullsized":"2024-04-25T15:45:18.470412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:40.746835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457637+0000","last_change":"2024-04-25T15:45:17.453212+0000","last_active":"2024-04-25T15:45:17.457637+0000","last_peered":"2024-04-25T15:45:17.457637+0000","last_clean":"2024-04-25T15:45:17.457637+0000","last_became_active":"2024-04-25T15:45:17.452909+0000","last_became_peered":"2024-04-25T15:45:17.452909+0000","last_unstale":"2024-04-25T15:45:17.457637+0000","last_undegraded":"2024-04-25T15:45:17.457637+0000","last_fullsized":"2024-04-25T15:45:17.457637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436140+0000","last_change":"2024-04-25T15:45:17.436140+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436140+0000","last_undegraded":"2024-04-25T15:45:17.436140+0000","last_fullsized":"2024-04-25T15:45:17.436140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456095+0000","last_change":"2024-04-25T15:45:17.454462+0000","last_active":"2024-04-25T15:45:17.456095+0000","last_peered":"2024-04-25T15:45:17.456095+0000","last_clean":"2024-04-25T15:45:17.456095+0000","last_became_active":"2024-04-25T15:45:17.454123+0000","last_became_peered":"2024-04-25T15:45:17.454123+0000","last_unstale":"2024-04-25T15:45:17.456095+0000","last_undegraded":"2024-04-25T15:45:17.456095+0000","last_fullsized":"2024-04-25T15:45:17.456095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468102+0000","last_change":"2024-04-25T15:45:18.466518+0000","last_active":"2024-04-25T15:45:18.468102+0000","last_peered":"2024-04-25T15:45:18.468102+0000","last_clean":"2024-04-25T15:45:18.468102+0000","last_became_active":"2024-04-25T15:45:18.466170+0000","last_became_peered":"2024-04-25T15:45:18.466170+0000","last_unstale":"2024-04-25T15:45:18.468102+0000","last_undegraded":"2024-04-25T15:45:18.468102+0000","last_fullsized":"2024-04-25T15:45:18.468102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:41.722999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452610+0000","last_change":"2024-04-25T15:45:17.449615+0000","last_active":"2024-04-25T15:45:17.452610+0000","last_peered":"2024-04-25T15:45:17.452610+0000","last_clean":"2024-04-25T15:45:17.452610+0000","last_became_active":"2024-04-25T15:45:17.449164+0000","last_became_peered":"2024-04-25T15:45:17.449164+0000","last_unstale":"2024-04-25T15:45:17.452610+0000","last_undegraded":"2024-04-25T15:45:17.452610+0000","last_fullsized":"2024-04-25T15:45:17.452610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442115+0000","last_change":"2024-04-25T15:45:17.442115+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442115+0000","last_undegraded":"2024-04-25T15:45:17.442115+0000","last_fullsized":"2024-04-25T15:45:17.442115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451982+0000","last_change":"2024-04-25T15:45:17.445560+0000","last_active":"2024-04-25T15:45:17.451982+0000","last_peered":"2024-04-25T15:45:17.451982+0000","last_clean":"2024-04-25T15:45:17.451982+0000","last_became_active":"2024-04-25T15:45:17.445197+0000","last_became_peered":"2024-04-25T15:45:17.445197+0000","last_unstale":"2024-04-25T15:45:17.451982+0000","last_undegraded":"2024-04-25T15:45:17.451982+0000","last_fullsized":"2024-04-25T15:45:17.451982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460732+0000","last_change":"2024-04-25T15:45:18.457807+0000","last_active":"2024-04-25T15:45:18.460732+0000","last_peered":"2024-04-25T15:45:18.460732+0000","last_clean":"2024-04-25T15:45:18.460732+0000","last_became_active":"2024-04-25T15:45:18.457452+0000","last_became_peered":"2024-04-25T15:45:18.457452+0000","last_unstale":"2024-04-25T15:45:18.460732+0000","last_undegraded":"2024-04-25T15:45:18.460732+0000","last_fullsized":"2024-04-25T15:45:18.460732+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:50.384952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444182+0000","last_change":"2024-04-25T15:45:17.452491+0000","last_active":"2024-04-25T15:45:18.444182+0000","last_peered":"2024-04-25T15:45:18.444182+0000","last_clean":"2024-04-25T15:45:18.444182+0000","last_became_active":"2024-04-25T15:45:17.452161+0000","last_became_peered":"2024-04-25T15:45:17.452161+0000","last_unstale":"2024-04-25T15:45:18.444182+0000","last_undegraded":"2024-04-25T15:45:18.444182+0000","last_fullsized":"2024-04-25T15:45:18.444182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.465589+0000","last_change":"2024-04-25T15:45:18.461064+0000","last_active":"2024-04-25T15:45:18.465589+0000","last_peered":"2024-04-25T15:45:18.465589+0000","last_clean":"2024-04-25T15:45:18.465589+0000","last_became_active":"2024-04-25T15:45:18.460573+0000","last_became_peered":"2024-04-25T15:45:18.460573+0000","last_unstale":"2024-04-25T15:45:18.465589+0000","last_undegraded":"2024-04-25T15:45:18.465589+0000","last_fullsized":"2024-04-25T15:45:18.465589+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:13.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471554+0000","last_change":"2024-04-25T15:45:17.455994+0000","last_active":"2024-04-25T15:45:18.471554+0000","last_peered":"2024-04-25T15:45:18.471554+0000","last_clean":"2024-04-25T15:45:18.471554+0000","last_became_active":"2024-04-25T15:45:17.455639+0000","last_became_peered":"2024-04-25T15:45:17.455639+0000","last_unstale":"2024-04-25T15:45:18.471554+0000","last_undegraded":"2024-04-25T15:45:18.471554+0000","last_fullsized":"2024-04-25T15:45:18.471554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:33.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440665+0000","last_change":"2024-04-25T15:45:17.440665+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440665+0000","last_undegraded":"2024-04-25T15:45:17.440665+0000","last_fullsized":"2024-04-25T15:45:17.440665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457294+0000","last_change":"2024-04-25T15:45:17.455522+0000","last_active":"2024-04-25T15:45:17.457294+0000","last_peered":"2024-04-25T15:45:17.457294+0000","last_clean":"2024-04-25T15:45:17.457294+0000","last_became_active":"2024-04-25T15:45:17.455177+0000","last_became_peered":"2024-04-25T15:45:17.455177+0000","last_unstale":"2024-04-25T15:45:17.457294+0000","last_undegraded":"2024-04-25T15:45:17.457294+0000","last_fullsized":"2024-04-25T15:45:17.457294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455252+0000","last_change":"2024-04-25T15:45:18.452851+0000","last_active":"2024-04-25T15:45:18.455252+0000","last_peered":"2024-04-25T15:45:18.455252+0000","last_clean":"2024-04-25T15:45:18.455252+0000","last_became_active":"2024-04-25T15:45:18.452522+0000","last_became_peered":"2024-04-25T15:45:18.452522+0000","last_unstale":"2024-04-25T15:45:18.455252+0000","last_undegraded":"2024-04-25T15:45:18.455252+0000","last_fullsized":"2024-04-25T15:45:18.455252+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:00.624839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444427+0000","last_change":"2024-04-25T15:45:17.451838+0000","last_active":"2024-04-25T15:45:18.444427+0000","last_peered":"2024-04-25T15:45:18.444427+0000","last_clean":"2024-04-25T15:45:18.444427+0000","last_became_active":"2024-04-25T15:45:17.451595+0000","last_became_peered":"2024-04-25T15:45:17.451595+0000","last_unstale":"2024-04-25T15:45:18.444427+0000","last_undegraded":"2024-04-25T15:45:18.444427+0000","last_fullsized":"2024-04-25T15:45:18.444427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:52.673909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473430+0000","last_change":"2024-04-25T15:45:18.469369+0000","last_active":"2024-04-25T15:45:18.473430+0000","last_peered":"2024-04-25T15:45:18.473430+0000","last_clean":"2024-04-25T15:45:18.473430+0000","last_became_active":"2024-04-25T15:45:18.469065+0000","last_became_peered":"2024-04-25T15:45:18.469065+0000","last_unstale":"2024-04-25T15:45:18.473430+0000","last_undegraded":"2024-04-25T15:45:18.473430+0000","last_fullsized":"2024-04-25T15:45:18.473430+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:47.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.454564+0000","last_change":"2024-04-25T15:45:17.452964+0000","last_active":"2024-04-25T15:45:17.454564+0000","last_peered":"2024-04-25T15:45:17.454564+0000","last_clean":"2024-04-25T15:45:17.454564+0000","last_became_active":"2024-04-25T15:45:17.452625+0000","last_became_peered":"2024-04-25T15:45:17.452625+0000","last_unstale":"2024-04-25T15:45:17.454564+0000","last_undegraded":"2024-04-25T15:45:17.454564+0000","last_fullsized":"2024-04-25T15:45:17.454564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:23.629942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470472+0000","last_change":"2024-04-25T15:45:18.464662+0000","last_active":"2024-04-25T15:45:18.470472+0000","last_peered":"2024-04-25T15:45:18.470472+0000","last_clean":"2024-04-25T15:45:18.470472+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.470472+0000","last_undegraded":"2024-04-25T15:45:18.470472+0000","last_fullsized":"2024-04-25T15:45:18.470472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:26.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.449816+0000","last_change":"2024-04-25T15:45:17.447299+0000","last_active":"2024-04-25T15:45:17.449816+0000","last_peered":"2024-04-25T15:45:17.449816+0000","last_clean":"2024-04-25T15:45:17.449816+0000","last_became_active":"2024-04-25T15:45:17.446963+0000","last_became_peered":"2024-04-25T15:45:17.446963+0000","last_unstale":"2024-04-25T15:45:17.449816+0000","last_undegraded":"2024-04-25T15:45:17.449816+0000","last_fullsized":"2024-04-25T15:45:17.449816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:22.500642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441575+0000","last_change":"2024-04-25T15:45:17.441575+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441575+0000","last_undegraded":"2024-04-25T15:45:17.441575+0000","last_fullsized":"2024-04-25T15:45:17.441575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445751+0000","last_change":"2024-04-25T15:45:17.447746+0000","last_active":"2024-04-25T15:45:18.445751+0000","last_peered":"2024-04-25T15:45:18.445751+0000","last_clean":"2024-04-25T15:45:18.445751+0000","last_became_active":"2024-04-25T15:45:17.447403+0000","last_became_peered":"2024-04-25T15:45:17.447403+0000","last_unstale":"2024-04-25T15:45:18.445751+0000","last_undegraded":"2024-04-25T15:45:18.445751+0000","last_fullsized":"2024-04-25T15:45:18.445751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:51.951450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457990+0000","last_change":"2024-04-25T15:45:18.450798+0000","last_active":"2024-04-25T15:45:18.457990+0000","last_peered":"2024-04-25T15:45:18.457990+0000","last_clean":"2024-04-25T15:45:18.457990+0000","last_became_active":"2024-04-25T15:45:18.450505+0000","last_became_peered":"2024-04-25T15:45:18.450505+0000","last_unstale":"2024-04-25T15:45:18.457990+0000","last_undegraded":"2024-04-25T15:45:18.457990+0000","last_fullsized":"2024-04-25T15:45:18.457990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:13.598541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460359+0000","last_change":"2024-04-25T15:45:17.449484+0000","last_active":"2024-04-25T15:45:18.460359+0000","last_peered":"2024-04-25T15:45:18.460359+0000","last_clean":"2024-04-25T15:45:18.460359+0000","last_became_active":"2024-04-25T15:45:17.449246+0000","last_became_peered":"2024-04-25T15:45:17.449246+0000","last_unstale":"2024-04-25T15:45:18.460359+0000","last_undegraded":"2024-04-25T15:45:18.460359+0000","last_fullsized":"2024-04-25T15:45:18.460359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:53.969769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463870+0000","last_change":"2024-04-25T15:45:18.461789+0000","last_active":"2024-04-25T15:45:18.463870+0000","last_peered":"2024-04-25T15:45:18.463870+0000","last_clean":"2024-04-25T15:45:18.463870+0000","last_became_active":"2024-04-25T15:45:18.461037+0000","last_became_peered":"2024-04-25T15:45:18.461037+0000","last_unstale":"2024-04-25T15:45:18.463870+0000","last_undegraded":"2024-04-25T15:45:18.463870+0000","last_fullsized":"2024-04-25T15:45:18.463870+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:29.775814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456766+0000","last_change":"2024-04-25T15:45:17.454679+0000","last_active":"2024-04-25T15:45:17.456766+0000","last_peered":"2024-04-25T15:45:17.456766+0000","last_clean":"2024-04-25T15:45:17.456766+0000","last_became_active":"2024-04-25T15:45:17.454369+0000","last_became_peered":"2024-04-25T15:45:17.454369+0000","last_unstale":"2024-04-25T15:45:17.456766+0000","last_undegraded":"2024-04-25T15:45:17.456766+0000","last_fullsized":"2024-04-25T15:45:17.456766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:34.081224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442596+0000","last_change":"2024-04-25T15:45:17.442596+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442596+0000","last_undegraded":"2024-04-25T15:45:17.442596+0000","last_fullsized":"2024-04-25T15:45:17.442596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.447410+0000","last_change":"2024-04-25T15:45:17.454527+0000","last_active":"2024-04-25T15:45:18.447410+0000","last_peered":"2024-04-25T15:45:18.447410+0000","last_clean":"2024-04-25T15:45:18.447410+0000","last_became_active":"2024-04-25T15:45:17.454188+0000","last_became_peered":"2024-04-25T15:45:17.454188+0000","last_unstale":"2024-04-25T15:45:18.447410+0000","last_undegraded":"2024-04-25T15:45:18.447410+0000","last_fullsized":"2024-04-25T15:45:18.447410+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:46.375607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472254+0000","last_change":"2024-04-25T15:45:18.469752+0000","last_active":"2024-04-25T15:45:18.472254+0000","last_peered":"2024-04-25T15:45:18.472254+0000","last_clean":"2024-04-25T15:45:18.472254+0000","last_became_active":"2024-04-25T15:45:18.469384+0000","last_became_peered":"2024-04-25T15:45:18.469384+0000","last_unstale":"2024-04-25T15:45:18.472254+0000","last_undegraded":"2024-04-25T15:45:18.472254+0000","last_fullsized":"2024-04-25T15:45:18.472254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446507+0000","last_change":"2024-04-25T15:45:17.455624+0000","last_active":"2024-04-25T15:45:18.446507+0000","last_peered":"2024-04-25T15:45:18.446507+0000","last_clean":"2024-04-25T15:45:18.446507+0000","last_became_active":"2024-04-25T15:45:17.455302+0000","last_became_peered":"2024-04-25T15:45:17.455302+0000","last_unstale":"2024-04-25T15:45:18.446507+0000","last_undegraded":"2024-04-25T15:45:18.446507+0000","last_fullsized":"2024-04-25T15:45:18.446507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:08.830467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.452996+0000","last_change":"2024-04-25T15:45:18.448618+0000","last_active":"2024-04-25T15:45:18.452996+0000","last_peered":"2024-04-25T15:45:18.452996+0000","last_clean":"2024-04-25T15:45:18.452996+0000","last_became_active":"2024-04-25T15:45:18.448310+0000","last_became_peered":"2024-04-25T15:45:18.448310+0000","last_unstale":"2024-04-25T15:45:18.452996+0000","last_undegraded":"2024-04-25T15:45:18.452996+0000","last_fullsized":"2024-04-25T15:45:18.452996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:56.668886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.454165+0000","last_change":"2024-04-25T15:45:17.455162+0000","last_active":"2024-04-25T15:45:18.454165+0000","last_peered":"2024-04-25T15:45:18.454165+0000","last_clean":"2024-04-25T15:45:18.454165+0000","last_became_active":"2024-04-25T15:45:17.454854+0000","last_became_peered":"2024-04-25T15:45:17.454854+0000","last_unstale":"2024-04-25T15:45:18.454165+0000","last_undegraded":"2024-04-25T15:45:18.454165+0000","last_fullsized":"2024-04-25T15:45:18.454165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:27.636826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464149+0000","last_change":"2024-04-25T15:45:18.460579+0000","last_active":"2024-04-25T15:45:18.464149+0000","last_peered":"2024-04-25T15:45:18.464149+0000","last_clean":"2024-04-25T15:45:18.464149+0000","last_became_active":"2024-04-25T15:45:18.460230+0000","last_became_peered":"2024-04-25T15:45:18.460230+0000","last_unstale":"2024-04-25T15:45:18.464149+0000","last_undegraded":"2024-04-25T15:45:18.464149+0000","last_fullsized":"2024-04-25T15:45:18.464149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:41.921359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444080+0000","last_change":"2024-04-25T15:45:17.453686+0000","last_active":"2024-04-25T15:45:18.444080+0000","last_peered":"2024-04-25T15:45:18.444080+0000","last_clean":"2024-04-25T15:45:18.444080+0000","last_became_active":"2024-04-25T15:45:17.453361+0000","last_became_peered":"2024-04-25T15:45:17.453361+0000","last_unstale":"2024-04-25T15:45:18.444080+0000","last_undegraded":"2024-04-25T15:45:18.444080+0000","last_fullsized":"2024-04-25T15:45:18.444080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.437098+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:17.437098+0000","last_peered":"2024-04-25T15:45:17.437098+0000","last_clean":"2024-04-25T15:45:17.437098+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:17.437098+0000","last_undegraded":"2024-04-25T15:45:17.437098+0000","last_fullsized":"2024-04-25T15:45:17.437098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":333071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":333037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1339392,"data_stored":923405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":909579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":319211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:21.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:21.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.593+0000 7f3bf158f640 1 Processor -- start 2024-04-25T15:45:21.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.593+0000 7f3bf158f640 1 -- start start 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bf158f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3bec0d41b0 0x7f3bec0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bf158f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bec0b7d60 0x7f3bec0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bf158f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bec163fb0 con 0x7f3bec1602a0 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bf158f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3bec164270 con 0x7f3bec0b7d60 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bf158f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3bec164550 con 0x7f3bec0d41b0 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bea7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3bec1602a0 0x7f3bec0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49486/0 (socket says 172.21.15.80:49486) 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3bea7fc640 1 -- 172.21.15.80:0/3492774562 learned_addr learned my addr 172.21.15.80:0/3492774562 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3beb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bec0b7d60 0x7f3bec0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3beaffd640 1 --2- 172.21.15.80:0/3492774562 >> v2:172.21.15.195:3300/0 conn(0x7f3bec0d41b0 0x7f3bec0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3beb7fe640 1 -- 172.21.15.80:0/3492774562 >> v2:172.21.15.195:3300/0 conn(0x7f3bec0d41b0 msgr2=0x7f3bec0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3beb7fe640 1 --2- 172.21.15.80:0/3492774562 >> v2:172.21.15.195:3300/0 conn(0x7f3bec0d41b0 0x7f3bec0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.594+0000 7f3beb7fe640 1 -- 172.21.15.80:0/3492774562 >> v1:172.21.15.80:6789/0 conn(0x7f3bec1602a0 legacy=0x7f3bec0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.595+0000 7f3beb7fe640 1 -- 172.21.15.80:0/3492774562 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec164830 con 0x7f3bec0b7d60 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.595+0000 7f3beb7fe640 1 --2- 172.21.15.80:0/3492774562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0b7d60 0x7f3bec0d49c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3bec08eaf0 tx=0x7f3be402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb948a3b1bafe9d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.595+0000 7f3be9ffb640 1 -- 172.21.15.80:0/3492774562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4037070 con 0x7f3bec0b7d60 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.595+0000 7f3be9ffb640 1 -- 172.21.15.80:0/3492774562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be402aca0 con 0x7f3bec0b7d60 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.595+0000 7f3be9ffb640 1 -- 172.21.15.80:0/3492774562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4032660 con 0x7f3bec0b7d60 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 -- 172.21.15.80:0/3492774562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0b7d60 msgr2=0x7f3bec0d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 --2- 172.21.15.80:0/3492774562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0b7d60 0x7f3bec0d49c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3bec08eaf0 tx=0x7f3be402a010 comp rx=0 tx=0).stop 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 -- 172.21.15.80:0/3492774562 shutdown_connections 2024-04-25T15:45:21.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 --2- 172.21.15.80:0/3492774562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0b7d60 0x7f3bec0d49c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 --2- 172.21.15.80:0/3492774562 >> v2:172.21.15.195:3300/0 conn(0x7f3bec0d41b0 0x7f3bec0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 -- 172.21.15.80:0/3492774562 >> 172.21.15.80:0/3492774562 conn(0x7f3bec06e9f0 msgr2=0x7f3bec0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:21.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 -- 172.21.15.80:0/3492774562 shutdown_connections 2024-04-25T15:45:21.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.596+0000 7f3bf158f640 1 -- 172.21.15.80:0/3492774562 wait complete. 2024-04-25T15:45:21.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.598+0000 7f3bf158f640 1 Processor -- start 2024-04-25T15:45:21.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.598+0000 7f3bf158f640 1 -- start start 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3bf158f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bec0d41b0 0x7f3bec0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3bf158f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec1602a0 0x7f3bec0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3bf158f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 0x7f3bec15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3bf158f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec0b5150 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3bf158f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec0b4fd0 con 0x7f3bec1602a0 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3bf158f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3bec0b9220 con 0x7f3bec0d41b0 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3beb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 0x7f3bec15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.599+0000 7f3beb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 0x7f3bec15bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60400/0 (socket says 172.21.15.80:60400) 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 -- 172.21.15.80:0/1298865573 learned_addr learned my addr 172.21.15.80:0/1298865573 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:21.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3bea7fc640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec1602a0 0x7f3bec0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beaffd640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bec0d41b0 0x7f3bec0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 -- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bec0d41b0 msgr2=0x7f3bec0cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bec0d41b0 0x7f3bec0cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 -- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec1602a0 msgr2=0x7f3bec0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec1602a0 0x7f3bec0cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 -- 172.21.15.80:0/1298865573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec0d0830 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3beb7fe640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 0x7f3bec15bca0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3be402a050 tx=0x7f3be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4037040 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be402ae50 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4004490 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec0caec0 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.600+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec0cb480 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.601+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec06a100 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.602+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3be402ab60 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.602+0000 7f3bd37fe640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bd80744b0 0x7f3bd80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.602+0000 7f3beaffd640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bd80744b0 0x7f3bd80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.602+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f3be40b5a10 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.603+0000 7f3beaffd640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bd80744b0 0x7f3bd80769c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009e90 tx=0x7f3bdc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.607+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3be4080010 con 0x7f3bec0cd9d0 2024-04-25T15:45:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.780+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bec06a100 con 0x7f3bd80744b0 2024-04-25T15:45:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.786+0000 7f3bd37fe640 1 -- 172.21.15.80:0/1298865573 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249561 (secure 0 0 0) 0x7f3bec06a100 con 0x7f3bd80744b0 2024-04-25T15:45:21.791 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bd80744b0 msgr2=0x7f3bd80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bd80744b0 0x7f3bd80769c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009e90 tx=0x7f3bdc00b040 comp rx=0 tx=0).stop 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 msgr2=0x7f3bec15bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 0x7f3bec15bca0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3be402a050 tx=0x7f3be40046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 shutdown_connections 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bd80744b0 0x7f3bd80769c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bec0cd9d0 0x7f3bec15bca0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec1602a0 0x7f3bec0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 --2- 172.21.15.80:0/1298865573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bec0d41b0 0x7f3bec0cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 >> 172.21.15.80:0/1298865573 conn(0x7f3bec06e9f0 msgr2=0x7f3bec15f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 shutdown_connections 2024-04-25T15:45:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.789+0000 7f3bf158f640 1 -- 172.21.15.80:0/1298865573 wait complete. 2024-04-25T15:45:21.801 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-04-25T15:45:21.026219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":118,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239728,"kb_used_data":6904,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734992,"statfs":{"total":773094113280,"available":772848631808,"internally_reserved":0,"allocated":7069696,"data_stored":3795913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599442"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470858+0000","last_change":"2024-04-25T15:45:18.463164+0000","last_active":"2024-04-25T15:45:18.470858+0000","last_peered":"2024-04-25T15:45:18.470858+0000","last_clean":"2024-04-25T15:45:18.470858+0000","last_became_active":"2024-04-25T15:45:18.462876+0000","last_became_peered":"2024-04-25T15:45:18.462876+0000","last_unstale":"2024-04-25T15:45:18.470858+0000","last_undegraded":"2024-04-25T15:45:18.470858+0000","last_fullsized":"2024-04-25T15:45:18.470858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.619090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473708+0000","last_change":"2024-04-25T15:45:18.471522+0000","last_active":"2024-04-25T15:45:18.473708+0000","last_peered":"2024-04-25T15:45:18.473708+0000","last_clean":"2024-04-25T15:45:18.473708+0000","last_became_active":"2024-04-25T15:45:18.471222+0000","last_became_peered":"2024-04-25T15:45:18.471222+0000","last_unstale":"2024-04-25T15:45:18.473708+0000","last_undegraded":"2024-04-25T15:45:18.473708+0000","last_fullsized":"2024-04-25T15:45:18.473708+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:07.083583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445527+0000","last_change":"2024-04-25T15:45:17.445527+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445527+0000","last_undegraded":"2024-04-25T15:45:17.445527+0000","last_fullsized":"2024-04-25T15:45:17.445527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457899+0000","last_change":"2024-04-25T15:45:18.456533+0000","last_active":"2024-04-25T15:45:18.457899+0000","last_peered":"2024-04-25T15:45:18.457899+0000","last_clean":"2024-04-25T15:45:18.457899+0000","last_became_active":"2024-04-25T15:45:18.456174+0000","last_became_peered":"2024-04-25T15:45:18.456174+0000","last_unstale":"2024-04-25T15:45:18.457899+0000","last_undegraded":"2024-04-25T15:45:18.457899+0000","last_fullsized":"2024-04-25T15:45:18.457899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:50.821828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.462989+0000","last_change":"2024-04-25T15:45:18.458070+0000","last_active":"2024-04-25T15:45:18.462989+0000","last_peered":"2024-04-25T15:45:18.462989+0000","last_clean":"2024-04-25T15:45:18.462989+0000","last_became_active":"2024-04-25T15:45:18.457484+0000","last_became_peered":"2024-04-25T15:45:18.457484+0000","last_unstale":"2024-04-25T15:45:18.462989+0000","last_undegraded":"2024-04-25T15:45:18.462989+0000","last_fullsized":"2024-04-25T15:45:18.462989+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:00.413348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467170+0000","last_change":"2024-04-25T15:45:18.456510+0000","last_active":"2024-04-25T15:45:18.467170+0000","last_peered":"2024-04-25T15:45:18.467170+0000","last_clean":"2024-04-25T15:45:18.467170+0000","last_became_active":"2024-04-25T15:45:18.456074+0000","last_became_peered":"2024-04-25T15:45:18.456074+0000","last_unstale":"2024-04-25T15:45:18.467170+0000","last_undegraded":"2024-04-25T15:45:18.467170+0000","last_fullsized":"2024-04-25T15:45:18.467170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:43.759488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445774+0000","last_change":"2024-04-25T15:45:17.445774+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445774+0000","last_undegraded":"2024-04-25T15:45:17.445774+0000","last_fullsized":"2024-04-25T15:45:17.445774+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436021+0000","last_change":"2024-04-25T15:45:17.436021+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436021+0000","last_undegraded":"2024-04-25T15:45:17.436021+0000","last_fullsized":"2024-04-25T15:45:17.436021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436489+0000","last_change":"2024-04-25T15:45:17.436489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436489+0000","last_undegraded":"2024-04-25T15:45:17.436489+0000","last_fullsized":"2024-04-25T15:45:17.436489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442162+0000","last_change":"2024-04-25T15:45:17.442162+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442162+0000","last_undegraded":"2024-04-25T15:45:17.442162+0000","last_fullsized":"2024-04-25T15:45:17.442162+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443910+0000","last_change":"2024-04-25T15:45:17.443910+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443910+0000","last_undegraded":"2024-04-25T15:45:17.443910+0000","last_fullsized":"2024-04-25T15:45:17.443910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.446326+0000","last_change":"2024-04-25T15:45:17.446326+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.446326+0000","last_undegraded":"2024-04-25T15:45:17.446326+0000","last_fullsized":"2024-04-25T15:45:17.446326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435716+0000","last_change":"2024-04-25T15:45:17.435716+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435716+0000","last_undegraded":"2024-04-25T15:45:17.435716+0000","last_fullsized":"2024-04-25T15:45:17.435716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436552+0000","last_change":"2024-04-25T15:45:17.436552+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436552+0000","last_undegraded":"2024-04-25T15:45:17.436552+0000","last_fullsized":"2024-04-25T15:45:17.436552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463682+0000","last_change":"2024-04-25T15:45:18.455213+0000","last_active":"2024-04-25T15:45:18.463682+0000","last_peered":"2024-04-25T15:45:18.463682+0000","last_clean":"2024-04-25T15:45:18.463682+0000","last_became_active":"2024-04-25T15:45:18.454775+0000","last_became_peered":"2024-04-25T15:45:18.454775+0000","last_unstale":"2024-04-25T15:45:18.463682+0000","last_undegraded":"2024-04-25T15:45:18.463682+0000","last_fullsized":"2024-04-25T15:45:18.463682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:24.128238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473633+0000","last_change":"2024-04-25T15:45:18.470969+0000","last_active":"2024-04-25T15:45:18.473633+0000","last_peered":"2024-04-25T15:45:18.473633+0000","last_clean":"2024-04-25T15:45:18.473633+0000","last_became_active":"2024-04-25T15:45:18.470257+0000","last_became_peered":"2024-04-25T15:45:18.470257+0000","last_unstale":"2024-04-25T15:45:18.473633+0000","last_undegraded":"2024-04-25T15:45:18.473633+0000","last_fullsized":"2024-04-25T15:45:18.473633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:42.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443489+0000","last_change":"2024-04-25T15:45:17.443489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443489+0000","last_undegraded":"2024-04-25T15:45:17.443489+0000","last_fullsized":"2024-04-25T15:45:17.443489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455289+0000","last_change":"2024-04-25T15:45:18.454437+0000","last_active":"2024-04-25T15:45:18.455289+0000","last_peered":"2024-04-25T15:45:18.455289+0000","last_clean":"2024-04-25T15:45:18.455289+0000","last_became_active":"2024-04-25T15:45:18.454136+0000","last_became_peered":"2024-04-25T15:45:18.454136+0000","last_unstale":"2024-04-25T15:45:18.455289+0000","last_undegraded":"2024-04-25T15:45:18.455289+0000","last_fullsized":"2024-04-25T15:45:18.455289+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:29.265268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461927+0000","last_change":"2024-04-25T15:45:18.457308+0000","last_active":"2024-04-25T15:45:18.461927+0000","last_peered":"2024-04-25T15:45:18.461927+0000","last_clean":"2024-04-25T15:45:18.461927+0000","last_became_active":"2024-04-25T15:45:18.456857+0000","last_became_peered":"2024-04-25T15:45:18.456857+0000","last_unstale":"2024-04-25T15:45:18.461927+0000","last_undegraded":"2024-04-25T15:45:18.461927+0000","last_fullsized":"2024-04-25T15:45:18.461927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:53.453597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445841+0000","last_change":"2024-04-25T15:45:17.445841+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445841+0000","last_undegraded":"2024-04-25T15:45:17.445841+0000","last_fullsized":"2024-04-25T15:45:17.445841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470602+0000","last_change":"2024-04-25T15:45:18.467343+0000","last_active":"2024-04-25T15:45:18.470602+0000","last_peered":"2024-04-25T15:45:18.470602+0000","last_clean":"2024-04-25T15:45:18.470602+0000","last_became_active":"2024-04-25T15:45:18.467005+0000","last_became_peered":"2024-04-25T15:45:18.467005+0000","last_unstale":"2024-04-25T15:45:18.470602+0000","last_undegraded":"2024-04-25T15:45:18.470602+0000","last_fullsized":"2024-04-25T15:45:18.470602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:32.165550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468031+0000","last_change":"2024-04-25T15:45:18.466266+0000","last_active":"2024-04-25T15:45:18.468031+0000","last_peered":"2024-04-25T15:45:18.468031+0000","last_clean":"2024-04-25T15:45:18.468031+0000","last_became_active":"2024-04-25T15:45:18.465937+0000","last_became_peered":"2024-04-25T15:45:18.465937+0000","last_unstale":"2024-04-25T15:45:18.468031+0000","last_undegraded":"2024-04-25T15:45:18.468031+0000","last_fullsized":"2024-04-25T15:45:18.468031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:03.990617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435673+0000","last_change":"2024-04-25T15:45:17.435673+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435673+0000","last_undegraded":"2024-04-25T15:45:17.435673+0000","last_fullsized":"2024-04-25T15:45:17.435673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445064+0000","last_change":"2024-04-25T15:45:17.445064+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445064+0000","last_undegraded":"2024-04-25T15:45:17.445064+0000","last_fullsized":"2024-04-25T15:45:17.445064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443182+0000","last_change":"2024-04-25T15:45:17.443182+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443182+0000","last_undegraded":"2024-04-25T15:45:17.443182+0000","last_fullsized":"2024-04-25T15:45:17.443182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441639+0000","last_change":"2024-04-25T15:45:17.441639+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441639+0000","last_undegraded":"2024-04-25T15:45:17.441639+0000","last_fullsized":"2024-04-25T15:45:17.441639+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472508+0000","last_change":"2024-04-25T15:45:18.468839+0000","last_active":"2024-04-25T15:45:18.472508+0000","last_peered":"2024-04-25T15:45:18.472508+0000","last_clean":"2024-04-25T15:45:18.472508+0000","last_became_active":"2024-04-25T15:45:18.467727+0000","last_became_peered":"2024-04-25T15:45:18.467727+0000","last_unstale":"2024-04-25T15:45:18.472508+0000","last_undegraded":"2024-04-25T15:45:18.472508+0000","last_fullsized":"2024-04-25T15:45:18.472508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:23.502579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442604+0000","last_change":"2024-04-25T15:45:17.442604+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442604+0000","last_undegraded":"2024-04-25T15:45:17.442604+0000","last_fullsized":"2024-04-25T15:45:17.442604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443084+0000","last_change":"2024-04-25T15:45:17.443084+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443084+0000","last_undegraded":"2024-04-25T15:45:17.443084+0000","last_fullsized":"2024-04-25T15:45:17.443084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468155+0000","last_change":"2024-04-25T15:45:18.461593+0000","last_active":"2024-04-25T15:45:18.468155+0000","last_peered":"2024-04-25T15:45:18.468155+0000","last_clean":"2024-04-25T15:45:18.468155+0000","last_became_active":"2024-04-25T15:45:18.460991+0000","last_became_peered":"2024-04-25T15:45:18.460991+0000","last_unstale":"2024-04-25T15:45:18.468155+0000","last_undegraded":"2024-04-25T15:45:18.468155+0000","last_fullsized":"2024-04-25T15:45:18.468155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:14.574983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471531+0000","last_change":"2024-04-25T15:45:18.470892+0000","last_active":"2024-04-25T15:45:18.471531+0000","last_peered":"2024-04-25T15:45:18.471531+0000","last_clean":"2024-04-25T15:45:18.471531+0000","last_became_active":"2024-04-25T15:45:18.470554+0000","last_became_peered":"2024-04-25T15:45:18.470554+0000","last_unstale":"2024-04-25T15:45:18.471531+0000","last_undegraded":"2024-04-25T15:45:18.471531+0000","last_fullsized":"2024-04-25T15:45:18.471531+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:11.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470500+0000","last_change":"2024-04-25T15:45:17.450209+0000","last_active":"2024-04-25T15:45:18.470500+0000","last_peered":"2024-04-25T15:45:18.470500+0000","last_clean":"2024-04-25T15:45:18.470500+0000","last_became_active":"2024-04-25T15:45:17.449955+0000","last_became_peered":"2024-04-25T15:45:17.449955+0000","last_unstale":"2024-04-25T15:45:18.470500+0000","last_undegraded":"2024-04-25T15:45:18.470500+0000","last_fullsized":"2024-04-25T15:45:18.470500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:49.999228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441117+0000","last_change":"2024-04-25T15:45:17.441117+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441117+0000","last_undegraded":"2024-04-25T15:45:17.441117+0000","last_fullsized":"2024-04-25T15:45:17.441117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468359+0000","last_change":"2024-04-25T15:45:17.452008+0000","last_active":"2024-04-25T15:45:18.468359+0000","last_peered":"2024-04-25T15:45:18.468359+0000","last_clean":"2024-04-25T15:45:18.468359+0000","last_became_active":"2024-04-25T15:45:17.451635+0000","last_became_peered":"2024-04-25T15:45:17.451635+0000","last_unstale":"2024-04-25T15:45:18.468359+0000","last_undegraded":"2024-04-25T15:45:18.468359+0000","last_fullsized":"2024-04-25T15:45:18.468359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464096+0000","last_change":"2024-04-25T15:45:18.460858+0000","last_active":"2024-04-25T15:45:18.464096+0000","last_peered":"2024-04-25T15:45:18.464096+0000","last_clean":"2024-04-25T15:45:18.464096+0000","last_became_active":"2024-04-25T15:45:18.460430+0000","last_became_peered":"2024-04-25T15:45:18.460430+0000","last_unstale":"2024-04-25T15:45:18.464096+0000","last_undegraded":"2024-04-25T15:45:18.464096+0000","last_fullsized":"2024-04-25T15:45:18.464096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:09.832403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468632+0000","last_change":"2024-04-25T15:45:17.448435+0000","last_active":"2024-04-25T15:45:18.468632+0000","last_peered":"2024-04-25T15:45:18.468632+0000","last_clean":"2024-04-25T15:45:18.468632+0000","last_became_active":"2024-04-25T15:45:17.448082+0000","last_became_peered":"2024-04-25T15:45:17.448082+0000","last_unstale":"2024-04-25T15:45:18.468632+0000","last_undegraded":"2024-04-25T15:45:18.468632+0000","last_fullsized":"2024-04-25T15:45:18.468632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:44.683965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436744+0000","last_change":"2024-04-25T15:45:17.436744+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436744+0000","last_undegraded":"2024-04-25T15:45:17.436744+0000","last_fullsized":"2024-04-25T15:45:17.436744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472823+0000","last_change":"2024-04-25T15:45:17.441391+0000","last_active":"2024-04-25T15:45:18.472823+0000","last_peered":"2024-04-25T15:45:18.472823+0000","last_clean":"2024-04-25T15:45:18.472823+0000","last_became_active":"2024-04-25T15:45:17.441059+0000","last_became_peered":"2024-04-25T15:45:17.441059+0000","last_unstale":"2024-04-25T15:45:18.472823+0000","last_undegraded":"2024-04-25T15:45:18.472823+0000","last_fullsized":"2024-04-25T15:45:18.472823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467444+0000","last_change":"2024-04-25T15:45:18.461108+0000","last_active":"2024-04-25T15:45:18.467444+0000","last_peered":"2024-04-25T15:45:18.467444+0000","last_clean":"2024-04-25T15:45:18.467444+0000","last_became_active":"2024-04-25T15:45:18.460693+0000","last_became_peered":"2024-04-25T15:45:18.460693+0000","last_unstale":"2024-04-25T15:45:18.467444+0000","last_undegraded":"2024-04-25T15:45:18.467444+0000","last_fullsized":"2024-04-25T15:45:18.467444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:27.044492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.469081+0000","last_change":"2024-04-25T15:45:17.453653+0000","last_active":"2024-04-25T15:45:18.469081+0000","last_peered":"2024-04-25T15:45:18.469081+0000","last_clean":"2024-04-25T15:45:18.469081+0000","last_became_active":"2024-04-25T15:45:17.453292+0000","last_became_peered":"2024-04-25T15:45:17.453292+0000","last_unstale":"2024-04-25T15:45:18.469081+0000","last_undegraded":"2024-04-25T15:45:18.469081+0000","last_fullsized":"2024-04-25T15:45:18.469081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:12.590842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472180+0000","last_change":"2024-04-25T15:45:18.469156+0000","last_active":"2024-04-25T15:45:18.472180+0000","last_peered":"2024-04-25T15:45:18.472180+0000","last_clean":"2024-04-25T15:45:18.472180+0000","last_became_active":"2024-04-25T15:45:18.468808+0000","last_became_peered":"2024-04-25T15:45:18.468808+0000","last_unstale":"2024-04-25T15:45:18.472180+0000","last_undegraded":"2024-04-25T15:45:18.472180+0000","last_fullsized":"2024-04-25T15:45:18.472180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:11.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473211+0000","last_change":"2024-04-25T15:45:17.448087+0000","last_active":"2024-04-25T15:45:18.473211+0000","last_peered":"2024-04-25T15:45:18.473211+0000","last_clean":"2024-04-25T15:45:18.473211+0000","last_became_active":"2024-04-25T15:45:17.447741+0000","last_became_peered":"2024-04-25T15:45:17.447741+0000","last_unstale":"2024-04-25T15:45:18.473211+0000","last_undegraded":"2024-04-25T15:45:18.473211+0000","last_fullsized":"2024-04-25T15:45:18.473211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:13.573046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.466578+0000","last_change":"2024-04-25T15:45:18.463919+0000","last_active":"2024-04-25T15:45:18.466578+0000","last_peered":"2024-04-25T15:45:18.466578+0000","last_clean":"2024-04-25T15:45:18.466578+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.466578+0000","last_undegraded":"2024-04-25T15:45:18.466578+0000","last_fullsized":"2024-04-25T15:45:18.466578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.704086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446311+0000","last_change":"2024-04-25T15:45:17.456424+0000","last_active":"2024-04-25T15:45:18.446311+0000","last_peered":"2024-04-25T15:45:18.446311+0000","last_clean":"2024-04-25T15:45:18.446311+0000","last_became_active":"2024-04-25T15:45:17.456094+0000","last_became_peered":"2024-04-25T15:45:17.456094+0000","last_unstale":"2024-04-25T15:45:18.446311+0000","last_undegraded":"2024-04-25T15:45:18.446311+0000","last_fullsized":"2024-04-25T15:45:18.446311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:59.411412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.453962+0000","last_change":"2024-04-25T15:45:18.450549+0000","last_active":"2024-04-25T15:45:18.453962+0000","last_peered":"2024-04-25T15:45:18.453962+0000","last_clean":"2024-04-25T15:45:18.453962+0000","last_became_active":"2024-04-25T15:45:18.450220+0000","last_became_peered":"2024-04-25T15:45:18.450220+0000","last_unstale":"2024-04-25T15:45:18.453962+0000","last_undegraded":"2024-04-25T15:45:18.453962+0000","last_fullsized":"2024-04-25T15:45:18.453962+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445943+0000","last_change":"2024-04-25T15:45:17.453235+0000","last_active":"2024-04-25T15:45:18.445943+0000","last_peered":"2024-04-25T15:45:18.445943+0000","last_clean":"2024-04-25T15:45:18.445943+0000","last_became_active":"2024-04-25T15:45:17.452866+0000","last_became_peered":"2024-04-25T15:45:17.452866+0000","last_unstale":"2024-04-25T15:45:18.445943+0000","last_undegraded":"2024-04-25T15:45:18.445943+0000","last_fullsized":"2024-04-25T15:45:18.445943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472543+0000","last_change":"2024-04-25T15:45:18.469147+0000","last_active":"2024-04-25T15:45:18.472543+0000","last_peered":"2024-04-25T15:45:18.472543+0000","last_clean":"2024-04-25T15:45:18.472543+0000","last_became_active":"2024-04-25T15:45:18.467937+0000","last_became_peered":"2024-04-25T15:45:18.467937+0000","last_unstale":"2024-04-25T15:45:18.472543+0000","last_undegraded":"2024-04-25T15:45:18.472543+0000","last_fullsized":"2024-04-25T15:45:18.472543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:24.631878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452522+0000","last_change":"2024-04-25T15:45:17.447439+0000","last_active":"2024-04-25T15:45:17.452522+0000","last_peered":"2024-04-25T15:45:17.452522+0000","last_clean":"2024-04-25T15:45:17.452522+0000","last_became_active":"2024-04-25T15:45:17.446486+0000","last_became_peered":"2024-04-25T15:45:17.446486+0000","last_unstale":"2024-04-25T15:45:17.452522+0000","last_undegraded":"2024-04-25T15:45:17.452522+0000","last_fullsized":"2024-04-25T15:45:17.452522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461897+0000","last_change":"2024-04-25T15:45:18.456089+0000","last_active":"2024-04-25T15:45:18.461897+0000","last_peered":"2024-04-25T15:45:18.461897+0000","last_clean":"2024-04-25T15:45:18.461897+0000","last_became_active":"2024-04-25T15:45:18.455775+0000","last_became_peered":"2024-04-25T15:45:18.455775+0000","last_unstale":"2024-04-25T15:45:18.461897+0000","last_undegraded":"2024-04-25T15:45:18.461897+0000","last_fullsized":"2024-04-25T15:45:18.461897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451366+0000","last_change":"2024-04-25T15:45:17.447523+0000","last_active":"2024-04-25T15:45:17.451366+0000","last_peered":"2024-04-25T15:45:17.451366+0000","last_clean":"2024-04-25T15:45:17.451366+0000","last_became_active":"2024-04-25T15:45:17.447092+0000","last_became_peered":"2024-04-25T15:45:17.447092+0000","last_unstale":"2024-04-25T15:45:17.451366+0000","last_undegraded":"2024-04-25T15:45:17.451366+0000","last_fullsized":"2024-04-25T15:45:17.451366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:21.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460793+0000","last_change":"2024-04-25T15:45:18.458720+0000","last_active":"2024-04-25T15:45:18.460793+0000","last_peered":"2024-04-25T15:45:18.460793+0000","last_clean":"2024-04-25T15:45:18.460793+0000","last_became_active":"2024-04-25T15:45:18.458419+0000","last_became_peered":"2024-04-25T15:45:18.458419+0000","last_unstale":"2024-04-25T15:45:18.460793+0000","last_undegraded":"2024-04-25T15:45:18.460793+0000","last_fullsized":"2024-04-25T15:45:18.460793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:22.375221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452009+0000","last_change":"2024-04-25T15:45:17.445901+0000","last_active":"2024-04-25T15:45:17.452009+0000","last_peered":"2024-04-25T15:45:17.452009+0000","last_clean":"2024-04-25T15:45:17.452009+0000","last_became_active":"2024-04-25T15:45:17.445519+0000","last_became_peered":"2024-04-25T15:45:17.445519+0000","last_unstale":"2024-04-25T15:45:17.452009+0000","last_undegraded":"2024-04-25T15:45:17.452009+0000","last_fullsized":"2024-04-25T15:45:17.452009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440758+0000","last_change":"2024-04-25T15:45:17.440758+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440758+0000","last_undegraded":"2024-04-25T15:45:17.440758+0000","last_fullsized":"2024-04-25T15:45:17.440758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.476351+0000","last_change":"2024-04-25T15:45:17.452349+0000","last_active":"2024-04-25T15:45:18.476351+0000","last_peered":"2024-04-25T15:45:18.476351+0000","last_clean":"2024-04-25T15:45:18.476351+0000","last_became_active":"2024-04-25T15:45:17.452038+0000","last_became_peered":"2024-04-25T15:45:17.452038+0000","last_unstale":"2024-04-25T15:45:18.476351+0000","last_undegraded":"2024-04-25T15:45:18.476351+0000","last_fullsized":"2024-04-25T15:45:18.476351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:30.586243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442657+0000","last_change":"2024-04-25T15:45:17.442657+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442657+0000","last_undegraded":"2024-04-25T15:45:17.442657+0000","last_fullsized":"2024-04-25T15:45:17.442657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457374+0000","last_change":"2024-04-25T15:45:17.456603+0000","last_active":"2024-04-25T15:45:17.457374+0000","last_peered":"2024-04-25T15:45:17.457374+0000","last_clean":"2024-04-25T15:45:17.457374+0000","last_became_active":"2024-04-25T15:45:17.456120+0000","last_became_peered":"2024-04-25T15:45:17.456120+0000","last_unstale":"2024-04-25T15:45:17.457374+0000","last_undegraded":"2024-04-25T15:45:17.457374+0000","last_fullsized":"2024-04-25T15:45:17.457374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:27.077156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441982+0000","last_change":"2024-04-25T15:45:17.441982+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441982+0000","last_undegraded":"2024-04-25T15:45:17.441982+0000","last_fullsized":"2024-04-25T15:45:17.441982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456027+0000","last_change":"2024-04-25T15:45:17.454916+0000","last_active":"2024-04-25T15:45:17.456027+0000","last_peered":"2024-04-25T15:45:17.456027+0000","last_clean":"2024-04-25T15:45:17.456027+0000","last_became_active":"2024-04-25T15:45:17.454350+0000","last_became_peered":"2024-04-25T15:45:17.454350+0000","last_unstale":"2024-04-25T15:45:17.456027+0000","last_undegraded":"2024-04-25T15:45:17.456027+0000","last_fullsized":"2024-04-25T15:45:17.456027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455222+0000","last_change":"2024-04-25T15:45:18.448588+0000","last_active":"2024-04-25T15:45:18.455222+0000","last_peered":"2024-04-25T15:45:18.455222+0000","last_clean":"2024-04-25T15:45:18.455222+0000","last_became_active":"2024-04-25T15:45:18.448287+0000","last_became_peered":"2024-04-25T15:45:18.448287+0000","last_unstale":"2024-04-25T15:45:18.455222+0000","last_undegraded":"2024-04-25T15:45:18.455222+0000","last_fullsized":"2024-04-25T15:45:18.455222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:58.998394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452843+0000","last_change":"2024-04-25T15:45:17.450515+0000","last_active":"2024-04-25T15:45:17.452843+0000","last_peered":"2024-04-25T15:45:17.452843+0000","last_clean":"2024-04-25T15:45:17.452843+0000","last_became_active":"2024-04-25T15:45:17.450214+0000","last_became_peered":"2024-04-25T15:45:17.450214+0000","last_unstale":"2024-04-25T15:45:17.452843+0000","last_undegraded":"2024-04-25T15:45:17.452843+0000","last_fullsized":"2024-04-25T15:45:17.452843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:17.535639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470412+0000","last_change":"2024-04-25T15:45:18.465099+0000","last_active":"2024-04-25T15:45:18.470412+0000","last_peered":"2024-04-25T15:45:18.470412+0000","last_clean":"2024-04-25T15:45:18.470412+0000","last_became_active":"2024-04-25T15:45:18.464807+0000","last_became_peered":"2024-04-25T15:45:18.464807+0000","last_unstale":"2024-04-25T15:45:18.470412+0000","last_undegraded":"2024-04-25T15:45:18.470412+0000","last_fullsized":"2024-04-25T15:45:18.470412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:40.746835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457637+0000","last_change":"2024-04-25T15:45:17.453212+0000","last_active":"2024-04-25T15:45:17.457637+0000","last_peered":"2024-04-25T15:45:17.457637+0000","last_clean":"2024-04-25T15:45:17.457637+0000","last_became_active":"2024-04-25T15:45:17.452909+0000","last_became_peered":"2024-04-25T15:45:17.452909+0000","last_unstale":"2024-04-25T15:45:17.457637+0000","last_undegraded":"2024-04-25T15:45:17.457637+0000","last_fullsized":"2024-04-25T15:45:17.457637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436140+0000","last_change":"2024-04-25T15:45:17.436140+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436140+0000","last_undegraded":"2024-04-25T15:45:17.436140+0000","last_fullsized":"2024-04-25T15:45:17.436140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456095+0000","last_change":"2024-04-25T15:45:17.454462+0000","last_active":"2024-04-25T15:45:17.456095+0000","last_peered":"2024-04-25T15:45:17.456095+0000","last_clean":"2024-04-25T15:45:17.456095+0000","last_became_active":"2024-04-25T15:45:17.454123+0000","last_became_peered":"2024-04-25T15:45:17.454123+0000","last_unstale":"2024-04-25T15:45:17.456095+0000","last_undegraded":"2024-04-25T15:45:17.456095+0000","last_fullsized":"2024-04-25T15:45:17.456095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468102+0000","last_change":"2024-04-25T15:45:18.466518+0000","last_active":"2024-04-25T15:45:18.468102+0000","last_peered":"2024-04-25T15:45:18.468102+0000","last_clean":"2024-04-25T15:45:18.468102+0000","last_became_active":"2024-04-25T15:45:18.466170+0000","last_became_peered":"2024-04-25T15:45:18.466170+0000","last_unstale":"2024-04-25T15:45:18.468102+0000","last_undegraded":"2024-04-25T15:45:18.468102+0000","last_fullsized":"2024-04-25T15:45:18.468102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:41.722999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452610+0000","last_change":"2024-04-25T15:45:17.449615+0000","last_active":"2024-04-25T15:45:17.452610+0000","last_peered":"2024-04-25T15:45:17.452610+0000","last_clean":"2024-04-25T15:45:17.452610+0000","last_became_active":"2024-04-25T15:45:17.449164+0000","last_became_peered":"2024-04-25T15:45:17.449164+0000","last_unstale":"2024-04-25T15:45:17.452610+0000","last_undegraded":"2024-04-25T15:45:17.452610+0000","last_fullsized":"2024-04-25T15:45:17.452610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442115+0000","last_change":"2024-04-25T15:45:17.442115+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442115+0000","last_undegraded":"2024-04-25T15:45:17.442115+0000","last_fullsized":"2024-04-25T15:45:17.442115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451982+0000","last_change":"2024-04-25T15:45:17.445560+0000","last_active":"2024-04-25T15:45:17.451982+0000","last_peered":"2024-04-25T15:45:17.451982+0000","last_clean":"2024-04-25T15:45:17.451982+0000","last_became_active":"2024-04-25T15:45:17.445197+0000","last_became_peered":"2024-04-25T15:45:17.445197+0000","last_unstale":"2024-04-25T15:45:17.451982+0000","last_undegraded":"2024-04-25T15:45:17.451982+0000","last_fullsized":"2024-04-25T15:45:17.451982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460732+0000","last_change":"2024-04-25T15:45:18.457807+0000","last_active":"2024-04-25T15:45:18.460732+0000","last_peered":"2024-04-25T15:45:18.460732+0000","last_clean":"2024-04-25T15:45:18.460732+0000","last_became_active":"2024-04-25T15:45:18.457452+0000","last_became_peered":"2024-04-25T15:45:18.457452+0000","last_unstale":"2024-04-25T15:45:18.460732+0000","last_undegraded":"2024-04-25T15:45:18.460732+0000","last_fullsized":"2024-04-25T15:45:18.460732+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:50.384952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444182+0000","last_change":"2024-04-25T15:45:17.452491+0000","last_active":"2024-04-25T15:45:18.444182+0000","last_peered":"2024-04-25T15:45:18.444182+0000","last_clean":"2024-04-25T15:45:18.444182+0000","last_became_active":"2024-04-25T15:45:17.452161+0000","last_became_peered":"2024-04-25T15:45:17.452161+0000","last_unstale":"2024-04-25T15:45:18.444182+0000","last_undegraded":"2024-04-25T15:45:18.444182+0000","last_fullsized":"2024-04-25T15:45:18.444182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.465589+0000","last_change":"2024-04-25T15:45:18.461064+0000","last_active":"2024-04-25T15:45:18.465589+0000","last_peered":"2024-04-25T15:45:18.465589+0000","last_clean":"2024-04-25T15:45:18.465589+0000","last_became_active":"2024-04-25T15:45:18.460573+0000","last_became_peered":"2024-04-25T15:45:18.460573+0000","last_unstale":"2024-04-25T15:45:18.465589+0000","last_undegraded":"2024-04-25T15:45:18.465589+0000","last_fullsized":"2024-04-25T15:45:18.465589+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:13.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471554+0000","last_change":"2024-04-25T15:45:17.455994+0000","last_active":"2024-04-25T15:45:18.471554+0000","last_peered":"2024-04-25T15:45:18.471554+0000","last_clean":"2024-04-25T15:45:18.471554+0000","last_became_active":"2024-04-25T15:45:17.455639+0000","last_became_peered":"2024-04-25T15:45:17.455639+0000","last_unstale":"2024-04-25T15:45:18.471554+0000","last_undegraded":"2024-04-25T15:45:18.471554+0000","last_fullsized":"2024-04-25T15:45:18.471554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:33.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440665+0000","last_change":"2024-04-25T15:45:17.440665+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440665+0000","last_undegraded":"2024-04-25T15:45:17.440665+0000","last_fullsized":"2024-04-25T15:45:17.440665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457294+0000","last_change":"2024-04-25T15:45:17.455522+0000","last_active":"2024-04-25T15:45:17.457294+0000","last_peered":"2024-04-25T15:45:17.457294+0000","last_clean":"2024-04-25T15:45:17.457294+0000","last_became_active":"2024-04-25T15:45:17.455177+0000","last_became_peered":"2024-04-25T15:45:17.455177+0000","last_unstale":"2024-04-25T15:45:17.457294+0000","last_undegraded":"2024-04-25T15:45:17.457294+0000","last_fullsized":"2024-04-25T15:45:17.457294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455252+0000","last_change":"2024-04-25T15:45:18.452851+0000","last_active":"2024-04-25T15:45:18.455252+0000","last_peered":"2024-04-25T15:45:18.455252+0000","last_clean":"2024-04-25T15:45:18.455252+0000","last_became_active":"2024-04-25T15:45:18.452522+0000","last_became_peered":"2024-04-25T15:45:18.452522+0000","last_unstale":"2024-04-25T15:45:18.455252+0000","last_undegraded":"2024-04-25T15:45:18.455252+0000","last_fullsized":"2024-04-25T15:45:18.455252+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:00.624839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444427+0000","last_change":"2024-04-25T15:45:17.451838+0000","last_active":"2024-04-25T15:45:18.444427+0000","last_peered":"2024-04-25T15:45:18.444427+0000","last_clean":"2024-04-25T15:45:18.444427+0000","last_became_active":"2024-04-25T15:45:17.451595+0000","last_became_peered":"2024-04-25T15:45:17.451595+0000","last_unstale":"2024-04-25T15:45:18.444427+0000","last_undegraded":"2024-04-25T15:45:18.444427+0000","last_fullsized":"2024-04-25T15:45:18.444427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:52.673909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473430+0000","last_change":"2024-04-25T15:45:18.469369+0000","last_active":"2024-04-25T15:45:18.473430+0000","last_peered":"2024-04-25T15:45:18.473430+0000","last_clean":"2024-04-25T15:45:18.473430+0000","last_became_active":"2024-04-25T15:45:18.469065+0000","last_became_peered":"2024-04-25T15:45:18.469065+0000","last_unstale":"2024-04-25T15:45:18.473430+0000","last_undegraded":"2024-04-25T15:45:18.473430+0000","last_fullsized":"2024-04-25T15:45:18.473430+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:47.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.454564+0000","last_change":"2024-04-25T15:45:17.452964+0000","last_active":"2024-04-25T15:45:17.454564+0000","last_peered":"2024-04-25T15:45:17.454564+0000","last_clean":"2024-04-25T15:45:17.454564+0000","last_became_active":"2024-04-25T15:45:17.452625+0000","last_became_peered":"2024-04-25T15:45:17.452625+0000","last_unstale":"2024-04-25T15:45:17.454564+0000","last_undegraded":"2024-04-25T15:45:17.454564+0000","last_fullsized":"2024-04-25T15:45:17.454564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:23.629942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470472+0000","last_change":"2024-04-25T15:45:18.464662+0000","last_active":"2024-04-25T15:45:18.470472+0000","last_peered":"2024-04-25T15:45:18.470472+0000","last_clean":"2024-04-25T15:45:18.470472+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.470472+0000","last_undegraded":"2024-04-25T15:45:18.470472+0000","last_fullsized":"2024-04-25T15:45:18.470472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:26.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.449816+0000","last_change":"2024-04-25T15:45:17.447299+0000","last_active":"2024-04-25T15:45:17.449816+0000","last_peered":"2024-04-25T15:45:17.449816+0000","last_clean":"2024-04-25T15:45:17.449816+0000","last_became_active":"2024-04-25T15:45:17.446963+0000","last_became_peered":"2024-04-25T15:45:17.446963+0000","last_unstale":"2024-04-25T15:45:17.449816+0000","last_undegraded":"2024-04-25T15:45:17.449816+0000","last_fullsized":"2024-04-25T15:45:17.449816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:22.500642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441575+0000","last_change":"2024-04-25T15:45:17.441575+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441575+0000","last_undegraded":"2024-04-25T15:45:17.441575+0000","last_fullsized":"2024-04-25T15:45:17.441575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445751+0000","last_change":"2024-04-25T15:45:17.447746+0000","last_active":"2024-04-25T15:45:18.445751+0000","last_peered":"2024-04-25T15:45:18.445751+0000","last_clean":"2024-04-25T15:45:18.445751+0000","last_became_active":"2024-04-25T15:45:17.447403+0000","last_became_peered":"2024-04-25T15:45:17.447403+0000","last_unstale":"2024-04-25T15:45:18.445751+0000","last_undegraded":"2024-04-25T15:45:18.445751+0000","last_fullsized":"2024-04-25T15:45:18.445751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:51.951450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457990+0000","last_change":"2024-04-25T15:45:18.450798+0000","last_active":"2024-04-25T15:45:18.457990+0000","last_peered":"2024-04-25T15:45:18.457990+0000","last_clean":"2024-04-25T15:45:18.457990+0000","last_became_active":"2024-04-25T15:45:18.450505+0000","last_became_peered":"2024-04-25T15:45:18.450505+0000","last_unstale":"2024-04-25T15:45:18.457990+0000","last_undegraded":"2024-04-25T15:45:18.457990+0000","last_fullsized":"2024-04-25T15:45:18.457990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:13.598541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460359+0000","last_change":"2024-04-25T15:45:17.449484+0000","last_active":"2024-04-25T15:45:18.460359+0000","last_peered":"2024-04-25T15:45:18.460359+0000","last_clean":"2024-04-25T15:45:18.460359+0000","last_became_active":"2024-04-25T15:45:17.449246+0000","last_became_peered":"2024-04-25T15:45:17.449246+0000","last_unstale":"2024-04-25T15:45:18.460359+0000","last_undegraded":"2024-04-25T15:45:18.460359+0000","last_fullsized":"2024-04-25T15:45:18.460359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:53.969769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463870+0000","last_change":"2024-04-25T15:45:18.461789+0000","last_active":"2024-04-25T15:45:18.463870+0000","last_peered":"2024-04-25T15:45:18.463870+0000","last_clean":"2024-04-25T15:45:18.463870+0000","last_became_active":"2024-04-25T15:45:18.461037+0000","last_became_peered":"2024-04-25T15:45:18.461037+0000","last_unstale":"2024-04-25T15:45:18.463870+0000","last_undegraded":"2024-04-25T15:45:18.463870+0000","last_fullsized":"2024-04-25T15:45:18.463870+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:29.775814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456766+0000","last_change":"2024-04-25T15:45:17.454679+0000","last_active":"2024-04-25T15:45:17.456766+0000","last_peered":"2024-04-25T15:45:17.456766+0000","last_clean":"2024-04-25T15:45:17.456766+0000","last_became_active":"2024-04-25T15:45:17.454369+0000","last_became_peered":"2024-04-25T15:45:17.454369+0000","last_unstale":"2024-04-25T15:45:17.456766+0000","last_undegraded":"2024-04-25T15:45:17.456766+0000","last_fullsized":"2024-04-25T15:45:17.456766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:34.081224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442596+0000","last_change":"2024-04-25T15:45:17.442596+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442596+0000","last_undegraded":"2024-04-25T15:45:17.442596+0000","last_fullsized":"2024-04-25T15:45:17.442596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.447410+0000","last_change":"2024-04-25T15:45:17.454527+0000","last_active":"2024-04-25T15:45:18.447410+0000","last_peered":"2024-04-25T15:45:18.447410+0000","last_clean":"2024-04-25T15:45:18.447410+0000","last_became_active":"2024-04-25T15:45:17.454188+0000","last_became_peered":"2024-04-25T15:45:17.454188+0000","last_unstale":"2024-04-25T15:45:18.447410+0000","last_undegraded":"2024-04-25T15:45:18.447410+0000","last_fullsized":"2024-04-25T15:45:18.447410+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:46.375607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472254+0000","last_change":"2024-04-25T15:45:18.469752+0000","last_active":"2024-04-25T15:45:18.472254+0000","last_peered":"2024-04-25T15:45:18.472254+0000","last_clean":"2024-04-25T15:45:18.472254+0000","last_became_active":"2024-04-25T15:45:18.469384+0000","last_became_peered":"2024-04-25T15:45:18.469384+0000","last_unstale":"2024-04-25T15:45:18.472254+0000","last_undegraded":"2024-04-25T15:45:18.472254+0000","last_fullsized":"2024-04-25T15:45:18.472254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446507+0000","last_change":"2024-04-25T15:45:17.455624+0000","last_active":"2024-04-25T15:45:18.446507+0000","last_peered":"2024-04-25T15:45:18.446507+0000","last_clean":"2024-04-25T15:45:18.446507+0000","last_became_active":"2024-04-25T15:45:17.455302+0000","last_became_peered":"2024-04-25T15:45:17.455302+0000","last_unstale":"2024-04-25T15:45:18.446507+0000","last_undegraded":"2024-04-25T15:45:18.446507+0000","last_fullsized":"2024-04-25T15:45:18.446507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:08.830467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.452996+0000","last_change":"2024-04-25T15:45:18.448618+0000","last_active":"2024-04-25T15:45:18.452996+0000","last_peered":"2024-04-25T15:45:18.452996+0000","last_clean":"2024-04-25T15:45:18.452996+0000","last_became_active":"2024-04-25T15:45:18.448310+0000","last_became_peered":"2024-04-25T15:45:18.448310+0000","last_unstale":"2024-04-25T15:45:18.452996+0000","last_undegraded":"2024-04-25T15:45:18.452996+0000","last_fullsized":"2024-04-25T15:45:18.452996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:56.668886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.454165+0000","last_change":"2024-04-25T15:45:17.455162+0000","last_active":"2024-04-25T15:45:18.454165+0000","last_peered":"2024-04-25T15:45:18.454165+0000","last_clean":"2024-04-25T15:45:18.454165+0000","last_became_active":"2024-04-25T15:45:17.454854+0000","last_became_peered":"2024-04-25T15:45:17.454854+0000","last_unstale":"2024-04-25T15:45:18.454165+0000","last_undegraded":"2024-04-25T15:45:18.454165+0000","last_fullsized":"2024-04-25T15:45:18.454165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:27.636826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464149+0000","last_change":"2024-04-25T15:45:18.460579+0000","last_active":"2024-04-25T15:45:18.464149+0000","last_peered":"2024-04-25T15:45:18.464149+0000","last_clean":"2024-04-25T15:45:18.464149+0000","last_became_active":"2024-04-25T15:45:18.460230+0000","last_became_peered":"2024-04-25T15:45:18.460230+0000","last_unstale":"2024-04-25T15:45:18.464149+0000","last_undegraded":"2024-04-25T15:45:18.464149+0000","last_fullsized":"2024-04-25T15:45:18.464149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:41.921359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444080+0000","last_change":"2024-04-25T15:45:17.453686+0000","last_active":"2024-04-25T15:45:18.444080+0000","last_peered":"2024-04-25T15:45:18.444080+0000","last_clean":"2024-04-25T15:45:18.444080+0000","last_became_active":"2024-04-25T15:45:17.453361+0000","last_became_peered":"2024-04-25T15:45:17.453361+0000","last_unstale":"2024-04-25T15:45:18.444080+0000","last_undegraded":"2024-04-25T15:45:18.444080+0000","last_fullsized":"2024-04-25T15:45:18.444080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.437098+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:17.437098+0000","last_peered":"2024-04-25T15:45:17.437098+0000","last_clean":"2024-04-25T15:45:17.437098+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:17.437098+0000","last_undegraded":"2024-04-25T15:45:17.437098+0000","last_fullsized":"2024-04-25T15:45:17.437098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":333071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":333037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1339392,"data_stored":923405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":909579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":319211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:21.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:21.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.948+0000 7fe669d64640 1 Processor -- start 2024-04-25T15:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.948+0000 7fe669d64640 1 -- start start 2024-04-25T15:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe669d64640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe66406dce0 0x7fe6640af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe669d64640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6640afc60 0x7fe66415b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe669d64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6640ae960 con 0x7fe6640d1090 2024-04-25T15:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe669d64640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe664070470 con 0x7fe6640afc60 2024-04-25T15:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe669d64640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe6640aec40 con 0x7fe66406dce0 2024-04-25T15:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6640afc60 0x7fe66415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6640afc60 0x7fe66415b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60408/0 (socket says 172.21.15.80:60408) 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 -- 172.21.15.80:0/658370639 learned_addr learned my addr 172.21.15.80:0/658370639 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe662ffd640 1 --2- 172.21.15.80:0/658370639 >> v2:172.21.15.195:3300/0 conn(0x7fe66406dce0 0x7fe6640af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 -- 172.21.15.80:0/658370639 >> v2:172.21.15.195:3300/0 conn(0x7fe66406dce0 msgr2=0x7fe6640af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 --2- 172.21.15.80:0/658370639 >> v2:172.21.15.195:3300/0 conn(0x7fe66406dce0 0x7fe6640af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 -- 172.21.15.80:0/658370639 >> v1:172.21.15.195:6789/0 conn(0x7fe6640d1090 legacy=0x7fe66406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.950+0000 7fe663fff640 1 -- 172.21.15.80:0/658370639 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6640aef20 con 0x7fe6640afc60 2024-04-25T15:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.951+0000 7fe663fff640 1 --2- 172.21.15.80:0/658370639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe66415b020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009e50 tx=0x7fe65c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3ca0219b7b61e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.951+0000 7fe6627fc640 1 -- 172.21.15.80:0/658370639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c036070 con 0x7fe6640afc60 2024-04-25T15:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.951+0000 7fe6627fc640 1 -- 172.21.15.80:0/658370639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c031600 con 0x7fe6640afc60 2024-04-25T15:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.951+0000 7fe6627fc640 1 -- 172.21.15.80:0/658370639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0319d0 con 0x7fe6640afc60 2024-04-25T15:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 -- 172.21.15.80:0/658370639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 msgr2=0x7fe66415b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 --2- 172.21.15.80:0/658370639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe66415b020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009e50 tx=0x7fe65c02a6d0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 -- 172.21.15.80:0/658370639 shutdown_connections 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 --2- 172.21.15.80:0/658370639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe66415b020 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 --2- 172.21.15.80:0/658370639 >> v2:172.21.15.195:3300/0 conn(0x7fe66406dce0 0x7fe6640af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 -- 172.21.15.80:0/658370639 >> 172.21.15.80:0/658370639 conn(0x7fe6640d1e20 msgr2=0x7fe664073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 -- 172.21.15.80:0/658370639 shutdown_connections 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.952+0000 7fe669d64640 1 -- 172.21.15.80:0/658370639 wait complete. 2024-04-25T15:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.953+0000 7fe669d64640 1 Processor -- start 2024-04-25T15:45:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.954+0000 7fe669d64640 1 -- start start 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe669d64640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe664142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe669d64640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6640d1090 0x7fe66409ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe669d64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe66409efc0 0x7fe66414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe669d64640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640b01f0 con 0x7fe6640afc60 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe669d64640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640b0070 con 0x7fe6640d1090 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe669d64640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe6640d14a0 con 0x7fe66409efc0 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe664142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe664142820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60420/0 (socket says 172.21.15.80:60420) 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 -- 172.21.15.80:0/487200474 learned_addr learned my addr 172.21.15.80:0/487200474 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe662ffd640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6640d1090 0x7fe66409ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 -- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe66409efc0 msgr2=0x7fe66414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe663fff640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe66409efc0 0x7fe66414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe66409efc0 0x7fe66414f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 -- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6640d1090 msgr2=0x7fe66409ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6640d1090 0x7fe66409ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 -- 172.21.15.80:0/487200474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe664143070 con 0x7fe6640afc60 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe662ffd640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6640d1090 0x7fe66409ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.955+0000 7fe6637fe640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe664142820 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe65400c470 tx=0x7fe65400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.956+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540052d0 con 0x7fe6640afc60 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.956+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe654005490 con 0x7fe6640afc60 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.956+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe664143350 con 0x7fe6640afc60 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.956+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654007260 con 0x7fe6640afc60 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.956+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe664143910 con 0x7fe6640afc60 2024-04-25T15:45:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.957+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66406a100 con 0x7fe6640afc60 2024-04-25T15:45:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.958+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe654007400 con 0x7fe6640afc60 2024-04-25T15:45:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.958+0000 7fe64bfff640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6500744b0 0x7fe6500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.958+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fe654094840 con 0x7fe6640afc60 2024-04-25T15:45:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.958+0000 7fe662ffd640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6500744b0 0x7fe6500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.958+0000 7fe662ffd640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6500744b0 0x7fe6500769c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe664141450 tx=0x7fe658008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:21.963+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe65405ee40 con 0x7fe6640afc60 2024-04-25T15:45:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.134+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6640b2e50 con 0x7fe6500744b0 2024-04-25T15:45:22.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.140+0000 7fe64bfff640 1 -- 172.21.15.80:0/487200474 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249561 (secure 0 0 0) 0x7fe6640b2e50 con 0x7fe6500744b0 2024-04-25T15:45:22.143 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:22.145 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6500744b0 msgr2=0x7fe6500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6500744b0 0x7fe6500769c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe664141450 tx=0x7fe658008040 comp rx=0 tx=0).stop 2024-04-25T15:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 msgr2=0x7fe664142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe664142820 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe65400c470 tx=0x7fe65400c930 comp rx=0 tx=0).stop 2024-04-25T15:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 shutdown_connections 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6500744b0 0x7fe6500769c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe66409efc0 0x7fe66414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6640d1090 0x7fe66409ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 --2- 172.21.15.80:0/487200474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6640afc60 0x7fe664142820 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.142+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 >> 172.21.15.80:0/487200474 conn(0x7fe6640d1e20 msgr2=0x7fe6640cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.143+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 shutdown_connections 2024-04-25T15:45:22.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.143+0000 7fe669d64640 1 -- 172.21.15.80:0/487200474 wait complete. 2024-04-25T15:45:22.155 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-04-25T15:45:21.026219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":118,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239728,"kb_used_data":6904,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734992,"statfs":{"total":773094113280,"available":772848631808,"internally_reserved":0,"allocated":7069696,"data_stored":3795913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599442"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470858+0000","last_change":"2024-04-25T15:45:18.463164+0000","last_active":"2024-04-25T15:45:18.470858+0000","last_peered":"2024-04-25T15:45:18.470858+0000","last_clean":"2024-04-25T15:45:18.470858+0000","last_became_active":"2024-04-25T15:45:18.462876+0000","last_became_peered":"2024-04-25T15:45:18.462876+0000","last_unstale":"2024-04-25T15:45:18.470858+0000","last_undegraded":"2024-04-25T15:45:18.470858+0000","last_fullsized":"2024-04-25T15:45:18.470858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.619090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473708+0000","last_change":"2024-04-25T15:45:18.471522+0000","last_active":"2024-04-25T15:45:18.473708+0000","last_peered":"2024-04-25T15:45:18.473708+0000","last_clean":"2024-04-25T15:45:18.473708+0000","last_became_active":"2024-04-25T15:45:18.471222+0000","last_became_peered":"2024-04-25T15:45:18.471222+0000","last_unstale":"2024-04-25T15:45:18.473708+0000","last_undegraded":"2024-04-25T15:45:18.473708+0000","last_fullsized":"2024-04-25T15:45:18.473708+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:07.083583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445527+0000","last_change":"2024-04-25T15:45:17.445527+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445527+0000","last_undegraded":"2024-04-25T15:45:17.445527+0000","last_fullsized":"2024-04-25T15:45:17.445527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457899+0000","last_change":"2024-04-25T15:45:18.456533+0000","last_active":"2024-04-25T15:45:18.457899+0000","last_peered":"2024-04-25T15:45:18.457899+0000","last_clean":"2024-04-25T15:45:18.457899+0000","last_became_active":"2024-04-25T15:45:18.456174+0000","last_became_peered":"2024-04-25T15:45:18.456174+0000","last_unstale":"2024-04-25T15:45:18.457899+0000","last_undegraded":"2024-04-25T15:45:18.457899+0000","last_fullsized":"2024-04-25T15:45:18.457899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:50.821828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.462989+0000","last_change":"2024-04-25T15:45:18.458070+0000","last_active":"2024-04-25T15:45:18.462989+0000","last_peered":"2024-04-25T15:45:18.462989+0000","last_clean":"2024-04-25T15:45:18.462989+0000","last_became_active":"2024-04-25T15:45:18.457484+0000","last_became_peered":"2024-04-25T15:45:18.457484+0000","last_unstale":"2024-04-25T15:45:18.462989+0000","last_undegraded":"2024-04-25T15:45:18.462989+0000","last_fullsized":"2024-04-25T15:45:18.462989+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:00.413348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467170+0000","last_change":"2024-04-25T15:45:18.456510+0000","last_active":"2024-04-25T15:45:18.467170+0000","last_peered":"2024-04-25T15:45:18.467170+0000","last_clean":"2024-04-25T15:45:18.467170+0000","last_became_active":"2024-04-25T15:45:18.456074+0000","last_became_peered":"2024-04-25T15:45:18.456074+0000","last_unstale":"2024-04-25T15:45:18.467170+0000","last_undegraded":"2024-04-25T15:45:18.467170+0000","last_fullsized":"2024-04-25T15:45:18.467170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:43.759488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445774+0000","last_change":"2024-04-25T15:45:17.445774+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445774+0000","last_undegraded":"2024-04-25T15:45:17.445774+0000","last_fullsized":"2024-04-25T15:45:17.445774+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436021+0000","last_change":"2024-04-25T15:45:17.436021+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436021+0000","last_undegraded":"2024-04-25T15:45:17.436021+0000","last_fullsized":"2024-04-25T15:45:17.436021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436489+0000","last_change":"2024-04-25T15:45:17.436489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436489+0000","last_undegraded":"2024-04-25T15:45:17.436489+0000","last_fullsized":"2024-04-25T15:45:17.436489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442162+0000","last_change":"2024-04-25T15:45:17.442162+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442162+0000","last_undegraded":"2024-04-25T15:45:17.442162+0000","last_fullsized":"2024-04-25T15:45:17.442162+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443910+0000","last_change":"2024-04-25T15:45:17.443910+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443910+0000","last_undegraded":"2024-04-25T15:45:17.443910+0000","last_fullsized":"2024-04-25T15:45:17.443910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.446326+0000","last_change":"2024-04-25T15:45:17.446326+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.446326+0000","last_undegraded":"2024-04-25T15:45:17.446326+0000","last_fullsized":"2024-04-25T15:45:17.446326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435716+0000","last_change":"2024-04-25T15:45:17.435716+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435716+0000","last_undegraded":"2024-04-25T15:45:17.435716+0000","last_fullsized":"2024-04-25T15:45:17.435716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436552+0000","last_change":"2024-04-25T15:45:17.436552+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436552+0000","last_undegraded":"2024-04-25T15:45:17.436552+0000","last_fullsized":"2024-04-25T15:45:17.436552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463682+0000","last_change":"2024-04-25T15:45:18.455213+0000","last_active":"2024-04-25T15:45:18.463682+0000","last_peered":"2024-04-25T15:45:18.463682+0000","last_clean":"2024-04-25T15:45:18.463682+0000","last_became_active":"2024-04-25T15:45:18.454775+0000","last_became_peered":"2024-04-25T15:45:18.454775+0000","last_unstale":"2024-04-25T15:45:18.463682+0000","last_undegraded":"2024-04-25T15:45:18.463682+0000","last_fullsized":"2024-04-25T15:45:18.463682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:24.128238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473633+0000","last_change":"2024-04-25T15:45:18.470969+0000","last_active":"2024-04-25T15:45:18.473633+0000","last_peered":"2024-04-25T15:45:18.473633+0000","last_clean":"2024-04-25T15:45:18.473633+0000","last_became_active":"2024-04-25T15:45:18.470257+0000","last_became_peered":"2024-04-25T15:45:18.470257+0000","last_unstale":"2024-04-25T15:45:18.473633+0000","last_undegraded":"2024-04-25T15:45:18.473633+0000","last_fullsized":"2024-04-25T15:45:18.473633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:42.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443489+0000","last_change":"2024-04-25T15:45:17.443489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443489+0000","last_undegraded":"2024-04-25T15:45:17.443489+0000","last_fullsized":"2024-04-25T15:45:17.443489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455289+0000","last_change":"2024-04-25T15:45:18.454437+0000","last_active":"2024-04-25T15:45:18.455289+0000","last_peered":"2024-04-25T15:45:18.455289+0000","last_clean":"2024-04-25T15:45:18.455289+0000","last_became_active":"2024-04-25T15:45:18.454136+0000","last_became_peered":"2024-04-25T15:45:18.454136+0000","last_unstale":"2024-04-25T15:45:18.455289+0000","last_undegraded":"2024-04-25T15:45:18.455289+0000","last_fullsized":"2024-04-25T15:45:18.455289+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:29.265268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461927+0000","last_change":"2024-04-25T15:45:18.457308+0000","last_active":"2024-04-25T15:45:18.461927+0000","last_peered":"2024-04-25T15:45:18.461927+0000","last_clean":"2024-04-25T15:45:18.461927+0000","last_became_active":"2024-04-25T15:45:18.456857+0000","last_became_peered":"2024-04-25T15:45:18.456857+0000","last_unstale":"2024-04-25T15:45:18.461927+0000","last_undegraded":"2024-04-25T15:45:18.461927+0000","last_fullsized":"2024-04-25T15:45:18.461927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:53.453597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445841+0000","last_change":"2024-04-25T15:45:17.445841+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445841+0000","last_undegraded":"2024-04-25T15:45:17.445841+0000","last_fullsized":"2024-04-25T15:45:17.445841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470602+0000","last_change":"2024-04-25T15:45:18.467343+0000","last_active":"2024-04-25T15:45:18.470602+0000","last_peered":"2024-04-25T15:45:18.470602+0000","last_clean":"2024-04-25T15:45:18.470602+0000","last_became_active":"2024-04-25T15:45:18.467005+0000","last_became_peered":"2024-04-25T15:45:18.467005+0000","last_unstale":"2024-04-25T15:45:18.470602+0000","last_undegraded":"2024-04-25T15:45:18.470602+0000","last_fullsized":"2024-04-25T15:45:18.470602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:32.165550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468031+0000","last_change":"2024-04-25T15:45:18.466266+0000","last_active":"2024-04-25T15:45:18.468031+0000","last_peered":"2024-04-25T15:45:18.468031+0000","last_clean":"2024-04-25T15:45:18.468031+0000","last_became_active":"2024-04-25T15:45:18.465937+0000","last_became_peered":"2024-04-25T15:45:18.465937+0000","last_unstale":"2024-04-25T15:45:18.468031+0000","last_undegraded":"2024-04-25T15:45:18.468031+0000","last_fullsized":"2024-04-25T15:45:18.468031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:03.990617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435673+0000","last_change":"2024-04-25T15:45:17.435673+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435673+0000","last_undegraded":"2024-04-25T15:45:17.435673+0000","last_fullsized":"2024-04-25T15:45:17.435673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445064+0000","last_change":"2024-04-25T15:45:17.445064+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445064+0000","last_undegraded":"2024-04-25T15:45:17.445064+0000","last_fullsized":"2024-04-25T15:45:17.445064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443182+0000","last_change":"2024-04-25T15:45:17.443182+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443182+0000","last_undegraded":"2024-04-25T15:45:17.443182+0000","last_fullsized":"2024-04-25T15:45:17.443182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441639+0000","last_change":"2024-04-25T15:45:17.441639+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441639+0000","last_undegraded":"2024-04-25T15:45:17.441639+0000","last_fullsized":"2024-04-25T15:45:17.441639+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472508+0000","last_change":"2024-04-25T15:45:18.468839+0000","last_active":"2024-04-25T15:45:18.472508+0000","last_peered":"2024-04-25T15:45:18.472508+0000","last_clean":"2024-04-25T15:45:18.472508+0000","last_became_active":"2024-04-25T15:45:18.467727+0000","last_became_peered":"2024-04-25T15:45:18.467727+0000","last_unstale":"2024-04-25T15:45:18.472508+0000","last_undegraded":"2024-04-25T15:45:18.472508+0000","last_fullsized":"2024-04-25T15:45:18.472508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:23.502579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442604+0000","last_change":"2024-04-25T15:45:17.442604+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442604+0000","last_undegraded":"2024-04-25T15:45:17.442604+0000","last_fullsized":"2024-04-25T15:45:17.442604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443084+0000","last_change":"2024-04-25T15:45:17.443084+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443084+0000","last_undegraded":"2024-04-25T15:45:17.443084+0000","last_fullsized":"2024-04-25T15:45:17.443084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468155+0000","last_change":"2024-04-25T15:45:18.461593+0000","last_active":"2024-04-25T15:45:18.468155+0000","last_peered":"2024-04-25T15:45:18.468155+0000","last_clean":"2024-04-25T15:45:18.468155+0000","last_became_active":"2024-04-25T15:45:18.460991+0000","last_became_peered":"2024-04-25T15:45:18.460991+0000","last_unstale":"2024-04-25T15:45:18.468155+0000","last_undegraded":"2024-04-25T15:45:18.468155+0000","last_fullsized":"2024-04-25T15:45:18.468155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:14.574983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471531+0000","last_change":"2024-04-25T15:45:18.470892+0000","last_active":"2024-04-25T15:45:18.471531+0000","last_peered":"2024-04-25T15:45:18.471531+0000","last_clean":"2024-04-25T15:45:18.471531+0000","last_became_active":"2024-04-25T15:45:18.470554+0000","last_became_peered":"2024-04-25T15:45:18.470554+0000","last_unstale":"2024-04-25T15:45:18.471531+0000","last_undegraded":"2024-04-25T15:45:18.471531+0000","last_fullsized":"2024-04-25T15:45:18.471531+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:11.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470500+0000","last_change":"2024-04-25T15:45:17.450209+0000","last_active":"2024-04-25T15:45:18.470500+0000","last_peered":"2024-04-25T15:45:18.470500+0000","last_clean":"2024-04-25T15:45:18.470500+0000","last_became_active":"2024-04-25T15:45:17.449955+0000","last_became_peered":"2024-04-25T15:45:17.449955+0000","last_unstale":"2024-04-25T15:45:18.470500+0000","last_undegraded":"2024-04-25T15:45:18.470500+0000","last_fullsized":"2024-04-25T15:45:18.470500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:49.999228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441117+0000","last_change":"2024-04-25T15:45:17.441117+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441117+0000","last_undegraded":"2024-04-25T15:45:17.441117+0000","last_fullsized":"2024-04-25T15:45:17.441117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468359+0000","last_change":"2024-04-25T15:45:17.452008+0000","last_active":"2024-04-25T15:45:18.468359+0000","last_peered":"2024-04-25T15:45:18.468359+0000","last_clean":"2024-04-25T15:45:18.468359+0000","last_became_active":"2024-04-25T15:45:17.451635+0000","last_became_peered":"2024-04-25T15:45:17.451635+0000","last_unstale":"2024-04-25T15:45:18.468359+0000","last_undegraded":"2024-04-25T15:45:18.468359+0000","last_fullsized":"2024-04-25T15:45:18.468359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464096+0000","last_change":"2024-04-25T15:45:18.460858+0000","last_active":"2024-04-25T15:45:18.464096+0000","last_peered":"2024-04-25T15:45:18.464096+0000","last_clean":"2024-04-25T15:45:18.464096+0000","last_became_active":"2024-04-25T15:45:18.460430+0000","last_became_peered":"2024-04-25T15:45:18.460430+0000","last_unstale":"2024-04-25T15:45:18.464096+0000","last_undegraded":"2024-04-25T15:45:18.464096+0000","last_fullsized":"2024-04-25T15:45:18.464096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:09.832403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468632+0000","last_change":"2024-04-25T15:45:17.448435+0000","last_active":"2024-04-25T15:45:18.468632+0000","last_peered":"2024-04-25T15:45:18.468632+0000","last_clean":"2024-04-25T15:45:18.468632+0000","last_became_active":"2024-04-25T15:45:17.448082+0000","last_became_peered":"2024-04-25T15:45:17.448082+0000","last_unstale":"2024-04-25T15:45:18.468632+0000","last_undegraded":"2024-04-25T15:45:18.468632+0000","last_fullsized":"2024-04-25T15:45:18.468632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:44.683965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436744+0000","last_change":"2024-04-25T15:45:17.436744+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436744+0000","last_undegraded":"2024-04-25T15:45:17.436744+0000","last_fullsized":"2024-04-25T15:45:17.436744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472823+0000","last_change":"2024-04-25T15:45:17.441391+0000","last_active":"2024-04-25T15:45:18.472823+0000","last_peered":"2024-04-25T15:45:18.472823+0000","last_clean":"2024-04-25T15:45:18.472823+0000","last_became_active":"2024-04-25T15:45:17.441059+0000","last_became_peered":"2024-04-25T15:45:17.441059+0000","last_unstale":"2024-04-25T15:45:18.472823+0000","last_undegraded":"2024-04-25T15:45:18.472823+0000","last_fullsized":"2024-04-25T15:45:18.472823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467444+0000","last_change":"2024-04-25T15:45:18.461108+0000","last_active":"2024-04-25T15:45:18.467444+0000","last_peered":"2024-04-25T15:45:18.467444+0000","last_clean":"2024-04-25T15:45:18.467444+0000","last_became_active":"2024-04-25T15:45:18.460693+0000","last_became_peered":"2024-04-25T15:45:18.460693+0000","last_unstale":"2024-04-25T15:45:18.467444+0000","last_undegraded":"2024-04-25T15:45:18.467444+0000","last_fullsized":"2024-04-25T15:45:18.467444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:27.044492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.469081+0000","last_change":"2024-04-25T15:45:17.453653+0000","last_active":"2024-04-25T15:45:18.469081+0000","last_peered":"2024-04-25T15:45:18.469081+0000","last_clean":"2024-04-25T15:45:18.469081+0000","last_became_active":"2024-04-25T15:45:17.453292+0000","last_became_peered":"2024-04-25T15:45:17.453292+0000","last_unstale":"2024-04-25T15:45:18.469081+0000","last_undegraded":"2024-04-25T15:45:18.469081+0000","last_fullsized":"2024-04-25T15:45:18.469081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:12.590842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472180+0000","last_change":"2024-04-25T15:45:18.469156+0000","last_active":"2024-04-25T15:45:18.472180+0000","last_peered":"2024-04-25T15:45:18.472180+0000","last_clean":"2024-04-25T15:45:18.472180+0000","last_became_active":"2024-04-25T15:45:18.468808+0000","last_became_peered":"2024-04-25T15:45:18.468808+0000","last_unstale":"2024-04-25T15:45:18.472180+0000","last_undegraded":"2024-04-25T15:45:18.472180+0000","last_fullsized":"2024-04-25T15:45:18.472180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:11.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473211+0000","last_change":"2024-04-25T15:45:17.448087+0000","last_active":"2024-04-25T15:45:18.473211+0000","last_peered":"2024-04-25T15:45:18.473211+0000","last_clean":"2024-04-25T15:45:18.473211+0000","last_became_active":"2024-04-25T15:45:17.447741+0000","last_became_peered":"2024-04-25T15:45:17.447741+0000","last_unstale":"2024-04-25T15:45:18.473211+0000","last_undegraded":"2024-04-25T15:45:18.473211+0000","last_fullsized":"2024-04-25T15:45:18.473211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:13.573046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.466578+0000","last_change":"2024-04-25T15:45:18.463919+0000","last_active":"2024-04-25T15:45:18.466578+0000","last_peered":"2024-04-25T15:45:18.466578+0000","last_clean":"2024-04-25T15:45:18.466578+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.466578+0000","last_undegraded":"2024-04-25T15:45:18.466578+0000","last_fullsized":"2024-04-25T15:45:18.466578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.704086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446311+0000","last_change":"2024-04-25T15:45:17.456424+0000","last_active":"2024-04-25T15:45:18.446311+0000","last_peered":"2024-04-25T15:45:18.446311+0000","last_clean":"2024-04-25T15:45:18.446311+0000","last_became_active":"2024-04-25T15:45:17.456094+0000","last_became_peered":"2024-04-25T15:45:17.456094+0000","last_unstale":"2024-04-25T15:45:18.446311+0000","last_undegraded":"2024-04-25T15:45:18.446311+0000","last_fullsized":"2024-04-25T15:45:18.446311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:59.411412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.453962+0000","last_change":"2024-04-25T15:45:18.450549+0000","last_active":"2024-04-25T15:45:18.453962+0000","last_peered":"2024-04-25T15:45:18.453962+0000","last_clean":"2024-04-25T15:45:18.453962+0000","last_became_active":"2024-04-25T15:45:18.450220+0000","last_became_peered":"2024-04-25T15:45:18.450220+0000","last_unstale":"2024-04-25T15:45:18.453962+0000","last_undegraded":"2024-04-25T15:45:18.453962+0000","last_fullsized":"2024-04-25T15:45:18.453962+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445943+0000","last_change":"2024-04-25T15:45:17.453235+0000","last_active":"2024-04-25T15:45:18.445943+0000","last_peered":"2024-04-25T15:45:18.445943+0000","last_clean":"2024-04-25T15:45:18.445943+0000","last_became_active":"2024-04-25T15:45:17.452866+0000","last_became_peered":"2024-04-25T15:45:17.452866+0000","last_unstale":"2024-04-25T15:45:18.445943+0000","last_undegraded":"2024-04-25T15:45:18.445943+0000","last_fullsized":"2024-04-25T15:45:18.445943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472543+0000","last_change":"2024-04-25T15:45:18.469147+0000","last_active":"2024-04-25T15:45:18.472543+0000","last_peered":"2024-04-25T15:45:18.472543+0000","last_clean":"2024-04-25T15:45:18.472543+0000","last_became_active":"2024-04-25T15:45:18.467937+0000","last_became_peered":"2024-04-25T15:45:18.467937+0000","last_unstale":"2024-04-25T15:45:18.472543+0000","last_undegraded":"2024-04-25T15:45:18.472543+0000","last_fullsized":"2024-04-25T15:45:18.472543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:24.631878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452522+0000","last_change":"2024-04-25T15:45:17.447439+0000","last_active":"2024-04-25T15:45:17.452522+0000","last_peered":"2024-04-25T15:45:17.452522+0000","last_clean":"2024-04-25T15:45:17.452522+0000","last_became_active":"2024-04-25T15:45:17.446486+0000","last_became_peered":"2024-04-25T15:45:17.446486+0000","last_unstale":"2024-04-25T15:45:17.452522+0000","last_undegraded":"2024-04-25T15:45:17.452522+0000","last_fullsized":"2024-04-25T15:45:17.452522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461897+0000","last_change":"2024-04-25T15:45:18.456089+0000","last_active":"2024-04-25T15:45:18.461897+0000","last_peered":"2024-04-25T15:45:18.461897+0000","last_clean":"2024-04-25T15:45:18.461897+0000","last_became_active":"2024-04-25T15:45:18.455775+0000","last_became_peered":"2024-04-25T15:45:18.455775+0000","last_unstale":"2024-04-25T15:45:18.461897+0000","last_undegraded":"2024-04-25T15:45:18.461897+0000","last_fullsized":"2024-04-25T15:45:18.461897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451366+0000","last_change":"2024-04-25T15:45:17.447523+0000","last_active":"2024-04-25T15:45:17.451366+0000","last_peered":"2024-04-25T15:45:17.451366+0000","last_clean":"2024-04-25T15:45:17.451366+0000","last_became_active":"2024-04-25T15:45:17.447092+0000","last_became_peered":"2024-04-25T15:45:17.447092+0000","last_unstale":"2024-04-25T15:45:17.451366+0000","last_undegraded":"2024-04-25T15:45:17.451366+0000","last_fullsized":"2024-04-25T15:45:17.451366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:21.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460793+0000","last_change":"2024-04-25T15:45:18.458720+0000","last_active":"2024-04-25T15:45:18.460793+0000","last_peered":"2024-04-25T15:45:18.460793+0000","last_clean":"2024-04-25T15:45:18.460793+0000","last_became_active":"2024-04-25T15:45:18.458419+0000","last_became_peered":"2024-04-25T15:45:18.458419+0000","last_unstale":"2024-04-25T15:45:18.460793+0000","last_undegraded":"2024-04-25T15:45:18.460793+0000","last_fullsized":"2024-04-25T15:45:18.460793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:22.375221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452009+0000","last_change":"2024-04-25T15:45:17.445901+0000","last_active":"2024-04-25T15:45:17.452009+0000","last_peered":"2024-04-25T15:45:17.452009+0000","last_clean":"2024-04-25T15:45:17.452009+0000","last_became_active":"2024-04-25T15:45:17.445519+0000","last_became_peered":"2024-04-25T15:45:17.445519+0000","last_unstale":"2024-04-25T15:45:17.452009+0000","last_undegraded":"2024-04-25T15:45:17.452009+0000","last_fullsized":"2024-04-25T15:45:17.452009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440758+0000","last_change":"2024-04-25T15:45:17.440758+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440758+0000","last_undegraded":"2024-04-25T15:45:17.440758+0000","last_fullsized":"2024-04-25T15:45:17.440758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.476351+0000","last_change":"2024-04-25T15:45:17.452349+0000","last_active":"2024-04-25T15:45:18.476351+0000","last_peered":"2024-04-25T15:45:18.476351+0000","last_clean":"2024-04-25T15:45:18.476351+0000","last_became_active":"2024-04-25T15:45:17.452038+0000","last_became_peered":"2024-04-25T15:45:17.452038+0000","last_unstale":"2024-04-25T15:45:18.476351+0000","last_undegraded":"2024-04-25T15:45:18.476351+0000","last_fullsized":"2024-04-25T15:45:18.476351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:30.586243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442657+0000","last_change":"2024-04-25T15:45:17.442657+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442657+0000","last_undegraded":"2024-04-25T15:45:17.442657+0000","last_fullsized":"2024-04-25T15:45:17.442657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457374+0000","last_change":"2024-04-25T15:45:17.456603+0000","last_active":"2024-04-25T15:45:17.457374+0000","last_peered":"2024-04-25T15:45:17.457374+0000","last_clean":"2024-04-25T15:45:17.457374+0000","last_became_active":"2024-04-25T15:45:17.456120+0000","last_became_peered":"2024-04-25T15:45:17.456120+0000","last_unstale":"2024-04-25T15:45:17.457374+0000","last_undegraded":"2024-04-25T15:45:17.457374+0000","last_fullsized":"2024-04-25T15:45:17.457374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:27.077156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441982+0000","last_change":"2024-04-25T15:45:17.441982+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441982+0000","last_undegraded":"2024-04-25T15:45:17.441982+0000","last_fullsized":"2024-04-25T15:45:17.441982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456027+0000","last_change":"2024-04-25T15:45:17.454916+0000","last_active":"2024-04-25T15:45:17.456027+0000","last_peered":"2024-04-25T15:45:17.456027+0000","last_clean":"2024-04-25T15:45:17.456027+0000","last_became_active":"2024-04-25T15:45:17.454350+0000","last_became_peered":"2024-04-25T15:45:17.454350+0000","last_unstale":"2024-04-25T15:45:17.456027+0000","last_undegraded":"2024-04-25T15:45:17.456027+0000","last_fullsized":"2024-04-25T15:45:17.456027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455222+0000","last_change":"2024-04-25T15:45:18.448588+0000","last_active":"2024-04-25T15:45:18.455222+0000","last_peered":"2024-04-25T15:45:18.455222+0000","last_clean":"2024-04-25T15:45:18.455222+0000","last_became_active":"2024-04-25T15:45:18.448287+0000","last_became_peered":"2024-04-25T15:45:18.448287+0000","last_unstale":"2024-04-25T15:45:18.455222+0000","last_undegraded":"2024-04-25T15:45:18.455222+0000","last_fullsized":"2024-04-25T15:45:18.455222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:58.998394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452843+0000","last_change":"2024-04-25T15:45:17.450515+0000","last_active":"2024-04-25T15:45:17.452843+0000","last_peered":"2024-04-25T15:45:17.452843+0000","last_clean":"2024-04-25T15:45:17.452843+0000","last_became_active":"2024-04-25T15:45:17.450214+0000","last_became_peered":"2024-04-25T15:45:17.450214+0000","last_unstale":"2024-04-25T15:45:17.452843+0000","last_undegraded":"2024-04-25T15:45:17.452843+0000","last_fullsized":"2024-04-25T15:45:17.452843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:17.535639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470412+0000","last_change":"2024-04-25T15:45:18.465099+0000","last_active":"2024-04-25T15:45:18.470412+0000","last_peered":"2024-04-25T15:45:18.470412+0000","last_clean":"2024-04-25T15:45:18.470412+0000","last_became_active":"2024-04-25T15:45:18.464807+0000","last_became_peered":"2024-04-25T15:45:18.464807+0000","last_unstale":"2024-04-25T15:45:18.470412+0000","last_undegraded":"2024-04-25T15:45:18.470412+0000","last_fullsized":"2024-04-25T15:45:18.470412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:40.746835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457637+0000","last_change":"2024-04-25T15:45:17.453212+0000","last_active":"2024-04-25T15:45:17.457637+0000","last_peered":"2024-04-25T15:45:17.457637+0000","last_clean":"2024-04-25T15:45:17.457637+0000","last_became_active":"2024-04-25T15:45:17.452909+0000","last_became_peered":"2024-04-25T15:45:17.452909+0000","last_unstale":"2024-04-25T15:45:17.457637+0000","last_undegraded":"2024-04-25T15:45:17.457637+0000","last_fullsized":"2024-04-25T15:45:17.457637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436140+0000","last_change":"2024-04-25T15:45:17.436140+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436140+0000","last_undegraded":"2024-04-25T15:45:17.436140+0000","last_fullsized":"2024-04-25T15:45:17.436140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456095+0000","last_change":"2024-04-25T15:45:17.454462+0000","last_active":"2024-04-25T15:45:17.456095+0000","last_peered":"2024-04-25T15:45:17.456095+0000","last_clean":"2024-04-25T15:45:17.456095+0000","last_became_active":"2024-04-25T15:45:17.454123+0000","last_became_peered":"2024-04-25T15:45:17.454123+0000","last_unstale":"2024-04-25T15:45:17.456095+0000","last_undegraded":"2024-04-25T15:45:17.456095+0000","last_fullsized":"2024-04-25T15:45:17.456095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468102+0000","last_change":"2024-04-25T15:45:18.466518+0000","last_active":"2024-04-25T15:45:18.468102+0000","last_peered":"2024-04-25T15:45:18.468102+0000","last_clean":"2024-04-25T15:45:18.468102+0000","last_became_active":"2024-04-25T15:45:18.466170+0000","last_became_peered":"2024-04-25T15:45:18.466170+0000","last_unstale":"2024-04-25T15:45:18.468102+0000","last_undegraded":"2024-04-25T15:45:18.468102+0000","last_fullsized":"2024-04-25T15:45:18.468102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:41.722999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452610+0000","last_change":"2024-04-25T15:45:17.449615+0000","last_active":"2024-04-25T15:45:17.452610+0000","last_peered":"2024-04-25T15:45:17.452610+0000","last_clean":"2024-04-25T15:45:17.452610+0000","last_became_active":"2024-04-25T15:45:17.449164+0000","last_became_peered":"2024-04-25T15:45:17.449164+0000","last_unstale":"2024-04-25T15:45:17.452610+0000","last_undegraded":"2024-04-25T15:45:17.452610+0000","last_fullsized":"2024-04-25T15:45:17.452610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442115+0000","last_change":"2024-04-25T15:45:17.442115+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442115+0000","last_undegraded":"2024-04-25T15:45:17.442115+0000","last_fullsized":"2024-04-25T15:45:17.442115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451982+0000","last_change":"2024-04-25T15:45:17.445560+0000","last_active":"2024-04-25T15:45:17.451982+0000","last_peered":"2024-04-25T15:45:17.451982+0000","last_clean":"2024-04-25T15:45:17.451982+0000","last_became_active":"2024-04-25T15:45:17.445197+0000","last_became_peered":"2024-04-25T15:45:17.445197+0000","last_unstale":"2024-04-25T15:45:17.451982+0000","last_undegraded":"2024-04-25T15:45:17.451982+0000","last_fullsized":"2024-04-25T15:45:17.451982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460732+0000","last_change":"2024-04-25T15:45:18.457807+0000","last_active":"2024-04-25T15:45:18.460732+0000","last_peered":"2024-04-25T15:45:18.460732+0000","last_clean":"2024-04-25T15:45:18.460732+0000","last_became_active":"2024-04-25T15:45:18.457452+0000","last_became_peered":"2024-04-25T15:45:18.457452+0000","last_unstale":"2024-04-25T15:45:18.460732+0000","last_undegraded":"2024-04-25T15:45:18.460732+0000","last_fullsized":"2024-04-25T15:45:18.460732+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:50.384952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444182+0000","last_change":"2024-04-25T15:45:17.452491+0000","last_active":"2024-04-25T15:45:18.444182+0000","last_peered":"2024-04-25T15:45:18.444182+0000","last_clean":"2024-04-25T15:45:18.444182+0000","last_became_active":"2024-04-25T15:45:17.452161+0000","last_became_peered":"2024-04-25T15:45:17.452161+0000","last_unstale":"2024-04-25T15:45:18.444182+0000","last_undegraded":"2024-04-25T15:45:18.444182+0000","last_fullsized":"2024-04-25T15:45:18.444182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.465589+0000","last_change":"2024-04-25T15:45:18.461064+0000","last_active":"2024-04-25T15:45:18.465589+0000","last_peered":"2024-04-25T15:45:18.465589+0000","last_clean":"2024-04-25T15:45:18.465589+0000","last_became_active":"2024-04-25T15:45:18.460573+0000","last_became_peered":"2024-04-25T15:45:18.460573+0000","last_unstale":"2024-04-25T15:45:18.465589+0000","last_undegraded":"2024-04-25T15:45:18.465589+0000","last_fullsized":"2024-04-25T15:45:18.465589+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:13.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471554+0000","last_change":"2024-04-25T15:45:17.455994+0000","last_active":"2024-04-25T15:45:18.471554+0000","last_peered":"2024-04-25T15:45:18.471554+0000","last_clean":"2024-04-25T15:45:18.471554+0000","last_became_active":"2024-04-25T15:45:17.455639+0000","last_became_peered":"2024-04-25T15:45:17.455639+0000","last_unstale":"2024-04-25T15:45:18.471554+0000","last_undegraded":"2024-04-25T15:45:18.471554+0000","last_fullsized":"2024-04-25T15:45:18.471554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:33.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440665+0000","last_change":"2024-04-25T15:45:17.440665+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440665+0000","last_undegraded":"2024-04-25T15:45:17.440665+0000","last_fullsized":"2024-04-25T15:45:17.440665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457294+0000","last_change":"2024-04-25T15:45:17.455522+0000","last_active":"2024-04-25T15:45:17.457294+0000","last_peered":"2024-04-25T15:45:17.457294+0000","last_clean":"2024-04-25T15:45:17.457294+0000","last_became_active":"2024-04-25T15:45:17.455177+0000","last_became_peered":"2024-04-25T15:45:17.455177+0000","last_unstale":"2024-04-25T15:45:17.457294+0000","last_undegraded":"2024-04-25T15:45:17.457294+0000","last_fullsized":"2024-04-25T15:45:17.457294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455252+0000","last_change":"2024-04-25T15:45:18.452851+0000","last_active":"2024-04-25T15:45:18.455252+0000","last_peered":"2024-04-25T15:45:18.455252+0000","last_clean":"2024-04-25T15:45:18.455252+0000","last_became_active":"2024-04-25T15:45:18.452522+0000","last_became_peered":"2024-04-25T15:45:18.452522+0000","last_unstale":"2024-04-25T15:45:18.455252+0000","last_undegraded":"2024-04-25T15:45:18.455252+0000","last_fullsized":"2024-04-25T15:45:18.455252+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:00.624839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444427+0000","last_change":"2024-04-25T15:45:17.451838+0000","last_active":"2024-04-25T15:45:18.444427+0000","last_peered":"2024-04-25T15:45:18.444427+0000","last_clean":"2024-04-25T15:45:18.444427+0000","last_became_active":"2024-04-25T15:45:17.451595+0000","last_became_peered":"2024-04-25T15:45:17.451595+0000","last_unstale":"2024-04-25T15:45:18.444427+0000","last_undegraded":"2024-04-25T15:45:18.444427+0000","last_fullsized":"2024-04-25T15:45:18.444427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:52.673909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473430+0000","last_change":"2024-04-25T15:45:18.469369+0000","last_active":"2024-04-25T15:45:18.473430+0000","last_peered":"2024-04-25T15:45:18.473430+0000","last_clean":"2024-04-25T15:45:18.473430+0000","last_became_active":"2024-04-25T15:45:18.469065+0000","last_became_peered":"2024-04-25T15:45:18.469065+0000","last_unstale":"2024-04-25T15:45:18.473430+0000","last_undegraded":"2024-04-25T15:45:18.473430+0000","last_fullsized":"2024-04-25T15:45:18.473430+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:47.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.454564+0000","last_change":"2024-04-25T15:45:17.452964+0000","last_active":"2024-04-25T15:45:17.454564+0000","last_peered":"2024-04-25T15:45:17.454564+0000","last_clean":"2024-04-25T15:45:17.454564+0000","last_became_active":"2024-04-25T15:45:17.452625+0000","last_became_peered":"2024-04-25T15:45:17.452625+0000","last_unstale":"2024-04-25T15:45:17.454564+0000","last_undegraded":"2024-04-25T15:45:17.454564+0000","last_fullsized":"2024-04-25T15:45:17.454564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:23.629942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470472+0000","last_change":"2024-04-25T15:45:18.464662+0000","last_active":"2024-04-25T15:45:18.470472+0000","last_peered":"2024-04-25T15:45:18.470472+0000","last_clean":"2024-04-25T15:45:18.470472+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.470472+0000","last_undegraded":"2024-04-25T15:45:18.470472+0000","last_fullsized":"2024-04-25T15:45:18.470472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:26.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.449816+0000","last_change":"2024-04-25T15:45:17.447299+0000","last_active":"2024-04-25T15:45:17.449816+0000","last_peered":"2024-04-25T15:45:17.449816+0000","last_clean":"2024-04-25T15:45:17.449816+0000","last_became_active":"2024-04-25T15:45:17.446963+0000","last_became_peered":"2024-04-25T15:45:17.446963+0000","last_unstale":"2024-04-25T15:45:17.449816+0000","last_undegraded":"2024-04-25T15:45:17.449816+0000","last_fullsized":"2024-04-25T15:45:17.449816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:22.500642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441575+0000","last_change":"2024-04-25T15:45:17.441575+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441575+0000","last_undegraded":"2024-04-25T15:45:17.441575+0000","last_fullsized":"2024-04-25T15:45:17.441575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445751+0000","last_change":"2024-04-25T15:45:17.447746+0000","last_active":"2024-04-25T15:45:18.445751+0000","last_peered":"2024-04-25T15:45:18.445751+0000","last_clean":"2024-04-25T15:45:18.445751+0000","last_became_active":"2024-04-25T15:45:17.447403+0000","last_became_peered":"2024-04-25T15:45:17.447403+0000","last_unstale":"2024-04-25T15:45:18.445751+0000","last_undegraded":"2024-04-25T15:45:18.445751+0000","last_fullsized":"2024-04-25T15:45:18.445751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:51.951450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457990+0000","last_change":"2024-04-25T15:45:18.450798+0000","last_active":"2024-04-25T15:45:18.457990+0000","last_peered":"2024-04-25T15:45:18.457990+0000","last_clean":"2024-04-25T15:45:18.457990+0000","last_became_active":"2024-04-25T15:45:18.450505+0000","last_became_peered":"2024-04-25T15:45:18.450505+0000","last_unstale":"2024-04-25T15:45:18.457990+0000","last_undegraded":"2024-04-25T15:45:18.457990+0000","last_fullsized":"2024-04-25T15:45:18.457990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:13.598541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460359+0000","last_change":"2024-04-25T15:45:17.449484+0000","last_active":"2024-04-25T15:45:18.460359+0000","last_peered":"2024-04-25T15:45:18.460359+0000","last_clean":"2024-04-25T15:45:18.460359+0000","last_became_active":"2024-04-25T15:45:17.449246+0000","last_became_peered":"2024-04-25T15:45:17.449246+0000","last_unstale":"2024-04-25T15:45:18.460359+0000","last_undegraded":"2024-04-25T15:45:18.460359+0000","last_fullsized":"2024-04-25T15:45:18.460359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:53.969769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463870+0000","last_change":"2024-04-25T15:45:18.461789+0000","last_active":"2024-04-25T15:45:18.463870+0000","last_peered":"2024-04-25T15:45:18.463870+0000","last_clean":"2024-04-25T15:45:18.463870+0000","last_became_active":"2024-04-25T15:45:18.461037+0000","last_became_peered":"2024-04-25T15:45:18.461037+0000","last_unstale":"2024-04-25T15:45:18.463870+0000","last_undegraded":"2024-04-25T15:45:18.463870+0000","last_fullsized":"2024-04-25T15:45:18.463870+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:29.775814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456766+0000","last_change":"2024-04-25T15:45:17.454679+0000","last_active":"2024-04-25T15:45:17.456766+0000","last_peered":"2024-04-25T15:45:17.456766+0000","last_clean":"2024-04-25T15:45:17.456766+0000","last_became_active":"2024-04-25T15:45:17.454369+0000","last_became_peered":"2024-04-25T15:45:17.454369+0000","last_unstale":"2024-04-25T15:45:17.456766+0000","last_undegraded":"2024-04-25T15:45:17.456766+0000","last_fullsized":"2024-04-25T15:45:17.456766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:34.081224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442596+0000","last_change":"2024-04-25T15:45:17.442596+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442596+0000","last_undegraded":"2024-04-25T15:45:17.442596+0000","last_fullsized":"2024-04-25T15:45:17.442596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.447410+0000","last_change":"2024-04-25T15:45:17.454527+0000","last_active":"2024-04-25T15:45:18.447410+0000","last_peered":"2024-04-25T15:45:18.447410+0000","last_clean":"2024-04-25T15:45:18.447410+0000","last_became_active":"2024-04-25T15:45:17.454188+0000","last_became_peered":"2024-04-25T15:45:17.454188+0000","last_unstale":"2024-04-25T15:45:18.447410+0000","last_undegraded":"2024-04-25T15:45:18.447410+0000","last_fullsized":"2024-04-25T15:45:18.447410+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:46.375607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472254+0000","last_change":"2024-04-25T15:45:18.469752+0000","last_active":"2024-04-25T15:45:18.472254+0000","last_peered":"2024-04-25T15:45:18.472254+0000","last_clean":"2024-04-25T15:45:18.472254+0000","last_became_active":"2024-04-25T15:45:18.469384+0000","last_became_peered":"2024-04-25T15:45:18.469384+0000","last_unstale":"2024-04-25T15:45:18.472254+0000","last_undegraded":"2024-04-25T15:45:18.472254+0000","last_fullsized":"2024-04-25T15:45:18.472254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446507+0000","last_change":"2024-04-25T15:45:17.455624+0000","last_active":"2024-04-25T15:45:18.446507+0000","last_peered":"2024-04-25T15:45:18.446507+0000","last_clean":"2024-04-25T15:45:18.446507+0000","last_became_active":"2024-04-25T15:45:17.455302+0000","last_became_peered":"2024-04-25T15:45:17.455302+0000","last_unstale":"2024-04-25T15:45:18.446507+0000","last_undegraded":"2024-04-25T15:45:18.446507+0000","last_fullsized":"2024-04-25T15:45:18.446507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:08.830467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.452996+0000","last_change":"2024-04-25T15:45:18.448618+0000","last_active":"2024-04-25T15:45:18.452996+0000","last_peered":"2024-04-25T15:45:18.452996+0000","last_clean":"2024-04-25T15:45:18.452996+0000","last_became_active":"2024-04-25T15:45:18.448310+0000","last_became_peered":"2024-04-25T15:45:18.448310+0000","last_unstale":"2024-04-25T15:45:18.452996+0000","last_undegraded":"2024-04-25T15:45:18.452996+0000","last_fullsized":"2024-04-25T15:45:18.452996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:56.668886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.454165+0000","last_change":"2024-04-25T15:45:17.455162+0000","last_active":"2024-04-25T15:45:18.454165+0000","last_peered":"2024-04-25T15:45:18.454165+0000","last_clean":"2024-04-25T15:45:18.454165+0000","last_became_active":"2024-04-25T15:45:17.454854+0000","last_became_peered":"2024-04-25T15:45:17.454854+0000","last_unstale":"2024-04-25T15:45:18.454165+0000","last_undegraded":"2024-04-25T15:45:18.454165+0000","last_fullsized":"2024-04-25T15:45:18.454165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:27.636826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464149+0000","last_change":"2024-04-25T15:45:18.460579+0000","last_active":"2024-04-25T15:45:18.464149+0000","last_peered":"2024-04-25T15:45:18.464149+0000","last_clean":"2024-04-25T15:45:18.464149+0000","last_became_active":"2024-04-25T15:45:18.460230+0000","last_became_peered":"2024-04-25T15:45:18.460230+0000","last_unstale":"2024-04-25T15:45:18.464149+0000","last_undegraded":"2024-04-25T15:45:18.464149+0000","last_fullsized":"2024-04-25T15:45:18.464149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:41.921359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444080+0000","last_change":"2024-04-25T15:45:17.453686+0000","last_active":"2024-04-25T15:45:18.444080+0000","last_peered":"2024-04-25T15:45:18.444080+0000","last_clean":"2024-04-25T15:45:18.444080+0000","last_became_active":"2024-04-25T15:45:17.453361+0000","last_became_peered":"2024-04-25T15:45:17.453361+0000","last_unstale":"2024-04-25T15:45:18.444080+0000","last_undegraded":"2024-04-25T15:45:18.444080+0000","last_fullsized":"2024-04-25T15:45:18.444080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.437098+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:17.437098+0000","last_peered":"2024-04-25T15:45:17.437098+0000","last_clean":"2024-04-25T15:45:17.437098+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:17.437098+0000","last_undegraded":"2024-04-25T15:45:17.437098+0000","last_fullsized":"2024-04-25T15:45:17.437098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":333071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":333037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1339392,"data_stored":923405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":909579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":319211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:22.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2024-04-25T15:45:22.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.435667+0000', 'last_change': '2024-04-25T15:45:17.435667+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.435667+0000', 'last_undegraded': '2024-04-25T15:45:17.435667+0000', 'last_fullsized': '2024-04-25T15:45:17.435667+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2024-04-25T15:45:22.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.445527+0000', 'last_change': '2024-04-25T15:45:17.445527+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.445527+0000', 'last_undegraded': '2024-04-25T15:45:17.445527+0000', 'last_fullsized': '2024-04-25T15:45:17.445527+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2024-04-25T15:45:22.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.445774+0000', 'last_change': '2024-04-25T15:45:17.445774+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.445774+0000', 'last_undegraded': '2024-04-25T15:45:17.445774+0000', 'last_fullsized': '2024-04-25T15:45:17.445774+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.436021+0000', 'last_change': '2024-04-25T15:45:17.436021+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.436021+0000', 'last_undegraded': '2024-04-25T15:45:17.436021+0000', 'last_fullsized': '2024-04-25T15:45:17.436021+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.436489+0000', 'last_change': '2024-04-25T15:45:17.436489+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.436489+0000', 'last_undegraded': '2024-04-25T15:45:17.436489+0000', 'last_fullsized': '2024-04-25T15:45:17.436489+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.442162+0000', 'last_change': '2024-04-25T15:45:17.442162+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.442162+0000', 'last_undegraded': '2024-04-25T15:45:17.442162+0000', 'last_fullsized': '2024-04-25T15:45:17.442162+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.443910+0000', 'last_change': '2024-04-25T15:45:17.443910+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.443910+0000', 'last_undegraded': '2024-04-25T15:45:17.443910+0000', 'last_fullsized': '2024-04-25T15:45:17.443910+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2024-04-25T15:45:22.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.446326+0000', 'last_change': '2024-04-25T15:45:17.446326+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.446326+0000', 'last_undegraded': '2024-04-25T15:45:17.446326+0000', 'last_fullsized': '2024-04-25T15:45:17.446326+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.435716+0000', 'last_change': '2024-04-25T15:45:17.435716+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.435716+0000', 'last_undegraded': '2024-04-25T15:45:17.435716+0000', 'last_fullsized': '2024-04-25T15:45:17.435716+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.436552+0000', 'last_change': '2024-04-25T15:45:17.436552+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.436552+0000', 'last_undegraded': '2024-04-25T15:45:17.436552+0000', 'last_fullsized': '2024-04-25T15:45:17.436552+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.443489+0000', 'last_change': '2024-04-25T15:45:17.443489+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.443489+0000', 'last_undegraded': '2024-04-25T15:45:17.443489+0000', 'last_fullsized': '2024-04-25T15:45:17.443489+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.445841+0000', 'last_change': '2024-04-25T15:45:17.445841+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.445841+0000', 'last_undegraded': '2024-04-25T15:45:17.445841+0000', 'last_fullsized': '2024-04-25T15:45:17.445841+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.435673+0000', 'last_change': '2024-04-25T15:45:17.435673+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.435673+0000', 'last_undegraded': '2024-04-25T15:45:17.435673+0000', 'last_fullsized': '2024-04-25T15:45:17.435673+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.445064+0000', 'last_change': '2024-04-25T15:45:17.445064+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.445064+0000', 'last_undegraded': '2024-04-25T15:45:17.445064+0000', 'last_fullsized': '2024-04-25T15:45:17.445064+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.443182+0000', 'last_change': '2024-04-25T15:45:17.443182+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.443182+0000', 'last_undegraded': '2024-04-25T15:45:17.443182+0000', 'last_fullsized': '2024-04-25T15:45:17.443182+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.441639+0000', 'last_change': '2024-04-25T15:45:17.441639+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.441639+0000', 'last_undegraded': '2024-04-25T15:45:17.441639+0000', 'last_fullsized': '2024-04-25T15:45:17.441639+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.435667+0000', 'last_change': '2024-04-25T15:45:17.435667+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.435667+0000', 'last_undegraded': '2024-04-25T15:45:17.435667+0000', 'last_fullsized': '2024-04-25T15:45:17.435667+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.442604+0000', 'last_change': '2024-04-25T15:45:17.442604+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.442604+0000', 'last_undegraded': '2024-04-25T15:45:17.442604+0000', 'last_fullsized': '2024-04-25T15:45:17.442604+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2024-04-25T15:45:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.443084+0000', 'last_change': '2024-04-25T15:45:17.443084+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.443084+0000', 'last_undegraded': '2024-04-25T15:45:17.443084+0000', 'last_fullsized': '2024-04-25T15:45:17.443084+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.441117+0000', 'last_change': '2024-04-25T15:45:17.441117+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.441117+0000', 'last_undegraded': '2024-04-25T15:45:17.441117+0000', 'last_fullsized': '2024-04-25T15:45:17.441117+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.436744+0000', 'last_change': '2024-04-25T15:45:17.436744+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.436744+0000', 'last_undegraded': '2024-04-25T15:45:17.436744+0000', 'last_fullsized': '2024-04-25T15:45:17.436744+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.440758+0000', 'last_change': '2024-04-25T15:45:17.440758+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.440758+0000', 'last_undegraded': '2024-04-25T15:45:17.440758+0000', 'last_fullsized': '2024-04-25T15:45:17.440758+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.442657+0000', 'last_change': '2024-04-25T15:45:17.442657+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.442657+0000', 'last_undegraded': '2024-04-25T15:45:17.442657+0000', 'last_fullsized': '2024-04-25T15:45:17.442657+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.441982+0000', 'last_change': '2024-04-25T15:45:17.441982+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.441982+0000', 'last_undegraded': '2024-04-25T15:45:17.441982+0000', 'last_fullsized': '2024-04-25T15:45:17.441982+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.436140+0000', 'last_change': '2024-04-25T15:45:17.436140+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.436140+0000', 'last_undegraded': '2024-04-25T15:45:17.436140+0000', 'last_fullsized': '2024-04-25T15:45:17.436140+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.442115+0000', 'last_change': '2024-04-25T15:45:17.442115+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.442115+0000', 'last_undegraded': '2024-04-25T15:45:17.442115+0000', 'last_fullsized': '2024-04-25T15:45:17.442115+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.440665+0000', 'last_change': '2024-04-25T15:45:17.440665+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.440665+0000', 'last_undegraded': '2024-04-25T15:45:17.440665+0000', 'last_fullsized': '2024-04-25T15:45:17.440665+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.441575+0000', 'last_change': '2024-04-25T15:45:17.441575+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.441575+0000', 'last_undegraded': '2024-04-25T15:45:17.441575+0000', 'last_fullsized': '2024-04-25T15:45:17.441575+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2024-04-25T15:45:22.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:17.442596+0000', 'last_change': '2024-04-25T15:45:17.442596+0000', 'last_active': '2024-04-25T15:45:17.426545+0000', 'last_peered': '2024-04-25T15:45:17.426545+0000', 'last_clean': '2024-04-25T15:45:17.426545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:17.442596+0000', 'last_undegraded': '2024-04-25T15:45:17.442596+0000', 'last_fullsized': '2024-04-25T15:45:17.442596+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:17.426545+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:22.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T15:45:22.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.301+0000 7faba81f8640 1 Processor -- start 2024-04-25T15:45:22.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.301+0000 7faba81f8640 1 -- start start 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba81f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00d34a0 0x7faba00b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba81f8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faba00b3ac0 0x7faba00b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba81f8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba00d1010 con 0x7faba006da90 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba81f8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7faba009cdf0 con 0x7faba00b3ac0 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba81f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faba009d0d0 con 0x7faba00d34a0 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba5793640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faba006da90 0x7faba006e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49502/0 (socket says 172.21.15.80:49502) 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba5793640 1 -- 172.21.15.80:0/3790953918 learned_addr learned my addr 172.21.15.80:0/3790953918 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:22.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba6795640 1 --2- 172.21.15.80:0/3790953918 >> v2:172.21.15.195:3300/0 conn(0x7faba00b3ac0 0x7faba00b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.302+0000 7faba5f94640 1 --2- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00d34a0 0x7faba00b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba4f92640 1 -- 172.21.15.80:0/3790953918 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405355372 0 0) 0x7faba00d1010 con 0x7faba006da90 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba4f92640 1 -- 172.21.15.80:0/3790953918 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab8c003520 con 0x7faba006da90 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba6795640 1 -- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00d34a0 msgr2=0x7faba00b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba6795640 1 --2- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00d34a0 0x7faba00b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba6795640 1 -- 172.21.15.80:0/3790953918 >> v1:172.21.15.80:6789/0 conn(0x7faba006da90 legacy=0x7faba006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba4f92640 1 -- 172.21.15.80:0/3790953918 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4158972225 0 0) 0x7fab8c003520 con 0x7faba006da90 2024-04-25T15:45:22.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.303+0000 7faba6795640 1 -- 172.21.15.80:0/3790953918 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba006ec70 con 0x7faba00b3ac0 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.304+0000 7faba6795640 1 --2- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00b3ac0 0x7faba00b3ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fab98009d90 tx=0x7fab9802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55959942caacf4c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.304+0000 7faba4f92640 1 -- 172.21.15.80:0/3790953918 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90001670 con 0x7faba00b3ac0 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.304+0000 7faba4f92640 1 -- 172.21.15.80:0/3790953918 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab98007540 con 0x7faba00b3ac0 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.304+0000 7faba4f92640 1 -- 172.21.15.80:0/3790953918 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab980078f0 con 0x7faba00b3ac0 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.304+0000 7faba81f8640 1 -- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00b3ac0 msgr2=0x7faba00b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.304+0000 7faba81f8640 1 --2- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00b3ac0 0x7faba00b3ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fab98009d90 tx=0x7fab9802a5f0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.305+0000 7faba81f8640 1 -- 172.21.15.80:0/3790953918 shutdown_connections 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.305+0000 7faba81f8640 1 --2- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00b3ac0 0x7faba00b3ed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.305+0000 7faba81f8640 1 --2- 172.21.15.80:0/3790953918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00d34a0 0x7faba00b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.305+0000 7faba81f8640 1 -- 172.21.15.80:0/3790953918 >> 172.21.15.80:0/3790953918 conn(0x7faba00d0450 msgr2=0x7faba00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.305+0000 7faba81f8640 1 -- 172.21.15.80:0/3790953918 shutdown_connections 2024-04-25T15:45:22.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.305+0000 7faba81f8640 1 -- 172.21.15.80:0/3790953918 wait complete. 2024-04-25T15:45:22.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.306+0000 7faba81f8640 1 Processor -- start 2024-04-25T15:45:22.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.306+0000 7faba81f8640 1 -- start start 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 0x7faba01521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00b3ac0 0x7faba015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00d34a0 0x7faba015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faba00b4410 con 0x7faba006da90 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faba006d7b0 con 0x7faba00d34a0 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faba00b4590 con 0x7faba00b3ac0 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 0x7faba01521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 0x7faba01521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60432/0 (socket says 172.21.15.80:60432) 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 -- 172.21.15.80:0/2835383709 learned_addr learned my addr 172.21.15.80:0/2835383709 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:22.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba6795640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00d34a0 0x7faba015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5793640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00b3ac0 0x7faba015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 -- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00b3ac0 msgr2=0x7faba015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00b3ac0 0x7faba015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 -- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00d34a0 msgr2=0x7faba015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00d34a0 0x7faba015e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 -- 172.21.15.80:0/2835383709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba015e910 con 0x7faba006da90 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5793640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00b3ac0 0x7faba015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba5f94640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 0x7faba01521a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00e8a0 tx=0x7fab9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c017070 con 0x7faba006da90 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c00c8e0 con 0x7faba006da90 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba015ebf0 con 0x7faba006da90 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00cc90 con 0x7faba006da90 2024-04-25T15:45:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.308+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba015f1b0 con 0x7faba006da90 2024-04-25T15:45:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.309+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba006a100 con 0x7faba006da90 2024-04-25T15:45:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.310+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fab9c01a070 con 0x7faba006da90 2024-04-25T15:45:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.311+0000 7fab967fc640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fab840744e0 0x7fab840769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.311+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fab9c095650 con 0x7faba006da90 2024-04-25T15:45:22.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.311+0000 7faba5793640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fab840744e0 0x7fab840769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.311+0000 7faba5793640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fab840744e0 0x7fab840769f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fab900011e0 tx=0x7fab90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:22.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.315+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab9c05f580 con 0x7faba006da90 2024-04-25T15:45:22.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.561+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faba01645e0 con 0x7faba006da90 2024-04-25T15:45:22.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.561+0000 7fab967fc640 1 -- 172.21.15.80:0/2835383709 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1517 (secure 0 0 0) 0x7fab9c063880 con 0x7faba006da90 2024-04-25T15:45:22.562 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:22.563 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":165,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1714059768,"num_in_osds":8,"osd_in_since":1714059759,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"creating+peering","count":29}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":592562,"bytes_used":245481472,"bytes_avail":772848631808,"bytes_total":773094113280,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":890,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":28,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6255}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-25T15:45:07.024045+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T15:45:22.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fab840744e0 msgr2=0x7fab840769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fab840744e0 0x7fab840769f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fab900011e0 tx=0x7fab90009040 comp rx=0 tx=0).stop 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 msgr2=0x7faba01521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 0x7faba01521a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00e8a0 tx=0x7fab9c00ed60 comp rx=0 tx=0).stop 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 shutdown_connections 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fab840744e0 0x7fab840769f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faba00d34a0 0x7faba015e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faba00b3ac0 0x7faba015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 --2- 172.21.15.80:0/2835383709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faba006da90 0x7faba01521a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 >> 172.21.15.80:0/2835383709 conn(0x7faba00d0450 msgr2=0x7faba01634b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 shutdown_connections 2024-04-25T15:45:22.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.563+0000 7faba81f8640 1 -- 172.21.15.80:0/2835383709 wait complete. 2024-04-25T15:45:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T15:45:22.575 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:22.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.681+0000 7fe73e06e640 1 Processor -- start 2024-04-25T15:45:22.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.681+0000 7fe73e06e640 1 -- start start 2024-04-25T15:45:22.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe73e06e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7380b7230 0x7fe73809ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe73e06e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7380b9350 con 0x7fe7380b2a40 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe73e06e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7380cf890 con 0x7fe7380cff30 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe73e06e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe7380cfb70 con 0x7fe7380b7230 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe736ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe7380b2a40 0x7fe7380d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49510/0 (socket says 172.21.15.80:49510) 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe736ffd640 1 -- 172.21.15.80:0/3684633078 learned_addr learned my addr 172.21.15.80:0/3684633078 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209401017 0 0) 0x7fe7380b9350 con 0x7fe7380b2a40 2024-04-25T15:45:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe720003520 con 0x7fe7380b2a40 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe737fff640 1 --2- 172.21.15.80:0/3684633078 >> v2:172.21.15.195:3300/0 conn(0x7fe7380b7230 0x7fe73809ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2218635262 0 0) 0x7fe720003520 con 0x7fe7380b2a40 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 >> v2:172.21.15.195:3300/0 conn(0x7fe7380b7230 msgr2=0x7fe73809ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 --2- 172.21.15.80:0/3684633078 >> v2:172.21.15.195:3300/0 conn(0x7fe7380b7230 0x7fe73809ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 >> v1:172.21.15.195:6789/0 conn(0x7fe7380cff30 legacy=0x7fe7380d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7380d2830 con 0x7fe7380b2a40 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe72c001670 con 0x7fe7380b2a40 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 >> v1:172.21.15.80:6789/0 conn(0x7fe7380b2a40 legacy=0x7fe7380d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7200039b0 0x7fe720003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe720004800 0x7fe720004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe720005270 0x7fe72000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe7380cfb70 con 0x7fe720004800 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe72000c200 con 0x7fe7200039b0 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.683+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe72000c400 con 0x7fe720005270 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe720004800 0x7fe720004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe7377fe640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7200039b0 0x7fe720003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe737fff640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe720005270 0x7fe72000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe736ffd640 1 -- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe720005270 msgr2=0x7fe72000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe720005270 0x7fe72000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe736ffd640 1 -- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7200039b0 msgr2=0x7fe720003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7200039b0 0x7fe720003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe736ffd640 1 -- 172.21.15.80:0/3684633078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe720003520 con 0x7fe720004800 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.684+0000 7fe737fff640 1 -- 172.21.15.80:0/3684633078 reap_dead start 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe720004800 0x7fe720004c10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe7380740f0 tx=0x7fe720005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82963e4e21523e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007d10 con 0x7fe720004800 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c005ad0 con 0x7fe720004800 2024-04-25T15:45:22.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe7367fc640 1 -- 172.21.15.80:0/3684633078 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007070 con 0x7fe720004800 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 -- 172.21.15.80:0/3684633078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe720004800 msgr2=0x7fe720004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe720004800 0x7fe720004c10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe7380740f0 tx=0x7fe720005830 comp rx=0 tx=0).stop 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 -- 172.21.15.80:0/3684633078 shutdown_connections 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3684633078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe720004800 0x7fe720004c10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 -- 172.21.15.80:0/3684633078 >> 172.21.15.80:0/3684633078 conn(0x7fe7380d0450 msgr2=0x7fe7380d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 -- 172.21.15.80:0/3684633078 shutdown_connections 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.685+0000 7fe73e06e640 1 -- 172.21.15.80:0/3684633078 wait complete. 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.687+0000 7fe73e06e640 1 Processor -- start 2024-04-25T15:45:22.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.687+0000 7fe73e06e640 1 -- start start 2024-04-25T15:45:22.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe720004800 0x7fe738152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 0x7fe7380b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73815b5d0 0x7fe7380b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe7380d10f0 con 0x7fe738160df0 2024-04-25T15:45:22.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe7380d0f70 con 0x7fe720004800 2024-04-25T15:45:22.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe73809ce90 con 0x7fe73815b5d0 2024-04-25T15:45:22.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 0x7fe7380b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 0x7fe7380b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60452/0 (socket says 172.21.15.80:60452) 2024-04-25T15:45:22.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 -- 172.21.15.80:0/3781736860 learned_addr learned my addr 172.21.15.80:0/3781736860 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:22.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe7377fe640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe720004800 0x7fe738152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe737fff640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73815b5d0 0x7fe7380b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 -- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73815b5d0 msgr2=0x7fe7380b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73815b5d0 0x7fe7380b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 -- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe720004800 msgr2=0x7fe738152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe720004800 0x7fe738152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 -- 172.21.15.80:0/3781736860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381605e0 con 0x7fe738160df0 2024-04-25T15:45:22.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe736ffd640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 0x7fe7380b3fc0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe72c001970 tx=0x7fe7380b9520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:22.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c03f020 con 0x7fe738160df0 2024-04-25T15:45:22.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c001470 con 0x7fe738160df0 2024-04-25T15:45:22.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7381608c0 con 0x7fe738160df0 2024-04-25T15:45:22.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0049e0 con 0x7fe738160df0 2024-04-25T15:45:22.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.689+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73809dc10 con 0x7fe738160df0 2024-04-25T15:45:22.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.691+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73806a100 con 0x7fe738160df0 2024-04-25T15:45:22.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.691+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe72c042020 con 0x7fe738160df0 2024-04-25T15:45:22.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.692+0000 7fe71ffff640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7240744e0 0x7fe7240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:22.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.692+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fe72c0b4a90 con 0x7fe738160df0 2024-04-25T15:45:22.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.692+0000 7fe7377fe640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7240744e0 0x7fe7240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:22.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.692+0000 7fe7377fe640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7240744e0 0x7fe7240769f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe728000c00 tx=0x7fe728009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:22.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.696+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe72c07ea40 con 0x7fe738160df0 2024-04-25T15:45:22.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.866+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe738161ff0 con 0x7fe7240744e0 2024-04-25T15:45:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.872+0000 7fe71ffff640 1 -- 172.21.15.80:0/3781736860 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249561 (secure 0 0 0) 0x7fe738161ff0 con 0x7fe7240744e0 2024-04-25T15:45:22.878 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:22.880 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:22.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7240744e0 msgr2=0x7fe7240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7240744e0 0x7fe7240769f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe728000c00 tx=0x7fe728009040 comp rx=0 tx=0).stop 2024-04-25T15:45:22.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 msgr2=0x7fe7380b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:22.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 0x7fe7380b3fc0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe72c001970 tx=0x7fe7380b9520 comp rx=0 tx=0).stop 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 shutdown_connections 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe7240744e0 0x7fe7240769f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73815b5d0 0x7fe7380b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe738160df0 0x7fe7380b3fc0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 --2- 172.21.15.80:0/3781736860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe720004800 0x7fe738152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 >> 172.21.15.80:0/3781736860 conn(0x7fe7380d0450 msgr2=0x7fe7380ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 shutdown_connections 2024-04-25T15:45:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:22.875+0000 7fe73e06e640 1 -- 172.21.15.80:0/3781736860 wait complete. 2024-04-25T15:45:22.888 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-04-25T15:45:21.026219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":118,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239728,"kb_used_data":6904,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734992,"statfs":{"total":773094113280,"available":772848631808,"internally_reserved":0,"allocated":7069696,"data_stored":3795913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599442"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470858+0000","last_change":"2024-04-25T15:45:18.463164+0000","last_active":"2024-04-25T15:45:18.470858+0000","last_peered":"2024-04-25T15:45:18.470858+0000","last_clean":"2024-04-25T15:45:18.470858+0000","last_became_active":"2024-04-25T15:45:18.462876+0000","last_became_peered":"2024-04-25T15:45:18.462876+0000","last_unstale":"2024-04-25T15:45:18.470858+0000","last_undegraded":"2024-04-25T15:45:18.470858+0000","last_fullsized":"2024-04-25T15:45:18.470858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.619090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473708+0000","last_change":"2024-04-25T15:45:18.471522+0000","last_active":"2024-04-25T15:45:18.473708+0000","last_peered":"2024-04-25T15:45:18.473708+0000","last_clean":"2024-04-25T15:45:18.473708+0000","last_became_active":"2024-04-25T15:45:18.471222+0000","last_became_peered":"2024-04-25T15:45:18.471222+0000","last_unstale":"2024-04-25T15:45:18.473708+0000","last_undegraded":"2024-04-25T15:45:18.473708+0000","last_fullsized":"2024-04-25T15:45:18.473708+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:07.083583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445527+0000","last_change":"2024-04-25T15:45:17.445527+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445527+0000","last_undegraded":"2024-04-25T15:45:17.445527+0000","last_fullsized":"2024-04-25T15:45:17.445527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457899+0000","last_change":"2024-04-25T15:45:18.456533+0000","last_active":"2024-04-25T15:45:18.457899+0000","last_peered":"2024-04-25T15:45:18.457899+0000","last_clean":"2024-04-25T15:45:18.457899+0000","last_became_active":"2024-04-25T15:45:18.456174+0000","last_became_peered":"2024-04-25T15:45:18.456174+0000","last_unstale":"2024-04-25T15:45:18.457899+0000","last_undegraded":"2024-04-25T15:45:18.457899+0000","last_fullsized":"2024-04-25T15:45:18.457899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:50.821828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.462989+0000","last_change":"2024-04-25T15:45:18.458070+0000","last_active":"2024-04-25T15:45:18.462989+0000","last_peered":"2024-04-25T15:45:18.462989+0000","last_clean":"2024-04-25T15:45:18.462989+0000","last_became_active":"2024-04-25T15:45:18.457484+0000","last_became_peered":"2024-04-25T15:45:18.457484+0000","last_unstale":"2024-04-25T15:45:18.462989+0000","last_undegraded":"2024-04-25T15:45:18.462989+0000","last_fullsized":"2024-04-25T15:45:18.462989+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:00.413348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467170+0000","last_change":"2024-04-25T15:45:18.456510+0000","last_active":"2024-04-25T15:45:18.467170+0000","last_peered":"2024-04-25T15:45:18.467170+0000","last_clean":"2024-04-25T15:45:18.467170+0000","last_became_active":"2024-04-25T15:45:18.456074+0000","last_became_peered":"2024-04-25T15:45:18.456074+0000","last_unstale":"2024-04-25T15:45:18.467170+0000","last_undegraded":"2024-04-25T15:45:18.467170+0000","last_fullsized":"2024-04-25T15:45:18.467170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:43.759488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445774+0000","last_change":"2024-04-25T15:45:17.445774+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445774+0000","last_undegraded":"2024-04-25T15:45:17.445774+0000","last_fullsized":"2024-04-25T15:45:17.445774+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436021+0000","last_change":"2024-04-25T15:45:17.436021+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436021+0000","last_undegraded":"2024-04-25T15:45:17.436021+0000","last_fullsized":"2024-04-25T15:45:17.436021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436489+0000","last_change":"2024-04-25T15:45:17.436489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436489+0000","last_undegraded":"2024-04-25T15:45:17.436489+0000","last_fullsized":"2024-04-25T15:45:17.436489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442162+0000","last_change":"2024-04-25T15:45:17.442162+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442162+0000","last_undegraded":"2024-04-25T15:45:17.442162+0000","last_fullsized":"2024-04-25T15:45:17.442162+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443910+0000","last_change":"2024-04-25T15:45:17.443910+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443910+0000","last_undegraded":"2024-04-25T15:45:17.443910+0000","last_fullsized":"2024-04-25T15:45:17.443910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.446326+0000","last_change":"2024-04-25T15:45:17.446326+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.446326+0000","last_undegraded":"2024-04-25T15:45:17.446326+0000","last_fullsized":"2024-04-25T15:45:17.446326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435716+0000","last_change":"2024-04-25T15:45:17.435716+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435716+0000","last_undegraded":"2024-04-25T15:45:17.435716+0000","last_fullsized":"2024-04-25T15:45:17.435716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436552+0000","last_change":"2024-04-25T15:45:17.436552+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436552+0000","last_undegraded":"2024-04-25T15:45:17.436552+0000","last_fullsized":"2024-04-25T15:45:17.436552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463682+0000","last_change":"2024-04-25T15:45:18.455213+0000","last_active":"2024-04-25T15:45:18.463682+0000","last_peered":"2024-04-25T15:45:18.463682+0000","last_clean":"2024-04-25T15:45:18.463682+0000","last_became_active":"2024-04-25T15:45:18.454775+0000","last_became_peered":"2024-04-25T15:45:18.454775+0000","last_unstale":"2024-04-25T15:45:18.463682+0000","last_undegraded":"2024-04-25T15:45:18.463682+0000","last_fullsized":"2024-04-25T15:45:18.463682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:24.128238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473633+0000","last_change":"2024-04-25T15:45:18.470969+0000","last_active":"2024-04-25T15:45:18.473633+0000","last_peered":"2024-04-25T15:45:18.473633+0000","last_clean":"2024-04-25T15:45:18.473633+0000","last_became_active":"2024-04-25T15:45:18.470257+0000","last_became_peered":"2024-04-25T15:45:18.470257+0000","last_unstale":"2024-04-25T15:45:18.473633+0000","last_undegraded":"2024-04-25T15:45:18.473633+0000","last_fullsized":"2024-04-25T15:45:18.473633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:42.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443489+0000","last_change":"2024-04-25T15:45:17.443489+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443489+0000","last_undegraded":"2024-04-25T15:45:17.443489+0000","last_fullsized":"2024-04-25T15:45:17.443489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455289+0000","last_change":"2024-04-25T15:45:18.454437+0000","last_active":"2024-04-25T15:45:18.455289+0000","last_peered":"2024-04-25T15:45:18.455289+0000","last_clean":"2024-04-25T15:45:18.455289+0000","last_became_active":"2024-04-25T15:45:18.454136+0000","last_became_peered":"2024-04-25T15:45:18.454136+0000","last_unstale":"2024-04-25T15:45:18.455289+0000","last_undegraded":"2024-04-25T15:45:18.455289+0000","last_fullsized":"2024-04-25T15:45:18.455289+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:29.265268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461927+0000","last_change":"2024-04-25T15:45:18.457308+0000","last_active":"2024-04-25T15:45:18.461927+0000","last_peered":"2024-04-25T15:45:18.461927+0000","last_clean":"2024-04-25T15:45:18.461927+0000","last_became_active":"2024-04-25T15:45:18.456857+0000","last_became_peered":"2024-04-25T15:45:18.456857+0000","last_unstale":"2024-04-25T15:45:18.461927+0000","last_undegraded":"2024-04-25T15:45:18.461927+0000","last_fullsized":"2024-04-25T15:45:18.461927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:53.453597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445841+0000","last_change":"2024-04-25T15:45:17.445841+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445841+0000","last_undegraded":"2024-04-25T15:45:17.445841+0000","last_fullsized":"2024-04-25T15:45:17.445841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470602+0000","last_change":"2024-04-25T15:45:18.467343+0000","last_active":"2024-04-25T15:45:18.470602+0000","last_peered":"2024-04-25T15:45:18.470602+0000","last_clean":"2024-04-25T15:45:18.470602+0000","last_became_active":"2024-04-25T15:45:18.467005+0000","last_became_peered":"2024-04-25T15:45:18.467005+0000","last_unstale":"2024-04-25T15:45:18.470602+0000","last_undegraded":"2024-04-25T15:45:18.470602+0000","last_fullsized":"2024-04-25T15:45:18.470602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:32.165550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468031+0000","last_change":"2024-04-25T15:45:18.466266+0000","last_active":"2024-04-25T15:45:18.468031+0000","last_peered":"2024-04-25T15:45:18.468031+0000","last_clean":"2024-04-25T15:45:18.468031+0000","last_became_active":"2024-04-25T15:45:18.465937+0000","last_became_peered":"2024-04-25T15:45:18.465937+0000","last_unstale":"2024-04-25T15:45:18.468031+0000","last_undegraded":"2024-04-25T15:45:18.468031+0000","last_fullsized":"2024-04-25T15:45:18.468031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:03.990617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435673+0000","last_change":"2024-04-25T15:45:17.435673+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435673+0000","last_undegraded":"2024-04-25T15:45:17.435673+0000","last_fullsized":"2024-04-25T15:45:17.435673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.445064+0000","last_change":"2024-04-25T15:45:17.445064+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.445064+0000","last_undegraded":"2024-04-25T15:45:17.445064+0000","last_fullsized":"2024-04-25T15:45:17.445064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443182+0000","last_change":"2024-04-25T15:45:17.443182+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443182+0000","last_undegraded":"2024-04-25T15:45:17.443182+0000","last_fullsized":"2024-04-25T15:45:17.443182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441639+0000","last_change":"2024-04-25T15:45:17.441639+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441639+0000","last_undegraded":"2024-04-25T15:45:17.441639+0000","last_fullsized":"2024-04-25T15:45:17.441639+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472508+0000","last_change":"2024-04-25T15:45:18.468839+0000","last_active":"2024-04-25T15:45:18.472508+0000","last_peered":"2024-04-25T15:45:18.472508+0000","last_clean":"2024-04-25T15:45:18.472508+0000","last_became_active":"2024-04-25T15:45:18.467727+0000","last_became_peered":"2024-04-25T15:45:18.467727+0000","last_unstale":"2024-04-25T15:45:18.472508+0000","last_undegraded":"2024-04-25T15:45:18.472508+0000","last_fullsized":"2024-04-25T15:45:18.472508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:23.502579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.435667+0000","last_change":"2024-04-25T15:45:17.435667+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.435667+0000","last_undegraded":"2024-04-25T15:45:17.435667+0000","last_fullsized":"2024-04-25T15:45:17.435667+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442604+0000","last_change":"2024-04-25T15:45:17.442604+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442604+0000","last_undegraded":"2024-04-25T15:45:17.442604+0000","last_fullsized":"2024-04-25T15:45:17.442604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.443084+0000","last_change":"2024-04-25T15:45:17.443084+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.443084+0000","last_undegraded":"2024-04-25T15:45:17.443084+0000","last_fullsized":"2024-04-25T15:45:17.443084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468155+0000","last_change":"2024-04-25T15:45:18.461593+0000","last_active":"2024-04-25T15:45:18.468155+0000","last_peered":"2024-04-25T15:45:18.468155+0000","last_clean":"2024-04-25T15:45:18.468155+0000","last_became_active":"2024-04-25T15:45:18.460991+0000","last_became_peered":"2024-04-25T15:45:18.460991+0000","last_unstale":"2024-04-25T15:45:18.468155+0000","last_undegraded":"2024-04-25T15:45:18.468155+0000","last_fullsized":"2024-04-25T15:45:18.468155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:14.574983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471531+0000","last_change":"2024-04-25T15:45:18.470892+0000","last_active":"2024-04-25T15:45:18.471531+0000","last_peered":"2024-04-25T15:45:18.471531+0000","last_clean":"2024-04-25T15:45:18.471531+0000","last_became_active":"2024-04-25T15:45:18.470554+0000","last_became_peered":"2024-04-25T15:45:18.470554+0000","last_unstale":"2024-04-25T15:45:18.471531+0000","last_undegraded":"2024-04-25T15:45:18.471531+0000","last_fullsized":"2024-04-25T15:45:18.471531+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:11.758823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470500+0000","last_change":"2024-04-25T15:45:17.450209+0000","last_active":"2024-04-25T15:45:18.470500+0000","last_peered":"2024-04-25T15:45:18.470500+0000","last_clean":"2024-04-25T15:45:18.470500+0000","last_became_active":"2024-04-25T15:45:17.449955+0000","last_became_peered":"2024-04-25T15:45:17.449955+0000","last_unstale":"2024-04-25T15:45:18.470500+0000","last_undegraded":"2024-04-25T15:45:18.470500+0000","last_fullsized":"2024-04-25T15:45:18.470500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:49.999228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441117+0000","last_change":"2024-04-25T15:45:17.441117+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441117+0000","last_undegraded":"2024-04-25T15:45:17.441117+0000","last_fullsized":"2024-04-25T15:45:17.441117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468359+0000","last_change":"2024-04-25T15:45:17.452008+0000","last_active":"2024-04-25T15:45:18.468359+0000","last_peered":"2024-04-25T15:45:18.468359+0000","last_clean":"2024-04-25T15:45:18.468359+0000","last_became_active":"2024-04-25T15:45:17.451635+0000","last_became_peered":"2024-04-25T15:45:17.451635+0000","last_unstale":"2024-04-25T15:45:18.468359+0000","last_undegraded":"2024-04-25T15:45:18.468359+0000","last_fullsized":"2024-04-25T15:45:18.468359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464096+0000","last_change":"2024-04-25T15:45:18.460858+0000","last_active":"2024-04-25T15:45:18.464096+0000","last_peered":"2024-04-25T15:45:18.464096+0000","last_clean":"2024-04-25T15:45:18.464096+0000","last_became_active":"2024-04-25T15:45:18.460430+0000","last_became_peered":"2024-04-25T15:45:18.460430+0000","last_unstale":"2024-04-25T15:45:18.464096+0000","last_undegraded":"2024-04-25T15:45:18.464096+0000","last_fullsized":"2024-04-25T15:45:18.464096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:09.832403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468632+0000","last_change":"2024-04-25T15:45:17.448435+0000","last_active":"2024-04-25T15:45:18.468632+0000","last_peered":"2024-04-25T15:45:18.468632+0000","last_clean":"2024-04-25T15:45:18.468632+0000","last_became_active":"2024-04-25T15:45:17.448082+0000","last_became_peered":"2024-04-25T15:45:17.448082+0000","last_unstale":"2024-04-25T15:45:18.468632+0000","last_undegraded":"2024-04-25T15:45:18.468632+0000","last_fullsized":"2024-04-25T15:45:18.468632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:44.683965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436744+0000","last_change":"2024-04-25T15:45:17.436744+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436744+0000","last_undegraded":"2024-04-25T15:45:17.436744+0000","last_fullsized":"2024-04-25T15:45:17.436744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472823+0000","last_change":"2024-04-25T15:45:17.441391+0000","last_active":"2024-04-25T15:45:18.472823+0000","last_peered":"2024-04-25T15:45:18.472823+0000","last_clean":"2024-04-25T15:45:18.472823+0000","last_became_active":"2024-04-25T15:45:17.441059+0000","last_became_peered":"2024-04-25T15:45:17.441059+0000","last_unstale":"2024-04-25T15:45:18.472823+0000","last_undegraded":"2024-04-25T15:45:18.472823+0000","last_fullsized":"2024-04-25T15:45:18.472823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.467444+0000","last_change":"2024-04-25T15:45:18.461108+0000","last_active":"2024-04-25T15:45:18.467444+0000","last_peered":"2024-04-25T15:45:18.467444+0000","last_clean":"2024-04-25T15:45:18.467444+0000","last_became_active":"2024-04-25T15:45:18.460693+0000","last_became_peered":"2024-04-25T15:45:18.460693+0000","last_unstale":"2024-04-25T15:45:18.467444+0000","last_undegraded":"2024-04-25T15:45:18.467444+0000","last_fullsized":"2024-04-25T15:45:18.467444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:27.044492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.469081+0000","last_change":"2024-04-25T15:45:17.453653+0000","last_active":"2024-04-25T15:45:18.469081+0000","last_peered":"2024-04-25T15:45:18.469081+0000","last_clean":"2024-04-25T15:45:18.469081+0000","last_became_active":"2024-04-25T15:45:17.453292+0000","last_became_peered":"2024-04-25T15:45:17.453292+0000","last_unstale":"2024-04-25T15:45:18.469081+0000","last_undegraded":"2024-04-25T15:45:18.469081+0000","last_fullsized":"2024-04-25T15:45:18.469081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:12.590842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472180+0000","last_change":"2024-04-25T15:45:18.469156+0000","last_active":"2024-04-25T15:45:18.472180+0000","last_peered":"2024-04-25T15:45:18.472180+0000","last_clean":"2024-04-25T15:45:18.472180+0000","last_became_active":"2024-04-25T15:45:18.468808+0000","last_became_peered":"2024-04-25T15:45:18.468808+0000","last_unstale":"2024-04-25T15:45:18.472180+0000","last_undegraded":"2024-04-25T15:45:18.472180+0000","last_fullsized":"2024-04-25T15:45:18.472180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:11.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473211+0000","last_change":"2024-04-25T15:45:17.448087+0000","last_active":"2024-04-25T15:45:18.473211+0000","last_peered":"2024-04-25T15:45:18.473211+0000","last_clean":"2024-04-25T15:45:18.473211+0000","last_became_active":"2024-04-25T15:45:17.447741+0000","last_became_peered":"2024-04-25T15:45:17.447741+0000","last_unstale":"2024-04-25T15:45:18.473211+0000","last_undegraded":"2024-04-25T15:45:18.473211+0000","last_fullsized":"2024-04-25T15:45:18.473211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:13.573046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.466578+0000","last_change":"2024-04-25T15:45:18.463919+0000","last_active":"2024-04-25T15:45:18.466578+0000","last_peered":"2024-04-25T15:45:18.466578+0000","last_clean":"2024-04-25T15:45:18.466578+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.466578+0000","last_undegraded":"2024-04-25T15:45:18.466578+0000","last_fullsized":"2024-04-25T15:45:18.466578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.704086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446311+0000","last_change":"2024-04-25T15:45:17.456424+0000","last_active":"2024-04-25T15:45:18.446311+0000","last_peered":"2024-04-25T15:45:18.446311+0000","last_clean":"2024-04-25T15:45:18.446311+0000","last_became_active":"2024-04-25T15:45:17.456094+0000","last_became_peered":"2024-04-25T15:45:17.456094+0000","last_unstale":"2024-04-25T15:45:18.446311+0000","last_undegraded":"2024-04-25T15:45:18.446311+0000","last_fullsized":"2024-04-25T15:45:18.446311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:59.411412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.453962+0000","last_change":"2024-04-25T15:45:18.450549+0000","last_active":"2024-04-25T15:45:18.453962+0000","last_peered":"2024-04-25T15:45:18.453962+0000","last_clean":"2024-04-25T15:45:18.453962+0000","last_became_active":"2024-04-25T15:45:18.450220+0000","last_became_peered":"2024-04-25T15:45:18.450220+0000","last_unstale":"2024-04-25T15:45:18.453962+0000","last_undegraded":"2024-04-25T15:45:18.453962+0000","last_fullsized":"2024-04-25T15:45:18.453962+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445943+0000","last_change":"2024-04-25T15:45:17.453235+0000","last_active":"2024-04-25T15:45:18.445943+0000","last_peered":"2024-04-25T15:45:18.445943+0000","last_clean":"2024-04-25T15:45:18.445943+0000","last_became_active":"2024-04-25T15:45:17.452866+0000","last_became_peered":"2024-04-25T15:45:17.452866+0000","last_unstale":"2024-04-25T15:45:18.445943+0000","last_undegraded":"2024-04-25T15:45:18.445943+0000","last_fullsized":"2024-04-25T15:45:18.445943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472543+0000","last_change":"2024-04-25T15:45:18.469147+0000","last_active":"2024-04-25T15:45:18.472543+0000","last_peered":"2024-04-25T15:45:18.472543+0000","last_clean":"2024-04-25T15:45:18.472543+0000","last_became_active":"2024-04-25T15:45:18.467937+0000","last_became_peered":"2024-04-25T15:45:18.467937+0000","last_unstale":"2024-04-25T15:45:18.472543+0000","last_undegraded":"2024-04-25T15:45:18.472543+0000","last_fullsized":"2024-04-25T15:45:18.472543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:24.631878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452522+0000","last_change":"2024-04-25T15:45:17.447439+0000","last_active":"2024-04-25T15:45:17.452522+0000","last_peered":"2024-04-25T15:45:17.452522+0000","last_clean":"2024-04-25T15:45:17.452522+0000","last_became_active":"2024-04-25T15:45:17.446486+0000","last_became_peered":"2024-04-25T15:45:17.446486+0000","last_unstale":"2024-04-25T15:45:17.452522+0000","last_undegraded":"2024-04-25T15:45:17.452522+0000","last_fullsized":"2024-04-25T15:45:17.452522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.461897+0000","last_change":"2024-04-25T15:45:18.456089+0000","last_active":"2024-04-25T15:45:18.461897+0000","last_peered":"2024-04-25T15:45:18.461897+0000","last_clean":"2024-04-25T15:45:18.461897+0000","last_became_active":"2024-04-25T15:45:18.455775+0000","last_became_peered":"2024-04-25T15:45:18.455775+0000","last_unstale":"2024-04-25T15:45:18.461897+0000","last_undegraded":"2024-04-25T15:45:18.461897+0000","last_fullsized":"2024-04-25T15:45:18.461897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451366+0000","last_change":"2024-04-25T15:45:17.447523+0000","last_active":"2024-04-25T15:45:17.451366+0000","last_peered":"2024-04-25T15:45:17.451366+0000","last_clean":"2024-04-25T15:45:17.451366+0000","last_became_active":"2024-04-25T15:45:17.447092+0000","last_became_peered":"2024-04-25T15:45:17.447092+0000","last_unstale":"2024-04-25T15:45:17.451366+0000","last_undegraded":"2024-04-25T15:45:17.451366+0000","last_fullsized":"2024-04-25T15:45:17.451366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:21.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460793+0000","last_change":"2024-04-25T15:45:18.458720+0000","last_active":"2024-04-25T15:45:18.460793+0000","last_peered":"2024-04-25T15:45:18.460793+0000","last_clean":"2024-04-25T15:45:18.460793+0000","last_became_active":"2024-04-25T15:45:18.458419+0000","last_became_peered":"2024-04-25T15:45:18.458419+0000","last_unstale":"2024-04-25T15:45:18.460793+0000","last_undegraded":"2024-04-25T15:45:18.460793+0000","last_fullsized":"2024-04-25T15:45:18.460793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:22.375221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452009+0000","last_change":"2024-04-25T15:45:17.445901+0000","last_active":"2024-04-25T15:45:17.452009+0000","last_peered":"2024-04-25T15:45:17.452009+0000","last_clean":"2024-04-25T15:45:17.452009+0000","last_became_active":"2024-04-25T15:45:17.445519+0000","last_became_peered":"2024-04-25T15:45:17.445519+0000","last_unstale":"2024-04-25T15:45:17.452009+0000","last_undegraded":"2024-04-25T15:45:17.452009+0000","last_fullsized":"2024-04-25T15:45:17.452009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440758+0000","last_change":"2024-04-25T15:45:17.440758+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440758+0000","last_undegraded":"2024-04-25T15:45:17.440758+0000","last_fullsized":"2024-04-25T15:45:17.440758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.476351+0000","last_change":"2024-04-25T15:45:17.452349+0000","last_active":"2024-04-25T15:45:18.476351+0000","last_peered":"2024-04-25T15:45:18.476351+0000","last_clean":"2024-04-25T15:45:18.476351+0000","last_became_active":"2024-04-25T15:45:17.452038+0000","last_became_peered":"2024-04-25T15:45:17.452038+0000","last_unstale":"2024-04-25T15:45:18.476351+0000","last_undegraded":"2024-04-25T15:45:18.476351+0000","last_fullsized":"2024-04-25T15:45:18.476351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:30.586243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442657+0000","last_change":"2024-04-25T15:45:17.442657+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442657+0000","last_undegraded":"2024-04-25T15:45:17.442657+0000","last_fullsized":"2024-04-25T15:45:17.442657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457374+0000","last_change":"2024-04-25T15:45:17.456603+0000","last_active":"2024-04-25T15:45:17.457374+0000","last_peered":"2024-04-25T15:45:17.457374+0000","last_clean":"2024-04-25T15:45:17.457374+0000","last_became_active":"2024-04-25T15:45:17.456120+0000","last_became_peered":"2024-04-25T15:45:17.456120+0000","last_unstale":"2024-04-25T15:45:17.457374+0000","last_undegraded":"2024-04-25T15:45:17.457374+0000","last_fullsized":"2024-04-25T15:45:17.457374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:27.077156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441982+0000","last_change":"2024-04-25T15:45:17.441982+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441982+0000","last_undegraded":"2024-04-25T15:45:17.441982+0000","last_fullsized":"2024-04-25T15:45:17.441982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456027+0000","last_change":"2024-04-25T15:45:17.454916+0000","last_active":"2024-04-25T15:45:17.456027+0000","last_peered":"2024-04-25T15:45:17.456027+0000","last_clean":"2024-04-25T15:45:17.456027+0000","last_became_active":"2024-04-25T15:45:17.454350+0000","last_became_peered":"2024-04-25T15:45:17.454350+0000","last_unstale":"2024-04-25T15:45:17.456027+0000","last_undegraded":"2024-04-25T15:45:17.456027+0000","last_fullsized":"2024-04-25T15:45:17.456027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:07.075623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455222+0000","last_change":"2024-04-25T15:45:18.448588+0000","last_active":"2024-04-25T15:45:18.455222+0000","last_peered":"2024-04-25T15:45:18.455222+0000","last_clean":"2024-04-25T15:45:18.455222+0000","last_became_active":"2024-04-25T15:45:18.448287+0000","last_became_peered":"2024-04-25T15:45:18.448287+0000","last_unstale":"2024-04-25T15:45:18.455222+0000","last_undegraded":"2024-04-25T15:45:18.455222+0000","last_fullsized":"2024-04-25T15:45:18.455222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:58.998394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452843+0000","last_change":"2024-04-25T15:45:17.450515+0000","last_active":"2024-04-25T15:45:17.452843+0000","last_peered":"2024-04-25T15:45:17.452843+0000","last_clean":"2024-04-25T15:45:17.452843+0000","last_became_active":"2024-04-25T15:45:17.450214+0000","last_became_peered":"2024-04-25T15:45:17.450214+0000","last_unstale":"2024-04-25T15:45:17.452843+0000","last_undegraded":"2024-04-25T15:45:17.452843+0000","last_fullsized":"2024-04-25T15:45:17.452843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:17.535639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470412+0000","last_change":"2024-04-25T15:45:18.465099+0000","last_active":"2024-04-25T15:45:18.470412+0000","last_peered":"2024-04-25T15:45:18.470412+0000","last_clean":"2024-04-25T15:45:18.470412+0000","last_became_active":"2024-04-25T15:45:18.464807+0000","last_became_peered":"2024-04-25T15:45:18.464807+0000","last_unstale":"2024-04-25T15:45:18.470412+0000","last_undegraded":"2024-04-25T15:45:18.470412+0000","last_fullsized":"2024-04-25T15:45:18.470412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:40.746835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457637+0000","last_change":"2024-04-25T15:45:17.453212+0000","last_active":"2024-04-25T15:45:17.457637+0000","last_peered":"2024-04-25T15:45:17.457637+0000","last_clean":"2024-04-25T15:45:17.457637+0000","last_became_active":"2024-04-25T15:45:17.452909+0000","last_became_peered":"2024-04-25T15:45:17.452909+0000","last_unstale":"2024-04-25T15:45:17.457637+0000","last_undegraded":"2024-04-25T15:45:17.457637+0000","last_fullsized":"2024-04-25T15:45:17.457637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.436140+0000","last_change":"2024-04-25T15:45:17.436140+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.436140+0000","last_undegraded":"2024-04-25T15:45:17.436140+0000","last_fullsized":"2024-04-25T15:45:17.436140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456095+0000","last_change":"2024-04-25T15:45:17.454462+0000","last_active":"2024-04-25T15:45:17.456095+0000","last_peered":"2024-04-25T15:45:17.456095+0000","last_clean":"2024-04-25T15:45:17.456095+0000","last_became_active":"2024-04-25T15:45:17.454123+0000","last_became_peered":"2024-04-25T15:45:17.454123+0000","last_unstale":"2024-04-25T15:45:17.456095+0000","last_undegraded":"2024-04-25T15:45:17.456095+0000","last_fullsized":"2024-04-25T15:45:17.456095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.468102+0000","last_change":"2024-04-25T15:45:18.466518+0000","last_active":"2024-04-25T15:45:18.468102+0000","last_peered":"2024-04-25T15:45:18.468102+0000","last_clean":"2024-04-25T15:45:18.468102+0000","last_became_active":"2024-04-25T15:45:18.466170+0000","last_became_peered":"2024-04-25T15:45:18.466170+0000","last_unstale":"2024-04-25T15:45:18.468102+0000","last_undegraded":"2024-04-25T15:45:18.468102+0000","last_fullsized":"2024-04-25T15:45:18.468102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:41.722999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.452610+0000","last_change":"2024-04-25T15:45:17.449615+0000","last_active":"2024-04-25T15:45:17.452610+0000","last_peered":"2024-04-25T15:45:17.452610+0000","last_clean":"2024-04-25T15:45:17.452610+0000","last_became_active":"2024-04-25T15:45:17.449164+0000","last_became_peered":"2024-04-25T15:45:17.449164+0000","last_unstale":"2024-04-25T15:45:17.452610+0000","last_undegraded":"2024-04-25T15:45:17.452610+0000","last_fullsized":"2024-04-25T15:45:17.452610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442115+0000","last_change":"2024-04-25T15:45:17.442115+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442115+0000","last_undegraded":"2024-04-25T15:45:17.442115+0000","last_fullsized":"2024-04-25T15:45:17.442115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.451982+0000","last_change":"2024-04-25T15:45:17.445560+0000","last_active":"2024-04-25T15:45:17.451982+0000","last_peered":"2024-04-25T15:45:17.451982+0000","last_clean":"2024-04-25T15:45:17.451982+0000","last_became_active":"2024-04-25T15:45:17.445197+0000","last_became_peered":"2024-04-25T15:45:17.445197+0000","last_unstale":"2024-04-25T15:45:17.451982+0000","last_undegraded":"2024-04-25T15:45:17.451982+0000","last_fullsized":"2024-04-25T15:45:17.451982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:10.694906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460732+0000","last_change":"2024-04-25T15:45:18.457807+0000","last_active":"2024-04-25T15:45:18.460732+0000","last_peered":"2024-04-25T15:45:18.460732+0000","last_clean":"2024-04-25T15:45:18.460732+0000","last_became_active":"2024-04-25T15:45:18.457452+0000","last_became_peered":"2024-04-25T15:45:18.457452+0000","last_unstale":"2024-04-25T15:45:18.460732+0000","last_undegraded":"2024-04-25T15:45:18.460732+0000","last_fullsized":"2024-04-25T15:45:18.460732+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:50.384952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444182+0000","last_change":"2024-04-25T15:45:17.452491+0000","last_active":"2024-04-25T15:45:18.444182+0000","last_peered":"2024-04-25T15:45:18.444182+0000","last_clean":"2024-04-25T15:45:18.444182+0000","last_became_active":"2024-04-25T15:45:17.452161+0000","last_became_peered":"2024-04-25T15:45:17.452161+0000","last_unstale":"2024-04-25T15:45:18.444182+0000","last_undegraded":"2024-04-25T15:45:18.444182+0000","last_fullsized":"2024-04-25T15:45:18.444182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.465589+0000","last_change":"2024-04-25T15:45:18.461064+0000","last_active":"2024-04-25T15:45:18.465589+0000","last_peered":"2024-04-25T15:45:18.465589+0000","last_clean":"2024-04-25T15:45:18.465589+0000","last_became_active":"2024-04-25T15:45:18.460573+0000","last_became_peered":"2024-04-25T15:45:18.460573+0000","last_unstale":"2024-04-25T15:45:18.465589+0000","last_undegraded":"2024-04-25T15:45:18.465589+0000","last_fullsized":"2024-04-25T15:45:18.465589+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:13.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.471554+0000","last_change":"2024-04-25T15:45:17.455994+0000","last_active":"2024-04-25T15:45:18.471554+0000","last_peered":"2024-04-25T15:45:18.471554+0000","last_clean":"2024-04-25T15:45:18.471554+0000","last_became_active":"2024-04-25T15:45:17.455639+0000","last_became_peered":"2024-04-25T15:45:17.455639+0000","last_unstale":"2024-04-25T15:45:18.471554+0000","last_undegraded":"2024-04-25T15:45:18.471554+0000","last_fullsized":"2024-04-25T15:45:18.471554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:33.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.440665+0000","last_change":"2024-04-25T15:45:17.440665+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.440665+0000","last_undegraded":"2024-04-25T15:45:17.440665+0000","last_fullsized":"2024-04-25T15:45:17.440665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.457294+0000","last_change":"2024-04-25T15:45:17.455522+0000","last_active":"2024-04-25T15:45:17.457294+0000","last_peered":"2024-04-25T15:45:17.457294+0000","last_clean":"2024-04-25T15:45:17.457294+0000","last_became_active":"2024-04-25T15:45:17.455177+0000","last_became_peered":"2024-04-25T15:45:17.455177+0000","last_unstale":"2024-04-25T15:45:17.457294+0000","last_undegraded":"2024-04-25T15:45:17.457294+0000","last_fullsized":"2024-04-25T15:45:17.457294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:41.669366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.455252+0000","last_change":"2024-04-25T15:45:18.452851+0000","last_active":"2024-04-25T15:45:18.455252+0000","last_peered":"2024-04-25T15:45:18.455252+0000","last_clean":"2024-04-25T15:45:18.455252+0000","last_became_active":"2024-04-25T15:45:18.452522+0000","last_became_peered":"2024-04-25T15:45:18.452522+0000","last_unstale":"2024-04-25T15:45:18.455252+0000","last_undegraded":"2024-04-25T15:45:18.455252+0000","last_fullsized":"2024-04-25T15:45:18.455252+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:48:00.624839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444427+0000","last_change":"2024-04-25T15:45:17.451838+0000","last_active":"2024-04-25T15:45:18.444427+0000","last_peered":"2024-04-25T15:45:18.444427+0000","last_clean":"2024-04-25T15:45:18.444427+0000","last_became_active":"2024-04-25T15:45:17.451595+0000","last_became_peered":"2024-04-25T15:45:17.451595+0000","last_unstale":"2024-04-25T15:45:18.444427+0000","last_undegraded":"2024-04-25T15:45:18.444427+0000","last_fullsized":"2024-04-25T15:45:18.444427+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:52.673909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.473430+0000","last_change":"2024-04-25T15:45:18.469369+0000","last_active":"2024-04-25T15:45:18.473430+0000","last_peered":"2024-04-25T15:45:18.473430+0000","last_clean":"2024-04-25T15:45:18.473430+0000","last_became_active":"2024-04-25T15:45:18.469065+0000","last_became_peered":"2024-04-25T15:45:18.469065+0000","last_unstale":"2024-04-25T15:45:18.473430+0000","last_undegraded":"2024-04-25T15:45:18.473430+0000","last_fullsized":"2024-04-25T15:45:18.473430+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:47.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.454564+0000","last_change":"2024-04-25T15:45:17.452964+0000","last_active":"2024-04-25T15:45:17.454564+0000","last_peered":"2024-04-25T15:45:17.454564+0000","last_clean":"2024-04-25T15:45:17.454564+0000","last_became_active":"2024-04-25T15:45:17.452625+0000","last_became_peered":"2024-04-25T15:45:17.452625+0000","last_unstale":"2024-04-25T15:45:17.454564+0000","last_undegraded":"2024-04-25T15:45:17.454564+0000","last_fullsized":"2024-04-25T15:45:17.454564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:23.629942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.470472+0000","last_change":"2024-04-25T15:45:18.464662+0000","last_active":"2024-04-25T15:45:18.470472+0000","last_peered":"2024-04-25T15:45:18.470472+0000","last_clean":"2024-04-25T15:45:18.470472+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:18.470472+0000","last_undegraded":"2024-04-25T15:45:18.470472+0000","last_fullsized":"2024-04-25T15:45:18.470472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:26.585201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.449816+0000","last_change":"2024-04-25T15:45:17.447299+0000","last_active":"2024-04-25T15:45:17.449816+0000","last_peered":"2024-04-25T15:45:17.449816+0000","last_clean":"2024-04-25T15:45:17.449816+0000","last_became_active":"2024-04-25T15:45:17.446963+0000","last_became_peered":"2024-04-25T15:45:17.446963+0000","last_unstale":"2024-04-25T15:45:17.449816+0000","last_undegraded":"2024-04-25T15:45:17.449816+0000","last_fullsized":"2024-04-25T15:45:17.449816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:22.500642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.441575+0000","last_change":"2024-04-25T15:45:17.441575+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.441575+0000","last_undegraded":"2024-04-25T15:45:17.441575+0000","last_fullsized":"2024-04-25T15:45:17.441575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.445751+0000","last_change":"2024-04-25T15:45:17.447746+0000","last_active":"2024-04-25T15:45:18.445751+0000","last_peered":"2024-04-25T15:45:18.445751+0000","last_clean":"2024-04-25T15:45:18.445751+0000","last_became_active":"2024-04-25T15:45:17.447403+0000","last_became_peered":"2024-04-25T15:45:17.447403+0000","last_unstale":"2024-04-25T15:45:18.445751+0000","last_undegraded":"2024-04-25T15:45:18.445751+0000","last_fullsized":"2024-04-25T15:45:18.445751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:51.951450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.457990+0000","last_change":"2024-04-25T15:45:18.450798+0000","last_active":"2024-04-25T15:45:18.457990+0000","last_peered":"2024-04-25T15:45:18.457990+0000","last_clean":"2024-04-25T15:45:18.457990+0000","last_became_active":"2024-04-25T15:45:18.450505+0000","last_became_peered":"2024-04-25T15:45:18.450505+0000","last_unstale":"2024-04-25T15:45:18.457990+0000","last_undegraded":"2024-04-25T15:45:18.457990+0000","last_fullsized":"2024-04-25T15:45:18.457990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:13.598541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.460359+0000","last_change":"2024-04-25T15:45:17.449484+0000","last_active":"2024-04-25T15:45:18.460359+0000","last_peered":"2024-04-25T15:45:18.460359+0000","last_clean":"2024-04-25T15:45:18.460359+0000","last_became_active":"2024-04-25T15:45:17.449246+0000","last_became_peered":"2024-04-25T15:45:17.449246+0000","last_unstale":"2024-04-25T15:45:18.460359+0000","last_undegraded":"2024-04-25T15:45:18.460359+0000","last_fullsized":"2024-04-25T15:45:18.460359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:53.969769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.463870+0000","last_change":"2024-04-25T15:45:18.461789+0000","last_active":"2024-04-25T15:45:18.463870+0000","last_peered":"2024-04-25T15:45:18.463870+0000","last_clean":"2024-04-25T15:45:18.463870+0000","last_became_active":"2024-04-25T15:45:18.461037+0000","last_became_peered":"2024-04-25T15:45:18.461037+0000","last_unstale":"2024-04-25T15:45:18.463870+0000","last_undegraded":"2024-04-25T15:45:18.463870+0000","last_fullsized":"2024-04-25T15:45:18.463870+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:29.775814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.456766+0000","last_change":"2024-04-25T15:45:17.454679+0000","last_active":"2024-04-25T15:45:17.456766+0000","last_peered":"2024-04-25T15:45:17.456766+0000","last_clean":"2024-04-25T15:45:17.456766+0000","last_became_active":"2024-04-25T15:45:17.454369+0000","last_became_peered":"2024-04-25T15:45:17.454369+0000","last_unstale":"2024-04-25T15:45:17.456766+0000","last_undegraded":"2024-04-25T15:45:17.456766+0000","last_fullsized":"2024-04-25T15:45:17.456766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:34.081224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-04-25T15:45:17.442596+0000","last_change":"2024-04-25T15:45:17.442596+0000","last_active":"2024-04-25T15:45:17.426545+0000","last_peered":"2024-04-25T15:45:17.426545+0000","last_clean":"2024-04-25T15:45:17.426545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:17.442596+0000","last_undegraded":"2024-04-25T15:45:17.442596+0000","last_fullsized":"2024-04-25T15:45:17.442596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.447410+0000","last_change":"2024-04-25T15:45:17.454527+0000","last_active":"2024-04-25T15:45:18.447410+0000","last_peered":"2024-04-25T15:45:18.447410+0000","last_clean":"2024-04-25T15:45:18.447410+0000","last_became_active":"2024-04-25T15:45:17.454188+0000","last_became_peered":"2024-04-25T15:45:17.454188+0000","last_unstale":"2024-04-25T15:45:18.447410+0000","last_undegraded":"2024-04-25T15:45:18.447410+0000","last_fullsized":"2024-04-25T15:45:18.447410+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:46.375607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.472254+0000","last_change":"2024-04-25T15:45:18.469752+0000","last_active":"2024-04-25T15:45:18.472254+0000","last_peered":"2024-04-25T15:45:18.472254+0000","last_clean":"2024-04-25T15:45:18.472254+0000","last_became_active":"2024-04-25T15:45:18.469384+0000","last_became_peered":"2024-04-25T15:45:18.469384+0000","last_unstale":"2024-04-25T15:45:18.472254+0000","last_undegraded":"2024-04-25T15:45:18.472254+0000","last_fullsized":"2024-04-25T15:45:18.472254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.446507+0000","last_change":"2024-04-25T15:45:17.455624+0000","last_active":"2024-04-25T15:45:18.446507+0000","last_peered":"2024-04-25T15:45:18.446507+0000","last_clean":"2024-04-25T15:45:18.446507+0000","last_became_active":"2024-04-25T15:45:17.455302+0000","last_became_peered":"2024-04-25T15:45:17.455302+0000","last_unstale":"2024-04-25T15:45:18.446507+0000","last_undegraded":"2024-04-25T15:45:18.446507+0000","last_fullsized":"2024-04-25T15:45:18.446507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:08.830467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.452996+0000","last_change":"2024-04-25T15:45:18.448618+0000","last_active":"2024-04-25T15:45:18.452996+0000","last_peered":"2024-04-25T15:45:18.452996+0000","last_clean":"2024-04-25T15:45:18.452996+0000","last_became_active":"2024-04-25T15:45:18.448310+0000","last_became_peered":"2024-04-25T15:45:18.448310+0000","last_unstale":"2024-04-25T15:45:18.452996+0000","last_undegraded":"2024-04-25T15:45:18.452996+0000","last_fullsized":"2024-04-25T15:45:18.452996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:56.668886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.454165+0000","last_change":"2024-04-25T15:45:17.455162+0000","last_active":"2024-04-25T15:45:18.454165+0000","last_peered":"2024-04-25T15:45:18.454165+0000","last_clean":"2024-04-25T15:45:18.454165+0000","last_became_active":"2024-04-25T15:45:17.454854+0000","last_became_peered":"2024-04-25T15:45:17.454854+0000","last_unstale":"2024-04-25T15:45:18.454165+0000","last_undegraded":"2024-04-25T15:45:18.454165+0000","last_fullsized":"2024-04-25T15:45:18.454165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:27.636826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.464149+0000","last_change":"2024-04-25T15:45:18.460579+0000","last_active":"2024-04-25T15:45:18.464149+0000","last_peered":"2024-04-25T15:45:18.464149+0000","last_clean":"2024-04-25T15:45:18.464149+0000","last_became_active":"2024-04-25T15:45:18.460230+0000","last_became_peered":"2024-04-25T15:45:18.460230+0000","last_unstale":"2024-04-25T15:45:18.464149+0000","last_undegraded":"2024-04-25T15:45:18.464149+0000","last_fullsized":"2024-04-25T15:45:18.464149+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:41.921359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T15:45:18.444080+0000","last_change":"2024-04-25T15:45:17.453686+0000","last_active":"2024-04-25T15:45:18.444080+0000","last_peered":"2024-04-25T15:45:18.444080+0000","last_clean":"2024-04-25T15:45:18.444080+0000","last_became_active":"2024-04-25T15:45:17.453361+0000","last_became_peered":"2024-04-25T15:45:17.453361+0000","last_unstale":"2024-04-25T15:45:18.444080+0000","last_undegraded":"2024-04-25T15:45:18.444080+0000","last_fullsized":"2024-04-25T15:45:18.444080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T15:45:17.437098+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:17.437098+0000","last_peered":"2024-04-25T15:45:17.437098+0000","last_clean":"2024-04-25T15:45:17.437098+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:17.437098+0000","last_undegraded":"2024-04-25T15:45:17.437098+0000","last_fullsized":"2024-04-25T15:45:17.437098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":333071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":333037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1339392,"data_stored":923405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":909579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":319211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":325870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:24.103 INFO:tasks.ceph.mds.a.smithi080.stderr:2024-04-25T15:45:24.103+0000 7faba3596640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:45:25.894 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.014+0000 7ff312bc7640 1 Processor -- start 2024-04-25T15:45:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.014+0000 7ff312bc7640 1 -- start start 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff312bc7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff30c160200 0x7ff30c0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff312bc7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c071df0 con 0x7ff30c0cfc40 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff312bc7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c0b6eb0 con 0x7ff30c0719e0 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff312bc7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c160610 con 0x7ff30c160200 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff30bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff30c160200 0x7ff30c0714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff310963640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff30c0cfc40 0x7ff30c164690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58878/0 (socket says 172.21.15.80:58878) 2024-04-25T15:45:26.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff310963640 1 -- 172.21.15.80:0/2462538377 learned_addr learned my addr 172.21.15.80:0/2462538377 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff30bfff640 1 -- 172.21.15.80:0/2462538377 >> v1:172.21.15.195:6789/0 conn(0x7ff30c0719e0 legacy=0x7ff30c0b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff30bfff640 1 -- 172.21.15.80:0/2462538377 >> v1:172.21.15.80:6789/0 conn(0x7ff30c0cfc40 legacy=0x7ff30c164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff30bfff640 1 -- 172.21.15.80:0/2462538377 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c0b7150 con 0x7ff30c160200 2024-04-25T15:45:26.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.016+0000 7ff30b7fe640 1 -- 172.21.15.80:0/2462538377 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940542891 0 0) 0x7ff2fc001110 con 0x7ff30c0cfc40 2024-04-25T15:45:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.017+0000 7ff30bfff640 1 --2- 172.21.15.80:0/2462538377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0714a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff3000097a0 tx=0x7ff30002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4532634d496268d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.017+0000 7ff30b7fe640 1 -- 172.21.15.80:0/2462538377 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300037070 con 0x7ff30c160200 2024-04-25T15:45:26.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.017+0000 7ff30b7fe640 1 -- 172.21.15.80:0/2462538377 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff30002ae50 con 0x7ff30c160200 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.017+0000 7ff30b7fe640 1 -- 172.21.15.80:0/2462538377 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300032660 con 0x7ff30c160200 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 -- 172.21.15.80:0/2462538377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 msgr2=0x7ff30c0714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 --2- 172.21.15.80:0/2462538377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0714a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff3000097a0 tx=0x7ff30002a140 comp rx=0 tx=0).stop 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 -- 172.21.15.80:0/2462538377 shutdown_connections 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 --2- 172.21.15.80:0/2462538377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0714a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 -- 172.21.15.80:0/2462538377 >> 172.21.15.80:0/2462538377 conn(0x7ff30c0d2080 msgr2=0x7ff30c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 -- 172.21.15.80:0/2462538377 shutdown_connections 2024-04-25T15:45:26.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.018+0000 7ff312bc7640 1 -- 172.21.15.80:0/2462538377 wait complete. 2024-04-25T15:45:26.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.019+0000 7ff312bc7640 1 Processor -- start 2024-04-25T15:45:26.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.020+0000 7ff312bc7640 1 -- start start 2024-04-25T15:45:26.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff312bc7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff30c0719e0 0x7ff30c149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff312bc7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff30c0cfc40 0x7ff30c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff312bc7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff312bc7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0b7430 con 0x7ff30c160200 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff312bc7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0b54c0 con 0x7ff30c0719e0 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff312bc7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c072040 con 0x7ff30c0cfc40 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37574/0 (socket says 172.21.15.80:37574) 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 -- 172.21.15.80:0/557290387 learned_addr learned my addr 172.21.15.80:0/557290387 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff30bfff640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff30c0cfc40 0x7ff30c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff310963640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff30c0719e0 0x7ff30c149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 -- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff30c0cfc40 msgr2=0x7ff30c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff30c0cfc40 0x7ff30c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 -- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff30c0719e0 msgr2=0x7ff30c149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff30c0719e0 0x7ff30c149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.021+0000 7ff311164640 1 -- 172.21.15.80:0/557290387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c1620d0 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.022+0000 7ff311164640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0cbb90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff30400be60 tx=0x7ff30400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.022+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304019070 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.022+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff304014440 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.022+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c0cc440 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.022+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304014870 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.022+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c0cca00 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.023+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c06d5d0 con 0x7ff30c160200 2024-04-25T15:45:26.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.024+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff30401c070 con 0x7ff30c160200 2024-04-25T15:45:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.024+0000 7ff3097fa640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff2f80744b0 0x7ff2f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.024+0000 7ff310963640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff2f80744b0 0x7ff2f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.024+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7ff304095340 con 0x7ff30c160200 2024-04-25T15:45:26.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.025+0000 7ff310963640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff2f80744b0 0x7ff2f80769c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc000f60 tx=0x7ff2fc007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.029+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff30c06d5d0 con 0x7ff30c160200 2024-04-25T15:45:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.201+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff30c072570 con 0x7ff2f80744b0 2024-04-25T15:45:26.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.207+0000 7ff3097fa640 1 -- 172.21.15.80:0/557290387 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251961 (secure 0 0 0) 0x7ff30c072570 con 0x7ff2f80744b0 2024-04-25T15:45:26.210 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff2f80744b0 msgr2=0x7ff2f80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff2f80744b0 0x7ff2f80769c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc000f60 tx=0x7ff2fc007c00 comp rx=0 tx=0).stop 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 msgr2=0x7ff30c0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0cbb90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff30400be60 tx=0x7ff30400bf50 comp rx=0 tx=0).stop 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 shutdown_connections 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff2f80744b0 0x7ff2f80769c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff30c160200 0x7ff30c0cbb90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff30c0cfc40 0x7ff30c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 --2- 172.21.15.80:0/557290387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff30c0719e0 0x7ff30c149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 >> 172.21.15.80:0/557290387 conn(0x7ff30c0d2080 msgr2=0x7ff30c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:26.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 shutdown_connections 2024-04-25T15:45:26.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.210+0000 7ff312bc7640 1 -- 172.21.15.80:0/557290387 wait complete. 2024-04-25T15:45:26.222 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-04-25T15:45:25.027015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239952,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734768,"statfs":{"total":773094113280,"available":772848402432,"internally_reserved":0,"allocated":7315456,"data_stored":3903388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.593660"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179535+0000","last_change":"2024-04-25T15:45:18.463164+0000","last_active":"2024-04-25T15:45:20.179535+0000","last_peered":"2024-04-25T15:45:20.179535+0000","last_clean":"2024-04-25T15:45:20.179535+0000","last_became_active":"2024-04-25T15:45:18.462876+0000","last_became_peered":"2024-04-25T15:45:18.462876+0000","last_unstale":"2024-04-25T15:45:20.179535+0000","last_undegraded":"2024-04-25T15:45:20.179535+0000","last_fullsized":"2024-04-25T15:45:20.179535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:55.316617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179616+0000","last_change":"2024-04-25T15:45:18.471522+0000","last_active":"2024-04-25T15:45:20.179616+0000","last_peered":"2024-04-25T15:45:20.179616+0000","last_clean":"2024-04-25T15:45:20.179616+0000","last_became_active":"2024-04-25T15:45:18.471222+0000","last_became_peered":"2024-04-25T15:45:18.471222+0000","last_unstale":"2024-04-25T15:45:20.179616+0000","last_undegraded":"2024-04-25T15:45:20.179616+0000","last_fullsized":"2024-04-25T15:45:20.179616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:40.261619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440635+0000","last_change":"2024-04-25T15:45:18.460556+0000","last_active":"2024-04-25T15:45:19.440635+0000","last_peered":"2024-04-25T15:45:19.440635+0000","last_clean":"2024-04-25T15:45:19.440635+0000","last_became_active":"2024-04-25T15:45:18.460099+0000","last_became_peered":"2024-04-25T15:45:18.460099+0000","last_unstale":"2024-04-25T15:45:19.440635+0000","last_undegraded":"2024-04-25T15:45:19.440635+0000","last_fullsized":"2024-04-25T15:45:19.440635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:13.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178346+0000","last_change":"2024-04-25T15:45:18.452196+0000","last_active":"2024-04-25T15:45:20.178346+0000","last_peered":"2024-04-25T15:45:20.178346+0000","last_clean":"2024-04-25T15:45:20.178346+0000","last_became_active":"2024-04-25T15:45:18.451833+0000","last_became_peered":"2024-04-25T15:45:18.451833+0000","last_unstale":"2024-04-25T15:45:20.178346+0000","last_undegraded":"2024-04-25T15:45:20.178346+0000","last_fullsized":"2024-04-25T15:45:20.178346+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:54.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440268+0000","last_change":"2024-04-25T15:45:18.456533+0000","last_active":"2024-04-25T15:45:19.440268+0000","last_peered":"2024-04-25T15:45:19.440268+0000","last_clean":"2024-04-25T15:45:19.440268+0000","last_became_active":"2024-04-25T15:45:18.456174+0000","last_became_peered":"2024-04-25T15:45:18.456174+0000","last_unstale":"2024-04-25T15:45:19.440268+0000","last_undegraded":"2024-04-25T15:45:19.440268+0000","last_fullsized":"2024-04-25T15:45:19.440268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:11.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179206+0000","last_change":"2024-04-25T15:45:18.458070+0000","last_active":"2024-04-25T15:45:20.179206+0000","last_peered":"2024-04-25T15:45:20.179206+0000","last_clean":"2024-04-25T15:45:20.179206+0000","last_became_active":"2024-04-25T15:45:18.457484+0000","last_became_peered":"2024-04-25T15:45:18.457484+0000","last_unstale":"2024-04-25T15:45:20.179206+0000","last_undegraded":"2024-04-25T15:45:20.179206+0000","last_fullsized":"2024-04-25T15:45:20.179206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:53.453597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178687+0000","last_change":"2024-04-25T15:45:18.456510+0000","last_active":"2024-04-25T15:45:20.178687+0000","last_peered":"2024-04-25T15:45:20.178687+0000","last_clean":"2024-04-25T15:45:20.178687+0000","last_became_active":"2024-04-25T15:45:18.456074+0000","last_became_peered":"2024-04-25T15:45:18.456074+0000","last_unstale":"2024-04-25T15:45:20.178687+0000","last_undegraded":"2024-04-25T15:45:20.178687+0000","last_fullsized":"2024-04-25T15:45:20.178687+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:45.957439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438345+0000","last_change":"2024-04-25T15:45:18.446657+0000","last_active":"2024-04-25T15:45:19.438345+0000","last_peered":"2024-04-25T15:45:19.438345+0000","last_clean":"2024-04-25T15:45:19.438345+0000","last_became_active":"2024-04-25T15:45:18.445678+0000","last_became_peered":"2024-04-25T15:45:18.445678+0000","last_unstale":"2024-04-25T15:45:19.438345+0000","last_undegraded":"2024-04-25T15:45:19.438345+0000","last_fullsized":"2024-04-25T15:45:19.438345+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:52.953386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.441320+0000","last_change":"2024-04-25T15:45:18.449358+0000","last_active":"2024-04-25T15:45:19.441320+0000","last_peered":"2024-04-25T15:45:19.441320+0000","last_clean":"2024-04-25T15:45:19.441320+0000","last_became_active":"2024-04-25T15:45:18.449043+0000","last_became_peered":"2024-04-25T15:45:18.449043+0000","last_unstale":"2024-04-25T15:45:19.441320+0000","last_undegraded":"2024-04-25T15:45:19.441320+0000","last_fullsized":"2024-04-25T15:45:19.441320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:03.990617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440803+0000","last_change":"2024-04-25T15:45:18.462777+0000","last_active":"2024-04-25T15:45:19.440803+0000","last_peered":"2024-04-25T15:45:19.440803+0000","last_clean":"2024-04-25T15:45:19.440803+0000","last_became_active":"2024-04-25T15:45:18.462454+0000","last_became_peered":"2024-04-25T15:45:18.462454+0000","last_unstale":"2024-04-25T15:45:19.440803+0000","last_undegraded":"2024-04-25T15:45:19.440803+0000","last_fullsized":"2024-04-25T15:45:19.440803+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178357+0000","last_change":"2024-04-25T15:45:18.470297+0000","last_active":"2024-04-25T15:45:20.178357+0000","last_peered":"2024-04-25T15:45:20.178357+0000","last_clean":"2024-04-25T15:45:20.178357+0000","last_became_active":"2024-04-25T15:45:18.469978+0000","last_became_peered":"2024-04-25T15:45:18.469978+0000","last_unstale":"2024-04-25T15:45:20.178357+0000","last_undegraded":"2024-04-25T15:45:20.178357+0000","last_fullsized":"2024-04-25T15:45:20.178357+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.619090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439256+0000","last_change":"2024-04-25T15:45:18.453938+0000","last_active":"2024-04-25T15:45:19.439256+0000","last_peered":"2024-04-25T15:45:19.439256+0000","last_clean":"2024-04-25T15:45:19.439256+0000","last_became_active":"2024-04-25T15:45:18.453638+0000","last_became_peered":"2024-04-25T15:45:18.453638+0000","last_unstale":"2024-04-25T15:45:19.439256+0000","last_undegraded":"2024-04-25T15:45:19.439256+0000","last_fullsized":"2024-04-25T15:45:19.439256+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:14.574983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438847+0000","last_change":"2024-04-25T15:45:18.459080+0000","last_active":"2024-04-25T15:45:19.438847+0000","last_peered":"2024-04-25T15:45:19.438847+0000","last_clean":"2024-04-25T15:45:19.438847+0000","last_became_active":"2024-04-25T15:45:18.458732+0000","last_became_peered":"2024-04-25T15:45:18.458732+0000","last_unstale":"2024-04-25T15:45:19.438847+0000","last_undegraded":"2024-04-25T15:45:19.438847+0000","last_fullsized":"2024-04-25T15:45:19.438847+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:09.832403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.441355+0000","last_change":"2024-04-25T15:45:18.450564+0000","last_active":"2024-04-25T15:45:19.441355+0000","last_peered":"2024-04-25T15:45:19.441355+0000","last_clean":"2024-04-25T15:45:19.441355+0000","last_became_active":"2024-04-25T15:45:18.450259+0000","last_became_peered":"2024-04-25T15:45:18.450259+0000","last_unstale":"2024-04-25T15:45:19.441355+0000","last_undegraded":"2024-04-25T15:45:19.441355+0000","last_fullsized":"2024-04-25T15:45:19.441355+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:32.165550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440822+0000","last_change":"2024-04-25T15:45:18.463282+0000","last_active":"2024-04-25T15:45:19.440822+0000","last_peered":"2024-04-25T15:45:19.440822+0000","last_clean":"2024-04-25T15:45:19.440822+0000","last_became_active":"2024-04-25T15:45:18.462958+0000","last_became_peered":"2024-04-25T15:45:18.462958+0000","last_unstale":"2024-04-25T15:45:19.440822+0000","last_undegraded":"2024-04-25T15:45:19.440822+0000","last_fullsized":"2024-04-25T15:45:19.440822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:14.574983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178871+0000","last_change":"2024-04-25T15:45:18.455213+0000","last_active":"2024-04-25T15:45:20.178871+0000","last_peered":"2024-04-25T15:45:20.178871+0000","last_clean":"2024-04-25T15:45:20.178871+0000","last_became_active":"2024-04-25T15:45:18.454775+0000","last_became_peered":"2024-04-25T15:45:18.454775+0000","last_unstale":"2024-04-25T15:45:20.178871+0000","last_undegraded":"2024-04-25T15:45:20.178871+0000","last_fullsized":"2024-04-25T15:45:20.178871+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:41.439353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179716+0000","last_change":"2024-04-25T15:45:18.470969+0000","last_active":"2024-04-25T15:45:20.179716+0000","last_peered":"2024-04-25T15:45:20.179716+0000","last_clean":"2024-04-25T15:45:20.179716+0000","last_became_active":"2024-04-25T15:45:18.470257+0000","last_became_peered":"2024-04-25T15:45:18.470257+0000","last_unstale":"2024-04-25T15:45:20.179716+0000","last_undegraded":"2024-04-25T15:45:20.179716+0000","last_fullsized":"2024-04-25T15:45:20.179716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:36.888466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178422+0000","last_change":"2024-04-25T15:45:18.452044+0000","last_active":"2024-04-25T15:45:20.178422+0000","last_peered":"2024-04-25T15:45:20.178422+0000","last_clean":"2024-04-25T15:45:20.178422+0000","last_became_active":"2024-04-25T15:45:18.451734+0000","last_became_peered":"2024-04-25T15:45:18.451734+0000","last_unstale":"2024-04-25T15:45:20.178422+0000","last_undegraded":"2024-04-25T15:45:20.178422+0000","last_fullsized":"2024-04-25T15:45:20.178422+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:40.746835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440204+0000","last_change":"2024-04-25T15:45:18.454437+0000","last_active":"2024-04-25T15:45:19.440204+0000","last_peered":"2024-04-25T15:45:19.440204+0000","last_clean":"2024-04-25T15:45:19.440204+0000","last_became_active":"2024-04-25T15:45:18.454136+0000","last_became_peered":"2024-04-25T15:45:18.454136+0000","last_unstale":"2024-04-25T15:45:19.440204+0000","last_undegraded":"2024-04-25T15:45:19.440204+0000","last_fullsized":"2024-04-25T15:45:19.440204+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:23.502579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179088+0000","last_change":"2024-04-25T15:45:18.457308+0000","last_active":"2024-04-25T15:45:20.179088+0000","last_peered":"2024-04-25T15:45:20.179088+0000","last_clean":"2024-04-25T15:45:20.179088+0000","last_became_active":"2024-04-25T15:45:18.456857+0000","last_became_peered":"2024-04-25T15:45:18.456857+0000","last_unstale":"2024-04-25T15:45:20.179088+0000","last_undegraded":"2024-04-25T15:45:20.179088+0000","last_fullsized":"2024-04-25T15:45:20.179088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:45.215621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439236+0000","last_change":"2024-04-25T15:45:18.460906+0000","last_active":"2024-04-25T15:45:19.439236+0000","last_peered":"2024-04-25T15:45:19.439236+0000","last_clean":"2024-04-25T15:45:19.439236+0000","last_became_active":"2024-04-25T15:45:18.460582+0000","last_became_peered":"2024-04-25T15:45:18.460582+0000","last_unstale":"2024-04-25T15:45:19.439236+0000","last_undegraded":"2024-04-25T15:45:19.439236+0000","last_fullsized":"2024-04-25T15:45:19.439236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:13.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178686+0000","last_change":"2024-04-25T15:45:18.467343+0000","last_active":"2024-04-25T15:45:20.178686+0000","last_peered":"2024-04-25T15:45:20.178686+0000","last_clean":"2024-04-25T15:45:20.178686+0000","last_became_active":"2024-04-25T15:45:18.467005+0000","last_became_peered":"2024-04-25T15:45:18.467005+0000","last_unstale":"2024-04-25T15:45:20.178686+0000","last_undegraded":"2024-04-25T15:45:20.178686+0000","last_fullsized":"2024-04-25T15:45:20.178686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:21.822607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178397+0000","last_change":"2024-04-25T15:45:18.466266+0000","last_active":"2024-04-25T15:45:20.178397+0000","last_peered":"2024-04-25T15:45:20.178397+0000","last_clean":"2024-04-25T15:45:20.178397+0000","last_became_active":"2024-04-25T15:45:18.465937+0000","last_became_peered":"2024-04-25T15:45:18.465937+0000","last_unstale":"2024-04-25T15:45:20.178397+0000","last_undegraded":"2024-04-25T15:45:20.178397+0000","last_fullsized":"2024-04-25T15:45:20.178397+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:29.235394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440859+0000","last_change":"2024-04-25T15:45:18.451220+0000","last_active":"2024-04-25T15:45:19.440859+0000","last_peered":"2024-04-25T15:45:19.440859+0000","last_clean":"2024-04-25T15:45:19.440859+0000","last_became_active":"2024-04-25T15:45:18.449959+0000","last_became_peered":"2024-04-25T15:45:18.449959+0000","last_unstale":"2024-04-25T15:45:19.440859+0000","last_undegraded":"2024-04-25T15:45:19.440859+0000","last_fullsized":"2024-04-25T15:45:19.440859+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439644+0000","last_change":"2024-04-25T15:45:18.456614+0000","last_active":"2024-04-25T15:45:19.439644+0000","last_peered":"2024-04-25T15:45:19.439644+0000","last_clean":"2024-04-25T15:45:19.439644+0000","last_became_active":"2024-04-25T15:45:18.454371+0000","last_became_peered":"2024-04-25T15:45:18.454371+0000","last_unstale":"2024-04-25T15:45:19.439644+0000","last_undegraded":"2024-04-25T15:45:19.439644+0000","last_fullsized":"2024-04-25T15:45:19.439644+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439451+0000","last_change":"2024-04-25T15:45:18.454219+0000","last_active":"2024-04-25T15:45:19.439451+0000","last_peered":"2024-04-25T15:45:19.439451+0000","last_clean":"2024-04-25T15:45:19.439451+0000","last_became_active":"2024-04-25T15:45:18.453884+0000","last_became_peered":"2024-04-25T15:45:18.453884+0000","last_unstale":"2024-04-25T15:45:19.439451+0000","last_undegraded":"2024-04-25T15:45:19.439451+0000","last_fullsized":"2024-04-25T15:45:19.439451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:47.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178466+0000","last_change":"2024-04-25T15:45:18.446392+0000","last_active":"2024-04-25T15:45:20.178466+0000","last_peered":"2024-04-25T15:45:20.178466+0000","last_clean":"2024-04-25T15:45:20.178466+0000","last_became_active":"2024-04-25T15:45:18.446037+0000","last_became_peered":"2024-04-25T15:45:18.446037+0000","last_unstale":"2024-04-25T15:45:20.178466+0000","last_undegraded":"2024-04-25T15:45:20.178466+0000","last_fullsized":"2024-04-25T15:45:20.178466+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:23.502579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179638+0000","last_change":"2024-04-25T15:45:18.468839+0000","last_active":"2024-04-25T15:45:20.179638+0000","last_peered":"2024-04-25T15:45:20.179638+0000","last_clean":"2024-04-25T15:45:20.179638+0000","last_became_active":"2024-04-25T15:45:18.467727+0000","last_became_peered":"2024-04-25T15:45:18.467727+0000","last_unstale":"2024-04-25T15:45:20.179638+0000","last_undegraded":"2024-04-25T15:45:20.179638+0000","last_fullsized":"2024-04-25T15:45:20.179638+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.179953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440707+0000","last_change":"2024-04-25T15:45:18.453721+0000","last_active":"2024-04-25T15:45:19.440707+0000","last_peered":"2024-04-25T15:45:19.440707+0000","last_clean":"2024-04-25T15:45:19.440707+0000","last_became_active":"2024-04-25T15:45:18.453439+0000","last_became_peered":"2024-04-25T15:45:18.453439+0000","last_unstale":"2024-04-25T15:45:19.440707+0000","last_undegraded":"2024-04-25T15:45:19.440707+0000","last_fullsized":"2024-04-25T15:45:19.440707+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:09.832403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438383+0000","last_change":"2024-04-25T15:45:18.453102+0000","last_active":"2024-04-25T15:45:19.438383+0000","last_peered":"2024-04-25T15:45:19.438383+0000","last_clean":"2024-04-25T15:45:19.438383+0000","last_became_active":"2024-04-25T15:45:18.452816+0000","last_became_peered":"2024-04-25T15:45:18.452816+0000","last_unstale":"2024-04-25T15:45:19.438383+0000","last_undegraded":"2024-04-25T15:45:19.438383+0000","last_fullsized":"2024-04-25T15:45:19.438383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:58.620166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.177993+0000","last_change":"2024-04-25T15:45:18.446842+0000","last_active":"2024-04-25T15:45:20.177993+0000","last_peered":"2024-04-25T15:45:20.177993+0000","last_clean":"2024-04-25T15:45:20.177993+0000","last_became_active":"2024-04-25T15:45:18.446489+0000","last_became_peered":"2024-04-25T15:45:18.446489+0000","last_unstale":"2024-04-25T15:45:20.177993+0000","last_undegraded":"2024-04-25T15:45:20.177993+0000","last_fullsized":"2024-04-25T15:45:20.177993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:51.001164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178474+0000","last_change":"2024-04-25T15:45:18.461593+0000","last_active":"2024-04-25T15:45:20.178474+0000","last_peered":"2024-04-25T15:45:20.178474+0000","last_clean":"2024-04-25T15:45:20.178474+0000","last_became_active":"2024-04-25T15:45:18.460991+0000","last_became_peered":"2024-04-25T15:45:18.460991+0000","last_unstale":"2024-04-25T15:45:20.178474+0000","last_undegraded":"2024-04-25T15:45:20.178474+0000","last_fullsized":"2024-04-25T15:45:20.178474+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439948+0000","last_change":"2024-04-25T15:45:18.470892+0000","last_active":"2024-04-25T15:45:19.439948+0000","last_peered":"2024-04-25T15:45:19.439948+0000","last_clean":"2024-04-25T15:45:19.439948+0000","last_became_active":"2024-04-25T15:45:18.470554+0000","last_became_peered":"2024-04-25T15:45:18.470554+0000","last_unstale":"2024-04-25T15:45:19.439948+0000","last_undegraded":"2024-04-25T15:45:19.439948+0000","last_fullsized":"2024-04-25T15:45:19.439948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:54.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179830+0000","last_change":"2024-04-25T15:45:17.450209+0000","last_active":"2024-04-25T15:45:20.179830+0000","last_peered":"2024-04-25T15:45:20.179830+0000","last_clean":"2024-04-25T15:45:20.179830+0000","last_became_active":"2024-04-25T15:45:17.449955+0000","last_became_peered":"2024-04-25T15:45:17.449955+0000","last_unstale":"2024-04-25T15:45:20.179830+0000","last_undegraded":"2024-04-25T15:45:20.179830+0000","last_fullsized":"2024-04-25T15:45:20.179830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:49.999228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178620+0000","last_change":"2024-04-25T15:45:18.457233+0000","last_active":"2024-04-25T15:45:20.178620+0000","last_peered":"2024-04-25T15:45:20.178620+0000","last_clean":"2024-04-25T15:45:20.178620+0000","last_became_active":"2024-04-25T15:45:18.456926+0000","last_became_peered":"2024-04-25T15:45:18.456926+0000","last_unstale":"2024-04-25T15:45:20.178620+0000","last_undegraded":"2024-04-25T15:45:20.178620+0000","last_fullsized":"2024-04-25T15:45:20.178620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:11.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.180001+0000","last_change":"2024-04-25T15:45:17.452008+0000","last_active":"2024-04-25T15:45:20.180001+0000","last_peered":"2024-04-25T15:45:20.180001+0000","last_clean":"2024-04-25T15:45:20.180001+0000","last_became_active":"2024-04-25T15:45:17.451635+0000","last_became_peered":"2024-04-25T15:45:17.451635+0000","last_unstale":"2024-04-25T15:45:20.180001+0000","last_undegraded":"2024-04-25T15:45:20.180001+0000","last_fullsized":"2024-04-25T15:45:20.180001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179813+0000","last_change":"2024-04-25T15:45:18.460858+0000","last_active":"2024-04-25T15:45:20.179813+0000","last_peered":"2024-04-25T15:45:20.179813+0000","last_clean":"2024-04-25T15:45:20.179813+0000","last_became_active":"2024-04-25T15:45:18.460430+0000","last_became_peered":"2024-04-25T15:45:18.460430+0000","last_unstale":"2024-04-25T15:45:20.179813+0000","last_undegraded":"2024-04-25T15:45:20.179813+0000","last_fullsized":"2024-04-25T15:45:20.179813+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:32.165550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.180145+0000","last_change":"2024-04-25T15:45:17.448435+0000","last_active":"2024-04-25T15:45:20.180145+0000","last_peered":"2024-04-25T15:45:20.180145+0000","last_clean":"2024-04-25T15:45:20.180145+0000","last_became_active":"2024-04-25T15:45:17.448082+0000","last_became_peered":"2024-04-25T15:45:17.448082+0000","last_unstale":"2024-04-25T15:45:20.180145+0000","last_undegraded":"2024-04-25T15:45:20.180145+0000","last_fullsized":"2024-04-25T15:45:20.180145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:44.683965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.441057+0000","last_change":"2024-04-25T15:45:18.469729+0000","last_active":"2024-04-25T15:45:19.441057+0000","last_peered":"2024-04-25T15:45:19.441057+0000","last_clean":"2024-04-25T15:45:19.441057+0000","last_became_active":"2024-04-25T15:45:18.469187+0000","last_became_peered":"2024-04-25T15:45:18.469187+0000","last_unstale":"2024-04-25T15:45:19.441057+0000","last_undegraded":"2024-04-25T15:45:19.441057+0000","last_fullsized":"2024-04-25T15:45:19.441057+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:53.453597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179902+0000","last_change":"2024-04-25T15:45:17.441391+0000","last_active":"2024-04-25T15:45:20.179902+0000","last_peered":"2024-04-25T15:45:20.179902+0000","last_clean":"2024-04-25T15:45:20.179902+0000","last_became_active":"2024-04-25T15:45:17.441059+0000","last_became_peered":"2024-04-25T15:45:17.441059+0000","last_unstale":"2024-04-25T15:45:20.179902+0000","last_undegraded":"2024-04-25T15:45:20.179902+0000","last_fullsized":"2024-04-25T15:45:20.179902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178878+0000","last_change":"2024-04-25T15:45:18.461108+0000","last_active":"2024-04-25T15:45:20.178878+0000","last_peered":"2024-04-25T15:45:20.178878+0000","last_clean":"2024-04-25T15:45:20.178878+0000","last_became_active":"2024-04-25T15:45:18.460693+0000","last_became_peered":"2024-04-25T15:45:18.460693+0000","last_unstale":"2024-04-25T15:45:20.178878+0000","last_undegraded":"2024-04-25T15:45:20.178878+0000","last_fullsized":"2024-04-25T15:45:20.178878+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:48.376552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178410+0000","last_change":"2024-04-25T15:45:17.453653+0000","last_active":"2024-04-25T15:45:20.178410+0000","last_peered":"2024-04-25T15:45:20.178410+0000","last_clean":"2024-04-25T15:45:20.178410+0000","last_became_active":"2024-04-25T15:45:17.453292+0000","last_became_peered":"2024-04-25T15:45:17.453292+0000","last_unstale":"2024-04-25T15:45:20.178410+0000","last_undegraded":"2024-04-25T15:45:20.178410+0000","last_fullsized":"2024-04-25T15:45:20.178410+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:12.590842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178786+0000","last_change":"2024-04-25T15:45:18.469156+0000","last_active":"2024-04-25T15:45:20.178786+0000","last_peered":"2024-04-25T15:45:20.178786+0000","last_clean":"2024-04-25T15:45:20.178786+0000","last_became_active":"2024-04-25T15:45:18.468808+0000","last_became_peered":"2024-04-25T15:45:18.468808+0000","last_unstale":"2024-04-25T15:45:20.178786+0000","last_undegraded":"2024-04-25T15:45:20.178786+0000","last_fullsized":"2024-04-25T15:45:20.178786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:18.537575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178796+0000","last_change":"2024-04-25T15:45:17.448087+0000","last_active":"2024-04-25T15:45:20.178796+0000","last_peered":"2024-04-25T15:45:20.178796+0000","last_clean":"2024-04-25T15:45:20.178796+0000","last_became_active":"2024-04-25T15:45:17.447741+0000","last_became_peered":"2024-04-25T15:45:17.447741+0000","last_unstale":"2024-04-25T15:45:20.178796+0000","last_undegraded":"2024-04-25T15:45:20.178796+0000","last_fullsized":"2024-04-25T15:45:20.178796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:13.573046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439554+0000","last_change":"2024-04-25T15:45:18.463919+0000","last_active":"2024-04-25T15:45:19.439554+0000","last_peered":"2024-04-25T15:45:19.439554+0000","last_clean":"2024-04-25T15:45:19.439554+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:19.439554+0000","last_undegraded":"2024-04-25T15:45:19.439554+0000","last_fullsized":"2024-04-25T15:45:19.439554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:28.638763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178503+0000","last_change":"2024-04-25T15:45:17.456424+0000","last_active":"2024-04-25T15:45:20.178503+0000","last_peered":"2024-04-25T15:45:20.178503+0000","last_clean":"2024-04-25T15:45:20.178503+0000","last_became_active":"2024-04-25T15:45:17.456094+0000","last_became_peered":"2024-04-25T15:45:17.456094+0000","last_unstale":"2024-04-25T15:45:20.178503+0000","last_undegraded":"2024-04-25T15:45:20.178503+0000","last_fullsized":"2024-04-25T15:45:20.178503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:59.411412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179707+0000","last_change":"2024-04-25T15:45:18.450549+0000","last_active":"2024-04-25T15:45:20.179707+0000","last_peered":"2024-04-25T15:45:20.179707+0000","last_clean":"2024-04-25T15:45:20.179707+0000","last_became_active":"2024-04-25T15:45:18.450220+0000","last_became_peered":"2024-04-25T15:45:18.450220+0000","last_unstale":"2024-04-25T15:45:20.179707+0000","last_undegraded":"2024-04-25T15:45:20.179707+0000","last_fullsized":"2024-04-25T15:45:20.179707+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:46.892009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439864+0000","last_change":"2024-04-25T15:45:17.453235+0000","last_active":"2024-04-25T15:45:19.439864+0000","last_peered":"2024-04-25T15:45:19.439864+0000","last_clean":"2024-04-25T15:45:19.439864+0000","last_became_active":"2024-04-25T15:45:17.452866+0000","last_became_peered":"2024-04-25T15:45:17.452866+0000","last_unstale":"2024-04-25T15:45:19.439864+0000","last_undegraded":"2024-04-25T15:45:19.439864+0000","last_fullsized":"2024-04-25T15:45:19.439864+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:05.525469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179830+0000","last_change":"2024-04-25T15:45:18.469147+0000","last_active":"2024-04-25T15:45:20.179830+0000","last_peered":"2024-04-25T15:45:20.179830+0000","last_clean":"2024-04-25T15:45:20.179830+0000","last_became_active":"2024-04-25T15:45:18.467937+0000","last_became_peered":"2024-04-25T15:45:18.467937+0000","last_unstale":"2024-04-25T15:45:20.179830+0000","last_undegraded":"2024-04-25T15:45:20.179830+0000","last_fullsized":"2024-04-25T15:45:20.179830+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:36.433635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.441279+0000","last_change":"2024-04-25T15:45:17.447439+0000","last_active":"2024-04-25T15:45:19.441279+0000","last_peered":"2024-04-25T15:45:19.441279+0000","last_clean":"2024-04-25T15:45:19.441279+0000","last_became_active":"2024-04-25T15:45:17.446486+0000","last_became_peered":"2024-04-25T15:45:17.446486+0000","last_unstale":"2024-04-25T15:45:19.441279+0000","last_undegraded":"2024-04-25T15:45:19.441279+0000","last_fullsized":"2024-04-25T15:45:19.441279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:35.431699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.180108+0000","last_change":"2024-04-25T15:45:18.456089+0000","last_active":"2024-04-25T15:45:20.180108+0000","last_peered":"2024-04-25T15:45:20.180108+0000","last_clean":"2024-04-25T15:45:20.180108+0000","last_became_active":"2024-04-25T15:45:18.455775+0000","last_became_peered":"2024-04-25T15:45:18.455775+0000","last_unstale":"2024-04-25T15:45:20.180108+0000","last_undegraded":"2024-04-25T15:45:20.180108+0000","last_fullsized":"2024-04-25T15:45:20.180108+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:32.475155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178677+0000","last_change":"2024-04-25T15:45:17.447523+0000","last_active":"2024-04-25T15:45:20.178677+0000","last_peered":"2024-04-25T15:45:20.178677+0000","last_clean":"2024-04-25T15:45:20.178677+0000","last_became_active":"2024-04-25T15:45:17.447092+0000","last_became_peered":"2024-04-25T15:45:17.447092+0000","last_unstale":"2024-04-25T15:45:20.178677+0000","last_undegraded":"2024-04-25T15:45:20.178677+0000","last_fullsized":"2024-04-25T15:45:20.178677+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:12.596605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439517+0000","last_change":"2024-04-25T15:45:18.458720+0000","last_active":"2024-04-25T15:45:19.439517+0000","last_peered":"2024-04-25T15:45:19.439517+0000","last_clean":"2024-04-25T15:45:19.439517+0000","last_became_active":"2024-04-25T15:45:18.458419+0000","last_became_peered":"2024-04-25T15:45:18.458419+0000","last_unstale":"2024-04-25T15:45:19.439517+0000","last_undegraded":"2024-04-25T15:45:19.439517+0000","last_fullsized":"2024-04-25T15:45:19.439517+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:24.886487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440730+0000","last_change":"2024-04-25T15:45:17.445901+0000","last_active":"2024-04-25T15:45:19.440730+0000","last_peered":"2024-04-25T15:45:19.440730+0000","last_clean":"2024-04-25T15:45:19.440730+0000","last_became_active":"2024-04-25T15:45:17.445519+0000","last_became_peered":"2024-04-25T15:45:17.445519+0000","last_unstale":"2024-04-25T15:45:19.440730+0000","last_undegraded":"2024-04-25T15:45:19.440730+0000","last_fullsized":"2024-04-25T15:45:19.440730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:47.725233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178653+0000","last_change":"2024-04-25T15:45:18.456011+0000","last_active":"2024-04-25T15:45:20.178653+0000","last_peered":"2024-04-25T15:45:20.178653+0000","last_clean":"2024-04-25T15:45:20.178653+0000","last_became_active":"2024-04-25T15:45:18.455599+0000","last_became_peered":"2024-04-25T15:45:18.455599+0000","last_unstale":"2024-04-25T15:45:20.178653+0000","last_undegraded":"2024-04-25T15:45:20.178653+0000","last_fullsized":"2024-04-25T15:45:20.178653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179778+0000","last_change":"2024-04-25T15:45:17.452349+0000","last_active":"2024-04-25T15:45:20.179778+0000","last_peered":"2024-04-25T15:45:20.179778+0000","last_clean":"2024-04-25T15:45:20.179778+0000","last_became_active":"2024-04-25T15:45:17.452038+0000","last_became_peered":"2024-04-25T15:45:17.452038+0000","last_unstale":"2024-04-25T15:45:20.179778+0000","last_undegraded":"2024-04-25T15:45:20.179778+0000","last_fullsized":"2024-04-25T15:45:20.179778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:30.586243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.177972+0000","last_change":"2024-04-25T15:45:18.448205+0000","last_active":"2024-04-25T15:45:20.177972+0000","last_peered":"2024-04-25T15:45:20.177972+0000","last_clean":"2024-04-25T15:45:20.177972+0000","last_became_active":"2024-04-25T15:45:18.447887+0000","last_became_peered":"2024-04-25T15:45:18.447887+0000","last_unstale":"2024-04-25T15:45:20.177972+0000","last_undegraded":"2024-04-25T15:45:20.177972+0000","last_fullsized":"2024-04-25T15:45:20.177972+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:28.638763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440842+0000","last_change":"2024-04-25T15:45:17.456603+0000","last_active":"2024-04-25T15:45:19.440842+0000","last_peered":"2024-04-25T15:45:19.440842+0000","last_clean":"2024-04-25T15:45:19.440842+0000","last_became_active":"2024-04-25T15:45:17.456120+0000","last_became_peered":"2024-04-25T15:45:17.456120+0000","last_unstale":"2024-04-25T15:45:19.440842+0000","last_undegraded":"2024-04-25T15:45:19.440842+0000","last_fullsized":"2024-04-25T15:45:19.440842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:54.314681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438518+0000","last_change":"2024-04-25T15:45:18.452091+0000","last_active":"2024-04-25T15:45:19.438518+0000","last_peered":"2024-04-25T15:45:19.438518+0000","last_clean":"2024-04-25T15:45:19.438518+0000","last_became_active":"2024-04-25T15:45:18.451785+0000","last_became_peered":"2024-04-25T15:45:18.451785+0000","last_unstale":"2024-04-25T15:45:19.438518+0000","last_undegraded":"2024-04-25T15:45:19.438518+0000","last_fullsized":"2024-04-25T15:45:19.438518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:00.413348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438362+0000","last_change":"2024-04-25T15:45:17.454916+0000","last_active":"2024-04-25T15:45:19.438362+0000","last_peered":"2024-04-25T15:45:19.438362+0000","last_clean":"2024-04-25T15:45:19.438362+0000","last_became_active":"2024-04-25T15:45:17.454350+0000","last_became_peered":"2024-04-25T15:45:17.454350+0000","last_unstale":"2024-04-25T15:45:19.438362+0000","last_undegraded":"2024-04-25T15:45:19.438362+0000","last_fullsized":"2024-04-25T15:45:19.438362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439841+0000","last_change":"2024-04-25T15:45:18.448588+0000","last_active":"2024-04-25T15:45:19.439841+0000","last_peered":"2024-04-25T15:45:19.439841+0000","last_clean":"2024-04-25T15:45:19.439841+0000","last_became_active":"2024-04-25T15:45:18.448287+0000","last_became_peered":"2024-04-25T15:45:18.448287+0000","last_unstale":"2024-04-25T15:45:19.439841+0000","last_undegraded":"2024-04-25T15:45:19.439841+0000","last_fullsized":"2024-04-25T15:45:19.439841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:31.588180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440615+0000","last_change":"2024-04-25T15:45:17.450515+0000","last_active":"2024-04-25T15:45:19.440615+0000","last_peered":"2024-04-25T15:45:19.440615+0000","last_clean":"2024-04-25T15:45:19.440615+0000","last_became_active":"2024-04-25T15:45:17.450214+0000","last_became_peered":"2024-04-25T15:45:17.450214+0000","last_unstale":"2024-04-25T15:45:19.440615+0000","last_undegraded":"2024-04-25T15:45:19.440615+0000","last_fullsized":"2024-04-25T15:45:19.440615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:35.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179255+0000","last_change":"2024-04-25T15:45:18.465099+0000","last_active":"2024-04-25T15:45:20.179255+0000","last_peered":"2024-04-25T15:45:20.179255+0000","last_clean":"2024-04-25T15:45:20.179255+0000","last_became_active":"2024-04-25T15:45:18.464807+0000","last_became_peered":"2024-04-25T15:45:18.464807+0000","last_unstale":"2024-04-25T15:45:20.179255+0000","last_undegraded":"2024-04-25T15:45:20.179255+0000","last_fullsized":"2024-04-25T15:45:20.179255+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:35.083161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.177878+0000","last_change":"2024-04-25T15:45:17.453212+0000","last_active":"2024-04-25T15:45:20.177878+0000","last_peered":"2024-04-25T15:45:20.177878+0000","last_clean":"2024-04-25T15:45:20.177878+0000","last_became_active":"2024-04-25T15:45:17.452909+0000","last_became_peered":"2024-04-25T15:45:17.452909+0000","last_unstale":"2024-04-25T15:45:20.177878+0000","last_undegraded":"2024-04-25T15:45:20.177878+0000","last_fullsized":"2024-04-25T15:45:20.177878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:59.622902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440913+0000","last_change":"2024-04-25T15:45:18.454588+0000","last_active":"2024-04-25T15:45:19.440913+0000","last_peered":"2024-04-25T15:45:19.440913+0000","last_clean":"2024-04-25T15:45:19.440913+0000","last_became_active":"2024-04-25T15:45:18.454184+0000","last_became_peered":"2024-04-25T15:45:18.454184+0000","last_unstale":"2024-04-25T15:45:19.440913+0000","last_undegraded":"2024-04-25T15:45:19.440913+0000","last_fullsized":"2024-04-25T15:45:19.440913+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:47.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439762+0000","last_change":"2024-04-25T15:45:17.454462+0000","last_active":"2024-04-25T15:45:19.439762+0000","last_peered":"2024-04-25T15:45:19.439762+0000","last_clean":"2024-04-25T15:45:19.439762+0000","last_became_active":"2024-04-25T15:45:17.454123+0000","last_became_peered":"2024-04-25T15:45:17.454123+0000","last_unstale":"2024-04-25T15:45:19.439762+0000","last_undegraded":"2024-04-25T15:45:19.439762+0000","last_fullsized":"2024-04-25T15:45:19.439762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:27.077156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440359+0000","last_change":"2024-04-25T15:45:18.466518+0000","last_active":"2024-04-25T15:45:19.440359+0000","last_peered":"2024-04-25T15:45:19.440359+0000","last_clean":"2024-04-25T15:45:19.440359+0000","last_became_active":"2024-04-25T15:45:18.466170+0000","last_became_peered":"2024-04-25T15:45:18.466170+0000","last_unstale":"2024-04-25T15:45:19.440359+0000","last_undegraded":"2024-04-25T15:45:19.440359+0000","last_fullsized":"2024-04-25T15:45:19.440359+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:24.631878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440973+0000","last_change":"2024-04-25T15:45:17.449615+0000","last_active":"2024-04-25T15:45:19.440973+0000","last_peered":"2024-04-25T15:45:19.440973+0000","last_clean":"2024-04-25T15:45:19.440973+0000","last_became_active":"2024-04-25T15:45:17.449164+0000","last_became_peered":"2024-04-25T15:45:17.449164+0000","last_unstale":"2024-04-25T15:45:19.440973+0000","last_undegraded":"2024-04-25T15:45:19.440973+0000","last_fullsized":"2024-04-25T15:45:19.440973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:16.178017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178473+0000","last_change":"2024-04-25T15:45:18.451006+0000","last_active":"2024-04-25T15:45:20.178473+0000","last_peered":"2024-04-25T15:45:20.178473+0000","last_clean":"2024-04-25T15:45:20.178473+0000","last_became_active":"2024-04-25T15:45:18.450671+0000","last_became_peered":"2024-04-25T15:45:18.450671+0000","last_unstale":"2024-04-25T15:45:20.178473+0000","last_undegraded":"2024-04-25T15:45:20.178473+0000","last_fullsized":"2024-04-25T15:45:20.178473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:24.631878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.441030+0000","last_change":"2024-04-25T15:45:17.445560+0000","last_active":"2024-04-25T15:45:19.441030+0000","last_peered":"2024-04-25T15:45:19.441030+0000","last_clean":"2024-04-25T15:45:19.441030+0000","last_became_active":"2024-04-25T15:45:17.445197+0000","last_became_peered":"2024-04-25T15:45:17.445197+0000","last_unstale":"2024-04-25T15:45:19.441030+0000","last_undegraded":"2024-04-25T15:45:19.441030+0000","last_fullsized":"2024-04-25T15:45:19.441030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:59.376290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439656+0000","last_change":"2024-04-25T15:45:18.457807+0000","last_active":"2024-04-25T15:45:19.439656+0000","last_peered":"2024-04-25T15:45:19.439656+0000","last_clean":"2024-04-25T15:45:19.439656+0000","last_became_active":"2024-04-25T15:45:18.457452+0000","last_became_peered":"2024-04-25T15:45:18.457452+0000","last_unstale":"2024-04-25T15:45:19.439656+0000","last_undegraded":"2024-04-25T15:45:19.439656+0000","last_fullsized":"2024-04-25T15:45:19.439656+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:51.001164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179093+0000","last_change":"2024-04-25T15:45:17.452491+0000","last_active":"2024-04-25T15:45:20.179093+0000","last_peered":"2024-04-25T15:45:20.179093+0000","last_clean":"2024-04-25T15:45:20.179093+0000","last_became_active":"2024-04-25T15:45:17.452161+0000","last_became_peered":"2024-04-25T15:45:17.452161+0000","last_unstale":"2024-04-25T15:45:20.179093+0000","last_undegraded":"2024-04-25T15:45:20.179093+0000","last_fullsized":"2024-04-25T15:45:20.179093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:39.016244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178647+0000","last_change":"2024-04-25T15:45:18.461064+0000","last_active":"2024-04-25T15:45:20.178647+0000","last_peered":"2024-04-25T15:45:20.178647+0000","last_clean":"2024-04-25T15:45:20.178647+0000","last_became_active":"2024-04-25T15:45:18.460573+0000","last_became_peered":"2024-04-25T15:45:18.460573+0000","last_unstale":"2024-04-25T15:45:20.178647+0000","last_undegraded":"2024-04-25T15:45:20.178647+0000","last_fullsized":"2024-04-25T15:45:20.178647+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:37.895273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178824+0000","last_change":"2024-04-25T15:45:17.455994+0000","last_active":"2024-04-25T15:45:20.178824+0000","last_peered":"2024-04-25T15:45:20.178824+0000","last_clean":"2024-04-25T15:45:20.178824+0000","last_became_active":"2024-04-25T15:45:17.455639+0000","last_became_peered":"2024-04-25T15:45:17.455639+0000","last_unstale":"2024-04-25T15:45:20.178824+0000","last_undegraded":"2024-04-25T15:45:20.178824+0000","last_fullsized":"2024-04-25T15:45:20.178824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:33.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438398+0000","last_change":"2024-04-25T15:45:18.457186+0000","last_active":"2024-04-25T15:45:19.438398+0000","last_peered":"2024-04-25T15:45:19.438398+0000","last_clean":"2024-04-25T15:45:19.438398+0000","last_became_active":"2024-04-25T15:45:18.455000+0000","last_became_peered":"2024-04-25T15:45:18.455000+0000","last_unstale":"2024-04-25T15:45:19.438398+0000","last_undegraded":"2024-04-25T15:45:19.438398+0000","last_fullsized":"2024-04-25T15:45:19.438398+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:40.018180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.438663+0000","last_change":"2024-04-25T15:45:17.455522+0000","last_active":"2024-04-25T15:45:19.438663+0000","last_peered":"2024-04-25T15:45:19.438663+0000","last_clean":"2024-04-25T15:45:19.438663+0000","last_became_active":"2024-04-25T15:45:17.455177+0000","last_became_peered":"2024-04-25T15:45:17.455177+0000","last_unstale":"2024-04-25T15:45:19.438663+0000","last_undegraded":"2024-04-25T15:45:19.438663+0000","last_fullsized":"2024-04-25T15:45:19.438663+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:17.535639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440058+0000","last_change":"2024-04-25T15:45:18.452851+0000","last_active":"2024-04-25T15:45:19.440058+0000","last_peered":"2024-04-25T15:45:19.440058+0000","last_clean":"2024-04-25T15:45:19.440058+0000","last_became_active":"2024-04-25T15:45:18.452522+0000","last_became_peered":"2024-04-25T15:45:18.452522+0000","last_unstale":"2024-04-25T15:45:19.440058+0000","last_undegraded":"2024-04-25T15:45:19.440058+0000","last_fullsized":"2024-04-25T15:45:19.440058+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:00.619090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179481+0000","last_change":"2024-04-25T15:45:17.451838+0000","last_active":"2024-04-25T15:45:20.179481+0000","last_peered":"2024-04-25T15:45:20.179481+0000","last_clean":"2024-04-25T15:45:20.179481+0000","last_became_active":"2024-04-25T15:45:17.451595+0000","last_became_peered":"2024-04-25T15:45:17.451595+0000","last_unstale":"2024-04-25T15:45:20.179481+0000","last_undegraded":"2024-04-25T15:45:20.179481+0000","last_fullsized":"2024-04-25T15:45:20.179481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:52.673909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179789+0000","last_change":"2024-04-25T15:45:18.469369+0000","last_active":"2024-04-25T15:45:20.179789+0000","last_peered":"2024-04-25T15:45:20.179789+0000","last_clean":"2024-04-25T15:45:20.179789+0000","last_became_active":"2024-04-25T15:45:18.469065+0000","last_became_peered":"2024-04-25T15:45:18.469065+0000","last_unstale":"2024-04-25T15:45:20.179789+0000","last_undegraded":"2024-04-25T15:45:20.179789+0000","last_fullsized":"2024-04-25T15:45:20.179789+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:03.990617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439962+0000","last_change":"2024-04-25T15:45:17.452964+0000","last_active":"2024-04-25T15:45:19.439962+0000","last_peered":"2024-04-25T15:45:19.439962+0000","last_clean":"2024-04-25T15:45:19.439962+0000","last_became_active":"2024-04-25T15:45:17.452625+0000","last_became_peered":"2024-04-25T15:45:17.452625+0000","last_unstale":"2024-04-25T15:45:19.439962+0000","last_undegraded":"2024-04-25T15:45:19.439962+0000","last_fullsized":"2024-04-25T15:45:19.439962+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:54.314681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179523+0000","last_change":"2024-04-25T15:45:18.464662+0000","last_active":"2024-04-25T15:45:20.179523+0000","last_peered":"2024-04-25T15:45:20.179523+0000","last_clean":"2024-04-25T15:45:20.179523+0000","last_became_active":"2024-04-25T15:45:18.463609+0000","last_became_peered":"2024-04-25T15:45:18.463609+0000","last_unstale":"2024-04-25T15:45:20.179523+0000","last_undegraded":"2024-04-25T15:45:20.179523+0000","last_fullsized":"2024-04-25T15:45:20.179523+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:35.465989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"63'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439723+0000","last_change":"2024-04-25T15:45:17.447299+0000","last_active":"2024-04-25T15:45:19.439723+0000","last_peered":"2024-04-25T15:45:19.439723+0000","last_clean":"2024-04-25T15:45:19.439723+0000","last_became_active":"2024-04-25T15:45:17.446963+0000","last_became_peered":"2024-04-25T15:45:17.446963+0000","last_unstale":"2024-04-25T15:45:19.439723+0000","last_undegraded":"2024-04-25T15:45:19.439723+0000","last_fullsized":"2024-04-25T15:45:19.439723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:34.081224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.439455+0000","last_change":"2024-04-25T15:45:18.453031+0000","last_active":"2024-04-25T15:45:19.439455+0000","last_peered":"2024-04-25T15:45:19.439455+0000","last_clean":"2024-04-25T15:45:19.439455+0000","last_became_active":"2024-04-25T15:45:18.452672+0000","last_became_peered":"2024-04-25T15:45:18.452672+0000","last_unstale":"2024-04-25T15:45:19.439455+0000","last_undegraded":"2024-04-25T15:45:19.439455+0000","last_fullsized":"2024-04-25T15:45:19.439455+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:56.785304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.180216+0000","last_change":"2024-04-25T15:45:17.447746+0000","last_active":"2024-04-25T15:45:20.180216+0000","last_peered":"2024-04-25T15:45:20.180216+0000","last_clean":"2024-04-25T15:45:20.180216+0000","last_became_active":"2024-04-25T15:45:17.447403+0000","last_became_peered":"2024-04-25T15:45:17.447403+0000","last_unstale":"2024-04-25T15:45:20.180216+0000","last_undegraded":"2024-04-25T15:45:20.180216+0000","last_fullsized":"2024-04-25T15:45:20.180216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:51.951450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440100+0000","last_change":"2024-04-25T15:45:18.450798+0000","last_active":"2024-04-25T15:45:19.440100+0000","last_peered":"2024-04-25T15:45:19.440100+0000","last_clean":"2024-04-25T15:45:19.440100+0000","last_became_active":"2024-04-25T15:45:18.450505+0000","last_became_peered":"2024-04-25T15:45:18.450505+0000","last_unstale":"2024-04-25T15:45:19.440100+0000","last_undegraded":"2024-04-25T15:45:19.440100+0000","last_fullsized":"2024-04-25T15:45:19.440100+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:40.746835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179890+0000","last_change":"2024-04-25T15:45:17.449484+0000","last_active":"2024-04-25T15:45:20.179890+0000","last_peered":"2024-04-25T15:45:20.179890+0000","last_clean":"2024-04-25T15:45:20.179890+0000","last_became_active":"2024-04-25T15:45:17.449246+0000","last_became_peered":"2024-04-25T15:45:17.449246+0000","last_unstale":"2024-04-25T15:45:20.179890+0000","last_undegraded":"2024-04-25T15:45:20.179890+0000","last_fullsized":"2024-04-25T15:45:20.179890+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:53.969769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440361+0000","last_change":"2024-04-25T15:45:18.461789+0000","last_active":"2024-04-25T15:45:19.440361+0000","last_peered":"2024-04-25T15:45:19.440361+0000","last_clean":"2024-04-25T15:45:19.440361+0000","last_became_active":"2024-04-25T15:45:18.461037+0000","last_became_peered":"2024-04-25T15:45:18.461037+0000","last_unstale":"2024-04-25T15:45:19.440361+0000","last_undegraded":"2024-04-25T15:45:19.440361+0000","last_fullsized":"2024-04-25T15:45:19.440361+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440974+0000","last_change":"2024-04-25T15:45:17.454679+0000","last_active":"2024-04-25T15:45:19.440974+0000","last_peered":"2024-04-25T15:45:19.440974+0000","last_clean":"2024-04-25T15:45:19.440974+0000","last_became_active":"2024-04-25T15:45:17.454369+0000","last_became_peered":"2024-04-25T15:45:17.454369+0000","last_unstale":"2024-04-25T15:45:19.440974+0000","last_undegraded":"2024-04-25T15:45:19.440974+0000","last_fullsized":"2024-04-25T15:45:19.440974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:39.259683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178132+0000","last_change":"2024-04-25T15:45:18.448392+0000","last_active":"2024-04-25T15:45:20.178132+0000","last_peered":"2024-04-25T15:45:20.178132+0000","last_clean":"2024-04-25T15:45:20.178132+0000","last_became_active":"2024-04-25T15:45:18.448065+0000","last_became_peered":"2024-04-25T15:45:18.448065+0000","last_unstale":"2024-04-25T15:45:20.178132+0000","last_undegraded":"2024-04-25T15:45:20.178132+0000","last_fullsized":"2024-04-25T15:45:20.178132+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:31.588180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178912+0000","last_change":"2024-04-25T15:45:17.454527+0000","last_active":"2024-04-25T15:45:20.178912+0000","last_peered":"2024-04-25T15:45:20.178912+0000","last_clean":"2024-04-25T15:45:20.178912+0000","last_became_active":"2024-04-25T15:45:17.454188+0000","last_became_peered":"2024-04-25T15:45:17.454188+0000","last_unstale":"2024-04-25T15:45:20.178912+0000","last_undegraded":"2024-04-25T15:45:20.178912+0000","last_fullsized":"2024-04-25T15:45:20.178912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:46.375607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.179271+0000","last_change":"2024-04-25T15:45:18.469752+0000","last_active":"2024-04-25T15:45:20.179271+0000","last_peered":"2024-04-25T15:45:20.179271+0000","last_clean":"2024-04-25T15:45:20.179271+0000","last_became_active":"2024-04-25T15:45:18.469384+0000","last_became_peered":"2024-04-25T15:45:18.469384+0000","last_unstale":"2024-04-25T15:45:20.179271+0000","last_undegraded":"2024-04-25T15:45:20.179271+0000","last_fullsized":"2024-04-25T15:45:20.179271+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:28.079093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178605+0000","last_change":"2024-04-25T15:45:17.455624+0000","last_active":"2024-04-25T15:45:20.178605+0000","last_peered":"2024-04-25T15:45:20.178605+0000","last_clean":"2024-04-25T15:45:20.178605+0000","last_became_active":"2024-04-25T15:45:17.455302+0000","last_became_peered":"2024-04-25T15:45:17.455302+0000","last_unstale":"2024-04-25T15:45:20.178605+0000","last_undegraded":"2024-04-25T15:45:20.178605+0000","last_fullsized":"2024-04-25T15:45:20.178605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:08.830467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178879+0000","last_change":"2024-04-25T15:45:18.448618+0000","last_active":"2024-04-25T15:45:20.178879+0000","last_peered":"2024-04-25T15:45:20.178879+0000","last_clean":"2024-04-25T15:45:20.178879+0000","last_became_active":"2024-04-25T15:45:18.448310+0000","last_became_peered":"2024-04-25T15:45:18.448310+0000","last_unstale":"2024-04-25T15:45:20.178879+0000","last_undegraded":"2024-04-25T15:45:20.178879+0000","last_fullsized":"2024-04-25T15:45:20.178879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:02.001526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178514+0000","last_change":"2024-04-25T15:45:17.455162+0000","last_active":"2024-04-25T15:45:20.178514+0000","last_peered":"2024-04-25T15:45:20.178514+0000","last_clean":"2024-04-25T15:45:20.178514+0000","last_became_active":"2024-04-25T15:45:17.454854+0000","last_became_peered":"2024-04-25T15:45:17.454854+0000","last_unstale":"2024-04-25T15:45:20.178514+0000","last_undegraded":"2024-04-25T15:45:20.178514+0000","last_fullsized":"2024-04-25T15:45:20.178514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:27.636826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440681+0000","last_change":"2024-04-25T15:45:18.460579+0000","last_active":"2024-04-25T15:45:19.440681+0000","last_peered":"2024-04-25T15:45:19.440681+0000","last_clean":"2024-04-25T15:45:19.440681+0000","last_became_active":"2024-04-25T15:45:18.460230+0000","last_became_peered":"2024-04-25T15:45:18.460230+0000","last_unstale":"2024-04-25T15:45:19.440681+0000","last_undegraded":"2024-04-25T15:45:19.440681+0000","last_fullsized":"2024-04-25T15:45:19.440681+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:17.426545+0000","last_clean_scrub_stamp":"2024-04-25T15:45:17.426545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:42.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:20.178242+0000","last_change":"2024-04-25T15:45:17.453686+0000","last_active":"2024-04-25T15:45:20.178242+0000","last_peered":"2024-04-25T15:45:20.178242+0000","last_clean":"2024-04-25T15:45:20.178242+0000","last_became_active":"2024-04-25T15:45:17.453361+0000","last_became_peered":"2024-04-25T15:45:17.453361+0000","last_unstale":"2024-04-25T15:45:20.178242+0000","last_undegraded":"2024-04-25T15:45:20.178242+0000","last_fullsized":"2024-04-25T15:45:20.178242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:16.424609+0000","last_clean_scrub_stamp":"2024-04-25T15:45:16.424609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:57.618229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":195,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T15:45:19.440991+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:19.440991+0000","last_peered":"2024-04-25T15:45:19.440991+0000","last_clean":"2024-04-25T15:45:19.440991+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:19.440991+0000","last_undegraded":"2024-04-25T15:45:19.440991+0000","last_fullsized":"2024-04-25T15:45:19.440991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":761856,"data_stored":339763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":339729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":339729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":342105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28340,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343500,"statfs":{"total":96636764160,"available":96607744000,"internally_reserved":0,"allocated":1351680,"data_stored":930097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1368064,"data_stored":930873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":339751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":341341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:26.225 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:45:26.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T15:45:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.375+0000 7fc545015640 1 Processor -- start 2024-04-25T15:45:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.376+0000 7fc545015640 1 -- start start 2024-04-25T15:45:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc545015640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc5400b4b60 0x7fc5400b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc545015640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5400b2f30 con 0x7fc5400b3850 2024-04-25T15:45:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc545015640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5400b2c90 con 0x7fc54006d6d0 2024-04-25T15:45:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc545015640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc54006eb60 con 0x7fc5400b4b60 2024-04-25T15:45:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc53f59e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc5400b3850 0x7fc54016a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58886/0 (socket says 172.21.15.80:58886) 2024-04-25T15:45:26.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc53f59e640 1 -- 172.21.15.80:0/2648879392 learned_addr learned my addr 172.21.15.80:0/2648879392 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc53ed9d640 1 --2- 172.21.15.80:0/2648879392 >> v2:172.21.15.195:3300/0 conn(0x7fc5400b4b60 0x7fc5400b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246690193 0 0) 0x7fc5400b2f30 con 0x7fc5400b3850 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.377+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc52c003520 con 0x7fc5400b3850 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1524573788 0 0) 0x7fc52c003520 con 0x7fc5400b3850 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 >> v2:172.21.15.195:3300/0 conn(0x7fc5400b4b60 msgr2=0x7fc5400b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 --2- 172.21.15.80:0/2648879392 >> v2:172.21.15.195:3300/0 conn(0x7fc5400b4b60 0x7fc5400b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 >> v1:172.21.15.195:6789/0 conn(0x7fc54006d6d0 legacy=0x7fc5400b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400d10a0 con 0x7fc5400b3850 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc5380019f0 con 0x7fc5400b3850 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 >> v1:172.21.15.80:6789/0 conn(0x7fc5400b3850 legacy=0x7fc54016a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0039b0 0x7fc52c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc52c004800 0x7fc52c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc52c0051c0 0x7fc52c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc54006eb60 con 0x7fc52c0051c0 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c00c160 con 0x7fc52c0039b0 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc52c00c360 con 0x7fc52c004800 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53f59e640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc52c0051c0 0x7fc52c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53ed9d640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0039b0 0x7fc52c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc537fff640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc52c004800 0x7fc52c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53f59e640 1 -- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc52c004800 msgr2=0x7fc52c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53f59e640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc52c004800 0x7fc52c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53f59e640 1 -- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0039b0 msgr2=0x7fc52c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53f59e640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0039b0 0x7fc52c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc53f59e640 1 -- 172.21.15.80:0/2648879392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c003520 con 0x7fc52c0051c0 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.378+0000 7fc537fff640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc52c004800 0x7fc52c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.379+0000 7fc53f59e640 1 -- 172.21.15.80:0/2648879392 reap_dead start 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.379+0000 7fc53f59e640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc52c0051c0 0x7fc52c00b9c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc53800a920 tx=0x7fc52c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541844603a028241 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.379+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53800a4c0 con 0x7fc52c0051c0 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.379+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53802f070 con 0x7fc52c0051c0 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.379+0000 7fc53e59c640 1 -- 172.21.15.80:0/2648879392 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53802bce0 con 0x7fc52c0051c0 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 -- 172.21.15.80:0/2648879392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc52c0051c0 msgr2=0x7fc52c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc52c0051c0 0x7fc52c00b9c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc53800a920 tx=0x7fc52c005830 comp rx=0 tx=0).stop 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 -- 172.21.15.80:0/2648879392 shutdown_connections 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 --2- 172.21.15.80:0/2648879392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc52c0051c0 0x7fc52c00b9c0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 -- 172.21.15.80:0/2648879392 >> 172.21.15.80:0/2648879392 conn(0x7fc5400d0450 msgr2=0x7fc5400d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 -- 172.21.15.80:0/2648879392 shutdown_connections 2024-04-25T15:45:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.380+0000 7fc545015640 1 -- 172.21.15.80:0/2648879392 wait complete. 2024-04-25T15:45:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.382+0000 7fc545015640 1 Processor -- start 2024-04-25T15:45:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.382+0000 7fc545015640 1 -- start start 2024-04-25T15:45:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc545015640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0051c0 0x7fc5400cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc545015640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 0x7fc5400b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc545015640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5400b1c10 0x7fc54009d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc545015640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc54009d0e0 con 0x7fc54009fb30 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc545015640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc5400d13a0 con 0x7fc52c0051c0 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc545015640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc54009d260 con 0x7fc5400b1c10 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 0x7fc5400b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 0x7fc5400b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37592/0 (socket says 172.21.15.80:37592) 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 -- 172.21.15.80:0/244520843 learned_addr learned my addr 172.21.15.80:0/244520843 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc53ed9d640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0051c0 0x7fc5400cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc53f59e640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5400b1c10 0x7fc54009d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 -- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5400b1c10 msgr2=0x7fc54009d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5400b1c10 0x7fc54009d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 -- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0051c0 msgr2=0x7fc5400cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0051c0 0x7fc5400cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 -- 172.21.15.80:0/244520843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400b2020 con 0x7fc54009fb30 2024-04-25T15:45:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.383+0000 7fc537fff640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 0x7fc5400b16d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e530 tx=0x7fc52800e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.384+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5280052e0 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.384+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc528018070 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.384+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5400a05b0 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.384+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528003810 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.384+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5400a0b70 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.385+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5400a0300 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.386+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc5280039b0 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.386+0000 7fc5377fe640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5200744b0 0x7fc5200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.386+0000 7fc53ed9d640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5200744b0 0x7fc5200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.386+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fc528095080 con 0x7fc54009fb30 2024-04-25T15:45:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.387+0000 7fc53ed9d640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5200744b0 0x7fc5200769c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc530009a70 tx=0x7fc530008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.391+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5400b2020 con 0x7fc54009fb30 2024-04-25T15:45:26.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.637+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc54006a100 con 0x7fc54009fb30 2024-04-25T15:45:26.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.639+0000 7fc5377fe640 1 -- 172.21.15.80:0/244520843 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fc52805f7a0 con 0x7fc54009fb30 2024-04-25T15:45:26.640 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:45:26.640 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:45:26.640 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-25T15:45:26.640 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-25T15:45:26.640 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T15:45:26.641 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5200744b0 msgr2=0x7fc5200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5200744b0 0x7fc5200769c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc530009a70 tx=0x7fc530008040 comp rx=0 tx=0).stop 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 msgr2=0x7fc5400b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 0x7fc5400b16d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e530 tx=0x7fc52800e9f0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 shutdown_connections 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc5200744b0 0x7fc5200769c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5400b1c10 0x7fc54009d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc54009fb30 0x7fc5400b16d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 --2- 172.21.15.80:0/244520843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc52c0051c0 0x7fc5400cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 >> 172.21.15.80:0/244520843 conn(0x7fc5400d0450 msgr2=0x7fc5400b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:26.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 shutdown_connections 2024-04-25T15:45:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.642+0000 7fc545015640 1 -- 172.21.15.80:0/244520843 wait complete. 2024-04-25T15:45:26.654 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:26.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.760+0000 7f0e44030640 1 Processor -- start 2024-04-25T15:45:26.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.760+0000 7f0e44030640 1 -- start start 2024-04-25T15:45:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e44030640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e3c06db10 0x7f0e3c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e44030640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0e3c15ff80 0x7f0e3c160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e44030640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3c1589c0 con 0x7f0e3c0714a0 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e44030640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3c15faf0 con 0x7f0e3c06db10 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e44030640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3c15ee90 con 0x7f0e3c15ff80 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e41dcc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e3c06db10 0x7f0e3c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e415cb640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0e3c0714a0 0x7f0e3c0718b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58900/0 (socket says 172.21.15.80:58900) 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e415cb640 1 -- 172.21.15.80:0/1281958018 learned_addr learned my addr 172.21.15.80:0/1281958018 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e425cd640 1 --2- 172.21.15.80:0/1281958018 >> v2:172.21.15.195:3300/0 conn(0x7f0e3c15ff80 0x7f0e3c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e41dcc640 1 -- 172.21.15.80:0/1281958018 >> v2:172.21.15.195:3300/0 conn(0x7f0e3c15ff80 msgr2=0x7f0e3c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e41dcc640 1 --2- 172.21.15.80:0/1281958018 >> v2:172.21.15.195:3300/0 conn(0x7f0e3c15ff80 0x7f0e3c160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e41dcc640 1 -- 172.21.15.80:0/1281958018 >> v1:172.21.15.80:6789/0 conn(0x7f0e3c0714a0 legacy=0x7f0e3c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e40dca640 1 -- 172.21.15.80:0/1281958018 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920369840 0 0) 0x7f0e3c1589c0 con 0x7f0e3c0714a0 2024-04-25T15:45:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.762+0000 7f0e41dcc640 1 -- 172.21.15.80:0/1281958018 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c15f170 con 0x7f0e3c06db10 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.763+0000 7f0e41dcc640 1 --2- 172.21.15.80:0/1281958018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c15e520 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0d0020 tx=0x7f0e3802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0a622df53ead35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.763+0000 7f0e40dca640 1 -- 172.21.15.80:0/1281958018 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38037070 con 0x7f0e3c06db10 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.763+0000 7f0e40dca640 1 -- 172.21.15.80:0/1281958018 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e38032440 con 0x7f0e3c06db10 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.763+0000 7f0e40dca640 1 -- 172.21.15.80:0/1281958018 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3802ae60 con 0x7f0e3c06db10 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 -- 172.21.15.80:0/1281958018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 msgr2=0x7f0e3c15e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 --2- 172.21.15.80:0/1281958018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c15e520 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0d0020 tx=0x7f0e3802a110 comp rx=0 tx=0).stop 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 -- 172.21.15.80:0/1281958018 shutdown_connections 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 --2- 172.21.15.80:0/1281958018 >> v2:172.21.15.195:3300/0 conn(0x7f0e3c15ff80 0x7f0e3c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 --2- 172.21.15.80:0/1281958018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c15e520 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 -- 172.21.15.80:0/1281958018 >> 172.21.15.80:0/1281958018 conn(0x7f0e3c0d2080 msgr2=0x7f0e3c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 -- 172.21.15.80:0/1281958018 shutdown_connections 2024-04-25T15:45:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.764+0000 7f0e44030640 1 -- 172.21.15.80:0/1281958018 wait complete. 2024-04-25T15:45:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.766+0000 7f0e44030640 1 Processor -- start 2024-04-25T15:45:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.766+0000 7f0e44030640 1 -- start start 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e44030640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e44030640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e3c0714a0 0x7f0e3c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e44030640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e3c15ff80 0x7f0e3c15c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e44030640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c15ea60 con 0x7f0e3c06db10 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e44030640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c15f450 con 0x7f0e3c0714a0 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e44030640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3c15ebe0 con 0x7f0e3c15ff80 2024-04-25T15:45:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37600/0 (socket says 172.21.15.80:37600) 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 -- 172.21.15.80:0/3549622313 learned_addr learned my addr 172.21.15.80:0/3549622313 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e415cb640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e3c0714a0 0x7f0e3c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 -- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e3c15ff80 msgr2=0x7f0e3c15c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e3c15ff80 0x7f0e3c15c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 -- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e3c0714a0 msgr2=0x7f0e3c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e3c0714a0 0x7f0e3c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 -- 172.21.15.80:0/3549622313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c155460 con 0x7f0e3c06db10 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e415cb640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e3c0714a0 0x7f0e3c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.767+0000 7f0e41dcc640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c153b80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009890 tx=0x7f0e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.768+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38041070 con 0x7f0e3c06db10 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.768+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3803c890 con 0x7f0e3c06db10 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.768+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c155740 con 0x7f0e3c06db10 2024-04-25T15:45:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.768+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38037040 con 0x7f0e3c06db10 2024-04-25T15:45:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.768+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3c155d00 con 0x7f0e3c06db10 2024-04-25T15:45:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.769+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3c06a100 con 0x7f0e3c06db10 2024-04-25T15:45:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.769+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0e38044070 con 0x7f0e3c06db10 2024-04-25T15:45:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.770+0000 7f0e327fc640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0e200744e0 0x7f0e200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.770+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f0e380b5e90 con 0x7f0e3c06db10 2024-04-25T15:45:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.770+0000 7f0e415cb640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0e200744e0 0x7f0e200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.770+0000 7f0e415cb640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0e200744e0 0x7f0e200769f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0cffd0 tx=0x7f0e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.775+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e38080500 con 0x7f0e3c06db10 2024-04-25T15:45:26.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.985+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e3c0b1a00 con 0x7f0e3c06db10 2024-04-25T15:45:26.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.985+0000 7f0e327fc640 1 -- 172.21.15.80:0/3549622313 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5188 (secure 0 0 0) 0x7f0e3807fe00 con 0x7f0e3c06db10 2024-04-25T15:45:26.986 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:26.986 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:17.799767+0000","modified":"2024-04-25T15:45:19.804939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4035847402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4035847402},{"type":"v1","addr":"172.21.15.80:6837","nonce":4035847402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":4}]} 2024-04-25T15:45:26.987 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-04-25T15:45:26.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0e200744e0 msgr2=0x7f0e200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0e200744e0 0x7f0e200769f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0cffd0 tx=0x7f0e2c009040 comp rx=0 tx=0).stop 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 msgr2=0x7f0e3c153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c153b80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009890 tx=0x7f0e380046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 shutdown_connections 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0e200744e0 0x7f0e200769f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e3c15ff80 0x7f0e3c15c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e3c0714a0 0x7f0e3c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 --2- 172.21.15.80:0/3549622313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e3c06db10 0x7f0e3c153b80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 >> 172.21.15.80:0/3549622313 conn(0x7f0e3c0d2080 msgr2=0x7f0e3c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 shutdown_connections 2024-04-25T15:45:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:26.987+0000 7f0e44030640 1 -- 172.21.15.80:0/3549622313 wait complete. 2024-04-25T15:45:27.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:45:17.799767+0000', 'modified': '2024-04-25T15:45:19.804939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6255': {'gid': 6255, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/4035847402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 4035847402}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 4035847402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6255, 'qdb_cluster': [6255]} 2024-04-25T15:45:27.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:45:27.403 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T15:45:27.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.512+0000 7fcc2b451640 1 Processor -- start 2024-04-25T15:45:27.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.513+0000 7fcc2b451640 1 -- start start 2024-04-25T15:45:27.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc2b451640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc240b91c0 0x7fcc240d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc2b451640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc240b2f30 con 0x7fcc240b4b60 2024-04-25T15:45:27.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc2b451640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc240b2c90 con 0x7fcc240d2480 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc2b451640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcc2406eb60 con 0x7fcc240b91c0 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc291ed640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcc240b4b60 0x7fcc2406d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58914/0 (socket says 172.21.15.80:58914) 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc291ed640 1 -- 172.21.15.80:0/1239517543 learned_addr learned my addr 172.21.15.80:0/1239517543 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc289ec640 1 --2- 172.21.15.80:0/1239517543 >> v2:172.21.15.195:3300/0 conn(0x7fcc240b91c0 0x7fcc240d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46161039 0 0) 0x7fcc240b2f30 con 0x7fcc240b4b60 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc10003520 con 0x7fcc240b4b60 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1383748458 0 0) 0x7fcc10003520 con 0x7fcc240b4b60 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 >> v2:172.21.15.195:3300/0 conn(0x7fcc240b91c0 msgr2=0x7fcc240d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 --2- 172.21.15.80:0/1239517543 >> v2:172.21.15.195:3300/0 conn(0x7fcc240b91c0 0x7fcc240d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 >> v1:172.21.15.195:6789/0 conn(0x7fcc240d2480 legacy=0x7fcc240d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc240d10a0 con 0x7fcc240b4b60 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.514+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fcc200017f0 con 0x7fcc240b4b60 2024-04-25T15:45:27.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 >> v1:172.21.15.80:6789/0 conn(0x7fcc240b4b60 legacy=0x7fcc2406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc10004800 0x7fcc10004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc100052a0 0x7fcc1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2406eb60 con 0x7fcc100039e0 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1000c230 con 0x7fcc100052a0 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1000c430 con 0x7fcc10004800 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc299ee640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc100052a0 0x7fcc1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc289ec640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc10004800 0x7fcc10004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc291ed640 1 -- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc10004800 msgr2=0x7fcc10004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc10004800 0x7fcc10004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc291ed640 1 -- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc100052a0 msgr2=0x7fcc1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc100052a0 0x7fcc1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc299ee640 1 -- 172.21.15.80:0/1239517543 reap_dead start 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.515+0000 7fcc291ed640 1 -- 172.21.15.80:0/1239517543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc10003520 con 0x7fcc100039e0 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc10003e70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcc240d1810 tx=0x7fcc10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444050162393b4f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20007d20 con 0x7fcc100039e0 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc20007290 con 0x7fcc100039e0 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc1bfff640 1 -- 172.21.15.80:0/1239517543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc200057a0 con 0x7fcc100039e0 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc2b451640 1 -- 172.21.15.80:0/1239517543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 msgr2=0x7fcc10003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc2b451640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc10003e70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcc240d1810 tx=0x7fcc10005830 comp rx=0 tx=0).stop 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc2b451640 1 -- 172.21.15.80:0/1239517543 shutdown_connections 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.516+0000 7fcc2b451640 1 --2- 172.21.15.80:0/1239517543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc10003e70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.517+0000 7fcc2b451640 1 -- 172.21.15.80:0/1239517543 >> 172.21.15.80:0/1239517543 conn(0x7fcc240d0450 msgr2=0x7fcc240d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.517+0000 7fcc2b451640 1 -- 172.21.15.80:0/1239517543 shutdown_connections 2024-04-25T15:45:27.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.517+0000 7fcc2b451640 1 -- 172.21.15.80:0/1239517543 wait complete. 2024-04-25T15:45:27.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.518+0000 7fcc2b451640 1 Processor -- start 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.518+0000 7fcc2b451640 1 -- start start 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc241d8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc240a1260 0x7fcc241dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc241db190 0x7fcc241db5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2409d0e0 con 0x7fcc100039e0 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2409cbe0 con 0x7fcc241db190 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2409d260 con 0x7fcc240a1260 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc241d8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc241d8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37618/0 (socket says 172.21.15.80:37618) 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 -- 172.21.15.80:0/2529939727 learned_addr learned my addr 172.21.15.80:0/2529939727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc240a1260 0x7fcc241dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc299ee640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc241db190 0x7fcc241db5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 -- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc240a1260 msgr2=0x7fcc241dac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc240a1260 0x7fcc241dac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 -- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc241db190 msgr2=0x7fcc241db5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc241db190 0x7fcc241db5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 -- 172.21.15.80:0/2529939727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc241dbae0 con 0x7fcc100039e0 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc240a1260 0x7fcc241dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc291ed640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc241d8bf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c300 tx=0x7fcc20001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc19ffb640 1 -- 172.21.15.80:0/2529939727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20040020 con 0x7fcc100039e0 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc19ffb640 1 -- 172.21.15.80:0/2529939727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc20007440 con 0x7fcc100039e0 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc241d9bb0 con 0x7fcc100039e0 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.520+0000 7fcc19ffb640 1 -- 172.21.15.80:0/2529939727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20037040 con 0x7fcc100039e0 2024-04-25T15:45:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.521+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc241da170 con 0x7fcc100039e0 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.522+0000 7fcc19ffb640 1 -- 172.21.15.80:0/2529939727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcc20043020 con 0x7fcc100039e0 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.523+0000 7fcc19ffb640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc080744e0 0x7fcc080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.523+0000 7fcc19ffb640 1 -- 172.21.15.80:0/2529939727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fcc200b4e10 con 0x7fcc100039e0 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.523+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc080744e0 0x7fcc080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.523+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc080744e0 0x7fcc080769f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcc140090e0 tx=0x7fcc14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.523+0000 7fcc323e3740 1 Processor -- start 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.524+0000 7fcc323e3740 1 -- start start 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654067600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d65403d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc323e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d653fa1740 con 0x55d653c7a590 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d653f3d3a0 con 0x55d653c723b0 2024-04-25T15:45:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55d653f9d700 con 0x55d653c9b270 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d65403d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d65403d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37620/0 (socket says 172.21.15.80:37620) 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 -- 172.21.15.80:0/749726156 learned_addr learned my addr 172.21.15.80:0/749726156 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc291ed640 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc289ec640 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 -- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 msgr2=0x55d654067600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654067600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 -- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 msgr2=0x55d654063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 -- 172.21.15.80:0/749726156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d653f59750 con 0x55d653c7a590 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc299ee640 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d65403d260 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcc240b8b70 tx=0x7fcc1c001f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671f23543e15e44d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.525+0000 7fcc0effd640 1 -- 172.21.15.80:0/749726156 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c003b80 con 0x55d653c7a590 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc0effd640 1 -- 172.21.15.80:0/749726156 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c003d40 con 0x55d653c7a590 2024-04-25T15:45:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc0effd640 1 -- 172.21.15.80:0/749726156 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c006b50 con 0x55d653c7a590 2024-04-25T15:45:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 -- 172.21.15.80:0/749726156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 msgr2=0x55d65403d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d65403d260 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcc240b8b70 tx=0x7fcc1c001f20 comp rx=0 tx=0).stop 2024-04-25T15:45:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 -- 172.21.15.80:0/749726156 shutdown_connections 2024-04-25T15:45:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d65403d260 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 --2- 172.21.15.80:0/749726156 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654067600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 -- 172.21.15.80:0/749726156 >> 172.21.15.80:0/749726156 conn(0x55d653c8f3c0 msgr2=0x55d65403c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 -- 172.21.15.80:0/749726156 shutdown_connections 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.526+0000 7fcc323e3740 1 -- 172.21.15.80:0/749726156 wait complete. 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.527+0000 7fcc323e3740 1 -- start start 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.527+0000 7fcc323e3740 1 Processor -- start 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654095220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d654082500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654082a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d653f28fe0 con 0x55d653c7a590 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d654061790 con 0x55d653c723b0 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55d6540806c0 con 0x55d653c9b270 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 10 client.0 _ll_register_callbacks cb 0x55d653f3f150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:45:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d654082500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d654082500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37624/0 (socket says 172.21.15.80:37624) 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 -- 172.21.15.80:0/1050170391 learned_addr learned my addr 172.21.15.80:0/1050170391 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654095220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc299ee640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654082a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 -- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 msgr2=0x55d654082a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654082a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 -- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 msgr2=0x55d654095220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654095220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 -- 172.21.15.80:0/1050170391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d653cb32d0 con 0x55d653c7a590 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc299ee640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654082a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654095220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc289ec640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d654082500 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009f10 tx=0x7fcc14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453eeefb387e5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc03fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc03fff640 1 -- 172.21.15.80:0/1050170391 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14026070 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc03fff640 1 -- 172.21.15.80:0/1050170391 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fcc14022630 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.529+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc1c003d40 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc03fff640 1 -- 172.21.15.80:0/1050170391 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc14031050 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 10 client.6426 fetch_fsmap learned FSMap version 28 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55d653d7d6b0 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc03fff640 1 -- 172.21.15.80:0/1050170391 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c003d40 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc03fff640 1 -- 172.21.15.80:0/1050170391 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7fcc14034020 con 0x55d653c7a590 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 10 client.6426 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 10 client.6426 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 20 client.6426 populate_metadata read hostname 'smithi080' 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d653c59e40 0x55d654081320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 4 client.6426 mds_command: new command op to 6255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 --> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d653faf350 con 0x55d653c59e40 2024-04-25T15:45:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d653c59e40 0x55d654081320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.530+0000 7fcc03fff640 10 client.6426 ms_handle_connect on v2:172.21.15.80:6835/4035847402 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc291ed640 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d653c59e40 0x55d654081320 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3c600d7a9d1627 server_cookie=1a0a71ea5f5049a6 in_seq=0 out_seq=0 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc03fff640 1 -- 172.21.15.80:0/1050170391 <== mds.0 v2:172.21.15.80:6835/4035847402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d653faf350 con 0x55d653c59e40 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc03fff640 10 client.6426 handle_command_reply: tid=0 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 client.6426 shutdown 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 msgr2=0x55d654082500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d654082500 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009f10 tx=0x7fcc14004730 comp rx=0 tx=0).stop 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 shutdown_connections 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d653c59e40 0x55d654081320 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d654082a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c7a590 0x55d654082500 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc03fff640 0 client.6426 ms_handle_reset on v2:172.21.15.80:6835/4035847402 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 --2- 172.21.15.80:0/1050170391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c723b0 0x55d654095220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.531+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 >> 172.21.15.80:0/1050170391 conn(0x55d653c8f3c0 msgr2=0x55d654036dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.532+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 shutdown_connections 2024-04-25T15:45:27.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.532+0000 7fcc323e3740 1 -- 172.21.15.80:0/1050170391 wait complete. 2024-04-25T15:45:27.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.532+0000 7fcc323e3740 20 client.6426 trim_cache size 0 max 16384 2024-04-25T15:45:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.550+0000 7fcc323e3740 1 Processor -- start 2024-04-25T15:45:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.550+0000 7fcc323e3740 1 -- start start 2024-04-25T15:45:27.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c7a590 0x55d65403aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d65403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc323e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc24203a20 con 0x55d653c723b0 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc24202a20 con 0x55d653c7a590 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc24201db0 con 0x55d653c9b270 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37638/0 (socket says 172.21.15.80:37638) 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 -- 172.21.15.80:0/252559310 learned_addr learned my addr 172.21.15.80:0/252559310 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc299ee640 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d65403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc289ec640 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c7a590 0x55d65403aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 -- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 msgr2=0x55d65403b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d65403b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 -- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c7a590 msgr2=0x55d65403aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c7a590 0x55d65403aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 -- 172.21.15.80:0/252559310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d65406a970 con 0x55d653c723b0 2024-04-25T15:45:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc291ed640 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcc2007c010 tx=0x7fcc2007e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5317670afebdd4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc0e7fc640 1 -- 172.21.15.80:0/252559310 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2009d070 con 0x55d653c723b0 2024-04-25T15:45:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc0e7fc640 1 -- 172.21.15.80:0/252559310 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200b2030 con 0x55d653c723b0 2024-04-25T15:45:27.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.552+0000 7fcc0e7fc640 1 -- 172.21.15.80:0/252559310 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20083150 con 0x55d653c723b0 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 -- 172.21.15.80:0/252559310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 msgr2=0x55d6540a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcc2007c010 tx=0x7fcc2007e810 comp rx=0 tx=0).stop 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 -- 172.21.15.80:0/252559310 shutdown_connections 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c9b270 0x55d65403b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c7a590 0x55d65403aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 --2- 172.21.15.80:0/252559310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 -- 172.21.15.80:0/252559310 >> 172.21.15.80:0/252559310 conn(0x55d653c8f3c0 msgr2=0x55d654067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 -- 172.21.15.80:0/252559310 shutdown_connections 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.553+0000 7fcc323e3740 1 -- 172.21.15.80:0/252559310 wait complete. 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.554+0000 7fcc323e3740 1 -- start start 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.554+0000 7fcc323e3740 1 Processor -- start 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.555+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.555+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c7a590 0x55d65403e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c9b270 0x55d654060350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d65405d7b0 con 0x55d653c723b0 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc242023d0 con 0x55d653c9b270 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55d65406a720 con 0x55d653c7a590 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 10 client.0 _ll_register_callbacks cb 0x7fcc140096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37640/0 (socket says 172.21.15.80:37640) 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 -- 172.21.15.80:0/2159203287 learned_addr learned my addr 172.21.15.80:0/2159203287 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c7a590 0x55d65403e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc299ee640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c9b270 0x55d654060350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 -- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c7a590 msgr2=0x55d65403e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c7a590 0x55d65403e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 -- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c9b270 msgr2=0x55d654060350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c9b270 0x55d654060350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 -- 172.21.15.80:0/2159203287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d654066be0 con 0x55d653c723b0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc291ed640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcc2007eaa0 tx=0x7fcc2002ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffc68e668a4a897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc03fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc03fff640 1 -- 172.21.15.80:0/2159203287 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2009d070 con 0x55d653c723b0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc03fff640 1 -- 172.21.15.80:0/2159203287 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fcc200878e0 con 0x55d653c723b0 2024-04-25T15:45:27.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc200b2030 con 0x55d653c723b0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc03fff640 1 -- 172.21.15.80:0/2159203287 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc2007eb70 con 0x55d653c723b0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 10 client.6432 fetch_fsmap learned FSMap version 28 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.556+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55d654062f00 con 0x55d653c723b0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc03fff640 1 -- 172.21.15.80:0/2159203287 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200b2030 con 0x55d653c723b0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc03fff640 1 -- 172.21.15.80:0/2159203287 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7fcc200a0020 con 0x55d653c723b0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc323e3740 10 client.6432 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc323e3740 10 client.6432 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc323e3740 20 client.6432 populate_metadata read hostname 'smithi080' 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc323e3740 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d6540823a0 0x55d6540827b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc323e3740 4 client.6432 mds_command: new command op to 6255 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 --> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] -- command(tid 0: {"prefix": "status"}) -- 0x55d654037c50 con 0x55d6540823a0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d6540823a0 0x55d6540827b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc03fff640 10 client.6432 ms_handle_connect on v2:172.21.15.80:6835/4035847402 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc289ec640 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d6540823a0 0x55d6540827b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f59da311aa072748 server_cookie=7a0ea7b8c811ebec in_seq=0 out_seq=0 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.557+0000 7fcc03fff640 1 -- 172.21.15.80:0/2159203287 <== mds.0 v2:172.21.15.80:6835/4035847402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d654037c50 con 0x55d6540823a0 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc03fff640 10 client.6432 handle_command_reply: tid=0 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 client.6432 shutdown 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 msgr2=0x55d6540a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcc2007eaa0 tx=0x7fcc2002ace0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 shutdown_connections 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:6835/4035847402,v1:172.21.15.80:6837/4035847402] conn(0x55d6540823a0 0x55d6540827b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d653c9b270 0x55d654060350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d653c7a590 0x55d65403e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc03fff640 0 client.6432 ms_handle_reset on v2:172.21.15.80:6835/4035847402 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 --2- 172.21.15.80:0/2159203287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d653c723b0 0x55d6540a53b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 >> 172.21.15.80:0/2159203287 conn(0x55d653c8f3c0 msgr2=0x55d65409ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 shutdown_connections 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 1 -- 172.21.15.80:0/2159203287 wait complete. 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc323e3740 20 client.6432 trim_cache size 0 max 16384 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:45:27.565 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 6255, 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 9.1240542710000003, 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 28, 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 63, 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 63, 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 14.457471124 2024-04-25T15:45:27.566 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc080744e0 msgr2=0x7fcc080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.558+0000 7fcc2b451640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc080744e0 0x7fcc080769f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcc140090e0 tx=0x7fcc14008040 comp rx=0 tx=0).stop 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 msgr2=0x7fcc241d8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc241d8bf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c300 tx=0x7fcc20001bc0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 shutdown_connections 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc080744e0 0x7fcc080769f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc241db190 0x7fcc241db5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc240a1260 0x7fcc241dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 --2- 172.21.15.80:0/2529939727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100039e0 0x7fcc241d8bf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 >> 172.21.15.80:0/2529939727 conn(0x7fcc240d0450 msgr2=0x7fcc240d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 shutdown_connections 2024-04-25T15:45:27.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.559+0000 7fcc2b451640 1 -- 172.21.15.80:0/2529939727 wait complete. 2024-04-25T15:45:27.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:45:27.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.677+0000 7f6cf994e640 1 Processor -- start 2024-04-25T15:45:27.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.677+0000 7f6cf994e640 1 -- start start 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf994e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6cf41604d0 0x7f6cf409bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf994e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf40d1ae0 0x7f6cf40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf994e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf40b3fe0 con 0x7f6cf40ccf60 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf994e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf40ce6d0 con 0x7f6cf41604d0 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf994e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf40ce110 con 0x7f6cf40d1ae0 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf37fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cf40ccf60 0x7f6cf40cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58926/0 (socket says 172.21.15.80:58926) 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf37fe640 1 -- 172.21.15.80:0/4144384503 learned_addr learned my addr 172.21.15.80:0/4144384503 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf2ffd640 1 --2- 172.21.15.80:0/4144384503 >> v2:172.21.15.195:3300/0 conn(0x7f6cf41604d0 0x7f6cf409bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf27fc640 1 --2- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf40d1ae0 0x7f6cf40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf1ffb640 1 -- 172.21.15.80:0/4144384503 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168674975 0 0) 0x7f6cf40b3fe0 con 0x7f6cf40ccf60 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.678+0000 7f6cf1ffb640 1 -- 172.21.15.80:0/4144384503 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cdc003520 con 0x7f6cf40ccf60 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.679+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf40d1ae0 msgr2=0x7f6cf40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:27.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.679+0000 7f6cf2ffd640 1 --2- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf40d1ae0 0x7f6cf40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.679+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/4144384503 >> v1:172.21.15.80:6789/0 conn(0x7f6cf40ccf60 legacy=0x7f6cf40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.679+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/4144384503 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf40ce3f0 con 0x7f6cf41604d0 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.679+0000 7f6cf2ffd640 1 --2- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf41604d0 0x7f6cf409bdf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097a0 tx=0x7f6cec02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4d0011554ece7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf1ffb640 1 -- 172.21.15.80:0/4144384503 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec037070 con 0x7f6cf41604d0 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf1ffb640 1 -- 172.21.15.80:0/4144384503 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec032440 con 0x7f6cf41604d0 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf1ffb640 1 -- 172.21.15.80:0/4144384503 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec032810 con 0x7f6cf41604d0 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 -- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf41604d0 msgr2=0x7f6cf409bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 --2- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf41604d0 0x7f6cf409bdf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097a0 tx=0x7f6cec02a180 comp rx=0 tx=0).stop 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 -- 172.21.15.80:0/4144384503 shutdown_connections 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 --2- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf40d1ae0 0x7f6cf40d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 --2- 172.21.15.80:0/4144384503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf41604d0 0x7f6cf409bdf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 -- 172.21.15.80:0/4144384503 >> 172.21.15.80:0/4144384503 conn(0x7f6cf40b7620 msgr2=0x7f6cf40b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 -- 172.21.15.80:0/4144384503 shutdown_connections 2024-04-25T15:45:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.680+0000 7f6cf994e640 1 -- 172.21.15.80:0/4144384503 wait complete. 2024-04-25T15:45:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.682+0000 7f6cf994e640 1 Processor -- start 2024-04-25T15:45:27.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.682+0000 7f6cf994e640 1 -- start start 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.683+0000 7f6cf994e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 0x7f6cf414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.683+0000 7f6cf994e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf40d1ae0 0x7f6cf4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.683+0000 7f6cf994e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf41604d0 0x7f6cf415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.683+0000 7f6cf994e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf40b3b70 con 0x7f6cf40ccf60 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.683+0000 7f6cf994e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf40d2430 con 0x7f6cf40d1ae0 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.683+0000 7f6cf994e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf40b3cf0 con 0x7f6cf41604d0 2024-04-25T15:45:27.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 0x7f6cf414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 0x7f6cf414fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37646/0 (socket says 172.21.15.80:37646) 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/3531698079 learned_addr learned my addr 172.21.15.80:0/3531698079 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf41604d0 msgr2=0x7f6cf415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf41604d0 0x7f6cf415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf40d1ae0 msgr2=0x7f6cf4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf27fc640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf40d1ae0 0x7f6cf4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf40d1ae0 0x7f6cf4159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 -- 172.21.15.80:0/3531698079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf40c9260 con 0x7f6cf40ccf60 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf2ffd640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 0x7f6cf414fdf0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6cec000c00 tx=0x7f6cec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec041020 con 0x7f6cf40ccf60 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec03d6e0 con 0x7f6cf40ccf60 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf4162c50 con 0x7f6cf40ccf60 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec037040 con 0x7f6cf40ccf60 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.684+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf4163210 con 0x7f6cf40ccf60 2024-04-25T15:45:27.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.685+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf406a100 con 0x7f6cf40ccf60 2024-04-25T15:45:27.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.686+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6cec044020 con 0x7f6cf40ccf60 2024-04-25T15:45:27.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.687+0000 7f6cdbfff640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ce00744e0 0x7f6ce00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:27.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.687+0000 7f6cf27fc640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ce00744e0 0x7f6ce00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:27.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.687+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f6cec0b5b20 con 0x7f6cf40ccf60 2024-04-25T15:45:27.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.687+0000 7f6cf27fc640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ce00744e0 0x7f6ce00769f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4159690 tx=0x7f6ce800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:27.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.691+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6cec04b030 con 0x7f6cf40ccf60 2024-04-25T15:45:27.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.903+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6cf40b5100 con 0x7f6cf40ccf60 2024-04-25T15:45:27.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.903+0000 7f6cdbfff640 1 -- 172.21.15.80:0/3531698079 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f6cec080130 con 0x7f6cf40ccf60 2024-04-25T15:45:27.905 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ce00744e0 msgr2=0x7f6ce00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ce00744e0 0x7f6ce00769f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4159690 tx=0x7f6ce800b040 comp rx=0 tx=0).stop 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 msgr2=0x7f6cf414fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 0x7f6cf414fdf0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6cec000c00 tx=0x7f6cec0046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 shutdown_connections 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6ce00744e0 0x7f6ce00769f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cf41604d0 0x7f6cf415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cf40d1ae0 0x7f6cf4159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 --2- 172.21.15.80:0/3531698079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cf40ccf60 0x7f6cf414fdf0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 >> 172.21.15.80:0/3531698079 conn(0x7f6cf40b7620 msgr2=0x7f6cf415eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 shutdown_connections 2024-04-25T15:45:27.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:27.905+0000 7f6cf994e640 1 -- 172.21.15.80:0/3531698079 wait complete. 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:45:27.918 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:45:27.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:27.919 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.934 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:45:27.935 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:45:27.936 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:27.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:27.937 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:45:27.997 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:45:27.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:27.998 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:45:28.054 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:45:28.054 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:45:28.054 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:45:28.054 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:45:28.055 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:45:28.055 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:45:28.055 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:45:28.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:45:28.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:45:28.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:45:28.055 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:45:28.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:28.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:28.178 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:45:28.193 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:45:28.193 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:45:28.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:45:28.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:28.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:45:28.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:28.257 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:28.312 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:45:28.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:28.312 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:28.366 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:45:28.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:28.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:28.458 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:28.459 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:45:28.466 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:28.466 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:45:28.466 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:45:28.467 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:45:28.469 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:45:28.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:28.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:28.493 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:45:28.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:45:28.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:28.593 INFO:teuthology.orchestra.run.smithi080.stdout:client6441 2024-04-25T15:45:28.593 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:28.593 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:28.608 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:45:28.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.755+0000 7f2deb708640 1 Processor -- start 2024-04-25T15:45:28.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.755+0000 7f2deb708640 1 -- start start 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2deb708640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2de4153f70 0x7f2de40b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2deb708640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40b0c00 0x7f2de406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2deb708640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de406df20 con 0x7f2de406db10 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2deb708640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40b1180 con 0x7f2de4153f70 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2deb708640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2de415d4f0 con 0x7f2de40b0c00 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2de4153f70 0x7f2de40b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2de4153f70 0x7f2de40b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37648/0 (socket says 172.21.15.80:37648) 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 -- 172.21.15.80:0/3753829451 learned_addr learned my addr 172.21.15.80:0/3753829451 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de9ca5640 1 --1- 172.21.15.80:0/3753829451 >> v1:172.21.15.80:6789/0 conn(0x7f2de406db10 0x7f2de4160940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58930/0 (socket says 172.21.15.80:58930) 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de8ca3640 1 --2- 172.21.15.80:0/3753829451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40b0c00 0x7f2de406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:28.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 -- 172.21.15.80:0/3753829451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40b0c00 msgr2=0x7f2de406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 --2- 172.21.15.80:0/3753829451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40b0c00 0x7f2de406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 -- 172.21.15.80:0/3753829451 >> v1:172.21.15.80:6789/0 conn(0x7f2de406db10 legacy=0x7f2de4160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.757+0000 7f2de94a4640 1 -- 172.21.15.80:0/3753829451 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de415e270 con 0x7f2de4153f70 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.758+0000 7f2de94a4640 1 --2- 172.21.15.80:0/3753829451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de4153f70 0x7f2de40b06c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d150 tx=0x7f2de002c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72be50030df667cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.758+0000 7f2ddbfff640 1 -- 172.21.15.80:0/3753829451 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0009600 con 0x7f2de4153f70 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.758+0000 7f2ddbfff640 1 -- 172.21.15.80:0/3753829451 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de0037070 con 0x7f2de4153f70 2024-04-25T15:45:28.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.758+0000 7f2ddbfff640 1 -- 172.21.15.80:0/3753829451 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de00099c0 con 0x7f2de4153f70 2024-04-25T15:45:28.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 -- 172.21.15.80:0/3753829451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de4153f70 msgr2=0x7f2de40b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:28.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 --2- 172.21.15.80:0/3753829451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de4153f70 0x7f2de40b06c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d150 tx=0x7f2de002c930 comp rx=0 tx=0).stop 2024-04-25T15:45:28.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 -- 172.21.15.80:0/3753829451 shutdown_connections 2024-04-25T15:45:28.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 --2- 172.21.15.80:0/3753829451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40b0c00 0x7f2de406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 --2- 172.21.15.80:0/3753829451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de4153f70 0x7f2de40b06c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 -- 172.21.15.80:0/3753829451 >> 172.21.15.80:0/3753829451 conn(0x7f2de40d1e20 msgr2=0x7f2de4073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 -- 172.21.15.80:0/3753829451 shutdown_connections 2024-04-25T15:45:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.759+0000 7f2deb708640 1 -- 172.21.15.80:0/3753829451 wait complete. 2024-04-25T15:45:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.760+0000 7f2deb708640 1 Processor -- start 2024-04-25T15:45:28.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.761+0000 7f2deb708640 1 -- start start 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2deb708640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de406db10 0x7f2de413d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2deb708640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 0x7f2de4146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2deb708640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de4153f70 0x7f2de41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2deb708640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40b5710 con 0x7f2de40b0c00 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2deb708640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2de415da70 con 0x7f2de406db10 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2deb708640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40aefe0 con 0x7f2de4153f70 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 0x7f2de4146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:28.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 0x7f2de4146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37652/0 (socket says 172.21.15.80:37652) 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 -- 172.21.15.80:0/3695380904 learned_addr learned my addr 172.21.15.80:0/3695380904 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de9ca5640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de4153f70 0x7f2de41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de94a4640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de406db10 0x7f2de413d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 -- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de4153f70 msgr2=0x7f2de41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de4153f70 0x7f2de41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 -- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de406db10 msgr2=0x7f2de413d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de406db10 0x7f2de413d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 -- 172.21.15.80:0/3695380904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de414fb80 con 0x7f2de40b0c00 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.762+0000 7f2de8ca3640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 0x7f2de4146b60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400d620 tx=0x7f2dd400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.763+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400b620 con 0x7f2de40b0c00 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.763+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd4019070 con 0x7f2de40b0c00 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.763+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400ba00 con 0x7f2de40b0c00 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.763+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de414fe60 con 0x7f2de40b0c00 2024-04-25T15:45:28.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.763+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de4150420 con 0x7f2de40b0c00 2024-04-25T15:45:28.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.764+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de413e050 con 0x7f2de40b0c00 2024-04-25T15:45:28.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.764+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2dd400bba0 con 0x7f2de40b0c00 2024-04-25T15:45:28.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.765+0000 7f2dd9ffb640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc80744e0 0x7f2dc80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:28.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.765+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f2dd4095800 con 0x7f2de40b0c00 2024-04-25T15:45:28.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.765+0000 7f2de94a4640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc80744e0 0x7f2dc80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:28.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.765+0000 7f2de94a4640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc80744e0 0x7f2dc80769f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2de0036000 tx=0x7f2de000b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:28.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.769+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2de413e050 con 0x7f2de40b0c00 2024-04-25T15:45:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.980+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2de406a100 con 0x7f2de40b0c00 2024-04-25T15:45:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.980+0000 7f2dd9ffb640 1 -- 172.21.15.80:0/3695380904 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f2dd405fe00 con 0x7f2de40b0c00 2024-04-25T15:45:28.981 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:45:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc80744e0 msgr2=0x7f2dc80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc80744e0 0x7f2dc80769f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2de0036000 tx=0x7f2de000b000 comp rx=0 tx=0).stop 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 msgr2=0x7f2de4146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 0x7f2de4146b60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400d620 tx=0x7f2dd400dae0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 shutdown_connections 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2dc80744e0 0x7f2dc80769f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de4153f70 0x7f2de41470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de40b0c00 0x7f2de4146b60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 --2- 172.21.15.80:0/3695380904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de406db10 0x7f2de413d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 >> 172.21.15.80:0/3695380904 conn(0x7f2de40d1e20 msgr2=0x7f2de406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 shutdown_connections 2024-04-25T15:45:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:28.982+0000 7f2deb708640 1 -- 172.21.15.80:0/3695380904 wait complete. 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:45:28.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:45:28.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:45:28.995 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:45:28.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:28.995 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.014 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42606sec preferred_lft 42606sec 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:45:29.015 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:29.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:29.017 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:45:29.081 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:45:29.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:29.083 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:45:29.140 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:45:29.140 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:45:29.140 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:45:29.141 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:45:29.141 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:45:29.141 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:45:29.141 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:45:29.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:45:29.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:45:29.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:45:29.141 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:45:29.233 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:45:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:45:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:45:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:29.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:29.270 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:45:29.285 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:45:29.285 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:45:29.285 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:45:29.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:29.286 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:45:29.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:29.349 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:29.404 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:45:29.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:29.404 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:29.458 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:45:29.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:29.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:29.551 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:29.551 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:45:29.559 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:29.559 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:45:29.560 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:45:29.562 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:45:29.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:29.562 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:29.586 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:45:29.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:45:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:45:29.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:45:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:29.683 INFO:teuthology.orchestra.run.smithi195.stdout:client6453 2024-04-25T15:45:29.684 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:29.684 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:29.699 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:45:29.699 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:45:29.743 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:45:29.783 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:45:29.783 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:29.783 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:29.783 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:29.799 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:29.799 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:29.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:30.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.001+0000 7fb821738640 1 Processor -- start 2024-04-25T15:45:30.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.002+0000 7fb821738640 1 -- start start 2024-04-25T15:45:30.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb821738640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb81c071950 0x7fb81c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb821738640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb81c0d2a90 0x7fb81c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb821738640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0d33e0 con 0x7fb81c161c80 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb821738640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb81c072aa0 con 0x7fb81c0d2a90 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb821738640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb81c1624d0 con 0x7fb81c071950 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb81c0d2a90 0x7fb81c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb81c161c80 0x7fb81c0b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58940/0 (socket says 172.21.15.80:58940) 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81a7fc640 1 -- 172.21.15.80:0/2522684149 learned_addr learned my addr 172.21.15.80:0/2522684149 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81affd640 1 --2- 172.21.15.80:0/2522684149 >> v2:172.21.15.195:3300/0 conn(0x7fb81c071950 0x7fb81c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81b7fe640 1 -- 172.21.15.80:0/2522684149 >> v2:172.21.15.195:3300/0 conn(0x7fb81c071950 msgr2=0x7fb81c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81b7fe640 1 --2- 172.21.15.80:0/2522684149 >> v2:172.21.15.195:3300/0 conn(0x7fb81c071950 0x7fb81c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81b7fe640 1 -- 172.21.15.80:0/2522684149 >> v1:172.21.15.80:6789/0 conn(0x7fb81c161c80 legacy=0x7fb81c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb819ffb640 1 -- 172.21.15.80:0/2522684149 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973566208 0 0) 0x7fb810001290 con 0x7fb81c161c80 2024-04-25T15:45:30.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.003+0000 7fb81b7fe640 1 -- 172.21.15.80:0/2522684149 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c1627b0 con 0x7fb81c0d2a90 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.004+0000 7fb81b7fe640 1 --2- 172.21.15.80:0/2522684149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0d2ea0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb81c08cc70 tx=0x7fb81402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f19fe232aa7cb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.004+0000 7fb819ffb640 1 -- 172.21.15.80:0/2522684149 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814037070 con 0x7fb81c0d2a90 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.004+0000 7fb819ffb640 1 -- 172.21.15.80:0/2522684149 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb814032440 con 0x7fb81c0d2a90 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.004+0000 7fb819ffb640 1 -- 172.21.15.80:0/2522684149 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81402ae60 con 0x7fb81c0d2a90 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 -- 172.21.15.80:0/2522684149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c0d2a90 msgr2=0x7fb81c0d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 --2- 172.21.15.80:0/2522684149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0d2ea0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb81c08cc70 tx=0x7fb81402a110 comp rx=0 tx=0).stop 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 -- 172.21.15.80:0/2522684149 shutdown_connections 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 --2- 172.21.15.80:0/2522684149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0d2ea0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 --2- 172.21.15.80:0/2522684149 >> v2:172.21.15.195:3300/0 conn(0x7fb81c071950 0x7fb81c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 -- 172.21.15.80:0/2522684149 >> 172.21.15.80:0/2522684149 conn(0x7fb81c0d3ea0 msgr2=0x7fb81c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 -- 172.21.15.80:0/2522684149 shutdown_connections 2024-04-25T15:45:30.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.005+0000 7fb821738640 1 -- 172.21.15.80:0/2522684149 wait complete. 2024-04-25T15:45:30.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.007+0000 7fb821738640 1 Processor -- start 2024-04-25T15:45:30.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.007+0000 7fb821738640 1 -- start start 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb821738640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb81c071950 0x7fb81c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb821738640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb821738640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 0x7fb81c1e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb821738640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0b7690 con 0x7fb81c161c80 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb821738640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0d2290 con 0x7fb81c0d2a90 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb821738640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c0b7810 con 0x7fb81c071950 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb81b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 0x7fb81c1e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb81b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 0x7fb81c1e7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37676/0 (socket says 172.21.15.80:37676) 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb81b7fe640 1 -- 172.21.15.80:0/3485309484 learned_addr learned my addr 172.21.15.80:0/3485309484 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb81a7fc640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.008+0000 7fb81affd640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb81c071950 0x7fb81c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb81b7fe640 1 -- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb81c071950 msgr2=0x7fb81c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb81b7fe640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb81c071950 0x7fb81c0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb81b7fe640 1 -- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb81c0d2a90 msgr2=0x7fb81c0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb81b7fe640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb81b7fe640 1 -- 172.21.15.80:0/3485309484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c151a00 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb81b7fe640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 0x7fb81c1e7ab0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb814009890 tx=0x7fb8140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814037050 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb814038040 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c151ca0 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814004450 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.009+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c152260 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.010+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c06a100 con 0x7fb81c161c80 2024-04-25T15:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.011+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb81403c6d0 con 0x7fb81c161c80 2024-04-25T15:45:30.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.011+0000 7fb8037fe640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8080744b0 0x7fb8080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.011+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fb8140b5be0 con 0x7fb81c161c80 2024-04-25T15:45:30.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.011+0000 7fb81affd640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8080744b0 0x7fb8080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.012+0000 7fb81affd640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8080744b0 0x7fb8080769c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0d15f0 tx=0x7fb80c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.016+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb81407fc20 con 0x7fb81c161c80 2024-04-25T15:45:30.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.196+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb81c0b9500 con 0x7fb81c161c80 2024-04-25T15:45:30.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.197+0000 7fb8037fe640 1 -- 172.21.15.80:0/3485309484 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16872 (secure 0 0 0) 0x7fb814083f20 con 0x7fb81c161c80 2024-04-25T15:45:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:30.199 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:19.434303+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8080744b0 msgr2=0x7fb8080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8080744b0 0x7fb8080769c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0d15f0 tx=0x7fb80c00b040 comp rx=0 tx=0).stop 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 msgr2=0x7fb81c1e7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 0x7fb81c1e7ab0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb814009890 tx=0x7fb8140046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 shutdown_connections 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8080744b0 0x7fb8080769c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb81c161c80 0x7fb81c1e7ab0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb81c0d2a90 0x7fb81c0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 --2- 172.21.15.80:0/3485309484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb81c071950 0x7fb81c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 >> 172.21.15.80:0/3485309484 conn(0x7fb81c0d3ea0 msgr2=0x7fb81c0b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 shutdown_connections 2024-04-25T15:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.199+0000 7fb821738640 1 -- 172.21.15.80:0/3485309484 wait complete. 2024-04-25T15:45:30.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:45:16.067128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:45:16.752308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:30.212 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.321+0000 7ff3282ca640 1 Processor -- start 2024-04-25T15:45:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.321+0000 7ff3282ca640 1 -- start start 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.322+0000 7ff3282ca640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff32006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.322+0000 7ff3282ca640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3200b37b0 0x7ff32006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.322+0000 7ff3282ca640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3200cfc90 con 0x7ff320163860 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.322+0000 7ff3282ca640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff32006c9a0 con 0x7ff3200b37b0 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.322+0000 7ff3282ca640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3200d2c10 con 0x7ff32006cc10 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3200b37b0 0x7ff32006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3200b37b0 0x7ff32006d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37688/0 (socket says 172.21.15.80:37688) 2024-04-25T15:45:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 -- 172.21.15.80:0/2975169763 learned_addr learned my addr 172.21.15.80:0/2975169763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff326066640 1 --2- 172.21.15.80:0/2975169763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff32006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 -- 172.21.15.80:0/2975169763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 msgr2=0x7ff32006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 --2- 172.21.15.80:0/2975169763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff32006d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 -- 172.21.15.80:0/2975169763 >> v1:172.21.15.195:6789/0 conn(0x7ff320163860 legacy=0x7ff3200d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.323+0000 7ff325865640 1 -- 172.21.15.80:0/2975169763 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3200cff30 con 0x7ff3200b37b0 2024-04-25T15:45:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.324+0000 7ff325865640 1 --2- 172.21.15.80:0/2975169763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff32006d6a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff310009870 tx=0x7ff31002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f58207a286a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.324+0000 7ff325064640 1 -- 172.21.15.80:0/2975169763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310037070 con 0x7ff3200b37b0 2024-04-25T15:45:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.324+0000 7ff325064640 1 -- 172.21.15.80:0/2975169763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310032440 con 0x7ff3200b37b0 2024-04-25T15:45:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.324+0000 7ff325064640 1 -- 172.21.15.80:0/2975169763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310032810 con 0x7ff3200b37b0 2024-04-25T15:45:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 -- 172.21.15.80:0/2975169763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 msgr2=0x7ff32006d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 --2- 172.21.15.80:0/2975169763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff32006d6a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff310009870 tx=0x7ff31002a270 comp rx=0 tx=0).stop 2024-04-25T15:45:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 -- 172.21.15.80:0/2975169763 shutdown_connections 2024-04-25T15:45:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 --2- 172.21.15.80:0/2975169763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff32006d6a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 --2- 172.21.15.80:0/2975169763 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff32006d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 -- 172.21.15.80:0/2975169763 >> 172.21.15.80:0/2975169763 conn(0x7ff32009b410 msgr2=0x7ff3200b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 -- 172.21.15.80:0/2975169763 shutdown_connections 2024-04-25T15:45:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.325+0000 7ff3282ca640 1 -- 172.21.15.80:0/2975169763 wait complete. 2024-04-25T15:45:30.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.326+0000 7ff3282ca640 1 Processor -- start 2024-04-25T15:45:30.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.326+0000 7ff3282ca640 1 -- start start 2024-04-25T15:45:30.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff3282ca640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff320154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff3282ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff3200c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff3282ca640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff320163860 0x7ff3200cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff3282ca640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff320076230 con 0x7ff3200b37b0 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff3282ca640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff32006c670 con 0x7ff320163860 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff3282ca640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3200d1460 con 0x7ff32006cc10 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff3200c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff3200c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37704/0 (socket says 172.21.15.80:37704) 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 -- 172.21.15.80:0/3914655929 learned_addr learned my addr 172.21.15.80:0/3914655929 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff326066640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff320154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff326867640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff320163860 0x7ff3200cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 -- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 msgr2=0x7ff320154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff320154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 -- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff320163860 msgr2=0x7ff3200cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff320163860 0x7ff3200cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 -- 172.21.15.80:0/3914655929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3200c9610 con 0x7ff3200b37b0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff326867640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff320163860 0x7ff3200cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff326066640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff320154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff325865640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff3200c90d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff31002a2b0 tx=0x7ff3100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.328+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310037040 con 0x7ff3200b37b0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.329+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310042070 con 0x7ff3200b37b0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.329+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3200c6d90 con 0x7ff3200b37b0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.329+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310030880 con 0x7ff3200b37b0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.329+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3200c7350 con 0x7ff3200b37b0 2024-04-25T15:45:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.329+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32006a100 con 0x7ff3200b37b0 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.330+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff310030a20 con 0x7ff3200b37b0 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.331+0000 7ff316ffd640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3040744e0 0x7ff3040769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.331+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7ff3100b5cc0 con 0x7ff3200b37b0 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.331+0000 7ff326066640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3040744e0 0x7ff3040769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.331+0000 7ff326066640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3040744e0 0x7ff3040769f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff31c007440 tx=0x7ff31c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.335+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3100802c0 con 0x7ff3200b37b0 2024-04-25T15:45:30.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.509+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3200c9840 con 0x7ff3200b37b0 2024-04-25T15:45:30.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.509+0000 7ff316ffd640 1 -- 172.21.15.80:0/3914655929 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) ==== 93+0+10 (secure 0 0 0) 0x7ff31007fbc0 con 0x7ff3200b37b0 2024-04-25T15:45:30.510 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3040744e0 msgr2=0x7ff3040769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3040744e0 0x7ff3040769f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff31c007440 tx=0x7ff31c00b040 comp rx=0 tx=0).stop 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 msgr2=0x7ff3200c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff3200c90d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff31002a2b0 tx=0x7ff3100046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 shutdown_connections 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3040744e0 0x7ff3040769f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff320163860 0x7ff3200cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3200b37b0 0x7ff3200c90d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 --2- 172.21.15.80:0/3914655929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff32006cc10 0x7ff320154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 >> 172.21.15.80:0/3914655929 conn(0x7ff32009b410 msgr2=0x7ff3200b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 shutdown_connections 2024-04-25T15:45:30.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.511+0000 7ff3282ca640 1 -- 172.21.15.80:0/3914655929 wait complete. 2024-04-25T15:45:30.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:45:30.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.632+0000 7f06a3b72640 1 Processor -- start 2024-04-25T15:45:30.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.632+0000 7f06a3b72640 1 -- start start 2024-04-25T15:45:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a3b72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f069c15f170 0x7f069c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a3b72640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069c161a00 con 0x7f069c070c10 2024-04-25T15:45:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a3b72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069c161ce0 con 0x7f069c06dce0 2024-04-25T15:45:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a3b72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f069c0d1530 con 0x7f069c15f170 2024-04-25T15:45:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a190e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f069c15f170 0x7f069c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a110d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f069c070c10 0x7f069c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58952/0 (socket says 172.21.15.80:58952) 2024-04-25T15:45:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.633+0000 7f06a110d640 1 -- 172.21.15.80:0/4101996029 learned_addr learned my addr 172.21.15.80:0/4101996029 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.634+0000 7f06a190e640 1 -- 172.21.15.80:0/4101996029 >> v1:172.21.15.195:6789/0 conn(0x7f069c06dce0 legacy=0x7f069c0ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.634+0000 7f06a190e640 1 -- 172.21.15.80:0/4101996029 >> v1:172.21.15.80:6789/0 conn(0x7f069c070c10 legacy=0x7f069c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.634+0000 7f06a190e640 1 -- 172.21.15.80:0/4101996029 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c161fc0 con 0x7f069c15f170 2024-04-25T15:45:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.634+0000 7f06a090c640 1 -- 172.21.15.80:0/4101996029 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666335112 0 0) 0x7f069c161a00 con 0x7f069c070c10 2024-04-25T15:45:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.634+0000 7f06a190e640 1 --2- 172.21.15.80:0/4101996029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c15f170 0x7f069c0d0ff0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f06980097a0 tx=0x7f069802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c22c1e50bacc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.634+0000 7f06a090c640 1 -- 172.21.15.80:0/4101996029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698037070 con 0x7f069c15f170 2024-04-25T15:45:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a090c640 1 -- 172.21.15.80:0/4101996029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698032440 con 0x7f069c15f170 2024-04-25T15:45:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a090c640 1 -- 172.21.15.80:0/4101996029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698032810 con 0x7f069c15f170 2024-04-25T15:45:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 -- 172.21.15.80:0/4101996029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c15f170 msgr2=0x7f069c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 --2- 172.21.15.80:0/4101996029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c15f170 0x7f069c0d0ff0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f06980097a0 tx=0x7f069802a230 comp rx=0 tx=0).stop 2024-04-25T15:45:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 -- 172.21.15.80:0/4101996029 shutdown_connections 2024-04-25T15:45:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 --2- 172.21.15.80:0/4101996029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c15f170 0x7f069c0d0ff0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 -- 172.21.15.80:0/4101996029 >> 172.21.15.80:0/4101996029 conn(0x7f069c0734b0 msgr2=0x7f069c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 -- 172.21.15.80:0/4101996029 shutdown_connections 2024-04-25T15:45:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.635+0000 7f06a3b72640 1 -- 172.21.15.80:0/4101996029 wait complete. 2024-04-25T15:45:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.637+0000 7f06a3b72640 1 Processor -- start 2024-04-25T15:45:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.637+0000 7f06a3b72640 1 -- start start 2024-04-25T15:45:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a3b72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 0x7f069c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a3b72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f069c15f170 0x7f069c147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a3b72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c06c5c0 0x7f069c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a3b72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f069c071020 con 0x7f069c070c10 2024-04-25T15:45:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a3b72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f069c162610 con 0x7f069c06c5c0 2024-04-25T15:45:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a3b72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f069c0711a0 con 0x7f069c15f170 2024-04-25T15:45:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.638+0000 7f06a190e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 0x7f069c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 0x7f069c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37724/0 (socket says 172.21.15.80:37724) 2024-04-25T15:45:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 -- 172.21.15.80:0/97939669 learned_addr learned my addr 172.21.15.80:0/97939669 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a210f640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c06c5c0 0x7f069c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a110d640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f069c15f170 0x7f069c147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 -- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f069c15f170 msgr2=0x7f069c147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f069c15f170 0x7f069c147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 -- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c06c5c0 msgr2=0x7f069c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c06c5c0 0x7f069c06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 -- 172.21.15.80:0/97939669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c15a440 con 0x7f069c070c10 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a210f640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c06c5c0 0x7f069c06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a190e640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 0x7f069c154b40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0698000c00 tx=0x7f06980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698037040 con 0x7f069c070c10 2024-04-25T15:45:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698042070 con 0x7f069c070c10 2024-04-25T15:45:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069c06cf10 con 0x7f069c070c10 2024-04-25T15:45:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698030a70 con 0x7f069c070c10 2024-04-25T15:45:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.639+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069c157a40 con 0x7f069c070c10 2024-04-25T15:45:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.640+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069c06a100 con 0x7f069c070c10 2024-04-25T15:45:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.641+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0698030c10 con 0x7f069c070c10 2024-04-25T15:45:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.641+0000 7f06927fc640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06800744b0 0x7f06800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.641+0000 7f06a110d640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06800744b0 0x7f06800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.641+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f06980b5f10 con 0x7f069c070c10 2024-04-25T15:45:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.642+0000 7f06a110d640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06800744b0 0x7f06800769c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f069c06d5a0 tx=0x7f068c007d20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.646+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f069c06cf10 con 0x7f069c070c10 2024-04-25T15:45:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.822+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f069c074570 con 0x7f069c070c10 2024-04-25T15:45:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.823+0000 7f06927fc640 1 -- 172.21.15.80:0/97939669 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) ==== 104+0+11 (secure 0 0 0) 0x7f0698080510 con 0x7f069c070c10 2024-04-25T15:45:30.824 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:45:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06800744b0 msgr2=0x7f06800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06800744b0 0x7f06800769c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f069c06d5a0 tx=0x7f068c007d20 comp rx=0 tx=0).stop 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 msgr2=0x7f069c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 0x7f069c154b40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0698000c00 tx=0x7f06980046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 shutdown_connections 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f06800744b0 0x7f06800769c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c06c5c0 0x7f069c06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f069c15f170 0x7f069c147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 --2- 172.21.15.80:0/97939669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c070c10 0x7f069c154b40 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 >> 172.21.15.80:0/97939669 conn(0x7f069c0734b0 msgr2=0x7f069c0af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 shutdown_connections 2024-04-25T15:45:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.825+0000 7f06a3b72640 1 -- 172.21.15.80:0/97939669 wait complete. 2024-04-25T15:45:30.837 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:45:30.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.947+0000 7f02cf1ee640 1 Processor -- start 2024-04-25T15:45:30.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.947+0000 7f02cf1ee640 1 -- start start 2024-04-25T15:45:30.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02cf1ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f02c80d2190 0x7f02c809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02cf1ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c8160760 con 0x7f02c80d3110 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02cf1ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c80b3410 con 0x7f02c809b410 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02cf1ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f02c809b920 con 0x7f02c80d2190 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f02c80d3110 0x7f02c80cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58968/0 (socket says 172.21.15.80:58968) 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c7fff640 1 -- 172.21.15.80:0/1426882288 learned_addr learned my addr 172.21.15.80:0/1426882288 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229143587 0 0) 0x7f02c8160760 con 0x7f02c80d3110 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b0003520 con 0x7f02c80d3110 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02cd78b640 1 --2- 172.21.15.80:0/1426882288 >> v2:172.21.15.195:3300/0 conn(0x7f02c80d2190 0x7f02c809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3771260578 0 0) 0x7f02b0003520 con 0x7f02c80d3110 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 >> v2:172.21.15.195:3300/0 conn(0x7f02c80d2190 msgr2=0x7f02c809bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:30.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 --2- 172.21.15.80:0/1426882288 >> v2:172.21.15.195:3300/0 conn(0x7f02c80d2190 0x7f02c809bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 >> v1:172.21.15.195:6789/0 conn(0x7f02c809b410 legacy=0x7f02c80d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c80b3c00 con 0x7f02c80d3110 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f02bc001690 con 0x7f02c80d3110 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.949+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 >> v1:172.21.15.80:6789/0 conn(0x7f02c80d3110 legacy=0x7f02c80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c77fe640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b00039b0 0x7f02b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c77fe640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b0004800 0x7f02b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c77fe640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00051c0 0x7f02b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02c809b920 con 0x7f02b00039b0 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f02b000c160 con 0x7f02b00051c0 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02b000c360 con 0x7f02b0004800 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b00039b0 0x7f02b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02cd78b640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00051c0 0x7f02b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02c7fff640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b0004800 0x7f02b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02ccf8a640 1 -- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b0004800 msgr2=0x7f02b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02b0004800 0x7f02b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02ccf8a640 1 -- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00051c0 msgr2=0x7f02b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00051c0 0x7f02b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02cd78b640 1 -- 172.21.15.80:0/1426882288 reap_dead start 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.950+0000 7f02ccf8a640 1 -- 172.21.15.80:0/1426882288 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b0003520 con 0x7f02b00039b0 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b00039b0 0x7f02b0003e20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f02b8001750 tx=0x7f02b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c766c9af3d06d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8001370 con 0x7f02b00039b0 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b80052d0 con 0x7f02b00039b0 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02c77fe640 1 -- 172.21.15.80:0/1426882288 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b802ab00 con 0x7f02b00039b0 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1426882288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b00039b0 msgr2=0x7f02b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b00039b0 0x7f02b0003e20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f02b8001750 tx=0x7f02b0005830 comp rx=0 tx=0).stop 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1426882288 shutdown_connections 2024-04-25T15:45:30.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1426882288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02b00039b0 0x7f02b0003e20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1426882288 >> 172.21.15.80:0/1426882288 conn(0x7f02c80b7620 msgr2=0x7f02c80b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:30.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1426882288 shutdown_connections 2024-04-25T15:45:30.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.951+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1426882288 wait complete. 2024-04-25T15:45:30.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.953+0000 7f02cf1ee640 1 Processor -- start 2024-04-25T15:45:30.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.953+0000 7f02cf1ee640 1 -- start start 2024-04-25T15:45:30.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00039b0 0x7f02c809ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02c814ec80 0x7f02c806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 0x7f02c8161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02c80cea40 con 0x7f02c806d8f0 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f02c80b41a0 con 0x7f02b00039b0 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02c809bdf0 con 0x7f02c814ec80 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 0x7f02c8161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 0x7f02c8161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37746/0 (socket says 172.21.15.80:37746) 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 -- 172.21.15.80:0/1341203107 learned_addr learned my addr 172.21.15.80:0/1341203107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00039b0 0x7f02c809ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02c7fff640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02c814ec80 0x7f02c806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 -- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02c814ec80 msgr2=0x7f02c806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02c814ec80 0x7f02c806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 -- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00039b0 msgr2=0x7f02c809ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00039b0 0x7f02c809ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 -- 172.21.15.80:0/1341203107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c806dd00 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02c7fff640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02c814ec80 0x7f02c806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cd78b640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 0x7f02c8161600 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f02c8073d30 tx=0x7f02c000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c000fdb0 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c001d070 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c8151740 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0015670 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.955+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c8151d00 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.957+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c806a100 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.957+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f02c0015810 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.957+0000 7f02c57fa640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02b40744b0 0x7f02b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.958+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f02c0095ee0 con 0x7f02c806d8f0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.958+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02b40744b0 0x7f02b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.958+0000 7f02ccf8a640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02b40744b0 0x7f02b40769c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f02b8032000 tx=0x7f02b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:30.962+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02c0027020 con 0x7f02c806d8f0 2024-04-25T15:45:31.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.136+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f02c80cffb0 con 0x7f02c806d8f0 2024-04-25T15:45:31.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.137+0000 7f02c57fa640 1 -- 172.21.15.80:0/1341203107 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) ==== 100+0+11 (secure 0 0 0) 0x7f02c806dd00 con 0x7f02c806d8f0 2024-04-25T15:45:31.138 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02b40744b0 msgr2=0x7f02b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02b40744b0 0x7f02b40769c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f02b8032000 tx=0x7f02b802e000 comp rx=0 tx=0).stop 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 msgr2=0x7f02c8161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 0x7f02c8161600 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f02c8073d30 tx=0x7f02c000f580 comp rx=0 tx=0).stop 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 shutdown_connections 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02b40744b0 0x7f02b40769c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02c806d8f0 0x7f02c8161600 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02c814ec80 0x7f02c806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 --2- 172.21.15.80:0/1341203107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02b00039b0 0x7f02c809ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 >> 172.21.15.80:0/1341203107 conn(0x7f02c80b7620 msgr2=0x7f02c80d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:31.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 shutdown_connections 2024-04-25T15:45:31.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.139+0000 7f02cf1ee640 1 -- 172.21.15.80:0/1341203107 wait complete. 2024-04-25T15:45:31.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:45:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.258+0000 7fe900b35640 1 Processor -- start 2024-04-25T15:45:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.258+0000 7fe900b35640 1 -- start start 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe900b35640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 0x7fe8fc09bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe900b35640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe8fc0cee60 0x7fe8fc0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe900b35640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8fc0b3fe0 con 0x7fe8fc1604d0 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe900b35640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe8fc0ce6d0 con 0x7fe8fc0cee60 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe900b35640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ce110 con 0x7fe8fc0d21f0 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8fa59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe8fc1604d0 0x7fe8fc0d1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58976/0 (socket says 172.21.15.80:58976) 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8fa59c640 1 -- 172.21.15.80:0/1081062209 learned_addr learned my addr 172.21.15.80:0/1081062209 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8fad9d640 1 --2- 172.21.15.80:0/1081062209 >> v2:172.21.15.195:3300/0 conn(0x7fe8fc0cee60 0x7fe8fc0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8f9d9b640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 0x7fe8fc09bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085917748 0 0) 0x7fe8fc0b3fe0 con 0x7fe8fc1604d0 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e4003520 con 0x7fe8fc1604d0 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.260+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1343555366 0 0) 0x7fe8e4003520 con 0x7fe8fc1604d0 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 msgr2=0x7fe8fc09bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 0x7fe8fc09bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 >> v2:172.21.15.195:3300/0 conn(0x7fe8fc0cee60 msgr2=0x7fe8fc0cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 --2- 172.21.15.80:0/1081062209 >> v2:172.21.15.195:3300/0 conn(0x7fe8fc0cee60 0x7fe8fc0cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc0ce3f0 con 0x7fe8fc1604d0 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe8ec0019f0 con 0x7fe8fc1604d0 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fad9d640 1 --2- 172.21.15.80:0/1081062209 >> v2:172.21.15.195:3300/0 conn(0x7fe8fc0cee60 0x7fe8fc0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 >> v1:172.21.15.80:6789/0 conn(0x7fe8fc1604d0 legacy=0x7fe8fc0d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4004800 0x7fe8e4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 0x7fe8e4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ce6d0 con 0x7fe8e40039b0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ce110 con 0x7fe8e4004800 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e400b9c0 con 0x7fe8fc0d21f0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fa59c640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8f9d9b640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4004800 0x7fe8e4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fad9d640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 0x7fe8e4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fa59c640 1 -- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 msgr2=0x7fe8e4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fa59c640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8fc0d21f0 0x7fe8e4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fa59c640 1 -- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4004800 msgr2=0x7fe8e4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fa59c640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4004800 0x7fe8e4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.261+0000 7fe8fa59c640 1 -- 172.21.15.80:0/1081062209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e4003520 con 0x7fe8e40039b0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.262+0000 7fe8fa59c640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003e20 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00a920 tx=0x7fe8e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b47b15212779bee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.262+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec00a4c0 con 0x7fe8e40039b0 2024-04-25T15:45:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.262+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec02f070 con 0x7fe8e40039b0 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.262+0000 7fe8f959a640 1 -- 172.21.15.80:0/1081062209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec02bd20 con 0x7fe8e40039b0 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe900b35640 1 -- 172.21.15.80:0/1081062209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e40039b0 msgr2=0x7fe8e4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe900b35640 1 --2- 172.21.15.80:0/1081062209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8e40039b0 0x7fe8e4003e20 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00a920 tx=0x7fe8e4005830 comp rx=0 tx=0).stop 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe8fad9d640 1 -- 172.21.15.80:0/1081062209 reap_dead start 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe900b35640 1 -- 172.21.15.80:0/1081062209 shutdown_connections 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe900b35640 1 -- 172.21.15.80:0/1081062209 >> 172.21.15.80:0/1081062209 conn(0x7fe8fc0b7620 msgr2=0x7fe8fc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe900b35640 1 -- 172.21.15.80:0/1081062209 shutdown_connections 2024-04-25T15:45:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.263+0000 7fe900b35640 1 -- 172.21.15.80:0/1081062209 wait complete. 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.265+0000 7fe900b35640 1 Processor -- start 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.265+0000 7fe900b35640 1 -- start start 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe900b35640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8e40039b0 0x7fe8fc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe900b35640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8fc1f9680 0x7fe8fc15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe900b35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 0x7fe8fc162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe900b35640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0b3cf0 con 0x7fe8fc161f60 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe900b35640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0b3b70 con 0x7fe8fc1f9680 2024-04-25T15:45:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe900b35640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc09bdf0 con 0x7fe8e40039b0 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 0x7fe8fc162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 0x7fe8fc162370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37766/0 (socket says 172.21.15.80:37766) 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 -- 172.21.15.80:0/2648080787 learned_addr learned my addr 172.21.15.80:0/2648080787 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8f9d9b640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8fc1f9680 0x7fe8fc15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 -- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8e40039b0 msgr2=0x7fe8fc0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8e40039b0 0x7fe8fc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 -- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8fc1f9680 msgr2=0x7fe8fc15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8fc1f9680 0x7fe8fc15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 -- 172.21.15.80:0/2648080787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc1628b0 con 0x7fe8fc161f60 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.266+0000 7fe8fad9d640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 0x7fe8fc162370 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0b8630 tx=0x7fe8f4011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.267+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f400fad0 con 0x7fe8fc161f60 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.267+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f401c070 con 0x7fe8fc161f60 2024-04-25T15:45:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.267+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4014440 con 0x7fe8fc161f60 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.267+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc0c77e0 con 0x7fe8fc161f60 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.267+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc1fa090 con 0x7fe8fc161f60 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.268+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc0c79b0 con 0x7fe8fc161f60 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.268+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe8f4012040 con 0x7fe8fc161f60 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.269+0000 7fe8eaffd640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8dc0744e0 0x7fe8dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.269+0000 7fe8fa59c640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8dc0744e0 0x7fe8dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.269+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fe8f4095370 con 0x7fe8fc161f60 2024-04-25T15:45:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.269+0000 7fe8fa59c640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8dc0744e0 0x7fe8dc0769f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec033000 tx=0x7fe8ec038040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.273+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe8fc1628b0 con 0x7fe8fc161f60 2024-04-25T15:45:31.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.459+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8fc06a100 con 0x7fe8fc161f60 2024-04-25T15:45:31.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.459+0000 7fe8eaffd640 1 -- 172.21.15.80:0/2648080787 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) ==== 80+0+0 (secure 0 0 0) 0x7fe8f405f970 con 0x7fe8fc161f60 2024-04-25T15:45:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8dc0744e0 msgr2=0x7fe8dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8dc0744e0 0x7fe8dc0769f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec033000 tx=0x7fe8ec038040 comp rx=0 tx=0).stop 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 msgr2=0x7fe8fc162370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 0x7fe8fc162370 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0b8630 tx=0x7fe8f4011e30 comp rx=0 tx=0).stop 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 shutdown_connections 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe8dc0744e0 0x7fe8dc0769f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8fc161f60 0x7fe8fc162370 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8fc1f9680 0x7fe8fc15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 --2- 172.21.15.80:0/2648080787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe8e40039b0 0x7fe8fc0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.461+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 >> 172.21.15.80:0/2648080787 conn(0x7fe8fc0b7620 msgr2=0x7fe8fc0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:31.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.462+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 shutdown_connections 2024-04-25T15:45:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.462+0000 7fe900b35640 1 -- 172.21.15.80:0/2648080787 wait complete. 2024-04-25T15:45:31.473 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:45:31.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:31.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:31.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:45:31.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:31.501 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:45:31.557 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:31.557 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:31.557 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:31.576 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:31.576 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:31.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:31.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.741+0000 7fd632aaf640 1 Processor -- start 2024-04-25T15:45:31.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.741+0000 7fd632aaf640 1 -- start start 2024-04-25T15:45:31.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd632aaf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd62c153f70 0x7fd62c0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd632aaf640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd62c0b0c00 0x7fd62c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd632aaf640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c06df20 con 0x7fd62c06db10 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd632aaf640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c0b1180 con 0x7fd62c153f70 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd632aaf640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c15d4f0 con 0x7fd62c0b0c00 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd63084b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd62c153f70 0x7fd62c0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.742+0000 7fd63104c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd62c06db10 0x7fd62c160940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58992/0 (socket says 172.21.15.80:58992) 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd63104c640 1 -- 172.21.15.80:0/1741739802 learned_addr learned my addr 172.21.15.80:0/1741739802 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd62bfff640 1 --2- 172.21.15.80:0/1741739802 >> v2:172.21.15.195:3300/0 conn(0x7fd62c0b0c00 0x7fd62c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd63084b640 1 -- 172.21.15.80:0/1741739802 >> v2:172.21.15.195:3300/0 conn(0x7fd62c0b0c00 msgr2=0x7fd62c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd63084b640 1 --2- 172.21.15.80:0/1741739802 >> v2:172.21.15.195:3300/0 conn(0x7fd62c0b0c00 0x7fd62c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd63084b640 1 -- 172.21.15.80:0/1741739802 >> v1:172.21.15.80:6789/0 conn(0x7fd62c06db10 legacy=0x7fd62c160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd62b7fe640 1 -- 172.21.15.80:0/1741739802 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972729628 0 0) 0x7fd624001490 con 0x7fd62c06db10 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.743+0000 7fd63084b640 1 -- 172.21.15.80:0/1741739802 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c15e270 con 0x7fd62c153f70 2024-04-25T15:45:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd63084b640 1 --2- 172.21.15.80:0/1741739802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b06c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0d2740 tx=0x7fd62002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d1b7973593aa6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:31.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd62b7fe640 1 -- 172.21.15.80:0/1741739802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620037070 con 0x7fd62c153f70 2024-04-25T15:45:31.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd62b7fe640 1 -- 172.21.15.80:0/1741739802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd620032440 con 0x7fd62c153f70 2024-04-25T15:45:31.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd62b7fe640 1 -- 172.21.15.80:0/1741739802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620032810 con 0x7fd62c153f70 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 -- 172.21.15.80:0/1741739802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 msgr2=0x7fd62c0b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1741739802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b06c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0d2740 tx=0x7fd62002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 -- 172.21.15.80:0/1741739802 shutdown_connections 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1741739802 >> v2:172.21.15.195:3300/0 conn(0x7fd62c0b0c00 0x7fd62c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1741739802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b06c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 -- 172.21.15.80:0/1741739802 >> 172.21.15.80:0/1741739802 conn(0x7fd62c0d1e20 msgr2=0x7fd62c073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.744+0000 7fd632aaf640 1 -- 172.21.15.80:0/1741739802 shutdown_connections 2024-04-25T15:45:31.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.745+0000 7fd632aaf640 1 -- 172.21.15.80:0/1741739802 wait complete. 2024-04-25T15:45:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.746+0000 7fd632aaf640 1 Processor -- start 2024-04-25T15:45:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.746+0000 7fd632aaf640 1 -- start start 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd62c06db10 0x7fd62c14a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd62c0b0c00 0x7fd62c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0b5710 con 0x7fd62c153f70 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c15da70 con 0x7fd62c0b0c00 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0aefe0 con 0x7fd62c06db10 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37788/0 (socket says 172.21.15.80:37788) 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 -- 172.21.15.80:0/1485304643 learned_addr learned my addr 172.21.15.80:0/1485304643 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:31.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd62bfff640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd62c0b0c00 0x7fd62c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63084b640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd62c06db10 0x7fd62c14a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 -- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd62c06db10 msgr2=0x7fd62c14a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd62c06db10 0x7fd62c14a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 -- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd62c0b0c00 msgr2=0x7fd62c0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd62c0b0c00 0x7fd62c0b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 -- 172.21.15.80:0/1485304643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c14b580 con 0x7fd62c153f70 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd63104c640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b27d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c730 tx=0x7fd62400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624018070 con 0x7fd62c153f70 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62400ce40 con 0x7fd62c153f70 2024-04-25T15:45:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62400a880 con 0x7fd62c153f70 2024-04-25T15:45:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.748+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c14b860 con 0x7fd62c153f70 2024-04-25T15:45:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.749+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c14be20 con 0x7fd62c153f70 2024-04-25T15:45:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.749+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c06a100 con 0x7fd62c153f70 2024-04-25T15:45:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.750+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd62401b070 con 0x7fd62c153f70 2024-04-25T15:45:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.750+0000 7fd6297fa640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6100744b0 0x7fd6100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.751+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fd624094900 con 0x7fd62c153f70 2024-04-25T15:45:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.751+0000 7fd63084b640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6100744b0 0x7fd6100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.751+0000 7fd63084b640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6100744b0 0x7fd6100769c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd620034000 tx=0x7fd62002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:31.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.755+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd62c06df20 con 0x7fd62c153f70 2024-04-25T15:45:31.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.929+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd62c0746d0 con 0x7fd62c153f70 2024-04-25T15:45:31.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.930+0000 7fd6297fa640 1 -- 172.21.15.80:0/1485304643 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16872 (secure 0 0 0) 0x7fd62405ef90 con 0x7fd62c153f70 2024-04-25T15:45:31.931 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:31.931 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:19.434303+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:31.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6100744b0 msgr2=0x7fd6100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6100744b0 0x7fd6100769c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd620034000 tx=0x7fd62002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:31.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 msgr2=0x7fd62c0b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:31.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b27d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c730 tx=0x7fd62400cbf0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 shutdown_connections 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd6100744b0 0x7fd6100769c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd62c153f70 0x7fd62c0b27d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd62c0b0c00 0x7fd62c0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 --2- 172.21.15.80:0/1485304643 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd62c06db10 0x7fd62c14a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 >> 172.21.15.80:0/1485304643 conn(0x7fd62c0d1e20 msgr2=0x7fd62c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 shutdown_connections 2024-04-25T15:45:31.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:31.932+0000 7fd632aaf640 1 -- 172.21.15.80:0/1485304643 wait complete. 2024-04-25T15:45:31.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:45:16.067128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:45:16.752308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:31.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:32.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.054+0000 7f44155ee640 1 Processor -- start 2024-04-25T15:45:32.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.054+0000 7f44155ee640 1 -- start start 2024-04-25T15:45:32.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f44155ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4410161870 0x7f4410160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f44155ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4410163f60 con 0x7f44100d23c0 2024-04-25T15:45:32.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f44155ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4410164240 con 0x7f44100d1c70 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f44155ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4410164520 con 0x7f4410161870 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f440effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4410161870 0x7f4410160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f440e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f44100d23c0 0x7f44100d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58994/0 (socket says 172.21.15.80:58994) 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f440effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4410161870 0x7f4410160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37792/0 (socket says 172.21.15.80:37792) 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.055+0000 7f440e7fc640 1 -- 172.21.15.80:0/748806428 learned_addr learned my addr 172.21.15.80:0/748806428 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440effd640 1 -- 172.21.15.80:0/748806428 >> v1:172.21.15.195:6789/0 conn(0x7f44100d1c70 legacy=0x7f441006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440effd640 1 -- 172.21.15.80:0/748806428 >> v1:172.21.15.80:6789/0 conn(0x7f44100d23c0 legacy=0x7f44100d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440effd640 1 -- 172.21.15.80:0/748806428 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410164800 con 0x7f4410161870 2024-04-25T15:45:32.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440effd640 1 --2- 172.21.15.80:0/748806428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4410161870 0x7f4410160280 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f44000097a0 tx=0x7f440002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835b065b8c92fb3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440dffb640 1 -- 172.21.15.80:0/748806428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400037070 con 0x7f4410161870 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440dffb640 1 -- 172.21.15.80:0/748806428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4400032440 con 0x7f4410161870 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.056+0000 7f440dffb640 1 -- 172.21.15.80:0/748806428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400032810 con 0x7f4410161870 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 -- 172.21.15.80:0/748806428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4410161870 msgr2=0x7f4410160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 --2- 172.21.15.80:0/748806428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4410161870 0x7f4410160280 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f44000097a0 tx=0x7f440002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 -- 172.21.15.80:0/748806428 shutdown_connections 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 --2- 172.21.15.80:0/748806428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4410161870 0x7f4410160280 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 -- 172.21.15.80:0/748806428 >> 172.21.15.80:0/748806428 conn(0x7f44100b54a0 msgr2=0x7f44100b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 -- 172.21.15.80:0/748806428 shutdown_connections 2024-04-25T15:45:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.057+0000 7f44155ee640 1 -- 172.21.15.80:0/748806428 wait complete. 2024-04-25T15:45:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.059+0000 7f44155ee640 1 Processor -- start 2024-04-25T15:45:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.059+0000 7f44155ee640 1 -- start start 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f44155ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44100d1c70 0x7f4410150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f44155ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 0x7f4410151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f44155ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4410161870 0x7f44100b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f44155ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f44100d2950 con 0x7f44100d23c0 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f44155ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f44100d27d0 con 0x7f44100d1c70 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f44155ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f44100d2ad0 con 0x7f4410161870 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f440e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 0x7f4410151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.060+0000 7f440e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 0x7f4410151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37796/0 (socket says 172.21.15.80:37796) 2024-04-25T15:45:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 -- 172.21.15.80:0/1052705196 learned_addr learned my addr 172.21.15.80:0/1052705196 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440effd640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44100d1c70 0x7f4410150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440f7fe640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4410161870 0x7f44100b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 -- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4410161870 msgr2=0x7f44100b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4410161870 0x7f44100b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 -- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44100d1c70 msgr2=0x7f4410150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44100d1c70 0x7f4410150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 -- 172.21.15.80:0/1052705196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410151320 con 0x7f44100d23c0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440effd640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44100d1c70 0x7f4410150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f440e7fc640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 0x7f4410151850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f440400c3c0 tx=0x7f440400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404017070 con 0x7f44100d23c0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4404005ce0 con 0x7f44100d23c0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4410151d90 con 0x7f44100d23c0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44040072f0 con 0x7f44100d23c0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.061+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44100c8f10 con 0x7f44100d23c0 2024-04-25T15:45:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.062+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441006a100 con 0x7f44100d23c0 2024-04-25T15:45:32.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.063+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f440401a070 con 0x7f44100d23c0 2024-04-25T15:45:32.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.063+0000 7f43f77fe640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43fc0744b0 0x7f43fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.063+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f4404094770 con 0x7f44100d23c0 2024-04-25T15:45:32.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.063+0000 7f440effd640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43fc0744b0 0x7f43fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.064+0000 7f440effd640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43fc0744b0 0x7f43fc0769c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4400034000 tx=0x7f440002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.068+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f440405ed70 con 0x7f44100d23c0 2024-04-25T15:45:32.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.240+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f441006edc0 con 0x7f44100d23c0 2024-04-25T15:45:32.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.240+0000 7f43f77fe640 1 -- 172.21.15.80:0/1052705196 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) ==== 93+0+10 (secure 0 0 0) 0x7f440405e670 con 0x7f44100d23c0 2024-04-25T15:45:32.241 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:32.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43fc0744b0 msgr2=0x7f43fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43fc0744b0 0x7f43fc0769c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4400034000 tx=0x7f440002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 msgr2=0x7f4410151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 0x7f4410151850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f440400c3c0 tx=0x7f440400c880 comp rx=0 tx=0).stop 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 shutdown_connections 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43fc0744b0 0x7f43fc0769c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4410161870 0x7f44100b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44100d23c0 0x7f4410151850 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 --2- 172.21.15.80:0/1052705196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44100d1c70 0x7f4410150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 >> 172.21.15.80:0/1052705196 conn(0x7f44100b54a0 msgr2=0x7f44100d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 shutdown_connections 2024-04-25T15:45:32.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.242+0000 7f44155ee640 1 -- 172.21.15.80:0/1052705196 wait complete. 2024-04-25T15:45:32.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:45:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.364+0000 7f208114d640 1 Processor -- start 2024-04-25T15:45:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.364+0000 7f208114d640 1 -- start start 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f208114d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f207c0b2f90 0x7f207c0ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f208114d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f207c163e40 0x7f207c160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f208114d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207c164670 con 0x7f207c0d3870 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f208114d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f207c164950 con 0x7f207c163e40 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f208114d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f207c164c30 con 0x7f207c0b2f90 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f207259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f207c163e40 0x7f207c160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f207b59e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f207c0d3870 0x7f207c0d3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59010/0 (socket says 172.21.15.80:59010) 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.365+0000 7f207b59e640 1 -- 172.21.15.80:0/3089473622 learned_addr learned my addr 172.21.15.80:0/3089473622 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207ad9d640 1 --2- 172.21.15.80:0/3089473622 >> v2:172.21.15.195:3300/0 conn(0x7f207c0b2f90 0x7f207c0ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207259c640 1 -- 172.21.15.80:0/3089473622 >> v2:172.21.15.195:3300/0 conn(0x7f207c0b2f90 msgr2=0x7f207c0ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207259c640 1 --2- 172.21.15.80:0/3089473622 >> v2:172.21.15.195:3300/0 conn(0x7f207c0b2f90 0x7f207c0ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207259c640 1 -- 172.21.15.80:0/3089473622 >> v1:172.21.15.80:6789/0 conn(0x7f207c0d3870 legacy=0x7f207c0d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207259c640 1 -- 172.21.15.80:0/3089473622 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c06db50 con 0x7f207c163e40 2024-04-25T15:45:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207a59c640 1 -- 172.21.15.80:0/3089473622 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109287029 0 0) 0x7f207c164670 con 0x7f207c0d3870 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.366+0000 7f207259c640 1 --2- 172.21.15.80:0/3089473622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c163e40 0x7f207c160140 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f207c08ccc0 tx=0x7f206402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e61364be71c160 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f207a59c640 1 -- 172.21.15.80:0/3089473622 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2064037070 con 0x7f207c163e40 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f207a59c640 1 -- 172.21.15.80:0/3089473622 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2064032440 con 0x7f207c163e40 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f207a59c640 1 -- 172.21.15.80:0/3089473622 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206402ae60 con 0x7f207c163e40 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 -- 172.21.15.80:0/3089473622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c163e40 msgr2=0x7f207c160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 --2- 172.21.15.80:0/3089473622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c163e40 0x7f207c160140 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f207c08ccc0 tx=0x7f206402a110 comp rx=0 tx=0).stop 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 -- 172.21.15.80:0/3089473622 shutdown_connections 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 --2- 172.21.15.80:0/3089473622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c163e40 0x7f207c160140 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 --2- 172.21.15.80:0/3089473622 >> v2:172.21.15.195:3300/0 conn(0x7f207c0b2f90 0x7f207c0ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 -- 172.21.15.80:0/3089473622 >> 172.21.15.80:0/3089473622 conn(0x7f207c0b5510 msgr2=0x7f207c0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 -- 172.21.15.80:0/3089473622 shutdown_connections 2024-04-25T15:45:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.367+0000 7f208114d640 1 -- 172.21.15.80:0/3089473622 wait complete. 2024-04-25T15:45:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.369+0000 7f208114d640 1 Processor -- start 2024-04-25T15:45:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.369+0000 7f208114d640 1 -- start start 2024-04-25T15:45:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 0x7f207c1f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f207c0d3870 0x7f207c1ec360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207c163e40 0x7f207c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f207c1643d0 con 0x7f207c0b2f90 2024-04-25T15:45:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f207c164250 con 0x7f207c163e40 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f207c06e350 con 0x7f207c0d3870 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 0x7f207c1f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 0x7f207c1f9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37814/0 (socket says 172.21.15.80:37814) 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 -- 172.21.15.80:0/2786468117 learned_addr learned my addr 172.21.15.80:0/2786468117 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207b59e640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207c163e40 0x7f207c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207259c640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f207c0d3870 0x7f207c1ec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 -- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f207c0d3870 msgr2=0x7f207c1ec360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f207c0d3870 0x7f207c1ec360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 -- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207c163e40 msgr2=0x7f207c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207c163e40 0x7f207c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 -- 172.21.15.80:0/2786468117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c1636e0 con 0x7f207c0b2f90 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207259c640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f207c0d3870 0x7f207c1ec360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f207ad9d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 0x7f207c1f9cc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f206c00d5d0 tx=0x7f206c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c004240 con 0x7f207c0b2f90 2024-04-25T15:45:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c0043e0 con 0x7f207c0b2f90 2024-04-25T15:45:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207c1fa740 con 0x7f207c0b2f90 2024-04-25T15:45:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c003830 con 0x7f207c0b2f90 2024-04-25T15:45:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.371+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207c161e60 con 0x7f207c0b2f90 2024-04-25T15:45:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.372+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207c06a100 con 0x7f207c0b2f90 2024-04-25T15:45:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.373+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f206c0039d0 con 0x7f207c0b2f90 2024-04-25T15:45:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.373+0000 7f2073fff640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f205c0744b0 0x7f205c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.374+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f206c095610 con 0x7f207c0b2f90 2024-04-25T15:45:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.374+0000 7f207259c640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f205c0744b0 0x7f205c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.374+0000 7f207259c640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f205c0744b0 0x7f205c0769c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2064034000 tx=0x7f206402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.378+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f206c05fca0 con 0x7f207c0b2f90 2024-04-25T15:45:32.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.551+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f207c0b9960 con 0x7f207c0b2f90 2024-04-25T15:45:32.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.552+0000 7f2073fff640 1 -- 172.21.15.80:0/2786468117 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) ==== 104+0+11 (secure 0 0 0) 0x7f206c05f5a0 con 0x7f207c0b2f90 2024-04-25T15:45:32.553 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:45:32.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f205c0744b0 msgr2=0x7f205c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f205c0744b0 0x7f205c0769c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2064034000 tx=0x7f206402e000 comp rx=0 tx=0).stop 2024-04-25T15:45:32.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 msgr2=0x7f207c1f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 0x7f207c1f9cc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f206c00d5d0 tx=0x7f206c00da90 comp rx=0 tx=0).stop 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 shutdown_connections 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f205c0744b0 0x7f205c0769c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207c163e40 0x7f207c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f207c0d3870 0x7f207c1ec360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 --2- 172.21.15.80:0/2786468117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f207c0b2f90 0x7f207c1f9cc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 >> 172.21.15.80:0/2786468117 conn(0x7f207c0b5510 msgr2=0x7f207c15b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 shutdown_connections 2024-04-25T15:45:32.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.554+0000 7f208114d640 1 -- 172.21.15.80:0/2786468117 wait complete. 2024-04-25T15:45:32.566 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:45:32.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.677+0000 7f02e604c640 1 Processor -- start 2024-04-25T15:45:32.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.678+0000 7f02e604c640 1 -- start start 2024-04-25T15:45:32.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02e604c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02e00d2190 0x7f02e009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02e604c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e0160760 con 0x7f02e009b410 2024-04-25T15:45:32.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02e604c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e00b3410 con 0x7f02e00d3110 2024-04-25T15:45:32.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02e604c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f02e009b920 con 0x7f02e00d2190 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02dffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02e00d2190 0x7f02e009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02df7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f02e009b410 0x7f02e00d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59022/0 (socket says 172.21.15.80:59022) 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02df7fe640 1 -- 172.21.15.80:0/213284289 learned_addr learned my addr 172.21.15.80:0/213284289 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02dffff640 1 -- 172.21.15.80:0/213284289 >> v1:172.21.15.195:6789/0 conn(0x7f02e00d3110 legacy=0x7f02e00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02dffff640 1 -- 172.21.15.80:0/213284289 >> v1:172.21.15.80:6789/0 conn(0x7f02e009b410 legacy=0x7f02e00d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02de7fc640 1 -- 172.21.15.80:0/213284289 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595850364 0 0) 0x7f02e0160760 con 0x7f02e009b410 2024-04-25T15:45:32.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.679+0000 7f02dffff640 1 -- 172.21.15.80:0/213284289 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e00b3c00 con 0x7f02e00d2190 2024-04-25T15:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.680+0000 7f02dffff640 1 --2- 172.21.15.80:0/213284289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e00d2190 0x7f02e009bdf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009d90 tx=0x7f02d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d09b614fcfc1291 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.680+0000 7f02de7fc640 1 -- 172.21.15.80:0/213284289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8007740 con 0x7f02e00d2190 2024-04-25T15:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.680+0000 7f02de7fc640 1 -- 172.21.15.80:0/213284289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d80078e0 con 0x7f02e00d2190 2024-04-25T15:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.680+0000 7f02de7fc640 1 -- 172.21.15.80:0/213284289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8007cb0 con 0x7f02e00d2190 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 -- 172.21.15.80:0/213284289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e00d2190 msgr2=0x7f02e009bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 --2- 172.21.15.80:0/213284289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e00d2190 0x7f02e009bdf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009d90 tx=0x7f02d802a6a0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 -- 172.21.15.80:0/213284289 shutdown_connections 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 --2- 172.21.15.80:0/213284289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e00d2190 0x7f02e009bdf0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 -- 172.21.15.80:0/213284289 >> 172.21.15.80:0/213284289 conn(0x7f02e00b7620 msgr2=0x7f02e00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 -- 172.21.15.80:0/213284289 shutdown_connections 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.681+0000 7f02e604c640 1 -- 172.21.15.80:0/213284289 wait complete. 2024-04-25T15:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.683+0000 7f02e604c640 1 Processor -- start 2024-04-25T15:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.683+0000 7f02e604c640 1 -- start start 2024-04-25T15:45:32.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02e604c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 0x7f02e01f9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02e604c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00d2190 0x7f02e0160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02e604c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00d3110 0x7f02e0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02e604c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02e00cea40 con 0x7f02e009b410 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02e604c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f02e00b41a0 con 0x7f02e00d2190 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02e604c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02e00cf670 con 0x7f02e00d3110 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 0x7f02e01f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 0x7f02e01f9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37828/0 (socket says 172.21.15.80:37828) 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 -- 172.21.15.80:0/329377316 learned_addr learned my addr 172.21.15.80:0/329377316 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02deffd640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00d2190 0x7f02e0160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02dffff640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00d3110 0x7f02e0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 -- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00d3110 msgr2=0x7f02e0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00d3110 0x7f02e0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 -- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00d2190 msgr2=0x7f02e0160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.684+0000 7f02df7fe640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00d2190 0x7f02e0160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02df7fe640 1 -- 172.21.15.80:0/329377316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e0161200 con 0x7f02e009b410 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02deffd640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00d2190 0x7f02e0160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02df7fe640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 0x7f02e01f9270 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f02d000c430 tx=0x7f02d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0017070 con 0x7f02e009b410 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d0005ce0 con 0x7f02e009b410 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e01614e0 con 0x7f02e009b410 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0007310 con 0x7f02e009b410 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.685+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e0161aa0 con 0x7f02e009b410 2024-04-25T15:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.686+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e006a100 con 0x7f02e009b410 2024-04-25T15:45:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.686+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f02d001a070 con 0x7f02e009b410 2024-04-25T15:45:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.687+0000 7f02c7fff640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02cc0744e0 0x7f02cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.687+0000 7f02deffd640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02cc0744e0 0x7f02cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.687+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f02d00947a0 con 0x7f02e009b410 2024-04-25T15:45:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.688+0000 7f02deffd640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02cc0744e0 0x7f02cc0769f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02d4006fd0 tx=0x7f02d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.692+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02d005edb0 con 0x7f02e009b410 2024-04-25T15:45:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.865+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f02e0069af0 con 0x7f02e009b410 2024-04-25T15:45:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.865+0000 7f02c7fff640 1 -- 172.21.15.80:0/329377316 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) ==== 100+0+11 (secure 0 0 0) 0x7f02d005e6b0 con 0x7f02e009b410 2024-04-25T15:45:32.866 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:45:32.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02cc0744e0 msgr2=0x7f02cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02cc0744e0 0x7f02cc0769f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02d4006fd0 tx=0x7f02d4008040 comp rx=0 tx=0).stop 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 msgr2=0x7f02e01f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 0x7f02e01f9270 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f02d000c430 tx=0x7f02d000c8f0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 shutdown_connections 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f02cc0744e0 0x7f02cc0769f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00d3110 0x7f02e0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00d2190 0x7f02e0160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 --2- 172.21.15.80:0/329377316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02e009b410 0x7f02e01f9270 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 >> 172.21.15.80:0/329377316 conn(0x7f02e00b7620 msgr2=0x7f02e00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 shutdown_connections 2024-04-25T15:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.867+0000 7f02e604c640 1 -- 172.21.15.80:0/329377316 wait complete. 2024-04-25T15:45:32.880 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:45:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.986+0000 7fe0c8c70640 1 Processor -- start 2024-04-25T15:45:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.986+0000 7fe0c8c70640 1 -- start start 2024-04-25T15:45:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c8c70640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 0x7fe0c40c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c8c70640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe0c40d2260 0x7fe0c40d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c8c70640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c40b2fe0 con 0x7fe0c406c5c0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c8c70640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c40b32c0 con 0x7fe0c40d2260 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c8c70640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c40b35a0 con 0x7fe0c40ceec0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c2d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0c406c5c0 0x7fe0c40b0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59038/0 (socket says 172.21.15.80:59038) 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c2d9d640 1 -- 172.21.15.80:0/2241105989 learned_addr learned my addr 172.21.15.80:0/2241105989 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c1d9b640 1 --2- 172.21.15.80:0/2241105989 >> v2:172.21.15.195:3300/0 conn(0x7fe0c40d2260 0x7fe0c40d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c259c640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 0x7fe0c40c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940816483 0 0) 0x7fe0c40b2fe0 con 0x7fe0c406c5c0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ac003520 con 0x7fe0c406c5c0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2520905410 0 0) 0x7fe0ac003520 con 0x7fe0c406c5c0 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 msgr2=0x7fe0c40c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 0x7fe0c40c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 >> v2:172.21.15.195:3300/0 conn(0x7fe0c40d2260 msgr2=0x7fe0c40d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 --2- 172.21.15.80:0/2241105989 >> v2:172.21.15.195:3300/0 conn(0x7fe0c40d2260 0x7fe0c40d2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c40d1a60 con 0x7fe0c406c5c0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe0bc001670 con 0x7fe0c406c5c0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 >> v1:172.21.15.80:6789/0 conn(0x7fe0c406c5c0 legacy=0x7fe0c40b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.988+0000 7fe0c159a640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ac0039b0 0x7fe0ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c159a640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 0x7fe0ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c159a640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac004d40 0x7fe0ac005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c40b32c0 con 0x7fe0ac004d40 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c40b35a0 con 0x7fe0ac0039b0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ac00ba40 con 0x7fe0c40ceec0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c2d9d640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac004d40 0x7fe0ac005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c259c640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ac0039b0 0x7fe0ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c1d9b640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 0x7fe0ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c2d9d640 1 -- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 msgr2=0x7fe0ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c2d9d640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0c40ceec0 0x7fe0ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c2d9d640 1 -- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ac0039b0 msgr2=0x7fe0ac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c2d9d640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ac0039b0 0x7fe0ac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.989+0000 7fe0c2d9d640 1 -- 172.21.15.80:0/2241105989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac003520 con 0x7fe0ac004d40 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c2d9d640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac004d40 0x7fe0ac005150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00c210 tx=0x7fe0ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a581e6595080cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc007d50 con 0x7fe0ac004d40 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc005ad0 con 0x7fe0ac004d40 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c159a640 1 -- 172.21.15.80:0/2241105989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc007070 con 0x7fe0ac004d40 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2241105989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac004d40 msgr2=0x7fe0ac005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2241105989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac004d40 0x7fe0ac005150 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00c210 tx=0x7fe0ac005830 comp rx=0 tx=0).stop 2024-04-25T15:45:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.990+0000 7fe0c2d9d640 1 -- 172.21.15.80:0/2241105989 reap_dead start 2024-04-25T15:45:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.991+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2241105989 shutdown_connections 2024-04-25T15:45:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.991+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2241105989 >> 172.21.15.80:0/2241105989 conn(0x7fe0c409b410 msgr2=0x7fe0c40b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.991+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2241105989 shutdown_connections 2024-04-25T15:45:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.991+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2241105989 wait complete. 2024-04-25T15:45:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.993+0000 7fe0c8c70640 1 Processor -- start 2024-04-25T15:45:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.993+0000 7fe0c8c70640 1 -- start start 2024-04-25T15:45:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c8c70640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0ac004d40 0x7fe0c40c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c8c70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 0x7fe0c40b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c8c70640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c40cd180 0x7fe0c40cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c8c70640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c40cf450 con 0x7fe0c414c9f0 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c8c70640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c40cf2d0 con 0x7fe0c40cd180 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c8c70640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c406c9d0 con 0x7fe0ac004d40 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 0x7fe0c40b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 0x7fe0c40b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37840/0 (socket says 172.21.15.80:37840) 2024-04-25T15:45:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 -- 172.21.15.80:0/2964285397 learned_addr learned my addr 172.21.15.80:0/2964285397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c2d9d640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c40cd180 0x7fe0c40cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 -- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0ac004d40 msgr2=0x7fe0c40c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0ac004d40 0x7fe0c40c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 -- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c40cd180 msgr2=0x7fe0c40cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c40cd180 0x7fe0c40cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 -- 172.21.15.80:0/2964285397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c40cdad0 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.994+0000 7fe0c1d9b640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 0x7fe0c40b0c50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8011990 tx=0x7fe0b8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.995+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8019070 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.995+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b8004240 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.995+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800f8c0 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.995+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c40c81f0 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.995+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c40c87b0 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.996+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c40c7f60 con 0x7fe0c414c9f0 2024-04-25T15:45:32.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.996+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe0b801c070 con 0x7fe0c414c9f0 2024-04-25T15:45:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.997+0000 7fe0b2ffd640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0a40744b0 0x7fe0a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.997+0000 7fe0c259c640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0a40744b0 0x7fe0a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.997+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fe0b80958c0 con 0x7fe0c414c9f0 2024-04-25T15:45:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:32.997+0000 7fe0c259c640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0a40744b0 0x7fe0a40769c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40742c0 tx=0x7fe0b4009750 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.001+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0c40cdad0 con 0x7fe0c414c9f0 2024-04-25T15:45:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.189+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe0c406a100 con 0x7fe0c414c9f0 2024-04-25T15:45:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.189+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/2964285397 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) ==== 80+0+0 (secure 0 0 0) 0x7fe0b805ff50 con 0x7fe0c414c9f0 2024-04-25T15:45:33.190 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:45:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0a40744b0 msgr2=0x7fe0a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0a40744b0 0x7fe0a40769c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40742c0 tx=0x7fe0b4009750 comp rx=0 tx=0).stop 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 msgr2=0x7fe0c40b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 0x7fe0c40b0c50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8011990 tx=0x7fe0b8011e50 comp rx=0 tx=0).stop 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 shutdown_connections 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0a40744b0 0x7fe0a40769c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c40cd180 0x7fe0c40cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0c414c9f0 0x7fe0c40b0c50 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 --2- 172.21.15.80:0/2964285397 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0ac004d40 0x7fe0c40c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 >> 172.21.15.80:0/2964285397 conn(0x7fe0c409b410 msgr2=0x7fe0c40d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 shutdown_connections 2024-04-25T15:45:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.191+0000 7fe0c8c70640 1 -- 172.21.15.80:0/2964285397 wait complete. 2024-04-25T15:45:33.203 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:45:33.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:33.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:33.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:45:33.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:33.236 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:45:33.294 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:33.294 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:33.294 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:33.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:45:33.310 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:45:33.310 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:33.311 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:33.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:45:33.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:33.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.461+0000 7f4ad56a8640 1 Processor -- start 2024-04-25T15:45:33.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.461+0000 7f4ad56a8640 1 -- start start 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4ad56a8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ad00b48d0 0x7f4ad00b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4ad56a8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad00b7fa0 con 0x7f4ad00d41b0 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4ad56a8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad0163fb0 con 0x7f4ad00b7b90 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4ad56a8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad0164270 con 0x7f4ad00b48d0 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4aceffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4ad00d41b0 0x7f4ad01602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59054/0 (socket says 172.21.15.80:59054) 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4aceffd640 1 -- 172.21.15.80:0/3639185281 learned_addr learned my addr 172.21.15.80:0/3639185281 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/3639185281 >> v2:172.21.15.195:3300/0 conn(0x7f4ad00b48d0 0x7f4ad00b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889015893 0 0) 0x7f4ac0001490 con 0x7f4ad00d41b0 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ab8003520 con 0x7f4ad00d41b0 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541247221 0 0) 0x7f4ab8003520 con 0x7f4ad00d41b0 2024-04-25T15:45:33.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 >> v2:172.21.15.195:3300/0 conn(0x7f4ad00b48d0 msgr2=0x7f4ad00b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 --2- 172.21.15.80:0/3639185281 >> v2:172.21.15.195:3300/0 conn(0x7f4ad00b48d0 0x7f4ad00b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 >> v1:172.21.15.195:6789/0 conn(0x7f4ad00b7b90 legacy=0x7f4ad00d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad0164550 con 0x7f4ad00d41b0 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f4ac0001bc0 con 0x7f4ad00d41b0 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 >> v1:172.21.15.80:6789/0 conn(0x7f4ad00d41b0 legacy=0x7f4ad01602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ab80039b0 0x7f4ab8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ab8004800 0x7f4ab8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8005250 0x7f4ab800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0164270 con 0x7f4ab8004800 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab800c1e0 con 0x7f4ab80039b0 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab800c3e0 con 0x7f4ab8005250 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.463+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ab8004800 0x7f4ab8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4aceffd640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ab80039b0 0x7f4ab8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8005250 0x7f4ab800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4ace7fc640 1 -- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8005250 msgr2=0x7f4ab800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8005250 0x7f4ab800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4ace7fc640 1 -- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ab80039b0 msgr2=0x7f4ab8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ab80039b0 0x7f4ab8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4ace7fc640 1 -- 172.21.15.80:0/3639185281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab8003520 con 0x7f4ab8004800 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4acf7fe640 1 -- 172.21.15.80:0/3639185281 reap_dead start 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.464+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ab8004800 0x7f4ab8004c10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00b9010 tx=0x7f4ab8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff39415f13049c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4036070 con 0x7f4ab8004800 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac4031400 con 0x7f4ab8004800 2024-04-25T15:45:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4acdffb640 1 -- 172.21.15.80:0/3639185281 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4009690 con 0x7f4ab8004800 2024-04-25T15:45:33.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 -- 172.21.15.80:0/3639185281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ab8004800 msgr2=0x7f4ab8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ab8004800 0x7f4ab8004c10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00b9010 tx=0x7f4ab8005830 comp rx=0 tx=0).stop 2024-04-25T15:45:33.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 -- 172.21.15.80:0/3639185281 shutdown_connections 2024-04-25T15:45:33.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/3639185281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ab8004800 0x7f4ab8004c10 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 -- 172.21.15.80:0/3639185281 >> 172.21.15.80:0/3639185281 conn(0x7f4ad006e9f0 msgr2=0x7f4ad00d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 -- 172.21.15.80:0/3639185281 shutdown_connections 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.465+0000 7f4ad56a8640 1 -- 172.21.15.80:0/3639185281 wait complete. 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.467+0000 7f4ad56a8640 1 Processor -- start 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.467+0000 7f4ad56a8640 1 -- start start 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.468+0000 7f4ad56a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8004800 0x7f4ad0149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.468+0000 7f4ad56a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 0x7f4ad01f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ad56a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f010 0x7f4ad015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ad56a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad00b4fd0 con 0x7f4ad014d1c0 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ad56a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0164b10 con 0x7f4ad015f010 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ad56a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad00b5150 con 0x7f4ab8004800 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 0x7f4ad01f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 0x7f4ad01f9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37852/0 (socket says 172.21.15.80:37852) 2024-04-25T15:45:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 -- 172.21.15.80:0/1565427848 learned_addr learned my addr 172.21.15.80:0/1565427848 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4aceffd640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8004800 0x7f4ad0149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f010 0x7f4ad015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 -- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8004800 msgr2=0x7f4ad0149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8004800 0x7f4ad0149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 -- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f010 msgr2=0x7f4ad015f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f010 0x7f4ad015f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 -- 172.21.15.80:0/1565427848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad015f960 con 0x7f4ad014d1c0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4acf7fe640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f010 0x7f4ad015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ace7fc640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 0x7f4ad01f9fc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4034040 tx=0x7f4ac4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403f030 con 0x7f4ad014d1c0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac4037040 con 0x7f4ad014d1c0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4036070 con 0x7f4ad014d1c0 2024-04-25T15:45:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad01fac00 con 0x7f4ad014d1c0 2024-04-25T15:45:33.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.469+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad014c9c0 con 0x7f4ad014d1c0 2024-04-25T15:45:33.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.470+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad01fa970 con 0x7f4ad014d1c0 2024-04-25T15:45:33.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.471+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ac4042070 con 0x7f4ad014d1c0 2024-04-25T15:45:33.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.471+0000 7f4ab77fe640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.471+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f4ac40b4a20 con 0x7f4ad014d1c0 2024-04-25T15:45:33.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.471+0000 7f4aceffd640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.472+0000 7f4aceffd640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00012e0 tx=0x7f4ac0006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.476+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ad015f960 con 0x7f4ad014d1c0 2024-04-25T15:45:33.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.686+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ad014c4e0 con 0x7f4ad014d1c0 2024-04-25T15:45:33.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.687+0000 7f4ab77fe640 1 -- 172.21.15.80:0/1565427848 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5188 (secure 0 0 0) 0x7f4ac40870a0 con 0x7f4ad014d1c0 2024-04-25T15:45:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:33.688 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:17.799767+0000","modified":"2024-04-25T15:45:19.804939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4035847402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4035847402},{"type":"v1","addr":"172.21.15.80:6837","nonce":4035847402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":4}]} 2024-04-25T15:45:33.689 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-04-25T15:45:33.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 msgr2=0x7f4abc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00012e0 tx=0x7f4ac0006040 comp rx=0 tx=0).stop 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 msgr2=0x7f4ad01f9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 0x7f4ad01f9fc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4034040 tx=0x7f4ac4004730 comp rx=0 tx=0).stop 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 shutdown_connections 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ad015f010 0x7f4ad015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ad014d1c0 0x7f4ad01f9fc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 --2- 172.21.15.80:0/1565427848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ab8004800 0x7f4ad0149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 >> 172.21.15.80:0/1565427848 conn(0x7f4ad006e9f0 msgr2=0x7f4ad00d5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 shutdown_connections 2024-04-25T15:45:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.689+0000 7f4ad56a8640 1 -- 172.21.15.80:0/1565427848 wait complete. 2024-04-25T15:45:33.701 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:33.708 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:33.746 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.809+0000 7fd584384640 1 Processor -- start 2024-04-25T15:45:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.809+0000 7fd584384640 1 -- start start 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd584384640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd57c071950 0x7fd57c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd584384640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd57c0d2a90 0x7fd57c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd584384640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c0d33e0 con 0x7fd57c161c80 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd584384640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c072aa0 con 0x7fd57c071950 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd584384640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c1624d0 con 0x7fd57c0d2a90 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd582120640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd57c071950 0x7fd57c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.810+0000 7fd582120640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd57c071950 0x7fd57c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37866/0 (socket says 172.21.15.80:37866) 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582120640 1 -- 172.21.15.80:0/3945217925 learned_addr learned my addr 172.21.15.80:0/3945217925 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582120640 1 -- 172.21.15.80:0/3945217925 >> v2:172.21.15.195:3300/0 conn(0x7fd57c0d2a90 msgr2=0x7fd57c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582921640 1 --2- 172.21.15.80:0/3945217925 >> v2:172.21.15.195:3300/0 conn(0x7fd57c0d2a90 0x7fd57c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582120640 1 --2- 172.21.15.80:0/3945217925 >> v2:172.21.15.195:3300/0 conn(0x7fd57c0d2a90 0x7fd57c0d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582120640 1 -- 172.21.15.80:0/3945217925 >> v1:172.21.15.195:6789/0 conn(0x7fd57c161c80 legacy=0x7fd57c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582120640 1 -- 172.21.15.80:0/3945217925 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c1627b0 con 0x7fd57c071950 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.811+0000 7fd582921640 1 --2- 172.21.15.80:0/3945217925 >> v2:172.21.15.195:3300/0 conn(0x7fd57c0d2a90 0x7fd57c0d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd582120640 1 --2- 172.21.15.80:0/3945217925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c072560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0cfff0 tx=0x7fd56c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c06c4c4d0ad9f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd58111e640 1 -- 172.21.15.80:0/3945217925 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c037070 con 0x7fd57c071950 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd58111e640 1 -- 172.21.15.80:0/3945217925 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c032440 con 0x7fd57c071950 2024-04-25T15:45:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd58111e640 1 -- 172.21.15.80:0/3945217925 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c032810 con 0x7fd57c071950 2024-04-25T15:45:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd584384640 1 -- 172.21.15.80:0/3945217925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 msgr2=0x7fd57c072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd584384640 1 --2- 172.21.15.80:0/3945217925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c072560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0cfff0 tx=0x7fd56c02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd584384640 1 -- 172.21.15.80:0/3945217925 shutdown_connections 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd584384640 1 --2- 172.21.15.80:0/3945217925 >> v2:172.21.15.195:3300/0 conn(0x7fd57c0d2a90 0x7fd57c0d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd584384640 1 --2- 172.21.15.80:0/3945217925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c072560 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.812+0000 7fd584384640 1 -- 172.21.15.80:0/3945217925 >> 172.21.15.80:0/3945217925 conn(0x7fd57c0d3ea0 msgr2=0x7fd57c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.813+0000 7fd584384640 1 -- 172.21.15.80:0/3945217925 shutdown_connections 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.813+0000 7fd584384640 1 -- 172.21.15.80:0/3945217925 wait complete. 2024-04-25T15:45:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.814+0000 7fd584384640 1 Processor -- start 2024-04-25T15:45:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.814+0000 7fd584384640 1 -- start start 2024-04-25T15:45:33.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.815+0000 7fd584384640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.815+0000 7fd584384640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd57c0d2a90 0x7fd57c1f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd584384640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd57c161c80 0x7fd57c1e8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd584384640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c0b7690 con 0x7fd57c071950 2024-04-25T15:45:33.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd584384640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c0d2290 con 0x7fd57c0d2a90 2024-04-25T15:45:33.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd584384640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c0b7810 con 0x7fd57c161c80 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c0cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37872/0 (socket says 172.21.15.80:37872) 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 -- 172.21.15.80:0/80717237 learned_addr learned my addr 172.21.15.80:0/80717237 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd58191f640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd57c0d2a90 0x7fd57c1f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582921640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd57c161c80 0x7fd57c1e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 -- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd57c161c80 msgr2=0x7fd57c1e8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd57c161c80 0x7fd57c1e8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 -- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd57c0d2a90 msgr2=0x7fd57c1f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd57c0d2a90 0x7fd57c1f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 -- 172.21.15.80:0/80717237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c0cbe70 con 0x7fd57c071950 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd582120640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c0cb570 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd56c02a1e0 tx=0x7fd56c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c037040 con 0x7fd57c071950 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c042070 con 0x7fd57c071950 2024-04-25T15:45:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c0cc150 con 0x7fd57c071950 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c030b90 con 0x7fd57c071950 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.816+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c1e94b0 con 0x7fd57c071950 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.818+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c1e9710 con 0x7fd57c071950 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.818+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd56c047460 con 0x7fd57c071950 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.818+0000 7fd572ffd640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5600744e0 0x7fd5600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.818+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fd56c0b5e70 con 0x7fd57c071950 2024-04-25T15:45:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.818+0000 7fd58191f640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5600744e0 0x7fd5600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:33.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.819+0000 7fd58191f640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5600744e0 0x7fd5600769f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ca5b0 tx=0x7fd578009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:33.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.823+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd57c0d33e0 con 0x7fd57c071950 2024-04-25T15:45:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:33.999+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd57c06a100 con 0x7fd57c071950 2024-04-25T15:45:34.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.000+0000 7fd572ffd640 1 -- 172.21.15.80:0/80717237 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16872 (secure 0 0 0) 0x7fd56c07feb0 con 0x7fd57c071950 2024-04-25T15:45:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:34.001 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:19.434303+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:34.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5600744e0 msgr2=0x7fd5600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5600744e0 0x7fd5600769f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ca5b0 tx=0x7fd578009060 comp rx=0 tx=0).stop 2024-04-25T15:45:34.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 msgr2=0x7fd57c0cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c0cb570 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd56c02a1e0 tx=0x7fd56c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 shutdown_connections 2024-04-25T15:45:34.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5600744e0 0x7fd5600769f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd57c161c80 0x7fd57c1e8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd57c0d2a90 0x7fd57c1f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 --2- 172.21.15.80:0/80717237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd57c071950 0x7fd57c0cb570 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 >> 172.21.15.80:0/80717237 conn(0x7fd57c0d3ea0 msgr2=0x7fd57c0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 shutdown_connections 2024-04-25T15:45:34.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.002+0000 7fd584384640 1 -- 172.21.15.80:0/80717237 wait complete. 2024-04-25T15:45:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:45:16.067128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:45:16.752308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:34.015 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:34.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.124+0000 7fdb7456c640 1 Processor -- start 2024-04-25T15:45:34.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.124+0000 7fdb7456c640 1 -- start start 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb7456c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdb6c0d0a90 0x7fdb6c168e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb7456c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb6c161b00 con 0x7fdb6c15e060 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb7456c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb6c161dc0 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb7456c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdb6c1620a0 con 0x7fdb6c0d0a90 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb71b07640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdb6c15e060 0x7fdb6c0d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59056/0 (socket says 172.21.15.80:59056) 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb71b07640 1 -- 172.21.15.80:0/3034896355 learned_addr learned my addr 172.21.15.80:0/3034896355 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.125+0000 7fdb72b09640 1 --2- 172.21.15.80:0/3034896355 >> v2:172.21.15.195:3300/0 conn(0x7fdb6c0d0a90 0x7fdb6c168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.126+0000 7fdb71306640 1 -- 172.21.15.80:0/3034896355 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525140888 0 0) 0x7fdb6c161b00 con 0x7fdb6c15e060 2024-04-25T15:45:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.126+0000 7fdb71306640 1 -- 172.21.15.80:0/3034896355 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb58003520 con 0x7fdb6c15e060 2024-04-25T15:45:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.126+0000 7fdb71306640 1 -- 172.21.15.80:0/3034896355 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2895305480 0 0) 0x7fdb58003520 con 0x7fdb6c15e060 2024-04-25T15:45:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.126+0000 7fdb72b09640 1 -- 172.21.15.80:0/3034896355 >> v1:172.21.15.195:6789/0 conn(0x7fdb6c0b2b80 legacy=0x7fdb6c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.126+0000 7fdb72b09640 1 -- 172.21.15.80:0/3034896355 >> v1:172.21.15.80:6789/0 conn(0x7fdb6c15e060 legacy=0x7fdb6c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.126+0000 7fdb72b09640 1 -- 172.21.15.80:0/3034896355 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c162380 con 0x7fdb6c0d0a90 2024-04-25T15:45:34.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.127+0000 7fdb72b09640 1 --2- 172.21.15.80:0/3034896355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c0d0a90 0x7fdb6c168e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009d90 tx=0x7fdb6402a510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=833e4e725229551e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.127+0000 7fdb71306640 1 -- 172.21.15.80:0/3034896355 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64035020 con 0x7fdb6c0d0a90 2024-04-25T15:45:34.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.127+0000 7fdb71306640 1 -- 172.21.15.80:0/3034896355 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb64007540 con 0x7fdb6c0d0a90 2024-04-25T15:45:34.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.127+0000 7fdb71306640 1 -- 172.21.15.80:0/3034896355 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c001670 con 0x7fdb6c0d0a90 2024-04-25T15:45:34.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.127+0000 7fdb7456c640 1 -- 172.21.15.80:0/3034896355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c0d0a90 msgr2=0x7fdb6c168e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.127+0000 7fdb7456c640 1 --2- 172.21.15.80:0/3034896355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c0d0a90 0x7fdb6c168e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009d90 tx=0x7fdb6402a510 comp rx=0 tx=0).stop 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.128+0000 7fdb7456c640 1 -- 172.21.15.80:0/3034896355 shutdown_connections 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.128+0000 7fdb7456c640 1 --2- 172.21.15.80:0/3034896355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c0d0a90 0x7fdb6c168e70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.128+0000 7fdb7456c640 1 -- 172.21.15.80:0/3034896355 >> 172.21.15.80:0/3034896355 conn(0x7fdb6c0b54a0 msgr2=0x7fdb6c0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.128+0000 7fdb7456c640 1 -- 172.21.15.80:0/3034896355 shutdown_connections 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.128+0000 7fdb7456c640 1 -- 172.21.15.80:0/3034896355 wait complete. 2024-04-25T15:45:34.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.129+0000 7fdb7456c640 1 Processor -- start 2024-04-25T15:45:34.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.129+0000 7fdb7456c640 1 -- start start 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 0x7fdb6c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb6c0d0a90 0x7fdb6c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c15e060 0x7fdb6c148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c0d32f0 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c162940 con 0x7fdb6c15e060 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb6c0d3470 con 0x7fdb6c0d0a90 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 0x7fdb6c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 0x7fdb6c1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37878/0 (socket says 172.21.15.80:37878) 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 -- 172.21.15.80:0/1892987461 learned_addr learned my addr 172.21.15.80:0/1892987461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb71b07640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb6c0d0a90 0x7fdb6c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72b09640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c15e060 0x7fdb6c148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 -- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb6c0d0a90 msgr2=0x7fdb6c0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb6c0d0a90 0x7fdb6c0cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 -- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c15e060 msgr2=0x7fdb6c148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c15e060 0x7fdb6c148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 -- 172.21.15.80:0/1892987461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c0c6e70 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72b09640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c15e060 0x7fdb6c148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb72308640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 0x7fdb6c1584a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c580 tx=0x7fdb6800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68017070 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb680035f0 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.131+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c0c7540 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.132+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680039e0 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.132+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c1579c0 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.133+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c06a100 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.133+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdb6801a070 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.134+0000 7fdb62ffd640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdb500744b0 0x7fdb500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.134+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fdb68094810 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.134+0000 7fdb71b07640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdb500744b0 0x7fdb500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.134+0000 7fdb71b07640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdb500744b0 0x7fdb500769c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c153940 tx=0x7fdb5c001d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.138+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb6805e860 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.311+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdb6c0d1c50 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.311+0000 7fdb62ffd640 1 -- 172.21.15.80:0/1892987461 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) ==== 93+0+10 (secure 0 0 0) 0x7fdb68062b60 con 0x7fdb6c0b2b80 2024-04-25T15:45:34.313 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.313+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdb500744b0 msgr2=0x7fdb500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.313+0000 7fdb7456c640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdb500744b0 0x7fdb500769c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c153940 tx=0x7fdb5c001d80 comp rx=0 tx=0).stop 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.313+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 msgr2=0x7fdb6c1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.313+0000 7fdb7456c640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 0x7fdb6c1584a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c580 tx=0x7fdb6800ca40 comp rx=0 tx=0).stop 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 shutdown_connections 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdb500744b0 0x7fdb500769c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c15e060 0x7fdb6c148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb6c0d0a90 0x7fdb6c0cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 --2- 172.21.15.80:0/1892987461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb6c0b2b80 0x7fdb6c1584a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 >> 172.21.15.80:0/1892987461 conn(0x7fdb6c0b54a0 msgr2=0x7fdb6c0d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 shutdown_connections 2024-04-25T15:45:34.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.314+0000 7fdb7456c640 1 -- 172.21.15.80:0/1892987461 wait complete. 2024-04-25T15:45:34.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:45:34.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.435+0000 7fc2dd667640 1 Processor -- start 2024-04-25T15:45:34.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.435+0000 7fc2dd667640 1 -- start start 2024-04-25T15:45:34.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2dd667640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc2d80d0b00 0x7fc2d80d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2dd667640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d81643f0 con 0x7fc2d80d2b80 2024-04-25T15:45:34.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2dd667640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d81646d0 con 0x7fc2d80b5490 2024-04-25T15:45:34.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2dd667640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d81649b0 con 0x7fc2d80d0b00 2024-04-25T15:45:34.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d67fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc2d80d0b00 0x7fc2d80d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc2d80d2b80 0x7fc2d80d47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33192/0 (socket says 172.21.15.80:33192) 2024-04-25T15:45:34.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d77fe640 1 -- 172.21.15.80:0/472503385 learned_addr learned my addr 172.21.15.80:0/472503385 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:34.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d67fc640 1 -- 172.21.15.80:0/472503385 >> v1:172.21.15.195:6789/0 conn(0x7fc2d80b5490 legacy=0x7fc2d8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d67fc640 1 -- 172.21.15.80:0/472503385 >> v1:172.21.15.80:6789/0 conn(0x7fc2d80d2b80 legacy=0x7fc2d80d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d67fc640 1 -- 172.21.15.80:0/472503385 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8164c90 con 0x7fc2d80d0b00 2024-04-25T15:45:34.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.437+0000 7fc2d5ffb640 1 -- 172.21.15.80:0/472503385 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153612355 0 0) 0x7fc2d81643f0 con 0x7fc2d80d2b80 2024-04-25T15:45:34.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.438+0000 7fc2d67fc640 1 --2- 172.21.15.80:0/472503385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d0b00 0x7fc2d80d2640 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097a0 tx=0x7fc2cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d320a220be16cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.438+0000 7fc2d5ffb640 1 -- 172.21.15.80:0/472503385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc037070 con 0x7fc2d80d0b00 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.438+0000 7fc2d5ffb640 1 -- 172.21.15.80:0/472503385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc032440 con 0x7fc2d80d0b00 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.438+0000 7fc2d5ffb640 1 -- 172.21.15.80:0/472503385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc032810 con 0x7fc2d80d0b00 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 -- 172.21.15.80:0/472503385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d0b00 msgr2=0x7fc2d80d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 --2- 172.21.15.80:0/472503385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d0b00 0x7fc2d80d2640 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097a0 tx=0x7fc2cc02a230 comp rx=0 tx=0).stop 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 -- 172.21.15.80:0/472503385 shutdown_connections 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 --2- 172.21.15.80:0/472503385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d0b00 0x7fc2d80d2640 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 -- 172.21.15.80:0/472503385 >> 172.21.15.80:0/472503385 conn(0x7fc2d806e650 msgr2=0x7fc2d806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 -- 172.21.15.80:0/472503385 shutdown_connections 2024-04-25T15:45:34.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.439+0000 7fc2dd667640 1 -- 172.21.15.80:0/472503385 wait complete. 2024-04-25T15:45:34.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.441+0000 7fc2dd667640 1 Processor -- start 2024-04-25T15:45:34.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.441+0000 7fc2dd667640 1 -- start start 2024-04-25T15:45:34.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2dd667640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d80d0b00 0x7fc2d8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2dd667640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 0x7fc2d8150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2dd667640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b8090 0x7fc2d80ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2dd667640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80b94e0 con 0x7fc2d80d2b80 2024-04-25T15:45:34.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2dd667640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80b9360 con 0x7fc2d80d0b00 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2dd667640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d8163f80 con 0x7fc2d80b8090 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 0x7fc2d8150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 0x7fc2d8150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40236/0 (socket says 172.21.15.80:40236) 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 -- 172.21.15.80:0/1895571623 learned_addr learned my addr 172.21.15.80:0/1895571623 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d6ffd640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d80d0b00 0x7fc2d8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d77fe640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b8090 0x7fc2d80ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 -- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b8090 msgr2=0x7fc2d80ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b8090 0x7fc2d80ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 -- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d80d0b00 msgr2=0x7fc2d8150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d80d0b00 0x7fc2d8150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 -- 172.21.15.80:0/1895571623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d81508d0 con 0x7fc2d80d2b80 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d77fe640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b8090 0x7fc2d80ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:34.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.442+0000 7fc2d67fc640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 0x7fc2d8150e00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.443+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc041070 con 0x7fc2d80d2b80 2024-04-25T15:45:34.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.443+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc03c930 con 0x7fc2d80d2b80 2024-04-25T15:45:34.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.443+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d80b6ff0 con 0x7fc2d80d2b80 2024-04-25T15:45:34.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.443+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc037040 con 0x7fc2d80d2b80 2024-04-25T15:45:34.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.443+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d80b75b0 con 0x7fc2d80d2b80 2024-04-25T15:45:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.444+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d806a100 con 0x7fc2d80d2b80 2024-04-25T15:45:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.444+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc2cc044070 con 0x7fc2d80d2b80 2024-04-25T15:45:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.445+0000 7fc2bf7fe640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc2c40744b0 0x7fc2c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.445+0000 7fc2d6ffd640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc2c40744b0 0x7fc2c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.445+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fc2cc0b6000 con 0x7fc2d80d2b80 2024-04-25T15:45:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.445+0000 7fc2d6ffd640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc2c40744b0 0x7fc2c40769c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80012e0 tx=0x7fc2c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.449+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2cc080600 con 0x7fc2d80d2b80 2024-04-25T15:45:34.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.627+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc2d815e970 con 0x7fc2d80d2b80 2024-04-25T15:45:34.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.628+0000 7fc2bf7fe640 1 -- 172.21.15.80:0/1895571623 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) ==== 104+0+11 (secure 0 0 0) 0x7fc2cc07ff00 con 0x7fc2d80d2b80 2024-04-25T15:45:34.629 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc2c40744b0 msgr2=0x7fc2c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc2c40744b0 0x7fc2c40769c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80012e0 tx=0x7fc2c8009040 comp rx=0 tx=0).stop 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 msgr2=0x7fc2d8150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 0x7fc2d8150e00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 shutdown_connections 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc2c40744b0 0x7fc2c40769c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b8090 0x7fc2d80ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2d80d2b80 0x7fc2d8150e00 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 --2- 172.21.15.80:0/1895571623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d80d0b00 0x7fc2d8150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 >> 172.21.15.80:0/1895571623 conn(0x7fc2d806e650 msgr2=0x7fc2d80ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 shutdown_connections 2024-04-25T15:45:34.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.630+0000 7fc2dd667640 1 -- 172.21.15.80:0/1895571623 wait complete. 2024-04-25T15:45:34.642 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:45:34.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.750+0000 7f3f44051640 1 Processor -- start 2024-04-25T15:45:34.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.750+0000 7f3f44051640 1 -- start start 2024-04-25T15:45:34.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f44051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f44051640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f3c0718d0 0x7f3f3c0d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f44051640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3c0b3290 con 0x7f3f3c0d3160 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f44051640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3f3c072400 con 0x7f3f3c0718d0 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f44051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c0d2790 con 0x7f3f3c0727c0 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f3c0718d0 0x7f3f3c0d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f3c0718d0 0x7f3f3c0d2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40238/0 (socket says 172.21.15.80:40238) 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 -- 172.21.15.80:0/1119182523 learned_addr learned my addr 172.21.15.80:0/1119182523 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f41ded640 1 --2- 172.21.15.80:0/1119182523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 -- 172.21.15.80:0/1119182523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 msgr2=0x7f3f3c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 --2- 172.21.15.80:0/1119182523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 -- 172.21.15.80:0/1119182523 >> v1:172.21.15.195:6789/0 conn(0x7f3f3c0d3160 legacy=0x7f3f3c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.752+0000 7f3f415ec640 1 -- 172.21.15.80:0/1119182523 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c072120 con 0x7f3f3c0718d0 2024-04-25T15:45:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.753+0000 7f3f415ec640 1 --2- 172.21.15.80:0/1119182523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0d2c20 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c072580 tx=0x7f3f2c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68222cec96dfb4ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.753+0000 7f3f40deb640 1 -- 172.21.15.80:0/1119182523 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c037070 con 0x7f3f3c0718d0 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.753+0000 7f3f40deb640 1 -- 172.21.15.80:0/1119182523 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c032440 con 0x7f3f3c0718d0 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.753+0000 7f3f40deb640 1 -- 172.21.15.80:0/1119182523 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c032810 con 0x7f3f3c0718d0 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 -- 172.21.15.80:0/1119182523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0718d0 msgr2=0x7f3f3c0d2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 --2- 172.21.15.80:0/1119182523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0d2c20 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c072580 tx=0x7f3f2c02a1c0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 -- 172.21.15.80:0/1119182523 shutdown_connections 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 --2- 172.21.15.80:0/1119182523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0d2c20 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 --2- 172.21.15.80:0/1119182523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 -- 172.21.15.80:0/1119182523 >> 172.21.15.80:0/1119182523 conn(0x7f3f3c0d3a30 msgr2=0x7f3f3c0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 -- 172.21.15.80:0/1119182523 shutdown_connections 2024-04-25T15:45:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.754+0000 7f3f44051640 1 -- 172.21.15.80:0/1119182523 wait complete. 2024-04-25T15:45:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.756+0000 7f3f44051640 1 Processor -- start 2024-04-25T15:45:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.756+0000 7f3f44051640 1 -- start start 2024-04-25T15:45:34.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f44051640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f44051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f44051640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 0x7f3f3c158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f44051640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c071ce0 con 0x7f3f3c0d3160 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f44051640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c0d2420 con 0x7f3f3c0718d0 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f44051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c071e60 con 0x7f3f3c0727c0 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 0x7f3f3c158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 0x7f3f3c158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40254/0 (socket says 172.21.15.80:40254) 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 -- 172.21.15.80:0/2953336652 learned_addr learned my addr 172.21.15.80:0/2953336652 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f41ded640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 -- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 msgr2=0x7f3f3c158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f415ec640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 -- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f3c0718d0 msgr2=0x7f3f3c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f425ee640 1 -- 172.21.15.80:0/2953336652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c0ccca0 con 0x7f3f3c0d3160 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.757+0000 7f3f41ded640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.758+0000 7f3f425ee640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 0x7f3f3c158990 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400c3c0 tx=0x7f3f3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.758+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34017070 con 0x7f3f3c0d3160 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.758+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f340052f0 con 0x7f3f3c0d3160 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.758+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34003850 con 0x7f3f3c0d3160 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.758+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3c159120 con 0x7f3f3c0d3160 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.758+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3c1596e0 con 0x7f3f3c0d3160 2024-04-25T15:45:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.759+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3c06a100 con 0x7f3f3c0d3160 2024-04-25T15:45:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.760+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3f3401a070 con 0x7f3f3c0d3160 2024-04-25T15:45:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.760+0000 7f3f327fc640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3f200744e0 0x7f3f200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.760+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f3f34094540 con 0x7f3f3c0d3160 2024-04-25T15:45:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.760+0000 7f3f41ded640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3f200744e0 0x7f3f200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:34.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.760+0000 7f3f41ded640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3f200744e0 0x7f3f200769f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009f50 tx=0x7f3f3800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:34.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.765+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f3405ebd0 con 0x7f3f3c0d3160 2024-04-25T15:45:34.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.940+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3f3c156c30 con 0x7f3f3c0d3160 2024-04-25T15:45:34.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.940+0000 7f3f327fc640 1 -- 172.21.15.80:0/2953336652 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) ==== 100+0+11 (secure 0 0 0) 0x7f3f3405e4d0 con 0x7f3f3c0d3160 2024-04-25T15:45:34.941 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:45:34.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3f200744e0 msgr2=0x7f3f200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3f200744e0 0x7f3f200769f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009f50 tx=0x7f3f3800b040 comp rx=0 tx=0).stop 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 msgr2=0x7f3f3c158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 0x7f3f3c158990 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400c3c0 tx=0x7f3f3400c880 comp rx=0 tx=0).stop 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 shutdown_connections 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3f200744e0 0x7f3f200769f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f3c0d3160 0x7f3f3c158990 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f3c0727c0 0x7f3f3c158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 --2- 172.21.15.80:0/2953336652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f3c0718d0 0x7f3f3c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 >> 172.21.15.80:0/2953336652 conn(0x7f3f3c0d3a30 msgr2=0x7f3f3c0b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 shutdown_connections 2024-04-25T15:45:34.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:34.942+0000 7f3f44051640 1 -- 172.21.15.80:0/2953336652 wait complete. 2024-04-25T15:45:34.955 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:35.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.061+0000 7f8144034640 1 Processor -- start 2024-04-25T15:45:35.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.061+0000 7f8144034640 1 -- start start 2024-04-25T15:45:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f8144034640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c0d22c0 0x7f813c0d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f8144034640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f813c1626e0 0x7f813c162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f8144034640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c0d37e0 con 0x7f813c163030 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f8144034640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f813c09cd00 con 0x7f813c1626e0 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f8144034640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f813c0cfe50 con 0x7f813c0d22c0 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f813c1626e0 0x7f813c162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f813c1626e0 0x7f813c162af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40270/0 (socket says 172.21.15.80:40270) 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 -- 172.21.15.80:0/2968626570 learned_addr learned my addr 172.21.15.80:0/2968626570 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f8141dd0640 1 --2- 172.21.15.80:0/2968626570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c0d22c0 0x7f813c0d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 -- 172.21.15.80:0/2968626570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c0d22c0 msgr2=0x7f813c0d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 --2- 172.21.15.80:0/2968626570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c0d22c0 0x7f813c0d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 -- 172.21.15.80:0/2968626570 >> v1:172.21.15.195:6789/0 conn(0x7f813c163030 legacy=0x7f813c0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.063+0000 7f81415cf640 1 -- 172.21.15.80:0/2968626570 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0b91c0 con 0x7f813c1626e0 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.064+0000 7f81415cf640 1 --2- 172.21.15.80:0/2968626570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c1626e0 0x7f813c162af0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f812c0098a0 tx=0x7f812c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e757b12cbf2aa2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.064+0000 7f8140dce640 1 -- 172.21.15.80:0/2968626570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c037070 con 0x7f813c1626e0 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.064+0000 7f8140dce640 1 -- 172.21.15.80:0/2968626570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c032440 con 0x7f813c1626e0 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.064+0000 7f8140dce640 1 -- 172.21.15.80:0/2968626570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c032810 con 0x7f813c1626e0 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 -- 172.21.15.80:0/2968626570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c1626e0 msgr2=0x7f813c162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 --2- 172.21.15.80:0/2968626570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c1626e0 0x7f813c162af0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f812c0098a0 tx=0x7f812c02a160 comp rx=0 tx=0).stop 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 -- 172.21.15.80:0/2968626570 shutdown_connections 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 --2- 172.21.15.80:0/2968626570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c1626e0 0x7f813c162af0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 --2- 172.21.15.80:0/2968626570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c0d22c0 0x7f813c0d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 -- 172.21.15.80:0/2968626570 >> 172.21.15.80:0/2968626570 conn(0x7f813c0d0450 msgr2=0x7f813c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 -- 172.21.15.80:0/2968626570 shutdown_connections 2024-04-25T15:45:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.065+0000 7f8144034640 1 -- 172.21.15.80:0/2968626570 wait complete. 2024-04-25T15:45:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.067+0000 7f8144034640 1 Processor -- start 2024-04-25T15:45:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.067+0000 7f8144034640 1 -- start start 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8144034640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 0x7f813c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8144034640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f813c1626e0 0x7f813c0a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8144034640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c163030 0x7f813c09d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8144034640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0cf820 con 0x7f813c0d22c0 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8144034640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f813c163440 con 0x7f813c1626e0 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8144034640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f813c09d190 con 0x7f813c163030 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 0x7f813c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 0x7f813c156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40280/0 (socket says 172.21.15.80:40280) 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 -- 172.21.15.80:0/3939177562 learned_addr learned my addr 172.21.15.80:0/3939177562 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 -- 172.21.15.80:0/3939177562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c163030 msgr2=0x7f813c09d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c163030 0x7f813c09d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 -- 172.21.15.80:0/3939177562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f813c1626e0 msgr2=0x7f813c0a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f813c1626e0 0x7f813c0a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.068+0000 7f8141dd0640 1 -- 172.21.15.80:0/3939177562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c09e610 con 0x7f813c0d22c0 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.069+0000 7f8141dd0640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 0x7f813c156ea0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8138007f20 tx=0x7f813800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.069+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138014620 con 0x7f813c0d22c0 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.069+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8138019070 con 0x7f813c0d22c0 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.069+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c0cbd30 con 0x7f813c0d22c0 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.069+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138014a00 con 0x7f813c0d22c0 2024-04-25T15:45:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.069+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c0cc2f0 con 0x7f813c0d22c0 2024-04-25T15:45:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.070+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c06a100 con 0x7f813c0d22c0 2024-04-25T15:45:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.070+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8138014ba0 con 0x7f813c0d22c0 2024-04-25T15:45:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.071+0000 7f81327fc640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f81200744e0 0x7f81200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.071+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f8138095ca0 con 0x7f813c0d22c0 2024-04-25T15:45:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.071+0000 7f81415cf640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f81200744e0 0x7f81200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.071+0000 7f81415cf640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f81200744e0 0x7f81200769f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f812c034000 tx=0x7f812c02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.076+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81380602a0 con 0x7f813c0d22c0 2024-04-25T15:45:35.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.286+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f813c0d1c90 con 0x7f813c0d22c0 2024-04-25T15:45:35.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.287+0000 7f81327fc640 1 -- 172.21.15.80:0/3939177562 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5188 (secure 0 0 0) 0x7f813805fba0 con 0x7f813c0d22c0 2024-04-25T15:45:35.288 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:35.288 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:17.799767+0000","modified":"2024-04-25T15:45:19.804939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4035847402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4035847402},{"type":"v1","addr":"172.21.15.80:6837","nonce":4035847402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":4}]} 2024-04-25T15:45:35.288 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.288+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f81200744e0 msgr2=0x7f81200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f81200744e0 0x7f81200769f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f812c034000 tx=0x7f812c02c000 comp rx=0 tx=0).stop 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 msgr2=0x7f813c156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 0x7f813c156ea0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8138007f20 tx=0x7f813800e570 comp rx=0 tx=0).stop 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 shutdown_connections 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f81200744e0 0x7f81200769f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f813c163030 0x7f813c09d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f813c1626e0 0x7f813c0a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 --2- 172.21.15.80:0/3939177562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f813c0d22c0 0x7f813c156ea0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 >> 172.21.15.80:0/3939177562 conn(0x7f813c0d0450 msgr2=0x7f813c0b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:35.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 shutdown_connections 2024-04-25T15:45:35.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.289+0000 7f8144034640 1 -- 172.21.15.80:0/3939177562 wait complete. 2024-04-25T15:45:35.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:35.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.407+0000 7f8c32f6c640 1 Processor -- start 2024-04-25T15:45:35.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.407+0000 7f8c32f6c640 1 -- start start 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c32f6c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8c2c0d2f40 0x7f8c2c06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c32f6c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c2c0d1de0 0x7f8c2c09b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c32f6c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c0d21f0 con 0x7f8c2c15d060 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c32f6c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c09b950 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c32f6c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c0d1020 con 0x7f8c2c0d2f40 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c31509640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c2c0d1de0 0x7f8c2c09b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c31509640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c2c0d1de0 0x7f8c2c09b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40294/0 (socket says 172.21.15.80:40294) 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c31509640 1 -- 172.21.15.80:0/3840362779 learned_addr learned my addr 172.21.15.80:0/3840362779 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c31509640 1 -- 172.21.15.80:0/3840362779 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c0d2f40 msgr2=0x7f8c2c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.408+0000 7f8c2bfff640 1 --2- 172.21.15.80:0/3840362779 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c0d2f40 0x7f8c2c06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c31509640 1 --2- 172.21.15.80:0/3840362779 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c0d2f40 0x7f8c2c06ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c31509640 1 -- 172.21.15.80:0/3840362779 >> v1:172.21.15.195:6789/0 conn(0x7f8c2c15d060 legacy=0x7f8c2c0d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:35.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c31509640 1 -- 172.21.15.80:0/3840362779 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c0d1300 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c31509640 1 --2- 172.21.15.80:0/3840362779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c09b410 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c06f1e0 tx=0x7f8c2402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2959e7a9f589a2db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c2b7fe640 1 -- 172.21.15.80:0/3840362779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24036070 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c2b7fe640 1 -- 172.21.15.80:0/3840362779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24031600 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.409+0000 7f8c2b7fe640 1 -- 172.21.15.80:0/3840362779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240319d0 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 -- 172.21.15.80:0/3840362779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 msgr2=0x7f8c2c09b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/3840362779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c09b410 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c06f1e0 tx=0x7f8c2402a6f0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 -- 172.21.15.80:0/3840362779 shutdown_connections 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/3840362779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c09b410 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/3840362779 >> v2:172.21.15.195:3300/0 conn(0x7f8c2c0d2f40 0x7f8c2c06ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 -- 172.21.15.80:0/3840362779 >> 172.21.15.80:0/3840362779 conn(0x7f8c2c074740 msgr2=0x7f8c2c0b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 -- 172.21.15.80:0/3840362779 shutdown_connections 2024-04-25T15:45:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.410+0000 7f8c32f6c640 1 -- 172.21.15.80:0/3840362779 wait complete. 2024-04-25T15:45:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.412+0000 7f8c32f6c640 1 Processor -- start 2024-04-25T15:45:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.412+0000 7f8c32f6c640 1 -- start start 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c32f6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c32f6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c15d060 0x7f8c2c0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c32f6c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c0c6640 0x7f8c2c15f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c32f6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0af5f0 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c32f6c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0d18c0 con 0x7f8c2c0c6640 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c32f6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c0af770 con 0x7f8c2c15d060 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c30d08640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c30d08640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c14b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40308/0 (socket says 172.21.15.80:40308) 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.413+0000 7f8c30d08640 1 -- 172.21.15.80:0/1466454164 learned_addr learned my addr 172.21.15.80:0/1466454164 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c31509640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c0c6640 0x7f8c2c15f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c2bfff640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c15d060 0x7f8c2c0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c30d08640 1 -- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c15d060 msgr2=0x7f8c2c0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c30d08640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c15d060 0x7f8c2c0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c30d08640 1 -- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c0c6640 msgr2=0x7f8c2c15f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c30d08640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c0c6640 0x7f8c2c15f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c30d08640 1 -- 172.21.15.80:0/1466454164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c14bd30 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c30d08640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c14b7f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400b3c0 tx=0x7f8c1400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14011830 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c14016070 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c0c6d80 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14011c50 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.414+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c0c7340 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.415+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2c06a100 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.416+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8c1401b460 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.416+0000 7f8c297fa640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8c0c0744b0 0x7f8c0c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.416+0000 7f8c2bfff640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8c0c0744b0 0x7f8c0c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.416+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f8c14095110 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.417+0000 7f8c2bfff640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8c0c0744b0 0x7f8c0c0769c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c006fd0 tx=0x7f8c1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.421+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c1405f710 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.598+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c2c160500 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.599+0000 7f8c297fa640 1 -- 172.21.15.80:0/1466454164 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16872 (secure 0 0 0) 0x7f8c1405f010 con 0x7f8c2c0d1de0 2024-04-25T15:45:35.600 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:35.601 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:19.434303+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8c0c0744b0 msgr2=0x7f8c0c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8c0c0744b0 0x7f8c0c0769c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c006fd0 tx=0x7f8c1c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 msgr2=0x7f8c2c14b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c14b7f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400b3c0 tx=0x7f8c1400b880 comp rx=0 tx=0).stop 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 shutdown_connections 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8c0c0744b0 0x7f8c0c0769c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c2c0c6640 0x7f8c2c15f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c2c15d060 0x7f8c2c0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 --2- 172.21.15.80:0/1466454164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c0d1de0 0x7f8c2c14b7f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 >> 172.21.15.80:0/1466454164 conn(0x7f8c2c074740 msgr2=0x7f8c2c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:35.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 shutdown_connections 2024-04-25T15:45:35.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.601+0000 7f8c32f6c640 1 -- 172.21.15.80:0/1466454164 wait complete. 2024-04-25T15:45:35.614 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:45:35.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:35.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.721+0000 7f23027d5640 1 Processor -- start 2024-04-25T15:45:35.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.721+0000 7f23027d5640 1 -- start start 2024-04-25T15:45:35.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f23027d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22fc0ce220 0x7f22fc09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f23027d5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0cf960 0x7f22fc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f23027d5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f22fc0b1ef0 0x7f22fc0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f23027d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc0cf4d0 con 0x7f22fc0ce220 2024-04-25T15:45:35.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f23027d5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc0ce630 con 0x7f22fc0b1ef0 2024-04-25T15:45:35.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f23027d5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc1607c0 con 0x7f22fc0cf960 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22fc0ce220 0x7f22fc09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22fc0ce220 0x7f22fc09bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40324/0 (socket says 172.21.15.80:40324) 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 -- 172.21.15.80:0/2601200591 learned_addr learned my addr 172.21.15.80:0/2601200591 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f2300d72640 1 --2- 172.21.15.80:0/2601200591 >> v2:172.21.15.195:3300/0 conn(0x7f22fc0b1ef0 0x7f22fc0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fb7fe640 1 --2- 172.21.15.80:0/2601200591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0cf960 0x7f22fc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 -- 172.21.15.80:0/2601200591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0cf960 msgr2=0x7f22fc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 --2- 172.21.15.80:0/2601200591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0cf960 0x7f22fc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 -- 172.21.15.80:0/2601200591 >> v2:172.21.15.195:3300/0 conn(0x7f22fc0b1ef0 msgr2=0x7f22fc0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 --2- 172.21.15.80:0/2601200591 >> v2:172.21.15.195:3300/0 conn(0x7f22fc0b1ef0 0x7f22fc0b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f22fbfff640 1 -- 172.21.15.80:0/2601200591 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc0ceba0 con 0x7f22fc0ce220 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.723+0000 7f2300d72640 1 --2- 172.21.15.80:0/2601200591 >> v2:172.21.15.195:3300/0 conn(0x7f22fc0b1ef0 0x7f22fc0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.724+0000 7f22fbfff640 1 --2- 172.21.15.80:0/2601200591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0ce220 0x7f22fc09bb70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f22fc09b7f0 tx=0x7f22ec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98b685dd8b7c538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.724+0000 7f22faffd640 1 -- 172.21.15.80:0/2601200591 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec037070 con 0x7f22fc0ce220 2024-04-25T15:45:35.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.724+0000 7f22faffd640 1 -- 172.21.15.80:0/2601200591 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec032440 con 0x7f22fc0ce220 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.724+0000 7f22faffd640 1 -- 172.21.15.80:0/2601200591 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec032810 con 0x7f22fc0ce220 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 -- 172.21.15.80:0/2601200591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0ce220 msgr2=0x7f22fc09bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 --2- 172.21.15.80:0/2601200591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0ce220 0x7f22fc09bb70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f22fc09b7f0 tx=0x7f22ec02a2a0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 -- 172.21.15.80:0/2601200591 shutdown_connections 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 --2- 172.21.15.80:0/2601200591 >> v2:172.21.15.195:3300/0 conn(0x7f22fc0b1ef0 0x7f22fc0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 --2- 172.21.15.80:0/2601200591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0cf960 0x7f22fc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 --2- 172.21.15.80:0/2601200591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0ce220 0x7f22fc09bb70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 -- 172.21.15.80:0/2601200591 >> 172.21.15.80:0/2601200591 conn(0x7f22fc0b7620 msgr2=0x7f22fc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 -- 172.21.15.80:0/2601200591 shutdown_connections 2024-04-25T15:45:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.725+0000 7f23027d5640 1 -- 172.21.15.80:0/2601200591 wait complete. 2024-04-25T15:45:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.726+0000 7f23027d5640 1 Processor -- start 2024-04-25T15:45:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.727+0000 7f23027d5640 1 -- start start 2024-04-25T15:45:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f23027d5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0b1ef0 0x7f22fc14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f23027d5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ce220 0x7f22fc0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f23027d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 0x7f22fc06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f23027d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc09c0b0 con 0x7f22fc0cf960 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f23027d5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0cf160 con 0x7f22fc0ce220 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f23027d5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc0d3530 con 0x7f22fc0b1ef0 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 0x7f22fc06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 0x7f22fc06d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40328/0 (socket says 172.21.15.80:40328) 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 -- 172.21.15.80:0/3509083976 learned_addr learned my addr 172.21.15.80:0/3509083976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f22fb7fe640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ce220 0x7f22fc0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f22fbfff640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0b1ef0 0x7f22fc14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 -- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0b1ef0 msgr2=0x7f22fc14fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0b1ef0 0x7f22fc14fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 -- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ce220 msgr2=0x7f22fc0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ce220 0x7f22fc0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 -- 172.21.15.80:0/3509083976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc160d70 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.728+0000 7f2300d72640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 0x7f22fc06d8b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f22f400cca0 tx=0x7f22f400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.729+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f400f680 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.729+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f400f840 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.729+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22fc161050 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.729+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f400fc30 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.729+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22fc161610 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.730+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22fc06eb50 con 0x7f22fc0cf960 2024-04-25T15:45:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.730+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f22f40213f0 con 0x7f22fc0cf960 2024-04-25T15:45:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.731+0000 7f22f8ff9640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22e80744b0 0x7f22e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.731+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f22f4096090 con 0x7f22fc0cf960 2024-04-25T15:45:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.731+0000 7f22fbfff640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22e80744b0 0x7f22e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.731+0000 7f22fbfff640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22e80744b0 0x7f22e80769c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22ec034000 tx=0x7f22ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:35.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.735+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22f4014030 con 0x7f22fc0cf960 2024-04-25T15:45:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.946+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22fc06a100 con 0x7f22fc0cf960 2024-04-25T15:45:35.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.947+0000 7f22f8ff9640 1 -- 172.21.15.80:0/3509083976 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5188 (secure 0 0 0) 0x7f22f4060720 con 0x7f22fc0cf960 2024-04-25T15:45:35.948 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:35.948 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:17.799767+0000","modified":"2024-04-25T15:45:19.804939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4035847402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4035847402},{"type":"v1","addr":"172.21.15.80:6837","nonce":4035847402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":4}]} 2024-04-25T15:45:35.949 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-04-25T15:45:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22e80744b0 msgr2=0x7f22e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22e80744b0 0x7f22e80769c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22ec034000 tx=0x7f22ec02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 msgr2=0x7f22fc06d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 0x7f22fc06d8b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f22f400cca0 tx=0x7f22f400a650 comp rx=0 tx=0).stop 2024-04-25T15:45:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 shutdown_connections 2024-04-25T15:45:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f22e80744b0 0x7f22e80769c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22fc0cf960 0x7f22fc06d8b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ce220 0x7f22fc0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 --2- 172.21.15.80:0/3509083976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22fc0b1ef0 0x7f22fc14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 >> 172.21.15.80:0/3509083976 conn(0x7f22fc0b7620 msgr2=0x7f22fc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 shutdown_connections 2024-04-25T15:45:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:35.949+0000 7f23027d5640 1 -- 172.21.15.80:0/3509083976 wait complete. 2024-04-25T15:45:35.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.068+0000 7f6cd7d3c640 1 Processor -- start 2024-04-25T15:45:36.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.068+0000 7f6cd7d3c640 1 -- start start 2024-04-25T15:45:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd7d3c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6cd0071bb0 0x7f6cd016b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd7d3c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd00b6eb0 con 0x7f6cd0160200 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd7d3c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd00b7150 con 0x7f6cd00cfc40 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd7d3c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd0160610 con 0x7f6cd0071bb0 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd52d7640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cd0160200 0x7f6cd00714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33208/0 (socket says 172.21.15.80:33208) 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd52d7640 1 -- 172.21.15.80:0/3873806515 learned_addr learned my addr 172.21.15.80:0/3873806515 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087870526 0 0) 0x7f6cd00b6eb0 con 0x7f6cd0160200 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cbc003520 con 0x7f6cd0160200 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd62d9640 1 --2- 172.21.15.80:0/3873806515 >> v2:172.21.15.195:3300/0 conn(0x7f6cd0071bb0 0x7f6cd016b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1841184381 0 0) 0x7f6cbc003520 con 0x7f6cd0160200 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 >> v2:172.21.15.195:3300/0 conn(0x7f6cd0071bb0 msgr2=0x7f6cd016b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 --2- 172.21.15.80:0/3873806515 >> v2:172.21.15.195:3300/0 conn(0x7f6cd0071bb0 0x7f6cd016b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 >> v1:172.21.15.195:6789/0 conn(0x7f6cd00cfc40 legacy=0x7f6cd0164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd00b51e0 con 0x7f6cd0160200 2024-04-25T15:45:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f6cc0001690 con 0x7f6cd0160200 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 >> v1:172.21.15.80:6789/0 conn(0x7f6cd0160200 legacy=0x7f6cd00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc0039b0 0x7f6cbc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cbc004800 0x7f6cbc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.070+0000 7f6cd4ad6640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cbc005250 0x7f6cbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0160610 con 0x7f6cbc004800 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc00c1e0 con 0x7f6cbc0039b0 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6cbc00c3e0 con 0x7f6cbc005250 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cbc004800 0x7f6cbc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd5ad8640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc0039b0 0x7f6cbc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd62d9640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cbc005250 0x7f6cbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd52d7640 1 -- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cbc005250 msgr2=0x7f6cbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cbc005250 0x7f6cbc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd52d7640 1 -- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc0039b0 msgr2=0x7f6cbc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc0039b0 0x7f6cbc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd62d9640 1 -- 172.21.15.80:0/3873806515 reap_dead start 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.071+0000 7f6cd52d7640 1 -- 172.21.15.80:0/3873806515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc003520 con 0x7f6cbc004800 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cbc004800 0x7f6cbc004c10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000c210 tx=0x7f6cbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebd5ff52adb805f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0007d30 con 0x7f6cbc004800 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc002e070 con 0x7f6cbc004800 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd4ad6640 1 -- 172.21.15.80:0/3873806515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0005d30 con 0x7f6cbc004800 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/3873806515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cbc004800 msgr2=0x7f6cbc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cbc004800 0x7f6cbc004c10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000c210 tx=0x7f6cbc005830 comp rx=0 tx=0).stop 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/3873806515 shutdown_connections 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/3873806515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cbc004800 0x7f6cbc004c10 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.072+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/3873806515 >> 172.21.15.80:0/3873806515 conn(0x7f6cd00d2080 msgr2=0x7f6cd00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.073+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/3873806515 shutdown_connections 2024-04-25T15:45:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.073+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/3873806515 wait complete. 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.074+0000 7f6cd7d3c640 1 Processor -- start 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.074+0000 7f6cd7d3c640 1 -- start start 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc004800 0x7f6cd015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 0x7f6cd0161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cd0161fc0 0x7f6cd01623d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0072040 con 0x7f6cd015c5b0 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd00b7430 con 0x7f6cbc004800 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd00b6b70 con 0x7f6cd0161fc0 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 0x7f6cd0161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 0x7f6cd0161a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40346/0 (socket says 172.21.15.80:40346) 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 -- 172.21.15.80:0/1333539792 learned_addr learned my addr 172.21.15.80:0/1333539792 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd62d9640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cd0161fc0 0x7f6cd01623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd5ad8640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc004800 0x7f6cd015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 -- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cd0161fc0 msgr2=0x7f6cd01623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cd0161fc0 0x7f6cd01623d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 -- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc004800 msgr2=0x7f6cd015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc004800 0x7f6cd015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 -- 172.21.15.80:0/1333539792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0162910 con 0x7f6cd015c5b0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd5ad8640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc004800 0x7f6cd015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd52d7640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 0x7f6cd0161a80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0001990 tx=0x7f6cd00d0050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0007d30 con 0x7f6cd015c5b0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc0043070 con 0x7f6cd015c5b0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00074d0 con 0x7f6cd015c5b0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd015c9c0 con 0x7f6cd015c5b0 2024-04-25T15:45:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.076+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd0160fa0 con 0x7f6cd015c5b0 2024-04-25T15:45:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.077+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd00ce6c0 con 0x7f6cd015c5b0 2024-04-25T15:45:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.078+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6cc0033470 con 0x7f6cd015c5b0 2024-04-25T15:45:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.078+0000 7f6cc67fc640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6cb40744b0 0x7f6cb40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.079+0000 7f6cd5ad8640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6cb40744b0 0x7f6cb40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.079+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f6cc00b5610 con 0x7f6cd015c5b0 2024-04-25T15:45:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.079+0000 7f6cd5ad8640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6cb40744b0 0x7f6cb40769c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc000f80 tx=0x7f6ccc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.083+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6cd015c9c0 con 0x7f6cd015c5b0 2024-04-25T15:45:36.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.296+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cd006a100 con 0x7f6cd015c5b0 2024-04-25T15:45:36.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.297+0000 7f6cc67fc640 1 -- 172.21.15.80:0/1333539792 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5188 (secure 0 0 0) 0x7f6cc007fcd0 con 0x7f6cd015c5b0 2024-04-25T15:45:36.298 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:36.298 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:17.799767+0000","modified":"2024-04-25T15:45:19.804939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/4035847402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":4035847402},{"type":"v1","addr":"172.21.15.80:6837","nonce":4035847402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":4}]} 2024-04-25T15:45:36.298 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6cb40744b0 msgr2=0x7f6cb40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6cb40744b0 0x7f6cb40769c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc000f80 tx=0x7f6ccc009040 comp rx=0 tx=0).stop 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 msgr2=0x7f6cd0161a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 0x7f6cd0161a80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0001990 tx=0x7f6cd00d0050 comp rx=0 tx=0).stop 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 shutdown_connections 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6cb40744b0 0x7f6cb40769c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6cd0161fc0 0x7f6cd01623d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cd015c5b0 0x7f6cd0161a80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 --2- 172.21.15.80:0/1333539792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cbc004800 0x7f6cd015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 >> 172.21.15.80:0/1333539792 conn(0x7f6cd00d2080 msgr2=0x7f6cd006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:36.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 shutdown_connections 2024-04-25T15:45:36.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.299+0000 7f6cd7d3c640 1 -- 172.21.15.80:0/1333539792 wait complete. 2024-04-25T15:45:36.311 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.416+0000 7f2b7bc30640 1 Processor -- start 2024-04-25T15:45:36.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.417+0000 7f2b7bc30640 1 -- start start 2024-04-25T15:45:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7bc30640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b740cff30 0x7f2b740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7bc30640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740b2a40 0x7f2b7409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7bc30640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2b740d2120 0x7f2b740d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7bc30640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2b740cfb70 con 0x7f2b740cff30 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7bc30640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2b740b9350 con 0x7f2b740d2120 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7bc30640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2b740cf890 con 0x7f2b740b2a40 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b740cff30 0x7f2b740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b740cff30 0x7f2b740b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40350/0 (socket says 172.21.15.80:40350) 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 -- 172.21.15.80:0/2849447799 learned_addr learned my addr 172.21.15.80:0/2849447799 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b7a1cd640 1 --2- 172.21.15.80:0/2849447799 >> v2:172.21.15.195:3300/0 conn(0x7f2b740d2120 0x7f2b740d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b791cb640 1 --2- 172.21.15.80:0/2849447799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740b2a40 0x7f2b7409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 -- 172.21.15.80:0/2849447799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740b2a40 msgr2=0x7f2b7409ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 --2- 172.21.15.80:0/2849447799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740b2a40 0x7f2b7409ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 -- 172.21.15.80:0/2849447799 >> v2:172.21.15.195:3300/0 conn(0x7f2b740d2120 msgr2=0x7f2b740d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 --2- 172.21.15.80:0/2849447799 >> v2:172.21.15.195:3300/0 conn(0x7f2b740d2120 0x7f2b740d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.418+0000 7f2b799cc640 1 -- 172.21.15.80:0/2849447799 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b740b9020 con 0x7f2b740cff30 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.419+0000 7f2b799cc640 1 --2- 172.21.15.80:0/2849447799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740cff30 0x7f2b740b7230 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2b74069160 tx=0x7f2b7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d033ba04aaedfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.419+0000 7f2b789ca640 1 -- 172.21.15.80:0/2849447799 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70036070 con 0x7f2b740cff30 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.419+0000 7f2b789ca640 1 -- 172.21.15.80:0/2849447799 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b70031600 con 0x7f2b740cff30 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.419+0000 7f2b789ca640 1 -- 172.21.15.80:0/2849447799 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b700319d0 con 0x7f2b740cff30 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 -- 172.21.15.80:0/2849447799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740cff30 msgr2=0x7f2b740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/2849447799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740cff30 0x7f2b740b7230 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2b74069160 tx=0x7f2b7002a660 comp rx=0 tx=0).stop 2024-04-25T15:45:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 -- 172.21.15.80:0/2849447799 shutdown_connections 2024-04-25T15:45:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/2849447799 >> v2:172.21.15.195:3300/0 conn(0x7f2b740d2120 0x7f2b740d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/2849447799 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740b2a40 0x7f2b7409ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/2849447799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740cff30 0x7f2b740b7230 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 -- 172.21.15.80:0/2849447799 >> 172.21.15.80:0/2849447799 conn(0x7f2b740d0450 msgr2=0x7f2b740d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 -- 172.21.15.80:0/2849447799 shutdown_connections 2024-04-25T15:45:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.420+0000 7f2b7bc30640 1 -- 172.21.15.80:0/2849447799 wait complete. 2024-04-25T15:45:36.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.422+0000 7f2b7bc30640 1 Processor -- start 2024-04-25T15:45:36.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.422+0000 7f2b7bc30640 1 -- start start 2024-04-25T15:45:36.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7bc30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 0x7f2b741596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7bc30640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b740cff30 0x7f2b74153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7bc30640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740d2120 0x7f2b7415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7bc30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740d15a0 con 0x7f2b740b2a40 2024-04-25T15:45:36.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7bc30640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740d11c0 con 0x7f2b740cff30 2024-04-25T15:45:36.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7bc30640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2b740d1720 con 0x7f2b740d2120 2024-04-25T15:45:36.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b799cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 0x7f2b741596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b799cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 0x7f2b741596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40366/0 (socket says 172.21.15.80:40366) 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b799cc640 1 -- 172.21.15.80:0/373789749 learned_addr learned my addr 172.21.15.80:0/373789749 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b791cb640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b740cff30 0x7f2b74153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.423+0000 7f2b7a1cd640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740d2120 0x7f2b7415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b799cc640 1 -- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740d2120 msgr2=0x7f2b7415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b799cc640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740d2120 0x7f2b7415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b799cc640 1 -- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b740cff30 msgr2=0x7f2b74153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b799cc640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b740cff30 0x7f2b74153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b799cc640 1 -- 172.21.15.80:0/373789749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b74154390 con 0x7f2b740b2a40 2024-04-25T15:45:36.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b791cb640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b740cff30 0x7f2b74153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:36.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b799cc640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 0x7f2b741596f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2b70000f80 tx=0x7f2b70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70036050 con 0x7f2b740b2a40 2024-04-25T15:45:36.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b70042070 con 0x7f2b740b2a40 2024-04-25T15:45:36.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7415b580 con 0x7f2b740b2a40 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70009510 con 0x7f2b740b2a40 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.424+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7415bb40 con 0x7f2b740b2a40 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.425+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7406a100 con 0x7f2b740b2a40 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.426+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2b70007c70 con 0x7f2b740b2a40 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.426+0000 7f2b6a7fc640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2b580744e0 0x7f2b580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.426+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f2b700b6110 con 0x7f2b740b2a40 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.426+0000 7f2b791cb640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2b580744e0 0x7f2b580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.426+0000 7f2b791cb640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2b580744e0 0x7f2b580769f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2b740b4dc0 tx=0x7f2b64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.431+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b70080710 con 0x7f2b740b2a40 2024-04-25T15:45:36.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.607+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b741550a0 con 0x7f2b740b2a40 2024-04-25T15:45:36.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.608+0000 7f2b6a7fc640 1 -- 172.21.15.80:0/373789749 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16872 (secure 0 0 0) 0x7f2b70080010 con 0x7f2b740b2a40 2024-04-25T15:45:36.609 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:36.610 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:19.434303+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:16.067128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:16.752308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2b580744e0 msgr2=0x7f2b580769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2b580744e0 0x7f2b580769f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2b740b4dc0 tx=0x7f2b64008040 comp rx=0 tx=0).stop 2024-04-25T15:45:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 msgr2=0x7f2b741596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 0x7f2b741596f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2b70000f80 tx=0x7f2b70004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 shutdown_connections 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2b580744e0 0x7f2b580769f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b740d2120 0x7f2b7415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b740cff30 0x7f2b74153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 --2- 172.21.15.80:0/373789749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b740b2a40 0x7f2b741596f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 >> 172.21.15.80:0/373789749 conn(0x7f2b740d0450 msgr2=0x7f2b740d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 shutdown_connections 2024-04-25T15:45:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.610+0000 7f2b7bc30640 1 -- 172.21.15.80:0/373789749 wait complete. 2024-04-25T15:45:36.623 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:45:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.730+0000 7f85fd81e640 1 Processor -- start 2024-04-25T15:45:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.730+0000 7f85fd81e640 1 -- start start 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85fd81e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85f80d41b0 0x7f85f80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85fd81e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f81602a0 0x7f85f80b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85fd81e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f85f80b7b90 0x7f85f80d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85fd81e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f85f80b7fa0 con 0x7f85f80d41b0 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85fd81e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f85f8163fb0 con 0x7f85f80b7b90 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85fd81e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f85f8164270 con 0x7f85f81602a0 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85f80d41b0 0x7f85f80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85f80d41b0 0x7f85f80b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40368/0 (socket says 172.21.15.80:40368) 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 -- 172.21.15.80:0/1133412364 learned_addr learned my addr 172.21.15.80:0/1133412364 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f77fe640 1 --2- 172.21.15.80:0/1133412364 >> v2:172.21.15.195:3300/0 conn(0x7f85f80b7b90 0x7f85f80d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f67fc640 1 --2- 172.21.15.80:0/1133412364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f81602a0 0x7f85f80b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 -- 172.21.15.80:0/1133412364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f81602a0 msgr2=0x7f85f80b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/1133412364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f81602a0 0x7f85f80b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 -- 172.21.15.80:0/1133412364 >> v2:172.21.15.195:3300/0 conn(0x7f85f80b7b90 msgr2=0x7f85f80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/1133412364 >> v2:172.21.15.195:3300/0 conn(0x7f85f80b7b90 0x7f85f80d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f6ffd640 1 -- 172.21.15.80:0/1133412364 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f8164550 con 0x7f85f80d41b0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.732+0000 7f85f77fe640 1 --2- 172.21.15.80:0/1133412364 >> v2:172.21.15.195:3300/0 conn(0x7f85f80b7b90 0x7f85f80d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.733+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/1133412364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f80b48d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f85f808e110 tx=0x7f85e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df16fb90bf63603d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.733+0000 7f85f5ffb640 1 -- 172.21.15.80:0/1133412364 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8037070 con 0x7f85f80d41b0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.733+0000 7f85f5ffb640 1 -- 172.21.15.80:0/1133412364 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8032440 con 0x7f85f80d41b0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.733+0000 7f85f5ffb640 1 -- 172.21.15.80:0/1133412364 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8032810 con 0x7f85f80d41b0 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 -- 172.21.15.80:0/1133412364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 msgr2=0x7f85f80b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 --2- 172.21.15.80:0/1133412364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f80b48d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f85f808e110 tx=0x7f85e802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 -- 172.21.15.80:0/1133412364 shutdown_connections 2024-04-25T15:45:36.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 --2- 172.21.15.80:0/1133412364 >> v2:172.21.15.195:3300/0 conn(0x7f85f80b7b90 0x7f85f80d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 --2- 172.21.15.80:0/1133412364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f81602a0 0x7f85f80b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 --2- 172.21.15.80:0/1133412364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f80b48d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 -- 172.21.15.80:0/1133412364 >> 172.21.15.80:0/1133412364 conn(0x7f85f806e9f0 msgr2=0x7f85f80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:36.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 -- 172.21.15.80:0/1133412364 shutdown_connections 2024-04-25T15:45:36.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.734+0000 7f85fd81e640 1 -- 172.21.15.80:0/1133412364 wait complete. 2024-04-25T15:45:36.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.735+0000 7f85fd81e640 1 Processor -- start 2024-04-25T15:45:36.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.736+0000 7f85fd81e640 1 -- start start 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85fd81e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f80b7b90 0x7f85f8150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85fd81e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f81f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85fd81e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85f81602a0 0x7f85f80cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85fd81e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f85f80b4fd0 con 0x7f85f80d41b0 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85fd81e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8164b10 con 0x7f85f81602a0 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85fd81e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f85f80b5150 con 0x7f85f80b7b90 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f81f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f81f62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40380/0 (socket says 172.21.15.80:40380) 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 -- 172.21.15.80:0/4179910162 learned_addr learned my addr 172.21.15.80:0/4179910162 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f80b7b90 0x7f85f8150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f77fe640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85f81602a0 0x7f85f80cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 -- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f80b7b90 msgr2=0x7f85f8150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f80b7b90 0x7f85f8150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 -- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85f81602a0 msgr2=0x7f85f80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85f81602a0 0x7f85f80cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f67fc640 1 -- 172.21.15.80:0/4179910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f81513a0 con 0x7f85f80d41b0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f80b7b90 0x7f85f8150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.737+0000 7f85f77fe640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85f81602a0 0x7f85f80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.738+0000 7f85f67fc640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f81f62a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00d5f0 tx=0x7f85ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.738+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0125f0 con 0x7f85f80d41b0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.738+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ec019070 con 0x7f85f80d41b0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.738+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0129d0 con 0x7f85f80d41b0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.738+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f80d13a0 con 0x7f85f80d41b0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.738+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f80cbdc0 con 0x7f85f80d41b0 2024-04-25T15:45:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.739+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f806a100 con 0x7f85f80d41b0 2024-04-25T15:45:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.739+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f85ec012b70 con 0x7f85f80d41b0 2024-04-25T15:45:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.740+0000 7f85dffff640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f85e40744b0 0x7f85e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.740+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f85ec095770 con 0x7f85f80d41b0 2024-04-25T15:45:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.740+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f85e40744b0 0x7f85e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.740+0000 7f85f6ffd640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f85e40744b0 0x7f85e40769c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f85e8034000 tx=0x7f85e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:36.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.745+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f85ec05fe00 con 0x7f85f80d41b0 2024-04-25T15:45:36.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.953+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85f80d3070 con 0x7f85f80d41b0 2024-04-25T15:45:36.955 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:45:36.954+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:45:36.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.956+0000 7f85dffff640 1 -- 172.21.15.80:0/4179910162 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f85ec05f700 con 0x7f85f80d41b0 2024-04-25T15:45:36.957 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:45:36.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.959+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f85e40744b0 msgr2=0x7f85e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.959+0000 7f85fd81e640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f85e40744b0 0x7f85e40769c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f85e8034000 tx=0x7f85e802e000 comp rx=0 tx=0).stop 2024-04-25T15:45:36.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.959+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 msgr2=0x7f85f81f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:36.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.959+0000 7f85fd81e640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f81f62a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00d5f0 tx=0x7f85ec00dab0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 shutdown_connections 2024-04-25T15:45:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f85e40744b0 0x7f85e40769c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85f81602a0 0x7f85f80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85f80d41b0 0x7f85f81f62a0 secure :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00d5f0 tx=0x7f85ec00dab0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 --2- 172.21.15.80:0/4179910162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85f80b7b90 0x7f85f8150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 >> 172.21.15.80:0/4179910162 conn(0x7f85f806e9f0 msgr2=0x7f85f8162cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.960+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 shutdown_connections 2024-04-25T15:45:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:36.961+0000 7f85fd81e640 1 -- 172.21.15.80:0/4179910162 wait complete. 2024-04-25T15:45:36.963 INFO:tasks.ceph.mds.a.smithi080.stderr: -2169> 2024-04-25T15:45:24.103+0000 7faba3596640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:45:36.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:45:37.015 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:45:37.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.085+0000 7f166e451640 1 Processor -- start 2024-04-25T15:45:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.085+0000 7f166e451640 1 -- start start 2024-04-25T15:45:37.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f166e451640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680b5490 0x7f1668160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:37.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f166e451640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16680d0b00 0x7f16680d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f166e451640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16680d57e0 con 0x7f16680d2b80 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f166e451640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f16681643f0 con 0x7f16680d0b00 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f166e451640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f16681646d0 con 0x7f16680b5490 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16680d0b00 0x7f16680d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16680d0b00 0x7f16680d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40418/0 (socket says 172.21.15.80:40418) 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 -- 172.21.15.80:0/3448275625 learned_addr learned my addr 172.21.15.80:0/3448275625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f1667fff640 1 --2- 172.21.15.80:0/3448275625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680b5490 0x7f1668160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 -- 172.21.15.80:0/3448275625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680b5490 msgr2=0x7f1668160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 --2- 172.21.15.80:0/3448275625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680b5490 0x7f1668160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 -- 172.21.15.80:0/3448275625 >> v1:172.21.15.195:6789/0 conn(0x7f16680d2b80 legacy=0x7f16680b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.087+0000 7f16677fe640 1 -- 172.21.15.80:0/3448275625 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681649b0 con 0x7f16680d0b00 2024-04-25T15:45:37.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.088+0000 7f16677fe640 1 --2- 172.21.15.80:0/3448275625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d0b00 0x7f16680d2640 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1658009870 tx=0x7f165802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b1df7980c61c80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.088+0000 7f1666ffd640 1 -- 172.21.15.80:0/3448275625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658037070 con 0x7f16680d0b00 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.088+0000 7f1666ffd640 1 -- 172.21.15.80:0/3448275625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658032440 con 0x7f16680d0b00 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.088+0000 7f1666ffd640 1 -- 172.21.15.80:0/3448275625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658032810 con 0x7f16680d0b00 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 -- 172.21.15.80:0/3448275625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d0b00 msgr2=0x7f16680d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 --2- 172.21.15.80:0/3448275625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d0b00 0x7f16680d2640 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1658009870 tx=0x7f165802a210 comp rx=0 tx=0).stop 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 -- 172.21.15.80:0/3448275625 shutdown_connections 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 --2- 172.21.15.80:0/3448275625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d0b00 0x7f16680d2640 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 --2- 172.21.15.80:0/3448275625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680b5490 0x7f1668160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 -- 172.21.15.80:0/3448275625 >> 172.21.15.80:0/3448275625 conn(0x7f166806e650 msgr2=0x7f166806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 -- 172.21.15.80:0/3448275625 shutdown_connections 2024-04-25T15:45:37.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.089+0000 7f166e451640 1 -- 172.21.15.80:0/3448275625 wait complete. 2024-04-25T15:45:37.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.091+0000 7f166e451640 1 Processor -- start 2024-04-25T15:45:37.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.091+0000 7f166e451640 1 -- start start 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f166e451640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16680d0b00 0x7f1668153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f166e451640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 0x7f16681f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f166e451640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1668155cd0 0x7f1668159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f166e451640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f16680d2f90 con 0x7f16680d2b80 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f166e451640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1668160840 con 0x7f16680d0b00 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f166e451640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f16680b9360 con 0x7f1668155cd0 2024-04-25T15:45:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 0x7f16681f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 0x7f16681f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40428/0 (socket says 172.21.15.80:40428) 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 -- 172.21.15.80:0/1241547716 learned_addr learned my addr 172.21.15.80:0/1241547716 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 -- 172.21.15.80:0/1241547716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1668155cd0 msgr2=0x7f1668159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1668155cd0 0x7f1668159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 -- 172.21.15.80:0/1241547716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16680d0b00 msgr2=0x7f1668153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16680d0b00 0x7f1668153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.092+0000 7f16677fe640 1 -- 172.21.15.80:0/1241547716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681594b0 con 0x7f16680d2b80 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.093+0000 7f16677fe640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 0x7f16681f6420 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1658009870 tx=0x7f16580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.093+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658041020 con 0x7f16680d2b80 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.093+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658030970 con 0x7f16680d2b80 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.093+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658037040 con 0x7f16680d2b80 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.093+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1668154f10 con 0x7f16680d2b80 2024-04-25T15:45:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.093+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681554d0 con 0x7f16680d2b80 2024-04-25T15:45:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.094+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166806a100 con 0x7f16680d2b80 2024-04-25T15:45:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.094+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1658044020 con 0x7f16680d2b80 2024-04-25T15:45:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.095+0000 7f1664ff9640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16540744b0 0x7f16540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.095+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6187+0+0 (secure 0 0 0) 0x7f16580b5e40 con 0x7f16680d2b80 2024-04-25T15:45:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.095+0000 7f1667fff640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16540744b0 0x7f16540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.095+0000 7f1667fff640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16540744b0 0x7f16540769c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f16680d08c0 tx=0x7f165c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:37.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.099+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f165804b030 con 0x7f16680d2b80 2024-04-25T15:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.311+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f16680d41d0 con 0x7f16680d2b80 2024-04-25T15:45:37.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.961+0000 7f1664ff9640 1 -- 172.21.15.80:0/1241547716 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7f16580804b0 con 0x7f16680d2b80 2024-04-25T15:45:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16540744b0 msgr2=0x7f16540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16540744b0 0x7f16540769c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f16680d08c0 tx=0x7f165c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 msgr2=0x7f16681f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 0x7f16681f6420 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1658009870 tx=0x7f16580046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 shutdown_connections 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16540744b0 0x7f16540769c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1668155cd0 0x7f1668159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16680d2b80 0x7f16681f6420 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 --2- 172.21.15.80:0/1241547716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16680d0b00 0x7f1668153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 >> 172.21.15.80:0/1241547716 conn(0x7f166806e650 msgr2=0x7f16680cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 shutdown_connections 2024-04-25T15:45:37.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:37.963+0000 7f166e451640 1 -- 172.21.15.80:0/1241547716 wait complete. 2024-04-25T15:45:37.977 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:45:38.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.132+0000 7f82a952d640 1 Processor -- start 2024-04-25T15:45:38.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.132+0000 7f82a952d640 1 -- start start 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a952d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f82a409c100 0x7f82a406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a952d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f82a40d30e0 0x7f82a406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a952d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a40ce4b0 con 0x7f82a415e3c0 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a952d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f82a40ce750 con 0x7f82a409c100 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a952d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f82a40cea30 con 0x7f82a40d30e0 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a2ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f82a409c100 0x7f82a406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a2ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f82a409c100 0x7f82a406e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40442/0 (socket says 172.21.15.80:40442) 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.133+0000 7f82a2ffd640 1 -- 172.21.15.80:0/4012521175 learned_addr learned my addr 172.21.15.80:0/4012521175 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a37fe640 1 --2- 172.21.15.80:0/4012521175 >> v2:172.21.15.195:3300/0 conn(0x7f82a40d30e0 0x7f82a406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:38.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a2ffd640 1 -- 172.21.15.80:0/4012521175 >> v2:172.21.15.195:3300/0 conn(0x7f82a40d30e0 msgr2=0x7f82a406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:38.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a2ffd640 1 --2- 172.21.15.80:0/4012521175 >> v2:172.21.15.195:3300/0 conn(0x7f82a40d30e0 0x7f82a406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a2ffd640 1 -- 172.21.15.80:0/4012521175 >> v1:172.21.15.195:6789/0 conn(0x7f82a415e3c0 legacy=0x7f82a40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:38.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a2ffd640 1 -- 172.21.15.80:0/4012521175 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a40ced10 con 0x7f82a409c100 2024-04-25T15:45:38.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a2ffd640 1 --2- 172.21.15.80:0/4012521175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a409c100 0x7f82a406e790 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f82a40b44e0 tx=0x7f829c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf36a2b0db4769e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:38.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a1ffb640 1 -- 172.21.15.80:0/4012521175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c036070 con 0x7f82a409c100 2024-04-25T15:45:38.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a1ffb640 1 -- 172.21.15.80:0/4012521175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c031600 con 0x7f82a409c100 2024-04-25T15:45:38.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.134+0000 7f82a1ffb640 1 -- 172.21.15.80:0/4012521175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c0319d0 con 0x7f82a409c100 2024-04-25T15:45:38.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 -- 172.21.15.80:0/4012521175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a409c100 msgr2=0x7f82a406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 --2- 172.21.15.80:0/4012521175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a409c100 0x7f82a406e790 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f82a40b44e0 tx=0x7f829c02a660 comp rx=0 tx=0).stop 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 -- 172.21.15.80:0/4012521175 shutdown_connections 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 --2- 172.21.15.80:0/4012521175 >> v2:172.21.15.195:3300/0 conn(0x7f82a40d30e0 0x7f82a406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 --2- 172.21.15.80:0/4012521175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a409c100 0x7f82a406e790 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 -- 172.21.15.80:0/4012521175 >> 172.21.15.80:0/4012521175 conn(0x7f82a40b7750 msgr2=0x7f82a40b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 -- 172.21.15.80:0/4012521175 shutdown_connections 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.135+0000 7f82a952d640 1 -- 172.21.15.80:0/4012521175 wait complete. 2024-04-25T15:45:38.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.137+0000 7f82a952d640 1 Processor -- start 2024-04-25T15:45:38.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.137+0000 7f82a952d640 1 -- start start 2024-04-25T15:45:38.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a952d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82a409c100 0x7f82a40cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a952d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82a415e3c0 0x7f82a415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a952d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 0x7f82a415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a952d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f82a406ee50 con 0x7f82a415e960 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a952d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f82a406ecd0 con 0x7f82a409c100 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a952d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f82a406cc00 con 0x7f82a415e3c0 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 0x7f82a415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 0x7f82a415f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40444/0 (socket says 172.21.15.80:40444) 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.138+0000 7f82a37fe640 1 -- 172.21.15.80:0/792943475 learned_addr learned my addr 172.21.15.80:0/792943475 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a2ffd640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82a409c100 0x7f82a40cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a27fc640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82a415e3c0 0x7f82a415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a37fe640 1 -- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82a415e3c0 msgr2=0x7f82a415f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a37fe640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82a415e3c0 0x7f82a415f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a37fe640 1 -- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82a409c100 msgr2=0x7f82a40cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:38.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a37fe640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82a409c100 0x7f82a40cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a37fe640 1 -- 172.21.15.80:0/792943475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a40cb980 con 0x7f82a415e960 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a37fe640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 0x7f82a415f7c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f829400c540 tx=0x7f829400ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294015070 con 0x7f82a415e960 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8294004220 con 0x7f82a415e960 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a40cbc60 con 0x7f82a415e960 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294003610 con 0x7f82a415e960 2024-04-25T15:45:38.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.139+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a40cc220 con 0x7f82a415e960 2024-04-25T15:45:38.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.140+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a406a100 con 0x7f82a415e960 2024-04-25T15:45:38.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.141+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f82940037b0 con 0x7f82a415e960 2024-04-25T15:45:38.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.141+0000 7f829b7fe640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f82840744e0 0x7f82840769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:38.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.141+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6187+0+0 (secure 0 0 0) 0x7f8294095110 con 0x7f82a415e960 2024-04-25T15:45:38.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.141+0000 7f82a2ffd640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f82840744e0 0x7f82840769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:38.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.142+0000 7f82a2ffd640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f82840744e0 0x7f82840769f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f829c033000 tx=0x7f829c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:38.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.146+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f829405f6c0 con 0x7f82a415e960 2024-04-25T15:45:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.319+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f82a40b40a0 con 0x7f82a415e960 2024-04-25T15:45:38.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.963+0000 7f829b7fe640 1 -- 172.21.15.80:0/792943475 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) ==== 181+0+0 (secure 0 0 0) 0x7f829405efc0 con 0x7f82a415e960 2024-04-25T15:45:38.964 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.968+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f82840744e0 msgr2=0x7f82840769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.968+0000 7f82a952d640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f82840744e0 0x7f82840769f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f829c033000 tx=0x7f829c009000 comp rx=0 tx=0).stop 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.968+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 msgr2=0x7f82a415f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.968+0000 7f82a952d640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 0x7f82a415f7c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f829400c540 tx=0x7f829400ca00 comp rx=0 tx=0).stop 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 shutdown_connections 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f82840744e0 0x7f82840769f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82a415e960 0x7f82a415f7c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82a415e3c0 0x7f82a415f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 --2- 172.21.15.80:0/792943475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82a409c100 0x7f82a40cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:38.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 >> 172.21.15.80:0/792943475 conn(0x7f82a40b7750 msgr2=0x7f82a40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:38.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 shutdown_connections 2024-04-25T15:45:38.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:38.969+0000 7f82a952d640 1 -- 172.21.15.80:0/792943475 wait complete. 2024-04-25T15:45:38.983 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:45:39.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.097+0000 7f4e10bb7640 1 Processor -- start 2024-04-25T15:45:39.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.097+0000 7f4e10bb7640 1 -- start start 2024-04-25T15:45:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e10bb7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0ce220 0x7f4e0c09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e10bb7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e0c0cf960 0x7f4e0c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e10bb7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0b1ef0 0x7f4e0c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e10bb7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0c0cf4d0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e10bb7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0c0ce630 con 0x7f4e0c0cf960 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e10bb7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c1607c0 con 0x7f4e0c0ce220 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e09d9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e0c0cf960 0x7f4e0c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0b1ef0 0x7f4e0c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0ce220 0x7f4e0c09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e0c0b1ef0 0x7f4e0c0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40452/0 (socket says 172.21.15.80:40452) 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e09d9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e0c0cf960 0x7f4e0c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:42920/0 (socket says 172.21.15.80:42920) 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 -- 172.21.15.80:0/1651495725 learned_addr learned my addr 172.21.15.80:0/1651495725 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 -- 172.21.15.80:0/1651495725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0ce220 msgr2=0x7f4e0c09bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 --2- 172.21.15.80:0/1651495725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0ce220 0x7f4e0c09bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 -- 172.21.15.80:0/1651495725 >> v2:172.21.15.195:3300/0 conn(0x7f4e0c0cf960 msgr2=0x7f4e0c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 --2- 172.21.15.80:0/1651495725 >> v2:172.21.15.195:3300/0 conn(0x7f4e0c0cf960 0x7f4e0c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.099+0000 7f4e0ad9d640 1 -- 172.21.15.80:0/1651495725 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c0ceba0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.100+0000 7f4e0ad9d640 1 --2- 172.21.15.80:0/1651495725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c0b2300 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0d0400 tx=0x7f4e0402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde8cd8a867d201e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.100+0000 7f4e0959a640 1 -- 172.21.15.80:0/1651495725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037070 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.100+0000 7f4e0959a640 1 -- 172.21.15.80:0/1651495725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e04032440 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.100+0000 7f4e0959a640 1 -- 172.21.15.80:0/1651495725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04032810 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1651495725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 msgr2=0x7f4e0c0b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1651495725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c0b2300 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0d0400 tx=0x7f4e0402a2a0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1651495725 shutdown_connections 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1651495725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c0b2300 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1651495725 >> v2:172.21.15.195:3300/0 conn(0x7f4e0c0cf960 0x7f4e0c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1651495725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0ce220 0x7f4e0c09bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1651495725 >> 172.21.15.80:0/1651495725 conn(0x7f4e0c0b7620 msgr2=0x7f4e0c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1651495725 shutdown_connections 2024-04-25T15:45:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.101+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1651495725 wait complete. 2024-04-25T15:45:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.103+0000 7f4e10bb7640 1 Processor -- start 2024-04-25T15:45:39.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.103+0000 7f4e10bb7640 1 -- start start 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e10bb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c163280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e10bb7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0ce220 0x7f4e0c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e10bb7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0cf960 0x7f4e0c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e10bb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c09c0b0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e10bb7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c0cf160 con 0x7f4e0c0ce220 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e10bb7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c0d3530 con 0x7f4e0c0cf960 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e0a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e0a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c163280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40470/0 (socket says 172.21.15.80:40470) 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.104+0000 7f4e0a59c640 1 -- 172.21.15.80:0/1319238677 learned_addr learned my addr 172.21.15.80:0/1319238677 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e09d9b640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0ce220 0x7f4e0c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0ad9d640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0cf960 0x7f4e0c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0a59c640 1 -- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0cf960 msgr2=0x7f4e0c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0a59c640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0cf960 0x7f4e0c0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0a59c640 1 -- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0ce220 msgr2=0x7f4e0c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0a59c640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0ce220 0x7f4e0c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0a59c640 1 -- 172.21.15.80:0/1319238677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c0c9f30 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0ad9d640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0cf960 0x7f4e0c0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e0a59c640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c163280 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00ef00 tx=0x7f4dfc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc018020 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc00bd90 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c0c65e0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc014620 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.105+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c0c99c0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.106+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c0cdcf0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.107+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4dfc005d10 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.107+0000 7f4dfaffd640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4dec0744b0 0x7f4dec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.107+0000 7f4e09d9b640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4dec0744b0 0x7f4dec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:39.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.107+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5749+0+0 (secure 0 0 0) 0x7f4dfc095ad0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.107+0000 7f4e09d9b640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4dec0744b0 0x7f4dec0769c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c15fee0 tx=0x7f4e00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:39.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.112+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e0c0cdcf0 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.286+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e0c068c30 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.969+0000 7f4dfaffd640 1 -- 172.21.15.80:0/1319238677 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) ==== 169+0+0 (secure 0 0 0) 0x7f4e0c068c30 con 0x7f4e0c0b1ef0 2024-04-25T15:45:39.970 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.971+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4dec0744b0 msgr2=0x7f4dec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.971+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4dec0744b0 0x7f4dec0769c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c15fee0 tx=0x7f4e00008040 comp rx=0 tx=0).stop 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.971+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 msgr2=0x7f4e0c163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.971+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c163280 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00ef00 tx=0x7f4dfc00b480 comp rx=0 tx=0).stop 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 shutdown_connections 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4dec0744b0 0x7f4dec0769c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0cf960 0x7f4e0c0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0ce220 0x7f4e0c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 --2- 172.21.15.80:0/1319238677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e0c0b1ef0 0x7f4e0c163280 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 >> 172.21.15.80:0/1319238677 conn(0x7f4e0c0b7620 msgr2=0x7f4e0c0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 shutdown_connections 2024-04-25T15:45:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:39.972+0000 7f4e10bb7640 1 -- 172.21.15.80:0/1319238677 wait complete. 2024-04-25T15:45:39.992 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T15:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.103+0000 7f77a6f9d640 1 Processor -- start 2024-04-25T15:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.103+0000 7f77a6f9d640 1 -- start start 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a6f9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a6f9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f77a00b3420 0x7f77a00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a6f9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a00b3d70 con 0x7f77a00cf090 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a6f9d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f77a00d0120 con 0x7f77a00b3420 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a6f9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f77a00d1b70 con 0x7f77a006ee40 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a5f9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.104+0000 7f77a679c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f77a00b3420 0x7f77a00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a579a640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f77a00cf090 0x7f77a00d2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54106/0 (socket says 172.21.15.80:54106) 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a579a640 1 -- 172.21.15.80:0/1670501237 learned_addr learned my addr 172.21.15.80:0/1670501237 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a4f99640 1 -- 172.21.15.80:0/1670501237 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062583733 0 0) 0x7f7790001110 con 0x7f77a00cf090 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a4f99640 1 -- 172.21.15.80:0/1670501237 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f778c003520 con 0x7f77a00cf090 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a679c640 1 -- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 msgr2=0x7f77a00b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a679c640 1 --2- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a679c640 1 -- 172.21.15.80:0/1670501237 >> v1:172.21.15.195:6789/0 conn(0x7f77a00cf090 legacy=0x7f77a00d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a679c640 1 -- 172.21.15.80:0/1670501237 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a00d1e50 con 0x7f77a00b3420 2024-04-25T15:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.105+0000 7f77a5f9b640 1 --2- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:45:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.106+0000 7f77a679c640 1 --2- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a00b3830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77980097a0 tx=0x7f779802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=906fa60ae240c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.106+0000 7f77a4f99640 1 -- 172.21.15.80:0/1670501237 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798037070 con 0x7f77a00b3420 2024-04-25T15:45:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.106+0000 7f77a4f99640 1 -- 172.21.15.80:0/1670501237 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7798032440 con 0x7f77a00b3420 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.106+0000 7f77a4f99640 1 -- 172.21.15.80:0/1670501237 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77980327f0 con 0x7f77a00b3420 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 -- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 msgr2=0x7f77a00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a00b3830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77980097a0 tx=0x7f779802a180 comp rx=0 tx=0).stop 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 -- 172.21.15.80:0/1670501237 shutdown_connections 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a00b3830 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/1670501237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 -- 172.21.15.80:0/1670501237 >> 172.21.15.80:0/1670501237 conn(0x7f77a009b410 msgr2=0x7f77a009b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 -- 172.21.15.80:0/1670501237 shutdown_connections 2024-04-25T15:45:40.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.107+0000 7f77a6f9d640 1 -- 172.21.15.80:0/1670501237 wait complete. 2024-04-25T15:45:40.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.108+0000 7f77a6f9d640 1 Processor -- start 2024-04-25T15:45:40.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.109+0000 7f77a6f9d640 1 -- start start 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a6f9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a6f9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a6f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 0x7f77a00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a6f9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77a00d26f0 con 0x7f77a00cf090 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a6f9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f77a00d2410 con 0x7f77a00b3420 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a6f9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f77a00d1820 con 0x7f77a006ee40 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 0x7f77a00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 0x7f77a00c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40484/0 (socket says 172.21.15.80:40484) 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 -- 172.21.15.80:0/2408079308 learned_addr learned my addr 172.21.15.80:0/2408079308 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a579a640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a5f9b640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 -- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 msgr2=0x7f77a00ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 -- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 msgr2=0x7f77a015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a015cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 -- 172.21.15.80:0/2408079308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a00ceb90 con 0x7f77a00cf090 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.110+0000 7f77a679c640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 0x7f77a00c73f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f779802a1c0 tx=0x7f77980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.111+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798037040 con 0x7f77a00cf090 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.111+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779803b430 con 0x7f77a00cf090 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.111+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779803b7e0 con 0x7f77a00cf090 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.111+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a01f9930 con 0x7f77a00cf090 2024-04-25T15:45:40.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.111+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a01f9ef0 con 0x7f77a00cf090 2024-04-25T15:45:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.112+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a00507b0 con 0x7f77a00cf090 2024-04-25T15:45:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.112+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7798044020 con 0x7f77a00cf090 2024-04-25T15:45:40.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.113+0000 7f77967fc640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77840744b0 0x7f77840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.113+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f77980b4f10 con 0x7f77a00cf090 2024-04-25T15:45:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.113+0000 7f77a5f9b640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77840744b0 0x7f77840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.113+0000 7f77a5f9b640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77840744b0 0x7f77840769c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f779c009bd0 tx=0x7f779c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:40.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.117+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f779807f2e0 con 0x7f77a00cf090 2024-04-25T15:45:40.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.290+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f77a00ce920 con 0x7f77a00cf090 2024-04-25T15:45:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.294+0000 7f77967fc640 1 -- 172.21.15.80:0/2408079308 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f77980835e0 con 0x7f77a00cf090 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77840744b0 msgr2=0x7f77840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77840744b0 0x7f77840769c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f779c009bd0 tx=0x7f779c00b040 comp rx=0 tx=0).stop 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 msgr2=0x7f77a00c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 0x7f77a00c73f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f779802a1c0 tx=0x7f77980046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 shutdown_connections 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77840744b0 0x7f77840769c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77a00cf090 0x7f77a00c73f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.296+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77a00b3420 0x7f77a015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.297+0000 7f77a6f9d640 1 --2- 172.21.15.80:0/2408079308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77a006ee40 0x7f77a00ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.297+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 >> 172.21.15.80:0/2408079308 conn(0x7f77a009b410 msgr2=0x7f77a00c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.297+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 shutdown_connections 2024-04-25T15:45:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.297+0000 7f77a6f9d640 1 -- 172.21.15.80:0/2408079308 wait complete. 2024-04-25T15:45:40.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-04-25T15:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.414+0000 7f6b6d20c640 1 Processor -- start 2024-04-25T15:45:40.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.414+0000 7f6b6d20c640 1 -- start start 2024-04-25T15:45:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b6d20c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6b680cfc40 0x7f6b68160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b6d20c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b68164690 0x7f6b680714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b6d20c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68071df0 con 0x7f6b680719e0 2024-04-25T15:45:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b6d20c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6b680b6eb0 con 0x7f6b68164690 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b6d20c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6b680b7150 con 0x7f6b680cfc40 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b68164690 0x7f6b680714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b68164690 0x7f6b680714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40492/0 (socket says 172.21.15.80:40492) 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 -- 172.21.15.80:0/2460151919 learned_addr learned my addr 172.21.15.80:0/2460151919 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b66d9d640 1 --2- 172.21.15.80:0/2460151919 >> v2:172.21.15.195:3300/0 conn(0x7f6b680cfc40 0x7f6b68160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 -- 172.21.15.80:0/2460151919 >> v2:172.21.15.195:3300/0 conn(0x7f6b680cfc40 msgr2=0x7f6b68160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 --2- 172.21.15.80:0/2460151919 >> v2:172.21.15.195:3300/0 conn(0x7f6b680cfc40 0x7f6b68160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 -- 172.21.15.80:0/2460151919 >> v1:172.21.15.195:6789/0 conn(0x7f6b680719e0 legacy=0x7f6b6806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.416+0000 7f6b5ffff640 1 -- 172.21.15.80:0/2460151919 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680b51e0 con 0x7f6b68164690 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.417+0000 7f6b5ffff640 1 --2- 172.21.15.80:0/2460151919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b68164690 0x7f6b680714a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6b68073c60 tx=0x7f6b5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2093cab30b9ce3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.417+0000 7f6b6659c640 1 -- 172.21.15.80:0/2460151919 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50037070 con 0x7f6b68164690 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.417+0000 7f6b6659c640 1 -- 172.21.15.80:0/2460151919 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50032440 con 0x7f6b68164690 2024-04-25T15:45:40.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.417+0000 7f6b6659c640 1 -- 172.21.15.80:0/2460151919 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50032810 con 0x7f6b68164690 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 -- 172.21.15.80:0/2460151919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b68164690 msgr2=0x7f6b680714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/2460151919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b68164690 0x7f6b680714a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6b68073c60 tx=0x7f6b5002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 -- 172.21.15.80:0/2460151919 shutdown_connections 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/2460151919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b68164690 0x7f6b680714a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/2460151919 >> v2:172.21.15.195:3300/0 conn(0x7f6b680cfc40 0x7f6b68160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 -- 172.21.15.80:0/2460151919 >> 172.21.15.80:0/2460151919 conn(0x7f6b680d2080 msgr2=0x7f6b680d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 -- 172.21.15.80:0/2460151919 shutdown_connections 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.418+0000 7f6b6d20c640 1 -- 172.21.15.80:0/2460151919 wait complete. 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.420+0000 7f6b6d20c640 1 Processor -- start 2024-04-25T15:45:40.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.420+0000 7f6b6d20c640 1 -- start start 2024-04-25T15:45:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6d20c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b680719e0 0x7f6b681fa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6d20c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 0x7f6b6815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6d20c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b68164690 0x7f6b6815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6d20c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68072040 con 0x7f6b680cfc40 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6d20c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680b7430 con 0x7f6b68164690 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6d20c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680b6b70 con 0x7f6b680719e0 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b5ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 0x7f6b6815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b5ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 0x7f6b6815d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40494/0 (socket says 172.21.15.80:40494) 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b5ffff640 1 -- 172.21.15.80:0/151707814 learned_addr learned my addr 172.21.15.80:0/151707814 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b6759e640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b68164690 0x7f6b6815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b66d9d640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b680719e0 0x7f6b681fa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b5ffff640 1 -- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b680719e0 msgr2=0x7f6b681fa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.421+0000 7f6b5ffff640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b680719e0 0x7f6b681fa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5ffff640 1 -- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b68164690 msgr2=0x7f6b6815f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5ffff640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b68164690 0x7f6b6815f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5ffff640 1 -- 172.21.15.80:0/151707814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b681fa8f0 con 0x7f6b680cfc40 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b66d9d640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b680719e0 0x7f6b681fa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5ffff640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 0x7f6b6815d7c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6b50000c00 tx=0x7f6b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50041020 con 0x7f6b680cfc40 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b500306c0 con 0x7f6b680cfc40 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b681fabd0 con 0x7f6b680cfc40 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50037040 con 0x7f6b680cfc40 2024-04-25T15:45:40.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.422+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6815dea0 con 0x7f6b680cfc40 2024-04-25T15:45:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.423+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6806a100 con 0x7f6b680cfc40 2024-04-25T15:45:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.423+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6b50044020 con 0x7f6b680cfc40 2024-04-25T15:45:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.424+0000 7f6b5f7fe640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b480744b0 0x7f6b480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.424+0000 7f6b66d9d640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b480744b0 0x7f6b480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.424+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f6b500b5920 con 0x7f6b680cfc40 2024-04-25T15:45:40.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.424+0000 7f6b66d9d640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b480744b0 0x7f6b480769c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6b58006fd0 tx=0x7f6b58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.428+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b5004b030 con 0x7f6b680cfc40 2024-04-25T15:45:40.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.678+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7f6b68072570 con 0x7f6b680cfc40 2024-04-25T15:45:40.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.970+0000 7f6b5f7fe640 1 -- 172.21.15.80:0/151707814 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v176) ==== 142+0+0 (secure 0 0 0) 0x7f6b50080230 con 0x7f6b680cfc40 2024-04-25T15:45:40.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b480744b0 msgr2=0x7f6b480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b480744b0 0x7f6b480769c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6b58006fd0 tx=0x7f6b58008040 comp rx=0 tx=0).stop 2024-04-25T15:45:40.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 msgr2=0x7f6b6815d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:40.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 0x7f6b6815d7c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6b50000c00 tx=0x7f6b500046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 shutdown_connections 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6b480744b0 0x7f6b480769c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b68164690 0x7f6b6815f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b680cfc40 0x7f6b6815d7c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 --2- 172.21.15.80:0/151707814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6b680719e0 0x7f6b681fa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 >> 172.21.15.80:0/151707814 conn(0x7f6b680d2080 msgr2=0x7f6b6815ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 shutdown_connections 2024-04-25T15:45:40.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:40.973+0000 7f6b6d20c640 1 -- 172.21.15.80:0/151707814 wait complete. 2024-04-25T15:45:40.986 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... skipped 'Requires FUSE client to inject client metadata' 2024-04-25T15:45:40.986 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-04-25T15:45:40.987 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-25T15:45:40.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.095+0000 7f3909d34640 1 Processor -- start 2024-04-25T15:45:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.095+0000 7f3909d34640 1 -- start start 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.096+0000 7f3909d34640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39040b91c0 0x7f39040d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.096+0000 7f3909d34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040d2480 0x7f39040d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.096+0000 7f3909d34640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39040b2f30 con 0x7f39040b4b60 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.096+0000 7f3909d34640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f390406eb60 con 0x7f39040b91c0 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.096+0000 7f3909d34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f39040b2c90 con 0x7f39040d2480 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.096+0000 7f3902ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39040b91c0 0x7f39040d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39040b91c0 0x7f39040d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40502/0 (socket says 172.21.15.80:40502) 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 -- 172.21.15.80:0/2085759333 learned_addr learned my addr 172.21.15.80:0/2085759333 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3903fff640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040d2480 0x7f39040d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 -- 172.21.15.80:0/2085759333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040d2480 msgr2=0x7f39040d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040d2480 0x7f39040d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 -- 172.21.15.80:0/2085759333 >> v1:172.21.15.195:6789/0 conn(0x7f39040b4b60 legacy=0x7f390406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 -- 172.21.15.80:0/2085759333 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39040d10a0 con 0x7f39040b91c0 2024-04-25T15:45:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3903fff640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040d2480 0x7f39040d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.097+0000 7f3902ffd640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040b91c0 0x7f39040d1f40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f38f80098a0 tx=0x7f38f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0906db2320cafc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f39027fc640 1 -- 172.21.15.80:0/2085759333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8037070 con 0x7f39040b91c0 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f39027fc640 1 -- 172.21.15.80:0/2085759333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f8032440 con 0x7f39040b91c0 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f39027fc640 1 -- 172.21.15.80:0/2085759333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8032810 con 0x7f39040b91c0 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 -- 172.21.15.80:0/2085759333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040b91c0 msgr2=0x7f39040d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040b91c0 0x7f39040d1f40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f38f80098a0 tx=0x7f38f802a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 -- 172.21.15.80:0/2085759333 shutdown_connections 2024-04-25T15:45:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040d2480 0x7f39040d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 --2- 172.21.15.80:0/2085759333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040b91c0 0x7f39040d1f40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 -- 172.21.15.80:0/2085759333 >> 172.21.15.80:0/2085759333 conn(0x7f39040d0450 msgr2=0x7f39040d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 -- 172.21.15.80:0/2085759333 shutdown_connections 2024-04-25T15:45:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.098+0000 7f3909d34640 1 -- 172.21.15.80:0/2085759333 wait complete. 2024-04-25T15:45:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.100+0000 7f3909d34640 1 Processor -- start 2024-04-25T15:45:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.101+0000 7f3909d34640 1 -- start start 2024-04-25T15:45:41.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3909d34640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040b4b60 0x7f39041dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3909d34640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39040b91c0 0x7f39040cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3909d34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 0x7f39040cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3909d34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f390409d0e0 con 0x7f39040d2480 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3909d34640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f390409cbe0 con 0x7f39040b91c0 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3909d34640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f390409d260 con 0x7f39040b4b60 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 0x7f39040cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 0x7f39040cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40506/0 (socket says 172.21.15.80:40506) 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 -- 172.21.15.80:0/3266546087 learned_addr learned my addr 172.21.15.80:0/3266546087 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f39037fe640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040b4b60 0x7f39041dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3902ffd640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39040b91c0 0x7f39040cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 -- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040b4b60 msgr2=0x7f39041dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040b4b60 0x7f39041dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 -- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39040b91c0 msgr2=0x7f39040cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39040b91c0 0x7f39040cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 -- 172.21.15.80:0/3266546087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39041e7040 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.102+0000 7f3903fff640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 0x7f39040cf590 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00cdb0 tx=0x7f38fc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.103+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00f680 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.103+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc00f840 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.103+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00fc30 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.103+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39041e72e0 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.103+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39041e78a0 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.104+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3904075c90 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.104+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f38fc0213f0 con 0x7f39040d2480 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.105+0000 7f38ebfff640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f38f00744e0 0x7f38f00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.105+0000 7f39037fe640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f38f00744e0 0x7f38f00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.105+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f38fc095d30 con 0x7f39040d2480 2024-04-25T15:45:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.105+0000 7f39037fe640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f38f00744e0 0x7f38f00769f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f39040d1810 tx=0x7f38f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.110+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38fc014030 con 0x7f39040d2480 2024-04-25T15:45:41.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.285+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39040b3b50 con 0x7f39040d2480 2024-04-25T15:45:41.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.285+0000 7f38ebfff640 1 -- 172.21.15.80:0/3266546087 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+13282 (secure 0 0 0) 0x7f38fc060630 con 0x7f39040d2480 2024-04-25T15:45:41.287 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:41.287 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":66,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:39.964450+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/4035847402":"2024-04-26T15:45:36.955614+0000","172.21.15.80:6835/4035847402":"2024-04-26T15:45:36.955614+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.287+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f38f00744e0 msgr2=0x7f38f00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.287+0000 7f3909d34640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f38f00744e0 0x7f38f00769f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f39040d1810 tx=0x7f38f4008040 comp rx=0 tx=0).stop 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.287+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 msgr2=0x7f39040cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.287+0000 7f3909d34640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 0x7f39040cf590 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00cdb0 tx=0x7f38fc00a650 comp rx=0 tx=0).stop 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.287+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 shutdown_connections 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.287+0000 7f3909d34640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f38f00744e0 0x7f38f00769f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.288+0000 7f3909d34640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39040d2480 0x7f39040cf590 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.288+0000 7f3909d34640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39040b91c0 0x7f39040cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.288+0000 7f3909d34640 1 --2- 172.21.15.80:0/3266546087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39040b4b60 0x7f39041dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.288+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 >> 172.21.15.80:0/3266546087 conn(0x7f39040d0450 msgr2=0x7f390406d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.288+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 shutdown_connections 2024-04-25T15:45:41.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.288+0000 7f3909d34640 1 -- 172.21.15.80:0/3266546087 wait complete. 2024-04-25T15:45:41.300 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:41.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.409+0000 7f3bc7184640 1 Processor -- start 2024-04-25T15:45:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.409+0000 7f3bc7184640 1 -- start start 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc7184640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3bc006cc10 0x7f3bc006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc7184640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bc00b37b0 0x7f3bc006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc7184640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc00d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc7184640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc00cfc90 con 0x7f3bc00b37b0 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc7184640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc006c9a0 con 0x7f3bc006cc10 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc7184640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc00d2c10 con 0x7f3bc0163860 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bc00b37b0 0x7f3bc006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bc00b37b0 0x7f3bc006d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40520/0 (socket says 172.21.15.80:40520) 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 -- 172.21.15.80:0/2701145198 learned_addr learned my addr 172.21.15.80:0/2701145198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc4f20640 1 --2- 172.21.15.80:0/2701145198 >> v2:172.21.15.195:3300/0 conn(0x7f3bc006cc10 0x7f3bc006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bc5721640 1 --2- 172.21.15.80:0/2701145198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc00d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 -- 172.21.15.80:0/2701145198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 msgr2=0x7f3bc00d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 --2- 172.21.15.80:0/2701145198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc00d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 -- 172.21.15.80:0/2701145198 >> v2:172.21.15.195:3300/0 conn(0x7f3bc006cc10 msgr2=0x7f3bc006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 --2- 172.21.15.80:0/2701145198 >> v2:172.21.15.195:3300/0 conn(0x7f3bc006cc10 0x7f3bc006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.411+0000 7f3bbffff640 1 -- 172.21.15.80:0/2701145198 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc00cff30 con 0x7f3bc00b37b0 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.412+0000 7f3bbffff640 1 --2- 172.21.15.80:0/2701145198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc006d6a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3bc009b9f0 tx=0x7f3bb402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b004562d1af262 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.412+0000 7f3bbf7fe640 1 -- 172.21.15.80:0/2701145198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4037070 con 0x7f3bc00b37b0 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.412+0000 7f3bbf7fe640 1 -- 172.21.15.80:0/2701145198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4032440 con 0x7f3bc00b37b0 2024-04-25T15:45:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.412+0000 7f3bbf7fe640 1 -- 172.21.15.80:0/2701145198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4032810 con 0x7f3bc00b37b0 2024-04-25T15:45:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 -- 172.21.15.80:0/2701145198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 msgr2=0x7f3bc006d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2701145198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc006d6a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3bc009b9f0 tx=0x7f3bb402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 -- 172.21.15.80:0/2701145198 shutdown_connections 2024-04-25T15:45:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2701145198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc00d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2701145198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc006d6a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2701145198 >> v2:172.21.15.195:3300/0 conn(0x7f3bc006cc10 0x7f3bc006d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 -- 172.21.15.80:0/2701145198 >> 172.21.15.80:0/2701145198 conn(0x7f3bc009b410 msgr2=0x7f3bc00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 -- 172.21.15.80:0/2701145198 shutdown_connections 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.413+0000 7f3bc7184640 1 -- 172.21.15.80:0/2701145198 wait complete. 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.414+0000 7f3bc7184640 1 Processor -- start 2024-04-25T15:45:41.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.414+0000 7f3bc7184640 1 -- start start 2024-04-25T15:45:41.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc7184640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bc006cc10 0x7f3bc00caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc7184640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc7184640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc7184640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0076230 con 0x7f3bc00b37b0 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc7184640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc006c670 con 0x7f3bc006cc10 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc7184640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc00d20a0 con 0x7f3bc0163860 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc00c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40532/0 (socket says 172.21.15.80:40532) 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 -- 172.21.15.80:0/2831882996 learned_addr learned my addr 172.21.15.80:0/2831882996 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc4f20640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bc006cc10 0x7f3bc00caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc5721640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 -- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 msgr2=0x7f3bc006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 -- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bc006cc10 msgr2=0x7f3bc00caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bc006cc10 0x7f3bc00caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bbffff640 1 -- 172.21.15.80:0/2831882996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc00cb4a0 con 0x7f3bc00b37b0 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.416+0000 7f3bc5721640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.417+0000 7f3bbffff640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc00c7cb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3bb402a220 tx=0x7f3bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.417+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4037040 con 0x7f3bc00b37b0 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.417+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4042070 con 0x7f3bc00b37b0 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.417+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc015ac40 con 0x7f3bc00b37b0 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.417+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4030bb0 con 0x7f3bc00b37b0 2024-04-25T15:45:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.417+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc00c5da0 con 0x7f3bc00b37b0 2024-04-25T15:45:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.418+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc00c8590 con 0x7f3bc00b37b0 2024-04-25T15:45:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.419+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3bb4047460 con 0x7f3bc00b37b0 2024-04-25T15:45:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.419+0000 7f3bbd7fa640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bac0744e0 0x7f3bac0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.419+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f3bb40b5c70 con 0x7f3bc00b37b0 2024-04-25T15:45:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.419+0000 7f3bc4f20640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bac0744e0 0x7f3bac0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.419+0000 7f3bc4f20640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bac0744e0 0x7f3bac0769f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0007db0 tx=0x7f3bb0007600 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.424+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3bb4080600 con 0x7f3bc00b37b0 2024-04-25T15:45:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.597+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3bc006a100 con 0x7f3bc00b37b0 2024-04-25T15:45:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.597+0000 7f3bbd7fa640 1 -- 172.21.15.80:0/2831882996 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7f3bb407ff00 con 0x7f3bc00b37b0 2024-04-25T15:45:41.599 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bac0744e0 msgr2=0x7f3bac0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bac0744e0 0x7f3bac0769f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0007db0 tx=0x7f3bb0007600 comp rx=0 tx=0).stop 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 msgr2=0x7f3bc00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc00c7cb0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3bb402a220 tx=0x7f3bb40046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 shutdown_connections 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bac0744e0 0x7f3bac0769f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bc0163860 0x7f3bc006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bc00b37b0 0x7f3bc00c7cb0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 --2- 172.21.15.80:0/2831882996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bc006cc10 0x7f3bc00caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.599+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 >> 172.21.15.80:0/2831882996 conn(0x7f3bc009b410 msgr2=0x7f3bc006fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.600+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 shutdown_connections 2024-04-25T15:45:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.600+0000 7f3bc7184640 1 -- 172.21.15.80:0/2831882996 wait complete. 2024-04-25T15:45:41.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-04-25T15:45:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.717+0000 7f7c37f57640 1 Processor -- start 2024-04-25T15:45:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.717+0000 7f7c37f57640 1 -- start start 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c37f57640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c300ce220 0x7f7c3009bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c37f57640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c301607c0 con 0x7f7c300cf960 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c37f57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c300d0180 con 0x7f7c300cfd70 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c37f57640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f7c300cf4d0 con 0x7f7c300ce220 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c354f2640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7c300cf960 0x7f7c300b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33218/0 (socket says 172.21.15.80:33218) 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c354f2640 1 -- 172.21.15.80:0/4042875803 learned_addr learned my addr 172.21.15.80:0/4042875803 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c35cf3640 1 --2- 172.21.15.80:0/4042875803 >> v2:172.21.15.80:3300/0 conn(0x7f7c300ce220 0x7f7c3009bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c35cf3640 1 -- 172.21.15.80:0/4042875803 >> v1:172.21.15.195:6789/0 conn(0x7f7c300cfd70 legacy=0x7f7c300d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c35cf3640 1 -- 172.21.15.80:0/4042875803 >> v1:172.21.15.80:6789/0 conn(0x7f7c300cf960 legacy=0x7f7c300b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c34cf1640 1 -- 172.21.15.80:0/4042875803 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725893557 0 0) 0x7f7c301607c0 con 0x7f7c300cf960 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.719+0000 7f7c35cf3640 1 -- 172.21.15.80:0/4042875803 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c300ceba0 con 0x7f7c300ce220 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.720+0000 7f7c35cf3640 1 --2- 172.21.15.80:0/4042875803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c3009bb70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009d90 tx=0x7f7c2c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe2501ee66d6518 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.720+0000 7f7c34cf1640 1 -- 172.21.15.80:0/4042875803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c037070 con 0x7f7c300ce220 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.720+0000 7f7c34cf1640 1 -- 172.21.15.80:0/4042875803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c007740 con 0x7f7c300ce220 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.720+0000 7f7c34cf1640 1 -- 172.21.15.80:0/4042875803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c007b10 con 0x7f7c300ce220 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 -- 172.21.15.80:0/4042875803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 msgr2=0x7f7c3009bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 --2- 172.21.15.80:0/4042875803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c3009bb70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009d90 tx=0x7f7c2c02a780 comp rx=0 tx=0).stop 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 -- 172.21.15.80:0/4042875803 shutdown_connections 2024-04-25T15:45:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 --2- 172.21.15.80:0/4042875803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c3009bb70 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 -- 172.21.15.80:0/4042875803 >> 172.21.15.80:0/4042875803 conn(0x7f7c300b7620 msgr2=0x7f7c300b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 -- 172.21.15.80:0/4042875803 shutdown_connections 2024-04-25T15:45:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.721+0000 7f7c37f57640 1 -- 172.21.15.80:0/4042875803 wait complete. 2024-04-25T15:45:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.723+0000 7f7c37f57640 1 Processor -- start 2024-04-25T15:45:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.723+0000 7f7c37f57640 1 -- start start 2024-04-25T15:45:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c37f57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c301e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c37f57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c300cf960 0x7f7c300cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c37f57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c300cfd70 0x7f7c3015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c37f57640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7c300cf160 con 0x7f7c300ce220 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c37f57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7c300ce630 con 0x7f7c300cfd70 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c37f57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3009c0b0 con 0x7f7c300cf960 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c301e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c301e9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40544/0 (socket says 172.21.15.80:40544) 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 -- 172.21.15.80:0/3598057544 learned_addr learned my addr 172.21.15.80:0/3598057544 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 -- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c300cf960 msgr2=0x7f7c300cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c300cf960 0x7f7c300cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 -- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c300cfd70 msgr2=0x7f7c3015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c364f4640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c300cfd70 0x7f7c3015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c300cfd70 0x7f7c3015ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.724+0000 7f7c35cf3640 1 -- 172.21.15.80:0/3598057544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30162bf0 con 0x7f7c300ce220 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.725+0000 7f7c35cf3640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c301e9390 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c035040 tx=0x7f7c2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.725+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c042070 con 0x7f7c300ce220 2024-04-25T15:45:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.725+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c007e40 con 0x7f7c300ce220 2024-04-25T15:45:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.725+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c30162ed0 con 0x7f7c300ce220 2024-04-25T15:45:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.725+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c037040 con 0x7f7c300ce220 2024-04-25T15:45:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.725+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c30163490 con 0x7f7c300ce220 2024-04-25T15:45:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.726+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3006a100 con 0x7f7c300ce220 2024-04-25T15:45:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.726+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7c2c003990 con 0x7f7c300ce220 2024-04-25T15:45:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.727+0000 7f7c267fc640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7c140744b0 0x7f7c140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.727+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f7c2c0b61e0 con 0x7f7c300ce220 2024-04-25T15:45:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.727+0000 7f7c354f2640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7c140744b0 0x7f7c140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.727+0000 7f7c354f2640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7c140744b0 0x7f7c140769c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7c20000c00 tx=0x7f7c200079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.731+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c2c04c020 con 0x7f7c300ce220 2024-04-25T15:45:41.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:41.980+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) -- 0x7f7c3006dd30 con 0x7f7c300ce220 2024-04-25T15:45:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.977+0000 7f7c267fc640 1 -- 172.21.15.80:0/3598057544 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v178) ==== 146+0+0 (secure 0 0 0) 0x7f7c2c080c30 con 0x7f7c300ce220 2024-04-25T15:45:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7c140744b0 msgr2=0x7f7c140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7c140744b0 0x7f7c140769c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7c20000c00 tx=0x7f7c200079c0 comp rx=0 tx=0).stop 2024-04-25T15:45:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 msgr2=0x7f7c301e9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c301e9390 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c035040 tx=0x7f7c2c004a40 comp rx=0 tx=0).stop 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 shutdown_connections 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7c140744b0 0x7f7c140769c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c300cfd70 0x7f7c3015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c300cf960 0x7f7c300cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 --2- 172.21.15.80:0/3598057544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c300ce220 0x7f7c301e9390 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 >> 172.21.15.80:0/3598057544 conn(0x7f7c300b7620 msgr2=0x7f7c300b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 shutdown_connections 2024-04-25T15:45:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:42.981+0000 7f7c37f57640 1 -- 172.21.15.80:0/3598057544 wait complete. 2024-04-25T15:45:42.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T15:45:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.112+0000 7f8fbb7d5640 1 Processor -- start 2024-04-25T15:45:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.112+0000 7f8fbb7d5640 1 -- start start 2024-04-25T15:45:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fbb7d5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8fb40b2b80 0x7f8fb415e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fbb7d5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fb40cee90 0x7f8fb40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fbb7d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb40d0cd0 con 0x7f8fb40d08c0 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fbb7d5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb4161b00 con 0x7f8fb40cee90 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fbb7d5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb4161dc0 con 0x7f8fb40b2b80 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fb8d70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fb40cee90 0x7f8fb40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fb9d72640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8fb40d08c0 0x7f8fb4071970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33222/0 (socket says 172.21.15.80:33222) 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.113+0000 7f8fb9d72640 1 -- 172.21.15.80:0/1807825154 learned_addr learned my addr 172.21.15.80:0/1807825154 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fb9571640 1 --2- 172.21.15.80:0/1807825154 >> v2:172.21.15.195:3300/0 conn(0x7f8fb40b2b80 0x7f8fb415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fb8d70640 1 -- 172.21.15.80:0/1807825154 >> v2:172.21.15.195:3300/0 conn(0x7f8fb40b2b80 msgr2=0x7f8fb415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fb8d70640 1 --2- 172.21.15.80:0/1807825154 >> v2:172.21.15.195:3300/0 conn(0x7f8fb40b2b80 0x7f8fb415e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fb8d70640 1 -- 172.21.15.80:0/1807825154 >> v1:172.21.15.80:6789/0 conn(0x7f8fb40d08c0 legacy=0x7f8fb4071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fabfff640 1 -- 172.21.15.80:0/1807825154 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239411703 0 0) 0x7f8fb40d0cd0 con 0x7f8fb40d08c0 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fb8d70640 1 -- 172.21.15.80:0/1807825154 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41620a0 con 0x7f8fb40cee90 2024-04-25T15:45:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.114+0000 7f8fb8d70640 1 --2- 172.21.15.80:0/1807825154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40cee90 0x7f8fb40d0380 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4074100 tx=0x7f8fa402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c7ed68a84979c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:43.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fabfff640 1 -- 172.21.15.80:0/1807825154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4037070 con 0x7f8fb40cee90 2024-04-25T15:45:43.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fabfff640 1 -- 172.21.15.80:0/1807825154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa4032440 con 0x7f8fb40cee90 2024-04-25T15:45:43.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fabfff640 1 -- 172.21.15.80:0/1807825154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa402ae60 con 0x7f8fb40cee90 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/1807825154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40cee90 msgr2=0x7f8fb40d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/1807825154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40cee90 0x7f8fb40d0380 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4074100 tx=0x7f8fa402a110 comp rx=0 tx=0).stop 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/1807825154 shutdown_connections 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/1807825154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40cee90 0x7f8fb40d0380 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/1807825154 >> v2:172.21.15.195:3300/0 conn(0x7f8fb40b2b80 0x7f8fb415e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/1807825154 >> 172.21.15.80:0/1807825154 conn(0x7f8fb40b54a0 msgr2=0x7f8fb40b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/1807825154 shutdown_connections 2024-04-25T15:45:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.115+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/1807825154 wait complete. 2024-04-25T15:45:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.117+0000 7f8fbb7d5640 1 Processor -- start 2024-04-25T15:45:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.117+0000 7f8fbb7d5640 1 -- start start 2024-04-25T15:45:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fbb7d5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fb40b2b80 0x7f8fb414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fbb7d5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fb40cee90 0x7f8fb4160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fbb7d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 0x7f8fb41607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fbb7d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4162940 con 0x7f8fb40d08c0 2024-04-25T15:45:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fbb7d5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4162660 con 0x7f8fb40cee90 2024-04-25T15:45:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fbb7d5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb40cf2a0 con 0x7f8fb40b2b80 2024-04-25T15:45:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fb9d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 0x7f8fb41607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fb9d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 0x7f8fb41607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40568/0 (socket says 172.21.15.80:40568) 2024-04-25T15:45:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.118+0000 7f8fb9d72640 1 -- 172.21.15.80:0/2773343542 learned_addr learned my addr 172.21.15.80:0/2773343542 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb8d70640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fb40cee90 0x7f8fb4160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9571640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fb40b2b80 0x7f8fb414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9d72640 1 -- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fb40b2b80 msgr2=0x7f8fb414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9d72640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fb40b2b80 0x7f8fb414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9d72640 1 -- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fb40cee90 msgr2=0x7f8fb4160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9d72640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fb40cee90 0x7f8fb4160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9d72640 1 -- 172.21.15.80:0/2773343542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb415f220 con 0x7f8fb40d08c0 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fb9d72640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 0x7f8fb41607d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00caf0 tx=0x7f8fac002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00abd0 con 0x7f8fb40d08c0 2024-04-25T15:45:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac00ad70 con 0x7f8fb40d08c0 2024-04-25T15:45:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb415f500 con 0x7f8fb40d08c0 2024-04-25T15:45:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac012640 con 0x7f8fb40d08c0 2024-04-25T15:45:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.119+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb415fac0 con 0x7f8fb40d08c0 2024-04-25T15:45:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.120+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb406a100 con 0x7f8fb40d08c0 2024-04-25T15:45:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.121+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8fac0127e0 con 0x7f8fb40d08c0 2024-04-25T15:45:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.121+0000 7f8fa9ffb640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f980744b0 0x7f8f980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.121+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f8fac095600 con 0x7f8fb40d08c0 2024-04-25T15:45:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.121+0000 7f8fb9571640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f980744b0 0x7f8f980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.122+0000 7f8fb9571640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f980744b0 0x7f8f980769c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0006fd0 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.126+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8fac05ff90 con 0x7f8fb40d08c0 2024-04-25T15:45:43.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.301+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8fb40d1c50 con 0x7f8fb40d08c0 2024-04-25T15:45:43.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.304+0000 7f8fa9ffb640 1 -- 172.21.15.80:0/2773343542 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f8fac05f890 con 0x7f8fb40d08c0 2024-04-25T15:45:43.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f980744b0 msgr2=0x7f8f980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f980744b0 0x7f8f980769c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0006fd0 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2024-04-25T15:45:43.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 msgr2=0x7f8fb41607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 0x7f8fb41607d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00caf0 tx=0x7f8fac002190 comp rx=0 tx=0).stop 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 shutdown_connections 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8f980744b0 0x7f8f980769c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb40d08c0 0x7f8fb41607d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fb40cee90 0x7f8fb4160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 --2- 172.21.15.80:0/2773343542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fb40b2b80 0x7f8fb414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 >> 172.21.15.80:0/2773343542 conn(0x7f8fb40b54a0 msgr2=0x7f8fb40b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 shutdown_connections 2024-04-25T15:45:43.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.307+0000 7f8fbb7d5640 1 -- 172.21.15.80:0/2773343542 wait complete. 2024-04-25T15:45:43.319 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:45:43.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:45:43.356 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:45:43.408 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:45:43.408 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:43.408 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:43.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:45:43.423 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:43.423 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:43.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:45:43.441 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:43.441 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:43.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:45:43.480 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:45:43.480 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:43.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:45:43.499 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T15:45:43.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.626+0000 7f3969696640 1 Processor -- start 2024-04-25T15:45:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.626+0000 7f3969696640 1 -- start start 2024-04-25T15:45:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3969696640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f39640d34a0 0x7f39640b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3969696640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39640b3ac0 0x7f39640b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3969696640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39640d1010 con 0x7f396406da90 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3969696640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f396409cdf0 con 0x7f39640b3ac0 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3969696640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f396409d0d0 con 0x7f39640d34a0 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39637fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39640b3ac0 0x7f39640b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39627fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f396406da90 0x7f396406e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33238/0 (socket says 172.21.15.80:33238) 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39627fc640 1 -- 172.21.15.80:0/3958966051 learned_addr learned my addr 172.21.15.80:0/3958966051 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3962ffd640 1 --2- 172.21.15.80:0/3958966051 >> v2:172.21.15.195:3300/0 conn(0x7f39640d34a0 0x7f39640b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39637fe640 1 -- 172.21.15.80:0/3958966051 >> v2:172.21.15.195:3300/0 conn(0x7f39640d34a0 msgr2=0x7f39640b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39637fe640 1 --2- 172.21.15.80:0/3958966051 >> v2:172.21.15.195:3300/0 conn(0x7f39640d34a0 0x7f39640b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39637fe640 1 -- 172.21.15.80:0/3958966051 >> v1:172.21.15.80:6789/0 conn(0x7f396406da90 legacy=0x7f396406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f39637fe640 1 -- 172.21.15.80:0/3958966051 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396406ec70 con 0x7f39640b3ac0 2024-04-25T15:45:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.628+0000 7f3961ffb640 1 -- 172.21.15.80:0/3958966051 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174611263 0 0) 0x7f39640d1010 con 0x7f396406da90 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.629+0000 7f39637fe640 1 --2- 172.21.15.80:0/3958966051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39640b3ac0 0x7f39640b3ed0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3964074480 tx=0x7f395c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee1f0f34b9e0b48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.629+0000 7f3961ffb640 1 -- 172.21.15.80:0/3958966051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c037070 con 0x7f39640b3ac0 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.629+0000 7f3961ffb640 1 -- 172.21.15.80:0/3958966051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395c032440 con 0x7f39640b3ac0 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.629+0000 7f3961ffb640 1 -- 172.21.15.80:0/3958966051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c032810 con 0x7f39640b3ac0 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 -- 172.21.15.80:0/3958966051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39640b3ac0 msgr2=0x7f39640b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 --2- 172.21.15.80:0/3958966051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39640b3ac0 0x7f39640b3ed0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3964074480 tx=0x7f395c02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 -- 172.21.15.80:0/3958966051 shutdown_connections 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 --2- 172.21.15.80:0/3958966051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39640b3ac0 0x7f39640b3ed0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 --2- 172.21.15.80:0/3958966051 >> v2:172.21.15.195:3300/0 conn(0x7f39640d34a0 0x7f39640b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 -- 172.21.15.80:0/3958966051 >> 172.21.15.80:0/3958966051 conn(0x7f39640d0450 msgr2=0x7f39640d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 -- 172.21.15.80:0/3958966051 shutdown_connections 2024-04-25T15:45:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.630+0000 7f3969696640 1 -- 172.21.15.80:0/3958966051 wait complete. 2024-04-25T15:45:43.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.632+0000 7f3969696640 1 Processor -- start 2024-04-25T15:45:43.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.632+0000 7f3969696640 1 -- start start 2024-04-25T15:45:43.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3969696640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 0x7f39641f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3969696640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39640b3ac0 0x7f396409eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3969696640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39640d34a0 0x7f396409f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3969696640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f39640b4410 con 0x7f396406da90 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3969696640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f396406d7b0 con 0x7f39640d34a0 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3969696640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f39640b4590 con 0x7f39640b3ac0 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 0x7f39641f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 0x7f39641f6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40596/0 (socket says 172.21.15.80:40596) 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 -- 172.21.15.80:0/1079394135 learned_addr learned my addr 172.21.15.80:0/1079394135 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f39637fe640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39640d34a0 0x7f396409f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f39627fc640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39640b3ac0 0x7f396409eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 -- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39640b3ac0 msgr2=0x7f396409eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39640b3ac0 0x7f396409eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 -- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39640d34a0 msgr2=0x7f396409f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39640d34a0 0x7f396409f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.633+0000 7f3962ffd640 1 -- 172.21.15.80:0/1079394135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39640b0e60 con 0x7f396406da90 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f39627fc640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39640b3ac0 0x7f396409eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f3962ffd640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 0x7f39641f6d10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3954007f20 tx=0x7f395400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954014620 con 0x7f396406da90 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954019070 con 0x7f396406da90 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954014a00 con 0x7f396406da90 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39640b1140 con 0x7f396406da90 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.634+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39640b1700 con 0x7f396406da90 2024-04-25T15:45:43.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.635+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396406a100 con 0x7f396406da90 2024-04-25T15:45:43.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.636+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3954014ba0 con 0x7f396406da90 2024-04-25T15:45:43.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.636+0000 7f394b7fe640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39500744e0 0x7f39500769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:43.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.636+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f3954095900 con 0x7f396406da90 2024-04-25T15:45:43.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.636+0000 7f39627fc640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39500744e0 0x7f39500769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:43.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.636+0000 7f39627fc640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39500744e0 0x7f39500769f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3958007fd0 tx=0x7f3958007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:43.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.640+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3954060200 con 0x7f396406da90 2024-04-25T15:45:43.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.855+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39640b52a0 con 0x7f396406da90 2024-04-25T15:45:43.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.855+0000 7f394b7fe640 1 -- 172.21.15.80:0/1079394135 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3875 (secure 0 0 0) 0x7f395405fb00 con 0x7f396406da90 2024-04-25T15:45:43.857 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:43.857 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2217046143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2217046143},{"type":"v1","addr":"172.21.15.80:6836","nonce":2217046143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/1009379139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":1009379139},{"type":"v1","addr":"172.21.15.195:6834","nonce":1009379139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3073089106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3073089106},{"type":"v1","addr":"172.21.15.195:6835","nonce":3073089106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":6606,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3296996743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3296996743},{"type":"v1","addr":"172.21.15.80:6837","nonce":3296996743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-04-25T15:45:43.857 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2024-04-25T15:45:43.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39500744e0 msgr2=0x7f39500769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39500744e0 0x7f39500769f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3958007fd0 tx=0x7f3958007de0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 msgr2=0x7f39641f6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:43.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 0x7f39641f6d10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3954007f20 tx=0x7f395400e570 comp rx=0 tx=0).stop 2024-04-25T15:45:43.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 shutdown_connections 2024-04-25T15:45:43.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39500744e0 0x7f39500769f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39640d34a0 0x7f396409f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39640b3ac0 0x7f396409eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.857+0000 7f3969696640 1 --2- 172.21.15.80:0/1079394135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f396406da90 0x7f39641f6d10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:43.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.858+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 >> 172.21.15.80:0/1079394135 conn(0x7f39640d0450 msgr2=0x7f3964162bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:43.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.858+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 shutdown_connections 2024-04-25T15:45:43.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:43.858+0000 7f3969696640 1 -- 172.21.15.80:0/1079394135 wait complete. 2024-04-25T15:45:43.870 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:45:43.870 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T15:45:43.871 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:45:43.871 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:43.871 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:45:43.871 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T15:45:43.871 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:45:43.871 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:43.871 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:45:43.871 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T15:45:43.872 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:45:43.872 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:43.872 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:45:43.872 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T15:45:43.872 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:45:43.872 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:45:43.882 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:45:43.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:45:43.884 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:45:43.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:45:43.885 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:45:43.885 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:45:43.886 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:45:43.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:45:43.926 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:45:43.926 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:43.927 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:45:43.927 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:43.928 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:45:43.928 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:43.929 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:45:43.929 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:43.929 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T15:45:44.011 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:45:44.012 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:45:44.023 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:45:44.024 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:45:44.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.045+0000 7fddd2242640 1 Processor -- start 2024-04-25T15:45:44.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.045+0000 7fddd2242640 1 -- start start 2024-04-25T15:45:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.046+0000 7fddd2242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc163d20 0x7fddcc160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.046+0000 7fddd2242640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddcc164300 con 0x7fddcc0ce680 2024-04-25T15:45:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.046+0000 7fddd2242640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddcc1645e0 con 0x7fddcc0d1590 2024-04-25T15:45:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.046+0000 7fddd2242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fddcc06e350 con 0x7fddcc163d20 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddcb7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fddcc0ce680 0x7fddcc0d2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33280/0 (socket says 172.21.15.80:33280) 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddcb7fe640 1 -- 172.21.15.80:0/3169503632 learned_addr learned my addr 172.21.15.80:0/3169503632 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddcaffd640 1 --2- 172.21.15.80:0/3169503632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc163d20 0x7fddcc160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddca7fc640 1 -- 172.21.15.80:0/3169503632 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994612196 0 0) 0x7fddcc164300 con 0x7fddcc0ce680 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddca7fc640 1 -- 172.21.15.80:0/3169503632 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb4003520 con 0x7fddcc0ce680 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddcaffd640 1 -- 172.21.15.80:0/3169503632 >> v1:172.21.15.195:6789/0 conn(0x7fddcc0d1590 legacy=0x7fddcc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddcaffd640 1 -- 172.21.15.80:0/3169503632 >> v1:172.21.15.80:6789/0 conn(0x7fddcc0ce680 legacy=0x7fddcc0d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.047+0000 7fddcaffd640 1 -- 172.21.15.80:0/3169503632 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc1648c0 con 0x7fddcc163d20 2024-04-25T15:45:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.048+0000 7fddcaffd640 1 --2- 172.21.15.80:0/3169503632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc163d20 0x7fddcc160120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fddcc06e4d0 tx=0x7fddc002a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f065ec7ca57dda36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.048+0000 7fddca7fc640 1 -- 172.21.15.80:0/3169503632 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0037070 con 0x7fddcc163d20 2024-04-25T15:45:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.048+0000 7fddca7fc640 1 -- 172.21.15.80:0/3169503632 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc002ad10 con 0x7fddcc163d20 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.048+0000 7fddca7fc640 1 -- 172.21.15.80:0/3169503632 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0032640 con 0x7fddcc163d20 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 -- 172.21.15.80:0/3169503632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc163d20 msgr2=0x7fddcc160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 --2- 172.21.15.80:0/3169503632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc163d20 0x7fddcc160120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fddcc06e4d0 tx=0x7fddc002a000 comp rx=0 tx=0).stop 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 -- 172.21.15.80:0/3169503632 shutdown_connections 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 --2- 172.21.15.80:0/3169503632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc163d20 0x7fddcc160120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 -- 172.21.15.80:0/3169503632 >> 172.21.15.80:0/3169503632 conn(0x7fddcc0d39c0 msgr2=0x7fddcc0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 -- 172.21.15.80:0/3169503632 shutdown_connections 2024-04-25T15:45:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.049+0000 7fddd2242640 1 -- 172.21.15.80:0/3169503632 wait complete. 2024-04-25T15:45:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.050+0000 7fddd2242640 1 Processor -- start 2024-04-25T15:45:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.051+0000 7fddd2242640 1 -- start start 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddd2242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc0ce680 0x7fddcc0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddd2242640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0d1590 0x7fddcc0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddd2242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 0x7fddcc0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddd2242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc16b050 con 0x7fddcc163d20 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddd2242640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc160660 con 0x7fddcc0d1590 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddd2242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fddcc16b1d0 con 0x7fddcc0ce680 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 0x7fddcc0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 0x7fddcc0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40620/0 (socket says 172.21.15.80:40620) 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 -- 172.21.15.80:0/1419066339 learned_addr learned my addr 172.21.15.80:0/1419066339 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcb7fe640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc0ce680 0x7fddcc0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcaffd640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0d1590 0x7fddcc0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 -- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc0ce680 msgr2=0x7fddcc0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc0ce680 0x7fddcc0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 -- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0d1590 msgr2=0x7fddcc0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0d1590 0x7fddcc0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.052+0000 7fddcbfff640 1 -- 172.21.15.80:0/1419066339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc156160 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.053+0000 7fddcbfff640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 0x7fddcc0c8940 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c7f0 tx=0x7fddc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.053+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4003da0 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.053+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc4005070 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.053+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4005460 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.053+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc1563f0 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.053+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc1569b0 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.054+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddcc0cd7a0 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.054+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fddc4005600 con 0x7fddcc163d20 2024-04-25T15:45:44.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.055+0000 7fddb3fff640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fddb80744b0 0x7fddb80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:44.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.055+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7fddc4094f40 con 0x7fddcc163d20 2024-04-25T15:45:44.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.055+0000 7fddcb7fe640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fddb80744b0 0x7fddb80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:44.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.055+0000 7fddcb7fe640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fddb80744b0 0x7fddb80769c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0011e0 tx=0x7fddbc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:44.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.059+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fddc405f1d0 con 0x7fddcc163d20 2024-04-25T15:45:44.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.245+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fddcc069330 con 0x7fddcc163d20 2024-04-25T15:45:44.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.992+0000 7fddb3fff640 1 -- 172.21.15.80:0/1419066339 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) ==== 97+0+0 (secure 0 0 0) 0x7fddcc069330 con 0x7fddcc163d20 2024-04-25T15:45:44.994 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-25T15:45:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fddb80744b0 msgr2=0x7fddb80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fddb80744b0 0x7fddb80769c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0011e0 tx=0x7fddbc007d30 comp rx=0 tx=0).stop 2024-04-25T15:45:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 msgr2=0x7fddcc0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 0x7fddcc0c8940 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c7f0 tx=0x7fddc400ccb0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 shutdown_connections 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fddb80744b0 0x7fddb80769c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddcc163d20 0x7fddcc0c8940 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0d1590 0x7fddcc0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 --2- 172.21.15.80:0/1419066339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddcc0ce680 0x7fddcc0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.995+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 >> 172.21.15.80:0/1419066339 conn(0x7fddcc0d39c0 msgr2=0x7fddcc157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.996+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 shutdown_connections 2024-04-25T15:45:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:44.996+0000 7fddd2242640 1 -- 172.21.15.80:0/1419066339 wait complete. 2024-04-25T15:45:45.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T15:45:45.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.124+0000 7f3670914640 1 Processor -- start 2024-04-25T15:45:45.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.124+0000 7f3670914640 1 -- start start 2024-04-25T15:45:45.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f3670914640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f366c0ce220 0x7f366c09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f3670914640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f366c0cfd70 0x7f366c0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f3670914640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c1607c0 con 0x7f366c0cf960 2024-04-25T15:45:45.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f3670914640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f366c0cf4d0 con 0x7f366c0cfd70 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f3670914640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f366c0ce630 con 0x7f366c0ce220 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f366c0cfd70 0x7f366c0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f366c0cfd70 0x7f366c0d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49350/0 (socket says 172.21.15.80:49350) 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 -- 172.21.15.80:0/1892199742 learned_addr learned my addr 172.21.15.80:0/1892199742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f3663fff640 1 --1- 172.21.15.80:0/1892199742 >> v1:172.21.15.80:6789/0 conn(0x7f366c0cf960 0x7f366c0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52524/0 (socket says 172.21.15.80:52524) 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366a59c640 1 --2- 172.21.15.80:0/1892199742 >> v2:172.21.15.195:3300/0 conn(0x7f366c0ce220 0x7f366c09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 -- 172.21.15.80:0/1892199742 >> v2:172.21.15.195:3300/0 conn(0x7f366c0ce220 msgr2=0x7f366c09bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 --2- 172.21.15.80:0/1892199742 >> v2:172.21.15.195:3300/0 conn(0x7f366c0ce220 0x7f366c09bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 -- 172.21.15.80:0/1892199742 >> v1:172.21.15.80:6789/0 conn(0x7f366c0cf960 legacy=0x7f366c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366ad9d640 1 -- 172.21.15.80:0/1892199742 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c0d0180 con 0x7f366c0cfd70 2024-04-25T15:45:45.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.126+0000 7f366a59c640 1 --2- 172.21.15.80:0/1892199742 >> v2:172.21.15.195:3300/0 conn(0x7f366c0ce220 0x7f366c09bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.127+0000 7f366ad9d640 1 --2- 172.21.15.80:0/1892199742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0cfd70 0x7f366c0d1a70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f366c0d3840 tx=0x7f366402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20120b7201134926 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.127+0000 7f3669d9b640 1 -- 172.21.15.80:0/1892199742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664036070 con 0x7f366c0cfd70 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.127+0000 7f3669d9b640 1 -- 172.21.15.80:0/1892199742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3664031600 con 0x7f366c0cfd70 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.127+0000 7f3669d9b640 1 -- 172.21.15.80:0/1892199742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640319f0 con 0x7f366c0cfd70 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 -- 172.21.15.80:0/1892199742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0cfd70 msgr2=0x7f366c0d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 --2- 172.21.15.80:0/1892199742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0cfd70 0x7f366c0d1a70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f366c0d3840 tx=0x7f366402a7c0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 -- 172.21.15.80:0/1892199742 shutdown_connections 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 --2- 172.21.15.80:0/1892199742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0cfd70 0x7f366c0d1a70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 --2- 172.21.15.80:0/1892199742 >> v2:172.21.15.195:3300/0 conn(0x7f366c0ce220 0x7f366c09bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 -- 172.21.15.80:0/1892199742 >> 172.21.15.80:0/1892199742 conn(0x7f366c0b7620 msgr2=0x7f366c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 -- 172.21.15.80:0/1892199742 shutdown_connections 2024-04-25T15:45:45.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.128+0000 7f3670914640 1 -- 172.21.15.80:0/1892199742 wait complete. 2024-04-25T15:45:45.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.130+0000 7f3670914640 1 Processor -- start 2024-04-25T15:45:45.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.130+0000 7f3670914640 1 -- start start 2024-04-25T15:45:45.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3670914640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 0x7f366c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3670914640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f366c0cf960 0x7f366c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3670914640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f366c0cfd70 0x7f366c0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3670914640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f366c0cf160 con 0x7f366c0ce220 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3670914640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f366c0cee80 con 0x7f366c0cfd70 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3670914640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f366c09c0b0 con 0x7f366c0cf960 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 0x7f366c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 0x7f366c15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49358/0 (socket says 172.21.15.80:49358) 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 -- 172.21.15.80:0/333322814 learned_addr learned my addr 172.21.15.80:0/333322814 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366ad9d640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f366c0cfd70 0x7f366c0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f3663fff640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f366c0cf960 0x7f366c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 -- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f366c0cf960 msgr2=0x7f366c0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f366c0cf960 0x7f366c0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 -- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f366c0cfd70 msgr2=0x7f366c0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f366c0cfd70 0x7f366c0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 -- 172.21.15.80:0/333322814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c0c8230 con 0x7f366c0ce220 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366ad9d640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f366c0cfd70 0x7f366c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.131+0000 7f366a59c640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 0x7f366c15daa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c7f0 tx=0x7f365c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.132+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c015070 con 0x7f366c0ce220 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.132+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c007820 con 0x7f366c0ce220 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.132+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c0c84a0 con 0x7f366c0ce220 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.132+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c007bd0 con 0x7f366c0ce220 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.132+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c0cac20 con 0x7f366c0ce220 2024-04-25T15:45:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.133+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c0caa10 con 0x7f366c0ce220 2024-04-25T15:45:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.133+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f365c018070 con 0x7f366c0ce220 2024-04-25T15:45:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.134+0000 7f3662ffd640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f364c0744b0 0x7f364c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.134+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5249+0+0 (secure 0 0 0) 0x7f365c0951f0 con 0x7f366c0ce220 2024-04-25T15:45:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.134+0000 7f3663fff640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f364c0744b0 0x7f364c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.134+0000 7f3663fff640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f364c0744b0 0x7f364c0769c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f366c1f96d0 tx=0x7f3654007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.139+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f365c05fb50 con 0x7f366c0ce220 2024-04-25T15:45:45.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.378+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f366c06a100 con 0x7f366c0ce220 2024-04-25T15:45:45.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.378+0000 7f3662ffd640 1 -- 172.21.15.80:0/333322814 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f365c05f450 con 0x7f366c0ce220 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw==", 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q==", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA==", 2024-04-25T15:45:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw==", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g==", 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw==", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw==", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q==", 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw==", 2024-04-25T15:45:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA==", 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA==", 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg==", 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw==", 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw==", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g==", 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw==", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:45:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDMeSpmVFP1JxAAQ3NwNePUywfB5CkeGWRjfA==", 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-25T15:45:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA==", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og==", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:45:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:45:45.393 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f364c0744b0 msgr2=0x7f364c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f364c0744b0 0x7f364c0769c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f366c1f96d0 tx=0x7f3654007ca0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 msgr2=0x7f366c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 0x7f366c15daa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c7f0 tx=0x7f365c00ccb0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 shutdown_connections 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f364c0744b0 0x7f364c0769c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f366c0cfd70 0x7f366c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f366c0cf960 0x7f366c0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 --2- 172.21.15.80:0/333322814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f366c0ce220 0x7f366c15daa0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 >> 172.21.15.80:0/333322814 conn(0x7f366c0b7620 msgr2=0x7f366c0b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 shutdown_connections 2024-04-25T15:45:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.380+0000 7f3670914640 1 -- 172.21.15.80:0/333322814 wait complete. 2024-04-25T15:45:45.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:45.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.502+0000 7feb5b296640 1 Processor -- start 2024-04-25T15:45:45.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.502+0000 7feb5b296640 1 -- start start 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb5b296640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feb54153f70 0x7feb540b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb5b296640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb5406dce0 0x7feb540b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb5b296640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb540b1180 con 0x7feb540b0c00 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb5b296640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7feb5415d4f0 con 0x7feb5406dce0 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb5b296640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7feb5415e270 con 0x7feb54153f70 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb5406dce0 0x7feb540b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb5406dce0 0x7feb540b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49360/0 (socket says 172.21.15.80:49360) 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 -- 172.21.15.80:0/173514290 learned_addr learned my addr 172.21.15.80:0/173514290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59032640 1 --2- 172.21.15.80:0/173514290 >> v2:172.21.15.195:3300/0 conn(0x7feb54153f70 0x7feb540b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 -- 172.21.15.80:0/173514290 >> v2:172.21.15.195:3300/0 conn(0x7feb54153f70 msgr2=0x7feb540b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 --2- 172.21.15.80:0/173514290 >> v2:172.21.15.195:3300/0 conn(0x7feb54153f70 0x7feb540b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 -- 172.21.15.80:0/173514290 >> v1:172.21.15.195:6789/0 conn(0x7feb540b0c00 legacy=0x7feb5406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59833640 1 -- 172.21.15.80:0/173514290 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5415d790 con 0x7feb5406dce0 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.504+0000 7feb59032640 1 --2- 172.21.15.80:0/173514290 >> v2:172.21.15.195:3300/0 conn(0x7feb54153f70 0x7feb540b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.505+0000 7feb59833640 1 --2- 172.21.15.80:0/173514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb5406dce0 0x7feb540b4700 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7feb54072bf0 tx=0x7feb4c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d5ea1204a03db3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.505+0000 7feb4bfff640 1 -- 172.21.15.80:0/173514290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c037070 con 0x7feb5406dce0 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.505+0000 7feb4bfff640 1 -- 172.21.15.80:0/173514290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c032440 con 0x7feb5406dce0 2024-04-25T15:45:45.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.505+0000 7feb4bfff640 1 -- 172.21.15.80:0/173514290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c032810 con 0x7feb5406dce0 2024-04-25T15:45:45.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 -- 172.21.15.80:0/173514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb5406dce0 msgr2=0x7feb540b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 --2- 172.21.15.80:0/173514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb5406dce0 0x7feb540b4700 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7feb54072bf0 tx=0x7feb4c02a230 comp rx=0 tx=0).stop 2024-04-25T15:45:45.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 -- 172.21.15.80:0/173514290 shutdown_connections 2024-04-25T15:45:45.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 --2- 172.21.15.80:0/173514290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb5406dce0 0x7feb540b4700 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 --2- 172.21.15.80:0/173514290 >> v2:172.21.15.195:3300/0 conn(0x7feb54153f70 0x7feb540b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 -- 172.21.15.80:0/173514290 >> 172.21.15.80:0/173514290 conn(0x7feb540d1e20 msgr2=0x7feb54073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 -- 172.21.15.80:0/173514290 shutdown_connections 2024-04-25T15:45:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.506+0000 7feb5b296640 1 -- 172.21.15.80:0/173514290 wait complete. 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.507+0000 7feb5b296640 1 Processor -- start 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.508+0000 7feb5b296640 1 -- start start 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb5b296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 0x7feb54154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb5b296640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb54153f70 0x7feb5414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb5b296640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb5414a420 0x7feb5414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb5b296640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feb540af160 con 0x7feb540b0c00 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb5b296640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feb540aefe0 con 0x7feb5414a420 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb5b296640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb540b4c40 con 0x7feb54153f70 2024-04-25T15:45:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 0x7feb54154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 0x7feb54154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49374/0 (socket says 172.21.15.80:49374) 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 -- 172.21.15.80:0/1051583641 learned_addr learned my addr 172.21.15.80:0/1051583641 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb58831640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb54153f70 0x7feb5414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59833640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb5414a420 0x7feb5414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 -- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb54153f70 msgr2=0x7feb5414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb54153f70 0x7feb5414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 -- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb5414a420 msgr2=0x7feb5414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb5414a420 0x7feb5414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 -- 172.21.15.80:0/1051583641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb541549d0 con 0x7feb540b0c00 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59833640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb5414a420 0x7feb5414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.509+0000 7feb59032640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 0x7feb54154380 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7feb5000ce00 tx=0x7feb5000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.510+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5000f680 con 0x7feb540b0c00 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.510+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5000f820 con 0x7feb540b0c00 2024-04-25T15:45:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.510+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5000fc30 con 0x7feb540b0c00 2024-04-25T15:45:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.510+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb54154cb0 con 0x7feb540b0c00 2024-04-25T15:45:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.510+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb54155270 con 0x7feb540b0c00 2024-04-25T15:45:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.511+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5406a100 con 0x7feb540b0c00 2024-04-25T15:45:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.511+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb50018400 con 0x7feb540b0c00 2024-04-25T15:45:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.512+0000 7feb49ffb640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb380744e0 0x7feb380769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.512+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5249+0+0 (secure 0 0 0) 0x7feb50095cb0 con 0x7feb540b0c00 2024-04-25T15:45:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.512+0000 7feb58831640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb380744e0 0x7feb380769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.512+0000 7feb58831640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb380744e0 0x7feb380769f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb54073490 tx=0x7feb44009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.517+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb50014030 con 0x7feb540b0c00 2024-04-25T15:45:45.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.695+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb54074000 con 0x7feb540b0c00 2024-04-25T15:45:45.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.696+0000 7feb49ffb640 1 -- 172.21.15.80:0/1051583641 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+13153 (secure 0 0 0) 0x7feb50060690 con 0x7feb540b0c00 2024-04-25T15:45:45.697 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:45.698 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":70,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:45.001780+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:45.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb380744e0 msgr2=0x7feb380769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb380744e0 0x7feb380769f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb54073490 tx=0x7feb44009060 comp rx=0 tx=0).stop 2024-04-25T15:45:45.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 msgr2=0x7feb54154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 0x7feb54154380 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7feb5000ce00 tx=0x7feb5000a650 comp rx=0 tx=0).stop 2024-04-25T15:45:45.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 shutdown_connections 2024-04-25T15:45:45.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb380744e0 0x7feb380769f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb5414a420 0x7feb5414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb54153f70 0x7feb5414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 --2- 172.21.15.80:0/1051583641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb540b0c00 0x7feb54154380 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 >> 172.21.15.80:0/1051583641 conn(0x7feb540d1e20 msgr2=0x7feb540b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:45.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 shutdown_connections 2024-04-25T15:45:45.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.699+0000 7feb5b296640 1 -- 172.21.15.80:0/1051583641 wait complete. 2024-04-25T15:45:45.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:45:45.711 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:45:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.820+0000 7f4396157640 1 Processor -- start 2024-04-25T15:45:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.820+0000 7f4396157640 1 -- start start 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f4396157640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f439009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f4396157640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43900d3110 0x7f43900d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f4396157640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4390160760 con 0x7f43900d1fc0 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f4396157640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f439009b920 con 0x7f43900d3110 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f4396157640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43900b3410 con 0x7f439009b410 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43900d3110 0x7f43900d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f439009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f439009bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:56320/0 (socket says 172.21.15.80:56320) 2024-04-25T15:45:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43900d3110 0x7f43900d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:44920/0 (socket says 172.21.15.80:44920) 2024-04-25T15:45:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 -- 172.21.15.80:0/810366934 learned_addr learned my addr 172.21.15.80:0/810366934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438ffff640 1 --1- 172.21.15.80:0/810366934 >> v1:172.21.15.195:6789/0 conn(0x7f43900d1fc0 0x7f43900b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:52882/0 (socket says 172.21.15.80:52882) 2024-04-25T15:45:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 -- 172.21.15.80:0/810366934 >> v2:172.21.15.195:3300/0 conn(0x7f43900d3110 msgr2=0x7f43900d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 --2- 172.21.15.80:0/810366934 >> v2:172.21.15.195:3300/0 conn(0x7f43900d3110 0x7f43900d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 -- 172.21.15.80:0/810366934 >> v1:172.21.15.195:6789/0 conn(0x7f43900d1fc0 legacy=0x7f43900b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.822+0000 7f438f7fe640 1 -- 172.21.15.80:0/810366934 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900b3c00 con 0x7f439009b410 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.823+0000 7f438f7fe640 1 --2- 172.21.15.80:0/810366934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f439009bdf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4380009870 tx=0x7f438002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6faaa1d69825464a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.823+0000 7f438e7fc640 1 -- 172.21.15.80:0/810366934 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380037070 con 0x7f439009b410 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.823+0000 7f438e7fc640 1 -- 172.21.15.80:0/810366934 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4380032440 con 0x7f439009b410 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.823+0000 7f438e7fc640 1 -- 172.21.15.80:0/810366934 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380032810 con 0x7f439009b410 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 -- 172.21.15.80:0/810366934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 msgr2=0x7f439009bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 --2- 172.21.15.80:0/810366934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f439009bdf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4380009870 tx=0x7f438002a270 comp rx=0 tx=0).stop 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 -- 172.21.15.80:0/810366934 shutdown_connections 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 --2- 172.21.15.80:0/810366934 >> v2:172.21.15.195:3300/0 conn(0x7f43900d3110 0x7f43900d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 --2- 172.21.15.80:0/810366934 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f439009bdf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 -- 172.21.15.80:0/810366934 >> 172.21.15.80:0/810366934 conn(0x7f43900b7620 msgr2=0x7f43900b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 -- 172.21.15.80:0/810366934 shutdown_connections 2024-04-25T15:45:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.824+0000 7f4396157640 1 -- 172.21.15.80:0/810366934 wait complete. 2024-04-25T15:45:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.826+0000 7f4396157640 1 Processor -- start 2024-04-25T15:45:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.826+0000 7f4396157640 1 -- start start 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f4396157640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f43901f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f4396157640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 0x7f439006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f4396157640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43900d3110 0x7f4390161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f4396157640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43900cea40 con 0x7f43900d1fc0 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f4396157640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43900b41a0 con 0x7f43900d3110 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f4396157640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43900d23d0 con 0x7f439009b410 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f438effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 0x7f439006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f438effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 0x7f439006e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49376/0 (socket says 172.21.15.80:49376) 2024-04-25T15:45:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.827+0000 7f438effd640 1 -- 172.21.15.80:0/4234910715 learned_addr learned my addr 172.21.15.80:0/4234910715 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438f7fe640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f43901f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438ffff640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43900d3110 0x7f4390161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438effd640 1 -- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 msgr2=0x7f43901f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438effd640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f43901f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438effd640 1 -- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43900d3110 msgr2=0x7f4390161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438effd640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43900d3110 0x7f4390161450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438effd640 1 -- 172.21.15.80:0/4234910715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439015e0c0 con 0x7f43900d1fc0 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438f7fe640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f43901f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f438effd640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 0x7f439006e530 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f438400e8a0 tx=0x7f438400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384017070 con 0x7f43900d1fc0 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438400c940 con 0x7f43900d1fc0 2024-04-25T15:45:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439015e3a0 con 0x7f43900d1fc0 2024-04-25T15:45:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438400cd30 con 0x7f43900d1fc0 2024-04-25T15:45:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.828+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439015e960 con 0x7f43900d1fc0 2024-04-25T15:45:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.829+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439006a100 con 0x7f43900d1fc0 2024-04-25T15:45:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.830+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f438401a070 con 0x7f43900d1fc0 2024-04-25T15:45:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.830+0000 7f4377fff640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f437c0744b0 0x7f437c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.830+0000 7f438f7fe640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f437c0744b0 0x7f437c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.830+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5249+0+0 (secure 0 0 0) 0x7f43840952e0 con 0x7f43900d1fc0 2024-04-25T15:45:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.830+0000 7f438f7fe640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f437c0744b0 0x7f437c0769c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4380034000 tx=0x7f438002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:45.835+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f438405fc30 con 0x7f43900d1fc0 2024-04-25T15:45:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.011+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f43900b17f0 con 0x7f43900d1fc0 2024-04-25T15:45:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.012+0000 7f4377fff640 1 -- 172.21.15.80:0/4234910715 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f438405f530 con 0x7f43900d1fc0 2024-04-25T15:45:46.013 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f437c0744b0 msgr2=0x7f437c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f437c0744b0 0x7f437c0769c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4380034000 tx=0x7f438002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 msgr2=0x7f439006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 0x7f439006e530 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f438400e8a0 tx=0x7f438400ed60 comp rx=0 tx=0).stop 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 shutdown_connections 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f437c0744b0 0x7f437c0769c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43900d3110 0x7f4390161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43900d1fc0 0x7f439006e530 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 --2- 172.21.15.80:0/4234910715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f439009b410 0x7f43901f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 >> 172.21.15.80:0/4234910715 conn(0x7f43900b7620 msgr2=0x7f43900b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 shutdown_connections 2024-04-25T15:45:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.014+0000 7f4396157640 1 -- 172.21.15.80:0/4234910715 wait complete. 2024-04-25T15:45:46.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:45:46.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.134+0000 7f5ee3700640 1 Processor -- start 2024-04-25T15:45:46.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.134+0000 7f5ee3700640 1 -- start start 2024-04-25T15:45:46.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee3700640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc0d26d0 0x7f5edc162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee3700640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5edc0d37e0 con 0x7f5edc0ce810 2024-04-25T15:45:46.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee3700640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5edc0b8240 con 0x7f5edc0d22c0 2024-04-25T15:45:46.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee3700640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5edc09cd00 con 0x7f5edc0d26d0 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee0c9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc0d26d0 0x7f5edc162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee1c9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5edc0ce810 0x7f5edc0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52540/0 (socket says 172.21.15.80:52540) 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee1c9d640 1 -- 172.21.15.80:0/2951426154 learned_addr learned my addr 172.21.15.80:0/2951426154 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee0c9b640 1 -- 172.21.15.80:0/2951426154 >> v1:172.21.15.195:6789/0 conn(0x7f5edc0d22c0 legacy=0x7f5edc1626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee0c9b640 1 -- 172.21.15.80:0/2951426154 >> v1:172.21.15.80:6789/0 conn(0x7f5edc0ce810 legacy=0x7f5edc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ed3fff640 1 -- 172.21.15.80:0/2951426154 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959272448 0 0) 0x7f5edc0d37e0 con 0x7f5edc0ce810 2024-04-25T15:45:46.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee0c9b640 1 -- 172.21.15.80:0/2951426154 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc0b91c0 con 0x7f5edc0d26d0 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ee0c9b640 1 --2- 172.21.15.80:0/2951426154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0d26d0 0x7f5edc162df0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0097a0 tx=0x7f5ecc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82c495ec65b4a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ed3fff640 1 -- 172.21.15.80:0/2951426154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc037070 con 0x7f5edc0d26d0 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ed3fff640 1 -- 172.21.15.80:0/2951426154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc02adc0 con 0x7f5edc0d26d0 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.137+0000 7f5ed3fff640 1 -- 172.21.15.80:0/2951426154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc032660 con 0x7f5edc0d26d0 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 -- 172.21.15.80:0/2951426154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0d26d0 msgr2=0x7f5edc162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 --2- 172.21.15.80:0/2951426154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0d26d0 0x7f5edc162df0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0097a0 tx=0x7f5ecc02a0b0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 -- 172.21.15.80:0/2951426154 shutdown_connections 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 --2- 172.21.15.80:0/2951426154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0d26d0 0x7f5edc162df0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 -- 172.21.15.80:0/2951426154 >> 172.21.15.80:0/2951426154 conn(0x7f5edc0d0450 msgr2=0x7f5edc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:46.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 -- 172.21.15.80:0/2951426154 shutdown_connections 2024-04-25T15:45:46.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.138+0000 7f5ee3700640 1 -- 172.21.15.80:0/2951426154 wait complete. 2024-04-25T15:45:46.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.139+0000 7f5ee3700640 1 Processor -- start 2024-04-25T15:45:46.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.140+0000 7f5ee3700640 1 -- start start 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee3700640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 0x7f5edc09d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee3700640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5edc0d22c0 0x7f5edc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee3700640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5edc0d26d0 0x7f5edc0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee3700640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc09d190 con 0x7f5edc0ce810 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee3700640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc0cfe50 con 0x7f5edc0d26d0 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee3700640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5edc0d47e0 con 0x7f5edc0d22c0 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 0x7f5edc09d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 0x7f5edc09d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49394/0 (socket says 172.21.15.80:49394) 2024-04-25T15:45:46.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 -- 172.21.15.80:0/3209169122 learned_addr learned my addr 172.21.15.80:0/3209169122 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee0c9b640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5edc0d22c0 0x7f5edc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 -- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5edc0d22c0 msgr2=0x7f5edc0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5edc0d22c0 0x7f5edc0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 -- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5edc0d26d0 msgr2=0x7f5edc0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5edc0d26d0 0x7f5edc0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 -- 172.21.15.80:0/3209169122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc0ca440 con 0x7f5edc0ce810 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee0c9b640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5edc0d22c0 0x7f5edc0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ee149c640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 0x7f5edc09d790 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800b3e0 tx=0x7f5ed800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.141+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8015020 con 0x7f5edc0ce810 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.142+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed8011850 con 0x7f5edc0ce810 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.142+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5edc0c7580 con 0x7f5edc0ce810 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.142+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8011c80 con 0x7f5edc0ce810 2024-04-25T15:45:46.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.142+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5edc0c7820 con 0x7f5edc0ce810 2024-04-25T15:45:46.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.143+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5edc06a100 con 0x7f5edc0ce810 2024-04-25T15:45:46.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.143+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5ed8018020 con 0x7f5edc0ce810 2024-04-25T15:45:46.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.144+0000 7f5ed1ffb640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ec00744b0 0x7f5ec00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.144+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5249+0+0 (secure 0 0 0) 0x7f5ed8094db0 con 0x7f5edc0ce810 2024-04-25T15:45:46.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.144+0000 7f5ee0c9b640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ec00744b0 0x7f5ec00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.144+0000 7f5ee0c9b640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ec00744b0 0x7f5ec00769c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc034000 tx=0x7f5ecc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:46.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.148+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5edc0c7580 con 0x7f5edc0ce810 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.326+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5edc0c7060 con 0x7f5edc0ce810 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.326+0000 7f5ed1ffb640 1 -- 172.21.15.80:0/3209169122 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f5ed8011e20 con 0x7f5edc0ce810 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:45:46.327 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ec00744b0 msgr2=0x7f5ec00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ec00744b0 0x7f5ec00769c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc034000 tx=0x7f5ecc02e000 comp rx=0 tx=0).stop 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 msgr2=0x7f5edc09d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 0x7f5edc09d790 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800b3e0 tx=0x7f5ed800b8a0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 shutdown_connections 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ec00744b0 0x7f5ec00769c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5edc0d26d0 0x7f5edc0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5edc0d22c0 0x7f5edc0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 --2- 172.21.15.80:0/3209169122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc0ce810 0x7f5edc09d790 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.328+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 >> 172.21.15.80:0/3209169122 conn(0x7f5edc0d0450 msgr2=0x7f5edc072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.329+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 shutdown_connections 2024-04-25T15:45:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.329+0000 7f5ee3700640 1 -- 172.21.15.80:0/3209169122 wait complete. 2024-04-25T15:45:46.340 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:45:46.340 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:45:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.451+0000 7fc8bdfb7640 1 Processor -- start 2024-04-25T15:45:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.451+0000 7fc8bdfb7640 1 -- start start 2024-04-25T15:45:46.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.452+0000 7fc8bdfb7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b80b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8bdfb7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc8b80b3850 0x7fc8b816a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8bdfb7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b80b2f30 con 0x7fc8b806d6d0 2024-04-25T15:45:46.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8bdfb7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b806eb60 con 0x7fc8b80b3850 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8bdfb7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b80b2c90 con 0x7fc8b80b4b60 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc8b80b3850 0x7fc8b816a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc8b80b3850 0x7fc8b816a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49404/0 (socket says 172.21.15.80:49404) 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 -- 172.21.15.80:0/713423847 learned_addr learned my addr 172.21.15.80:0/713423847 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b77fe640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b80b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 -- 172.21.15.80:0/713423847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 msgr2=0x7fc8b80b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b80b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 -- 172.21.15.80:0/713423847 >> v1:172.21.15.195:6789/0 conn(0x7fc8b806d6d0 legacy=0x7fc8b80b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b7fff640 1 -- 172.21.15.80:0/713423847 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80d10a0 con 0x7fc8b80b3850 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.453+0000 7fc8b77fe640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b80b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.454+0000 7fc8b7fff640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b816a6c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009e50 tx=0x7fc8b002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2231c1af58ab4b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.454+0000 7fc8b67fc640 1 -- 172.21.15.80:0/713423847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0036070 con 0x7fc8b80b3850 2024-04-25T15:45:46.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.454+0000 7fc8b67fc640 1 -- 172.21.15.80:0/713423847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0031600 con 0x7fc8b80b3850 2024-04-25T15:45:46.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.454+0000 7fc8b67fc640 1 -- 172.21.15.80:0/713423847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00319d0 con 0x7fc8b80b3850 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/713423847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 msgr2=0x7fc8b816a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b816a6c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009e50 tx=0x7fc8b002a630 comp rx=0 tx=0).stop 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/713423847 shutdown_connections 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b816a6c0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/713423847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b80b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/713423847 >> 172.21.15.80:0/713423847 conn(0x7fc8b80d0450 msgr2=0x7fc8b80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/713423847 shutdown_connections 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.455+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/713423847 wait complete. 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.456+0000 7fc8bdfb7640 1 Processor -- start 2024-04-25T15:45:46.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.457+0000 7fc8bdfb7640 1 -- start start 2024-04-25T15:45:46.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8bdfb7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b806d6d0 0x7fc8b80a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8bdfb7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b81d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8bdfb7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b81d8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8bdfb7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b80d2f50 con 0x7fc8b80b3850 2024-04-25T15:45:46.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8bdfb7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b809cbe0 con 0x7fc8b806d6d0 2024-04-25T15:45:46.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8bdfb7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b809d0e0 con 0x7fc8b80b4b60 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b81d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b81d5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49406/0 (socket says 172.21.15.80:49406) 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 -- 172.21.15.80:0/2090805524 learned_addr learned my addr 172.21.15.80:0/2090805524 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b77fe640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b806d6d0 0x7fc8b80a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b7fff640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b81d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 -- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 msgr2=0x7fc8b81d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b81d8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 -- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b806d6d0 msgr2=0x7fc8b80a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b806d6d0 0x7fc8b80a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 -- 172.21.15.80:0/2090805524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b81d6e20 con 0x7fc8b80b3850 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.458+0000 7fc8b6ffd640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b81d5ac0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b3f0 tx=0x7fc8ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.459+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac015020 con 0x7fc8b80b3850 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.459+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac011830 con 0x7fc8b80b3850 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.459+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b81d7100 con 0x7fc8b80b3850 2024-04-25T15:45:46.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.459+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac011c20 con 0x7fc8b80b3850 2024-04-25T15:45:46.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.459+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81d76c0 con 0x7fc8b80b3850 2024-04-25T15:45:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.460+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8075c90 con 0x7fc8b80b3850 2024-04-25T15:45:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.460+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc8ac018020 con 0x7fc8b80b3850 2024-04-25T15:45:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.461+0000 7fc89ffff640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a40744b0 0x7fc8a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.461+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5249+0+0 (secure 0 0 0) 0x7fc8ac094d30 con 0x7fc8b80b3850 2024-04-25T15:45:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.461+0000 7fc8b77fe640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a40744b0 0x7fc8a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:46.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.461+0000 7fc8b77fe640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a40744b0 0x7fc8a40769c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8006fd0 tx=0x7fc8a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:46.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.465+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc8ac01f030 con 0x7fc8b80b3850 2024-04-25T15:45:46.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:46.639+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc8b806efc0 con 0x7fc8b80b3850 2024-04-25T15:45:47.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.005+0000 7fc89ffff640 1 -- 172.21.15.80:0/2090805524 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7fc8ac05f600 con 0x7fc8b80b3850 2024-04-25T15:45:47.005 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.007+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a40744b0 msgr2=0x7fc8a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.007+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a40744b0 0x7fc8a40769c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8006fd0 tx=0x7fc8a8008040 comp rx=0 tx=0).stop 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.007+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 msgr2=0x7fc8b81d5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.007+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b81d5ac0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00b3f0 tx=0x7fc8ac00b8b0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 shutdown_connections 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a40744b0 0x7fc8a40769c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b80b4b60 0x7fc8b81d8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b80b3850 0x7fc8b81d5ac0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 --2- 172.21.15.80:0/2090805524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b806d6d0 0x7fc8b80a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 >> 172.21.15.80:0/2090805524 conn(0x7fc8b80d0450 msgr2=0x7fc8b806e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 shutdown_connections 2024-04-25T15:45:47.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.008+0000 7fc8bdfb7640 1 -- 172.21.15.80:0/2090805524 wait complete. 2024-04-25T15:45:47.022 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:45:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.137+0000 7fa3d610d640 1 Processor -- start 2024-04-25T15:45:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.137+0000 7fa3d610d640 1 -- start start 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.138+0000 7fa3d610d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa3d00d34a0 0x7fa3d00b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.138+0000 7fa3d610d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3d006da90 0x7fa3d006e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.138+0000 7fa3d610d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d006eaa0 0x7fa3d00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.138+0000 7fa3d610d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d00d1010 con 0x7fa3d006da90 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.138+0000 7fa3d610d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d009cdf0 con 0x7fa3d00d34a0 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.138+0000 7fa3d610d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d009d0d0 con 0x7fa3d006eaa0 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3d006da90 0x7fa3d006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3d006da90 0x7fa3d006e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49422/0 (socket says 172.21.15.80:49422) 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 -- 172.21.15.80:0/443300224 learned_addr learned my addr 172.21.15.80:0/443300224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3cffff640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d006eaa0 0x7fa3d00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3cf7fe640 1 --2- 172.21.15.80:0/443300224 >> v2:172.21.15.195:3300/0 conn(0x7fa3d00d34a0 0x7fa3d00b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 -- 172.21.15.80:0/443300224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d006eaa0 msgr2=0x7fa3d00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d006eaa0 0x7fa3d00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 -- 172.21.15.80:0/443300224 >> v2:172.21.15.195:3300/0 conn(0x7fa3d00d34a0 msgr2=0x7fa3d00b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/443300224 >> v2:172.21.15.195:3300/0 conn(0x7fa3d00d34a0 0x7fa3d00b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3ceffd640 1 -- 172.21.15.80:0/443300224 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d00d12f0 con 0x7fa3d006da90 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3cffff640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d006eaa0 0x7fa3d00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.139+0000 7fa3cf7fe640 1 --2- 172.21.15.80:0/443300224 >> v2:172.21.15.195:3300/0 conn(0x7fa3d00d34a0 0x7fa3d00b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d006e560 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0074480 tx=0x7fa3c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf2dcc52f2fb19f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3ce7fc640 1 -- 172.21.15.80:0/443300224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4037070 con 0x7fa3d006da90 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3ce7fc640 1 -- 172.21.15.80:0/443300224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c4032440 con 0x7fa3d006da90 2024-04-25T15:45:47.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3ce7fc640 1 -- 172.21.15.80:0/443300224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4032810 con 0x7fa3d006da90 2024-04-25T15:45:47.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3d610d640 1 -- 172.21.15.80:0/443300224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 msgr2=0x7fa3d006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:47.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3d610d640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d006e560 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0074480 tx=0x7fa3c402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.140+0000 7fa3d610d640 1 -- 172.21.15.80:0/443300224 shutdown_connections 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.141+0000 7fa3d610d640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d006eaa0 0x7fa3d00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.141+0000 7fa3d610d640 1 --2- 172.21.15.80:0/443300224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d006e560 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.141+0000 7fa3d610d640 1 --2- 172.21.15.80:0/443300224 >> v2:172.21.15.195:3300/0 conn(0x7fa3d00d34a0 0x7fa3d00b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.141+0000 7fa3d610d640 1 -- 172.21.15.80:0/443300224 >> 172.21.15.80:0/443300224 conn(0x7fa3d00d0450 msgr2=0x7fa3d00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.141+0000 7fa3d610d640 1 -- 172.21.15.80:0/443300224 shutdown_connections 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.141+0000 7fa3d610d640 1 -- 172.21.15.80:0/443300224 wait complete. 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.142+0000 7fa3d610d640 1 Processor -- start 2024-04-25T15:45:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.142+0000 7fa3d610d640 1 -- start start 2024-04-25T15:45:47.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3d610d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3d610d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d006eaa0 0x7fa3d00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3d610d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d00d34a0 0x7fa3d00b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3d610d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d00b4180 con 0x7fa3d006da90 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3d610d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d00b4000 con 0x7fa3d006eaa0 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3d610d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d00b4300 con 0x7fa3d00d34a0 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49438/0 (socket says 172.21.15.80:49438) 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 -- 172.21.15.80:0/3776783165 learned_addr learned my addr 172.21.15.80:0/3776783165 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cffff640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d00d34a0 0x7fa3d00b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d006eaa0 0x7fa3d00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 -- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d00d34a0 msgr2=0x7fa3d00b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:47.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d00d34a0 0x7fa3d00b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 -- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d006eaa0 msgr2=0x7fa3d00b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:47.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d006eaa0 0x7fa3d00b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:47.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 -- 172.21.15.80:0/3776783165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d00b2260 con 0x7fa3d006da90 2024-04-25T15:45:47.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d006eaa0 0x7fa3d00b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:47.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cffff640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d00d34a0 0x7fa3d00b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:47.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3cf7fe640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d015cf00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c820 tx=0x7fa3c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0004220 con 0x7fa3d006da90 2024-04-25T15:45:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.144+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c00043c0 con 0x7fa3d006da90 2024-04-25T15:45:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.145+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d00b2540 con 0x7fa3d006da90 2024-04-25T15:45:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.145+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0005bb0 con 0x7fa3d006da90 2024-04-25T15:45:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.145+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d00b2b00 con 0x7fa3d006da90 2024-04-25T15:45:47.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.146+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d006a100 con 0x7fa3d006da90 2024-04-25T15:45:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.146+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa3c0007830 con 0x7fa3d006da90 2024-04-25T15:45:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.147+0000 7fa3b7fff640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3bc0744e0 0x7fa3bc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.147+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5619+0+0 (secure 0 0 0) 0x7fa3c0095550 con 0x7fa3d006da90 2024-04-25T15:45:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.147+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3bc0744e0 0x7fa3bc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:47.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.147+0000 7fa3ceffd640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3bc0744e0 0x7fa3bc0769f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4034000 tx=0x7fa3c402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:47.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.152+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3c001e020 con 0x7fa3d006da90 2024-04-25T15:45:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:47.326+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa3d00b52a0 con 0x7fa3d006da90 2024-04-25T15:45:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.012+0000 7fa3b7fff640 1 -- 172.21.15.80:0/3776783165 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7fa3c0015030 con 0x7fa3d006da90 2024-04-25T15:45:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:45:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3bc0744e0 msgr2=0x7fa3bc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3bc0744e0 0x7fa3bc0769f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4034000 tx=0x7fa3c402e000 comp rx=0 tx=0).stop 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 msgr2=0x7fa3d015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d015cf00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c820 tx=0x7fa3c000cce0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 shutdown_connections 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa3bc0744e0 0x7fa3bc0769f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3d00d34a0 0x7fa3d00b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d006eaa0 0x7fa3d00b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 --2- 172.21.15.80:0/3776783165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3d006da90 0x7fa3d015cf00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 >> 172.21.15.80:0/3776783165 conn(0x7fa3d00d0450 msgr2=0x7fa3d0071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 shutdown_connections 2024-04-25T15:45:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.015+0000 7fa3d610d640 1 -- 172.21.15.80:0/3776783165 wait complete. 2024-04-25T15:45:48.041 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:45:48.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.156+0000 7f1f55546640 1 Processor -- start 2024-04-25T15:45:48.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.156+0000 7f1f55546640 1 -- start start 2024-04-25T15:45:48.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.157+0000 7f1f55546640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f500b5490 0x7f1f50160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.157+0000 7f1f55546640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f500d0b00 0x7f1f500d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.157+0000 7f1f55546640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f500d57e0 con 0x7f1f500d2b80 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.157+0000 7f1f55546640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1f501643f0 con 0x7f1f500d0b00 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.157+0000 7f1f55546640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1f501646d0 con 0x7f1f500b5490 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.157+0000 7f1f4e7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f500d0b00 0x7f1f500d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f500d2b80 0x7f1f500b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52554/0 (socket says 172.21.15.80:52554) 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4e7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f500d0b00 0x7f1f500d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49446/0 (socket says 172.21.15.80:49446) 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4f7fe640 1 -- 172.21.15.80:0/2111709027 learned_addr learned my addr 172.21.15.80:0/2111709027 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4effd640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f500b5490 0x7f1f50160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2111709027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f500b5490 msgr2=0x7f1f50160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4e7fc640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f500b5490 0x7f1f50160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2111709027 >> v1:172.21.15.80:6789/0 conn(0x7f1f500d2b80 legacy=0x7f1f500b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:48.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4dffb640 1 -- 172.21.15.80:0/2111709027 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942353046 0 0) 0x7f1f500d57e0 con 0x7f1f500d2b80 2024-04-25T15:45:48.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2111709027 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f501649b0 con 0x7f1f500d0b00 2024-04-25T15:45:48.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.158+0000 7f1f4effd640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f500b5490 0x7f1f50160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:48.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f4e7fc640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d0b00 0x7f1f500d2640 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f1f440097a0 tx=0x7f1f4402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f349044ab1778e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:48.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f4dffb640 1 -- 172.21.15.80:0/2111709027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44037070 con 0x7f1f500d0b00 2024-04-25T15:45:48.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f4dffb640 1 -- 172.21.15.80:0/2111709027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f44032440 con 0x7f1f500d0b00 2024-04-25T15:45:48.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f4dffb640 1 -- 172.21.15.80:0/2111709027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44032810 con 0x7f1f500d0b00 2024-04-25T15:45:48.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 -- 172.21.15.80:0/2111709027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d0b00 msgr2=0x7f1f500d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:48.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d0b00 0x7f1f500d2640 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f1f440097a0 tx=0x7f1f4402a180 comp rx=0 tx=0).stop 2024-04-25T15:45:48.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 -- 172.21.15.80:0/2111709027 shutdown_connections 2024-04-25T15:45:48.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d0b00 0x7f1f500d2640 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 --2- 172.21.15.80:0/2111709027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f500b5490 0x7f1f50160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 -- 172.21.15.80:0/2111709027 >> 172.21.15.80:0/2111709027 conn(0x7f1f5006e650 msgr2=0x7f1f5006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:48.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.159+0000 7f1f55546640 1 -- 172.21.15.80:0/2111709027 shutdown_connections 2024-04-25T15:45:48.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.160+0000 7f1f55546640 1 -- 172.21.15.80:0/2111709027 wait complete. 2024-04-25T15:45:48.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.161+0000 7f1f55546640 1 Processor -- start 2024-04-25T15:45:48.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.161+0000 7f1f55546640 1 -- start start 2024-04-25T15:45:48.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f55546640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f500d0b00 0x7f1f500b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:48.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f55546640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 0x7f1f500b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:48.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f55546640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f501f9b20 0x7f1f501f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:48.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f55546640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1f500d2f90 con 0x7f1f500d2b80 2024-04-25T15:45:48.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f55546640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1f50160840 con 0x7f1f500d0b00 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f55546640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1f500b9360 con 0x7f1f501f9b20 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 0x7f1f500b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 0x7f1f500b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49460/0 (socket says 172.21.15.80:49460) 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2994484041 learned_addr learned my addr 172.21.15.80:0/2994484041 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4f7fe640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f501f9b20 0x7f1f501f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4effd640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f500d0b00 0x7f1f500b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f501f9b20 msgr2=0x7f1f501f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f501f9b20 0x7f1f501f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f500d0b00 msgr2=0x7f1f500b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f500d0b00 0x7f1f500b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 -- 172.21.15.80:0/2994484041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f501fa470 con 0x7f1f500d2b80 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f4e7fc640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 0x7f1f500b2000 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c00 tx=0x7f1f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:48.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44037050 con 0x7f1f500d2b80 2024-04-25T15:45:48.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.163+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f44038040 con 0x7f1f500d2b80 2024-04-25T15:45:48.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.164+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f500af3b0 con 0x7f1f500d2b80 2024-04-25T15:45:48.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.164+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44004470 con 0x7f1f500d2b80 2024-04-25T15:45:48.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.164+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f500af8b0 con 0x7f1f500d2b80 2024-04-25T15:45:48.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.164+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5006a100 con 0x7f1f500d2b80 2024-04-25T15:45:48.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.165+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1f44030980 con 0x7f1f500d2b80 2024-04-25T15:45:48.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.166+0000 7f1f377fe640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1f3c0744b0 0x7f1f3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:48.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.166+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6001+0+0 (secure 0 0 0) 0x7f1f440b5f70 con 0x7f1f500d2b80 2024-04-25T15:45:48.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.166+0000 7f1f4effd640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1f3c0744b0 0x7f1f3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:48.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.166+0000 7f1f4effd640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1f3c0744b0 0x7f1f3c0769c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1f500d08c0 tx=0x7f1f40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:48.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.170+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f501fa470 con 0x7f1f500d2b80 2024-04-25T15:45:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:48.381+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1f50069af0 con 0x7f1f500d2b80 2024-04-25T15:45:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.013+0000 7f1f377fe640 1 -- 172.21.15.80:0/2994484041 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v33) ==== 174+0+0 (secure 0 0 0) 0x7f1f44030c70 con 0x7f1f500d2b80 2024-04-25T15:45:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 11 and data pool 12 2024-04-25T15:45:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.017+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1f3c0744b0 msgr2=0x7f1f3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.017+0000 7f1f55546640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1f3c0744b0 0x7f1f3c0769c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1f500d08c0 tx=0x7f1f40008040 comp rx=0 tx=0).stop 2024-04-25T15:45:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.017+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 msgr2=0x7f1f500b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.017+0000 7f1f55546640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 0x7f1f500b2000 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c00 tx=0x7f1f440046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 shutdown_connections 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1f3c0744b0 0x7f1f3c0769c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1f501f9b20 0x7f1f501f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f500d2b80 0x7f1f500b2000 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 --2- 172.21.15.80:0/2994484041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f500d0b00 0x7f1f500b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 >> 172.21.15.80:0/2994484041 conn(0x7f1f5006e650 msgr2=0x7f1f500ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.018+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 shutdown_connections 2024-04-25T15:45:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.019+0000 7f1f55546640 1 -- 172.21.15.80:0/2994484041 wait complete. 2024-04-25T15:45:49.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:49.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.156+0000 7f7dfdb72640 1 Processor -- start 2024-04-25T15:45:49.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.156+0000 7f7dfdb72640 1 -- start start 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7dfdb72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df80d41b0 0x7f7df80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7dfdb72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7df80b7d60 0x7f7df80d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7dfdb72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df8163fb0 con 0x7f7df81602a0 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7dfdb72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f7df8164270 con 0x7f7df80b7d60 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7dfdb72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7df8164550 con 0x7f7df80d41b0 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7df80b7d60 0x7f7df80d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7df80b7d60 0x7f7df80d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49464/0 (socket says 172.21.15.80:49464) 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 -- 172.21.15.80:0/4162507648 learned_addr learned my addr 172.21.15.80:0/4162507648 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df77fe640 1 --2- 172.21.15.80:0/4162507648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df80d41b0 0x7f7df80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 -- 172.21.15.80:0/4162507648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df80d41b0 msgr2=0x7f7df80b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 --2- 172.21.15.80:0/4162507648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df80d41b0 0x7f7df80b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 -- 172.21.15.80:0/4162507648 >> v1:172.21.15.195:6789/0 conn(0x7f7df81602a0 legacy=0x7f7df80b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.158+0000 7f7df7fff640 1 -- 172.21.15.80:0/4162507648 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df8164830 con 0x7f7df80b7d60 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.159+0000 7f7df7fff640 1 --2- 172.21.15.80:0/4162507648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80b7d60 0x7f7df80d49c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009e50 tx=0x7f7df002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b077208df81ad53f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.159+0000 7f7df67fc640 1 -- 172.21.15.80:0/4162507648 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0036070 con 0x7f7df80b7d60 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.159+0000 7f7df67fc640 1 -- 172.21.15.80:0/4162507648 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df0031600 con 0x7f7df80b7d60 2024-04-25T15:45:49.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.159+0000 7f7df67fc640 1 -- 172.21.15.80:0/4162507648 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df00319d0 con 0x7f7df80b7d60 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 -- 172.21.15.80:0/4162507648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80b7d60 msgr2=0x7f7df80d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/4162507648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80b7d60 0x7f7df80d49c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009e50 tx=0x7f7df002a6c0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 -- 172.21.15.80:0/4162507648 shutdown_connections 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/4162507648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80b7d60 0x7f7df80d49c0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/4162507648 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df80d41b0 0x7f7df80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 -- 172.21.15.80:0/4162507648 >> 172.21.15.80:0/4162507648 conn(0x7f7df806e9f0 msgr2=0x7f7df80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 -- 172.21.15.80:0/4162507648 shutdown_connections 2024-04-25T15:45:49.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.160+0000 7f7dfdb72640 1 -- 172.21.15.80:0/4162507648 wait complete. 2024-04-25T15:45:49.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.162+0000 7f7dfdb72640 1 Processor -- start 2024-04-25T15:45:49.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.162+0000 7f7dfdb72640 1 -- start start 2024-04-25T15:45:49.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7dfdb72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 0x7f7df81594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7dfdb72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df81602a0 0x7f7df8163840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7dfdb72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7df81f6aa0 0x7f7df81f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7dfdb72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7df80b5150 con 0x7f7df80d41b0 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7dfdb72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7df80b4fd0 con 0x7f7df81f6aa0 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7dfdb72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7df80b9220 con 0x7f7df81602a0 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 0x7f7df81594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 0x7f7df81594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49478/0 (socket says 172.21.15.80:49478) 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 -- 172.21.15.80:0/3138520257 learned_addr learned my addr 172.21.15.80:0/3138520257 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 -- 172.21.15.80:0/3138520257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df81602a0 msgr2=0x7f7df8163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df81602a0 0x7f7df8163840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 -- 172.21.15.80:0/3138520257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7df81f6aa0 msgr2=0x7f7df81f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7df81f6aa0 0x7f7df81f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.163+0000 7f7df77fe640 1 -- 172.21.15.80:0/3138520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df8160990 con 0x7f7df80d41b0 2024-04-25T15:45:49.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.164+0000 7f7df77fe640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 0x7f7df81594f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7de800d5f0 tx=0x7f7de800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.164+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80125f0 con 0x7f7df80d41b0 2024-04-25T15:45:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.164+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de8019070 con 0x7f7df80d41b0 2024-04-25T15:45:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.164+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df8160c70 con 0x7f7df80d41b0 2024-04-25T15:45:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.164+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80129d0 con 0x7f7df80d41b0 2024-04-25T15:45:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.164+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df8161230 con 0x7f7df80d41b0 2024-04-25T15:45:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.165+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df806a100 con 0x7f7df80d41b0 2024-04-25T15:45:49.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.165+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7de8012b70 con 0x7f7df80d41b0 2024-04-25T15:45:49.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.166+0000 7f7ddffff640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7de40744b0 0x7f7de40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.166+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6101+0+0 (secure 0 0 0) 0x7f7de8095810 con 0x7f7df80d41b0 2024-04-25T15:45:49.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.166+0000 7f7df6ffd640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7de40744b0 0x7f7de40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.166+0000 7f7df6ffd640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7de40744b0 0x7f7de40769c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7dec006fd0 tx=0x7f7dec006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.170+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7de805fea0 con 0x7f7df80d41b0 2024-04-25T15:45:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.348+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7df80d3070 con 0x7f7df80d41b0 2024-04-25T15:45:49.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.349+0000 7f7ddffff640 1 -- 172.21.15.80:0/3138520257 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16946 (secure 0 0 0) 0x7f7de805f7a0 con 0x7f7df80d41b0 2024-04-25T15:45:49.349 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:49.349 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":73,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:48.382079+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7de40744b0 msgr2=0x7f7de40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7de40744b0 0x7f7de40769c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7dec006fd0 tx=0x7f7dec006bc0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 msgr2=0x7f7df81594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 0x7f7df81594f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7de800d5f0 tx=0x7f7de800dab0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 shutdown_connections 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f7de40744b0 0x7f7de40769c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7df81f6aa0 0x7f7df81f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7df81602a0 0x7f7df8163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 --2- 172.21.15.80:0/3138520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7df80d41b0 0x7f7df81594f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 >> 172.21.15.80:0/3138520257 conn(0x7f7df806e9f0 msgr2=0x7f7df815dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 shutdown_connections 2024-04-25T15:45:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.351+0000 7f7dfdb72640 1 -- 172.21.15.80:0/3138520257 wait complete. 2024-04-25T15:45:49.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:49.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.470+0000 7f118a430640 1 Processor -- start 2024-04-25T15:45:49.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.470+0000 7f118a430640 1 -- start start 2024-04-25T15:45:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f118a430640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1184071950 0x7f1184072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f118a430640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1184161c80 0x7f11840b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f118a430640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f11840b74c0 0x7f11840d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f118a430640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1184072aa0 con 0x7f1184161c80 2024-04-25T15:45:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f118a430640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f11841624d0 con 0x7f11840b74c0 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f118a430640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11841627b0 con 0x7f1184071950 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f11837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1184161c80 0x7f11840b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f11837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1184161c80 0x7f11840b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49490/0 (socket says 172.21.15.80:49490) 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f11837fe640 1 -- 172.21.15.80:0/511413932 learned_addr learned my addr 172.21.15.80:0/511413932 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.471+0000 7f11889cd640 1 --2- 172.21.15.80:0/511413932 >> v2:172.21.15.195:3300/0 conn(0x7f11840b74c0 0x7f11840d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11837fe640 1 -- 172.21.15.80:0/511413932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1184071950 msgr2=0x7f1184072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11837fe640 1 --2- 172.21.15.80:0/511413932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1184071950 0x7f1184072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11837fe640 1 -- 172.21.15.80:0/511413932 >> v2:172.21.15.195:3300/0 conn(0x7f11840b74c0 msgr2=0x7f11840d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11837fe640 1 --2- 172.21.15.80:0/511413932 >> v2:172.21.15.195:3300/0 conn(0x7f11840b74c0 0x7f11840d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11837fe640 1 -- 172.21.15.80:0/511413932 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1184162a90 con 0x7f1184161c80 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11889cd640 1 --2- 172.21.15.80:0/511413932 >> v2:172.21.15.195:3300/0 conn(0x7f11840b74c0 0x7f11840d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f11837fe640 1 --2- 172.21.15.80:0/511413932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840b6f80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f11841626e0 tx=0x7f117802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd94cb0770eb5cea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f1182ffd640 1 -- 172.21.15.80:0/511413932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117802ae60 con 0x7f1184161c80 2024-04-25T15:45:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f1182ffd640 1 -- 172.21.15.80:0/511413932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1178004030 con 0x7f1184161c80 2024-04-25T15:45:49.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.472+0000 7f1182ffd640 1 -- 172.21.15.80:0/511413932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178004460 con 0x7f1184161c80 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 -- 172.21.15.80:0/511413932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 msgr2=0x7f11840b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 --2- 172.21.15.80:0/511413932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840b6f80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f11841626e0 tx=0x7f117802a110 comp rx=0 tx=0).stop 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 -- 172.21.15.80:0/511413932 shutdown_connections 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 --2- 172.21.15.80:0/511413932 >> v2:172.21.15.195:3300/0 conn(0x7f11840b74c0 0x7f11840d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 --2- 172.21.15.80:0/511413932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840b6f80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 --2- 172.21.15.80:0/511413932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1184071950 0x7f1184072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 -- 172.21.15.80:0/511413932 >> 172.21.15.80:0/511413932 conn(0x7f11840d3ea0 msgr2=0x7f11840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 -- 172.21.15.80:0/511413932 shutdown_connections 2024-04-25T15:45:49.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.473+0000 7f118a430640 1 -- 172.21.15.80:0/511413932 wait complete. 2024-04-25T15:45:49.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.475+0000 7f118a430640 1 Processor -- start 2024-04-25T15:45:49.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.475+0000 7f118a430640 1 -- start start 2024-04-25T15:45:49.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.476+0000 7f118a430640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1184071950 0x7f1184150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.476+0000 7f118a430640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11840b74c0 0x7f118414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.476+0000 7f118a430640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.476+0000 7f118a430640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1184162210 con 0x7f1184161c80 2024-04-25T15:45:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.476+0000 7f118a430640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1184162090 con 0x7f1184071950 2024-04-25T15:45:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.476+0000 7f118a430640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11840d2fd0 con 0x7f11840b74c0 2024-04-25T15:45:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49496/0 (socket says 172.21.15.80:49496) 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 -- 172.21.15.80:0/2720848134 learned_addr learned my addr 172.21.15.80:0/2720848134 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f1183fff640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1184071950 0x7f1184150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11837fe640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11840b74c0 0x7f118414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 -- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11840b74c0 msgr2=0x7f118414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11840b74c0 0x7f118414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 -- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1184071950 msgr2=0x7f1184150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1184071950 0x7f1184150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 -- 172.21.15.80:0/2720848134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118414f5b0 con 0x7f1184161c80 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11837fe640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11840b74c0 0x7f118414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f11889cd640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840c9e10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f117c00cdb0 tx=0x7f117c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c00f680 con 0x7f1184161c80 2024-04-25T15:45:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c00f840 con 0x7f1184161c80 2024-04-25T15:45:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118414f890 con 0x7f1184161c80 2024-04-25T15:45:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c00fc30 con 0x7f1184161c80 2024-04-25T15:45:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.477+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118414fe50 con 0x7f1184161c80 2024-04-25T15:45:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.478+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118406a100 con 0x7f1184161c80 2024-04-25T15:45:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.479+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f117c0213f0 con 0x7f1184161c80 2024-04-25T15:45:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.479+0000 7f1180ff9640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11700744e0 0x7f11700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.479+0000 7f1183fff640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11700744e0 0x7f11700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.480+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6101+0+0 (secure 0 0 0) 0x7f117c096100 con 0x7f1184161c80 2024-04-25T15:45:49.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.480+0000 7f1183fff640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11700744e0 0x7f11700769f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f11840d15f0 tx=0x7f1174009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.484+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f117c014030 con 0x7f1184161c80 2024-04-25T15:45:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.657+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f118414f340 con 0x7f1184161c80 2024-04-25T15:45:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.658+0000 7f1180ff9640 1 -- 172.21.15.80:0/2720848134 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16946 (secure 0 0 0) 0x7f117c060700 con 0x7f1184161c80 2024-04-25T15:45:49.659 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:49.659 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":73,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:48.382079+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.660+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11700744e0 msgr2=0x7f11700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.660+0000 7f118a430640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11700744e0 0x7f11700769f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f11840d15f0 tx=0x7f1174009060 comp rx=0 tx=0).stop 2024-04-25T15:45:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.660+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 msgr2=0x7f11840c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.660+0000 7f118a430640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840c9e10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f117c00cdb0 tx=0x7f117c00a650 comp rx=0 tx=0).stop 2024-04-25T15:45:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 shutdown_connections 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11700744e0 0x7f11700769f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1184161c80 0x7f11840c9e10 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11840b74c0 0x7f118414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 --2- 172.21.15.80:0/2720848134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1184071950 0x7f1184150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 >> 172.21.15.80:0/2720848134 conn(0x7f11840d3ea0 msgr2=0x7f11840b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 shutdown_connections 2024-04-25T15:45:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.661+0000 7f118a430640 1 -- 172.21.15.80:0/2720848134 wait complete. 2024-04-25T15:45:49.672 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:45:49.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.783+0000 7f5af6ba8640 1 Processor -- start 2024-04-25T15:45:49.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.783+0000 7f5af6ba8640 1 -- start start 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af6ba8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5af00b5490 0x7f5af0160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af6ba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d0b00 0x7f5af00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af6ba8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00d57e0 con 0x7f5af00d2b80 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af6ba8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5af01643f0 con 0x7f5af00b5490 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af6ba8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5af01646d0 con 0x7f5af00d0b00 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af4944640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5af00b5490 0x7f5af0160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af5145640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5af00d2b80 0x7f5af00b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52566/0 (socket says 172.21.15.80:52566) 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5af5145640 1 -- 172.21.15.80:0/4201067302 learned_addr learned my addr 172.21.15.80:0/4201067302 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.784+0000 7f5aeffff640 1 --2- 172.21.15.80:0/4201067302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d0b00 0x7f5af00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.785+0000 7f5af4944640 1 -- 172.21.15.80:0/4201067302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d0b00 msgr2=0x7f5af00d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:49.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.785+0000 7f5af4944640 1 --2- 172.21.15.80:0/4201067302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d0b00 0x7f5af00d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.785+0000 7f5af4944640 1 -- 172.21.15.80:0/4201067302 >> v1:172.21.15.80:6789/0 conn(0x7f5af00d2b80 legacy=0x7f5af00b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.785+0000 7f5aef7fe640 1 -- 172.21.15.80:0/4201067302 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484314822 0 0) 0x7f5af00d57e0 con 0x7f5af00d2b80 2024-04-25T15:45:49.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.785+0000 7f5af4944640 1 -- 172.21.15.80:0/4201067302 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af01649b0 con 0x7f5af00b5490 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.785+0000 7f5af4944640 1 --2- 172.21.15.80:0/4201067302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00b5490 0x7f5af0160300 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40097a0 tx=0x7f5ae402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f7eba6e3414be1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5aef7fe640 1 -- 172.21.15.80:0/4201067302 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4037070 con 0x7f5af00b5490 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5aef7fe640 1 -- 172.21.15.80:0/4201067302 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae4032440 con 0x7f5af00b5490 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5aef7fe640 1 -- 172.21.15.80:0/4201067302 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4032810 con 0x7f5af00b5490 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 -- 172.21.15.80:0/4201067302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00b5490 msgr2=0x7f5af0160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/4201067302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00b5490 0x7f5af0160300 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40097a0 tx=0x7f5ae402a180 comp rx=0 tx=0).stop 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 -- 172.21.15.80:0/4201067302 shutdown_connections 2024-04-25T15:45:49.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/4201067302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d0b00 0x7f5af00d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/4201067302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00b5490 0x7f5af0160300 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 -- 172.21.15.80:0/4201067302 >> 172.21.15.80:0/4201067302 conn(0x7f5af006e650 msgr2=0x7f5af006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:49.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 -- 172.21.15.80:0/4201067302 shutdown_connections 2024-04-25T15:45:49.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.786+0000 7f5af6ba8640 1 -- 172.21.15.80:0/4201067302 wait complete. 2024-04-25T15:45:49.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.788+0000 7f5af6ba8640 1 Processor -- start 2024-04-25T15:45:49.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.788+0000 7f5af6ba8640 1 -- start start 2024-04-25T15:45:49.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.789+0000 7f5af6ba8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d0b00 0x7f5af01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.789+0000 7f5af6ba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d2b80 0x7f5af01532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af6ba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 0x7f5af0162610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af6ba8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00d2f90 con 0x7f5af0162200 2024-04-25T15:45:49.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af6ba8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0160840 con 0x7f5af00d0b00 2024-04-25T15:45:49.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af6ba8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00b9360 con 0x7f5af00d2b80 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 0x7f5af0162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 0x7f5af0162610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49524/0 (socket says 172.21.15.80:49524) 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 -- 172.21.15.80:0/2723669980 learned_addr learned my addr 172.21.15.80:0/2723669980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5aeffff640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d2b80 0x7f5af01532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af4944640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d0b00 0x7f5af01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 -- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d2b80 msgr2=0x7f5af01532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d2b80 0x7f5af01532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 -- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d0b00 msgr2=0x7f5af01597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d0b00 0x7f5af01597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 -- 172.21.15.80:0/2723669980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af0159d30 con 0x7f5af0162200 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af5145640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 0x7f5af0162610 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c700 tx=0x7f5ae800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8018070 con 0x7f5af0162200 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae800ce10 con 0x7f5af0162200 2024-04-25T15:45:49.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af0162b50 con 0x7f5af0162200 2024-04-25T15:45:49.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800a860 con 0x7f5af0162200 2024-04-25T15:45:49.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.790+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af0153e50 con 0x7f5af0162200 2024-04-25T15:45:49.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.791+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af0159f80 con 0x7f5af0162200 2024-04-25T15:45:49.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.792+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5ae801b070 con 0x7f5af0162200 2024-04-25T15:45:49.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.793+0000 7f5aed7fa640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ad40744b0 0x7f5ad40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:49.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.793+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6101+0+0 (secure 0 0 0) 0x7f5ae80947e0 con 0x7f5af0162200 2024-04-25T15:45:49.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.793+0000 7f5af4944640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ad40744b0 0x7f5ad40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:49.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.793+0000 7f5af4944640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ad40744b0 0x7f5ad40769c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4034000 tx=0x7f5ae402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:49.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:49.797+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5af0162b50 con 0x7f5af0162200 2024-04-25T15:45:50.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.011+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5af00d41d0 con 0x7f5af0162200 2024-04-25T15:45:50.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.028+0000 7f5aed7fa640 1 -- 172.21.15.80:0/2723669980 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7f5af0159d30 con 0x7f5af0162200 2024-04-25T15:45:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ad40744b0 msgr2=0x7f5ad40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ad40744b0 0x7f5ad40769c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4034000 tx=0x7f5ae402e000 comp rx=0 tx=0).stop 2024-04-25T15:45:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 msgr2=0x7f5af0162610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 0x7f5af0162610 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c700 tx=0x7f5ae800cbc0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 shutdown_connections 2024-04-25T15:45:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5ad40744b0 0x7f5ad40769c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af0162200 0x7f5af0162610 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00d2b80 0x7f5af01532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 --2- 172.21.15.80:0/2723669980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d0b00 0x7f5af01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 >> 172.21.15.80:0/2723669980 conn(0x7f5af006e650 msgr2=0x7f5af00b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 shutdown_connections 2024-04-25T15:45:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.030+0000 7f5af6ba8640 1 -- 172.21.15.80:0/2723669980 wait complete. 2024-04-25T15:45:50.042 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:45:50.043 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:45:50.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.152+0000 7fdcff070640 1 Processor -- start 2024-04-25T15:45:50.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.152+0000 7fdcff070640 1 -- start start 2024-04-25T15:45:50.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcff070640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdcf815d760 0x7fdcf8156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcff070640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf80b6b50 con 0x7fdcf806dce0 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcff070640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf80b6870 con 0x7fdcf8160ad0 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcff070640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdcf815cc80 con 0x7fdcf815d760 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcfd60d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdcf806dce0 0x7fdcf80b4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52580/0 (socket says 172.21.15.80:52580) 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcfd60d640 1 -- 172.21.15.80:0/3277310736 learned_addr learned my addr 172.21.15.80:0/3277310736 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcfce0c640 1 --2- 172.21.15.80:0/3277310736 >> v2:172.21.15.195:3300/0 conn(0x7fdcf815d760 0x7fdcf8156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582272729 0 0) 0x7fdcf80b6b50 con 0x7fdcf806dce0 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce0003520 con 0x7fdcf806dce0 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.154+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2287125814 0 0) 0x7fdce0003520 con 0x7fdcf806dce0 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 >> v2:172.21.15.195:3300/0 conn(0x7fdcf815d760 msgr2=0x7fdcf8156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 --2- 172.21.15.80:0/3277310736 >> v2:172.21.15.195:3300/0 conn(0x7fdcf815d760 0x7fdcf8156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 >> v1:172.21.15.195:6789/0 conn(0x7fdcf8160ad0 legacy=0x7fdcf806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf815cf60 con 0x7fdcf806dce0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fdcf00019f0 con 0x7fdcf806dce0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 >> v1:172.21.15.80:6789/0 conn(0x7fdcf806dce0 legacy=0x7fdcf80b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00039b0 0x7fdce0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdce0004800 0x7fdce0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce00051c0 0x7fdce000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf815cc80 con 0x7fdce00051c0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdce000c160 con 0x7fdce00039b0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdce000c360 con 0x7fdce0004800 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfd60d640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce00051c0 0x7fdce000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfce0c640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00039b0 0x7fdce0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcf7fff640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdce0004800 0x7fdce0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfd60d640 1 -- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdce0004800 msgr2=0x7fdce0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfd60d640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdce0004800 0x7fdce0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfd60d640 1 -- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00039b0 msgr2=0x7fdce0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfd60d640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00039b0 0x7fdce0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.155+0000 7fdcfd60d640 1 -- 172.21.15.80:0/3277310736 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce0003520 con 0x7fdce00051c0 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.156+0000 7fdcfd60d640 1 -- 172.21.15.80:0/3277310736 reap_dead start 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.156+0000 7fdcfd60d640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce00051c0 0x7fdce000b9c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000a830 tx=0x7fdce0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bffca329c8d230 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.156+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000a480 con 0x7fdce00051c0 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.156+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf002f070 con 0x7fdce00051c0 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.156+0000 7fdcf77fe640 1 -- 172.21.15.80:0/3277310736 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf002bbe0 con 0x7fdce00051c0 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 -- 172.21.15.80:0/3277310736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce00051c0 msgr2=0x7fdce000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce00051c0 0x7fdce000b9c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000a830 tx=0x7fdce0005830 comp rx=0 tx=0).stop 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 -- 172.21.15.80:0/3277310736 shutdown_connections 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 --2- 172.21.15.80:0/3277310736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce00051c0 0x7fdce000b9c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 -- 172.21.15.80:0/3277310736 >> 172.21.15.80:0/3277310736 conn(0x7fdcf80734b0 msgr2=0x7fdcf80738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 -- 172.21.15.80:0/3277310736 shutdown_connections 2024-04-25T15:45:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.157+0000 7fdcff070640 1 -- 172.21.15.80:0/3277310736 wait complete. 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.158+0000 7fdcff070640 1 Processor -- start 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.158+0000 7fdcff070640 1 -- start start 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00051c0 0x7fdcf80b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 0x7fdcf8145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcf815f4c0 0x7fdcf815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf80b6510 con 0x7fdcf81440d0 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf80711f0 con 0x7fdce00051c0 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf8160ee0 con 0x7fdcf815f4c0 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 0x7fdcf8145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 0x7fdcf8145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49554/0 (socket says 172.21.15.80:49554) 2024-04-25T15:45:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 -- 172.21.15.80:0/2784991954 learned_addr learned my addr 172.21.15.80:0/2784991954 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcfce0c640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00051c0 0x7fdcf80b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcfd60d640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcf815f4c0 0x7fdcf815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 -- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcf815f4c0 msgr2=0x7fdcf815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcf815f4c0 0x7fdcf815e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 -- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00051c0 msgr2=0x7fdcf80b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00051c0 0x7fdcf80b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 -- 172.21.15.80:0/2784991954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf80b1660 con 0x7fdcf81440d0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcfce0c640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00051c0 0x7fdcf80b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf7fff640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 0x7fdcf8145510 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00f5c0 tx=0x7fdcec00fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0052e0 con 0x7fdcf81440d0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec018070 con 0x7fdcf81440d0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf80b1940 con 0x7fdcf81440d0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.160+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec003830 con 0x7fdcf81440d0 2024-04-25T15:45:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.161+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf80b1f00 con 0x7fdcf81440d0 2024-04-25T15:45:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.161+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf806a100 con 0x7fdcf81440d0 2024-04-25T15:45:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.162+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdcec0039d0 con 0x7fdcf81440d0 2024-04-25T15:45:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.162+0000 7fdcf57fa640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdce40744b0 0x7fdce40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.163+0000 7fdcfce0c640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdce40744b0 0x7fdce40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.163+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fdcec0951a0 con 0x7fdcf81440d0 2024-04-25T15:45:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.163+0000 7fdcfce0c640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdce40744b0 0x7fdce40769c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009b40 tx=0x7fdce8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.167+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdcec05f790 con 0x7fdcf81440d0 2024-04-25T15:45:50.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:50.376+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdcf8152410 con 0x7fdcf81440d0 2024-04-25T15:45:50.998 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-25T15:45:50.999+0000 7f7b9c6e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:45:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.037+0000 7fdcf57fa640 1 -- 172.21.15.80:0/2784991954 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7fdcec05f090 con 0x7fdcf81440d0 2024-04-25T15:45:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdce40744b0 msgr2=0x7fdce40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdce40744b0 0x7fdce40769c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009b40 tx=0x7fdce8008040 comp rx=0 tx=0).stop 2024-04-25T15:45:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 msgr2=0x7fdcf8145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 0x7fdcf8145510 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00f5c0 tx=0x7fdcec00fa80 comp rx=0 tx=0).stop 2024-04-25T15:45:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 shutdown_connections 2024-04-25T15:45:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fdce40744b0 0x7fdce40769c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcf815f4c0 0x7fdcf815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf81440d0 0x7fdcf8145510 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 --2- 172.21.15.80:0/2784991954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdce00051c0 0x7fdcf80b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 >> 172.21.15.80:0/2784991954 conn(0x7fdcf80734b0 msgr2=0x7fdcf80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 shutdown_connections 2024-04-25T15:45:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.040+0000 7fdcff070640 1 -- 172.21.15.80:0/2784991954 wait complete. 2024-04-25T15:45:51.053 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:45:51.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.166+0000 7fcec7ed8640 1 Processor -- start 2024-04-25T15:45:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.166+0000 7fcec7ed8640 1 -- start start 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.167+0000 7fcec7ed8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec00714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.167+0000 7fcec7ed8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcec00719e0 0x7fcec00b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.167+0000 7fcec7ed8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec0071df0 con 0x7fcec00cfc40 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.167+0000 7fcec7ed8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcec0160610 con 0x7fcec00719e0 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.167+0000 7fcec7ed8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcec00b6eb0 con 0x7fcec0160200 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec6475640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcec00719e0 0x7fcec00b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec5c74640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcec00cfc40 0x7fcec0164690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52582/0 (socket says 172.21.15.80:52582) 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec5c74640 1 -- 172.21.15.80:0/3458227486 learned_addr learned my addr 172.21.15.80:0/3458227486 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec5473640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec00714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec6475640 1 -- 172.21.15.80:0/3458227486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 msgr2=0x7fcec00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec6475640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec00714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec6475640 1 -- 172.21.15.80:0/3458227486 >> v1:172.21.15.80:6789/0 conn(0x7fcec00cfc40 legacy=0x7fcec0164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec4c72640 1 -- 172.21.15.80:0/3458227486 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506887944 0 0) 0x7fcebc001110 con 0x7fcec00cfc40 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec6475640 1 -- 172.21.15.80:0/3458227486 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec00b7150 con 0x7fcec00719e0 2024-04-25T15:45:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.168+0000 7fcec5473640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec00714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.169+0000 7fcec6475640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00719e0 0x7fcec00b59e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009d90 tx=0x7fceb802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66aa3c1c49f965a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.169+0000 7fcec4c72640 1 -- 172.21.15.80:0/3458227486 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8031600 con 0x7fcec00719e0 2024-04-25T15:45:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.169+0000 7fcec4c72640 1 -- 172.21.15.80:0/3458227486 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb80317a0 con 0x7fcec00719e0 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.169+0000 7fcec4c72640 1 -- 172.21.15.80:0/3458227486 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8031b70 con 0x7fcec00719e0 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.169+0000 7fcec7ed8640 1 -- 172.21.15.80:0/3458227486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00719e0 msgr2=0x7fcec00b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.169+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00719e0 0x7fcec00b59e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009d90 tx=0x7fceb802a5d0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.170+0000 7fcec7ed8640 1 -- 172.21.15.80:0/3458227486 shutdown_connections 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.170+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00719e0 0x7fcec00b59e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.170+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/3458227486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec00714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.170+0000 7fcec7ed8640 1 -- 172.21.15.80:0/3458227486 >> 172.21.15.80:0/3458227486 conn(0x7fcec00d2080 msgr2=0x7fcec00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.170+0000 7fcec7ed8640 1 -- 172.21.15.80:0/3458227486 shutdown_connections 2024-04-25T15:45:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.170+0000 7fcec7ed8640 1 -- 172.21.15.80:0/3458227486 wait complete. 2024-04-25T15:45:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.171+0000 7fcec7ed8640 1 Processor -- start 2024-04-25T15:45:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.171+0000 7fcec7ed8640 1 -- start start 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcec00719e0 0x7fcec01ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 0x7fcec0155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec01ebb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcec00b7430 con 0x7fcec00cfc40 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcec00b54c0 con 0x7fcec00719e0 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcec0072040 con 0x7fcec0160200 2024-04-25T15:45:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 0x7fcec0155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 0x7fcec0155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49572/0 (socket says 172.21.15.80:49572) 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 -- 172.21.15.80:0/1711358098 learned_addr learned my addr 172.21.15.80:0/1711358098 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec6475640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec01ebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5c74640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcec00719e0 0x7fcec01ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 -- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 msgr2=0x7fcec01ebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec01ebb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 -- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcec00719e0 msgr2=0x7fcec01ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcec00719e0 0x7fcec01ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 -- 172.21.15.80:0/1711358098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec01e9560 con 0x7fcec00cfc40 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec5473640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 0x7fcec0155890 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c7f0 tx=0x7fceb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb0015070 con 0x7fcec00cfc40 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb0007820 con 0x7fcec00cfc40 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec0162420 con 0x7fcec00cfc40 2024-04-25T15:45:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb0007bd0 con 0x7fcec00cfc40 2024-04-25T15:45:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.173+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01e8a80 con 0x7fcec00cfc40 2024-04-25T15:45:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.174+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec006a100 con 0x7fcec00cfc40 2024-04-25T15:45:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.175+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fceb0018070 con 0x7fcec00cfc40 2024-04-25T15:45:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.175+0000 7fceb67fc640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcea40744b0 0x7fcea40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.175+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fceb0095550 con 0x7fcec00cfc40 2024-04-25T15:45:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.175+0000 7fcec5c74640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcea40744b0 0x7fcea40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.176+0000 7fcec5c74640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcea40744b0 0x7fcea40769c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000f60 tx=0x7fcebc007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.180+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fceb005fb50 con 0x7fcec00cfc40 2024-04-25T15:45:51.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.391+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcec0072570 con 0x7fcec00cfc40 2024-04-25T15:45:51.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.391+0000 7fceb67fc640 1 -- 172.21.15.80:0/1711358098 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7fceb005f450 con 0x7fcec00cfc40 2024-04-25T15:45:51.392 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:51.392 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:45:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcea40744b0 msgr2=0x7fcea40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcea40744b0 0x7fcea40769c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000f60 tx=0x7fcebc007c00 comp rx=0 tx=0).stop 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 msgr2=0x7fcec0155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 0x7fcec0155890 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c7f0 tx=0x7fceb000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 shutdown_connections 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcea40744b0 0x7fcea40769c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcec0160200 0x7fcec01ebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec00cfc40 0x7fcec0155890 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.393+0000 7fcec7ed8640 1 --2- 172.21.15.80:0/1711358098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcec00719e0 0x7fcec01ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.394+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 >> 172.21.15.80:0/1711358098 conn(0x7fcec00d2080 msgr2=0x7fcec006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.394+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 shutdown_connections 2024-04-25T15:45:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.394+0000 7fcec7ed8640 1 -- 172.21.15.80:0/1711358098 wait complete. 2024-04-25T15:45:51.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:45:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.513+0000 7f7509fb2640 1 Processor -- start 2024-04-25T15:45:51.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.513+0000 7f7509fb2640 1 -- start start 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f7509fb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 0x7f750406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f7509fb2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f75040b4700 0x7f75040b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f7509fb2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750406df20 con 0x7f7504153f70 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f7509fb2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f75040b1180 con 0x7f75040b4700 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f7509fb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f750415d4f0 con 0x7f750406d5d0 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75037fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7504153f70 0x7f75040b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52586/0 (socket says 172.21.15.80:52586) 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75037fe640 1 -- 172.21.15.80:0/305553847 learned_addr learned my addr 172.21.15.80:0/305553847 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224198653 0 0) 0x7f74f4001110 con 0x7f7504153f70 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74ec003520 con 0x7f7504153f70 2024-04-25T15:45:51.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1510323502 0 0) 0x7f74ec003520 con 0x7f7504153f70 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 msgr2=0x7f750406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 0x7f750406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 >> v2:172.21.15.195:3300/0 conn(0x7f75040b4700 msgr2=0x7f75040b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 --2- 172.21.15.80:0/305553847 >> v2:172.21.15.195:3300/0 conn(0x7f75040b4700 0x7f75040b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750415e270 con 0x7f7504153f70 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f74f4001840 con 0x7f7504153f70 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.515+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 >> v1:172.21.15.80:6789/0 conn(0x7f7504153f70 legacy=0x7f75040b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75027fc640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74ec0039b0 0x7f74ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75027fc640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f74ec004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75027fc640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 0x7f74ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f75040b1180 con 0x7f74ec004800 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f750415d4f0 con 0x7f74ec0039b0 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74ec005610 con 0x7f750406d5d0 2024-04-25T15:45:51.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7502ffd640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f74ec004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f75037fe640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74ec0039b0 0x7f74ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7503fff640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 0x7f74ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7502ffd640 1 -- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 msgr2=0x7f74ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7502ffd640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750406d5d0 0x7f74ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7502ffd640 1 -- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74ec0039b0 msgr2=0x7f74ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7502ffd640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74ec0039b0 0x7f74ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.516+0000 7f7502ffd640 1 -- 172.21.15.80:0/305553847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec003520 con 0x7f74ec004800 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f7502ffd640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f74ec004c10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009860 tx=0x7f74ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b512373ca99adbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8037070 con 0x7f74ec004800 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f802aa80 con 0x7f74ec004800 2024-04-25T15:45:51.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f75027fc640 1 -- 172.21.15.80:0/305553847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8009460 con 0x7f74ec004800 2024-04-25T15:45:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f7509fb2640 1 -- 172.21.15.80:0/305553847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 msgr2=0x7f74ec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f7509fb2640 1 --2- 172.21.15.80:0/305553847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f74ec004c10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009860 tx=0x7f74ec005830 comp rx=0 tx=0).stop 2024-04-25T15:45:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f7503fff640 1 -- 172.21.15.80:0/305553847 reap_dead start 2024-04-25T15:45:51.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f7509fb2640 1 -- 172.21.15.80:0/305553847 shutdown_connections 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.517+0000 7f7509fb2640 1 -- 172.21.15.80:0/305553847 >> 172.21.15.80:0/305553847 conn(0x7f75040d1e20 msgr2=0x7f7504073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.518+0000 7f7509fb2640 1 -- 172.21.15.80:0/305553847 shutdown_connections 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.518+0000 7f7509fb2640 1 -- 172.21.15.80:0/305553847 wait complete. 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.519+0000 7f7509fb2640 1 Processor -- start 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.519+0000 7f7509fb2640 1 -- start start 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f750409b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750415cbf0 0x7f750409e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f750409e5b0 0x7f750409c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f75040b0dd0 con 0x7f74ec004800 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f750415da70 con 0x7f750409e5b0 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f75041f6320 con 0x7f750415cbf0 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f750409b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f750409b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49584/0 (socket says 172.21.15.80:49584) 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 -- 172.21.15.80:0/1548614100 learned_addr learned my addr 172.21.15.80:0/1548614100 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7502ffd640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750415cbf0 0x7f750409e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7503fff640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f750409e5b0 0x7f750409c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 -- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750415cbf0 msgr2=0x7f750409e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750415cbf0 0x7f750409e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 -- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f750409e5b0 msgr2=0x7f750409c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f750409e5b0 0x7f750409c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 -- 172.21.15.80:0/1548614100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750409e9c0 con 0x7f74ec004800 2024-04-25T15:45:51.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f75037fe640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f750409b9c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f74f4007330 tx=0x7f74f40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f400e8f0 con 0x7f74ec004800 2024-04-25T15:45:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4018070 con 0x7f74ec004800 2024-04-25T15:45:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f400ecf0 con 0x7f74ec004800 2024-04-25T15:45:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.521+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750409bf00 con 0x7f74ec004800 2024-04-25T15:45:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.522+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750414eb10 con 0x7f74ec004800 2024-04-25T15:45:51.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.522+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750414f4b0 con 0x7f74ec004800 2024-04-25T15:45:51.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.523+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f74f401d460 con 0x7f74ec004800 2024-04-25T15:45:51.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.524+0000 7f74ebfff640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74f00744b0 0x7f74f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.524+0000 7f7502ffd640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74f00744b0 0x7f74f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.524+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f74f4095450 con 0x7f74ec004800 2024-04-25T15:45:51.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.524+0000 7f7502ffd640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74f00744b0 0x7f74f00769c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f74f8034000 tx=0x7f74f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.528+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f750414f4b0 con 0x7f74ec004800 2024-04-25T15:45:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.706+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7504070c20 con 0x7f74ec004800 2024-04-25T15:45:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.707+0000 7f74ebfff640 1 -- 172.21.15.80:0/1548614100 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16933 (secure 0 0 0) 0x7f7504070c20 con 0x7f74ec004800 2024-04-25T15:45:51.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:51.708 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:50.027676+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74f00744b0 msgr2=0x7f74f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74f00744b0 0x7f74f00769c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f74f8034000 tx=0x7f74f802e000 comp rx=0 tx=0).stop 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 msgr2=0x7f750409b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f750409b9c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f74f4007330 tx=0x7f74f40077f0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 shutdown_connections 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74f00744b0 0x7f74f00769c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f750409e5b0 0x7f750409c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750415cbf0 0x7f750409e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 --2- 172.21.15.80:0/1548614100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74ec004800 0x7f750409b9c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 >> 172.21.15.80:0/1548614100 conn(0x7f75040d1e20 msgr2=0x7f750414c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 shutdown_connections 2024-04-25T15:45:51.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.709+0000 7f7509fb2640 1 -- 172.21.15.80:0/1548614100 wait complete. 2024-04-25T15:45:51.721 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:45:51.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:51.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.827+0000 7fb867fb2640 1 Processor -- start 2024-04-25T15:45:51.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.827+0000 7fb867fb2640 1 -- start start 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb867fb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 0x7fb8600d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb867fb2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8601607c0 con 0x7fb8600cf960 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb867fb2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8600d0180 con 0x7fb8600ce220 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb867fb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb8600cf4d0 con 0x7fb8600cfd70 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb86554d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb8600cf960 0x7fb8600b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52596/0 (socket says 172.21.15.80:52596) 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb86554d640 1 -- 172.21.15.80:0/3892857089 learned_addr learned my addr 172.21.15.80:0/3892857089 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb86654f640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 0x7fb8600d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401233919 0 0) 0x7fb8601607c0 con 0x7fb8600cf960 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb84c003520 con 0x7fb8600cf960 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3998033602 0 0) 0x7fb84c003520 con 0x7fb8600cf960 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 msgr2=0x7fb8600d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 0x7fb8600d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 >> v1:172.21.15.195:6789/0 conn(0x7fb8600ce220 legacy=0x7fb86009bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8600ceba0 con 0x7fb8600cf960 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb850001670 con 0x7fb8600cf960 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 >> v1:172.21.15.80:6789/0 conn(0x7fb8600cf960 legacy=0x7fb8600b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 0x7fb84c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb84c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb84c004d40 0x7fb84c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600cf4d0 con 0x7fb84c003f40 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c00bbb0 con 0x7fb84c004d40 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.829+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c00bdb0 con 0x7fb8600cfd70 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86554d640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb84c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb865d4e640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 0x7fb84c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86654f640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb84c004d40 0x7fb84c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86554d640 1 -- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 msgr2=0x7fb84c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86554d640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8600cfd70 0x7fb84c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86554d640 1 -- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb84c004d40 msgr2=0x7fb84c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86554d640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb84c004d40 0x7fb84c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.830+0000 7fb86554d640 1 -- 172.21.15.80:0/3892857089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c003520 con 0x7fb84c003f40 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb86554d640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb84c004800 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb85000c290 tx=0x7fb84c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9e688e734efd07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850007d50 con 0x7fb84c003f40 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb850005af0 con 0x7fb84c003f40 2024-04-25T15:45:51.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb864d4c640 1 -- 172.21.15.80:0/3892857089 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850007070 con 0x7fb84c003f40 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb867fb2640 1 -- 172.21.15.80:0/3892857089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 msgr2=0x7fb84c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb867fb2640 1 --2- 172.21.15.80:0/3892857089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb84c004800 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb85000c290 tx=0x7fb84c005830 comp rx=0 tx=0).stop 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb86654f640 1 -- 172.21.15.80:0/3892857089 reap_dead start 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb867fb2640 1 -- 172.21.15.80:0/3892857089 shutdown_connections 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb867fb2640 1 -- 172.21.15.80:0/3892857089 >> 172.21.15.80:0/3892857089 conn(0x7fb8600b7620 msgr2=0x7fb8600b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.831+0000 7fb867fb2640 1 -- 172.21.15.80:0/3892857089 shutdown_connections 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.832+0000 7fb867fb2640 1 -- 172.21.15.80:0/3892857089 wait complete. 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.833+0000 7fb867fb2640 1 Processor -- start 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.833+0000 7fb867fb2640 1 -- start start 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.834+0000 7fb867fb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb8600a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.834+0000 7fb867fb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8600cbb30 0x7fb8600cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.834+0000 7fb867fb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb86009dd00 0x7fb8600c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.834+0000 7fb867fb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600cf160 con 0x7fb84c003f40 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.834+0000 7fb867fb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600ce630 con 0x7fb8600cbb30 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb867fb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb8600d3530 con 0x7fb86009dd00 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb8600a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb8600a0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49608/0 (socket says 172.21.15.80:49608) 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 -- 172.21.15.80:0/2036290304 learned_addr learned my addr 172.21.15.80:0/2036290304 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb86554d640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8600cbb30 0x7fb8600cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb86654f640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb86009dd00 0x7fb8600c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 -- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb86009dd00 msgr2=0x7fb8600c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb86009dd00 0x7fb8600c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 -- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8600cbb30 msgr2=0x7fb8600cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8600cbb30 0x7fb8600cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 -- 172.21.15.80:0/2036290304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8600caa90 con 0x7fb84c003f40 2024-04-25T15:45:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb86654f640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb86009dd00 0x7fb8600c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb865d4e640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb8600a0070 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00f980 tx=0x7fb85c00fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c003b80 con 0x7fb84c003f40 2024-04-25T15:45:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c018070 con 0x7fb84c003f40 2024-04-25T15:45:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8600cad70 con 0x7fb84c003f40 2024-04-25T15:45:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00d7f0 con 0x7fb84c003f40 2024-04-25T15:45:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.835+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8600cb330 con 0x7fb84c003f40 2024-04-25T15:45:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.836+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb86006a100 con 0x7fb84c003f40 2024-04-25T15:45:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.837+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb85c00d990 con 0x7fb84c003f40 2024-04-25T15:45:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.837+0000 7fb8567fc640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8440744b0 0x7fb8440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.837+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fb85c095590 con 0x7fb84c003f40 2024-04-25T15:45:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.837+0000 7fb86554d640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8440744b0 0x7fb8440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.838+0000 7fb86554d640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8440744b0 0x7fb8440769c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb850033000 tx=0x7fb85002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:51.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:51.842+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb85c05fb90 con 0x7fb84c003f40 2024-04-25T15:45:52.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.015+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8600d0180 con 0x7fb8440744b0 2024-04-25T15:45:52.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.020+0000 7fb8567fc640 1 -- 172.21.15.80:0/2036290304 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248282 (secure 0 0 0) 0x7fb8600d0180 con 0x7fb8440744b0 2024-04-25T15:45:52.023 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:52.024 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8440744b0 msgr2=0x7fb8440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8440744b0 0x7fb8440769c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb850033000 tx=0x7fb85002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 msgr2=0x7fb8600a0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb8600a0070 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00f980 tx=0x7fb85c00fe40 comp rx=0 tx=0).stop 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 shutdown_connections 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8440744b0 0x7fb8440769c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb86009dd00 0x7fb8600c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8600cbb30 0x7fb8600cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 --2- 172.21.15.80:0/2036290304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb84c003f40 0x7fb8600a0070 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 >> 172.21.15.80:0/2036290304 conn(0x7fb8600b7620 msgr2=0x7fb86006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 shutdown_connections 2024-04-25T15:45:52.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.024+0000 7fb867fb2640 1 -- 172.21.15.80:0/2036290304 wait complete. 2024-04-25T15:45:52.035 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-25T15:45:51.032572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240800,"kb_used_data":7972,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733920,"statfs":{"total":773094113280,"available":772847534080,"internally_reserved":0,"allocated":8163328,"data_stored":4307791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.025812"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018731+0000","last_change":"2024-04-25T15:45:48.018731+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018731+0000","last_undegraded":"2024-04-25T15:45:48.018731+0000","last_fullsized":"2024-04-25T15:45:48.018731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023863+0000","last_change":"2024-04-25T15:45:49.023863+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023863+0000","last_undegraded":"2024-04-25T15:45:49.023863+0000","last_fullsized":"2024-04-25T15:45:49.023863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028092+0000","last_change":"2024-04-25T15:45:49.028092+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028092+0000","last_undegraded":"2024-04-25T15:45:49.028092+0000","last_fullsized":"2024-04-25T15:45:49.028092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.029372+0000","last_change":"2024-04-25T15:45:48.029372+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.029372+0000","last_undegraded":"2024-04-25T15:45:48.029372+0000","last_fullsized":"2024-04-25T15:45:48.029372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024738+0000","last_change":"2024-04-25T15:45:49.024738+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024738+0000","last_undegraded":"2024-04-25T15:45:49.024738+0000","last_fullsized":"2024-04-25T15:45:49.024738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029845+0000","last_change":"2024-04-25T15:45:49.029845+0000","last_active":"2024-04-25T15:45:49.029845+0000","last_peered":"2024-04-25T15:45:49.029845+0000","last_clean":"2024-04-25T15:45:49.029845+0000","last_became_active":"2024-04-25T15:45:49.029552+0000","last_became_peered":"2024-04-25T15:45:49.029552+0000","last_unstale":"2024-04-25T15:45:49.029845+0000","last_undegraded":"2024-04-25T15:45:49.029845+0000","last_fullsized":"2024-04-25T15:45:49.029845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:39.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019213+0000","last_change":"2024-04-25T15:45:49.019213+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019213+0000","last_undegraded":"2024-04-25T15:45:49.019213+0000","last_fullsized":"2024-04-25T15:45:49.019213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024119+0000","last_change":"2024-04-25T15:45:49.024119+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024119+0000","last_undegraded":"2024-04-25T15:45:49.024119+0000","last_fullsized":"2024-04-25T15:45:49.024119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015600+0000","last_change":"2024-04-25T15:45:48.015600+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015600+0000","last_undegraded":"2024-04-25T15:45:48.015600+0000","last_fullsized":"2024-04-25T15:45:48.015600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028438+0000","last_change":"2024-04-25T15:45:48.028438+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028438+0000","last_undegraded":"2024-04-25T15:45:48.028438+0000","last_fullsized":"2024-04-25T15:45:48.028438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022300+0000","last_change":"2024-04-25T15:45:49.022300+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022300+0000","last_undegraded":"2024-04-25T15:45:49.022300+0000","last_fullsized":"2024-04-25T15:45:49.022300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028853+0000","last_change":"2024-04-25T15:45:48.028853+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028853+0000","last_undegraded":"2024-04-25T15:45:48.028853+0000","last_fullsized":"2024-04-25T15:45:48.028853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025139+0000","last_change":"2024-04-25T15:45:49.025139+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025139+0000","last_undegraded":"2024-04-25T15:45:49.025139+0000","last_fullsized":"2024-04-25T15:45:49.025139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029074+0000","last_change":"2024-04-25T15:45:49.029074+0000","last_active":"2024-04-25T15:45:49.029074+0000","last_peered":"2024-04-25T15:45:49.029074+0000","last_clean":"2024-04-25T15:45:49.029074+0000","last_became_active":"2024-04-25T15:45:49.028755+0000","last_became_peered":"2024-04-25T15:45:49.028755+0000","last_unstale":"2024-04-25T15:45:49.029074+0000","last_undegraded":"2024-04-25T15:45:49.029074+0000","last_fullsized":"2024-04-25T15:45:49.029074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:52.521122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022077+0000","last_change":"2024-04-25T15:45:49.022077+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022077+0000","last_undegraded":"2024-04-25T15:45:49.022077+0000","last_fullsized":"2024-04-25T15:45:49.022077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016251+0000","last_change":"2024-04-25T15:45:48.016251+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016251+0000","last_undegraded":"2024-04-25T15:45:48.016251+0000","last_fullsized":"2024-04-25T15:45:48.016251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023201+0000","last_change":"2024-04-25T15:45:49.023201+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023201+0000","last_undegraded":"2024-04-25T15:45:49.023201+0000","last_fullsized":"2024-04-25T15:45:49.023201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028512+0000","last_change":"2024-04-25T15:45:49.028512+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028512+0000","last_undegraded":"2024-04-25T15:45:49.028512+0000","last_fullsized":"2024-04-25T15:45:49.028512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.034922+0000","last_change":"2024-04-25T15:45:49.034922+0000","last_active":"2024-04-25T15:45:49.034922+0000","last_peered":"2024-04-25T15:45:49.034922+0000","last_clean":"2024-04-25T15:45:49.034922+0000","last_became_active":"2024-04-25T15:45:49.034583+0000","last_became_peered":"2024-04-25T15:45:49.034583+0000","last_unstale":"2024-04-25T15:45:49.034922+0000","last_undegraded":"2024-04-25T15:45:49.034922+0000","last_fullsized":"2024-04-25T15:45:49.034922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:36.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022440+0000","last_change":"2024-04-25T15:45:49.022440+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022440+0000","last_undegraded":"2024-04-25T15:45:49.022440+0000","last_fullsized":"2024-04-25T15:45:49.022440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016724+0000","last_change":"2024-04-25T15:45:48.016724+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016724+0000","last_undegraded":"2024-04-25T15:45:48.016724+0000","last_fullsized":"2024-04-25T15:45:48.016724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.026259+0000","last_change":"2024-04-25T15:45:49.026259+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.026259+0000","last_undegraded":"2024-04-25T15:45:49.026259+0000","last_fullsized":"2024-04-25T15:45:49.026259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015647+0000","last_change":"2024-04-25T15:45:48.015647+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015647+0000","last_undegraded":"2024-04-25T15:45:48.015647+0000","last_fullsized":"2024-04-25T15:45:48.015647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022012+0000","last_change":"2024-04-25T15:45:49.022012+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022012+0000","last_undegraded":"2024-04-25T15:45:49.022012+0000","last_fullsized":"2024-04-25T15:45:49.022012+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022749+0000","last_change":"2024-04-25T15:45:49.022749+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022749+0000","last_undegraded":"2024-04-25T15:45:49.022749+0000","last_fullsized":"2024-04-25T15:45:49.022749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.027913+0000","last_change":"2024-04-25T15:45:48.027913+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.027913+0000","last_undegraded":"2024-04-25T15:45:48.027913+0000","last_fullsized":"2024-04-25T15:45:48.027913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017398+0000","last_change":"2024-04-25T15:45:48.017398+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017398+0000","last_undegraded":"2024-04-25T15:45:48.017398+0000","last_fullsized":"2024-04-25T15:45:48.017398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022792+0000","last_change":"2024-04-25T15:45:49.022792+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022792+0000","last_undegraded":"2024-04-25T15:45:49.022792+0000","last_fullsized":"2024-04-25T15:45:49.022792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.036903+0000","last_change":"2024-04-25T15:45:49.035131+0000","last_active":"2024-04-25T15:45:49.036903+0000","last_peered":"2024-04-25T15:45:49.036903+0000","last_clean":"2024-04-25T15:45:49.036903+0000","last_became_active":"2024-04-25T15:45:49.034817+0000","last_became_peered":"2024-04-25T15:45:49.034817+0000","last_unstale":"2024-04-25T15:45:49.036903+0000","last_undegraded":"2024-04-25T15:45:49.036903+0000","last_fullsized":"2024-04-25T15:45:49.036903+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:08.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017915+0000","last_change":"2024-04-25T15:45:48.017915+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017915+0000","last_undegraded":"2024-04-25T15:45:48.017915+0000","last_fullsized":"2024-04-25T15:45:48.017915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.038316+0000","last_change":"2024-04-25T15:45:49.027721+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.038316+0000","last_undegraded":"2024-04-25T15:45:49.038316+0000","last_fullsized":"2024-04-25T15:45:49.038316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015713+0000","last_change":"2024-04-25T15:45:48.015713+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015713+0000","last_undegraded":"2024-04-25T15:45:48.015713+0000","last_fullsized":"2024-04-25T15:45:48.015713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030741+0000","last_change":"2024-04-25T15:45:49.030741+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030741+0000","last_undegraded":"2024-04-25T15:45:49.030741+0000","last_fullsized":"2024-04-25T15:45:49.030741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023487+0000","last_change":"2024-04-25T15:45:48.039764+0000","last_active":"2024-04-25T15:45:49.023487+0000","last_peered":"2024-04-25T15:45:49.023487+0000","last_clean":"2024-04-25T15:45:49.023487+0000","last_became_active":"2024-04-25T15:45:48.039397+0000","last_became_peered":"2024-04-25T15:45:48.039397+0000","last_unstale":"2024-04-25T15:45:49.023487+0000","last_undegraded":"2024-04-25T15:45:49.023487+0000","last_fullsized":"2024-04-25T15:45:49.023487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:19.962659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035334+0000","last_change":"2024-04-25T15:45:49.031788+0000","last_active":"2024-04-25T15:45:49.035334+0000","last_peered":"2024-04-25T15:45:49.035334+0000","last_clean":"2024-04-25T15:45:49.035334+0000","last_became_active":"2024-04-25T15:45:49.031493+0000","last_became_peered":"2024-04-25T15:45:49.031493+0000","last_unstale":"2024-04-25T15:45:49.035334+0000","last_undegraded":"2024-04-25T15:45:49.035334+0000","last_fullsized":"2024-04-25T15:45:49.035334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:01.670130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031654+0000","last_change":"2024-04-25T15:45:48.027890+0000","last_active":"2024-04-25T15:45:48.031654+0000","last_peered":"2024-04-25T15:45:48.031654+0000","last_clean":"2024-04-25T15:45:48.031654+0000","last_became_active":"2024-04-25T15:45:48.026687+0000","last_became_peered":"2024-04-25T15:45:48.026687+0000","last_unstale":"2024-04-25T15:45:48.031654+0000","last_undegraded":"2024-04-25T15:45:48.031654+0000","last_fullsized":"2024-04-25T15:45:48.031654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.311840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018421+0000","last_change":"2024-04-25T15:45:48.018421+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018421+0000","last_undegraded":"2024-04-25T15:45:48.018421+0000","last_fullsized":"2024-04-25T15:45:48.018421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.037025+0000","last_change":"2024-04-25T15:45:48.035315+0000","last_active":"2024-04-25T15:45:48.037025+0000","last_peered":"2024-04-25T15:45:48.037025+0000","last_clean":"2024-04-25T15:45:48.037025+0000","last_became_active":"2024-04-25T15:45:48.034967+0000","last_became_peered":"2024-04-25T15:45:48.034967+0000","last_unstale":"2024-04-25T15:45:48.037025+0000","last_undegraded":"2024-04-25T15:45:48.037025+0000","last_fullsized":"2024-04-25T15:45:48.037025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:00.668039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016159+0000","last_change":"2024-04-25T15:45:48.016159+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016159+0000","last_undegraded":"2024-04-25T15:45:48.016159+0000","last_fullsized":"2024-04-25T15:45:48.016159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041363+0000","last_change":"2024-04-25T15:45:48.034036+0000","last_active":"2024-04-25T15:45:49.041363+0000","last_peered":"2024-04-25T15:45:49.041363+0000","last_clean":"2024-04-25T15:45:49.041363+0000","last_became_active":"2024-04-25T15:45:48.033687+0000","last_became_peered":"2024-04-25T15:45:48.033687+0000","last_unstale":"2024-04-25T15:45:49.041363+0000","last_undegraded":"2024-04-25T15:45:49.041363+0000","last_fullsized":"2024-04-25T15:45:49.041363+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:15.263609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022992+0000","last_change":"2024-04-25T15:45:49.022992+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022992+0000","last_undegraded":"2024-04-25T15:45:49.022992+0000","last_fullsized":"2024-04-25T15:45:49.022992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035079+0000","last_change":"2024-04-25T15:45:48.033192+0000","last_active":"2024-04-25T15:45:48.035079+0000","last_peered":"2024-04-25T15:45:48.035079+0000","last_clean":"2024-04-25T15:45:48.035079+0000","last_became_active":"2024-04-25T15:45:48.032675+0000","last_became_peered":"2024-04-25T15:45:48.032675+0000","last_unstale":"2024-04-25T15:45:48.035079+0000","last_undegraded":"2024-04-25T15:45:48.035079+0000","last_fullsized":"2024-04-25T15:45:48.035079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:29.955933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022681+0000","last_change":"2024-04-25T15:45:49.022681+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022681+0000","last_undegraded":"2024-04-25T15:45:49.022681+0000","last_fullsized":"2024-04-25T15:45:49.022681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.040085+0000","last_change":"2024-04-25T15:45:48.039562+0000","last_active":"2024-04-25T15:45:48.040085+0000","last_peered":"2024-04-25T15:45:48.040085+0000","last_clean":"2024-04-25T15:45:48.040085+0000","last_became_active":"2024-04-25T15:45:48.039300+0000","last_became_peered":"2024-04-25T15:45:48.039300+0000","last_unstale":"2024-04-25T15:45:48.040085+0000","last_undegraded":"2024-04-25T15:45:48.040085+0000","last_fullsized":"2024-04-25T15:45:48.040085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015499+0000","last_change":"2024-04-25T15:45:48.015499+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015499+0000","last_undegraded":"2024-04-25T15:45:48.015499+0000","last_fullsized":"2024-04-25T15:45:48.015499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022955+0000","last_change":"2024-04-25T15:45:48.035584+0000","last_active":"2024-04-25T15:45:49.022955+0000","last_peered":"2024-04-25T15:45:49.022955+0000","last_clean":"2024-04-25T15:45:49.022955+0000","last_became_active":"2024-04-25T15:45:48.034409+0000","last_became_peered":"2024-04-25T15:45:48.034409+0000","last_unstale":"2024-04-25T15:45:49.022955+0000","last_undegraded":"2024-04-25T15:45:49.022955+0000","last_fullsized":"2024-04-25T15:45:49.022955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019645+0000","last_change":"2024-04-25T15:45:49.019645+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019645+0000","last_undegraded":"2024-04-25T15:45:49.019645+0000","last_fullsized":"2024-04-25T15:45:49.019645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024427+0000","last_change":"2024-04-25T15:45:48.031484+0000","last_active":"2024-04-25T15:45:49.024427+0000","last_peered":"2024-04-25T15:45:49.024427+0000","last_clean":"2024-04-25T15:45:49.024427+0000","last_became_active":"2024-04-25T15:45:48.031166+0000","last_became_peered":"2024-04-25T15:45:48.031166+0000","last_unstale":"2024-04-25T15:45:49.024427+0000","last_undegraded":"2024-04-25T15:45:49.024427+0000","last_fullsized":"2024-04-25T15:45:49.024427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:59.353521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022274+0000","last_change":"2024-04-25T15:45:49.022274+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022274+0000","last_undegraded":"2024-04-25T15:45:49.022274+0000","last_fullsized":"2024-04-25T15:45:49.022274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031663+0000","last_change":"2024-04-25T15:45:48.027388+0000","last_active":"2024-04-25T15:45:48.031663+0000","last_peered":"2024-04-25T15:45:48.031663+0000","last_clean":"2024-04-25T15:45:48.031663+0000","last_became_active":"2024-04-25T15:45:48.026972+0000","last_became_peered":"2024-04-25T15:45:48.026972+0000","last_unstale":"2024-04-25T15:45:48.031663+0000","last_undegraded":"2024-04-25T15:45:48.031663+0000","last_fullsized":"2024-04-25T15:45:48.031663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.026459+0000","last_change":"2024-04-25T15:45:48.026459+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.026459+0000","last_undegraded":"2024-04-25T15:45:48.026459+0000","last_fullsized":"2024-04-25T15:45:48.026459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036696+0000","last_change":"2024-04-25T15:45:48.035924+0000","last_active":"2024-04-25T15:45:48.036696+0000","last_peered":"2024-04-25T15:45:48.036696+0000","last_clean":"2024-04-25T15:45:48.036696+0000","last_became_active":"2024-04-25T15:45:48.035502+0000","last_became_peered":"2024-04-25T15:45:48.035502+0000","last_unstale":"2024-04-25T15:45:48.036696+0000","last_undegraded":"2024-04-25T15:45:48.036696+0000","last_fullsized":"2024-04-25T15:45:48.036696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018187+0000","last_change":"2024-04-25T15:45:49.018187+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018187+0000","last_undegraded":"2024-04-25T15:45:49.018187+0000","last_fullsized":"2024-04-25T15:45:49.018187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023677+0000","last_change":"2024-04-25T15:45:48.029162+0000","last_active":"2024-04-25T15:45:49.023677+0000","last_peered":"2024-04-25T15:45:49.023677+0000","last_clean":"2024-04-25T15:45:49.023677+0000","last_became_active":"2024-04-25T15:45:48.028855+0000","last_became_peered":"2024-04-25T15:45:48.028855+0000","last_unstale":"2024-04-25T15:45:49.023677+0000","last_undegraded":"2024-04-25T15:45:49.023677+0000","last_fullsized":"2024-04-25T15:45:49.023677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:51.952928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030726+0000","last_change":"2024-04-25T15:45:49.030726+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030726+0000","last_undegraded":"2024-04-25T15:45:49.030726+0000","last_fullsized":"2024-04-25T15:45:49.030726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'5","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.020492+0000","last_change":"2024-04-25T15:45:48.025186+0000","last_active":"2024-04-25T15:45:49.020492+0000","last_peered":"2024-04-25T15:45:49.020492+0000","last_clean":"2024-04-25T15:45:49.020492+0000","last_became_active":"2024-04-25T15:45:48.024784+0000","last_became_peered":"2024-04-25T15:45:48.024784+0000","last_unstale":"2024-04-25T15:45:49.020492+0000","last_undegraded":"2024-04-25T15:45:49.020492+0000","last_fullsized":"2024-04-25T15:45:49.020492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:22.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028357+0000","last_change":"2024-04-25T15:45:48.028357+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028357+0000","last_undegraded":"2024-04-25T15:45:48.028357+0000","last_fullsized":"2024-04-25T15:45:48.028357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035546+0000","last_change":"2024-04-25T15:45:48.032275+0000","last_active":"2024-04-25T15:45:48.035546+0000","last_peered":"2024-04-25T15:45:48.035546+0000","last_clean":"2024-04-25T15:45:48.035546+0000","last_became_active":"2024-04-25T15:45:48.031954+0000","last_became_peered":"2024-04-25T15:45:48.031954+0000","last_unstale":"2024-04-25T15:45:48.035546+0000","last_undegraded":"2024-04-25T15:45:48.035546+0000","last_fullsized":"2024-04-25T15:45:48.035546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:52.683379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018834+0000","last_change":"2024-04-25T15:45:49.018834+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018834+0000","last_undegraded":"2024-04-25T15:45:49.018834+0000","last_fullsized":"2024-04-25T15:45:49.018834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036583+0000","last_change":"2024-04-25T15:45:48.034555+0000","last_active":"2024-04-25T15:45:48.036583+0000","last_peered":"2024-04-25T15:45:48.036583+0000","last_clean":"2024-04-25T15:45:48.036583+0000","last_became_active":"2024-04-25T15:45:48.034231+0000","last_became_peered":"2024-04-25T15:45:48.034231+0000","last_unstale":"2024-04-25T15:45:48.036583+0000","last_undegraded":"2024-04-25T15:45:48.036583+0000","last_fullsized":"2024-04-25T15:45:48.036583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035068+0000","last_change":"2024-04-25T15:45:49.031420+0000","last_active":"2024-04-25T15:45:49.035068+0000","last_peered":"2024-04-25T15:45:49.035068+0000","last_clean":"2024-04-25T15:45:49.035068+0000","last_became_active":"2024-04-25T15:45:49.031020+0000","last_became_peered":"2024-04-25T15:45:49.031020+0000","last_unstale":"2024-04-25T15:45:49.035068+0000","last_undegraded":"2024-04-25T15:45:49.035068+0000","last_fullsized":"2024-04-25T15:45:49.035068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:29.199964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.025629+0000","last_change":"2024-04-25T15:45:48.037474+0000","last_active":"2024-04-25T15:45:49.025629+0000","last_peered":"2024-04-25T15:45:49.025629+0000","last_clean":"2024-04-25T15:45:49.025629+0000","last_became_active":"2024-04-25T15:45:48.037137+0000","last_became_peered":"2024-04-25T15:45:48.037137+0000","last_unstale":"2024-04-25T15:45:49.025629+0000","last_undegraded":"2024-04-25T15:45:49.025629+0000","last_fullsized":"2024-04-25T15:45:49.025629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:46.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040575+0000","last_change":"2024-04-25T15:45:49.039181+0000","last_active":"2024-04-25T15:45:49.040575+0000","last_peered":"2024-04-25T15:45:49.040575+0000","last_clean":"2024-04-25T15:45:49.040575+0000","last_became_active":"2024-04-25T15:45:49.038832+0000","last_became_peered":"2024-04-25T15:45:49.038832+0000","last_unstale":"2024-04-25T15:45:49.040575+0000","last_undegraded":"2024-04-25T15:45:49.040575+0000","last_fullsized":"2024-04-25T15:45:49.040575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:44.172577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022379+0000","last_change":"2024-04-25T15:45:48.034495+0000","last_active":"2024-04-25T15:45:49.022379+0000","last_peered":"2024-04-25T15:45:49.022379+0000","last_clean":"2024-04-25T15:45:49.022379+0000","last_became_active":"2024-04-25T15:45:48.034171+0000","last_became_peered":"2024-04-25T15:45:48.034171+0000","last_unstale":"2024-04-25T15:45:49.022379+0000","last_undegraded":"2024-04-25T15:45:49.022379+0000","last_fullsized":"2024-04-25T15:45:49.022379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030626+0000","last_change":"2024-04-25T15:45:49.030626+0000","last_active":"2024-04-25T15:45:49.030626+0000","last_peered":"2024-04-25T15:45:49.030626+0000","last_clean":"2024-04-25T15:45:49.030626+0000","last_became_active":"2024-04-25T15:45:49.030305+0000","last_became_peered":"2024-04-25T15:45:49.030305+0000","last_unstale":"2024-04-25T15:45:49.030626+0000","last_undegraded":"2024-04-25T15:45:49.030626+0000","last_fullsized":"2024-04-25T15:45:49.030626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.212910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033931+0000","last_change":"2024-04-25T15:45:48.030606+0000","last_active":"2024-04-25T15:45:48.033931+0000","last_peered":"2024-04-25T15:45:48.033931+0000","last_clean":"2024-04-25T15:45:48.033931+0000","last_became_active":"2024-04-25T15:45:48.030252+0000","last_became_peered":"2024-04-25T15:45:48.030252+0000","last_unstale":"2024-04-25T15:45:48.033931+0000","last_undegraded":"2024-04-25T15:45:48.033931+0000","last_fullsized":"2024-04-25T15:45:48.033931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.020571+0000","last_change":"2024-04-25T15:45:49.020571+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.020571+0000","last_undegraded":"2024-04-25T15:45:49.020571+0000","last_fullsized":"2024-04-25T15:45:49.020571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033071+0000","last_change":"2024-04-25T15:45:48.031558+0000","last_active":"2024-04-25T15:45:48.033071+0000","last_peered":"2024-04-25T15:45:48.033071+0000","last_clean":"2024-04-25T15:45:48.033071+0000","last_became_active":"2024-04-25T15:45:48.030245+0000","last_became_peered":"2024-04-25T15:45:48.030245+0000","last_unstale":"2024-04-25T15:45:48.033071+0000","last_undegraded":"2024-04-25T15:45:48.033071+0000","last_fullsized":"2024-04-25T15:45:48.033071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:38:06.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025889+0000","last_change":"2024-04-25T15:45:49.025889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025889+0000","last_undegraded":"2024-04-25T15:45:49.025889+0000","last_fullsized":"2024-04-25T15:45:49.025889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023844+0000","last_change":"2024-04-25T15:45:48.032149+0000","last_active":"2024-04-25T15:45:49.023844+0000","last_peered":"2024-04-25T15:45:49.023844+0000","last_clean":"2024-04-25T15:45:49.023844+0000","last_became_active":"2024-04-25T15:45:48.031853+0000","last_became_peered":"2024-04-25T15:45:48.031853+0000","last_unstale":"2024-04-25T15:45:49.023844+0000","last_undegraded":"2024-04-25T15:45:49.023844+0000","last_fullsized":"2024-04-25T15:45:49.023844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:11.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030640+0000","last_change":"2024-04-25T15:45:49.030640+0000","last_active":"2024-04-25T15:45:49.030640+0000","last_peered":"2024-04-25T15:45:49.030640+0000","last_clean":"2024-04-25T15:45:49.030640+0000","last_became_active":"2024-04-25T15:45:49.030331+0000","last_became_peered":"2024-04-25T15:45:49.030331+0000","last_unstale":"2024-04-25T15:45:49.030640+0000","last_undegraded":"2024-04-25T15:45:49.030640+0000","last_fullsized":"2024-04-25T15:45:49.030640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:48.687335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030273+0000","last_change":"2024-04-25T15:45:48.033544+0000","last_active":"2024-04-25T15:45:49.030273+0000","last_peered":"2024-04-25T15:45:49.030273+0000","last_clean":"2024-04-25T15:45:49.030273+0000","last_became_active":"2024-04-25T15:45:48.033248+0000","last_became_peered":"2024-04-25T15:45:48.033248+0000","last_unstale":"2024-04-25T15:45:49.030273+0000","last_undegraded":"2024-04-25T15:45:49.030273+0000","last_fullsized":"2024-04-25T15:45:49.030273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:09.595887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037533+0000","last_change":"2024-04-25T15:45:49.033989+0000","last_active":"2024-04-25T15:45:49.037533+0000","last_peered":"2024-04-25T15:45:49.037533+0000","last_clean":"2024-04-25T15:45:49.037533+0000","last_became_active":"2024-04-25T15:45:49.033692+0000","last_became_peered":"2024-04-25T15:45:49.033692+0000","last_unstale":"2024-04-25T15:45:49.037533+0000","last_undegraded":"2024-04-25T15:45:49.037533+0000","last_fullsized":"2024-04-25T15:45:49.037533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:20.697315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017353+0000","last_change":"2024-04-25T15:45:48.026000+0000","last_active":"2024-04-25T15:45:49.017353+0000","last_peered":"2024-04-25T15:45:49.017353+0000","last_clean":"2024-04-25T15:45:49.017353+0000","last_became_active":"2024-04-25T15:45:48.025670+0000","last_became_peered":"2024-04-25T15:45:48.025670+0000","last_unstale":"2024-04-25T15:45:49.017353+0000","last_undegraded":"2024-04-25T15:45:49.017353+0000","last_fullsized":"2024-04-25T15:45:49.017353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:55.222065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024245+0000","last_change":"2024-04-25T15:45:49.024245+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024245+0000","last_undegraded":"2024-04-25T15:45:49.024245+0000","last_fullsized":"2024-04-25T15:45:49.024245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017282+0000","last_change":"2024-04-25T15:45:48.028925+0000","last_active":"2024-04-25T15:45:49.017282+0000","last_peered":"2024-04-25T15:45:49.017282+0000","last_clean":"2024-04-25T15:45:49.017282+0000","last_became_active":"2024-04-25T15:45:48.028353+0000","last_became_peered":"2024-04-25T15:45:48.028353+0000","last_unstale":"2024-04-25T15:45:49.017282+0000","last_undegraded":"2024-04-25T15:45:49.017282+0000","last_fullsized":"2024-04-25T15:45:49.017282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:28.927396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039375+0000","last_change":"2024-04-25T15:45:49.032361+0000","last_active":"2024-04-25T15:45:49.039375+0000","last_peered":"2024-04-25T15:45:49.039375+0000","last_clean":"2024-04-25T15:45:49.039375+0000","last_became_active":"2024-04-25T15:45:49.032084+0000","last_became_peered":"2024-04-25T15:45:49.032084+0000","last_unstale":"2024-04-25T15:45:49.039375+0000","last_undegraded":"2024-04-25T15:45:49.039375+0000","last_fullsized":"2024-04-25T15:45:49.039375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.993146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.016982+0000","last_change":"2024-04-25T15:45:48.027883+0000","last_active":"2024-04-25T15:45:49.016982+0000","last_peered":"2024-04-25T15:45:49.016982+0000","last_clean":"2024-04-25T15:45:49.016982+0000","last_became_active":"2024-04-25T15:45:48.027582+0000","last_became_peered":"2024-04-25T15:45:48.027582+0000","last_unstale":"2024-04-25T15:45:49.016982+0000","last_undegraded":"2024-04-25T15:45:49.016982+0000","last_fullsized":"2024-04-25T15:45:49.016982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:07.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015824+0000","last_change":"2024-04-25T15:45:48.015824+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015824+0000","last_undegraded":"2024-04-25T15:45:48.015824+0000","last_fullsized":"2024-04-25T15:45:48.015824+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036123+0000","last_change":"2024-04-25T15:45:48.035036+0000","last_active":"2024-04-25T15:45:48.036123+0000","last_peered":"2024-04-25T15:45:48.036123+0000","last_clean":"2024-04-25T15:45:48.036123+0000","last_became_active":"2024-04-25T15:45:48.034635+0000","last_became_peered":"2024-04-25T15:45:48.034635+0000","last_unstale":"2024-04-25T15:45:48.036123+0000","last_undegraded":"2024-04-25T15:45:48.036123+0000","last_fullsized":"2024-04-25T15:45:48.036123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:39.304770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039371+0000","last_change":"2024-04-25T15:45:49.031634+0000","last_active":"2024-04-25T15:45:49.039371+0000","last_peered":"2024-04-25T15:45:49.039371+0000","last_clean":"2024-04-25T15:45:49.039371+0000","last_became_active":"2024-04-25T15:45:49.030687+0000","last_became_peered":"2024-04-25T15:45:49.030687+0000","last_unstale":"2024-04-25T15:45:49.039371+0000","last_undegraded":"2024-04-25T15:45:49.039371+0000","last_fullsized":"2024-04-25T15:45:49.039371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:10.597978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024523+0000","last_change":"2024-04-25T15:45:48.040359+0000","last_active":"2024-04-25T15:45:49.024523+0000","last_peered":"2024-04-25T15:45:49.024523+0000","last_clean":"2024-04-25T15:45:49.024523+0000","last_became_active":"2024-04-25T15:45:48.040028+0000","last_became_peered":"2024-04-25T15:45:48.040028+0000","last_unstale":"2024-04-25T15:45:49.024523+0000","last_undegraded":"2024-04-25T15:45:49.024523+0000","last_fullsized":"2024-04-25T15:45:49.024523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017889+0000","last_change":"2024-04-25T15:45:48.017889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017889+0000","last_undegraded":"2024-04-25T15:45:48.017889+0000","last_fullsized":"2024-04-25T15:45:48.017889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035226+0000","last_change":"2024-04-25T15:45:48.032412+0000","last_active":"2024-04-25T15:45:48.035226+0000","last_peered":"2024-04-25T15:45:48.035226+0000","last_clean":"2024-04-25T15:45:48.035226+0000","last_became_active":"2024-04-25T15:45:48.032095+0000","last_became_peered":"2024-04-25T15:45:48.032095+0000","last_unstale":"2024-04-25T15:45:48.035226+0000","last_undegraded":"2024-04-25T15:45:48.035226+0000","last_fullsized":"2024-04-25T15:45:48.035226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037021+0000","last_change":"2024-04-25T15:45:49.037021+0000","last_active":"2024-04-25T15:45:49.037021+0000","last_peered":"2024-04-25T15:45:49.037021+0000","last_clean":"2024-04-25T15:45:49.037021+0000","last_became_active":"2024-04-25T15:45:49.036709+0000","last_became_peered":"2024-04-25T15:45:49.036709+0000","last_unstale":"2024-04-25T15:45:49.037021+0000","last_undegraded":"2024-04-25T15:45:49.037021+0000","last_fullsized":"2024-04-25T15:45:49.037021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:29.929487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031635+0000","last_change":"2024-04-25T15:45:48.026477+0000","last_active":"2024-04-25T15:45:48.031635+0000","last_peered":"2024-04-25T15:45:48.031635+0000","last_clean":"2024-04-25T15:45:48.031635+0000","last_became_active":"2024-04-25T15:45:48.026123+0000","last_became_peered":"2024-04-25T15:45:48.026123+0000","last_unstale":"2024-04-25T15:45:48.031635+0000","last_undegraded":"2024-04-25T15:45:48.031635+0000","last_fullsized":"2024-04-25T15:45:48.031635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041247+0000","last_change":"2024-04-25T15:45:49.041247+0000","last_active":"2024-04-25T15:45:49.041247+0000","last_peered":"2024-04-25T15:45:49.041247+0000","last_clean":"2024-04-25T15:45:49.041247+0000","last_became_active":"2024-04-25T15:45:49.040773+0000","last_became_peered":"2024-04-25T15:45:49.040773+0000","last_unstale":"2024-04-25T15:45:49.041247+0000","last_undegraded":"2024-04-25T15:45:49.041247+0000","last_fullsized":"2024-04-25T15:45:49.041247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:45.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019955+0000","last_change":"2024-04-25T15:45:48.032005+0000","last_active":"2024-04-25T15:45:49.019955+0000","last_peered":"2024-04-25T15:45:49.019955+0000","last_clean":"2024-04-25T15:45:49.019955+0000","last_became_active":"2024-04-25T15:45:48.031690+0000","last_became_peered":"2024-04-25T15:45:48.031690+0000","last_unstale":"2024-04-25T15:45:49.019955+0000","last_undegraded":"2024-04-25T15:45:49.019955+0000","last_fullsized":"2024-04-25T15:45:49.019955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:03.901419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040490+0000","last_change":"2024-04-25T15:45:49.035767+0000","last_active":"2024-04-25T15:45:49.040490+0000","last_peered":"2024-04-25T15:45:49.040490+0000","last_clean":"2024-04-25T15:45:49.040490+0000","last_became_active":"2024-04-25T15:45:49.035455+0000","last_became_peered":"2024-04-25T15:45:49.035455+0000","last_unstale":"2024-04-25T15:45:49.040490+0000","last_undegraded":"2024-04-25T15:45:49.040490+0000","last_fullsized":"2024-04-25T15:45:49.040490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:40.412201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.026369+0000","last_change":"2024-04-25T15:45:48.039813+0000","last_active":"2024-04-25T15:45:49.026369+0000","last_peered":"2024-04-25T15:45:49.026369+0000","last_clean":"2024-04-25T15:45:49.026369+0000","last_became_active":"2024-04-25T15:45:48.039488+0000","last_became_peered":"2024-04-25T15:45:48.039488+0000","last_unstale":"2024-04-25T15:45:49.026369+0000","last_undegraded":"2024-04-25T15:45:49.026369+0000","last_fullsized":"2024-04-25T15:45:49.026369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:11.300706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028334+0000","last_change":"2024-04-25T15:45:49.028334+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028334+0000","last_undegraded":"2024-04-25T15:45:49.028334+0000","last_fullsized":"2024-04-25T15:45:49.028334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019744+0000","last_change":"2024-04-25T15:45:48.025876+0000","last_active":"2024-04-25T15:45:49.019744+0000","last_peered":"2024-04-25T15:45:49.019744+0000","last_clean":"2024-04-25T15:45:49.019744+0000","last_became_active":"2024-04-25T15:45:48.025572+0000","last_became_peered":"2024-04-25T15:45:48.025572+0000","last_unstale":"2024-04-25T15:45:49.019744+0000","last_undegraded":"2024-04-25T15:45:49.019744+0000","last_fullsized":"2024-04-25T15:45:49.019744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.253552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.037634+0000","last_change":"2024-04-25T15:45:49.031169+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.037634+0000","last_undegraded":"2024-04-25T15:45:49.037634+0000","last_fullsized":"2024-04-25T15:45:49.037634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.031053+0000","last_change":"2024-04-25T15:45:48.027979+0000","last_active":"2024-04-25T15:45:49.031053+0000","last_peered":"2024-04-25T15:45:49.031053+0000","last_clean":"2024-04-25T15:45:49.031053+0000","last_became_active":"2024-04-25T15:45:48.027663+0000","last_became_peered":"2024-04-25T15:45:48.027663+0000","last_unstale":"2024-04-25T15:45:49.031053+0000","last_undegraded":"2024-04-25T15:45:49.031053+0000","last_fullsized":"2024-04-25T15:45:49.031053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:29.991055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016887+0000","last_change":"2024-04-25T15:45:48.016887+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016887+0000","last_undegraded":"2024-04-25T15:45:48.016887+0000","last_fullsized":"2024-04-25T15:45:48.016887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.018488+0000","last_change":"2024-04-25T15:45:48.027167+0000","last_active":"2024-04-25T15:45:49.018488+0000","last_peered":"2024-04-25T15:45:49.018488+0000","last_clean":"2024-04-25T15:45:49.018488+0000","last_became_active":"2024-04-25T15:45:48.026855+0000","last_became_peered":"2024-04-25T15:45:48.026855+0000","last_unstale":"2024-04-25T15:45:49.018488+0000","last_undegraded":"2024-04-25T15:45:49.018488+0000","last_fullsized":"2024-04-25T15:45:49.018488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:48.804981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":213,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.016506+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:48.016506+0000","last_peered":"2024-04-25T15:45:48.016506+0000","last_clean":"2024-04-25T15:45:48.016506+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:48.016506+0000","last_undegraded":"2024-04-25T15:45:48.016506+0000","last_fullsized":"2024-04-25T15:45:48.016506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343376,"statfs":{"total":96636764160,"available":96607617024,"internally_reserved":0,"allocated":1470464,"data_stored":983750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":977083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:52.039 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:52.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.183+0000 7f418571c640 1 Processor -- start 2024-04-25T15:45:52.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.183+0000 7f418571c640 1 -- start start 2024-04-25T15:45:52.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f418571c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4180071950 0x7f4180072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f418571c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41800d2a90 0x7f41800d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f418571c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41800d33e0 con 0x7f4180161c80 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f418571c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4180072aa0 con 0x7f4180071950 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f418571c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41801624d0 con 0x7f41800d2a90 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f417effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4180071950 0x7f4180072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f4177fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4180161c80 0x7f41800b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52608/0 (socket says 172.21.15.80:52608) 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f4177fff640 1 -- 172.21.15.80:0/3204322623 learned_addr learned my addr 172.21.15.80:0/3204322623 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.184+0000 7f417effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4180071950 0x7f4180072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49624/0 (socket says 172.21.15.80:49624) 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417effd640 1 -- 172.21.15.80:0/3204322623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41800d2a90 msgr2=0x7f41800d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417effd640 1 --2- 172.21.15.80:0/3204322623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41800d2a90 0x7f41800d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417effd640 1 -- 172.21.15.80:0/3204322623 >> v1:172.21.15.80:6789/0 conn(0x7f4180161c80 legacy=0x7f41800b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417effd640 1 -- 172.21.15.80:0/3204322623 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41801627b0 con 0x7f4180071950 2024-04-25T15:45:52.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417e7fc640 1 -- 172.21.15.80:0/3204322623 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870047107 0 0) 0x7f4168001290 con 0x7f4180161c80 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417effd640 1 --2- 172.21.15.80:0/3204322623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4180071950 0x7f4180072560 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f41700097a0 tx=0x7f417002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600a526a8b29fd0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417e7fc640 1 -- 172.21.15.80:0/3204322623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170037070 con 0x7f4180071950 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417e7fc640 1 -- 172.21.15.80:0/3204322623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417002ae50 con 0x7f4180071950 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.185+0000 7f417e7fc640 1 -- 172.21.15.80:0/3204322623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170032660 con 0x7f4180071950 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 -- 172.21.15.80:0/3204322623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4180071950 msgr2=0x7f4180072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 --2- 172.21.15.80:0/3204322623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4180071950 0x7f4180072560 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f41700097a0 tx=0x7f417002a100 comp rx=0 tx=0).stop 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 -- 172.21.15.80:0/3204322623 shutdown_connections 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 --2- 172.21.15.80:0/3204322623 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41800d2a90 0x7f41800d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 --2- 172.21.15.80:0/3204322623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4180071950 0x7f4180072560 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 -- 172.21.15.80:0/3204322623 >> 172.21.15.80:0/3204322623 conn(0x7f41800d3ea0 msgr2=0x7f41800d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 -- 172.21.15.80:0/3204322623 shutdown_connections 2024-04-25T15:45:52.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.186+0000 7f418571c640 1 -- 172.21.15.80:0/3204322623 wait complete. 2024-04-25T15:45:52.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.188+0000 7f418571c640 1 Processor -- start 2024-04-25T15:45:52.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.188+0000 7f418571c640 1 -- start start 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f418571c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4180071950 0x7f41800af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f418571c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 0x7f41801fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f418571c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180161c80 0x7f4180160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f418571c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41800b7690 con 0x7f41800d2a90 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f418571c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f41800d2290 con 0x7f4180161c80 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f418571c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41800b7810 con 0x7f4180071950 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f4177fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 0x7f41801fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f4177fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 0x7f41801fa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49638/0 (socket says 172.21.15.80:49638) 2024-04-25T15:45:52.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.189+0000 7f4177fff640 1 -- 172.21.15.80:0/1377647813 learned_addr learned my addr 172.21.15.80:0/1377647813 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f417effd640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4180071950 0x7f41800af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f417f7fe640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180161c80 0x7f4180160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f4177fff640 1 -- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4180071950 msgr2=0x7f41800af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f4177fff640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4180071950 0x7f41800af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f4177fff640 1 -- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180161c80 msgr2=0x7f4180160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f4177fff640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180161c80 0x7f4180160d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f4177fff640 1 -- 172.21.15.80:0/1377647813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41801fadf0 con 0x7f41800d2a90 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f417effd640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4180071950 0x7f41800af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f4177fff640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 0x7f41801fa8b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4168001eb0 tx=0x7f416800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168017070 con 0x7f41800d2a90 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41680074e0 con 0x7f41800d2a90 2024-04-25T15:45:52.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41801612a0 con 0x7f41800d2a90 2024-04-25T15:45:52.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680059e0 con 0x7f41800d2a90 2024-04-25T15:45:52.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.190+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41800b17b0 con 0x7f41800d2a90 2024-04-25T15:45:52.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.191+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41800af830 con 0x7f41800d2a90 2024-04-25T15:45:52.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.192+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f416801a070 con 0x7f41800d2a90 2024-04-25T15:45:52.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.192+0000 7f41777fe640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f41600744e0 0x7f41600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.192+0000 7f417effd640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f41600744e0 0x7f41600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.192+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f41680946f0 con 0x7f41800d2a90 2024-04-25T15:45:52.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.193+0000 7f417effd640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f41600744e0 0x7f41600769f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4170034000 tx=0x7f417002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.197+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41800d33e0 con 0x7f41800d2a90 2024-04-25T15:45:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.370+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f418006a100 con 0x7f41600744e0 2024-04-25T15:45:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.376+0000 7f41777fe640 1 -- 172.21.15.80:0/1377647813 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248282 (secure 0 0 0) 0x7f418006a100 con 0x7f41600744e0 2024-04-25T15:45:52.379 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:52.380 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f41600744e0 msgr2=0x7f41600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f41600744e0 0x7f41600769f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4170034000 tx=0x7f417002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 msgr2=0x7f41801fa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 0x7f41801fa8b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4168001eb0 tx=0x7f416800c890 comp rx=0 tx=0).stop 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 shutdown_connections 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f41600744e0 0x7f41600769f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180161c80 0x7f4180160d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41800d2a90 0x7f41801fa8b0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 --2- 172.21.15.80:0/1377647813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4180071950 0x7f41800af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 >> 172.21.15.80:0/1377647813 conn(0x7f41800d3ea0 msgr2=0x7f41800c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 shutdown_connections 2024-04-25T15:45:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.379+0000 7f418571c640 1 -- 172.21.15.80:0/1377647813 wait complete. 2024-04-25T15:45:52.390 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-25T15:45:51.032572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240800,"kb_used_data":7972,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733920,"statfs":{"total":773094113280,"available":772847534080,"internally_reserved":0,"allocated":8163328,"data_stored":4307791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.025812"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018731+0000","last_change":"2024-04-25T15:45:48.018731+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018731+0000","last_undegraded":"2024-04-25T15:45:48.018731+0000","last_fullsized":"2024-04-25T15:45:48.018731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023863+0000","last_change":"2024-04-25T15:45:49.023863+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023863+0000","last_undegraded":"2024-04-25T15:45:49.023863+0000","last_fullsized":"2024-04-25T15:45:49.023863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028092+0000","last_change":"2024-04-25T15:45:49.028092+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028092+0000","last_undegraded":"2024-04-25T15:45:49.028092+0000","last_fullsized":"2024-04-25T15:45:49.028092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.029372+0000","last_change":"2024-04-25T15:45:48.029372+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.029372+0000","last_undegraded":"2024-04-25T15:45:48.029372+0000","last_fullsized":"2024-04-25T15:45:48.029372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024738+0000","last_change":"2024-04-25T15:45:49.024738+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024738+0000","last_undegraded":"2024-04-25T15:45:49.024738+0000","last_fullsized":"2024-04-25T15:45:49.024738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029845+0000","last_change":"2024-04-25T15:45:49.029845+0000","last_active":"2024-04-25T15:45:49.029845+0000","last_peered":"2024-04-25T15:45:49.029845+0000","last_clean":"2024-04-25T15:45:49.029845+0000","last_became_active":"2024-04-25T15:45:49.029552+0000","last_became_peered":"2024-04-25T15:45:49.029552+0000","last_unstale":"2024-04-25T15:45:49.029845+0000","last_undegraded":"2024-04-25T15:45:49.029845+0000","last_fullsized":"2024-04-25T15:45:49.029845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:39.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019213+0000","last_change":"2024-04-25T15:45:49.019213+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019213+0000","last_undegraded":"2024-04-25T15:45:49.019213+0000","last_fullsized":"2024-04-25T15:45:49.019213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024119+0000","last_change":"2024-04-25T15:45:49.024119+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024119+0000","last_undegraded":"2024-04-25T15:45:49.024119+0000","last_fullsized":"2024-04-25T15:45:49.024119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015600+0000","last_change":"2024-04-25T15:45:48.015600+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015600+0000","last_undegraded":"2024-04-25T15:45:48.015600+0000","last_fullsized":"2024-04-25T15:45:48.015600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028438+0000","last_change":"2024-04-25T15:45:48.028438+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028438+0000","last_undegraded":"2024-04-25T15:45:48.028438+0000","last_fullsized":"2024-04-25T15:45:48.028438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022300+0000","last_change":"2024-04-25T15:45:49.022300+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022300+0000","last_undegraded":"2024-04-25T15:45:49.022300+0000","last_fullsized":"2024-04-25T15:45:49.022300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028853+0000","last_change":"2024-04-25T15:45:48.028853+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028853+0000","last_undegraded":"2024-04-25T15:45:48.028853+0000","last_fullsized":"2024-04-25T15:45:48.028853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025139+0000","last_change":"2024-04-25T15:45:49.025139+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025139+0000","last_undegraded":"2024-04-25T15:45:49.025139+0000","last_fullsized":"2024-04-25T15:45:49.025139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029074+0000","last_change":"2024-04-25T15:45:49.029074+0000","last_active":"2024-04-25T15:45:49.029074+0000","last_peered":"2024-04-25T15:45:49.029074+0000","last_clean":"2024-04-25T15:45:49.029074+0000","last_became_active":"2024-04-25T15:45:49.028755+0000","last_became_peered":"2024-04-25T15:45:49.028755+0000","last_unstale":"2024-04-25T15:45:49.029074+0000","last_undegraded":"2024-04-25T15:45:49.029074+0000","last_fullsized":"2024-04-25T15:45:49.029074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:52.521122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022077+0000","last_change":"2024-04-25T15:45:49.022077+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022077+0000","last_undegraded":"2024-04-25T15:45:49.022077+0000","last_fullsized":"2024-04-25T15:45:49.022077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016251+0000","last_change":"2024-04-25T15:45:48.016251+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016251+0000","last_undegraded":"2024-04-25T15:45:48.016251+0000","last_fullsized":"2024-04-25T15:45:48.016251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023201+0000","last_change":"2024-04-25T15:45:49.023201+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023201+0000","last_undegraded":"2024-04-25T15:45:49.023201+0000","last_fullsized":"2024-04-25T15:45:49.023201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028512+0000","last_change":"2024-04-25T15:45:49.028512+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028512+0000","last_undegraded":"2024-04-25T15:45:49.028512+0000","last_fullsized":"2024-04-25T15:45:49.028512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.034922+0000","last_change":"2024-04-25T15:45:49.034922+0000","last_active":"2024-04-25T15:45:49.034922+0000","last_peered":"2024-04-25T15:45:49.034922+0000","last_clean":"2024-04-25T15:45:49.034922+0000","last_became_active":"2024-04-25T15:45:49.034583+0000","last_became_peered":"2024-04-25T15:45:49.034583+0000","last_unstale":"2024-04-25T15:45:49.034922+0000","last_undegraded":"2024-04-25T15:45:49.034922+0000","last_fullsized":"2024-04-25T15:45:49.034922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:36.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022440+0000","last_change":"2024-04-25T15:45:49.022440+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022440+0000","last_undegraded":"2024-04-25T15:45:49.022440+0000","last_fullsized":"2024-04-25T15:45:49.022440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016724+0000","last_change":"2024-04-25T15:45:48.016724+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016724+0000","last_undegraded":"2024-04-25T15:45:48.016724+0000","last_fullsized":"2024-04-25T15:45:48.016724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.026259+0000","last_change":"2024-04-25T15:45:49.026259+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.026259+0000","last_undegraded":"2024-04-25T15:45:49.026259+0000","last_fullsized":"2024-04-25T15:45:49.026259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015647+0000","last_change":"2024-04-25T15:45:48.015647+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015647+0000","last_undegraded":"2024-04-25T15:45:48.015647+0000","last_fullsized":"2024-04-25T15:45:48.015647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022012+0000","last_change":"2024-04-25T15:45:49.022012+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022012+0000","last_undegraded":"2024-04-25T15:45:49.022012+0000","last_fullsized":"2024-04-25T15:45:49.022012+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022749+0000","last_change":"2024-04-25T15:45:49.022749+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022749+0000","last_undegraded":"2024-04-25T15:45:49.022749+0000","last_fullsized":"2024-04-25T15:45:49.022749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.027913+0000","last_change":"2024-04-25T15:45:48.027913+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.027913+0000","last_undegraded":"2024-04-25T15:45:48.027913+0000","last_fullsized":"2024-04-25T15:45:48.027913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017398+0000","last_change":"2024-04-25T15:45:48.017398+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017398+0000","last_undegraded":"2024-04-25T15:45:48.017398+0000","last_fullsized":"2024-04-25T15:45:48.017398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022792+0000","last_change":"2024-04-25T15:45:49.022792+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022792+0000","last_undegraded":"2024-04-25T15:45:49.022792+0000","last_fullsized":"2024-04-25T15:45:49.022792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.036903+0000","last_change":"2024-04-25T15:45:49.035131+0000","last_active":"2024-04-25T15:45:49.036903+0000","last_peered":"2024-04-25T15:45:49.036903+0000","last_clean":"2024-04-25T15:45:49.036903+0000","last_became_active":"2024-04-25T15:45:49.034817+0000","last_became_peered":"2024-04-25T15:45:49.034817+0000","last_unstale":"2024-04-25T15:45:49.036903+0000","last_undegraded":"2024-04-25T15:45:49.036903+0000","last_fullsized":"2024-04-25T15:45:49.036903+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:08.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017915+0000","last_change":"2024-04-25T15:45:48.017915+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017915+0000","last_undegraded":"2024-04-25T15:45:48.017915+0000","last_fullsized":"2024-04-25T15:45:48.017915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.038316+0000","last_change":"2024-04-25T15:45:49.027721+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.038316+0000","last_undegraded":"2024-04-25T15:45:49.038316+0000","last_fullsized":"2024-04-25T15:45:49.038316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015713+0000","last_change":"2024-04-25T15:45:48.015713+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015713+0000","last_undegraded":"2024-04-25T15:45:48.015713+0000","last_fullsized":"2024-04-25T15:45:48.015713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030741+0000","last_change":"2024-04-25T15:45:49.030741+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030741+0000","last_undegraded":"2024-04-25T15:45:49.030741+0000","last_fullsized":"2024-04-25T15:45:49.030741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023487+0000","last_change":"2024-04-25T15:45:48.039764+0000","last_active":"2024-04-25T15:45:49.023487+0000","last_peered":"2024-04-25T15:45:49.023487+0000","last_clean":"2024-04-25T15:45:49.023487+0000","last_became_active":"2024-04-25T15:45:48.039397+0000","last_became_peered":"2024-04-25T15:45:48.039397+0000","last_unstale":"2024-04-25T15:45:49.023487+0000","last_undegraded":"2024-04-25T15:45:49.023487+0000","last_fullsized":"2024-04-25T15:45:49.023487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:19.962659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035334+0000","last_change":"2024-04-25T15:45:49.031788+0000","last_active":"2024-04-25T15:45:49.035334+0000","last_peered":"2024-04-25T15:45:49.035334+0000","last_clean":"2024-04-25T15:45:49.035334+0000","last_became_active":"2024-04-25T15:45:49.031493+0000","last_became_peered":"2024-04-25T15:45:49.031493+0000","last_unstale":"2024-04-25T15:45:49.035334+0000","last_undegraded":"2024-04-25T15:45:49.035334+0000","last_fullsized":"2024-04-25T15:45:49.035334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:01.670130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031654+0000","last_change":"2024-04-25T15:45:48.027890+0000","last_active":"2024-04-25T15:45:48.031654+0000","last_peered":"2024-04-25T15:45:48.031654+0000","last_clean":"2024-04-25T15:45:48.031654+0000","last_became_active":"2024-04-25T15:45:48.026687+0000","last_became_peered":"2024-04-25T15:45:48.026687+0000","last_unstale":"2024-04-25T15:45:48.031654+0000","last_undegraded":"2024-04-25T15:45:48.031654+0000","last_fullsized":"2024-04-25T15:45:48.031654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.311840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018421+0000","last_change":"2024-04-25T15:45:48.018421+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018421+0000","last_undegraded":"2024-04-25T15:45:48.018421+0000","last_fullsized":"2024-04-25T15:45:48.018421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.037025+0000","last_change":"2024-04-25T15:45:48.035315+0000","last_active":"2024-04-25T15:45:48.037025+0000","last_peered":"2024-04-25T15:45:48.037025+0000","last_clean":"2024-04-25T15:45:48.037025+0000","last_became_active":"2024-04-25T15:45:48.034967+0000","last_became_peered":"2024-04-25T15:45:48.034967+0000","last_unstale":"2024-04-25T15:45:48.037025+0000","last_undegraded":"2024-04-25T15:45:48.037025+0000","last_fullsized":"2024-04-25T15:45:48.037025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:00.668039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016159+0000","last_change":"2024-04-25T15:45:48.016159+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016159+0000","last_undegraded":"2024-04-25T15:45:48.016159+0000","last_fullsized":"2024-04-25T15:45:48.016159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041363+0000","last_change":"2024-04-25T15:45:48.034036+0000","last_active":"2024-04-25T15:45:49.041363+0000","last_peered":"2024-04-25T15:45:49.041363+0000","last_clean":"2024-04-25T15:45:49.041363+0000","last_became_active":"2024-04-25T15:45:48.033687+0000","last_became_peered":"2024-04-25T15:45:48.033687+0000","last_unstale":"2024-04-25T15:45:49.041363+0000","last_undegraded":"2024-04-25T15:45:49.041363+0000","last_fullsized":"2024-04-25T15:45:49.041363+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:15.263609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022992+0000","last_change":"2024-04-25T15:45:49.022992+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022992+0000","last_undegraded":"2024-04-25T15:45:49.022992+0000","last_fullsized":"2024-04-25T15:45:49.022992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035079+0000","last_change":"2024-04-25T15:45:48.033192+0000","last_active":"2024-04-25T15:45:48.035079+0000","last_peered":"2024-04-25T15:45:48.035079+0000","last_clean":"2024-04-25T15:45:48.035079+0000","last_became_active":"2024-04-25T15:45:48.032675+0000","last_became_peered":"2024-04-25T15:45:48.032675+0000","last_unstale":"2024-04-25T15:45:48.035079+0000","last_undegraded":"2024-04-25T15:45:48.035079+0000","last_fullsized":"2024-04-25T15:45:48.035079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:29.955933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022681+0000","last_change":"2024-04-25T15:45:49.022681+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022681+0000","last_undegraded":"2024-04-25T15:45:49.022681+0000","last_fullsized":"2024-04-25T15:45:49.022681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.040085+0000","last_change":"2024-04-25T15:45:48.039562+0000","last_active":"2024-04-25T15:45:48.040085+0000","last_peered":"2024-04-25T15:45:48.040085+0000","last_clean":"2024-04-25T15:45:48.040085+0000","last_became_active":"2024-04-25T15:45:48.039300+0000","last_became_peered":"2024-04-25T15:45:48.039300+0000","last_unstale":"2024-04-25T15:45:48.040085+0000","last_undegraded":"2024-04-25T15:45:48.040085+0000","last_fullsized":"2024-04-25T15:45:48.040085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015499+0000","last_change":"2024-04-25T15:45:48.015499+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015499+0000","last_undegraded":"2024-04-25T15:45:48.015499+0000","last_fullsized":"2024-04-25T15:45:48.015499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022955+0000","last_change":"2024-04-25T15:45:48.035584+0000","last_active":"2024-04-25T15:45:49.022955+0000","last_peered":"2024-04-25T15:45:49.022955+0000","last_clean":"2024-04-25T15:45:49.022955+0000","last_became_active":"2024-04-25T15:45:48.034409+0000","last_became_peered":"2024-04-25T15:45:48.034409+0000","last_unstale":"2024-04-25T15:45:49.022955+0000","last_undegraded":"2024-04-25T15:45:49.022955+0000","last_fullsized":"2024-04-25T15:45:49.022955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019645+0000","last_change":"2024-04-25T15:45:49.019645+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019645+0000","last_undegraded":"2024-04-25T15:45:49.019645+0000","last_fullsized":"2024-04-25T15:45:49.019645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024427+0000","last_change":"2024-04-25T15:45:48.031484+0000","last_active":"2024-04-25T15:45:49.024427+0000","last_peered":"2024-04-25T15:45:49.024427+0000","last_clean":"2024-04-25T15:45:49.024427+0000","last_became_active":"2024-04-25T15:45:48.031166+0000","last_became_peered":"2024-04-25T15:45:48.031166+0000","last_unstale":"2024-04-25T15:45:49.024427+0000","last_undegraded":"2024-04-25T15:45:49.024427+0000","last_fullsized":"2024-04-25T15:45:49.024427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:59.353521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022274+0000","last_change":"2024-04-25T15:45:49.022274+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022274+0000","last_undegraded":"2024-04-25T15:45:49.022274+0000","last_fullsized":"2024-04-25T15:45:49.022274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031663+0000","last_change":"2024-04-25T15:45:48.027388+0000","last_active":"2024-04-25T15:45:48.031663+0000","last_peered":"2024-04-25T15:45:48.031663+0000","last_clean":"2024-04-25T15:45:48.031663+0000","last_became_active":"2024-04-25T15:45:48.026972+0000","last_became_peered":"2024-04-25T15:45:48.026972+0000","last_unstale":"2024-04-25T15:45:48.031663+0000","last_undegraded":"2024-04-25T15:45:48.031663+0000","last_fullsized":"2024-04-25T15:45:48.031663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.026459+0000","last_change":"2024-04-25T15:45:48.026459+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.026459+0000","last_undegraded":"2024-04-25T15:45:48.026459+0000","last_fullsized":"2024-04-25T15:45:48.026459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036696+0000","last_change":"2024-04-25T15:45:48.035924+0000","last_active":"2024-04-25T15:45:48.036696+0000","last_peered":"2024-04-25T15:45:48.036696+0000","last_clean":"2024-04-25T15:45:48.036696+0000","last_became_active":"2024-04-25T15:45:48.035502+0000","last_became_peered":"2024-04-25T15:45:48.035502+0000","last_unstale":"2024-04-25T15:45:48.036696+0000","last_undegraded":"2024-04-25T15:45:48.036696+0000","last_fullsized":"2024-04-25T15:45:48.036696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018187+0000","last_change":"2024-04-25T15:45:49.018187+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018187+0000","last_undegraded":"2024-04-25T15:45:49.018187+0000","last_fullsized":"2024-04-25T15:45:49.018187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023677+0000","last_change":"2024-04-25T15:45:48.029162+0000","last_active":"2024-04-25T15:45:49.023677+0000","last_peered":"2024-04-25T15:45:49.023677+0000","last_clean":"2024-04-25T15:45:49.023677+0000","last_became_active":"2024-04-25T15:45:48.028855+0000","last_became_peered":"2024-04-25T15:45:48.028855+0000","last_unstale":"2024-04-25T15:45:49.023677+0000","last_undegraded":"2024-04-25T15:45:49.023677+0000","last_fullsized":"2024-04-25T15:45:49.023677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:51.952928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030726+0000","last_change":"2024-04-25T15:45:49.030726+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030726+0000","last_undegraded":"2024-04-25T15:45:49.030726+0000","last_fullsized":"2024-04-25T15:45:49.030726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'5","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.020492+0000","last_change":"2024-04-25T15:45:48.025186+0000","last_active":"2024-04-25T15:45:49.020492+0000","last_peered":"2024-04-25T15:45:49.020492+0000","last_clean":"2024-04-25T15:45:49.020492+0000","last_became_active":"2024-04-25T15:45:48.024784+0000","last_became_peered":"2024-04-25T15:45:48.024784+0000","last_unstale":"2024-04-25T15:45:49.020492+0000","last_undegraded":"2024-04-25T15:45:49.020492+0000","last_fullsized":"2024-04-25T15:45:49.020492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:22.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028357+0000","last_change":"2024-04-25T15:45:48.028357+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028357+0000","last_undegraded":"2024-04-25T15:45:48.028357+0000","last_fullsized":"2024-04-25T15:45:48.028357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035546+0000","last_change":"2024-04-25T15:45:48.032275+0000","last_active":"2024-04-25T15:45:48.035546+0000","last_peered":"2024-04-25T15:45:48.035546+0000","last_clean":"2024-04-25T15:45:48.035546+0000","last_became_active":"2024-04-25T15:45:48.031954+0000","last_became_peered":"2024-04-25T15:45:48.031954+0000","last_unstale":"2024-04-25T15:45:48.035546+0000","last_undegraded":"2024-04-25T15:45:48.035546+0000","last_fullsized":"2024-04-25T15:45:48.035546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:52.683379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018834+0000","last_change":"2024-04-25T15:45:49.018834+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018834+0000","last_undegraded":"2024-04-25T15:45:49.018834+0000","last_fullsized":"2024-04-25T15:45:49.018834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036583+0000","last_change":"2024-04-25T15:45:48.034555+0000","last_active":"2024-04-25T15:45:48.036583+0000","last_peered":"2024-04-25T15:45:48.036583+0000","last_clean":"2024-04-25T15:45:48.036583+0000","last_became_active":"2024-04-25T15:45:48.034231+0000","last_became_peered":"2024-04-25T15:45:48.034231+0000","last_unstale":"2024-04-25T15:45:48.036583+0000","last_undegraded":"2024-04-25T15:45:48.036583+0000","last_fullsized":"2024-04-25T15:45:48.036583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035068+0000","last_change":"2024-04-25T15:45:49.031420+0000","last_active":"2024-04-25T15:45:49.035068+0000","last_peered":"2024-04-25T15:45:49.035068+0000","last_clean":"2024-04-25T15:45:49.035068+0000","last_became_active":"2024-04-25T15:45:49.031020+0000","last_became_peered":"2024-04-25T15:45:49.031020+0000","last_unstale":"2024-04-25T15:45:49.035068+0000","last_undegraded":"2024-04-25T15:45:49.035068+0000","last_fullsized":"2024-04-25T15:45:49.035068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:29.199964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.025629+0000","last_change":"2024-04-25T15:45:48.037474+0000","last_active":"2024-04-25T15:45:49.025629+0000","last_peered":"2024-04-25T15:45:49.025629+0000","last_clean":"2024-04-25T15:45:49.025629+0000","last_became_active":"2024-04-25T15:45:48.037137+0000","last_became_peered":"2024-04-25T15:45:48.037137+0000","last_unstale":"2024-04-25T15:45:49.025629+0000","last_undegraded":"2024-04-25T15:45:49.025629+0000","last_fullsized":"2024-04-25T15:45:49.025629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:46.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040575+0000","last_change":"2024-04-25T15:45:49.039181+0000","last_active":"2024-04-25T15:45:49.040575+0000","last_peered":"2024-04-25T15:45:49.040575+0000","last_clean":"2024-04-25T15:45:49.040575+0000","last_became_active":"2024-04-25T15:45:49.038832+0000","last_became_peered":"2024-04-25T15:45:49.038832+0000","last_unstale":"2024-04-25T15:45:49.040575+0000","last_undegraded":"2024-04-25T15:45:49.040575+0000","last_fullsized":"2024-04-25T15:45:49.040575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:44.172577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022379+0000","last_change":"2024-04-25T15:45:48.034495+0000","last_active":"2024-04-25T15:45:49.022379+0000","last_peered":"2024-04-25T15:45:49.022379+0000","last_clean":"2024-04-25T15:45:49.022379+0000","last_became_active":"2024-04-25T15:45:48.034171+0000","last_became_peered":"2024-04-25T15:45:48.034171+0000","last_unstale":"2024-04-25T15:45:49.022379+0000","last_undegraded":"2024-04-25T15:45:49.022379+0000","last_fullsized":"2024-04-25T15:45:49.022379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030626+0000","last_change":"2024-04-25T15:45:49.030626+0000","last_active":"2024-04-25T15:45:49.030626+0000","last_peered":"2024-04-25T15:45:49.030626+0000","last_clean":"2024-04-25T15:45:49.030626+0000","last_became_active":"2024-04-25T15:45:49.030305+0000","last_became_peered":"2024-04-25T15:45:49.030305+0000","last_unstale":"2024-04-25T15:45:49.030626+0000","last_undegraded":"2024-04-25T15:45:49.030626+0000","last_fullsized":"2024-04-25T15:45:49.030626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.212910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033931+0000","last_change":"2024-04-25T15:45:48.030606+0000","last_active":"2024-04-25T15:45:48.033931+0000","last_peered":"2024-04-25T15:45:48.033931+0000","last_clean":"2024-04-25T15:45:48.033931+0000","last_became_active":"2024-04-25T15:45:48.030252+0000","last_became_peered":"2024-04-25T15:45:48.030252+0000","last_unstale":"2024-04-25T15:45:48.033931+0000","last_undegraded":"2024-04-25T15:45:48.033931+0000","last_fullsized":"2024-04-25T15:45:48.033931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.020571+0000","last_change":"2024-04-25T15:45:49.020571+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.020571+0000","last_undegraded":"2024-04-25T15:45:49.020571+0000","last_fullsized":"2024-04-25T15:45:49.020571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033071+0000","last_change":"2024-04-25T15:45:48.031558+0000","last_active":"2024-04-25T15:45:48.033071+0000","last_peered":"2024-04-25T15:45:48.033071+0000","last_clean":"2024-04-25T15:45:48.033071+0000","last_became_active":"2024-04-25T15:45:48.030245+0000","last_became_peered":"2024-04-25T15:45:48.030245+0000","last_unstale":"2024-04-25T15:45:48.033071+0000","last_undegraded":"2024-04-25T15:45:48.033071+0000","last_fullsized":"2024-04-25T15:45:48.033071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:38:06.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025889+0000","last_change":"2024-04-25T15:45:49.025889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025889+0000","last_undegraded":"2024-04-25T15:45:49.025889+0000","last_fullsized":"2024-04-25T15:45:49.025889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023844+0000","last_change":"2024-04-25T15:45:48.032149+0000","last_active":"2024-04-25T15:45:49.023844+0000","last_peered":"2024-04-25T15:45:49.023844+0000","last_clean":"2024-04-25T15:45:49.023844+0000","last_became_active":"2024-04-25T15:45:48.031853+0000","last_became_peered":"2024-04-25T15:45:48.031853+0000","last_unstale":"2024-04-25T15:45:49.023844+0000","last_undegraded":"2024-04-25T15:45:49.023844+0000","last_fullsized":"2024-04-25T15:45:49.023844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:11.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030640+0000","last_change":"2024-04-25T15:45:49.030640+0000","last_active":"2024-04-25T15:45:49.030640+0000","last_peered":"2024-04-25T15:45:49.030640+0000","last_clean":"2024-04-25T15:45:49.030640+0000","last_became_active":"2024-04-25T15:45:49.030331+0000","last_became_peered":"2024-04-25T15:45:49.030331+0000","last_unstale":"2024-04-25T15:45:49.030640+0000","last_undegraded":"2024-04-25T15:45:49.030640+0000","last_fullsized":"2024-04-25T15:45:49.030640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:48.687335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030273+0000","last_change":"2024-04-25T15:45:48.033544+0000","last_active":"2024-04-25T15:45:49.030273+0000","last_peered":"2024-04-25T15:45:49.030273+0000","last_clean":"2024-04-25T15:45:49.030273+0000","last_became_active":"2024-04-25T15:45:48.033248+0000","last_became_peered":"2024-04-25T15:45:48.033248+0000","last_unstale":"2024-04-25T15:45:49.030273+0000","last_undegraded":"2024-04-25T15:45:49.030273+0000","last_fullsized":"2024-04-25T15:45:49.030273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:09.595887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037533+0000","last_change":"2024-04-25T15:45:49.033989+0000","last_active":"2024-04-25T15:45:49.037533+0000","last_peered":"2024-04-25T15:45:49.037533+0000","last_clean":"2024-04-25T15:45:49.037533+0000","last_became_active":"2024-04-25T15:45:49.033692+0000","last_became_peered":"2024-04-25T15:45:49.033692+0000","last_unstale":"2024-04-25T15:45:49.037533+0000","last_undegraded":"2024-04-25T15:45:49.037533+0000","last_fullsized":"2024-04-25T15:45:49.037533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:20.697315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017353+0000","last_change":"2024-04-25T15:45:48.026000+0000","last_active":"2024-04-25T15:45:49.017353+0000","last_peered":"2024-04-25T15:45:49.017353+0000","last_clean":"2024-04-25T15:45:49.017353+0000","last_became_active":"2024-04-25T15:45:48.025670+0000","last_became_peered":"2024-04-25T15:45:48.025670+0000","last_unstale":"2024-04-25T15:45:49.017353+0000","last_undegraded":"2024-04-25T15:45:49.017353+0000","last_fullsized":"2024-04-25T15:45:49.017353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:55.222065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024245+0000","last_change":"2024-04-25T15:45:49.024245+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024245+0000","last_undegraded":"2024-04-25T15:45:49.024245+0000","last_fullsized":"2024-04-25T15:45:49.024245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017282+0000","last_change":"2024-04-25T15:45:48.028925+0000","last_active":"2024-04-25T15:45:49.017282+0000","last_peered":"2024-04-25T15:45:49.017282+0000","last_clean":"2024-04-25T15:45:49.017282+0000","last_became_active":"2024-04-25T15:45:48.028353+0000","last_became_peered":"2024-04-25T15:45:48.028353+0000","last_unstale":"2024-04-25T15:45:49.017282+0000","last_undegraded":"2024-04-25T15:45:49.017282+0000","last_fullsized":"2024-04-25T15:45:49.017282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:28.927396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039375+0000","last_change":"2024-04-25T15:45:49.032361+0000","last_active":"2024-04-25T15:45:49.039375+0000","last_peered":"2024-04-25T15:45:49.039375+0000","last_clean":"2024-04-25T15:45:49.039375+0000","last_became_active":"2024-04-25T15:45:49.032084+0000","last_became_peered":"2024-04-25T15:45:49.032084+0000","last_unstale":"2024-04-25T15:45:49.039375+0000","last_undegraded":"2024-04-25T15:45:49.039375+0000","last_fullsized":"2024-04-25T15:45:49.039375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.993146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.016982+0000","last_change":"2024-04-25T15:45:48.027883+0000","last_active":"2024-04-25T15:45:49.016982+0000","last_peered":"2024-04-25T15:45:49.016982+0000","last_clean":"2024-04-25T15:45:49.016982+0000","last_became_active":"2024-04-25T15:45:48.027582+0000","last_became_peered":"2024-04-25T15:45:48.027582+0000","last_unstale":"2024-04-25T15:45:49.016982+0000","last_undegraded":"2024-04-25T15:45:49.016982+0000","last_fullsized":"2024-04-25T15:45:49.016982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:07.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015824+0000","last_change":"2024-04-25T15:45:48.015824+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015824+0000","last_undegraded":"2024-04-25T15:45:48.015824+0000","last_fullsized":"2024-04-25T15:45:48.015824+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036123+0000","last_change":"2024-04-25T15:45:48.035036+0000","last_active":"2024-04-25T15:45:48.036123+0000","last_peered":"2024-04-25T15:45:48.036123+0000","last_clean":"2024-04-25T15:45:48.036123+0000","last_became_active":"2024-04-25T15:45:48.034635+0000","last_became_peered":"2024-04-25T15:45:48.034635+0000","last_unstale":"2024-04-25T15:45:48.036123+0000","last_undegraded":"2024-04-25T15:45:48.036123+0000","last_fullsized":"2024-04-25T15:45:48.036123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:39.304770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039371+0000","last_change":"2024-04-25T15:45:49.031634+0000","last_active":"2024-04-25T15:45:49.039371+0000","last_peered":"2024-04-25T15:45:49.039371+0000","last_clean":"2024-04-25T15:45:49.039371+0000","last_became_active":"2024-04-25T15:45:49.030687+0000","last_became_peered":"2024-04-25T15:45:49.030687+0000","last_unstale":"2024-04-25T15:45:49.039371+0000","last_undegraded":"2024-04-25T15:45:49.039371+0000","last_fullsized":"2024-04-25T15:45:49.039371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:10.597978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024523+0000","last_change":"2024-04-25T15:45:48.040359+0000","last_active":"2024-04-25T15:45:49.024523+0000","last_peered":"2024-04-25T15:45:49.024523+0000","last_clean":"2024-04-25T15:45:49.024523+0000","last_became_active":"2024-04-25T15:45:48.040028+0000","last_became_peered":"2024-04-25T15:45:48.040028+0000","last_unstale":"2024-04-25T15:45:49.024523+0000","last_undegraded":"2024-04-25T15:45:49.024523+0000","last_fullsized":"2024-04-25T15:45:49.024523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017889+0000","last_change":"2024-04-25T15:45:48.017889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017889+0000","last_undegraded":"2024-04-25T15:45:48.017889+0000","last_fullsized":"2024-04-25T15:45:48.017889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035226+0000","last_change":"2024-04-25T15:45:48.032412+0000","last_active":"2024-04-25T15:45:48.035226+0000","last_peered":"2024-04-25T15:45:48.035226+0000","last_clean":"2024-04-25T15:45:48.035226+0000","last_became_active":"2024-04-25T15:45:48.032095+0000","last_became_peered":"2024-04-25T15:45:48.032095+0000","last_unstale":"2024-04-25T15:45:48.035226+0000","last_undegraded":"2024-04-25T15:45:48.035226+0000","last_fullsized":"2024-04-25T15:45:48.035226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037021+0000","last_change":"2024-04-25T15:45:49.037021+0000","last_active":"2024-04-25T15:45:49.037021+0000","last_peered":"2024-04-25T15:45:49.037021+0000","last_clean":"2024-04-25T15:45:49.037021+0000","last_became_active":"2024-04-25T15:45:49.036709+0000","last_became_peered":"2024-04-25T15:45:49.036709+0000","last_unstale":"2024-04-25T15:45:49.037021+0000","last_undegraded":"2024-04-25T15:45:49.037021+0000","last_fullsized":"2024-04-25T15:45:49.037021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:29.929487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031635+0000","last_change":"2024-04-25T15:45:48.026477+0000","last_active":"2024-04-25T15:45:48.031635+0000","last_peered":"2024-04-25T15:45:48.031635+0000","last_clean":"2024-04-25T15:45:48.031635+0000","last_became_active":"2024-04-25T15:45:48.026123+0000","last_became_peered":"2024-04-25T15:45:48.026123+0000","last_unstale":"2024-04-25T15:45:48.031635+0000","last_undegraded":"2024-04-25T15:45:48.031635+0000","last_fullsized":"2024-04-25T15:45:48.031635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041247+0000","last_change":"2024-04-25T15:45:49.041247+0000","last_active":"2024-04-25T15:45:49.041247+0000","last_peered":"2024-04-25T15:45:49.041247+0000","last_clean":"2024-04-25T15:45:49.041247+0000","last_became_active":"2024-04-25T15:45:49.040773+0000","last_became_peered":"2024-04-25T15:45:49.040773+0000","last_unstale":"2024-04-25T15:45:49.041247+0000","last_undegraded":"2024-04-25T15:45:49.041247+0000","last_fullsized":"2024-04-25T15:45:49.041247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:45.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019955+0000","last_change":"2024-04-25T15:45:48.032005+0000","last_active":"2024-04-25T15:45:49.019955+0000","last_peered":"2024-04-25T15:45:49.019955+0000","last_clean":"2024-04-25T15:45:49.019955+0000","last_became_active":"2024-04-25T15:45:48.031690+0000","last_became_peered":"2024-04-25T15:45:48.031690+0000","last_unstale":"2024-04-25T15:45:49.019955+0000","last_undegraded":"2024-04-25T15:45:49.019955+0000","last_fullsized":"2024-04-25T15:45:49.019955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:03.901419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040490+0000","last_change":"2024-04-25T15:45:49.035767+0000","last_active":"2024-04-25T15:45:49.040490+0000","last_peered":"2024-04-25T15:45:49.040490+0000","last_clean":"2024-04-25T15:45:49.040490+0000","last_became_active":"2024-04-25T15:45:49.035455+0000","last_became_peered":"2024-04-25T15:45:49.035455+0000","last_unstale":"2024-04-25T15:45:49.040490+0000","last_undegraded":"2024-04-25T15:45:49.040490+0000","last_fullsized":"2024-04-25T15:45:49.040490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:40.412201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.026369+0000","last_change":"2024-04-25T15:45:48.039813+0000","last_active":"2024-04-25T15:45:49.026369+0000","last_peered":"2024-04-25T15:45:49.026369+0000","last_clean":"2024-04-25T15:45:49.026369+0000","last_became_active":"2024-04-25T15:45:48.039488+0000","last_became_peered":"2024-04-25T15:45:48.039488+0000","last_unstale":"2024-04-25T15:45:49.026369+0000","last_undegraded":"2024-04-25T15:45:49.026369+0000","last_fullsized":"2024-04-25T15:45:49.026369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:11.300706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028334+0000","last_change":"2024-04-25T15:45:49.028334+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028334+0000","last_undegraded":"2024-04-25T15:45:49.028334+0000","last_fullsized":"2024-04-25T15:45:49.028334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019744+0000","last_change":"2024-04-25T15:45:48.025876+0000","last_active":"2024-04-25T15:45:49.019744+0000","last_peered":"2024-04-25T15:45:49.019744+0000","last_clean":"2024-04-25T15:45:49.019744+0000","last_became_active":"2024-04-25T15:45:48.025572+0000","last_became_peered":"2024-04-25T15:45:48.025572+0000","last_unstale":"2024-04-25T15:45:49.019744+0000","last_undegraded":"2024-04-25T15:45:49.019744+0000","last_fullsized":"2024-04-25T15:45:49.019744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.253552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.037634+0000","last_change":"2024-04-25T15:45:49.031169+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.037634+0000","last_undegraded":"2024-04-25T15:45:49.037634+0000","last_fullsized":"2024-04-25T15:45:49.037634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.031053+0000","last_change":"2024-04-25T15:45:48.027979+0000","last_active":"2024-04-25T15:45:49.031053+0000","last_peered":"2024-04-25T15:45:49.031053+0000","last_clean":"2024-04-25T15:45:49.031053+0000","last_became_active":"2024-04-25T15:45:48.027663+0000","last_became_peered":"2024-04-25T15:45:48.027663+0000","last_unstale":"2024-04-25T15:45:49.031053+0000","last_undegraded":"2024-04-25T15:45:49.031053+0000","last_fullsized":"2024-04-25T15:45:49.031053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:29.991055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016887+0000","last_change":"2024-04-25T15:45:48.016887+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016887+0000","last_undegraded":"2024-04-25T15:45:48.016887+0000","last_fullsized":"2024-04-25T15:45:48.016887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.018488+0000","last_change":"2024-04-25T15:45:48.027167+0000","last_active":"2024-04-25T15:45:49.018488+0000","last_peered":"2024-04-25T15:45:49.018488+0000","last_clean":"2024-04-25T15:45:49.018488+0000","last_became_active":"2024-04-25T15:45:48.026855+0000","last_became_peered":"2024-04-25T15:45:48.026855+0000","last_unstale":"2024-04-25T15:45:49.018488+0000","last_undegraded":"2024-04-25T15:45:49.018488+0000","last_fullsized":"2024-04-25T15:45:49.018488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:48.804981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":213,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.016506+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:48.016506+0000","last_peered":"2024-04-25T15:45:48.016506+0000","last_clean":"2024-04-25T15:45:48.016506+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:48.016506+0000","last_undegraded":"2024-04-25T15:45:48.016506+0000","last_fullsized":"2024-04-25T15:45:48.016506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343376,"statfs":{"total":96636764160,"available":96607617024,"internally_reserved":0,"allocated":1470464,"data_stored":983750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":977083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:52.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:52.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.538+0000 7f6d2efb2640 1 Processor -- start 2024-04-25T15:45:52.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.538+0000 7f6d2efb2640 1 -- start start 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.539+0000 7f6d2efb2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d280ce220 0x7f6d2809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2efb2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d281607c0 con 0x7f6d280cfd70 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2efb2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d280d0180 con 0x7f6d280cf960 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2efb2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6d280cf4d0 con 0x7f6d280ce220 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2cd4e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d280ce220 0x7f6d2809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2cd4e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d280ce220 0x7f6d2809bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49642/0 (socket says 172.21.15.80:49642) 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2d54f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6d280cfd70 0x7f6d280d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52624/0 (socket says 172.21.15.80:52624) 2024-04-25T15:45:52.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/3208131049 learned_addr learned my addr 172.21.15.80:0/3208131049 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/3208131049 >> v1:172.21.15.195:6789/0 conn(0x7f6d280cf960 legacy=0x7f6d280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/3208131049 >> v1:172.21.15.80:6789/0 conn(0x7f6d280cfd70 legacy=0x7f6d280d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d277fe640 1 -- 172.21.15.80:0/3208131049 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729805440 0 0) 0x7f6d281607c0 con 0x7f6d280cfd70 2024-04-25T15:45:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.540+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/3208131049 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d280ceba0 con 0x7f6d280ce220 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.541+0000 7f6d2cd4e640 1 --2- 172.21.15.80:0/3208131049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d2809bb70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009870 tx=0x7f6d1802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a0f66540a3649 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.541+0000 7f6d277fe640 1 -- 172.21.15.80:0/3208131049 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18037070 con 0x7f6d280ce220 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.541+0000 7f6d277fe640 1 -- 172.21.15.80:0/3208131049 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18032640 con 0x7f6d280ce220 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.541+0000 7f6d277fe640 1 -- 172.21.15.80:0/3208131049 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18032a10 con 0x7f6d280ce220 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.541+0000 7f6d2efb2640 1 -- 172.21.15.80:0/3208131049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 msgr2=0x7f6d2809bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.541+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/3208131049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d2809bb70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009870 tx=0x7f6d1802a330 comp rx=0 tx=0).stop 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.542+0000 7f6d2efb2640 1 -- 172.21.15.80:0/3208131049 shutdown_connections 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.542+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/3208131049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d2809bb70 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.542+0000 7f6d2efb2640 1 -- 172.21.15.80:0/3208131049 >> 172.21.15.80:0/3208131049 conn(0x7f6d280b7620 msgr2=0x7f6d280b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:52.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.542+0000 7f6d2efb2640 1 -- 172.21.15.80:0/3208131049 shutdown_connections 2024-04-25T15:45:52.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.542+0000 7f6d2efb2640 1 -- 172.21.15.80:0/3208131049 wait complete. 2024-04-25T15:45:52.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.543+0000 7f6d2efb2640 1 Processor -- start 2024-04-25T15:45:52.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.543+0000 7f6d2efb2640 1 -- start start 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2efb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d280c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2efb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d280cf960 0x7f6d2815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2efb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d280cfd70 0x7f6d281f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2efb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280cf160 con 0x7f6d280ce220 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2efb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280ce630 con 0x7f6d280cf960 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2efb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2809c0b0 con 0x7f6d280cfd70 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d280c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d280c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49648/0 (socket says 172.21.15.80:49648) 2024-04-25T15:45:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/2888495264 learned_addr learned my addr 172.21.15.80:0/2888495264 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2d54f640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d280cfd70 0x7f6d281f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d27fff640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d280cf960 0x7f6d2815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d280cfd70 msgr2=0x7f6d281f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d280cfd70 0x7f6d281f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d280cf960 msgr2=0x7f6d2815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d280cf960 0x7f6d2815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 -- 172.21.15.80:0/2888495264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2815e380 con 0x7f6d280ce220 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2d54f640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d280cfd70 0x7f6d281f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d27fff640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d280cf960 0x7f6d2815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.545+0000 7f6d2cd4e640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d280c7e40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6d18000c00 tx=0x7f6d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.546+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18041070 con 0x7f6d280ce220 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.546+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1803c870 con 0x7f6d280ce220 2024-04-25T15:45:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.546+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d280c7080 con 0x7f6d280ce220 2024-04-25T15:45:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.546+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18037040 con 0x7f6d280ce220 2024-04-25T15:45:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.546+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d280c7640 con 0x7f6d280ce220 2024-04-25T15:45:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.547+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d2806a100 con 0x7f6d280ce220 2024-04-25T15:45:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.547+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6d18044070 con 0x7f6d280ce220 2024-04-25T15:45:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.548+0000 7f6d257fa640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.548+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f6d180b5f40 con 0x7f6d280ce220 2024-04-25T15:45:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.548+0000 7f6d27fff640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.548+0000 7f6d27fff640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c006fd0 tx=0x7f6d1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.552+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d18080540 con 0x7f6d280ce220 2024-04-25T15:45:52.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.723+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d28071920 con 0x7f6d140744b0 2024-04-25T15:45:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.729+0000 7f6d257fa640 1 -- 172.21.15.80:0/2888495264 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248282 (secure 0 0 0) 0x7f6d28071920 con 0x7f6d140744b0 2024-04-25T15:45:52.732 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:52.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 msgr2=0x7f6d140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c006fd0 tx=0x7f6d1c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 msgr2=0x7f6d280c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d280c7e40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6d18000c00 tx=0x7f6d180046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 shutdown_connections 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6d140744b0 0x7f6d140769c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d280cfd70 0x7f6d281f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d280cf960 0x7f6d2815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 --2- 172.21.15.80:0/2888495264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d280ce220 0x7f6d280c7e40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 >> 172.21.15.80:0/2888495264 conn(0x7f6d280b7620 msgr2=0x7f6d280d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 shutdown_connections 2024-04-25T15:45:52.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.732+0000 7f6d2efb2640 1 -- 172.21.15.80:0/2888495264 wait complete. 2024-04-25T15:45:52.743 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-25T15:45:51.032572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240800,"kb_used_data":7972,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733920,"statfs":{"total":773094113280,"available":772847534080,"internally_reserved":0,"allocated":8163328,"data_stored":4307791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.025812"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018731+0000","last_change":"2024-04-25T15:45:48.018731+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018731+0000","last_undegraded":"2024-04-25T15:45:48.018731+0000","last_fullsized":"2024-04-25T15:45:48.018731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023863+0000","last_change":"2024-04-25T15:45:49.023863+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023863+0000","last_undegraded":"2024-04-25T15:45:49.023863+0000","last_fullsized":"2024-04-25T15:45:49.023863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028092+0000","last_change":"2024-04-25T15:45:49.028092+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028092+0000","last_undegraded":"2024-04-25T15:45:49.028092+0000","last_fullsized":"2024-04-25T15:45:49.028092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.029372+0000","last_change":"2024-04-25T15:45:48.029372+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.029372+0000","last_undegraded":"2024-04-25T15:45:48.029372+0000","last_fullsized":"2024-04-25T15:45:48.029372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024738+0000","last_change":"2024-04-25T15:45:49.024738+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024738+0000","last_undegraded":"2024-04-25T15:45:49.024738+0000","last_fullsized":"2024-04-25T15:45:49.024738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029845+0000","last_change":"2024-04-25T15:45:49.029845+0000","last_active":"2024-04-25T15:45:49.029845+0000","last_peered":"2024-04-25T15:45:49.029845+0000","last_clean":"2024-04-25T15:45:49.029845+0000","last_became_active":"2024-04-25T15:45:49.029552+0000","last_became_peered":"2024-04-25T15:45:49.029552+0000","last_unstale":"2024-04-25T15:45:49.029845+0000","last_undegraded":"2024-04-25T15:45:49.029845+0000","last_fullsized":"2024-04-25T15:45:49.029845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:39.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019213+0000","last_change":"2024-04-25T15:45:49.019213+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019213+0000","last_undegraded":"2024-04-25T15:45:49.019213+0000","last_fullsized":"2024-04-25T15:45:49.019213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024119+0000","last_change":"2024-04-25T15:45:49.024119+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024119+0000","last_undegraded":"2024-04-25T15:45:49.024119+0000","last_fullsized":"2024-04-25T15:45:49.024119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015600+0000","last_change":"2024-04-25T15:45:48.015600+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015600+0000","last_undegraded":"2024-04-25T15:45:48.015600+0000","last_fullsized":"2024-04-25T15:45:48.015600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028438+0000","last_change":"2024-04-25T15:45:48.028438+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028438+0000","last_undegraded":"2024-04-25T15:45:48.028438+0000","last_fullsized":"2024-04-25T15:45:48.028438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022300+0000","last_change":"2024-04-25T15:45:49.022300+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022300+0000","last_undegraded":"2024-04-25T15:45:49.022300+0000","last_fullsized":"2024-04-25T15:45:49.022300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028853+0000","last_change":"2024-04-25T15:45:48.028853+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028853+0000","last_undegraded":"2024-04-25T15:45:48.028853+0000","last_fullsized":"2024-04-25T15:45:48.028853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025139+0000","last_change":"2024-04-25T15:45:49.025139+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025139+0000","last_undegraded":"2024-04-25T15:45:49.025139+0000","last_fullsized":"2024-04-25T15:45:49.025139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029074+0000","last_change":"2024-04-25T15:45:49.029074+0000","last_active":"2024-04-25T15:45:49.029074+0000","last_peered":"2024-04-25T15:45:49.029074+0000","last_clean":"2024-04-25T15:45:49.029074+0000","last_became_active":"2024-04-25T15:45:49.028755+0000","last_became_peered":"2024-04-25T15:45:49.028755+0000","last_unstale":"2024-04-25T15:45:49.029074+0000","last_undegraded":"2024-04-25T15:45:49.029074+0000","last_fullsized":"2024-04-25T15:45:49.029074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:52.521122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022077+0000","last_change":"2024-04-25T15:45:49.022077+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022077+0000","last_undegraded":"2024-04-25T15:45:49.022077+0000","last_fullsized":"2024-04-25T15:45:49.022077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016251+0000","last_change":"2024-04-25T15:45:48.016251+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016251+0000","last_undegraded":"2024-04-25T15:45:48.016251+0000","last_fullsized":"2024-04-25T15:45:48.016251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023201+0000","last_change":"2024-04-25T15:45:49.023201+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023201+0000","last_undegraded":"2024-04-25T15:45:49.023201+0000","last_fullsized":"2024-04-25T15:45:49.023201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028512+0000","last_change":"2024-04-25T15:45:49.028512+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028512+0000","last_undegraded":"2024-04-25T15:45:49.028512+0000","last_fullsized":"2024-04-25T15:45:49.028512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.034922+0000","last_change":"2024-04-25T15:45:49.034922+0000","last_active":"2024-04-25T15:45:49.034922+0000","last_peered":"2024-04-25T15:45:49.034922+0000","last_clean":"2024-04-25T15:45:49.034922+0000","last_became_active":"2024-04-25T15:45:49.034583+0000","last_became_peered":"2024-04-25T15:45:49.034583+0000","last_unstale":"2024-04-25T15:45:49.034922+0000","last_undegraded":"2024-04-25T15:45:49.034922+0000","last_fullsized":"2024-04-25T15:45:49.034922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:36.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022440+0000","last_change":"2024-04-25T15:45:49.022440+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022440+0000","last_undegraded":"2024-04-25T15:45:49.022440+0000","last_fullsized":"2024-04-25T15:45:49.022440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016724+0000","last_change":"2024-04-25T15:45:48.016724+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016724+0000","last_undegraded":"2024-04-25T15:45:48.016724+0000","last_fullsized":"2024-04-25T15:45:48.016724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.026259+0000","last_change":"2024-04-25T15:45:49.026259+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.026259+0000","last_undegraded":"2024-04-25T15:45:49.026259+0000","last_fullsized":"2024-04-25T15:45:49.026259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015647+0000","last_change":"2024-04-25T15:45:48.015647+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015647+0000","last_undegraded":"2024-04-25T15:45:48.015647+0000","last_fullsized":"2024-04-25T15:45:48.015647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022012+0000","last_change":"2024-04-25T15:45:49.022012+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022012+0000","last_undegraded":"2024-04-25T15:45:49.022012+0000","last_fullsized":"2024-04-25T15:45:49.022012+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022749+0000","last_change":"2024-04-25T15:45:49.022749+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022749+0000","last_undegraded":"2024-04-25T15:45:49.022749+0000","last_fullsized":"2024-04-25T15:45:49.022749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.027913+0000","last_change":"2024-04-25T15:45:48.027913+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.027913+0000","last_undegraded":"2024-04-25T15:45:48.027913+0000","last_fullsized":"2024-04-25T15:45:48.027913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017398+0000","last_change":"2024-04-25T15:45:48.017398+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017398+0000","last_undegraded":"2024-04-25T15:45:48.017398+0000","last_fullsized":"2024-04-25T15:45:48.017398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022792+0000","last_change":"2024-04-25T15:45:49.022792+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022792+0000","last_undegraded":"2024-04-25T15:45:49.022792+0000","last_fullsized":"2024-04-25T15:45:49.022792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.036903+0000","last_change":"2024-04-25T15:45:49.035131+0000","last_active":"2024-04-25T15:45:49.036903+0000","last_peered":"2024-04-25T15:45:49.036903+0000","last_clean":"2024-04-25T15:45:49.036903+0000","last_became_active":"2024-04-25T15:45:49.034817+0000","last_became_peered":"2024-04-25T15:45:49.034817+0000","last_unstale":"2024-04-25T15:45:49.036903+0000","last_undegraded":"2024-04-25T15:45:49.036903+0000","last_fullsized":"2024-04-25T15:45:49.036903+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:08.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017915+0000","last_change":"2024-04-25T15:45:48.017915+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017915+0000","last_undegraded":"2024-04-25T15:45:48.017915+0000","last_fullsized":"2024-04-25T15:45:48.017915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.038316+0000","last_change":"2024-04-25T15:45:49.027721+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.038316+0000","last_undegraded":"2024-04-25T15:45:49.038316+0000","last_fullsized":"2024-04-25T15:45:49.038316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015713+0000","last_change":"2024-04-25T15:45:48.015713+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015713+0000","last_undegraded":"2024-04-25T15:45:48.015713+0000","last_fullsized":"2024-04-25T15:45:48.015713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030741+0000","last_change":"2024-04-25T15:45:49.030741+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030741+0000","last_undegraded":"2024-04-25T15:45:49.030741+0000","last_fullsized":"2024-04-25T15:45:49.030741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023487+0000","last_change":"2024-04-25T15:45:48.039764+0000","last_active":"2024-04-25T15:45:49.023487+0000","last_peered":"2024-04-25T15:45:49.023487+0000","last_clean":"2024-04-25T15:45:49.023487+0000","last_became_active":"2024-04-25T15:45:48.039397+0000","last_became_peered":"2024-04-25T15:45:48.039397+0000","last_unstale":"2024-04-25T15:45:49.023487+0000","last_undegraded":"2024-04-25T15:45:49.023487+0000","last_fullsized":"2024-04-25T15:45:49.023487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:19.962659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035334+0000","last_change":"2024-04-25T15:45:49.031788+0000","last_active":"2024-04-25T15:45:49.035334+0000","last_peered":"2024-04-25T15:45:49.035334+0000","last_clean":"2024-04-25T15:45:49.035334+0000","last_became_active":"2024-04-25T15:45:49.031493+0000","last_became_peered":"2024-04-25T15:45:49.031493+0000","last_unstale":"2024-04-25T15:45:49.035334+0000","last_undegraded":"2024-04-25T15:45:49.035334+0000","last_fullsized":"2024-04-25T15:45:49.035334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:01.670130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031654+0000","last_change":"2024-04-25T15:45:48.027890+0000","last_active":"2024-04-25T15:45:48.031654+0000","last_peered":"2024-04-25T15:45:48.031654+0000","last_clean":"2024-04-25T15:45:48.031654+0000","last_became_active":"2024-04-25T15:45:48.026687+0000","last_became_peered":"2024-04-25T15:45:48.026687+0000","last_unstale":"2024-04-25T15:45:48.031654+0000","last_undegraded":"2024-04-25T15:45:48.031654+0000","last_fullsized":"2024-04-25T15:45:48.031654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.311840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018421+0000","last_change":"2024-04-25T15:45:48.018421+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018421+0000","last_undegraded":"2024-04-25T15:45:48.018421+0000","last_fullsized":"2024-04-25T15:45:48.018421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.037025+0000","last_change":"2024-04-25T15:45:48.035315+0000","last_active":"2024-04-25T15:45:48.037025+0000","last_peered":"2024-04-25T15:45:48.037025+0000","last_clean":"2024-04-25T15:45:48.037025+0000","last_became_active":"2024-04-25T15:45:48.034967+0000","last_became_peered":"2024-04-25T15:45:48.034967+0000","last_unstale":"2024-04-25T15:45:48.037025+0000","last_undegraded":"2024-04-25T15:45:48.037025+0000","last_fullsized":"2024-04-25T15:45:48.037025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:00.668039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016159+0000","last_change":"2024-04-25T15:45:48.016159+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016159+0000","last_undegraded":"2024-04-25T15:45:48.016159+0000","last_fullsized":"2024-04-25T15:45:48.016159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041363+0000","last_change":"2024-04-25T15:45:48.034036+0000","last_active":"2024-04-25T15:45:49.041363+0000","last_peered":"2024-04-25T15:45:49.041363+0000","last_clean":"2024-04-25T15:45:49.041363+0000","last_became_active":"2024-04-25T15:45:48.033687+0000","last_became_peered":"2024-04-25T15:45:48.033687+0000","last_unstale":"2024-04-25T15:45:49.041363+0000","last_undegraded":"2024-04-25T15:45:49.041363+0000","last_fullsized":"2024-04-25T15:45:49.041363+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:15.263609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022992+0000","last_change":"2024-04-25T15:45:49.022992+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022992+0000","last_undegraded":"2024-04-25T15:45:49.022992+0000","last_fullsized":"2024-04-25T15:45:49.022992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035079+0000","last_change":"2024-04-25T15:45:48.033192+0000","last_active":"2024-04-25T15:45:48.035079+0000","last_peered":"2024-04-25T15:45:48.035079+0000","last_clean":"2024-04-25T15:45:48.035079+0000","last_became_active":"2024-04-25T15:45:48.032675+0000","last_became_peered":"2024-04-25T15:45:48.032675+0000","last_unstale":"2024-04-25T15:45:48.035079+0000","last_undegraded":"2024-04-25T15:45:48.035079+0000","last_fullsized":"2024-04-25T15:45:48.035079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:29.955933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022681+0000","last_change":"2024-04-25T15:45:49.022681+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022681+0000","last_undegraded":"2024-04-25T15:45:49.022681+0000","last_fullsized":"2024-04-25T15:45:49.022681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.040085+0000","last_change":"2024-04-25T15:45:48.039562+0000","last_active":"2024-04-25T15:45:48.040085+0000","last_peered":"2024-04-25T15:45:48.040085+0000","last_clean":"2024-04-25T15:45:48.040085+0000","last_became_active":"2024-04-25T15:45:48.039300+0000","last_became_peered":"2024-04-25T15:45:48.039300+0000","last_unstale":"2024-04-25T15:45:48.040085+0000","last_undegraded":"2024-04-25T15:45:48.040085+0000","last_fullsized":"2024-04-25T15:45:48.040085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015499+0000","last_change":"2024-04-25T15:45:48.015499+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015499+0000","last_undegraded":"2024-04-25T15:45:48.015499+0000","last_fullsized":"2024-04-25T15:45:48.015499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022955+0000","last_change":"2024-04-25T15:45:48.035584+0000","last_active":"2024-04-25T15:45:49.022955+0000","last_peered":"2024-04-25T15:45:49.022955+0000","last_clean":"2024-04-25T15:45:49.022955+0000","last_became_active":"2024-04-25T15:45:48.034409+0000","last_became_peered":"2024-04-25T15:45:48.034409+0000","last_unstale":"2024-04-25T15:45:49.022955+0000","last_undegraded":"2024-04-25T15:45:49.022955+0000","last_fullsized":"2024-04-25T15:45:49.022955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019645+0000","last_change":"2024-04-25T15:45:49.019645+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019645+0000","last_undegraded":"2024-04-25T15:45:49.019645+0000","last_fullsized":"2024-04-25T15:45:49.019645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024427+0000","last_change":"2024-04-25T15:45:48.031484+0000","last_active":"2024-04-25T15:45:49.024427+0000","last_peered":"2024-04-25T15:45:49.024427+0000","last_clean":"2024-04-25T15:45:49.024427+0000","last_became_active":"2024-04-25T15:45:48.031166+0000","last_became_peered":"2024-04-25T15:45:48.031166+0000","last_unstale":"2024-04-25T15:45:49.024427+0000","last_undegraded":"2024-04-25T15:45:49.024427+0000","last_fullsized":"2024-04-25T15:45:49.024427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:59.353521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022274+0000","last_change":"2024-04-25T15:45:49.022274+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022274+0000","last_undegraded":"2024-04-25T15:45:49.022274+0000","last_fullsized":"2024-04-25T15:45:49.022274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031663+0000","last_change":"2024-04-25T15:45:48.027388+0000","last_active":"2024-04-25T15:45:48.031663+0000","last_peered":"2024-04-25T15:45:48.031663+0000","last_clean":"2024-04-25T15:45:48.031663+0000","last_became_active":"2024-04-25T15:45:48.026972+0000","last_became_peered":"2024-04-25T15:45:48.026972+0000","last_unstale":"2024-04-25T15:45:48.031663+0000","last_undegraded":"2024-04-25T15:45:48.031663+0000","last_fullsized":"2024-04-25T15:45:48.031663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.026459+0000","last_change":"2024-04-25T15:45:48.026459+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.026459+0000","last_undegraded":"2024-04-25T15:45:48.026459+0000","last_fullsized":"2024-04-25T15:45:48.026459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036696+0000","last_change":"2024-04-25T15:45:48.035924+0000","last_active":"2024-04-25T15:45:48.036696+0000","last_peered":"2024-04-25T15:45:48.036696+0000","last_clean":"2024-04-25T15:45:48.036696+0000","last_became_active":"2024-04-25T15:45:48.035502+0000","last_became_peered":"2024-04-25T15:45:48.035502+0000","last_unstale":"2024-04-25T15:45:48.036696+0000","last_undegraded":"2024-04-25T15:45:48.036696+0000","last_fullsized":"2024-04-25T15:45:48.036696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018187+0000","last_change":"2024-04-25T15:45:49.018187+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018187+0000","last_undegraded":"2024-04-25T15:45:49.018187+0000","last_fullsized":"2024-04-25T15:45:49.018187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023677+0000","last_change":"2024-04-25T15:45:48.029162+0000","last_active":"2024-04-25T15:45:49.023677+0000","last_peered":"2024-04-25T15:45:49.023677+0000","last_clean":"2024-04-25T15:45:49.023677+0000","last_became_active":"2024-04-25T15:45:48.028855+0000","last_became_peered":"2024-04-25T15:45:48.028855+0000","last_unstale":"2024-04-25T15:45:49.023677+0000","last_undegraded":"2024-04-25T15:45:49.023677+0000","last_fullsized":"2024-04-25T15:45:49.023677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:51.952928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030726+0000","last_change":"2024-04-25T15:45:49.030726+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030726+0000","last_undegraded":"2024-04-25T15:45:49.030726+0000","last_fullsized":"2024-04-25T15:45:49.030726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'5","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.020492+0000","last_change":"2024-04-25T15:45:48.025186+0000","last_active":"2024-04-25T15:45:49.020492+0000","last_peered":"2024-04-25T15:45:49.020492+0000","last_clean":"2024-04-25T15:45:49.020492+0000","last_became_active":"2024-04-25T15:45:48.024784+0000","last_became_peered":"2024-04-25T15:45:48.024784+0000","last_unstale":"2024-04-25T15:45:49.020492+0000","last_undegraded":"2024-04-25T15:45:49.020492+0000","last_fullsized":"2024-04-25T15:45:49.020492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:22.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028357+0000","last_change":"2024-04-25T15:45:48.028357+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028357+0000","last_undegraded":"2024-04-25T15:45:48.028357+0000","last_fullsized":"2024-04-25T15:45:48.028357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035546+0000","last_change":"2024-04-25T15:45:48.032275+0000","last_active":"2024-04-25T15:45:48.035546+0000","last_peered":"2024-04-25T15:45:48.035546+0000","last_clean":"2024-04-25T15:45:48.035546+0000","last_became_active":"2024-04-25T15:45:48.031954+0000","last_became_peered":"2024-04-25T15:45:48.031954+0000","last_unstale":"2024-04-25T15:45:48.035546+0000","last_undegraded":"2024-04-25T15:45:48.035546+0000","last_fullsized":"2024-04-25T15:45:48.035546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:52.683379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018834+0000","last_change":"2024-04-25T15:45:49.018834+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018834+0000","last_undegraded":"2024-04-25T15:45:49.018834+0000","last_fullsized":"2024-04-25T15:45:49.018834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036583+0000","last_change":"2024-04-25T15:45:48.034555+0000","last_active":"2024-04-25T15:45:48.036583+0000","last_peered":"2024-04-25T15:45:48.036583+0000","last_clean":"2024-04-25T15:45:48.036583+0000","last_became_active":"2024-04-25T15:45:48.034231+0000","last_became_peered":"2024-04-25T15:45:48.034231+0000","last_unstale":"2024-04-25T15:45:48.036583+0000","last_undegraded":"2024-04-25T15:45:48.036583+0000","last_fullsized":"2024-04-25T15:45:48.036583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035068+0000","last_change":"2024-04-25T15:45:49.031420+0000","last_active":"2024-04-25T15:45:49.035068+0000","last_peered":"2024-04-25T15:45:49.035068+0000","last_clean":"2024-04-25T15:45:49.035068+0000","last_became_active":"2024-04-25T15:45:49.031020+0000","last_became_peered":"2024-04-25T15:45:49.031020+0000","last_unstale":"2024-04-25T15:45:49.035068+0000","last_undegraded":"2024-04-25T15:45:49.035068+0000","last_fullsized":"2024-04-25T15:45:49.035068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:29.199964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.025629+0000","last_change":"2024-04-25T15:45:48.037474+0000","last_active":"2024-04-25T15:45:49.025629+0000","last_peered":"2024-04-25T15:45:49.025629+0000","last_clean":"2024-04-25T15:45:49.025629+0000","last_became_active":"2024-04-25T15:45:48.037137+0000","last_became_peered":"2024-04-25T15:45:48.037137+0000","last_unstale":"2024-04-25T15:45:49.025629+0000","last_undegraded":"2024-04-25T15:45:49.025629+0000","last_fullsized":"2024-04-25T15:45:49.025629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:46.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040575+0000","last_change":"2024-04-25T15:45:49.039181+0000","last_active":"2024-04-25T15:45:49.040575+0000","last_peered":"2024-04-25T15:45:49.040575+0000","last_clean":"2024-04-25T15:45:49.040575+0000","last_became_active":"2024-04-25T15:45:49.038832+0000","last_became_peered":"2024-04-25T15:45:49.038832+0000","last_unstale":"2024-04-25T15:45:49.040575+0000","last_undegraded":"2024-04-25T15:45:49.040575+0000","last_fullsized":"2024-04-25T15:45:49.040575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:44.172577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022379+0000","last_change":"2024-04-25T15:45:48.034495+0000","last_active":"2024-04-25T15:45:49.022379+0000","last_peered":"2024-04-25T15:45:49.022379+0000","last_clean":"2024-04-25T15:45:49.022379+0000","last_became_active":"2024-04-25T15:45:48.034171+0000","last_became_peered":"2024-04-25T15:45:48.034171+0000","last_unstale":"2024-04-25T15:45:49.022379+0000","last_undegraded":"2024-04-25T15:45:49.022379+0000","last_fullsized":"2024-04-25T15:45:49.022379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030626+0000","last_change":"2024-04-25T15:45:49.030626+0000","last_active":"2024-04-25T15:45:49.030626+0000","last_peered":"2024-04-25T15:45:49.030626+0000","last_clean":"2024-04-25T15:45:49.030626+0000","last_became_active":"2024-04-25T15:45:49.030305+0000","last_became_peered":"2024-04-25T15:45:49.030305+0000","last_unstale":"2024-04-25T15:45:49.030626+0000","last_undegraded":"2024-04-25T15:45:49.030626+0000","last_fullsized":"2024-04-25T15:45:49.030626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.212910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033931+0000","last_change":"2024-04-25T15:45:48.030606+0000","last_active":"2024-04-25T15:45:48.033931+0000","last_peered":"2024-04-25T15:45:48.033931+0000","last_clean":"2024-04-25T15:45:48.033931+0000","last_became_active":"2024-04-25T15:45:48.030252+0000","last_became_peered":"2024-04-25T15:45:48.030252+0000","last_unstale":"2024-04-25T15:45:48.033931+0000","last_undegraded":"2024-04-25T15:45:48.033931+0000","last_fullsized":"2024-04-25T15:45:48.033931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.020571+0000","last_change":"2024-04-25T15:45:49.020571+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.020571+0000","last_undegraded":"2024-04-25T15:45:49.020571+0000","last_fullsized":"2024-04-25T15:45:49.020571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033071+0000","last_change":"2024-04-25T15:45:48.031558+0000","last_active":"2024-04-25T15:45:48.033071+0000","last_peered":"2024-04-25T15:45:48.033071+0000","last_clean":"2024-04-25T15:45:48.033071+0000","last_became_active":"2024-04-25T15:45:48.030245+0000","last_became_peered":"2024-04-25T15:45:48.030245+0000","last_unstale":"2024-04-25T15:45:48.033071+0000","last_undegraded":"2024-04-25T15:45:48.033071+0000","last_fullsized":"2024-04-25T15:45:48.033071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:38:06.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025889+0000","last_change":"2024-04-25T15:45:49.025889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025889+0000","last_undegraded":"2024-04-25T15:45:49.025889+0000","last_fullsized":"2024-04-25T15:45:49.025889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023844+0000","last_change":"2024-04-25T15:45:48.032149+0000","last_active":"2024-04-25T15:45:49.023844+0000","last_peered":"2024-04-25T15:45:49.023844+0000","last_clean":"2024-04-25T15:45:49.023844+0000","last_became_active":"2024-04-25T15:45:48.031853+0000","last_became_peered":"2024-04-25T15:45:48.031853+0000","last_unstale":"2024-04-25T15:45:49.023844+0000","last_undegraded":"2024-04-25T15:45:49.023844+0000","last_fullsized":"2024-04-25T15:45:49.023844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:11.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030640+0000","last_change":"2024-04-25T15:45:49.030640+0000","last_active":"2024-04-25T15:45:49.030640+0000","last_peered":"2024-04-25T15:45:49.030640+0000","last_clean":"2024-04-25T15:45:49.030640+0000","last_became_active":"2024-04-25T15:45:49.030331+0000","last_became_peered":"2024-04-25T15:45:49.030331+0000","last_unstale":"2024-04-25T15:45:49.030640+0000","last_undegraded":"2024-04-25T15:45:49.030640+0000","last_fullsized":"2024-04-25T15:45:49.030640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:48.687335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030273+0000","last_change":"2024-04-25T15:45:48.033544+0000","last_active":"2024-04-25T15:45:49.030273+0000","last_peered":"2024-04-25T15:45:49.030273+0000","last_clean":"2024-04-25T15:45:49.030273+0000","last_became_active":"2024-04-25T15:45:48.033248+0000","last_became_peered":"2024-04-25T15:45:48.033248+0000","last_unstale":"2024-04-25T15:45:49.030273+0000","last_undegraded":"2024-04-25T15:45:49.030273+0000","last_fullsized":"2024-04-25T15:45:49.030273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:09.595887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037533+0000","last_change":"2024-04-25T15:45:49.033989+0000","last_active":"2024-04-25T15:45:49.037533+0000","last_peered":"2024-04-25T15:45:49.037533+0000","last_clean":"2024-04-25T15:45:49.037533+0000","last_became_active":"2024-04-25T15:45:49.033692+0000","last_became_peered":"2024-04-25T15:45:49.033692+0000","last_unstale":"2024-04-25T15:45:49.037533+0000","last_undegraded":"2024-04-25T15:45:49.037533+0000","last_fullsized":"2024-04-25T15:45:49.037533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:20.697315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017353+0000","last_change":"2024-04-25T15:45:48.026000+0000","last_active":"2024-04-25T15:45:49.017353+0000","last_peered":"2024-04-25T15:45:49.017353+0000","last_clean":"2024-04-25T15:45:49.017353+0000","last_became_active":"2024-04-25T15:45:48.025670+0000","last_became_peered":"2024-04-25T15:45:48.025670+0000","last_unstale":"2024-04-25T15:45:49.017353+0000","last_undegraded":"2024-04-25T15:45:49.017353+0000","last_fullsized":"2024-04-25T15:45:49.017353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:55.222065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024245+0000","last_change":"2024-04-25T15:45:49.024245+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024245+0000","last_undegraded":"2024-04-25T15:45:49.024245+0000","last_fullsized":"2024-04-25T15:45:49.024245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017282+0000","last_change":"2024-04-25T15:45:48.028925+0000","last_active":"2024-04-25T15:45:49.017282+0000","last_peered":"2024-04-25T15:45:49.017282+0000","last_clean":"2024-04-25T15:45:49.017282+0000","last_became_active":"2024-04-25T15:45:48.028353+0000","last_became_peered":"2024-04-25T15:45:48.028353+0000","last_unstale":"2024-04-25T15:45:49.017282+0000","last_undegraded":"2024-04-25T15:45:49.017282+0000","last_fullsized":"2024-04-25T15:45:49.017282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:28.927396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039375+0000","last_change":"2024-04-25T15:45:49.032361+0000","last_active":"2024-04-25T15:45:49.039375+0000","last_peered":"2024-04-25T15:45:49.039375+0000","last_clean":"2024-04-25T15:45:49.039375+0000","last_became_active":"2024-04-25T15:45:49.032084+0000","last_became_peered":"2024-04-25T15:45:49.032084+0000","last_unstale":"2024-04-25T15:45:49.039375+0000","last_undegraded":"2024-04-25T15:45:49.039375+0000","last_fullsized":"2024-04-25T15:45:49.039375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.993146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.016982+0000","last_change":"2024-04-25T15:45:48.027883+0000","last_active":"2024-04-25T15:45:49.016982+0000","last_peered":"2024-04-25T15:45:49.016982+0000","last_clean":"2024-04-25T15:45:49.016982+0000","last_became_active":"2024-04-25T15:45:48.027582+0000","last_became_peered":"2024-04-25T15:45:48.027582+0000","last_unstale":"2024-04-25T15:45:49.016982+0000","last_undegraded":"2024-04-25T15:45:49.016982+0000","last_fullsized":"2024-04-25T15:45:49.016982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:07.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015824+0000","last_change":"2024-04-25T15:45:48.015824+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015824+0000","last_undegraded":"2024-04-25T15:45:48.015824+0000","last_fullsized":"2024-04-25T15:45:48.015824+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036123+0000","last_change":"2024-04-25T15:45:48.035036+0000","last_active":"2024-04-25T15:45:48.036123+0000","last_peered":"2024-04-25T15:45:48.036123+0000","last_clean":"2024-04-25T15:45:48.036123+0000","last_became_active":"2024-04-25T15:45:48.034635+0000","last_became_peered":"2024-04-25T15:45:48.034635+0000","last_unstale":"2024-04-25T15:45:48.036123+0000","last_undegraded":"2024-04-25T15:45:48.036123+0000","last_fullsized":"2024-04-25T15:45:48.036123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:39.304770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039371+0000","last_change":"2024-04-25T15:45:49.031634+0000","last_active":"2024-04-25T15:45:49.039371+0000","last_peered":"2024-04-25T15:45:49.039371+0000","last_clean":"2024-04-25T15:45:49.039371+0000","last_became_active":"2024-04-25T15:45:49.030687+0000","last_became_peered":"2024-04-25T15:45:49.030687+0000","last_unstale":"2024-04-25T15:45:49.039371+0000","last_undegraded":"2024-04-25T15:45:49.039371+0000","last_fullsized":"2024-04-25T15:45:49.039371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:10.597978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024523+0000","last_change":"2024-04-25T15:45:48.040359+0000","last_active":"2024-04-25T15:45:49.024523+0000","last_peered":"2024-04-25T15:45:49.024523+0000","last_clean":"2024-04-25T15:45:49.024523+0000","last_became_active":"2024-04-25T15:45:48.040028+0000","last_became_peered":"2024-04-25T15:45:48.040028+0000","last_unstale":"2024-04-25T15:45:49.024523+0000","last_undegraded":"2024-04-25T15:45:49.024523+0000","last_fullsized":"2024-04-25T15:45:49.024523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017889+0000","last_change":"2024-04-25T15:45:48.017889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017889+0000","last_undegraded":"2024-04-25T15:45:48.017889+0000","last_fullsized":"2024-04-25T15:45:48.017889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035226+0000","last_change":"2024-04-25T15:45:48.032412+0000","last_active":"2024-04-25T15:45:48.035226+0000","last_peered":"2024-04-25T15:45:48.035226+0000","last_clean":"2024-04-25T15:45:48.035226+0000","last_became_active":"2024-04-25T15:45:48.032095+0000","last_became_peered":"2024-04-25T15:45:48.032095+0000","last_unstale":"2024-04-25T15:45:48.035226+0000","last_undegraded":"2024-04-25T15:45:48.035226+0000","last_fullsized":"2024-04-25T15:45:48.035226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037021+0000","last_change":"2024-04-25T15:45:49.037021+0000","last_active":"2024-04-25T15:45:49.037021+0000","last_peered":"2024-04-25T15:45:49.037021+0000","last_clean":"2024-04-25T15:45:49.037021+0000","last_became_active":"2024-04-25T15:45:49.036709+0000","last_became_peered":"2024-04-25T15:45:49.036709+0000","last_unstale":"2024-04-25T15:45:49.037021+0000","last_undegraded":"2024-04-25T15:45:49.037021+0000","last_fullsized":"2024-04-25T15:45:49.037021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:29.929487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031635+0000","last_change":"2024-04-25T15:45:48.026477+0000","last_active":"2024-04-25T15:45:48.031635+0000","last_peered":"2024-04-25T15:45:48.031635+0000","last_clean":"2024-04-25T15:45:48.031635+0000","last_became_active":"2024-04-25T15:45:48.026123+0000","last_became_peered":"2024-04-25T15:45:48.026123+0000","last_unstale":"2024-04-25T15:45:48.031635+0000","last_undegraded":"2024-04-25T15:45:48.031635+0000","last_fullsized":"2024-04-25T15:45:48.031635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041247+0000","last_change":"2024-04-25T15:45:49.041247+0000","last_active":"2024-04-25T15:45:49.041247+0000","last_peered":"2024-04-25T15:45:49.041247+0000","last_clean":"2024-04-25T15:45:49.041247+0000","last_became_active":"2024-04-25T15:45:49.040773+0000","last_became_peered":"2024-04-25T15:45:49.040773+0000","last_unstale":"2024-04-25T15:45:49.041247+0000","last_undegraded":"2024-04-25T15:45:49.041247+0000","last_fullsized":"2024-04-25T15:45:49.041247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:45.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019955+0000","last_change":"2024-04-25T15:45:48.032005+0000","last_active":"2024-04-25T15:45:49.019955+0000","last_peered":"2024-04-25T15:45:49.019955+0000","last_clean":"2024-04-25T15:45:49.019955+0000","last_became_active":"2024-04-25T15:45:48.031690+0000","last_became_peered":"2024-04-25T15:45:48.031690+0000","last_unstale":"2024-04-25T15:45:49.019955+0000","last_undegraded":"2024-04-25T15:45:49.019955+0000","last_fullsized":"2024-04-25T15:45:49.019955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:03.901419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040490+0000","last_change":"2024-04-25T15:45:49.035767+0000","last_active":"2024-04-25T15:45:49.040490+0000","last_peered":"2024-04-25T15:45:49.040490+0000","last_clean":"2024-04-25T15:45:49.040490+0000","last_became_active":"2024-04-25T15:45:49.035455+0000","last_became_peered":"2024-04-25T15:45:49.035455+0000","last_unstale":"2024-04-25T15:45:49.040490+0000","last_undegraded":"2024-04-25T15:45:49.040490+0000","last_fullsized":"2024-04-25T15:45:49.040490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:40.412201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.026369+0000","last_change":"2024-04-25T15:45:48.039813+0000","last_active":"2024-04-25T15:45:49.026369+0000","last_peered":"2024-04-25T15:45:49.026369+0000","last_clean":"2024-04-25T15:45:49.026369+0000","last_became_active":"2024-04-25T15:45:48.039488+0000","last_became_peered":"2024-04-25T15:45:48.039488+0000","last_unstale":"2024-04-25T15:45:49.026369+0000","last_undegraded":"2024-04-25T15:45:49.026369+0000","last_fullsized":"2024-04-25T15:45:49.026369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:11.300706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028334+0000","last_change":"2024-04-25T15:45:49.028334+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028334+0000","last_undegraded":"2024-04-25T15:45:49.028334+0000","last_fullsized":"2024-04-25T15:45:49.028334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019744+0000","last_change":"2024-04-25T15:45:48.025876+0000","last_active":"2024-04-25T15:45:49.019744+0000","last_peered":"2024-04-25T15:45:49.019744+0000","last_clean":"2024-04-25T15:45:49.019744+0000","last_became_active":"2024-04-25T15:45:48.025572+0000","last_became_peered":"2024-04-25T15:45:48.025572+0000","last_unstale":"2024-04-25T15:45:49.019744+0000","last_undegraded":"2024-04-25T15:45:49.019744+0000","last_fullsized":"2024-04-25T15:45:49.019744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.253552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.037634+0000","last_change":"2024-04-25T15:45:49.031169+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.037634+0000","last_undegraded":"2024-04-25T15:45:49.037634+0000","last_fullsized":"2024-04-25T15:45:49.037634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.031053+0000","last_change":"2024-04-25T15:45:48.027979+0000","last_active":"2024-04-25T15:45:49.031053+0000","last_peered":"2024-04-25T15:45:49.031053+0000","last_clean":"2024-04-25T15:45:49.031053+0000","last_became_active":"2024-04-25T15:45:48.027663+0000","last_became_peered":"2024-04-25T15:45:48.027663+0000","last_unstale":"2024-04-25T15:45:49.031053+0000","last_undegraded":"2024-04-25T15:45:49.031053+0000","last_fullsized":"2024-04-25T15:45:49.031053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:29.991055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016887+0000","last_change":"2024-04-25T15:45:48.016887+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016887+0000","last_undegraded":"2024-04-25T15:45:48.016887+0000","last_fullsized":"2024-04-25T15:45:48.016887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.018488+0000","last_change":"2024-04-25T15:45:48.027167+0000","last_active":"2024-04-25T15:45:49.018488+0000","last_peered":"2024-04-25T15:45:49.018488+0000","last_clean":"2024-04-25T15:45:49.018488+0000","last_became_active":"2024-04-25T15:45:48.026855+0000","last_became_peered":"2024-04-25T15:45:48.026855+0000","last_unstale":"2024-04-25T15:45:49.018488+0000","last_undegraded":"2024-04-25T15:45:49.018488+0000","last_fullsized":"2024-04-25T15:45:49.018488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:48.804981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":213,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.016506+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:48.016506+0000","last_peered":"2024-04-25T15:45:48.016506+0000","last_clean":"2024-04-25T15:45:48.016506+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:48.016506+0000","last_undegraded":"2024-04-25T15:45:48.016506+0000","last_fullsized":"2024-04-25T15:45:48.016506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343376,"statfs":{"total":96636764160,"available":96607617024,"internally_reserved":0,"allocated":1470464,"data_stored":983750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":977083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:52.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2024-04-25T15:45:52.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.018731+0000', 'last_change': '2024-04-25T15:45:48.018731+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.018731+0000', 'last_undegraded': '2024-04-25T15:45:48.018731+0000', 'last_fullsized': '2024-04-25T15:45:48.018731+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.023863+0000', 'last_change': '2024-04-25T15:45:49.023863+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.023863+0000', 'last_undegraded': '2024-04-25T15:45:49.023863+0000', 'last_fullsized': '2024-04-25T15:45:49.023863+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.028092+0000', 'last_change': '2024-04-25T15:45:49.028092+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.028092+0000', 'last_undegraded': '2024-04-25T15:45:49.028092+0000', 'last_fullsized': '2024-04-25T15:45:49.028092+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.029372+0000', 'last_change': '2024-04-25T15:45:48.029372+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.029372+0000', 'last_undegraded': '2024-04-25T15:45:48.029372+0000', 'last_fullsized': '2024-04-25T15:45:48.029372+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2024-04-25T15:45:52.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.024738+0000', 'last_change': '2024-04-25T15:45:49.024738+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.024738+0000', 'last_undegraded': '2024-04-25T15:45:49.024738+0000', 'last_fullsized': '2024-04-25T15:45:49.024738+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.019213+0000', 'last_change': '2024-04-25T15:45:49.019213+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.019213+0000', 'last_undegraded': '2024-04-25T15:45:49.019213+0000', 'last_fullsized': '2024-04-25T15:45:49.019213+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.024119+0000', 'last_change': '2024-04-25T15:45:49.024119+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.024119+0000', 'last_undegraded': '2024-04-25T15:45:49.024119+0000', 'last_fullsized': '2024-04-25T15:45:49.024119+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.015600+0000', 'last_change': '2024-04-25T15:45:48.015600+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.015600+0000', 'last_undegraded': '2024-04-25T15:45:48.015600+0000', 'last_fullsized': '2024-04-25T15:45:48.015600+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.028438+0000', 'last_change': '2024-04-25T15:45:48.028438+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.028438+0000', 'last_undegraded': '2024-04-25T15:45:48.028438+0000', 'last_fullsized': '2024-04-25T15:45:48.028438+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2024-04-25T15:45:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022300+0000', 'last_change': '2024-04-25T15:45:49.022300+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022300+0000', 'last_undegraded': '2024-04-25T15:45:49.022300+0000', 'last_fullsized': '2024-04-25T15:45:49.022300+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.028853+0000', 'last_change': '2024-04-25T15:45:48.028853+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.028853+0000', 'last_undegraded': '2024-04-25T15:45:48.028853+0000', 'last_fullsized': '2024-04-25T15:45:48.028853+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.025139+0000', 'last_change': '2024-04-25T15:45:49.025139+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.025139+0000', 'last_undegraded': '2024-04-25T15:45:49.025139+0000', 'last_fullsized': '2024-04-25T15:45:49.025139+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022077+0000', 'last_change': '2024-04-25T15:45:49.022077+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022077+0000', 'last_undegraded': '2024-04-25T15:45:49.022077+0000', 'last_fullsized': '2024-04-25T15:45:49.022077+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.016251+0000', 'last_change': '2024-04-25T15:45:48.016251+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.016251+0000', 'last_undegraded': '2024-04-25T15:45:48.016251+0000', 'last_fullsized': '2024-04-25T15:45:48.016251+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.023201+0000', 'last_change': '2024-04-25T15:45:49.023201+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.023201+0000', 'last_undegraded': '2024-04-25T15:45:49.023201+0000', 'last_fullsized': '2024-04-25T15:45:49.023201+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': ['2', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.028512+0000', 'last_change': '2024-04-25T15:45:49.028512+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.028512+0000', 'last_undegraded': '2024-04-25T15:45:49.028512+0000', 'last_fullsized': '2024-04-25T15:45:49.028512+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022440+0000', 'last_change': '2024-04-25T15:45:49.022440+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022440+0000', 'last_undegraded': '2024-04-25T15:45:49.022440+0000', 'last_fullsized': '2024-04-25T15:45:49.022440+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.016724+0000', 'last_change': '2024-04-25T15:45:48.016724+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.016724+0000', 'last_undegraded': '2024-04-25T15:45:48.016724+0000', 'last_fullsized': '2024-04-25T15:45:48.016724+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.026259+0000', 'last_change': '2024-04-25T15:45:49.026259+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.026259+0000', 'last_undegraded': '2024-04-25T15:45:49.026259+0000', 'last_fullsized': '2024-04-25T15:45:49.026259+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.015647+0000', 'last_change': '2024-04-25T15:45:48.015647+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.015647+0000', 'last_undegraded': '2024-04-25T15:45:48.015647+0000', 'last_fullsized': '2024-04-25T15:45:48.015647+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2024-04-25T15:45:52.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022012+0000', 'last_change': '2024-04-25T15:45:49.022012+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022012+0000', 'last_undegraded': '2024-04-25T15:45:49.022012+0000', 'last_fullsized': '2024-04-25T15:45:49.022012+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022749+0000', 'last_change': '2024-04-25T15:45:49.022749+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022749+0000', 'last_undegraded': '2024-04-25T15:45:49.022749+0000', 'last_fullsized': '2024-04-25T15:45:49.022749+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.027913+0000', 'last_change': '2024-04-25T15:45:48.027913+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.027913+0000', 'last_undegraded': '2024-04-25T15:45:48.027913+0000', 'last_fullsized': '2024-04-25T15:45:48.027913+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.017398+0000', 'last_change': '2024-04-25T15:45:48.017398+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.017398+0000', 'last_undegraded': '2024-04-25T15:45:48.017398+0000', 'last_fullsized': '2024-04-25T15:45:48.017398+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022792+0000', 'last_change': '2024-04-25T15:45:49.022792+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022792+0000', 'last_undegraded': '2024-04-25T15:45:49.022792+0000', 'last_fullsized': '2024-04-25T15:45:49.022792+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.017915+0000', 'last_change': '2024-04-25T15:45:48.017915+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.017915+0000', 'last_undegraded': '2024-04-25T15:45:48.017915+0000', 'last_fullsized': '2024-04-25T15:45:48.017915+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2024-04-25T15:45:52.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.038316+0000', 'last_change': '2024-04-25T15:45:49.027721+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.038316+0000', 'last_undegraded': '2024-04-25T15:45:49.038316+0000', 'last_fullsized': '2024-04-25T15:45:49.038316+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.015713+0000', 'last_change': '2024-04-25T15:45:48.015713+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.015713+0000', 'last_undegraded': '2024-04-25T15:45:48.015713+0000', 'last_fullsized': '2024-04-25T15:45:48.015713+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.030741+0000', 'last_change': '2024-04-25T15:45:49.030741+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.030741+0000', 'last_undegraded': '2024-04-25T15:45:49.030741+0000', 'last_fullsized': '2024-04-25T15:45:49.030741+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.018421+0000', 'last_change': '2024-04-25T15:45:48.018421+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.018421+0000', 'last_undegraded': '2024-04-25T15:45:48.018421+0000', 'last_fullsized': '2024-04-25T15:45:48.018421+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.016159+0000', 'last_change': '2024-04-25T15:45:48.016159+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.016159+0000', 'last_undegraded': '2024-04-25T15:45:48.016159+0000', 'last_fullsized': '2024-04-25T15:45:48.016159+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022992+0000', 'last_change': '2024-04-25T15:45:49.022992+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022992+0000', 'last_undegraded': '2024-04-25T15:45:49.022992+0000', 'last_fullsized': '2024-04-25T15:45:49.022992+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022681+0000', 'last_change': '2024-04-25T15:45:49.022681+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022681+0000', 'last_undegraded': '2024-04-25T15:45:49.022681+0000', 'last_fullsized': '2024-04-25T15:45:49.022681+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.015499+0000', 'last_change': '2024-04-25T15:45:48.015499+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.015499+0000', 'last_undegraded': '2024-04-25T15:45:48.015499+0000', 'last_fullsized': '2024-04-25T15:45:48.015499+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.019645+0000', 'last_change': '2024-04-25T15:45:49.019645+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.019645+0000', 'last_undegraded': '2024-04-25T15:45:49.019645+0000', 'last_fullsized': '2024-04-25T15:45:49.019645+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.022274+0000', 'last_change': '2024-04-25T15:45:49.022274+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.022274+0000', 'last_undegraded': '2024-04-25T15:45:49.022274+0000', 'last_fullsized': '2024-04-25T15:45:49.022274+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.026459+0000', 'last_change': '2024-04-25T15:45:48.026459+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.026459+0000', 'last_undegraded': '2024-04-25T15:45:48.026459+0000', 'last_fullsized': '2024-04-25T15:45:48.026459+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2024-04-25T15:45:52.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.018187+0000', 'last_change': '2024-04-25T15:45:49.018187+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.018187+0000', 'last_undegraded': '2024-04-25T15:45:49.018187+0000', 'last_fullsized': '2024-04-25T15:45:49.018187+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.030726+0000', 'last_change': '2024-04-25T15:45:49.030726+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.030726+0000', 'last_undegraded': '2024-04-25T15:45:49.030726+0000', 'last_fullsized': '2024-04-25T15:45:49.030726+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.028357+0000', 'last_change': '2024-04-25T15:45:48.028357+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.028357+0000', 'last_undegraded': '2024-04-25T15:45:48.028357+0000', 'last_fullsized': '2024-04-25T15:45:48.028357+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.018834+0000', 'last_change': '2024-04-25T15:45:49.018834+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.018834+0000', 'last_undegraded': '2024-04-25T15:45:49.018834+0000', 'last_fullsized': '2024-04-25T15:45:49.018834+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.020571+0000', 'last_change': '2024-04-25T15:45:49.020571+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.020571+0000', 'last_undegraded': '2024-04-25T15:45:49.020571+0000', 'last_fullsized': '2024-04-25T15:45:49.020571+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': ['2', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.025889+0000', 'last_change': '2024-04-25T15:45:49.025889+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.025889+0000', 'last_undegraded': '2024-04-25T15:45:49.025889+0000', 'last_fullsized': '2024-04-25T15:45:49.025889+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2024-04-25T15:45:52.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.024245+0000', 'last_change': '2024-04-25T15:45:49.024245+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.024245+0000', 'last_undegraded': '2024-04-25T15:45:49.024245+0000', 'last_fullsized': '2024-04-25T15:45:49.024245+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.015824+0000', 'last_change': '2024-04-25T15:45:48.015824+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.015824+0000', 'last_undegraded': '2024-04-25T15:45:48.015824+0000', 'last_fullsized': '2024-04-25T15:45:48.015824+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.017889+0000', 'last_change': '2024-04-25T15:45:48.017889+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.017889+0000', 'last_undegraded': '2024-04-25T15:45:48.017889+0000', 'last_fullsized': '2024-04-25T15:45:48.017889+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.028334+0000', 'last_change': '2024-04-25T15:45:49.028334+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.028334+0000', 'last_undegraded': '2024-04-25T15:45:49.028334+0000', 'last_fullsized': '2024-04-25T15:45:49.028334+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 73, 'state': 'creating+activating', 'last_fresh': '2024-04-25T15:45:49.037634+0000', 'last_change': '2024-04-25T15:45:49.031169+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:49.037634+0000', 'last_undegraded': '2024-04-25T15:45:49.037634+0000', 'last_fullsized': '2024-04-25T15:45:49.037634+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2024-04-25T15:45:52.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:45:48.016887+0000', 'last_change': '2024-04-25T15:45:48.016887+0000', 'last_active': '2024-04-25T15:45:48.006343+0000', 'last_peered': '2024-04-25T15:45:48.006343+0000', 'last_clean': '2024-04-25T15:45:48.006343+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:45:48.016887+0000', 'last_undegraded': '2024-04-25T15:45:48.016887+0000', 'last_fullsized': '2024-04-25T15:45:48.016887+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'last_clean_scrub_stamp': '2024-04-25T15:45:48.006343+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:45:52.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T15:45:52.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.891+0000 7fcc39eb6640 1 Processor -- start 2024-04-25T15:45:52.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.891+0000 7fcc39eb6640 1 -- start start 2024-04-25T15:45:52.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.892+0000 7fcc39eb6640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc3409bea0 0x7fcc340ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc39eb6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc39eb6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc3406c660 con 0x7fcc340d2830 2024-04-25T15:45:52.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc39eb6640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcc3406cc40 con 0x7fcc3409bea0 2024-04-25T15:45:52.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc39eb6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc340ced60 con 0x7fcc3406d0d0 2024-04-25T15:45:52.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:56558/0 (socket says 172.21.15.80:56558) 2024-04-25T15:45:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 -- 172.21.15.80:0/223192741 learned_addr learned my addr 172.21.15.80:0/223192741 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 -- 172.21.15.80:0/223192741 >> v2:172.21.15.195:3300/0 conn(0x7fcc3409bea0 msgr2=0x7fcc340ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 --2- 172.21.15.80:0/223192741 >> v2:172.21.15.195:3300/0 conn(0x7fcc3409bea0 0x7fcc340ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 -- 172.21.15.80:0/223192741 >> v1:172.21.15.195:6789/0 conn(0x7fcc340d2830 legacy=0x7fcc340d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.893+0000 7fcc33fff640 1 -- 172.21.15.80:0/223192741 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3406c8d0 con 0x7fcc3406d0d0 2024-04-25T15:45:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.894+0000 7fcc33fff640 1 --2- 172.21.15.80:0/223192741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3406d4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009e50 tx=0x7fcc2c02a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa0fa09ba7b6bb14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.894+0000 7fcc327fc640 1 -- 172.21.15.80:0/223192741 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c036070 con 0x7fcc3406d0d0 2024-04-25T15:45:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.894+0000 7fcc327fc640 1 -- 172.21.15.80:0/223192741 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c031600 con 0x7fcc3406d0d0 2024-04-25T15:45:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.894+0000 7fcc327fc640 1 -- 172.21.15.80:0/223192741 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0319d0 con 0x7fcc3406d0d0 2024-04-25T15:45:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 -- 172.21.15.80:0/223192741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 msgr2=0x7fcc3406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/223192741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3406d4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009e50 tx=0x7fcc2c02a6c0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 -- 172.21.15.80:0/223192741 shutdown_connections 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/223192741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3406d4e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/223192741 >> v2:172.21.15.195:3300/0 conn(0x7fcc3409bea0 0x7fcc340ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 -- 172.21.15.80:0/223192741 >> 172.21.15.80:0/223192741 conn(0x7fcc340b7620 msgr2=0x7fcc340b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 -- 172.21.15.80:0/223192741 shutdown_connections 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.895+0000 7fcc39eb6640 1 -- 172.21.15.80:0/223192741 wait complete. 2024-04-25T15:45:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.897+0000 7fcc39eb6640 1 Processor -- start 2024-04-25T15:45:52.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.897+0000 7fcc39eb6640 1 -- start start 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc39eb6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3409d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc39eb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 0x7fcc3409ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc39eb6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc340d2830 0x7fcc3414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc39eb6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340ce8c0 con 0x7fcc3409bea0 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc39eb6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340cf040 con 0x7fcc340d2830 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc39eb6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc340cea40 con 0x7fcc3406d0d0 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 0x7fcc3409ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 0x7fcc3409ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49662/0 (socket says 172.21.15.80:49662) 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc32ffd640 1 -- 172.21.15.80:0/2998795765 learned_addr learned my addr 172.21.15.80:0/2998795765 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc337fe640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3409d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.898+0000 7fcc33fff640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc340d2830 0x7fcc3414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc32ffd640 1 -- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 msgr2=0x7fcc3409d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc32ffd640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3409d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc32ffd640 1 -- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc340d2830 msgr2=0x7fcc3414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc32ffd640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc340d2830 0x7fcc3414e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc32ffd640 1 -- 172.21.15.80:0/2998795765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340c6440 con 0x7fcc3409bea0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc32ffd640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 0x7fcc3409ffb0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3e0 tx=0x7fcc2800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28015020 con 0x7fcc3409bea0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28011850 con 0x7fcc3409bea0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc340c6940 con 0x7fcc3409bea0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28011c40 con 0x7fcc3409bea0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.899+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc340c6f00 con 0x7fcc3409bea0 2024-04-25T15:45:52.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.900+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc340c66b0 con 0x7fcc3409bea0 2024-04-25T15:45:52.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.900+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcc28018020 con 0x7fcc3409bea0 2024-04-25T15:45:52.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.901+0000 7fcc1bfff640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744e0 0x7fcc200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:52.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.901+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fcc28095420 con 0x7fcc3409bea0 2024-04-25T15:45:52.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.901+0000 7fcc337fe640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744e0 0x7fcc200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:52.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.901+0000 7fcc337fe640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744e0 0x7fcc200769f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcc3409c430 tx=0x7fcc24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:52.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:52.905+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc2801f020 con 0x7fcc3409bea0 2024-04-25T15:45:53.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.155+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcc3406ed60 con 0x7fcc3409bea0 2024-04-25T15:45:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.156+0000 7fcc1bfff640 1 -- 172.21.15.80:0/2998795765 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1565 (secure 0 0 0) 0x7fcc2805f980 con 0x7fcc3409bea0 2024-04-25T15:45:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:53.156 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":196,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":74,"num_osds":8,"num_up_osds":8,"osd_up_since":1714059768,"num_in_osds":8,"osd_in_since":1714059759,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":48},{"state_name":"creating+activating","count":29},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":591040,"bytes_used":246579200,"bytes_avail":772847534080,"bytes_total":773094113280,"inactive_pgs_ratio":0.50515460968017578,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":35,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6684}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-04-25T15:45:37.030179+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744e0 msgr2=0x7fcc200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744e0 0x7fcc200769f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcc3409c430 tx=0x7fcc24008040 comp rx=0 tx=0).stop 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 msgr2=0x7fcc3409ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 0x7fcc3409ffb0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3e0 tx=0x7fcc2800b8a0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 shutdown_connections 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744e0 0x7fcc200769f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc340d2830 0x7fcc3414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc3409bea0 0x7fcc3409ffb0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 --2- 172.21.15.80:0/2998795765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc3406d0d0 0x7fcc3409d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 >> 172.21.15.80:0/2998795765 conn(0x7fcc340b7620 msgr2=0x7fcc3406e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:53.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 shutdown_connections 2024-04-25T15:45:53.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.158+0000 7fcc39eb6640 1 -- 172.21.15.80:0/2998795765 wait complete. 2024-04-25T15:45:53.169 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T15:45:53.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:53.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.276+0000 7fef4d727640 1 Processor -- start 2024-04-25T15:45:53.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.276+0000 7fef4d727640 1 -- start start 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.277+0000 7fef4d727640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.277+0000 7fef4d727640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef480b1ef0 0x7fef480b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.277+0000 7fef4d727640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef481607c0 con 0x7fef480ce220 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.277+0000 7fef4d727640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fef480cf4d0 con 0x7fef480b1ef0 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.277+0000 7fef4d727640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef480ce630 con 0x7fef480cf960 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef480b1ef0 0x7fef480b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef480b1ef0 0x7fef480b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49664/0 (socket says 172.21.15.80:49664) 2024-04-25T15:45:53.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 -- 172.21.15.80:0/4280568312 learned_addr learned my addr 172.21.15.80:0/4280568312 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:53.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef467fc640 1 --2- 172.21.15.80:0/4280568312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:53.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 -- 172.21.15.80:0/4280568312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 msgr2=0x7fef480cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:53.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 --2- 172.21.15.80:0/4280568312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 -- 172.21.15.80:0/4280568312 >> v1:172.21.15.195:6789/0 conn(0x7fef480ce220 legacy=0x7fef4809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:53.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.278+0000 7fef477fe640 1 -- 172.21.15.80:0/4280568312 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480ceba0 con 0x7fef480b1ef0 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef477fe640 1 --2- 172.21.15.80:0/4280568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b2300 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fef40009870 tx=0x7fef4002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3056cb8264f08b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef45ffb640 1 -- 172.21.15.80:0/4280568312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40037070 con 0x7fef480b1ef0 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef45ffb640 1 -- 172.21.15.80:0/4280568312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40032440 con 0x7fef480b1ef0 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef45ffb640 1 -- 172.21.15.80:0/4280568312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40032810 con 0x7fef480b1ef0 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef4d727640 1 -- 172.21.15.80:0/4280568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 msgr2=0x7fef480b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef4d727640 1 --2- 172.21.15.80:0/4280568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b2300 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fef40009870 tx=0x7fef4002a2a0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef4d727640 1 -- 172.21.15.80:0/4280568312 shutdown_connections 2024-04-25T15:45:53.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef4d727640 1 --2- 172.21.15.80:0/4280568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b2300 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef4d727640 1 --2- 172.21.15.80:0/4280568312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.279+0000 7fef4d727640 1 -- 172.21.15.80:0/4280568312 >> 172.21.15.80:0/4280568312 conn(0x7fef480b7620 msgr2=0x7fef480b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:53.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.280+0000 7fef4d727640 1 -- 172.21.15.80:0/4280568312 shutdown_connections 2024-04-25T15:45:53.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.280+0000 7fef4d727640 1 -- 172.21.15.80:0/4280568312 wait complete. 2024-04-25T15:45:53.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.281+0000 7fef4d727640 1 Processor -- start 2024-04-25T15:45:53.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.281+0000 7fef4d727640 1 -- start start 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef480ce220 0x7fef481f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef480d3530 con 0x7fef480b1ef0 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fef480cf160 con 0x7fef480ce220 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef481f6630 con 0x7fef480cf960 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:53.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49674/0 (socket says 172.21.15.80:49674) 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 -- 172.21.15.80:0/2694986700 learned_addr learned my addr 172.21.15.80:0/2694986700 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef467fc640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef480ce220 0x7fef481f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef477fe640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 -- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 msgr2=0x7fef480cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 -- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef480ce220 msgr2=0x7fef481f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef480ce220 0x7fef481f60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 -- 172.21.15.80:0/2694986700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480b0030 con 0x7fef480b1ef0 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef467fc640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef480ce220 0x7fef481f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef46ffd640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b10d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fef3800ba80 tx=0x7fef3800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3800cc00 con 0x7fef480b1ef0 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3800cda0 con 0x7fef480b1ef0 2024-04-25T15:45:53.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38003bb0 con 0x7fef480b1ef0 2024-04-25T15:45:53.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef480b0310 con 0x7fef480b1ef0 2024-04-25T15:45:53.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.283+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef480b08d0 con 0x7fef480b1ef0 2024-04-25T15:45:53.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.284+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4806a100 con 0x7fef480b1ef0 2024-04-25T15:45:53.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.285+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fef38014440 con 0x7fef480b1ef0 2024-04-25T15:45:53.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.285+0000 7fef2f7fe640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef340744b0 0x7fef340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.286+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fef38095210 con 0x7fef480b1ef0 2024-04-25T15:45:53.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.286+0000 7fef467fc640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef340744b0 0x7fef340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:53.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.286+0000 7fef467fc640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef340744b0 0x7fef340769c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fef3c006fd0 tx=0x7fef3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:53.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.290+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef3805f250 con 0x7fef480b1ef0 2024-04-25T15:45:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.460+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef48151640 con 0x7fef340744b0 2024-04-25T15:45:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.466+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2694986700 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248282 (secure 0 0 0) 0x7fef3c00e820 con 0x7fef340744b0 2024-04-25T15:45:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef340744b0 msgr2=0x7fef340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef340744b0 0x7fef340769c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fef3c006fd0 tx=0x7fef3c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 msgr2=0x7fef480b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b10d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fef3800ba80 tx=0x7fef3800bf40 comp rx=0 tx=0).stop 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 shutdown_connections 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fef340744b0 0x7fef340769c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef480cf960 0x7fef480cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef480ce220 0x7fef481f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 --2- 172.21.15.80:0/2694986700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef480b1ef0 0x7fef480b10d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 >> 172.21.15.80:0/2694986700 conn(0x7fef480b7620 msgr2=0x7fef480710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:53.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 shutdown_connections 2024-04-25T15:45:53.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:53.469+0000 7fef4d727640 1 -- 172.21.15.80:0/2694986700 wait complete. 2024-04-25T15:45:53.481 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T15:45:53.032913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240800,"kb_used_data":7972,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733920,"statfs":{"total":773094113280,"available":772847534080,"internally_reserved":0,"allocated":8163328,"data_stored":4307791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001081"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018731+0000","last_change":"2024-04-25T15:45:48.018731+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018731+0000","last_undegraded":"2024-04-25T15:45:48.018731+0000","last_fullsized":"2024-04-25T15:45:48.018731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023863+0000","last_change":"2024-04-25T15:45:49.023863+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023863+0000","last_undegraded":"2024-04-25T15:45:49.023863+0000","last_fullsized":"2024-04-25T15:45:49.023863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028092+0000","last_change":"2024-04-25T15:45:49.028092+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028092+0000","last_undegraded":"2024-04-25T15:45:49.028092+0000","last_fullsized":"2024-04-25T15:45:49.028092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.029372+0000","last_change":"2024-04-25T15:45:48.029372+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.029372+0000","last_undegraded":"2024-04-25T15:45:48.029372+0000","last_fullsized":"2024-04-25T15:45:48.029372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024738+0000","last_change":"2024-04-25T15:45:49.024738+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024738+0000","last_undegraded":"2024-04-25T15:45:49.024738+0000","last_fullsized":"2024-04-25T15:45:49.024738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029845+0000","last_change":"2024-04-25T15:45:49.029845+0000","last_active":"2024-04-25T15:45:49.029845+0000","last_peered":"2024-04-25T15:45:49.029845+0000","last_clean":"2024-04-25T15:45:49.029845+0000","last_became_active":"2024-04-25T15:45:49.029552+0000","last_became_peered":"2024-04-25T15:45:49.029552+0000","last_unstale":"2024-04-25T15:45:49.029845+0000","last_undegraded":"2024-04-25T15:45:49.029845+0000","last_fullsized":"2024-04-25T15:45:49.029845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:39.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019213+0000","last_change":"2024-04-25T15:45:49.019213+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019213+0000","last_undegraded":"2024-04-25T15:45:49.019213+0000","last_fullsized":"2024-04-25T15:45:49.019213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024119+0000","last_change":"2024-04-25T15:45:49.024119+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024119+0000","last_undegraded":"2024-04-25T15:45:49.024119+0000","last_fullsized":"2024-04-25T15:45:49.024119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015600+0000","last_change":"2024-04-25T15:45:48.015600+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015600+0000","last_undegraded":"2024-04-25T15:45:48.015600+0000","last_fullsized":"2024-04-25T15:45:48.015600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028438+0000","last_change":"2024-04-25T15:45:48.028438+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028438+0000","last_undegraded":"2024-04-25T15:45:48.028438+0000","last_fullsized":"2024-04-25T15:45:48.028438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022300+0000","last_change":"2024-04-25T15:45:49.022300+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022300+0000","last_undegraded":"2024-04-25T15:45:49.022300+0000","last_fullsized":"2024-04-25T15:45:49.022300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028853+0000","last_change":"2024-04-25T15:45:48.028853+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028853+0000","last_undegraded":"2024-04-25T15:45:48.028853+0000","last_fullsized":"2024-04-25T15:45:48.028853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025139+0000","last_change":"2024-04-25T15:45:49.025139+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025139+0000","last_undegraded":"2024-04-25T15:45:49.025139+0000","last_fullsized":"2024-04-25T15:45:49.025139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.029074+0000","last_change":"2024-04-25T15:45:49.029074+0000","last_active":"2024-04-25T15:45:49.029074+0000","last_peered":"2024-04-25T15:45:49.029074+0000","last_clean":"2024-04-25T15:45:49.029074+0000","last_became_active":"2024-04-25T15:45:49.028755+0000","last_became_peered":"2024-04-25T15:45:49.028755+0000","last_unstale":"2024-04-25T15:45:49.029074+0000","last_undegraded":"2024-04-25T15:45:49.029074+0000","last_fullsized":"2024-04-25T15:45:49.029074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:52.521122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022077+0000","last_change":"2024-04-25T15:45:49.022077+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022077+0000","last_undegraded":"2024-04-25T15:45:49.022077+0000","last_fullsized":"2024-04-25T15:45:49.022077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016251+0000","last_change":"2024-04-25T15:45:48.016251+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016251+0000","last_undegraded":"2024-04-25T15:45:48.016251+0000","last_fullsized":"2024-04-25T15:45:48.016251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.023201+0000","last_change":"2024-04-25T15:45:49.023201+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.023201+0000","last_undegraded":"2024-04-25T15:45:49.023201+0000","last_fullsized":"2024-04-25T15:45:49.023201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028512+0000","last_change":"2024-04-25T15:45:49.028512+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028512+0000","last_undegraded":"2024-04-25T15:45:49.028512+0000","last_fullsized":"2024-04-25T15:45:49.028512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.034922+0000","last_change":"2024-04-25T15:45:49.034922+0000","last_active":"2024-04-25T15:45:49.034922+0000","last_peered":"2024-04-25T15:45:49.034922+0000","last_clean":"2024-04-25T15:45:49.034922+0000","last_became_active":"2024-04-25T15:45:49.034583+0000","last_became_peered":"2024-04-25T15:45:49.034583+0000","last_unstale":"2024-04-25T15:45:49.034922+0000","last_undegraded":"2024-04-25T15:45:49.034922+0000","last_fullsized":"2024-04-25T15:45:49.034922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:36.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022440+0000","last_change":"2024-04-25T15:45:49.022440+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022440+0000","last_undegraded":"2024-04-25T15:45:49.022440+0000","last_fullsized":"2024-04-25T15:45:49.022440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016724+0000","last_change":"2024-04-25T15:45:48.016724+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016724+0000","last_undegraded":"2024-04-25T15:45:48.016724+0000","last_fullsized":"2024-04-25T15:45:48.016724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.026259+0000","last_change":"2024-04-25T15:45:49.026259+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.026259+0000","last_undegraded":"2024-04-25T15:45:49.026259+0000","last_fullsized":"2024-04-25T15:45:49.026259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015647+0000","last_change":"2024-04-25T15:45:48.015647+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015647+0000","last_undegraded":"2024-04-25T15:45:48.015647+0000","last_fullsized":"2024-04-25T15:45:48.015647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022012+0000","last_change":"2024-04-25T15:45:49.022012+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022012+0000","last_undegraded":"2024-04-25T15:45:49.022012+0000","last_fullsized":"2024-04-25T15:45:49.022012+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022749+0000","last_change":"2024-04-25T15:45:49.022749+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022749+0000","last_undegraded":"2024-04-25T15:45:49.022749+0000","last_fullsized":"2024-04-25T15:45:49.022749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.027913+0000","last_change":"2024-04-25T15:45:48.027913+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.027913+0000","last_undegraded":"2024-04-25T15:45:48.027913+0000","last_fullsized":"2024-04-25T15:45:48.027913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017398+0000","last_change":"2024-04-25T15:45:48.017398+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017398+0000","last_undegraded":"2024-04-25T15:45:48.017398+0000","last_fullsized":"2024-04-25T15:45:48.017398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022792+0000","last_change":"2024-04-25T15:45:49.022792+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022792+0000","last_undegraded":"2024-04-25T15:45:49.022792+0000","last_fullsized":"2024-04-25T15:45:49.022792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.036903+0000","last_change":"2024-04-25T15:45:49.035131+0000","last_active":"2024-04-25T15:45:49.036903+0000","last_peered":"2024-04-25T15:45:49.036903+0000","last_clean":"2024-04-25T15:45:49.036903+0000","last_became_active":"2024-04-25T15:45:49.034817+0000","last_became_peered":"2024-04-25T15:45:49.034817+0000","last_unstale":"2024-04-25T15:45:49.036903+0000","last_undegraded":"2024-04-25T15:45:49.036903+0000","last_fullsized":"2024-04-25T15:45:49.036903+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:08.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017915+0000","last_change":"2024-04-25T15:45:48.017915+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017915+0000","last_undegraded":"2024-04-25T15:45:48.017915+0000","last_fullsized":"2024-04-25T15:45:48.017915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.038316+0000","last_change":"2024-04-25T15:45:49.027721+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.038316+0000","last_undegraded":"2024-04-25T15:45:49.038316+0000","last_fullsized":"2024-04-25T15:45:49.038316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015713+0000","last_change":"2024-04-25T15:45:48.015713+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015713+0000","last_undegraded":"2024-04-25T15:45:48.015713+0000","last_fullsized":"2024-04-25T15:45:48.015713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030741+0000","last_change":"2024-04-25T15:45:49.030741+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030741+0000","last_undegraded":"2024-04-25T15:45:49.030741+0000","last_fullsized":"2024-04-25T15:45:49.030741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023487+0000","last_change":"2024-04-25T15:45:48.039764+0000","last_active":"2024-04-25T15:45:49.023487+0000","last_peered":"2024-04-25T15:45:49.023487+0000","last_clean":"2024-04-25T15:45:49.023487+0000","last_became_active":"2024-04-25T15:45:48.039397+0000","last_became_peered":"2024-04-25T15:45:48.039397+0000","last_unstale":"2024-04-25T15:45:49.023487+0000","last_undegraded":"2024-04-25T15:45:49.023487+0000","last_fullsized":"2024-04-25T15:45:49.023487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:19.962659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035334+0000","last_change":"2024-04-25T15:45:49.031788+0000","last_active":"2024-04-25T15:45:49.035334+0000","last_peered":"2024-04-25T15:45:49.035334+0000","last_clean":"2024-04-25T15:45:49.035334+0000","last_became_active":"2024-04-25T15:45:49.031493+0000","last_became_peered":"2024-04-25T15:45:49.031493+0000","last_unstale":"2024-04-25T15:45:49.035334+0000","last_undegraded":"2024-04-25T15:45:49.035334+0000","last_fullsized":"2024-04-25T15:45:49.035334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:01.670130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031654+0000","last_change":"2024-04-25T15:45:48.027890+0000","last_active":"2024-04-25T15:45:48.031654+0000","last_peered":"2024-04-25T15:45:48.031654+0000","last_clean":"2024-04-25T15:45:48.031654+0000","last_became_active":"2024-04-25T15:45:48.026687+0000","last_became_peered":"2024-04-25T15:45:48.026687+0000","last_unstale":"2024-04-25T15:45:48.031654+0000","last_undegraded":"2024-04-25T15:45:48.031654+0000","last_fullsized":"2024-04-25T15:45:48.031654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.311840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.018421+0000","last_change":"2024-04-25T15:45:48.018421+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.018421+0000","last_undegraded":"2024-04-25T15:45:48.018421+0000","last_fullsized":"2024-04-25T15:45:48.018421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.037025+0000","last_change":"2024-04-25T15:45:48.035315+0000","last_active":"2024-04-25T15:45:48.037025+0000","last_peered":"2024-04-25T15:45:48.037025+0000","last_clean":"2024-04-25T15:45:48.037025+0000","last_became_active":"2024-04-25T15:45:48.034967+0000","last_became_peered":"2024-04-25T15:45:48.034967+0000","last_unstale":"2024-04-25T15:45:48.037025+0000","last_undegraded":"2024-04-25T15:45:48.037025+0000","last_fullsized":"2024-04-25T15:45:48.037025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:00.668039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016159+0000","last_change":"2024-04-25T15:45:48.016159+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016159+0000","last_undegraded":"2024-04-25T15:45:48.016159+0000","last_fullsized":"2024-04-25T15:45:48.016159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041363+0000","last_change":"2024-04-25T15:45:48.034036+0000","last_active":"2024-04-25T15:45:49.041363+0000","last_peered":"2024-04-25T15:45:49.041363+0000","last_clean":"2024-04-25T15:45:49.041363+0000","last_became_active":"2024-04-25T15:45:48.033687+0000","last_became_peered":"2024-04-25T15:45:48.033687+0000","last_unstale":"2024-04-25T15:45:49.041363+0000","last_undegraded":"2024-04-25T15:45:49.041363+0000","last_fullsized":"2024-04-25T15:45:49.041363+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:15.263609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022992+0000","last_change":"2024-04-25T15:45:49.022992+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022992+0000","last_undegraded":"2024-04-25T15:45:49.022992+0000","last_fullsized":"2024-04-25T15:45:49.022992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035079+0000","last_change":"2024-04-25T15:45:48.033192+0000","last_active":"2024-04-25T15:45:48.035079+0000","last_peered":"2024-04-25T15:45:48.035079+0000","last_clean":"2024-04-25T15:45:48.035079+0000","last_became_active":"2024-04-25T15:45:48.032675+0000","last_became_peered":"2024-04-25T15:45:48.032675+0000","last_unstale":"2024-04-25T15:45:48.035079+0000","last_undegraded":"2024-04-25T15:45:48.035079+0000","last_fullsized":"2024-04-25T15:45:48.035079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:29.955933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022681+0000","last_change":"2024-04-25T15:45:49.022681+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022681+0000","last_undegraded":"2024-04-25T15:45:49.022681+0000","last_fullsized":"2024-04-25T15:45:49.022681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.040085+0000","last_change":"2024-04-25T15:45:48.039562+0000","last_active":"2024-04-25T15:45:48.040085+0000","last_peered":"2024-04-25T15:45:48.040085+0000","last_clean":"2024-04-25T15:45:48.040085+0000","last_became_active":"2024-04-25T15:45:48.039300+0000","last_became_peered":"2024-04-25T15:45:48.039300+0000","last_unstale":"2024-04-25T15:45:48.040085+0000","last_undegraded":"2024-04-25T15:45:48.040085+0000","last_fullsized":"2024-04-25T15:45:48.040085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015499+0000","last_change":"2024-04-25T15:45:48.015499+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015499+0000","last_undegraded":"2024-04-25T15:45:48.015499+0000","last_fullsized":"2024-04-25T15:45:48.015499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022955+0000","last_change":"2024-04-25T15:45:48.035584+0000","last_active":"2024-04-25T15:45:49.022955+0000","last_peered":"2024-04-25T15:45:49.022955+0000","last_clean":"2024-04-25T15:45:49.022955+0000","last_became_active":"2024-04-25T15:45:48.034409+0000","last_became_peered":"2024-04-25T15:45:48.034409+0000","last_unstale":"2024-04-25T15:45:49.022955+0000","last_undegraded":"2024-04-25T15:45:49.022955+0000","last_fullsized":"2024-04-25T15:45:49.022955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.019645+0000","last_change":"2024-04-25T15:45:49.019645+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.019645+0000","last_undegraded":"2024-04-25T15:45:49.019645+0000","last_fullsized":"2024-04-25T15:45:49.019645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024427+0000","last_change":"2024-04-25T15:45:48.031484+0000","last_active":"2024-04-25T15:45:49.024427+0000","last_peered":"2024-04-25T15:45:49.024427+0000","last_clean":"2024-04-25T15:45:49.024427+0000","last_became_active":"2024-04-25T15:45:48.031166+0000","last_became_peered":"2024-04-25T15:45:48.031166+0000","last_unstale":"2024-04-25T15:45:49.024427+0000","last_undegraded":"2024-04-25T15:45:49.024427+0000","last_fullsized":"2024-04-25T15:45:49.024427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:59.353521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.022274+0000","last_change":"2024-04-25T15:45:49.022274+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.022274+0000","last_undegraded":"2024-04-25T15:45:49.022274+0000","last_fullsized":"2024-04-25T15:45:49.022274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031663+0000","last_change":"2024-04-25T15:45:48.027388+0000","last_active":"2024-04-25T15:45:48.031663+0000","last_peered":"2024-04-25T15:45:48.031663+0000","last_clean":"2024-04-25T15:45:48.031663+0000","last_became_active":"2024-04-25T15:45:48.026972+0000","last_became_peered":"2024-04-25T15:45:48.026972+0000","last_unstale":"2024-04-25T15:45:48.031663+0000","last_undegraded":"2024-04-25T15:45:48.031663+0000","last_fullsized":"2024-04-25T15:45:48.031663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:12.145300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.026459+0000","last_change":"2024-04-25T15:45:48.026459+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.026459+0000","last_undegraded":"2024-04-25T15:45:48.026459+0000","last_fullsized":"2024-04-25T15:45:48.026459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036696+0000","last_change":"2024-04-25T15:45:48.035924+0000","last_active":"2024-04-25T15:45:48.036696+0000","last_peered":"2024-04-25T15:45:48.036696+0000","last_clean":"2024-04-25T15:45:48.036696+0000","last_became_active":"2024-04-25T15:45:48.035502+0000","last_became_peered":"2024-04-25T15:45:48.035502+0000","last_unstale":"2024-04-25T15:45:48.036696+0000","last_undegraded":"2024-04-25T15:45:48.036696+0000","last_fullsized":"2024-04-25T15:45:48.036696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018187+0000","last_change":"2024-04-25T15:45:49.018187+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018187+0000","last_undegraded":"2024-04-25T15:45:49.018187+0000","last_fullsized":"2024-04-25T15:45:49.018187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023677+0000","last_change":"2024-04-25T15:45:48.029162+0000","last_active":"2024-04-25T15:45:49.023677+0000","last_peered":"2024-04-25T15:45:49.023677+0000","last_clean":"2024-04-25T15:45:49.023677+0000","last_became_active":"2024-04-25T15:45:48.028855+0000","last_became_peered":"2024-04-25T15:45:48.028855+0000","last_unstale":"2024-04-25T15:45:49.023677+0000","last_undegraded":"2024-04-25T15:45:49.023677+0000","last_fullsized":"2024-04-25T15:45:49.023677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:51.952928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.030726+0000","last_change":"2024-04-25T15:45:49.030726+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.030726+0000","last_undegraded":"2024-04-25T15:45:49.030726+0000","last_fullsized":"2024-04-25T15:45:49.030726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'5","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.020492+0000","last_change":"2024-04-25T15:45:48.025186+0000","last_active":"2024-04-25T15:45:49.020492+0000","last_peered":"2024-04-25T15:45:49.020492+0000","last_clean":"2024-04-25T15:45:49.020492+0000","last_became_active":"2024-04-25T15:45:48.024784+0000","last_became_peered":"2024-04-25T15:45:48.024784+0000","last_unstale":"2024-04-25T15:45:49.020492+0000","last_undegraded":"2024-04-25T15:45:49.020492+0000","last_fullsized":"2024-04-25T15:45:49.020492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:22.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.028357+0000","last_change":"2024-04-25T15:45:48.028357+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.028357+0000","last_undegraded":"2024-04-25T15:45:48.028357+0000","last_fullsized":"2024-04-25T15:45:48.028357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035546+0000","last_change":"2024-04-25T15:45:48.032275+0000","last_active":"2024-04-25T15:45:48.035546+0000","last_peered":"2024-04-25T15:45:48.035546+0000","last_clean":"2024-04-25T15:45:48.035546+0000","last_became_active":"2024-04-25T15:45:48.031954+0000","last_became_peered":"2024-04-25T15:45:48.031954+0000","last_unstale":"2024-04-25T15:45:48.035546+0000","last_undegraded":"2024-04-25T15:45:48.035546+0000","last_fullsized":"2024-04-25T15:45:48.035546+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:52.683379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.018834+0000","last_change":"2024-04-25T15:45:49.018834+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.018834+0000","last_undegraded":"2024-04-25T15:45:49.018834+0000","last_fullsized":"2024-04-25T15:45:49.018834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036583+0000","last_change":"2024-04-25T15:45:48.034555+0000","last_active":"2024-04-25T15:45:48.036583+0000","last_peered":"2024-04-25T15:45:48.036583+0000","last_clean":"2024-04-25T15:45:48.036583+0000","last_became_active":"2024-04-25T15:45:48.034231+0000","last_became_peered":"2024-04-25T15:45:48.034231+0000","last_unstale":"2024-04-25T15:45:48.036583+0000","last_undegraded":"2024-04-25T15:45:48.036583+0000","last_fullsized":"2024-04-25T15:45:48.036583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.035068+0000","last_change":"2024-04-25T15:45:49.031420+0000","last_active":"2024-04-25T15:45:49.035068+0000","last_peered":"2024-04-25T15:45:49.035068+0000","last_clean":"2024-04-25T15:45:49.035068+0000","last_became_active":"2024-04-25T15:45:49.031020+0000","last_became_peered":"2024-04-25T15:45:49.031020+0000","last_unstale":"2024-04-25T15:45:49.035068+0000","last_undegraded":"2024-04-25T15:45:49.035068+0000","last_fullsized":"2024-04-25T15:45:49.035068+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:29.199964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.025629+0000","last_change":"2024-04-25T15:45:48.037474+0000","last_active":"2024-04-25T15:45:49.025629+0000","last_peered":"2024-04-25T15:45:49.025629+0000","last_clean":"2024-04-25T15:45:49.025629+0000","last_became_active":"2024-04-25T15:45:48.037137+0000","last_became_peered":"2024-04-25T15:45:48.037137+0000","last_unstale":"2024-04-25T15:45:49.025629+0000","last_undegraded":"2024-04-25T15:45:49.025629+0000","last_fullsized":"2024-04-25T15:45:49.025629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:46.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040575+0000","last_change":"2024-04-25T15:45:49.039181+0000","last_active":"2024-04-25T15:45:49.040575+0000","last_peered":"2024-04-25T15:45:49.040575+0000","last_clean":"2024-04-25T15:45:49.040575+0000","last_became_active":"2024-04-25T15:45:49.038832+0000","last_became_peered":"2024-04-25T15:45:49.038832+0000","last_unstale":"2024-04-25T15:45:49.040575+0000","last_undegraded":"2024-04-25T15:45:49.040575+0000","last_fullsized":"2024-04-25T15:45:49.040575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:44.172577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.022379+0000","last_change":"2024-04-25T15:45:48.034495+0000","last_active":"2024-04-25T15:45:49.022379+0000","last_peered":"2024-04-25T15:45:49.022379+0000","last_clean":"2024-04-25T15:45:49.022379+0000","last_became_active":"2024-04-25T15:45:48.034171+0000","last_became_peered":"2024-04-25T15:45:48.034171+0000","last_unstale":"2024-04-25T15:45:49.022379+0000","last_undegraded":"2024-04-25T15:45:49.022379+0000","last_fullsized":"2024-04-25T15:45:49.022379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030626+0000","last_change":"2024-04-25T15:45:49.030626+0000","last_active":"2024-04-25T15:45:49.030626+0000","last_peered":"2024-04-25T15:45:49.030626+0000","last_clean":"2024-04-25T15:45:49.030626+0000","last_became_active":"2024-04-25T15:45:49.030305+0000","last_became_peered":"2024-04-25T15:45:49.030305+0000","last_unstale":"2024-04-25T15:45:49.030626+0000","last_undegraded":"2024-04-25T15:45:49.030626+0000","last_fullsized":"2024-04-25T15:45:49.030626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.212910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033931+0000","last_change":"2024-04-25T15:45:48.030606+0000","last_active":"2024-04-25T15:45:48.033931+0000","last_peered":"2024-04-25T15:45:48.033931+0000","last_clean":"2024-04-25T15:45:48.033931+0000","last_became_active":"2024-04-25T15:45:48.030252+0000","last_became_peered":"2024-04-25T15:45:48.030252+0000","last_unstale":"2024-04-25T15:45:48.033931+0000","last_undegraded":"2024-04-25T15:45:48.033931+0000","last_fullsized":"2024-04-25T15:45:48.033931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.020571+0000","last_change":"2024-04-25T15:45:49.020571+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.020571+0000","last_undegraded":"2024-04-25T15:45:49.020571+0000","last_fullsized":"2024-04-25T15:45:49.020571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.033071+0000","last_change":"2024-04-25T15:45:48.031558+0000","last_active":"2024-04-25T15:45:48.033071+0000","last_peered":"2024-04-25T15:45:48.033071+0000","last_clean":"2024-04-25T15:45:48.033071+0000","last_became_active":"2024-04-25T15:45:48.030245+0000","last_became_peered":"2024-04-25T15:45:48.030245+0000","last_unstale":"2024-04-25T15:45:48.033071+0000","last_undegraded":"2024-04-25T15:45:48.033071+0000","last_fullsized":"2024-04-25T15:45:48.033071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:38:06.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.025889+0000","last_change":"2024-04-25T15:45:49.025889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.025889+0000","last_undegraded":"2024-04-25T15:45:49.025889+0000","last_fullsized":"2024-04-25T15:45:49.025889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.023844+0000","last_change":"2024-04-25T15:45:48.032149+0000","last_active":"2024-04-25T15:45:49.023844+0000","last_peered":"2024-04-25T15:45:49.023844+0000","last_clean":"2024-04-25T15:45:49.023844+0000","last_became_active":"2024-04-25T15:45:48.031853+0000","last_became_peered":"2024-04-25T15:45:48.031853+0000","last_unstale":"2024-04-25T15:45:49.023844+0000","last_undegraded":"2024-04-25T15:45:49.023844+0000","last_fullsized":"2024-04-25T15:45:49.023844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:11.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030640+0000","last_change":"2024-04-25T15:45:49.030640+0000","last_active":"2024-04-25T15:45:49.030640+0000","last_peered":"2024-04-25T15:45:49.030640+0000","last_clean":"2024-04-25T15:45:49.030640+0000","last_became_active":"2024-04-25T15:45:49.030331+0000","last_became_peered":"2024-04-25T15:45:49.030331+0000","last_unstale":"2024-04-25T15:45:49.030640+0000","last_undegraded":"2024-04-25T15:45:49.030640+0000","last_fullsized":"2024-04-25T15:45:49.030640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:48.687335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.030273+0000","last_change":"2024-04-25T15:45:48.033544+0000","last_active":"2024-04-25T15:45:49.030273+0000","last_peered":"2024-04-25T15:45:49.030273+0000","last_clean":"2024-04-25T15:45:49.030273+0000","last_became_active":"2024-04-25T15:45:48.033248+0000","last_became_peered":"2024-04-25T15:45:48.033248+0000","last_unstale":"2024-04-25T15:45:49.030273+0000","last_undegraded":"2024-04-25T15:45:49.030273+0000","last_fullsized":"2024-04-25T15:45:49.030273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:09.595887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037533+0000","last_change":"2024-04-25T15:45:49.033989+0000","last_active":"2024-04-25T15:45:49.037533+0000","last_peered":"2024-04-25T15:45:49.037533+0000","last_clean":"2024-04-25T15:45:49.037533+0000","last_became_active":"2024-04-25T15:45:49.033692+0000","last_became_peered":"2024-04-25T15:45:49.033692+0000","last_unstale":"2024-04-25T15:45:49.037533+0000","last_undegraded":"2024-04-25T15:45:49.037533+0000","last_fullsized":"2024-04-25T15:45:49.037533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:20.697315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017353+0000","last_change":"2024-04-25T15:45:48.026000+0000","last_active":"2024-04-25T15:45:49.017353+0000","last_peered":"2024-04-25T15:45:49.017353+0000","last_clean":"2024-04-25T15:45:49.017353+0000","last_became_active":"2024-04-25T15:45:48.025670+0000","last_became_peered":"2024-04-25T15:45:48.025670+0000","last_unstale":"2024-04-25T15:45:49.017353+0000","last_undegraded":"2024-04-25T15:45:49.017353+0000","last_fullsized":"2024-04-25T15:45:49.017353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:55.222065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.024245+0000","last_change":"2024-04-25T15:45:49.024245+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.024245+0000","last_undegraded":"2024-04-25T15:45:49.024245+0000","last_fullsized":"2024-04-25T15:45:49.024245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.017282+0000","last_change":"2024-04-25T15:45:48.028925+0000","last_active":"2024-04-25T15:45:49.017282+0000","last_peered":"2024-04-25T15:45:49.017282+0000","last_clean":"2024-04-25T15:45:49.017282+0000","last_became_active":"2024-04-25T15:45:48.028353+0000","last_became_peered":"2024-04-25T15:45:48.028353+0000","last_unstale":"2024-04-25T15:45:49.017282+0000","last_undegraded":"2024-04-25T15:45:49.017282+0000","last_fullsized":"2024-04-25T15:45:49.017282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:28.927396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039375+0000","last_change":"2024-04-25T15:45:49.032361+0000","last_active":"2024-04-25T15:45:49.039375+0000","last_peered":"2024-04-25T15:45:49.039375+0000","last_clean":"2024-04-25T15:45:49.039375+0000","last_became_active":"2024-04-25T15:45:49.032084+0000","last_became_peered":"2024-04-25T15:45:49.032084+0000","last_unstale":"2024-04-25T15:45:49.039375+0000","last_undegraded":"2024-04-25T15:45:49.039375+0000","last_fullsized":"2024-04-25T15:45:49.039375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:30.993146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.016982+0000","last_change":"2024-04-25T15:45:48.027883+0000","last_active":"2024-04-25T15:45:49.016982+0000","last_peered":"2024-04-25T15:45:49.016982+0000","last_clean":"2024-04-25T15:45:49.016982+0000","last_became_active":"2024-04-25T15:45:48.027582+0000","last_became_peered":"2024-04-25T15:45:48.027582+0000","last_unstale":"2024-04-25T15:45:49.016982+0000","last_undegraded":"2024-04-25T15:45:49.016982+0000","last_fullsized":"2024-04-25T15:45:49.016982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:07.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.015824+0000","last_change":"2024-04-25T15:45:48.015824+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.015824+0000","last_undegraded":"2024-04-25T15:45:48.015824+0000","last_fullsized":"2024-04-25T15:45:48.015824+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.036123+0000","last_change":"2024-04-25T15:45:48.035036+0000","last_active":"2024-04-25T15:45:48.036123+0000","last_peered":"2024-04-25T15:45:48.036123+0000","last_clean":"2024-04-25T15:45:48.036123+0000","last_became_active":"2024-04-25T15:45:48.034635+0000","last_became_peered":"2024-04-25T15:45:48.034635+0000","last_unstale":"2024-04-25T15:45:48.036123+0000","last_undegraded":"2024-04-25T15:45:48.036123+0000","last_fullsized":"2024-04-25T15:45:48.036123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:39.304770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.039371+0000","last_change":"2024-04-25T15:45:49.031634+0000","last_active":"2024-04-25T15:45:49.039371+0000","last_peered":"2024-04-25T15:45:49.039371+0000","last_clean":"2024-04-25T15:45:49.039371+0000","last_became_active":"2024-04-25T15:45:49.030687+0000","last_became_peered":"2024-04-25T15:45:49.030687+0000","last_unstale":"2024-04-25T15:45:49.039371+0000","last_undegraded":"2024-04-25T15:45:49.039371+0000","last_fullsized":"2024-04-25T15:45:49.039371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:10.597978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.024523+0000","last_change":"2024-04-25T15:45:48.040359+0000","last_active":"2024-04-25T15:45:49.024523+0000","last_peered":"2024-04-25T15:45:49.024523+0000","last_clean":"2024-04-25T15:45:49.024523+0000","last_became_active":"2024-04-25T15:45:48.040028+0000","last_became_peered":"2024-04-25T15:45:48.040028+0000","last_unstale":"2024-04-25T15:45:49.024523+0000","last_undegraded":"2024-04-25T15:45:49.024523+0000","last_fullsized":"2024-04-25T15:45:49.024523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.017889+0000","last_change":"2024-04-25T15:45:48.017889+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.017889+0000","last_undegraded":"2024-04-25T15:45:48.017889+0000","last_fullsized":"2024-04-25T15:45:48.017889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.035226+0000","last_change":"2024-04-25T15:45:48.032412+0000","last_active":"2024-04-25T15:45:48.035226+0000","last_peered":"2024-04-25T15:45:48.035226+0000","last_clean":"2024-04-25T15:45:48.035226+0000","last_became_active":"2024-04-25T15:45:48.032095+0000","last_became_peered":"2024-04-25T15:45:48.032095+0000","last_unstale":"2024-04-25T15:45:48.035226+0000","last_undegraded":"2024-04-25T15:45:48.035226+0000","last_fullsized":"2024-04-25T15:45:48.035226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.037021+0000","last_change":"2024-04-25T15:45:49.037021+0000","last_active":"2024-04-25T15:45:49.037021+0000","last_peered":"2024-04-25T15:45:49.037021+0000","last_clean":"2024-04-25T15:45:49.037021+0000","last_became_active":"2024-04-25T15:45:49.036709+0000","last_became_peered":"2024-04-25T15:45:49.036709+0000","last_unstale":"2024-04-25T15:45:49.037021+0000","last_undegraded":"2024-04-25T15:45:49.037021+0000","last_fullsized":"2024-04-25T15:45:49.037021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:29.929487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.031635+0000","last_change":"2024-04-25T15:45:48.026477+0000","last_active":"2024-04-25T15:45:48.031635+0000","last_peered":"2024-04-25T15:45:48.031635+0000","last_clean":"2024-04-25T15:45:48.031635+0000","last_became_active":"2024-04-25T15:45:48.026123+0000","last_became_peered":"2024-04-25T15:45:48.026123+0000","last_unstale":"2024-04-25T15:45:48.031635+0000","last_undegraded":"2024-04-25T15:45:48.031635+0000","last_fullsized":"2024-04-25T15:45:48.031635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.806290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.041247+0000","last_change":"2024-04-25T15:45:49.041247+0000","last_active":"2024-04-25T15:45:49.041247+0000","last_peered":"2024-04-25T15:45:49.041247+0000","last_clean":"2024-04-25T15:45:49.041247+0000","last_became_active":"2024-04-25T15:45:49.040773+0000","last_became_peered":"2024-04-25T15:45:49.040773+0000","last_unstale":"2024-04-25T15:45:49.041247+0000","last_undegraded":"2024-04-25T15:45:49.041247+0000","last_fullsized":"2024-04-25T15:45:49.041247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:45.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019955+0000","last_change":"2024-04-25T15:45:48.032005+0000","last_active":"2024-04-25T15:45:49.019955+0000","last_peered":"2024-04-25T15:45:49.019955+0000","last_clean":"2024-04-25T15:45:49.019955+0000","last_became_active":"2024-04-25T15:45:48.031690+0000","last_became_peered":"2024-04-25T15:45:48.031690+0000","last_unstale":"2024-04-25T15:45:49.019955+0000","last_undegraded":"2024-04-25T15:45:49.019955+0000","last_fullsized":"2024-04-25T15:45:49.019955+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:03.901419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.040490+0000","last_change":"2024-04-25T15:45:49.035767+0000","last_active":"2024-04-25T15:45:49.040490+0000","last_peered":"2024-04-25T15:45:49.040490+0000","last_clean":"2024-04-25T15:45:49.040490+0000","last_became_active":"2024-04-25T15:45:49.035455+0000","last_became_peered":"2024-04-25T15:45:49.035455+0000","last_unstale":"2024-04-25T15:45:49.040490+0000","last_undegraded":"2024-04-25T15:45:49.040490+0000","last_fullsized":"2024-04-25T15:45:49.040490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:40.412201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.026369+0000","last_change":"2024-04-25T15:45:48.039813+0000","last_active":"2024-04-25T15:45:49.026369+0000","last_peered":"2024-04-25T15:45:49.026369+0000","last_clean":"2024-04-25T15:45:49.026369+0000","last_became_active":"2024-04-25T15:45:48.039488+0000","last_became_peered":"2024-04-25T15:45:48.039488+0000","last_unstale":"2024-04-25T15:45:49.026369+0000","last_undegraded":"2024-04-25T15:45:49.026369+0000","last_fullsized":"2024-04-25T15:45:49.026369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:11.300706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.028334+0000","last_change":"2024-04-25T15:45:49.028334+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.028334+0000","last_undegraded":"2024-04-25T15:45:49.028334+0000","last_fullsized":"2024-04-25T15:45:49.028334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.019744+0000","last_change":"2024-04-25T15:45:48.025876+0000","last_active":"2024-04-25T15:45:49.019744+0000","last_peered":"2024-04-25T15:45:49.019744+0000","last_clean":"2024-04-25T15:45:49.019744+0000","last_became_active":"2024-04-25T15:45:48.025572+0000","last_became_peered":"2024-04-25T15:45:48.025572+0000","last_unstale":"2024-04-25T15:45:49.019744+0000","last_undegraded":"2024-04-25T15:45:49.019744+0000","last_fullsized":"2024-04-25T15:45:49.019744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.253552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":4,"reported_epoch":73,"state":"creating+activating","last_fresh":"2024-04-25T15:45:49.037634+0000","last_change":"2024-04-25T15:45:49.031169+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:49.037634+0000","last_undegraded":"2024-04-25T15:45:49.037634+0000","last_fullsized":"2024-04-25T15:45:49.037634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.031053+0000","last_change":"2024-04-25T15:45:48.027979+0000","last_active":"2024-04-25T15:45:49.031053+0000","last_peered":"2024-04-25T15:45:49.031053+0000","last_clean":"2024-04-25T15:45:49.031053+0000","last_became_active":"2024-04-25T15:45:48.027663+0000","last_became_peered":"2024-04-25T15:45:48.027663+0000","last_unstale":"2024-04-25T15:45:49.031053+0000","last_undegraded":"2024-04-25T15:45:49.031053+0000","last_fullsized":"2024-04-25T15:45:49.031053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:29.991055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T15:45:48.016887+0000","last_change":"2024-04-25T15:45:48.016887+0000","last_active":"2024-04-25T15:45:48.006343+0000","last_peered":"2024-04-25T15:45:48.006343+0000","last_clean":"2024-04-25T15:45:48.006343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:45:48.016887+0000","last_undegraded":"2024-04-25T15:45:48.016887+0000","last_fullsized":"2024-04-25T15:45:48.016887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T15:45:49.018488+0000","last_change":"2024-04-25T15:45:48.027167+0000","last_active":"2024-04-25T15:45:49.018488+0000","last_peered":"2024-04-25T15:45:49.018488+0000","last_clean":"2024-04-25T15:45:49.018488+0000","last_became_active":"2024-04-25T15:45:48.026855+0000","last_became_peered":"2024-04-25T15:45:48.026855+0000","last_unstale":"2024-04-25T15:45:49.018488+0000","last_undegraded":"2024-04-25T15:45:49.018488+0000","last_fullsized":"2024-04-25T15:45:49.018488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:48.804981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":213,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T15:45:48.016506+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:48.016506+0000","last_peered":"2024-04-25T15:45:48.016506+0000","last_clean":"2024-04-25T15:45:48.016506+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:48.016506+0000","last_undegraded":"2024-04-25T15:45:48.016506+0000","last_fullsized":"2024-04-25T15:45:48.016506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":393382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343376,"statfs":{"total":96636764160,"available":96607617024,"internally_reserved":0,"allocated":1470464,"data_stored":983750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":977083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":386715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:56.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:45:56.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.608+0000 7f96952f9640 1 Processor -- start 2024-04-25T15:45:56.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.608+0000 7f96952f9640 1 -- start start 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f96952f9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96900d41b0 0x7f96900b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f96952f9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9690163fb0 con 0x7f96901602a0 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f96952f9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9690164270 con 0x7f96900b7d60 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f96952f9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9690164550 con 0x7f96900d41b0 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f968effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96900d41b0 0x7f96900b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f968effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96900d41b0 0x7f96900b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33648/0 (socket says 172.21.15.80:33648) 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f968effd640 1 -- 172.21.15.80:0/403901720 learned_addr learned my addr 172.21.15.80:0/403901720 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.609+0000 7f968e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f96901602a0 0x7f96900b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36054/0 (socket says 172.21.15.80:36054) 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.610+0000 7f968effd640 1 -- 172.21.15.80:0/403901720 >> v1:172.21.15.195:6789/0 conn(0x7f96900b7d60 legacy=0x7f96900d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.610+0000 7f968effd640 1 -- 172.21.15.80:0/403901720 >> v1:172.21.15.80:6789/0 conn(0x7f96901602a0 legacy=0x7f96900b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.610+0000 7f968effd640 1 -- 172.21.15.80:0/403901720 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9690164830 con 0x7f96900d41b0 2024-04-25T15:45:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.610+0000 7f968dffb640 1 -- 172.21.15.80:0/403901720 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579054392 0 0) 0x7f9690163fb0 con 0x7f96901602a0 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.610+0000 7f968effd640 1 --2- 172.21.15.80:0/403901720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96900d41b0 0x7f96900b48d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9680009870 tx=0x7f968002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195f6cd52a4711e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f968dffb640 1 -- 172.21.15.80:0/403901720 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680037070 con 0x7f96900d41b0 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f968dffb640 1 -- 172.21.15.80:0/403901720 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9680032440 con 0x7f96900d41b0 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f968dffb640 1 -- 172.21.15.80:0/403901720 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680032810 con 0x7f96900d41b0 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 -- 172.21.15.80:0/403901720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96900d41b0 msgr2=0x7f96900b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 --2- 172.21.15.80:0/403901720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96900d41b0 0x7f96900b48d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9680009870 tx=0x7f968002a210 comp rx=0 tx=0).stop 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 -- 172.21.15.80:0/403901720 shutdown_connections 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 --2- 172.21.15.80:0/403901720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96900d41b0 0x7f96900b48d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 -- 172.21.15.80:0/403901720 >> 172.21.15.80:0/403901720 conn(0x7f969006e9f0 msgr2=0x7f96900d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 -- 172.21.15.80:0/403901720 shutdown_connections 2024-04-25T15:45:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.611+0000 7f96952f9640 1 -- 172.21.15.80:0/403901720 wait complete. 2024-04-25T15:45:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.613+0000 7f96952f9640 1 Processor -- start 2024-04-25T15:45:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.613+0000 7f96952f9640 1 -- start start 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f96952f9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96900d41b0 0x7f96900c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f96952f9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96901602a0 0x7f9690161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f96952f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 0x7f9690162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f96952f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f96900b5150 con 0x7f9690162160 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f96952f9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f96900b4fd0 con 0x7f96900d41b0 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f96952f9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f96900b9220 con 0x7f96901602a0 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 0x7f9690162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 0x7f9690162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33650/0 (socket says 172.21.15.80:33650) 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 -- 172.21.15.80:0/3188774904 learned_addr learned my addr 172.21.15.80:0/3188774904 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:56.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968effd640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96900d41b0 0x7f96900c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968e7fc640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96901602a0 0x7f9690161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 -- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96901602a0 msgr2=0x7f9690161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96901602a0 0x7f9690161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 -- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96900d41b0 msgr2=0x7f96900c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96900d41b0 0x7f96900c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 -- 172.21.15.80:0/3188774904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9690162ab0 con 0x7f9690162160 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.615+0000 7f968f7fe640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 0x7f9690162570 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f968800b9e0 tx=0x7f968800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.616+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688003b70 con 0x7f9690162160 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.616+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9688003d10 con 0x7f9690162160 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.616+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9690163580 con 0x7f9690162160 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.616+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968800cb00 con 0x7f9690162160 2024-04-25T15:45:56.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.616+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9690163820 con 0x7f9690162160 2024-04-25T15:45:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.617+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969006a100 con 0x7f9690162160 2024-04-25T15:45:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.617+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f968800cca0 con 0x7f9690162160 2024-04-25T15:45:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.618+0000 7f96777fe640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f967c0744e0 0x7f967c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.618+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f96880950f0 con 0x7f9690162160 2024-04-25T15:45:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.618+0000 7f968effd640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f967c0744e0 0x7f967c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.618+0000 7f968effd640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f967c0744e0 0x7f967c0769f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9680034000 tx=0x7f968002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:56.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.622+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f968805f130 con 0x7f9690162160 2024-04-25T15:45:56.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.794+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96900b4a40 con 0x7f967c0744e0 2024-04-25T15:45:56.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.800+0000 7f96777fe640 1 -- 172.21.15.80:0/3188774904 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252060 (secure 0 0 0) 0x7f96900b4a40 con 0x7f967c0744e0 2024-04-25T15:45:56.804 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:56.805 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f967c0744e0 msgr2=0x7f967c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f967c0744e0 0x7f967c0769f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9680034000 tx=0x7f968002e000 comp rx=0 tx=0).stop 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 msgr2=0x7f9690162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 0x7f9690162570 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f968800b9e0 tx=0x7f968800bea0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 shutdown_connections 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f967c0744e0 0x7f967c0769f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9690162160 0x7f9690162570 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96901602a0 0x7f9690161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 --2- 172.21.15.80:0/3188774904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96900d41b0 0x7f96900c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 >> 172.21.15.80:0/3188774904 conn(0x7f969006e9f0 msgr2=0x7f96900b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:56.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 shutdown_connections 2024-04-25T15:45:56.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.803+0000 7f96952f9640 1 -- 172.21.15.80:0/3188774904 wait complete. 2024-04-25T15:45:56.816 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-25T15:45:55.033259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245236,"kb_used_data":8264,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729484,"statfs":{"total":773094113280,"available":772842991616,"internally_reserved":0,"allocated":8462336,"data_stored":4443484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.020240"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035542+0000","last_change":"2024-04-25T15:45:49.028594+0000","last_active":"2024-04-25T15:45:50.035542+0000","last_peered":"2024-04-25T15:45:50.035542+0000","last_clean":"2024-04-25T15:45:50.035542+0000","last_became_active":"2024-04-25T15:45:49.028017+0000","last_became_peered":"2024-04-25T15:45:49.028017+0000","last_unstale":"2024-04-25T15:45:50.035542+0000","last_undegraded":"2024-04-25T15:45:50.035542+0000","last_fullsized":"2024-04-25T15:45:50.035542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.567089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023695+0000","last_change":"2024-04-25T15:45:49.053209+0000","last_active":"2024-04-25T15:45:51.023695+0000","last_peered":"2024-04-25T15:45:51.023695+0000","last_clean":"2024-04-25T15:45:51.023695+0000","last_became_active":"2024-04-25T15:45:49.052885+0000","last_became_peered":"2024-04-25T15:45:49.052885+0000","last_unstale":"2024-04-25T15:45:51.023695+0000","last_undegraded":"2024-04-25T15:45:51.023695+0000","last_fullsized":"2024-04-25T15:45:51.023695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:48.184976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777566+0000","last_change":"2024-04-25T15:45:49.048277+0000","last_active":"2024-04-25T15:45:50.777566+0000","last_peered":"2024-04-25T15:45:50.777566+0000","last_clean":"2024-04-25T15:45:50.777566+0000","last_became_active":"2024-04-25T15:45:49.047948+0000","last_became_peered":"2024-04-25T15:45:49.047948+0000","last_unstale":"2024-04-25T15:45:50.777566+0000","last_undegraded":"2024-04-25T15:45:50.777566+0000","last_fullsized":"2024-04-25T15:45:50.777566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:17:03.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340283+0000","last_change":"2024-04-25T15:45:49.031657+0000","last_active":"2024-04-25T15:45:51.340283+0000","last_peered":"2024-04-25T15:45:51.340283+0000","last_clean":"2024-04-25T15:45:51.340283+0000","last_became_active":"2024-04-25T15:45:49.031321+0000","last_became_peered":"2024-04-25T15:45:49.031321+0000","last_unstale":"2024-04-25T15:45:51.340283+0000","last_undegraded":"2024-04-25T15:45:51.340283+0000","last_fullsized":"2024-04-25T15:45:51.340283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.212910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034533+0000","last_change":"2024-04-25T15:45:49.037879+0000","last_active":"2024-04-25T15:45:50.034533+0000","last_peered":"2024-04-25T15:45:50.034533+0000","last_clean":"2024-04-25T15:45:50.034533+0000","last_became_active":"2024-04-25T15:45:49.037584+0000","last_became_peered":"2024-04-25T15:45:49.037584+0000","last_unstale":"2024-04-25T15:45:50.034533+0000","last_undegraded":"2024-04-25T15:45:50.034533+0000","last_fullsized":"2024-04-25T15:45:50.034533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:49.117373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.262840+0000","last_change":"2024-04-25T15:45:49.029845+0000","last_active":"2024-04-25T15:45:52.262840+0000","last_peered":"2024-04-25T15:45:52.262840+0000","last_clean":"2024-04-25T15:45:52.262840+0000","last_became_active":"2024-04-25T15:45:49.029552+0000","last_became_peered":"2024-04-25T15:45:49.029552+0000","last_unstale":"2024-04-25T15:45:52.262840+0000","last_undegraded":"2024-04-25T15:45:52.262840+0000","last_fullsized":"2024-04-25T15:45:52.262840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:48.190960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.793846+0000","last_change":"2024-04-25T15:45:49.047358+0000","last_active":"2024-04-25T15:45:50.793846+0000","last_peered":"2024-04-25T15:45:50.793846+0000","last_clean":"2024-04-25T15:45:50.793846+0000","last_became_active":"2024-04-25T15:45:49.046968+0000","last_became_peered":"2024-04-25T15:45:49.046968+0000","last_unstale":"2024-04-25T15:45:50.793846+0000","last_undegraded":"2024-04-25T15:45:50.793846+0000","last_fullsized":"2024-04-25T15:45:50.793846+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:34.570415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034116+0000","last_change":"2024-04-25T15:45:49.038120+0000","last_active":"2024-04-25T15:45:50.034116+0000","last_peered":"2024-04-25T15:45:50.034116+0000","last_clean":"2024-04-25T15:45:50.034116+0000","last_became_active":"2024-04-25T15:45:49.037171+0000","last_became_peered":"2024-04-25T15:45:49.037171+0000","last_unstale":"2024-04-25T15:45:50.034116+0000","last_undegraded":"2024-04-25T15:45:50.034116+0000","last_fullsized":"2024-04-25T15:45:50.034116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.663380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.036158+0000","last_change":"2024-04-25T15:45:49.039990+0000","last_active":"2024-04-25T15:45:50.036158+0000","last_peered":"2024-04-25T15:45:50.036158+0000","last_clean":"2024-04-25T15:45:50.036158+0000","last_became_active":"2024-04-25T15:45:49.039661+0000","last_became_peered":"2024-04-25T15:45:49.039661+0000","last_unstale":"2024-04-25T15:45:50.036158+0000","last_undegraded":"2024-04-25T15:45:50.036158+0000","last_fullsized":"2024-04-25T15:45:50.036158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:34.570415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340414+0000","last_change":"2024-04-25T15:45:49.033365+0000","last_active":"2024-04-25T15:45:51.340414+0000","last_peered":"2024-04-25T15:45:51.340414+0000","last_clean":"2024-04-25T15:45:51.340414+0000","last_became_active":"2024-04-25T15:45:49.033043+0000","last_became_peered":"2024-04-25T15:45:49.033043+0000","last_unstale":"2024-04-25T15:45:51.340414+0000","last_undegraded":"2024-04-25T15:45:51.340414+0000","last_fullsized":"2024-04-25T15:45:51.340414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:12.163908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023504+0000","last_change":"2024-04-25T15:45:49.050415+0000","last_active":"2024-04-25T15:45:51.023504+0000","last_peered":"2024-04-25T15:45:51.023504+0000","last_clean":"2024-04-25T15:45:51.023504+0000","last_became_active":"2024-04-25T15:45:49.048602+0000","last_became_peered":"2024-04-25T15:45:49.048602+0000","last_unstale":"2024-04-25T15:45:51.023504+0000","last_undegraded":"2024-04-25T15:45:51.023504+0000","last_fullsized":"2024-04-25T15:45:51.023504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:15.963151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340354+0000","last_change":"2024-04-25T15:45:49.042559+0000","last_active":"2024-04-25T15:45:51.340354+0000","last_peered":"2024-04-25T15:45:51.340354+0000","last_clean":"2024-04-25T15:45:51.340354+0000","last_became_active":"2024-04-25T15:45:49.042104+0000","last_became_peered":"2024-04-25T15:45:49.042104+0000","last_unstale":"2024-04-25T15:45:51.340354+0000","last_undegraded":"2024-04-25T15:45:51.340354+0000","last_fullsized":"2024-04-25T15:45:51.340354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:36.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034571+0000","last_change":"2024-04-25T15:45:49.039773+0000","last_active":"2024-04-25T15:45:50.034571+0000","last_peered":"2024-04-25T15:45:50.034571+0000","last_clean":"2024-04-25T15:45:50.034571+0000","last_became_active":"2024-04-25T15:45:49.039456+0000","last_became_peered":"2024-04-25T15:45:49.039456+0000","last_unstale":"2024-04-25T15:45:50.034571+0000","last_undegraded":"2024-04-25T15:45:50.034571+0000","last_fullsized":"2024-04-25T15:45:50.034571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:58.658891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.262908+0000","last_change":"2024-04-25T15:45:49.029074+0000","last_active":"2024-04-25T15:45:52.262908+0000","last_peered":"2024-04-25T15:45:52.262908+0000","last_clean":"2024-04-25T15:45:52.262908+0000","last_became_active":"2024-04-25T15:45:49.028755+0000","last_became_peered":"2024-04-25T15:45:49.028755+0000","last_unstale":"2024-04-25T15:45:52.262908+0000","last_undegraded":"2024-04-25T15:45:52.262908+0000","last_fullsized":"2024-04-25T15:45:52.262908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:14.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023205+0000","last_change":"2024-04-25T15:45:49.047602+0000","last_active":"2024-04-25T15:45:51.023205+0000","last_peered":"2024-04-25T15:45:51.023205+0000","last_clean":"2024-04-25T15:45:51.023205+0000","last_became_active":"2024-04-25T15:45:49.047308+0000","last_became_peered":"2024-04-25T15:45:49.047308+0000","last_unstale":"2024-04-25T15:45:51.023205+0000","last_undegraded":"2024-04-25T15:45:51.023205+0000","last_fullsized":"2024-04-25T15:45:51.023205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:48.190960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034767+0000","last_change":"2024-04-25T15:45:49.028223+0000","last_active":"2024-04-25T15:45:50.034767+0000","last_peered":"2024-04-25T15:45:50.034767+0000","last_clean":"2024-04-25T15:45:50.034767+0000","last_became_active":"2024-04-25T15:45:49.027887+0000","last_became_peered":"2024-04-25T15:45:49.027887+0000","last_unstale":"2024-04-25T15:45:50.034767+0000","last_undegraded":"2024-04-25T15:45:50.034767+0000","last_fullsized":"2024-04-25T15:45:50.034767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:26.418994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034546+0000","last_change":"2024-04-25T15:45:49.044865+0000","last_active":"2024-04-25T15:45:50.034546+0000","last_peered":"2024-04-25T15:45:50.034546+0000","last_clean":"2024-04-25T15:45:50.034546+0000","last_became_active":"2024-04-25T15:45:49.044558+0000","last_became_peered":"2024-04-25T15:45:49.044558+0000","last_unstale":"2024-04-25T15:45:50.034546+0000","last_undegraded":"2024-04-25T15:45:50.034546+0000","last_fullsized":"2024-04-25T15:45:50.034546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:05.662959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777396+0000","last_change":"2024-04-25T15:45:49.043656+0000","last_active":"2024-04-25T15:45:50.777396+0000","last_peered":"2024-04-25T15:45:50.777396+0000","last_clean":"2024-04-25T15:45:50.777396+0000","last_became_active":"2024-04-25T15:45:49.043341+0000","last_became_peered":"2024-04-25T15:45:49.043341+0000","last_unstale":"2024-04-25T15:45:50.777396+0000","last_undegraded":"2024-04-25T15:45:50.777396+0000","last_fullsized":"2024-04-25T15:45:50.777396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:52.402405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.262930+0000","last_change":"2024-04-25T15:45:49.034922+0000","last_active":"2024-04-25T15:45:52.262930+0000","last_peered":"2024-04-25T15:45:52.262930+0000","last_clean":"2024-04-25T15:45:52.262930+0000","last_became_active":"2024-04-25T15:45:49.034583+0000","last_became_peered":"2024-04-25T15:45:49.034583+0000","last_unstale":"2024-04-25T15:45:52.262930+0000","last_undegraded":"2024-04-25T15:45:52.262930+0000","last_fullsized":"2024-04-25T15:45:52.262930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.567089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034620+0000","last_change":"2024-04-25T15:45:49.050924+0000","last_active":"2024-04-25T15:45:50.034620+0000","last_peered":"2024-04-25T15:45:50.034620+0000","last_clean":"2024-04-25T15:45:50.034620+0000","last_became_active":"2024-04-25T15:45:49.050097+0000","last_became_peered":"2024-04-25T15:45:49.050097+0000","last_unstale":"2024-04-25T15:45:50.034620+0000","last_undegraded":"2024-04-25T15:45:50.034620+0000","last_fullsized":"2024-04-25T15:45:50.034620+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:25.896415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034693+0000","last_change":"2024-04-25T15:45:49.044675+0000","last_active":"2024-04-25T15:45:50.034693+0000","last_peered":"2024-04-25T15:45:50.034693+0000","last_clean":"2024-04-25T15:45:50.034693+0000","last_became_active":"2024-04-25T15:45:49.044353+0000","last_became_peered":"2024-04-25T15:45:49.044353+0000","last_unstale":"2024-04-25T15:45:50.034693+0000","last_undegraded":"2024-04-25T15:45:50.034693+0000","last_fullsized":"2024-04-25T15:45:50.034693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:40.412201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034220+0000","last_change":"2024-04-25T15:45:49.039675+0000","last_active":"2024-04-25T15:45:50.034220+0000","last_peered":"2024-04-25T15:45:50.034220+0000","last_clean":"2024-04-25T15:45:50.034220+0000","last_became_active":"2024-04-25T15:45:49.039361+0000","last_became_peered":"2024-04-25T15:45:49.039361+0000","last_unstale":"2024-04-25T15:45:50.034220+0000","last_undegraded":"2024-04-25T15:45:50.034220+0000","last_fullsized":"2024-04-25T15:45:50.034220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:13.251100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.036138+0000","last_change":"2024-04-25T15:45:49.031429+0000","last_active":"2024-04-25T15:45:50.036138+0000","last_peered":"2024-04-25T15:45:50.036138+0000","last_clean":"2024-04-25T15:45:50.036138+0000","last_became_active":"2024-04-25T15:45:49.031076+0000","last_became_peered":"2024-04-25T15:45:49.031076+0000","last_unstale":"2024-04-25T15:45:50.036138+0000","last_undegraded":"2024-04-25T15:45:50.036138+0000","last_fullsized":"2024-04-25T15:45:50.036138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:08.475071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023092+0000","last_change":"2024-04-25T15:45:49.041468+0000","last_active":"2024-04-25T15:45:51.023092+0000","last_peered":"2024-04-25T15:45:51.023092+0000","last_clean":"2024-04-25T15:45:51.023092+0000","last_became_active":"2024-04-25T15:45:49.040642+0000","last_became_peered":"2024-04-25T15:45:49.040642+0000","last_unstale":"2024-04-25T15:45:51.023092+0000","last_undegraded":"2024-04-25T15:45:51.023092+0000","last_fullsized":"2024-04-25T15:45:51.023092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:56.828104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023617+0000","last_change":"2024-04-25T15:45:49.041701+0000","last_active":"2024-04-25T15:45:51.023617+0000","last_peered":"2024-04-25T15:45:51.023617+0000","last_clean":"2024-04-25T15:45:51.023617+0000","last_became_active":"2024-04-25T15:45:49.041347+0000","last_became_peered":"2024-04-25T15:45:49.041347+0000","last_unstale":"2024-04-25T15:45:51.023617+0000","last_undegraded":"2024-04-25T15:45:51.023617+0000","last_fullsized":"2024-04-25T15:45:51.023617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:31.011761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340328+0000","last_change":"2024-04-25T15:45:49.042367+0000","last_active":"2024-04-25T15:45:51.340328+0000","last_peered":"2024-04-25T15:45:51.340328+0000","last_clean":"2024-04-25T15:45:51.340328+0000","last_became_active":"2024-04-25T15:45:49.042054+0000","last_became_peered":"2024-04-25T15:45:49.042054+0000","last_unstale":"2024-04-25T15:45:51.340328+0000","last_undegraded":"2024-04-25T15:45:51.340328+0000","last_fullsized":"2024-04-25T15:45:51.340328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:48.687335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035894+0000","last_change":"2024-04-25T15:45:49.028947+0000","last_active":"2024-04-25T15:45:50.035894+0000","last_peered":"2024-04-25T15:45:50.035894+0000","last_clean":"2024-04-25T15:45:50.035894+0000","last_became_active":"2024-04-25T15:45:49.027952+0000","last_became_peered":"2024-04-25T15:45:49.027952+0000","last_unstale":"2024-04-25T15:45:50.035894+0000","last_undegraded":"2024-04-25T15:45:50.035894+0000","last_fullsized":"2024-04-25T15:45:50.035894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:15.963151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034706+0000","last_change":"2024-04-25T15:45:49.035757+0000","last_active":"2024-04-25T15:45:50.034706+0000","last_peered":"2024-04-25T15:45:50.034706+0000","last_clean":"2024-04-25T15:45:50.034706+0000","last_became_active":"2024-04-25T15:45:49.035434+0000","last_became_peered":"2024-04-25T15:45:49.035434+0000","last_unstale":"2024-04-25T15:45:50.034706+0000","last_undegraded":"2024-04-25T15:45:50.034706+0000","last_fullsized":"2024-04-25T15:45:50.034706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:10.841417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023268+0000","last_change":"2024-04-25T15:45:49.035131+0000","last_active":"2024-04-25T15:45:51.023268+0000","last_peered":"2024-04-25T15:45:51.023268+0000","last_clean":"2024-04-25T15:45:51.023268+0000","last_became_active":"2024-04-25T15:45:49.034817+0000","last_became_peered":"2024-04-25T15:45:49.034817+0000","last_unstale":"2024-04-25T15:45:51.023268+0000","last_undegraded":"2024-04-25T15:45:51.023268+0000","last_fullsized":"2024-04-25T15:45:51.023268+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.567089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034898+0000","last_change":"2024-04-25T15:45:49.042206+0000","last_active":"2024-04-25T15:45:50.034898+0000","last_peered":"2024-04-25T15:45:50.034898+0000","last_clean":"2024-04-25T15:45:50.034898+0000","last_became_active":"2024-04-25T15:45:49.041707+0000","last_became_peered":"2024-04-25T15:45:49.041707+0000","last_unstale":"2024-04-25T15:45:50.034898+0000","last_undegraded":"2024-04-25T15:45:50.034898+0000","last_fullsized":"2024-04-25T15:45:50.034898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:14.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777302+0000","last_change":"2024-04-25T15:45:49.043226+0000","last_active":"2024-04-25T15:45:50.777302+0000","last_peered":"2024-04-25T15:45:50.777302+0000","last_clean":"2024-04-25T15:45:50.777302+0000","last_became_active":"2024-04-25T15:45:49.042919+0000","last_became_peered":"2024-04-25T15:45:49.042919+0000","last_unstale":"2024-04-25T15:45:50.777302+0000","last_undegraded":"2024-04-25T15:45:50.777302+0000","last_fullsized":"2024-04-25T15:45:50.777302+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.815192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035974+0000","last_change":"2024-04-25T15:45:49.027504+0000","last_active":"2024-04-25T15:45:50.035974+0000","last_peered":"2024-04-25T15:45:50.035974+0000","last_clean":"2024-04-25T15:45:50.035974+0000","last_became_active":"2024-04-25T15:45:49.026525+0000","last_became_peered":"2024-04-25T15:45:49.026525+0000","last_unstale":"2024-04-25T15:45:50.035974+0000","last_undegraded":"2024-04-25T15:45:50.035974+0000","last_fullsized":"2024-04-25T15:45:50.035974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777207+0000","last_change":"2024-04-25T15:45:49.045054+0000","last_active":"2024-04-25T15:45:50.777207+0000","last_peered":"2024-04-25T15:45:50.777207+0000","last_clean":"2024-04-25T15:45:50.777207+0000","last_became_active":"2024-04-25T15:45:49.044769+0000","last_became_peered":"2024-04-25T15:45:49.044769+0000","last_unstale":"2024-04-25T15:45:50.777207+0000","last_undegraded":"2024-04-25T15:45:50.777207+0000","last_fullsized":"2024-04-25T15:45:50.777207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:02.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"73'4","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034654+0000","last_change":"2024-04-25T15:45:48.039764+0000","last_active":"2024-04-25T15:45:50.034654+0000","last_peered":"2024-04-25T15:45:50.034654+0000","last_clean":"2024-04-25T15:45:50.034654+0000","last_became_active":"2024-04-25T15:45:48.039397+0000","last_became_peered":"2024-04-25T15:45:48.039397+0000","last_unstale":"2024-04-25T15:45:50.034654+0000","last_undegraded":"2024-04-25T15:45:50.034654+0000","last_fullsized":"2024-04-25T15:45:50.034654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:19.962659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023244+0000","last_change":"2024-04-25T15:45:49.031788+0000","last_active":"2024-04-25T15:45:51.023244+0000","last_peered":"2024-04-25T15:45:51.023244+0000","last_clean":"2024-04-25T15:45:51.023244+0000","last_became_active":"2024-04-25T15:45:49.031493+0000","last_became_peered":"2024-04-25T15:45:49.031493+0000","last_unstale":"2024-04-25T15:45:51.023244+0000","last_undegraded":"2024-04-25T15:45:51.023244+0000","last_fullsized":"2024-04-25T15:45:51.023244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:14.610165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035559+0000","last_change":"2024-04-25T15:45:48.027890+0000","last_active":"2024-04-25T15:45:50.035559+0000","last_peered":"2024-04-25T15:45:50.035559+0000","last_clean":"2024-04-25T15:45:50.035559+0000","last_became_active":"2024-04-25T15:45:48.026687+0000","last_became_peered":"2024-04-25T15:45:48.026687+0000","last_unstale":"2024-04-25T15:45:50.035559+0000","last_undegraded":"2024-04-25T15:45:50.035559+0000","last_fullsized":"2024-04-25T15:45:50.035559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:07.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035958+0000","last_change":"2024-04-25T15:45:49.042414+0000","last_active":"2024-04-25T15:45:50.035958+0000","last_peered":"2024-04-25T15:45:50.035958+0000","last_clean":"2024-04-25T15:45:50.035958+0000","last_became_active":"2024-04-25T15:45:49.042083+0000","last_became_peered":"2024-04-25T15:45:49.042083+0000","last_unstale":"2024-04-25T15:45:50.035958+0000","last_undegraded":"2024-04-25T15:45:50.035958+0000","last_fullsized":"2024-04-25T15:45:50.035958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:27.365102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035350+0000","last_change":"2024-04-25T15:45:48.035315+0000","last_active":"2024-04-25T15:45:50.035350+0000","last_peered":"2024-04-25T15:45:50.035350+0000","last_clean":"2024-04-25T15:45:50.035350+0000","last_became_active":"2024-04-25T15:45:48.034967+0000","last_became_peered":"2024-04-25T15:45:48.034967+0000","last_unstale":"2024-04-25T15:45:50.035350+0000","last_undegraded":"2024-04-25T15:45:50.035350+0000","last_fullsized":"2024-04-25T15:45:50.035350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:51.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035164+0000","last_change":"2024-04-25T15:45:49.045403+0000","last_active":"2024-04-25T15:45:50.035164+0000","last_peered":"2024-04-25T15:45:50.035164+0000","last_clean":"2024-04-25T15:45:50.035164+0000","last_became_active":"2024-04-25T15:45:49.044983+0000","last_became_peered":"2024-04-25T15:45:49.044983+0000","last_unstale":"2024-04-25T15:45:50.035164+0000","last_undegraded":"2024-04-25T15:45:50.035164+0000","last_fullsized":"2024-04-25T15:45:50.035164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:45.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794078+0000","last_change":"2024-04-25T15:45:48.034036+0000","last_active":"2024-04-25T15:45:50.794078+0000","last_peered":"2024-04-25T15:45:50.794078+0000","last_clean":"2024-04-25T15:45:50.794078+0000","last_became_active":"2024-04-25T15:45:48.033687+0000","last_became_peered":"2024-04-25T15:45:48.033687+0000","last_unstale":"2024-04-25T15:45:50.794078+0000","last_undegraded":"2024-04-25T15:45:50.794078+0000","last_fullsized":"2024-04-25T15:45:50.794078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:15.263609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023328+0000","last_change":"2024-04-25T15:45:49.053884+0000","last_active":"2024-04-25T15:45:51.023328+0000","last_peered":"2024-04-25T15:45:51.023328+0000","last_clean":"2024-04-25T15:45:51.023328+0000","last_became_active":"2024-04-25T15:45:49.053298+0000","last_became_peered":"2024-04-25T15:45:49.053298+0000","last_unstale":"2024-04-25T15:45:51.023328+0000","last_undegraded":"2024-04-25T15:45:51.023328+0000","last_fullsized":"2024-04-25T15:45:51.023328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:26.418994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035280+0000","last_change":"2024-04-25T15:45:48.033192+0000","last_active":"2024-04-25T15:45:50.035280+0000","last_peered":"2024-04-25T15:45:50.035280+0000","last_clean":"2024-04-25T15:45:50.035280+0000","last_became_active":"2024-04-25T15:45:48.032675+0000","last_became_peered":"2024-04-25T15:45:48.032675+0000","last_unstale":"2024-04-25T15:45:50.035280+0000","last_undegraded":"2024-04-25T15:45:50.035280+0000","last_fullsized":"2024-04-25T15:45:50.035280+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:39.406605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023607+0000","last_change":"2024-04-25T15:45:49.050495+0000","last_active":"2024-04-25T15:45:51.023607+0000","last_peered":"2024-04-25T15:45:51.023607+0000","last_clean":"2024-04-25T15:45:51.023607+0000","last_became_active":"2024-04-25T15:45:49.050186+0000","last_became_peered":"2024-04-25T15:45:49.050186+0000","last_unstale":"2024-04-25T15:45:51.023607+0000","last_undegraded":"2024-04-25T15:45:51.023607+0000","last_fullsized":"2024-04-25T15:45:51.023607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:55.884438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.339973+0000","last_change":"2024-04-25T15:45:48.039562+0000","last_active":"2024-04-25T15:45:51.339973+0000","last_peered":"2024-04-25T15:45:51.339973+0000","last_clean":"2024-04-25T15:45:51.339973+0000","last_became_active":"2024-04-25T15:45:48.039300+0000","last_became_peered":"2024-04-25T15:45:48.039300+0000","last_unstale":"2024-04-25T15:45:51.339973+0000","last_undegraded":"2024-04-25T15:45:51.339973+0000","last_fullsized":"2024-04-25T15:45:51.339973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.311840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035652+0000","last_change":"2024-04-25T15:45:49.040690+0000","last_active":"2024-04-25T15:45:50.035652+0000","last_peered":"2024-04-25T15:45:50.035652+0000","last_clean":"2024-04-25T15:45:50.035652+0000","last_became_active":"2024-04-25T15:45:49.040387+0000","last_became_peered":"2024-04-25T15:45:49.040387+0000","last_unstale":"2024-04-25T15:45:50.035652+0000","last_undegraded":"2024-04-25T15:45:50.035652+0000","last_fullsized":"2024-04-25T15:45:50.035652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.957341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023342+0000","last_change":"2024-04-25T15:45:48.035584+0000","last_active":"2024-04-25T15:45:51.023342+0000","last_peered":"2024-04-25T15:45:51.023342+0000","last_clean":"2024-04-25T15:45:51.023342+0000","last_became_active":"2024-04-25T15:45:48.034409+0000","last_became_peered":"2024-04-25T15:45:48.034409+0000","last_unstale":"2024-04-25T15:45:51.023342+0000","last_undegraded":"2024-04-25T15:45:51.023342+0000","last_fullsized":"2024-04-25T15:45:51.023342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794199+0000","last_change":"2024-04-25T15:45:49.047136+0000","last_active":"2024-04-25T15:45:50.794199+0000","last_peered":"2024-04-25T15:45:50.794199+0000","last_clean":"2024-04-25T15:45:50.794199+0000","last_became_active":"2024-04-25T15:45:49.046731+0000","last_became_peered":"2024-04-25T15:45:49.046731+0000","last_unstale":"2024-04-25T15:45:50.794199+0000","last_undegraded":"2024-04-25T15:45:50.794199+0000","last_fullsized":"2024-04-25T15:45:50.794199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:17.471807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034112+0000","last_change":"2024-04-25T15:45:48.031484+0000","last_active":"2024-04-25T15:45:50.034112+0000","last_peered":"2024-04-25T15:45:50.034112+0000","last_clean":"2024-04-25T15:45:50.034112+0000","last_became_active":"2024-04-25T15:45:48.031166+0000","last_became_peered":"2024-04-25T15:45:48.031166+0000","last_unstale":"2024-04-25T15:45:50.034112+0000","last_undegraded":"2024-04-25T15:45:50.034112+0000","last_fullsized":"2024-04-25T15:45:50.034112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:59.353521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023114+0000","last_change":"2024-04-25T15:45:49.041798+0000","last_active":"2024-04-25T15:45:51.023114+0000","last_peered":"2024-04-25T15:45:51.023114+0000","last_clean":"2024-04-25T15:45:51.023114+0000","last_became_active":"2024-04-25T15:45:49.041123+0000","last_became_peered":"2024-04-25T15:45:49.041123+0000","last_unstale":"2024-04-25T15:45:51.023114+0000","last_undegraded":"2024-04-25T15:45:51.023114+0000","last_fullsized":"2024-04-25T15:45:51.023114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.869005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035674+0000","last_change":"2024-04-25T15:45:48.027388+0000","last_active":"2024-04-25T15:45:50.035674+0000","last_peered":"2024-04-25T15:45:50.035674+0000","last_clean":"2024-04-25T15:45:50.035674+0000","last_became_active":"2024-04-25T15:45:48.026972+0000","last_became_peered":"2024-04-25T15:45:48.026972+0000","last_unstale":"2024-04-25T15:45:50.035674+0000","last_undegraded":"2024-04-25T15:45:50.035674+0000","last_fullsized":"2024-04-25T15:45:50.035674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:55.222065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340196+0000","last_change":"2024-04-25T15:45:49.030713+0000","last_active":"2024-04-25T15:45:51.340196+0000","last_peered":"2024-04-25T15:45:51.340196+0000","last_clean":"2024-04-25T15:45:51.340196+0000","last_became_active":"2024-04-25T15:45:49.030207+0000","last_became_peered":"2024-04-25T15:45:49.030207+0000","last_unstale":"2024-04-25T15:45:51.340196+0000","last_undegraded":"2024-04-25T15:45:51.340196+0000","last_fullsized":"2024-04-25T15:45:51.340196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:39.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340420+0000","last_change":"2024-04-25T15:45:48.035924+0000","last_active":"2024-04-25T15:45:51.340420+0000","last_peered":"2024-04-25T15:45:51.340420+0000","last_clean":"2024-04-25T15:45:51.340420+0000","last_became_active":"2024-04-25T15:45:48.035502+0000","last_became_peered":"2024-04-25T15:45:48.035502+0000","last_unstale":"2024-04-25T15:45:51.340420+0000","last_undegraded":"2024-04-25T15:45:51.340420+0000","last_fullsized":"2024-04-25T15:45:51.340420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:43.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.263139+0000","last_change":"2024-04-25T15:45:49.048628+0000","last_active":"2024-04-25T15:45:52.263139+0000","last_peered":"2024-04-25T15:45:52.263139+0000","last_clean":"2024-04-25T15:45:52.263139+0000","last_became_active":"2024-04-25T15:45:49.048214+0000","last_became_peered":"2024-04-25T15:45:49.048214+0000","last_unstale":"2024-04-25T15:45:52.263139+0000","last_undegraded":"2024-04-25T15:45:52.263139+0000","last_fullsized":"2024-04-25T15:45:52.263139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:26.418994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"73'3","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034772+0000","last_change":"2024-04-25T15:45:48.029162+0000","last_active":"2024-04-25T15:45:50.034772+0000","last_peered":"2024-04-25T15:45:50.034772+0000","last_clean":"2024-04-25T15:45:50.034772+0000","last_became_active":"2024-04-25T15:45:48.028855+0000","last_became_peered":"2024-04-25T15:45:48.028855+0000","last_unstale":"2024-04-25T15:45:50.034772+0000","last_undegraded":"2024-04-25T15:45:50.034772+0000","last_fullsized":"2024-04-25T15:45:50.034772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:51.952928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777211+0000","last_change":"2024-04-25T15:45:49.052137+0000","last_active":"2024-04-25T15:45:50.777211+0000","last_peered":"2024-04-25T15:45:50.777211+0000","last_clean":"2024-04-25T15:45:50.777211+0000","last_became_active":"2024-04-25T15:45:49.051835+0000","last_became_peered":"2024-04-25T15:45:49.051835+0000","last_unstale":"2024-04-25T15:45:50.777211+0000","last_undegraded":"2024-04-25T15:45:50.777211+0000","last_fullsized":"2024-04-25T15:45:50.777211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:14.684389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"73'6","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794211+0000","last_change":"2024-04-25T15:45:48.025186+0000","last_active":"2024-04-25T15:45:50.794211+0000","last_peered":"2024-04-25T15:45:50.794211+0000","last_clean":"2024-04-25T15:45:50.794211+0000","last_became_active":"2024-04-25T15:45:48.024784+0000","last_became_peered":"2024-04-25T15:45:48.024784+0000","last_unstale":"2024-04-25T15:45:50.794211+0000","last_undegraded":"2024-04-25T15:45:50.794211+0000","last_fullsized":"2024-04-25T15:45:50.794211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:22.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340484+0000","last_change":"2024-04-25T15:45:49.043895+0000","last_active":"2024-04-25T15:45:51.340484+0000","last_peered":"2024-04-25T15:45:51.340484+0000","last_clean":"2024-04-25T15:45:51.340484+0000","last_became_active":"2024-04-25T15:45:49.043539+0000","last_became_peered":"2024-04-25T15:45:49.043539+0000","last_unstale":"2024-04-25T15:45:51.340484+0000","last_undegraded":"2024-04-25T15:45:51.340484+0000","last_fullsized":"2024-04-25T15:45:51.340484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:28.046094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.339983+0000","last_change":"2024-04-25T15:45:48.032275+0000","last_active":"2024-04-25T15:45:51.339983+0000","last_peered":"2024-04-25T15:45:51.339983+0000","last_clean":"2024-04-25T15:45:51.339983+0000","last_became_active":"2024-04-25T15:45:48.031954+0000","last_became_peered":"2024-04-25T15:45:48.031954+0000","last_unstale":"2024-04-25T15:45:51.339983+0000","last_undegraded":"2024-04-25T15:45:51.339983+0000","last_fullsized":"2024-04-25T15:45:51.339983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.793999+0000","last_change":"2024-04-25T15:45:49.048816+0000","last_active":"2024-04-25T15:45:50.793999+0000","last_peered":"2024-04-25T15:45:50.793999+0000","last_clean":"2024-04-25T15:45:50.793999+0000","last_became_active":"2024-04-25T15:45:49.048524+0000","last_became_peered":"2024-04-25T15:45:49.048524+0000","last_unstale":"2024-04-25T15:45:50.793999+0000","last_undegraded":"2024-04-25T15:45:50.793999+0000","last_fullsized":"2024-04-25T15:45:50.793999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.815192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034768+0000","last_change":"2024-04-25T15:45:48.034555+0000","last_active":"2024-04-25T15:45:50.034768+0000","last_peered":"2024-04-25T15:45:50.034768+0000","last_clean":"2024-04-25T15:45:50.034768+0000","last_became_active":"2024-04-25T15:45:48.034231+0000","last_became_peered":"2024-04-25T15:45:48.034231+0000","last_unstale":"2024-04-25T15:45:50.034768+0000","last_undegraded":"2024-04-25T15:45:50.034768+0000","last_fullsized":"2024-04-25T15:45:50.034768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:28.927396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794094+0000","last_change":"2024-04-25T15:45:49.031420+0000","last_active":"2024-04-25T15:45:50.794094+0000","last_peered":"2024-04-25T15:45:50.794094+0000","last_clean":"2024-04-25T15:45:50.794094+0000","last_became_active":"2024-04-25T15:45:49.031020+0000","last_became_peered":"2024-04-25T15:45:49.031020+0000","last_unstale":"2024-04-25T15:45:50.794094+0000","last_undegraded":"2024-04-25T15:45:50.794094+0000","last_fullsized":"2024-04-25T15:45:50.794094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:52.402405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034112+0000","last_change":"2024-04-25T15:45:48.037474+0000","last_active":"2024-04-25T15:45:50.034112+0000","last_peered":"2024-04-25T15:45:50.034112+0000","last_clean":"2024-04-25T15:45:50.034112+0000","last_became_active":"2024-04-25T15:45:48.037137+0000","last_became_peered":"2024-04-25T15:45:48.037137+0000","last_unstale":"2024-04-25T15:45:50.034112+0000","last_undegraded":"2024-04-25T15:45:50.034112+0000","last_fullsized":"2024-04-25T15:45:50.034112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:46.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794256+0000","last_change":"2024-04-25T15:45:49.039181+0000","last_active":"2024-04-25T15:45:50.794256+0000","last_peered":"2024-04-25T15:45:50.794256+0000","last_clean":"2024-04-25T15:45:50.794256+0000","last_became_active":"2024-04-25T15:45:49.038832+0000","last_became_peered":"2024-04-25T15:45:49.038832+0000","last_unstale":"2024-04-25T15:45:50.794256+0000","last_undegraded":"2024-04-25T15:45:50.794256+0000","last_fullsized":"2024-04-25T15:45:50.794256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:17:03.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"73'8","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023255+0000","last_change":"2024-04-25T15:45:48.034495+0000","last_active":"2024-04-25T15:45:51.023255+0000","last_peered":"2024-04-25T15:45:51.023255+0000","last_clean":"2024-04-25T15:45:51.023255+0000","last_became_active":"2024-04-25T15:45:48.034171+0000","last_became_peered":"2024-04-25T15:45:48.034171+0000","last_unstale":"2024-04-25T15:45:51.023255+0000","last_undegraded":"2024-04-25T15:45:51.023255+0000","last_fullsized":"2024-04-25T15:45:51.023255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.757951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.262758+0000","last_change":"2024-04-25T15:45:49.030626+0000","last_active":"2024-04-25T15:45:52.262758+0000","last_peered":"2024-04-25T15:45:52.262758+0000","last_clean":"2024-04-25T15:45:52.262758+0000","last_became_active":"2024-04-25T15:45:49.030305+0000","last_became_peered":"2024-04-25T15:45:49.030305+0000","last_unstale":"2024-04-25T15:45:52.262758+0000","last_undegraded":"2024-04-25T15:45:52.262758+0000","last_fullsized":"2024-04-25T15:45:52.262758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:56.828104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035811+0000","last_change":"2024-04-25T15:45:48.030606+0000","last_active":"2024-04-25T15:45:50.035811+0000","last_peered":"2024-04-25T15:45:50.035811+0000","last_clean":"2024-04-25T15:45:50.035811+0000","last_became_active":"2024-04-25T15:45:48.030252+0000","last_became_peered":"2024-04-25T15:45:48.030252+0000","last_unstale":"2024-04-25T15:45:50.035811+0000","last_undegraded":"2024-04-25T15:45:50.035811+0000","last_fullsized":"2024-04-25T15:45:50.035811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:48.804981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034146+0000","last_change":"2024-04-25T15:45:49.038753+0000","last_active":"2024-04-25T15:45:50.034146+0000","last_peered":"2024-04-25T15:45:50.034146+0000","last_clean":"2024-04-25T15:45:50.034146+0000","last_became_active":"2024-04-25T15:45:49.038478+0000","last_became_peered":"2024-04-25T15:45:49.038478+0000","last_unstale":"2024-04-25T15:45:50.034146+0000","last_undegraded":"2024-04-25T15:45:50.034146+0000","last_fullsized":"2024-04-25T15:45:50.034146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:42.276640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035782+0000","last_change":"2024-04-25T15:45:48.031558+0000","last_active":"2024-04-25T15:45:50.035782+0000","last_peered":"2024-04-25T15:45:50.035782+0000","last_clean":"2024-04-25T15:45:50.035782+0000","last_became_active":"2024-04-25T15:45:48.030245+0000","last_became_peered":"2024-04-25T15:45:48.030245+0000","last_unstale":"2024-04-25T15:45:50.035782+0000","last_undegraded":"2024-04-25T15:45:50.035782+0000","last_fullsized":"2024-04-25T15:45:50.035782+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:17:18.304876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034207+0000","last_change":"2024-04-25T15:45:49.047049+0000","last_active":"2024-04-25T15:45:50.034207+0000","last_peered":"2024-04-25T15:45:50.034207+0000","last_clean":"2024-04-25T15:45:50.034207+0000","last_became_active":"2024-04-25T15:45:49.046746+0000","last_became_peered":"2024-04-25T15:45:49.046746+0000","last_unstale":"2024-04-25T15:45:50.034207+0000","last_undegraded":"2024-04-25T15:45:50.034207+0000","last_fullsized":"2024-04-25T15:45:50.034207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:38.657357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034800+0000","last_change":"2024-04-25T15:45:48.032149+0000","last_active":"2024-04-25T15:45:50.034800+0000","last_peered":"2024-04-25T15:45:50.034800+0000","last_clean":"2024-04-25T15:45:50.034800+0000","last_became_active":"2024-04-25T15:45:48.031853+0000","last_became_peered":"2024-04-25T15:45:48.031853+0000","last_unstale":"2024-04-25T15:45:50.034800+0000","last_undegraded":"2024-04-25T15:45:50.034800+0000","last_fullsized":"2024-04-25T15:45:50.034800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:11.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.263032+0000","last_change":"2024-04-25T15:45:49.030640+0000","last_active":"2024-04-25T15:45:52.263032+0000","last_peered":"2024-04-25T15:45:52.263032+0000","last_clean":"2024-04-25T15:45:52.263032+0000","last_became_active":"2024-04-25T15:45:49.030331+0000","last_became_peered":"2024-04-25T15:45:49.030331+0000","last_unstale":"2024-04-25T15:45:52.263032+0000","last_undegraded":"2024-04-25T15:45:52.263032+0000","last_fullsized":"2024-04-25T15:45:52.263032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.869005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777254+0000","last_change":"2024-04-25T15:45:48.033544+0000","last_active":"2024-04-25T15:45:50.777254+0000","last_peered":"2024-04-25T15:45:50.777254+0000","last_clean":"2024-04-25T15:45:50.777254+0000","last_became_active":"2024-04-25T15:45:48.033248+0000","last_became_peered":"2024-04-25T15:45:48.033248+0000","last_unstale":"2024-04-25T15:45:50.777254+0000","last_undegraded":"2024-04-25T15:45:50.777254+0000","last_fullsized":"2024-04-25T15:45:50.777254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:09.595887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023465+0000","last_change":"2024-04-25T15:45:49.033989+0000","last_active":"2024-04-25T15:45:51.023465+0000","last_peered":"2024-04-25T15:45:51.023465+0000","last_clean":"2024-04-25T15:45:51.023465+0000","last_became_active":"2024-04-25T15:45:49.033692+0000","last_became_peered":"2024-04-25T15:45:49.033692+0000","last_unstale":"2024-04-25T15:45:51.023465+0000","last_undegraded":"2024-04-25T15:45:51.023465+0000","last_fullsized":"2024-04-25T15:45:51.023465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.263016+0000","last_change":"2024-04-25T15:45:48.026000+0000","last_active":"2024-04-25T15:45:52.263016+0000","last_peered":"2024-04-25T15:45:52.263016+0000","last_clean":"2024-04-25T15:45:52.263016+0000","last_became_active":"2024-04-25T15:45:48.025670+0000","last_became_peered":"2024-04-25T15:45:48.025670+0000","last_unstale":"2024-04-25T15:45:52.263016+0000","last_undegraded":"2024-04-25T15:45:52.263016+0000","last_fullsized":"2024-04-25T15:45:52.263016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:55.222065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023746+0000","last_change":"2024-04-25T15:45:49.042149+0000","last_active":"2024-04-25T15:45:51.023746+0000","last_peered":"2024-04-25T15:45:51.023746+0000","last_clean":"2024-04-25T15:45:51.023746+0000","last_became_active":"2024-04-25T15:45:49.041847+0000","last_became_peered":"2024-04-25T15:45:49.041847+0000","last_unstale":"2024-04-25T15:45:51.023746+0000","last_undegraded":"2024-04-25T15:45:51.023746+0000","last_fullsized":"2024-04-25T15:45:51.023746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:45.813778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.262732+0000","last_change":"2024-04-25T15:45:48.028925+0000","last_active":"2024-04-25T15:45:52.262732+0000","last_peered":"2024-04-25T15:45:52.262732+0000","last_clean":"2024-04-25T15:45:52.262732+0000","last_became_active":"2024-04-25T15:45:48.028353+0000","last_became_peered":"2024-04-25T15:45:48.028353+0000","last_unstale":"2024-04-25T15:45:52.262732+0000","last_undegraded":"2024-04-25T15:45:52.262732+0000","last_fullsized":"2024-04-25T15:45:52.262732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:28.927396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794360+0000","last_change":"2024-04-25T15:45:49.032361+0000","last_active":"2024-04-25T15:45:50.794360+0000","last_peered":"2024-04-25T15:45:50.794360+0000","last_clean":"2024-04-25T15:45:50.794360+0000","last_became_active":"2024-04-25T15:45:49.032084+0000","last_became_peered":"2024-04-25T15:45:49.032084+0000","last_unstale":"2024-04-25T15:45:50.794360+0000","last_undegraded":"2024-04-25T15:45:50.794360+0000","last_fullsized":"2024-04-25T15:45:50.794360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:53.685470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.262688+0000","last_change":"2024-04-25T15:45:48.027883+0000","last_active":"2024-04-25T15:45:52.262688+0000","last_peered":"2024-04-25T15:45:52.262688+0000","last_clean":"2024-04-25T15:45:52.262688+0000","last_became_active":"2024-04-25T15:45:48.027582+0000","last_became_peered":"2024-04-25T15:45:48.027582+0000","last_unstale":"2024-04-25T15:45:52.262688+0000","last_undegraded":"2024-04-25T15:45:52.262688+0000","last_fullsized":"2024-04-25T15:45:52.262688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:07.611360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034848+0000","last_change":"2024-04-25T15:45:49.037390+0000","last_active":"2024-04-25T15:45:50.034848+0000","last_peered":"2024-04-25T15:45:50.034848+0000","last_clean":"2024-04-25T15:45:50.034848+0000","last_became_active":"2024-04-25T15:45:49.037059+0000","last_became_peered":"2024-04-25T15:45:49.037059+0000","last_unstale":"2024-04-25T15:45:50.034848+0000","last_undegraded":"2024-04-25T15:45:50.034848+0000","last_fullsized":"2024-04-25T15:45:50.034848+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:44.172577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.340247+0000","last_change":"2024-04-25T15:45:48.035036+0000","last_active":"2024-04-25T15:45:51.340247+0000","last_peered":"2024-04-25T15:45:51.340247+0000","last_clean":"2024-04-25T15:45:51.340247+0000","last_became_active":"2024-04-25T15:45:48.034635+0000","last_became_peered":"2024-04-25T15:45:48.034635+0000","last_unstale":"2024-04-25T15:45:51.340247+0000","last_undegraded":"2024-04-25T15:45:51.340247+0000","last_fullsized":"2024-04-25T15:45:51.340247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.793849+0000","last_change":"2024-04-25T15:45:49.031634+0000","last_active":"2024-04-25T15:45:50.793849+0000","last_peered":"2024-04-25T15:45:50.793849+0000","last_clean":"2024-04-25T15:45:50.793849+0000","last_became_active":"2024-04-25T15:45:49.030687+0000","last_became_peered":"2024-04-25T15:45:49.030687+0000","last_unstale":"2024-04-25T15:45:50.793849+0000","last_undegraded":"2024-04-25T15:45:50.793849+0000","last_fullsized":"2024-04-25T15:45:50.793849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:02.745348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023796+0000","last_change":"2024-04-25T15:45:48.040359+0000","last_active":"2024-04-25T15:45:51.023796+0000","last_peered":"2024-04-25T15:45:51.023796+0000","last_clean":"2024-04-25T15:45:51.023796+0000","last_became_active":"2024-04-25T15:45:48.040028+0000","last_became_peered":"2024-04-25T15:45:48.040028+0000","last_unstale":"2024-04-25T15:45:51.023796+0000","last_undegraded":"2024-04-25T15:45:51.023796+0000","last_fullsized":"2024-04-25T15:45:51.023796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:50.714213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.036153+0000","last_change":"2024-04-25T15:45:49.042677+0000","last_active":"2024-04-25T15:45:50.036153+0000","last_peered":"2024-04-25T15:45:50.036153+0000","last_clean":"2024-04-25T15:45:50.036153+0000","last_became_active":"2024-04-25T15:45:49.039943+0000","last_became_peered":"2024-04-25T15:45:49.039943+0000","last_unstale":"2024-04-25T15:45:50.036153+0000","last_undegraded":"2024-04-25T15:45:50.036153+0000","last_fullsized":"2024-04-25T15:45:50.036153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:24.033395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035690+0000","last_change":"2024-04-25T15:45:48.032412+0000","last_active":"2024-04-25T15:45:50.035690+0000","last_peered":"2024-04-25T15:45:50.035690+0000","last_clean":"2024-04-25T15:45:50.035690+0000","last_became_active":"2024-04-25T15:45:48.032095+0000","last_became_peered":"2024-04-25T15:45:48.032095+0000","last_unstale":"2024-04-25T15:45:50.035690+0000","last_undegraded":"2024-04-25T15:45:50.035690+0000","last_fullsized":"2024-04-25T15:45:50.035690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:38.208848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:51.023382+0000","last_change":"2024-04-25T15:45:49.037021+0000","last_active":"2024-04-25T15:45:51.023382+0000","last_peered":"2024-04-25T15:45:51.023382+0000","last_clean":"2024-04-25T15:45:51.023382+0000","last_became_active":"2024-04-25T15:45:49.036709+0000","last_became_peered":"2024-04-25T15:45:49.036709+0000","last_unstale":"2024-04-25T15:45:51.023382+0000","last_undegraded":"2024-04-25T15:45:51.023382+0000","last_fullsized":"2024-04-25T15:45:51.023382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:48.337208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035350+0000","last_change":"2024-04-25T15:45:48.026477+0000","last_active":"2024-04-25T15:45:50.035350+0000","last_peered":"2024-04-25T15:45:50.035350+0000","last_clean":"2024-04-25T15:45:50.035350+0000","last_became_active":"2024-04-25T15:45:48.026123+0000","last_became_peered":"2024-04-25T15:45:48.026123+0000","last_unstale":"2024-04-25T15:45:50.035350+0000","last_undegraded":"2024-04-25T15:45:50.035350+0000","last_fullsized":"2024-04-25T15:45:50.035350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:19.695224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.793907+0000","last_change":"2024-04-25T15:45:49.041247+0000","last_active":"2024-04-25T15:45:50.793907+0000","last_peered":"2024-04-25T15:45:50.793907+0000","last_clean":"2024-04-25T15:45:50.793907+0000","last_became_active":"2024-04-25T15:45:49.040773+0000","last_became_peered":"2024-04-25T15:45:49.040773+0000","last_unstale":"2024-04-25T15:45:50.793907+0000","last_undegraded":"2024-04-25T15:45:50.793907+0000","last_fullsized":"2024-04-25T15:45:50.793907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:14.684389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.793771+0000","last_change":"2024-04-25T15:45:48.032005+0000","last_active":"2024-04-25T15:45:50.793771+0000","last_peered":"2024-04-25T15:45:50.793771+0000","last_clean":"2024-04-25T15:45:50.793771+0000","last_became_active":"2024-04-25T15:45:48.031690+0000","last_became_peered":"2024-04-25T15:45:48.031690+0000","last_unstale":"2024-04-25T15:45:50.793771+0000","last_undegraded":"2024-04-25T15:45:50.793771+0000","last_fullsized":"2024-04-25T15:45:50.793771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:03.901419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794181+0000","last_change":"2024-04-25T15:45:49.035767+0000","last_active":"2024-04-25T15:45:50.794181+0000","last_peered":"2024-04-25T15:45:50.794181+0000","last_clean":"2024-04-25T15:45:50.794181+0000","last_became_active":"2024-04-25T15:45:49.035455+0000","last_became_peered":"2024-04-25T15:45:49.035455+0000","last_unstale":"2024-04-25T15:45:50.794181+0000","last_undegraded":"2024-04-25T15:45:50.794181+0000","last_fullsized":"2024-04-25T15:45:50.794181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:15.795419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.034402+0000","last_change":"2024-04-25T15:45:48.039813+0000","last_active":"2024-04-25T15:45:50.034402+0000","last_peered":"2024-04-25T15:45:50.034402+0000","last_clean":"2024-04-25T15:45:50.034402+0000","last_became_active":"2024-04-25T15:45:48.039488+0000","last_became_peered":"2024-04-25T15:45:48.039488+0000","last_unstale":"2024-04-25T15:45:50.034402+0000","last_undegraded":"2024-04-25T15:45:50.034402+0000","last_fullsized":"2024-04-25T15:45:50.034402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:11.300706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777471+0000","last_change":"2024-04-25T15:45:49.049616+0000","last_active":"2024-04-25T15:45:50.777471+0000","last_peered":"2024-04-25T15:45:50.777471+0000","last_clean":"2024-04-25T15:45:50.777471+0000","last_became_active":"2024-04-25T15:45:49.049301+0000","last_became_peered":"2024-04-25T15:45:49.049301+0000","last_unstale":"2024-04-25T15:45:50.777471+0000","last_undegraded":"2024-04-25T15:45:50.777471+0000","last_fullsized":"2024-04-25T15:45:50.777471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:15.795419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.794044+0000","last_change":"2024-04-25T15:45:48.025876+0000","last_active":"2024-04-25T15:45:50.794044+0000","last_peered":"2024-04-25T15:45:50.794044+0000","last_clean":"2024-04-25T15:45:50.794044+0000","last_became_active":"2024-04-25T15:45:48.025572+0000","last_became_peered":"2024-04-25T15:45:48.025572+0000","last_unstale":"2024-04-25T15:45:50.794044+0000","last_undegraded":"2024-04-25T15:45:50.794044+0000","last_fullsized":"2024-04-25T15:45:50.794044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:23.253552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777517+0000","last_change":"2024-04-25T15:45:49.046609+0000","last_active":"2024-04-25T15:45:50.777517+0000","last_peered":"2024-04-25T15:45:50.777517+0000","last_clean":"2024-04-25T15:45:50.777517+0000","last_became_active":"2024-04-25T15:45:49.045976+0000","last_became_peered":"2024-04-25T15:45:49.045976+0000","last_unstale":"2024-04-25T15:45:50.777517+0000","last_undegraded":"2024-04-25T15:45:50.777517+0000","last_fullsized":"2024-04-25T15:45:50.777517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:17.471807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.777116+0000","last_change":"2024-04-25T15:45:48.027979+0000","last_active":"2024-04-25T15:45:50.777116+0000","last_peered":"2024-04-25T15:45:50.777116+0000","last_clean":"2024-04-25T15:45:50.777116+0000","last_became_active":"2024-04-25T15:45:48.027663+0000","last_became_peered":"2024-04-25T15:45:48.027663+0000","last_unstale":"2024-04-25T15:45:50.777116+0000","last_undegraded":"2024-04-25T15:45:50.777116+0000","last_fullsized":"2024-04-25T15:45:50.777116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:29.991055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035582+0000","last_change":"2024-04-25T15:45:49.048917+0000","last_active":"2024-04-25T15:45:50.035582+0000","last_peered":"2024-04-25T15:45:50.035582+0000","last_clean":"2024-04-25T15:45:50.035582+0000","last_became_active":"2024-04-25T15:45:49.048529+0000","last_became_peered":"2024-04-25T15:45:49.048529+0000","last_unstale":"2024-04-25T15:45:50.035582+0000","last_undegraded":"2024-04-25T15:45:50.035582+0000","last_fullsized":"2024-04-25T15:45:50.035582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:48.006343+0000","last_clean_scrub_stamp":"2024-04-25T15:45:48.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.869005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:52.263179+0000","last_change":"2024-04-25T15:45:48.027167+0000","last_active":"2024-04-25T15:45:52.263179+0000","last_peered":"2024-04-25T15:45:52.263179+0000","last_clean":"2024-04-25T15:45:52.263179+0000","last_became_active":"2024-04-25T15:45:48.026855+0000","last_became_peered":"2024-04-25T15:45:48.026855+0000","last_unstale":"2024-04-25T15:45:52.263179+0000","last_undegraded":"2024-04-25T15:45:52.263179+0000","last_fullsized":"2024-04-25T15:45:52.263179+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:45:47.004252+0000","last_clean_scrub_stamp":"2024-04-25T15:45:47.004252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:48.804981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":217,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T15:45:50.035837+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:45:50.035837+0000","last_peered":"2024-04-25T15:45:50.035837+0000","last_clean":"2024-04-25T15:45:50.035837+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:45:50.035837+0000","last_undegraded":"2024-04-25T15:45:50.035837+0000","last_fullsized":"2024-04-25T15:45:50.035837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":913408,"data_stored":408853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":407823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":913408,"data_stored":407983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":407353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343356,"statfs":{"total":96636764160,"available":96607596544,"internally_reserved":0,"allocated":1495040,"data_stored":997609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":997631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":905216,"data_stored":407275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":408957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:45:56.820 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:45:56.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T15:45:56.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.970+0000 7f6bf29ba640 1 Processor -- start 2024-04-25T15:45:56.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.970+0000 7f6bf29ba640 1 -- start start 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.971+0000 7f6bf29ba640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6bec0b48d0 0x7f6bec0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.971+0000 7f6bf29ba640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.971+0000 7f6bf29ba640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bec0b7fa0 con 0x7f6bec0d41b0 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.971+0000 7f6bf29ba640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec163fb0 con 0x7f6bec0b48d0 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.971+0000 7f6bf29ba640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec164270 con 0x7f6bec0b7b90 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6bf0f57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6beb7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6bec0b48d0 0x7f6bec0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6bf0f57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:55702/0 (socket says 172.21.15.80:55702) 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6bebfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f6bec0d41b0 0x7f6bec1602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:34272/0 (socket says 172.21.15.80:34272) 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6bf0f57640 1 -- 172.21.15.80:0/1697833715 learned_addr learned my addr 172.21.15.80:0/1697833715 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6beb7fe640 1 -- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 msgr2=0x7f6bec0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6beb7fe640 1 --2- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6beb7fe640 1 -- 172.21.15.80:0/1697833715 >> v1:172.21.15.195:6789/0 conn(0x7f6bec0d41b0 legacy=0x7f6bec1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.972+0000 7f6beb7fe640 1 -- 172.21.15.80:0/1697833715 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec164550 con 0x7f6bec0b48d0 2024-04-25T15:45:56.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.973+0000 7f6beb7fe640 1 --2- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec0b7650 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92085e247e9a4563 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:56.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.973+0000 7f6beaffd640 1 -- 172.21.15.80:0/1697833715 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0037070 con 0x7f6bec0b48d0 2024-04-25T15:45:56.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.973+0000 7f6beaffd640 1 -- 172.21.15.80:0/1697833715 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be0032440 con 0x7f6bec0b48d0 2024-04-25T15:45:56.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6beaffd640 1 -- 172.21.15.80:0/1697833715 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0032810 con 0x7f6bec0b48d0 2024-04-25T15:45:56.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 msgr2=0x7f6bec0b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec0b7650 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097a0 tx=0x7f6be002a180 comp rx=0 tx=0).stop 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1697833715 shutdown_connections 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1697833715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec0b7650 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1697833715 >> 172.21.15.80:0/1697833715 conn(0x7f6bec06e9f0 msgr2=0x7f6bec0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1697833715 shutdown_connections 2024-04-25T15:45:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.974+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1697833715 wait complete. 2024-04-25T15:45:56.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.976+0000 7f6bf29ba640 1 Processor -- start 2024-04-25T15:45:56.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.976+0000 7f6bf29ba640 1 -- start start 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 0x7f6bec0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec0b4fd0 con 0x7f6bec0d41b0 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec164b10 con 0x7f6bec0b48d0 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec0b5150 con 0x7f6bec0b7b90 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 0x7f6bec0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 0x7f6bec0cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33666/0 (socket says 172.21.15.80:33666) 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 -- 172.21.15.80:0/1980163290 learned_addr learned my addr 172.21.15.80:0/1980163290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6beb7fe640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bebfff640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 -- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 msgr2=0x7f6bec0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 -- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 msgr2=0x7f6bec150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 -- 172.21.15.80:0/1980163290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec151180 con 0x7f6bec0d41b0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf0f57640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 0x7f6bec0cd290 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009cf0 tx=0x7f6be400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be400cd20 con 0x7f6bec0d41b0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be4003990 con 0x7f6bec0d41b0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.978+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec0cc8a0 con 0x7f6bec0d41b0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.979+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4003d80 con 0x7f6bec0d41b0 2024-04-25T15:45:56.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.979+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec0cabc0 con 0x7f6bec0d41b0 2024-04-25T15:45:56.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.979+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec0cc5f0 con 0x7f6bec0d41b0 2024-04-25T15:45:56.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.980+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6be4012050 con 0x7f6bec0d41b0 2024-04-25T15:45:56.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.981+0000 7f6be8ff9640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6bd80744e0 0x7f6bd80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:56.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.981+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f6be4095800 con 0x7f6bec0d41b0 2024-04-25T15:45:56.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.981+0000 7f6bebfff640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6bd80744e0 0x7f6bd80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:56.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.981+0000 7f6bebfff640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6bd80744e0 0x7f6bd80769f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000f60 tx=0x7f6bdc007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:56.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:56.985+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6be4010040 con 0x7f6bec0d41b0 2024-04-25T15:45:57.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.233+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6bec06a100 con 0x7f6bec0d41b0 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.236+0000 7f6be8ff9640 1 -- 172.21.15.80:0/1980163290 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f6be405fe00 con 0x7f6bec0d41b0 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T15:45:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6bd80744e0 msgr2=0x7f6bd80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6bd80744e0 0x7f6bd80769f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000f60 tx=0x7f6bdc007ce0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 msgr2=0x7f6bec0cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 0x7f6bec0cd290 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009cf0 tx=0x7f6be400c490 comp rx=0 tx=0).stop 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 shutdown_connections 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6bd80744e0 0x7f6bd80769f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bec0d41b0 0x7f6bec0cd290 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6bec0b7b90 0x7f6bec0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 --2- 172.21.15.80:0/1980163290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6bec0b48d0 0x7f6bec150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 >> 172.21.15.80:0/1980163290 conn(0x7f6bec06e9f0 msgr2=0x7f6bec0c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:57.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 shutdown_connections 2024-04-25T15:45:57.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.238+0000 7f6bf29ba640 1 -- 172.21.15.80:0/1980163290 wait complete. 2024-04-25T15:45:57.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:45:57.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.356+0000 7fe1d18e9640 1 Processor -- start 2024-04-25T15:45:57.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.356+0000 7fe1d18e9640 1 -- start start 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1d18e9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe1cc0b7d60 0x7fe1cc16b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1d18e9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1cc0d59d0 con 0x7fe1cc0b48d0 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1d18e9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1cc163fb0 con 0x7fe1cc0d41b0 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1d18e9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe1cc164270 con 0x7fe1cc0b7d60 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1ca7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe1cc0b48d0 0x7fe1cc0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36068/0 (socket says 172.21.15.80:36068) 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1ca7fc640 1 -- 172.21.15.80:0/1268440830 learned_addr learned my addr 172.21.15.80:0/1268440830 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093494884 0 0) 0x7fe1cc0d59d0 con 0x7fe1cc0b48d0 2024-04-25T15:45:57.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/1268440830 >> v2:172.21.15.195:3300/0 conn(0x7fe1cc0b7d60 0x7fe1cc16b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b4003520 con 0x7fe1cc0b48d0 2024-04-25T15:45:57.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781187302 0 0) 0x7fe1b4003520 con 0x7fe1cc0b48d0 2024-04-25T15:45:57.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 >> v2:172.21.15.195:3300/0 conn(0x7fe1cc0b7d60 msgr2=0x7fe1cc16b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:57.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1c9ffb640 1 --2- 172.21.15.80:0/1268440830 >> v2:172.21.15.195:3300/0 conn(0x7fe1cc0b7d60 0x7fe1cc16b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.358+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 >> v1:172.21.15.195:6789/0 conn(0x7fe1cc0d41b0 legacy=0x7fe1cc1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc164550 con 0x7fe1cc0b48d0 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe1c0001670 con 0x7fe1cc0b48d0 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 >> v1:172.21.15.80:6789/0 conn(0x7fe1cc0b48d0 legacy=0x7fe1cc0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b40039b0 0x7fe1b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1b4004800 0x7fe1b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc164270 con 0x7fe1b4005250 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b400c1e0 con 0x7fe1b40039b0 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b400c3e0 con 0x7fe1b4004800 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1caffd640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b40039b0 0x7fe1b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1ca7fc640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1b4004800 0x7fe1b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1cb7fe640 1 -- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1b4004800 msgr2=0x7fe1b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1b4004800 0x7fe1b4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1cb7fe640 1 -- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b40039b0 msgr2=0x7fe1b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b40039b0 0x7fe1b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1cb7fe640 1 -- 172.21.15.80:0/1268440830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b4003520 con 0x7fe1b4005250 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.359+0000 7fe1ca7fc640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1b4004800 0x7fe1b4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1cb7fe640 1 -- 172.21.15.80:0/1268440830 reap_dead start 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1b400b9c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009a90 tx=0x7fe1b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438f70ef6e423dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4009690 con 0x7fe1b4005250 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4004020 con 0x7fe1b4005250 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1c9ffb640 1 -- 172.21.15.80:0/1268440830 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4004410 con 0x7fe1b4005250 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1d18e9640 1 -- 172.21.15.80:0/1268440830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 msgr2=0x7fe1b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.360+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1b400b9c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009a90 tx=0x7fe1b4005830 comp rx=0 tx=0).stop 2024-04-25T15:45:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.361+0000 7fe1d18e9640 1 -- 172.21.15.80:0/1268440830 shutdown_connections 2024-04-25T15:45:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.361+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/1268440830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1b400b9c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.361+0000 7fe1d18e9640 1 -- 172.21.15.80:0/1268440830 >> 172.21.15.80:0/1268440830 conn(0x7fe1cc06e9f0 msgr2=0x7fe1cc0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.361+0000 7fe1d18e9640 1 -- 172.21.15.80:0/1268440830 shutdown_connections 2024-04-25T15:45:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.361+0000 7fe1d18e9640 1 -- 172.21.15.80:0/1268440830 wait complete. 2024-04-25T15:45:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.362+0000 7fe1d18e9640 1 Processor -- start 2024-04-25T15:45:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.362+0000 7fe1d18e9640 1 -- start start 2024-04-25T15:45:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1cc14afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1cc1633e0 0x7fe1cc14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0cba80 0x7fe1cc0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0b4fd0 con 0x7fe1b4005250 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc164b10 con 0x7fe1cc0cba80 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0b5150 con 0x7fe1cc1633e0 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1cc14afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1cc14afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33688/0 (socket says 172.21.15.80:33688) 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 -- 172.21.15.80:0/2656517742 learned_addr learned my addr 172.21.15.80:0/2656517742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1ca7fc640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1cc1633e0 0x7fe1cc14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0cba80 0x7fe1cc0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 -- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1cc1633e0 msgr2=0x7fe1cc14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1cc1633e0 0x7fe1cc14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 -- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0cba80 msgr2=0x7fe1cc0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0cba80 0x7fe1cc0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 -- 172.21.15.80:0/2656517742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc14bf20 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1ca7fc640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1cc1633e0 0x7fe1cc14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1cb7fe640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0cba80 0x7fe1cc0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1caffd640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1cc14afe0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00f960 tx=0x7fe1bc00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc003b80 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc018070 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00d7f0 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc0ccf60 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.364+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc149080 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.365+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc06a100 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.366+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe1bc00d990 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.366+0000 7fe1b3fff640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1b80744b0 0x7fe1b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.366+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fe1bc095520 con 0x7fe1b4005250 2024-04-25T15:45:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.366+0000 7fe1ca7fc640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1b80744b0 0x7fe1b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:57.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.367+0000 7fe1ca7fc640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1b80744b0 0x7fe1b80769c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc1608e0 tx=0x7fe1c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:57.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.371+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1bc05f560 con 0x7fe1b4005250 2024-04-25T15:45:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.582+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1cc163cd0 con 0x7fe1b4005250 2024-04-25T15:45:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.582+0000 7fe1b3fff640 1 -- 172.21.15.80:0/2656517742 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7fe1bc063860 con 0x7fe1b4005250 2024-04-25T15:45:57.583 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:45:57.584 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:45:57.584 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1b80744b0 msgr2=0x7fe1b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1b80744b0 0x7fe1b80769c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc1608e0 tx=0x7fe1c0009040 comp rx=0 tx=0).stop 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 msgr2=0x7fe1cc14afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1cc14afe0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00f960 tx=0x7fe1bc00fe20 comp rx=0 tx=0).stop 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 shutdown_connections 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe1b80744b0 0x7fe1b80769c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0cba80 0x7fe1cc0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1cc1633e0 0x7fe1cc14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 --2- 172.21.15.80:0/2656517742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b4005250 0x7fe1cc14afe0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.584+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 >> 172.21.15.80:0/2656517742 conn(0x7fe1cc06e9f0 msgr2=0x7fe1cc0b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:57.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.585+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 shutdown_connections 2024-04-25T15:45:57.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:57.585+0000 7fe1d18e9640 1 -- 172.21.15.80:0/2656517742 wait complete. 2024-04-25T15:45:57.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:45:48.382037+0000', 'modified': '2024-04-25T15:45:50.377180+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6684}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6684': {'gid': 6684, 'name': 'c', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/231548395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 231548395}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 231548395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6684, 'qdb_cluster': [6684]} 2024-04-25T15:45:57.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:45:58.000 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:45:58.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.110+0000 7f363359e640 1 Processor -- start 2024-04-25T15:45:58.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.110+0000 7f363359e640 1 -- start start 2024-04-25T15:45:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f363359e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ce8c0 0x7f36340d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f363359e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36340d2db0 0x7f363406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f363359e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36340cf7e0 con 0x7f36340d0380 2024-04-25T15:45:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f363359e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f36340d31c0 con 0x7f36340d2db0 2024-04-25T15:45:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f363359e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f36340d1d10 con 0x7f36340ce8c0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f3632d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36340d2db0 0x7f363406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f3632d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36340d2db0 0x7f363406c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33704/0 (socket says 172.21.15.80:33704) 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f3632d9d640 1 -- 172.21.15.80:0/1104795768 learned_addr learned my addr 172.21.15.80:0/1104795768 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.111+0000 7f3631d9b640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ce8c0 0x7f36340d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f3632d9d640 1 -- 172.21.15.80:0/1104795768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ce8c0 msgr2=0x7f36340d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f3632d9d640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ce8c0 0x7f36340d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f3632d9d640 1 -- 172.21.15.80:0/1104795768 >> v1:172.21.15.195:6789/0 conn(0x7f36340d0380 legacy=0x7f36340ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f3632d9d640 1 -- 172.21.15.80:0/1104795768 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36340d1ff0 con 0x7f36340d2db0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f3631d9b640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ce8c0 0x7f36340d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f3632d9d640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340d2db0 0x7f363406c5c0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f362c009870 tx=0x7f362c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dbb2d446057fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f363159a640 1 -- 172.21.15.80:0/1104795768 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c037070 con 0x7f36340d2db0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.112+0000 7f363159a640 1 -- 172.21.15.80:0/1104795768 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c032440 con 0x7f36340d2db0 2024-04-25T15:45:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363159a640 1 -- 172.21.15.80:0/1104795768 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c032810 con 0x7f36340d2db0 2024-04-25T15:45:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 -- 172.21.15.80:0/1104795768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340d2db0 msgr2=0x7f363406c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340d2db0 0x7f363406c5c0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f362c009870 tx=0x7f362c02a270 comp rx=0 tx=0).stop 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 -- 172.21.15.80:0/1104795768 shutdown_connections 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340d2db0 0x7f363406c5c0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 --2- 172.21.15.80:0/1104795768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ce8c0 0x7f36340d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 -- 172.21.15.80:0/1104795768 >> 172.21.15.80:0/1104795768 conn(0x7f363409b410 msgr2=0x7f363409b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 -- 172.21.15.80:0/1104795768 shutdown_connections 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.113+0000 7f363359e640 1 -- 172.21.15.80:0/1104795768 wait complete. 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.115+0000 7f363359e640 1 Processor -- start 2024-04-25T15:45:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.115+0000 7f363359e640 1 -- start start 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.116+0000 7f363359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 0x7f363409d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340d0380 0x7f363409e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36340d2db0 0x7f36340b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f36340d2890 con 0x7f36340ce8c0 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f36340d25b0 con 0x7f36340d2db0 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f363406eee0 con 0x7f36340d0380 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 0x7f363409d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 0x7f363409d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33708/0 (socket says 172.21.15.80:33708) 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 -- 172.21.15.80:0/1198681650 learned_addr learned my addr 172.21.15.80:0/1198681650 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f3632d9d640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36340d2db0 0x7f36340b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f3631d9b640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340d0380 0x7f363409e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 -- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340d0380 msgr2=0x7f363409e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340d0380 0x7f363409e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 -- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36340d2db0 msgr2=0x7f36340b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36340d2db0 0x7f36340b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 -- 172.21.15.80:0/1198681650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363409d9a0 con 0x7f36340ce8c0 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363259c640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 0x7f363409d460 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f362400c760 tx=0x7f362400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f362affd640 1 -- 172.21.15.80:0/1198681650 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624016020 con 0x7f36340ce8c0 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f362affd640 1 -- 172.21.15.80:0/1198681650 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3624006d50 con 0x7f36340ce8c0 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36341fab30 con 0x7f36340ce8c0 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f362affd640 1 -- 172.21.15.80:0/1198681650 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624003bb0 con 0x7f36340ce8c0 2024-04-25T15:45:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.117+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36341fb0f0 con 0x7f36340ce8c0 2024-04-25T15:45:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.119+0000 7f362affd640 1 -- 172.21.15.80:0/1198681650 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f362400a850 con 0x7f36340ce8c0 2024-04-25T15:45:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.119+0000 7f362affd640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.120+0000 7f362affd640 1 -- 172.21.15.80:0/1198681650 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f3624094ee0 con 0x7f36340ce8c0 2024-04-25T15:45:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.120+0000 7f3631d9b640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.120+0000 7f3631d9b640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f36340b47f0 tx=0x7f361c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.120+0000 7f363fd8a740 1 Processor -- start 2024-04-25T15:45:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.121+0000 7f363fd8a740 1 -- start start 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b166e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b166b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b1644460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363fd8a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5610b15a8740 con 0x5610b12a2270 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5610b15443a0 con 0x5610b12793b0 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5610b15a4700 con 0x5610b1281590 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b166e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b166e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33720/0 (socket says 172.21.15.80:33720) 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 -- 172.21.15.80:0/3126866853 learned_addr learned my addr 172.21.15.80:0/3126866853 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 -- 172.21.15.80:0/3126866853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 msgr2=0x5610b1644460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b1644460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 -- 172.21.15.80:0/3126866853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 msgr2=0x5610b166b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b166b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 -- 172.21.15.80:0/3126866853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610b1560750 con 0x5610b12a2270 2024-04-25T15:45:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f363259c640 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b166e800 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3624007fd0 tx=0x7f3624000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e11e7167a6f0927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.122+0000 7f3613fff640 1 -- 172.21.15.80:0/3126866853 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624067c40 con 0x5610b12a2270 2024-04-25T15:45:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f3613fff640 1 -- 172.21.15.80:0/3126866853 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3624078380 con 0x5610b12a2270 2024-04-25T15:45:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f3613fff640 1 -- 172.21.15.80:0/3126866853 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362400ad60 con 0x5610b12a2270 2024-04-25T15:45:58.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 -- 172.21.15.80:0/3126866853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 msgr2=0x5610b166e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b166e800 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3624007fd0 tx=0x7f3624000f40 comp rx=0 tx=0).stop 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 -- 172.21.15.80:0/3126866853 shutdown_connections 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b1644460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b166b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3126866853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b166e800 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 -- 172.21.15.80:0/3126866853 >> 172.21.15.80:0/3126866853 conn(0x5610b12963c0 msgr2=0x5610b1643bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 -- 172.21.15.80:0/3126866853 shutdown_connections 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.123+0000 7f363fd8a740 1 -- 172.21.15.80:0/3126866853 wait complete. 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.124+0000 7f363fd8a740 1 -- start start 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.124+0000 7f363fd8a740 1 Processor -- start 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12793b0 0x5610b1686eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 0x5610b1667ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12a2270 0x5610b1671ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5610b152ffe0 con 0x5610b1281590 2024-04-25T15:45:58.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5610b1687960 con 0x5610b12a2270 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5610b16667b0 con 0x5610b12793b0 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 10 client.0 _ll_register_callbacks cb 0x5610b1546150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 0x5610b1667ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 0x5610b1667ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33732/0 (socket says 172.21.15.80:33732) 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 -- 172.21.15.80:0/3933953855 learned_addr learned my addr 172.21.15.80:0/3933953855 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 -- 172.21.15.80:0/3933953855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12793b0 msgr2=0x5610b1686eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12793b0 0x5610b1686eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 -- 172.21.15.80:0/3933953855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12a2270 msgr2=0x5610b1671ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12a2270 0x5610b1671ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 -- 172.21.15.80:0/3933953855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610b12ba2d0 con 0x5610b1281590 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f3631d9b640 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 0x5610b1667ab0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f361c016500 tx=0x7f361c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9bd2e9e1fb116a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f36117fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f36117fa640 1 -- 172.21.15.80:0/3933953855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c026060 con 0x5610b1281590 2024-04-25T15:45:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f36117fa640 1 -- 172.21.15.80:0/3933953855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f361c014640 con 0x5610b1281590 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.126+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3624078380 con 0x5610b1281590 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f36117fa640 1 -- 172.21.15.80:0/3933953855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f361c02c050 con 0x5610b1281590 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 10 client.6858 fetch_fsmap learned FSMap version 35 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x5610b13846b0 con 0x5610b1281590 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f36117fa640 1 -- 172.21.15.80:0/3933953855 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3624078380 con 0x5610b1281590 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f36117fa640 1 -- 172.21.15.80:0/3933953855 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f361c02f020 con 0x5610b1281590 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 10 client.6858 fetch_fsmap finished waiting for FSMap version 35 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 10 client.6858 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 20 client.6858 populate_metadata read hostname 'smithi080' 2024-04-25T15:45:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1260e40 0x5610b166f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 4 client.6858 mds_command: new command op to 6684 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 --> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610b15b6350 con 0x5610b1260e40 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f363259c640 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1260e40 0x5610b166f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.127+0000 7f36117fa640 10 client.6858 ms_handle_connect on v2:172.21.15.80:6835/231548395 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.128+0000 7f363259c640 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1260e40 0x5610b166f720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbb77d19481155ad server_cookie=1391a073ad33d19c in_seq=0 out_seq=0 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.128+0000 7f36117fa640 1 -- 172.21.15.80:0/3933953855 <== mds.0 v2:172.21.15.80:6835/231548395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5610b15b6350 con 0x5610b1260e40 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.128+0000 7f36117fa640 10 client.6858 handle_command_reply: tid=0 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.128+0000 7f363fd8a740 1 client.6858 shutdown 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.128+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 msgr2=0x5610b1667ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.128+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 0x5610b1667ab0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f361c016500 tx=0x7f361c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 shutdown_connections 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1260e40 0x5610b166f720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12a2270 0x5610b1671ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b1281590 0x5610b1667ab0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3933953855 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12793b0 0x5610b1686eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f36117fa640 0 client.6858 ms_handle_reset on v2:172.21.15.80:6835/231548395 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 >> 172.21.15.80:0/3933953855 conn(0x5610b12963c0 msgr2=0x5610b1643bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 shutdown_connections 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 1 -- 172.21.15.80:0/3933953855 wait complete. 2024-04-25T15:45:58.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.129+0000 7f363fd8a740 20 client.6858 trim_cache size 0 max 16384 2024-04-25T15:45:58.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.148+0000 7f363fd8a740 1 Processor -- start 2024-04-25T15:45:58.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.148+0000 7f363fd8a740 1 -- start start 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 0x5610b166e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b1281590 0x5610b166fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12a2270 0x5610b1686960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363fd8a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f36342065e0 con 0x5610b12793b0 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f36341fe640 con 0x5610b1281590 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3634206020 con 0x5610b12a2270 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 0x5610b166e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 0x5610b166e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33738/0 (socket says 172.21.15.80:33738) 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 -- 172.21.15.80:0/1661267995 learned_addr learned my addr 172.21.15.80:0/1661267995 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 -- 172.21.15.80:0/1661267995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12a2270 msgr2=0x5610b1686960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12a2270 0x5610b1686960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 -- 172.21.15.80:0/1661267995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b1281590 msgr2=0x5610b166fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b1281590 0x5610b166fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 -- 172.21.15.80:0/1661267995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610b166ed40 con 0x5610b12793b0 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.149+0000 7f363259c640 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 0x5610b166e800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f362405ebd0 tx=0x7f3624075000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d95ffff4f5d24f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f36137fe640 1 -- 172.21.15.80:0/1661267995 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624078380 con 0x5610b12793b0 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f36137fe640 1 -- 172.21.15.80:0/1661267995 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362400ab40 con 0x5610b12793b0 2024-04-25T15:45:58.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f36137fe640 1 -- 172.21.15.80:0/1661267995 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362405e180 con 0x5610b12793b0 2024-04-25T15:45:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 -- 172.21.15.80:0/1661267995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 msgr2=0x5610b166e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 0x5610b166e800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f362405ebd0 tx=0x7f3624075000 comp rx=0 tx=0).stop 2024-04-25T15:45:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 -- 172.21.15.80:0/1661267995 shutdown_connections 2024-04-25T15:45:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b12a2270 0x5610b1686960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b1281590 0x5610b166fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 --2- 172.21.15.80:0/1661267995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12793b0 0x5610b166e800 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 -- 172.21.15.80:0/1661267995 >> 172.21.15.80:0/1661267995 conn(0x5610b12963c0 msgr2=0x5610b1642480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 -- 172.21.15.80:0/1661267995 shutdown_connections 2024-04-25T15:45:58.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.150+0000 7f363fd8a740 1 -- 172.21.15.80:0/1661267995 wait complete. 2024-04-25T15:45:58.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.151+0000 7f363fd8a740 1 -- start start 2024-04-25T15:45:58.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.151+0000 7f363fd8a740 1 Processor -- start 2024-04-25T15:45:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b1705d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b16aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b167f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5610b1671ff0 con 0x5610b12a2270 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5610b16877c0 con 0x5610b12793b0 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5610b166d1f0 con 0x5610b1281590 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363fd8a740 10 client.0 _ll_register_callbacks cb 0x7f361c00bd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b167f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b167f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33742/0 (socket says 172.21.15.80:33742) 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 -- 172.21.15.80:0/3991455976 learned_addr learned my addr 172.21.15.80:0/3991455976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f363259c640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b1705d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3631d9b640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b16aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 -- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 msgr2=0x5610b16aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b16aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 -- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 msgr2=0x5610b1705d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b1705d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 -- 172.21.15.80:0/3991455976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610b16ab1c0 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f3632d9d640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b167f5c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f362c035040 tx=0x7f362c0329a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6419bee21f9268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f36117fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.153+0000 7f36117fa640 1 -- 172.21.15.80:0/3991455976 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c037040 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f36117fa640 1 -- 172.21.15.80:0/3991455976 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f362c03e660 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362400ab40 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f36117fa640 1 -- 172.21.15.80:0/3991455976 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f362c04c050 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 10 client.6864 fetch_fsmap learned FSMap version 35 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x5610b167fb00 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f36117fa640 1 -- 172.21.15.80:0/3991455976 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362400ab40 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f36117fa640 1 -- 172.21.15.80:0/3991455976 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f362c04f020 con 0x5610b12a2270 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 10 client.6864 fetch_fsmap finished waiting for FSMap version 35 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 10 client.6864 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 20 client.6864 populate_metadata read hostname 'smithi080' 2024-04-25T15:45:58.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1699ac0 0x5610b1699ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 4 client.6864 mds_command: new command op to 6684 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 --> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] -- command(tid 0: {"prefix": "status"}) -- 0x5610b15b01c0 con 0x5610b1699ac0 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f363259c640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1699ac0 0x5610b1699ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.154+0000 7f36117fa640 10 client.6864 ms_handle_connect on v2:172.21.15.80:6835/231548395 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363259c640 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1699ac0 0x5610b1699ed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98529cd6ce25c2f0 server_cookie=6ff43f47d8fddde5 in_seq=0 out_seq=0 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f36117fa640 1 -- 172.21.15.80:0/3991455976 <== mds.0 v2:172.21.15.80:6835/231548395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5610b15b01c0 con 0x5610b1699ac0 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f36117fa640 10 client.6864 handle_command_reply: tid=0 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 client.6864 shutdown 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 msgr2=0x5610b167f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b167f5c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f362c035040 tx=0x7f362c0329a0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 shutdown_connections 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x5610b1699ac0 0x5610b1699ed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5610b12a2270 0x5610b167f5c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f36117fa640 0 client.6864 ms_handle_reset on v2:172.21.15.80:6835/231548395 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5610b1281590 0x5610b16aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 --2- 172.21.15.80:0/3991455976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610b12793b0 0x5610b1705d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 >> 172.21.15.80:0/3991455976 conn(0x5610b12963c0 msgr2=0x5610b169ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 shutdown_connections 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 1 -- 172.21.15.80:0/3991455976 wait complete. 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.155+0000 7f363fd8a740 20 client.6864 trim_cache size 0 max 16384 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:45:58.162 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 6684, 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 9.1417388499999994, 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 35, 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 74, 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 74, 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 14.143343556 2024-04-25T15:45:58.163 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 msgr2=0x7f36140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f36340b47f0 tx=0x7f361c008040 comp rx=0 tx=0).stop 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 msgr2=0x7f363409d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 0x7f363409d460 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f362400c760 tx=0x7f362400cc20 comp rx=0 tx=0).stop 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 shutdown_connections 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f36140744b0 0x7f36140769c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36340d2db0 0x7f36340b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340d0380 0x7f363409e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 --2- 172.21.15.80:0/1198681650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36340ce8c0 0x7f363409d460 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 >> 172.21.15.80:0/1198681650 conn(0x7f363409b410 msgr2=0x7f36340af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 shutdown_connections 2024-04-25T15:45:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.156+0000 7f363359e640 1 -- 172.21.15.80:0/1198681650 wait complete. 2024-04-25T15:45:58.168 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:45:58.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.274+0000 7fe26c3d7640 1 Processor -- start 2024-04-25T15:45:58.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.274+0000 7fe26c3d7640 1 -- start start 2024-04-25T15:45:58.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26c3d7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 0x7fe2640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26c3d7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe26409d2a0 con 0x7fe2640cff30 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26c3d7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2640b9350 con 0x7fe26409ce90 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26c3d7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe2640cfb70 con 0x7fe2640b2a40 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26a173640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe2640cff30 0x7fe2640d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36070/0 (socket says 172.21.15.80:36070) 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26a173640 1 -- 172.21.15.80:0/3489728930 learned_addr learned my addr 172.21.15.80:0/3489728930 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269972640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 0x7fe2640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484687452 0 0) 0x7fe260001290 con 0x7fe2640cff30 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe250003520 con 0x7fe2640cff30 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242824663 0 0) 0x7fe2640b9350 con 0x7fe26409ce90 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe260001290 con 0x7fe26409ce90 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651233804 0 0) 0x7fe250003520 con 0x7fe2640cff30 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 msgr2=0x7fe2640b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 0x7fe2640b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 >> v1:172.21.15.195:6789/0 conn(0x7fe26409ce90 legacy=0x7fe2640d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2640cf890 con 0x7fe2640cff30 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe260001940 con 0x7fe2640cff30 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 >> v1:172.21.15.80:6789/0 conn(0x7fe2640cff30 legacy=0x7fe2640d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe250003b70 0x7fe250003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 0x7fe250004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250004d40 0x7fe250005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe2640cfb70 con 0x7fe250003b70 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe25000bbd0 con 0x7fe250004d40 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe25000bdd0 con 0x7fe2640b2a40 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.276+0000 7fe26a173640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe250003b70 0x7fe250003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe269972640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 0x7fe250004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a974640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250004d40 0x7fe250005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a173640 1 -- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 msgr2=0x7fe250004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a173640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2640b2a40 0x7fe250004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a173640 1 -- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250004d40 msgr2=0x7fe250005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a173640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250004d40 0x7fe250005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a173640 1 -- 172.21.15.80:0/3489728930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe250003520 con 0x7fe250003b70 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.277+0000 7fe26a173640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe250003b70 0x7fe250003fc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe2640d2bc0 tx=0x7fe250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c70fbc56996bdb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260007d50 con 0x7fe250003b70 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe260007290 con 0x7fe250003b70 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe269171640 1 -- 172.21.15.80:0/3489728930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2600057a0 con 0x7fe250003b70 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26c3d7640 1 -- 172.21.15.80:0/3489728930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe250003b70 msgr2=0x7fe250003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/3489728930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe250003b70 0x7fe250003fc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe2640d2bc0 tx=0x7fe250005830 comp rx=0 tx=0).stop 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26a974640 1 -- 172.21.15.80:0/3489728930 reap_dead start 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26c3d7640 1 -- 172.21.15.80:0/3489728930 shutdown_connections 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26c3d7640 1 -- 172.21.15.80:0/3489728930 >> 172.21.15.80:0/3489728930 conn(0x7fe2640d0450 msgr2=0x7fe2640d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26c3d7640 1 -- 172.21.15.80:0/3489728930 shutdown_connections 2024-04-25T15:45:58.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.278+0000 7fe26c3d7640 1 -- 172.21.15.80:0/3489728930 wait complete. 2024-04-25T15:45:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.280+0000 7fe26c3d7640 1 Processor -- start 2024-04-25T15:45:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.280+0000 7fe26c3d7640 1 -- start start 2024-04-25T15:45:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26c3d7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250003b70 0x7fe2641f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26c3d7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe264152d60 0x7fe26415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26c3d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 0x7fe2641610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26c3d7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe2640d1cb0 con 0x7fe264160ce0 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26c3d7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe2640b9020 con 0x7fe250003b70 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26c3d7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe2640cf540 con 0x7fe264152d60 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.281+0000 7fe26a974640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 0x7fe2641610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 0x7fe2641610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33766/0 (socket says 172.21.15.80:33766) 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 -- 172.21.15.80:0/1033231654 learned_addr learned my addr 172.21.15.80:0/1033231654 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a173640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250003b70 0x7fe2641f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe269972640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe264152d60 0x7fe26415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 -- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe264152d60 msgr2=0x7fe26415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe264152d60 0x7fe26415fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 -- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250003b70 msgr2=0x7fe2641f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250003b70 0x7fe2641f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 -- 172.21.15.80:0/1033231654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26415ec50 con 0x7fe264160ce0 2024-04-25T15:45:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe269972640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe264152d60 0x7fe26415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26a974640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 0x7fe2641610f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe2640ce320 tx=0x7fe25c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c019070 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c006e20 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26415ef30 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c003bb0 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.282+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26415f4f0 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.283+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26406a100 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.284+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe25c01c070 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.284+0000 7fe25affd640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2480744b0 0x7fe2480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.284+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fe25c094700 con 0x7fe264160ce0 2024-04-25T15:45:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.284+0000 7fe26a173640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2480744b0 0x7fe2480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.285+0000 7fe26a173640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2480744b0 0x7fe2480769c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe260032000 tx=0x7fe260034040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.289+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe25c05e6b0 con 0x7fe264160ce0 2024-04-25T15:45:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.503+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe26415e9e0 con 0x7fe264160ce0 2024-04-25T15:45:58.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.504+0000 7fe25affd640 1 -- 172.21.15.80:0/1033231654 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7fe25c0629b0 con 0x7fe264160ce0 2024-04-25T15:45:58.507 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2480744b0 msgr2=0x7fe2480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2480744b0 0x7fe2480769c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe260032000 tx=0x7fe260034040 comp rx=0 tx=0).stop 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 msgr2=0x7fe2641610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 0x7fe2641610f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe2640ce320 tx=0x7fe25c00ff70 comp rx=0 tx=0).stop 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 shutdown_connections 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2480744b0 0x7fe2480769c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe264160ce0 0x7fe2641610f0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe264152d60 0x7fe26415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 --2- 172.21.15.80:0/1033231654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250003b70 0x7fe2641f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 >> 172.21.15.80:0/1033231654 conn(0x7fe2640d0450 msgr2=0x7fe2640d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 shutdown_connections 2024-04-25T15:45:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58.506+0000 7fe26c3d7640 1 -- 172.21.15.80:0/1033231654 wait complete. 2024-04-25T15:45:58.518 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:45:58.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:45:58.519 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:45:58.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:58.519 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:58.535 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42598sec preferred_lft 42598sec 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:45:58.536 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:58.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:58.537 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:45:58.597 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:45:58.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:58.598 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:45:58.654 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:45:58.654 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:45:58.654 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:45:58.654 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:45:58.654 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:45:58.655 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:45:58.655 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:45:58.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:45:58.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:45:58.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:45:58.655 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:45:58.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:45:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:58.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:58.778 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:45:58.793 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:45:58.793 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:45:58.793 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:45:58.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:58.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:45:58.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:58.856 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:58.912 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:45:58.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:58.913 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:58.967 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:45:58.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:58.968 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:59.060 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:59.060 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:45:59.069 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:45:59.069 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:45:59.069 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:45:59.069 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:45:59.070 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:45:59.072 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:45:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:45:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:45:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:45:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:45:59.072 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:45:59.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:59.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:45:59.102 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:45:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:45:59.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:59.204 INFO:teuthology.orchestra.run.smithi080.stdout:client6211 2024-04-25T15:45:59.205 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:45:59.205 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:45:59.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:45:59.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.366+0000 7f7476372640 1 Processor -- start 2024-04-25T15:45:59.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.367+0000 7f7476372640 1 -- start start 2024-04-25T15:45:59.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f7476372640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f74700d1090 0x7f747006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f7476372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f74700af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f7476372640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74700afc60 0x7f747015b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f7476372640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f747006df20 con 0x7f74700afc60 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f7476372640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f74700ae960 con 0x7f74700d1090 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f7476372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74700aec40 con 0x7f747006db10 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74700afc60 0x7f747015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74700afc60 0x7f747015b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33768/0 (socket says 172.21.15.80:33768) 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 -- 172.21.15.80:0/791260404 learned_addr learned my addr 172.21.15.80:0/791260404 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f746ffff640 1 --2- 172.21.15.80:0/791260404 >> v2:172.21.15.195:3300/0 conn(0x7f74700d1090 0x7f747006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f746f7fe640 1 --2- 172.21.15.80:0/791260404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f74700af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 -- 172.21.15.80:0/791260404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 msgr2=0x7f74700af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 --2- 172.21.15.80:0/791260404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f74700af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 -- 172.21.15.80:0/791260404 >> v2:172.21.15.195:3300/0 conn(0x7f74700d1090 msgr2=0x7f747006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 --2- 172.21.15.80:0/791260404 >> v2:172.21.15.195:3300/0 conn(0x7f74700d1090 0x7f747006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.368+0000 7f747490f640 1 -- 172.21.15.80:0/791260404 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74700aef20 con 0x7f74700afc60 2024-04-25T15:45:59.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.369+0000 7f747490f640 1 --2- 172.21.15.80:0/791260404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f747015b020 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7470072bf0 tx=0x7f746802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9406d3ee48d232 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:59.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.369+0000 7f746effd640 1 -- 172.21.15.80:0/791260404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468036070 con 0x7f74700afc60 2024-04-25T15:45:59.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.369+0000 7f746effd640 1 -- 172.21.15.80:0/791260404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7468031600 con 0x7f74700afc60 2024-04-25T15:45:59.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.369+0000 7f746effd640 1 -- 172.21.15.80:0/791260404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74680319d0 con 0x7f74700afc60 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 -- 172.21.15.80:0/791260404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 msgr2=0x7f747015b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 --2- 172.21.15.80:0/791260404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f747015b020 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7470072bf0 tx=0x7f746802a610 comp rx=0 tx=0).stop 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 -- 172.21.15.80:0/791260404 shutdown_connections 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 --2- 172.21.15.80:0/791260404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f747015b020 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 --2- 172.21.15.80:0/791260404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f74700af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 --2- 172.21.15.80:0/791260404 >> v2:172.21.15.195:3300/0 conn(0x7f74700d1090 0x7f747006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 -- 172.21.15.80:0/791260404 >> 172.21.15.80:0/791260404 conn(0x7f74700d1e20 msgr2=0x7f7470073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 -- 172.21.15.80:0/791260404 shutdown_connections 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.370+0000 7f7476372640 1 -- 172.21.15.80:0/791260404 wait complete. 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.372+0000 7f7476372640 1 Processor -- start 2024-04-25T15:45:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.372+0000 7f7476372640 1 -- start start 2024-04-25T15:45:59.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f7476372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f7470135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f7476372640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f7470133fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f7476372640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74700d1090 0x7f74701f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f7476372640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f74700b01f0 con 0x7f74700afc60 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f7476372640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f74700b0070 con 0x7f74700d1090 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f7476372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74700d14a0 con 0x7f747006db10 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f746f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f7470133fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f746f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f7470133fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33770/0 (socket says 172.21.15.80:33770) 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.373+0000 7f746f7fe640 1 -- 172.21.15.80:0/1988822509 learned_addr learned my addr 172.21.15.80:0/1988822509 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f747490f640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74700d1090 0x7f74701f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746ffff640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f7470135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746f7fe640 1 -- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 msgr2=0x7f7470135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746f7fe640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f7470135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746f7fe640 1 -- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74700d1090 msgr2=0x7f74701f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746f7fe640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74700d1090 0x7f74701f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746f7fe640 1 -- 172.21.15.80:0/1988822509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74701349c0 con 0x7f74700afc60 2024-04-25T15:45:59.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f747490f640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74700d1090 0x7f74701f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746f7fe640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f7470133fe0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f746400d620 tx=0x7f746400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400b620 con 0x7f74700afc60 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7464019070 con 0x7f74700afc60 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7470134ca0 con 0x7f74700afc60 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400ba00 con 0x7f74700afc60 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.374+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7470135260 con 0x7f74700afc60 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.375+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f747006a100 con 0x7f74700afc60 2024-04-25T15:45:59.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.376+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f746400bba0 con 0x7f74700afc60 2024-04-25T15:45:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.376+0000 7f746cff9640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f745c0744b0 0x7f745c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.376+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f74640957f0 con 0x7f74700afc60 2024-04-25T15:45:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.376+0000 7f746ffff640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f745c0744b0 0x7f745c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.376+0000 7f746ffff640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f745c0744b0 0x7f745c0769c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7460006fd0 tx=0x7f7460008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:45:59.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.381+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f746405fdf0 con 0x7f74700afc60 2024-04-25T15:45:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.591+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7470134750 con 0x7f74700afc60 2024-04-25T15:45:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.592+0000 7f746cff9640 1 -- 172.21.15.80:0/1988822509 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7f7464066e20 con 0x7f74700afc60 2024-04-25T15:45:59.593 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:45:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f745c0744b0 msgr2=0x7f745c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f745c0744b0 0x7f745c0769c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7460006fd0 tx=0x7f7460008040 comp rx=0 tx=0).stop 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 msgr2=0x7f7470133fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f7470133fe0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f746400d620 tx=0x7f746400dae0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 shutdown_connections 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f745c0744b0 0x7f745c0769c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74700d1090 0x7f74701f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74700afc60 0x7f7470133fe0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 --2- 172.21.15.80:0/1988822509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f747006db10 0x7f7470135a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:59.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 >> 172.21.15.80:0/1988822509 conn(0x7f74700d1e20 msgr2=0x7f747015f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:45:59.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 shutdown_connections 2024-04-25T15:45:59.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:45:59.594+0000 7f7476372640 1 -- 172.21.15.80:0/1988822509 wait complete. 2024-04-25T15:45:59.606 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:45:59.606 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:45:59.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:45:59.606 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:45:59.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:45:59.607 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:45:59.607 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:45:59.607 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:45:59.607 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:45:59.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:59.608 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:45:59.627 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:45:59.627 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:45:59.627 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:45:59.627 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:59.628 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42575sec preferred_lft 42575sec 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.629 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:45:59.630 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:45:59.630 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:45:59.630 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:45:59.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:59.630 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:45:59.694 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:45:59.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:59.696 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:45:59.754 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:45:59.754 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:45:59.754 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:45:59.754 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:45:59.754 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:45:59.755 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:45:59.755 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:45:59.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:45:59.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:45:59.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:45:59.755 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:45:59.846 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:45:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:45:59.877 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:45:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:45:59.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:59.884 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:45:59.899 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:45:59.899 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:45:59.899 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:45:59.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:45:59.899 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:45:59.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:45:59.963 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:00.018 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:46:00.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:46:00.018 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:00.072 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:46:00.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:00.072 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:00.164 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:00.164 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:46:00.174 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:00.174 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:46:00.174 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:46:00.174 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:46:00.174 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:46:00.175 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:46:00.175 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:46:00.175 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:46:00.175 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:46:00.175 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:46:00.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:46:00.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:00.176 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:00.200 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:46:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:46:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:46:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:46:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:46:00.296 INFO:teuthology.orchestra.run.smithi195.stdout:client6217 2024-04-25T15:46:00.296 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:00.297 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:00.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-04-25T15:46:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.424+0000 7fbba8ae2640 1 Processor -- start 2024-04-25T15:46:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.424+0000 7fbba8ae2640 1 -- start start 2024-04-25T15:46:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba8ae2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbba40727c0 0x7fbba40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba8ae2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbba40718d0 0x7fbba40d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba8ae2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba40b3290 con 0x7fbba40d3160 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba8ae2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbba4072400 con 0x7fbba40727c0 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba8ae2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbba40d2790 con 0x7fbba40718d0 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbba40727c0 0x7fbba40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbba40727c0 0x7fbba40b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33782/0 (socket says 172.21.15.80:33782) 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 -- 172.21.15.80:0/3972297360 learned_addr learned my addr 172.21.15.80:0/3972297360 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba1d9b640 1 --2- 172.21.15.80:0/3972297360 >> v2:172.21.15.195:3300/0 conn(0x7fbba40718d0 0x7fbba40d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 -- 172.21.15.80:0/3972297360 >> v2:172.21.15.195:3300/0 conn(0x7fbba40718d0 msgr2=0x7fbba40d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 --2- 172.21.15.80:0/3972297360 >> v2:172.21.15.195:3300/0 conn(0x7fbba40718d0 0x7fbba40d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 -- 172.21.15.80:0/3972297360 >> v1:172.21.15.195:6789/0 conn(0x7fbba40d3160 legacy=0x7fbba40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.426+0000 7fbba259c640 1 -- 172.21.15.80:0/3972297360 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba4072120 con 0x7fbba40727c0 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.427+0000 7fbba259c640 1 --2- 172.21.15.80:0/3972297360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40727c0 0x7fbba40b2d50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbba4161b40 tx=0x7fbb9402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f797a3782a7fba70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.427+0000 7fbba159a640 1 -- 172.21.15.80:0/3972297360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94036070 con 0x7fbba40727c0 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.427+0000 7fbba159a640 1 -- 172.21.15.80:0/3972297360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94031600 con 0x7fbba40727c0 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.427+0000 7fbba159a640 1 -- 172.21.15.80:0/3972297360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb940319d0 con 0x7fbba40727c0 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3972297360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40727c0 msgr2=0x7fbba40b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3972297360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40727c0 0x7fbba40b2d50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbba4161b40 tx=0x7fbb9402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3972297360 shutdown_connections 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3972297360 >> v2:172.21.15.195:3300/0 conn(0x7fbba40718d0 0x7fbba40d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3972297360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40727c0 0x7fbba40b2d50 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3972297360 >> 172.21.15.80:0/3972297360 conn(0x7fbba40d3a30 msgr2=0x7fbba40d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3972297360 shutdown_connections 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.428+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3972297360 wait complete. 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.430+0000 7fbba8ae2640 1 Processor -- start 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.430+0000 7fbba8ae2640 1 -- start start 2024-04-25T15:46:00.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba8ae2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 0x7fbba40aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba8ae2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbba40727c0 0x7fbba41544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba8ae2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40d3160 0x7fbba4150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba8ae2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbba4071ce0 con 0x7fbba40718d0 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba8ae2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbba40d2420 con 0x7fbba40d3160 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba8ae2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbba4071e60 con 0x7fbba40727c0 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 0x7fbba40aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 0x7fbba40aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33792/0 (socket says 172.21.15.80:33792) 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba259c640 1 -- 172.21.15.80:0/3597774859 learned_addr learned my addr 172.21.15.80:0/3597774859 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba1d9b640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbba40727c0 0x7fbba41544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.431+0000 7fbba2d9d640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40d3160 0x7fbba4150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba259c640 1 -- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbba40727c0 msgr2=0x7fbba41544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba259c640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbba40727c0 0x7fbba41544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba259c640 1 -- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40d3160 msgr2=0x7fbba4150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba259c640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40d3160 0x7fbba4150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba259c640 1 -- 172.21.15.80:0/3597774859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba4153710 con 0x7fbba40718d0 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba2d9d640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40d3160 0x7fbba4150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba259c640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 0x7fbba40aa5a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009f40 tx=0x7fbb94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9403f020 con 0x7fbba40718d0 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94037040 con 0x7fbba40718d0 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba41539f0 con 0x7fbba40718d0 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94036070 con 0x7fbba40718d0 2024-04-25T15:46:00.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.432+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba41513c0 con 0x7fbba40718d0 2024-04-25T15:46:00.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.433+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba406a100 con 0x7fbba40718d0 2024-04-25T15:46:00.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.434+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbb94042020 con 0x7fbba40718d0 2024-04-25T15:46:00.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.434+0000 7fbb92ffd640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbb840744b0 0x7fbb840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.434+0000 7fbba1d9b640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbb840744b0 0x7fbb840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.434+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fbb940b5890 con 0x7fbba40718d0 2024-04-25T15:46:00.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.435+0000 7fbba1d9b640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbb840744b0 0x7fbb840769c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbba415e4f0 tx=0x7fbb98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:00.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.439+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb94049030 con 0x7fbba40718d0 2024-04-25T15:46:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.613+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7fbba40b9290 con 0x7fbba40718d0 2024-04-25T15:46:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.617+0000 7fbb92ffd640 1 -- 172.21.15.80:0/3597774859 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fbb9407fe90 con 0x7fbba40718d0 2024-04-25T15:46:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbb840744b0 msgr2=0x7fbb840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbb840744b0 0x7fbb840769c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbba415e4f0 tx=0x7fbb98008040 comp rx=0 tx=0).stop 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 msgr2=0x7fbba40aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 0x7fbba40aa5a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009f40 tx=0x7fbb94004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 shutdown_connections 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fbb840744b0 0x7fbb840769c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40d3160 0x7fbba4150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbba40727c0 0x7fbba41544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 --2- 172.21.15.80:0/3597774859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbba40718d0 0x7fbba40aa5a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 >> 172.21.15.80:0/3597774859 conn(0x7fbba40d3a30 msgr2=0x7fbba40c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 shutdown_connections 2024-04-25T15:46:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.619+0000 7fbba8ae2640 1 -- 172.21.15.80:0/3597774859 wait complete. 2024-04-25T15:46:00.631 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:00.631 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:00.646 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:00.646 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:00.701 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.847+0000 7f15287b2640 1 Processor -- start 2024-04-25T15:46:00.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.847+0000 7f15287b2640 1 -- start start 2024-04-25T15:46:00.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.848+0000 7f15287b2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f15200afe30 0x7f152015b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f15287b2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15200ae960 con 0x7f152006dce0 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f15287b2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15200aec40 con 0x7f15200d1090 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f15287b2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1520070470 con 0x7f15200afe30 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f1525d4d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f152006dce0 0x7f15200af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36084/0 (socket says 172.21.15.80:36084) 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f1525d4d640 1 -- 172.21.15.80:0/3672863659 learned_addr learned my addr 172.21.15.80:0/3672863659 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f1526d4f640 1 --2- 172.21.15.80:0/3672863659 >> v2:172.21.15.195:3300/0 conn(0x7f15200afe30 0x7f152015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047538208 0 0) 0x7f15200ae960 con 0x7f152006dce0 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f150c003520 con 0x7f152006dce0 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3567611138 0 0) 0x7f150c003520 con 0x7f152006dce0 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 >> v2:172.21.15.195:3300/0 conn(0x7f15200afe30 msgr2=0x7f152015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 --2- 172.21.15.80:0/3672863659 >> v2:172.21.15.195:3300/0 conn(0x7f15200afe30 0x7f152015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 >> v1:172.21.15.195:6789/0 conn(0x7f15200d1090 legacy=0x7f152006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15200aef20 con 0x7f152006dce0 2024-04-25T15:46:00.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f1510001670 con 0x7f152006dce0 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f1526d4f640 1 --2- 172.21.15.80:0/3672863659 >> v2:172.21.15.195:3300/0 conn(0x7f15200afe30 0x7f152015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 >> v1:172.21.15.80:6789/0 conn(0x7f152006dce0 legacy=0x7f15200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f150c0039b0 0x7f150c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f150c004800 0x7f150c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c005250 0x7f150c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f150c00c1b0 con 0x7f150c004800 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f150c00c360 con 0x7f150c005250 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f150c00c560 con 0x7f150c0039b0 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.849+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f150c004800 0x7f150c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1526d4f640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c005250 0x7f150c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f152654e640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f150c0039b0 0x7f150c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1525d4d640 1 -- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f150c0039b0 msgr2=0x7f150c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f150c0039b0 0x7f150c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1525d4d640 1 -- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c005250 msgr2=0x7f150c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c005250 0x7f150c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1526d4f640 1 -- 172.21.15.80:0/3672863659 reap_dead start 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1525d4d640 1 -- 172.21.15.80:0/3672863659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c003520 con 0x7f150c004800 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.850+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f150c004800 0x7f150c004c10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f151000c240 tx=0x7f150c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be04200e899bc170 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510007cf0 con 0x7f150c004800 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1510005af0 con 0x7f150c004800 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f152554c640 1 -- 172.21.15.80:0/3672863659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510007070 con 0x7f150c004800 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 -- 172.21.15.80:0/3672863659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f150c004800 msgr2=0x7f150c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f150c004800 0x7f150c004c10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f151000c240 tx=0x7f150c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:00.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 -- 172.21.15.80:0/3672863659 shutdown_connections 2024-04-25T15:46:00.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 --2- 172.21.15.80:0/3672863659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f150c004800 0x7f150c004c10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 -- 172.21.15.80:0/3672863659 >> 172.21.15.80:0/3672863659 conn(0x7f15200d1e20 msgr2=0x7f1520073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:00.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 -- 172.21.15.80:0/3672863659 shutdown_connections 2024-04-25T15:46:00.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.851+0000 7f15287b2640 1 -- 172.21.15.80:0/3672863659 wait complete. 2024-04-25T15:46:00.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.853+0000 7f15287b2640 1 Processor -- start 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.853+0000 7f15287b2640 1 -- start start 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.854+0000 7f15287b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c004800 0x7f1520154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.854+0000 7f15287b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 0x7f15201f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.854+0000 7f15287b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1520154b60 0x7f15201f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.854+0000 7f15287b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f15200d1620 con 0x7f15200cff80 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.854+0000 7f15287b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f15200d14a0 con 0x7f150c004800 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.854+0000 7f15287b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f152015f1d0 con 0x7f1520154b60 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 0x7f15201f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 0x7f15201f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33816/0 (socket says 172.21.15.80:33816) 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 -- 172.21.15.80:0/3038050198 learned_addr learned my addr 172.21.15.80:0/3038050198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1526d4f640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1520154b60 0x7f15201f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f152654e640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c004800 0x7f1520154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 -- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1520154b60 msgr2=0x7f15201f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1520154b60 0x7f15201f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 -- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c004800 msgr2=0x7f1520154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c004800 0x7f1520154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 -- 172.21.15.80:0/3038050198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152009b5b0 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1525d4d640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 0x7f15201f55a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f151000c360 tx=0x7f15200aee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510037040 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1510041070 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152009b890 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510001670 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.855+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15200cf780 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.856+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152006a100 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.857+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1510004a00 con 0x7f15200cff80 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.857+0000 7f1516ffd640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f15040744b0 0x7f15040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:00.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.858+0000 7f152654e640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f15040744b0 0x7f15040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.858+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f15100b5030 con 0x7f15200cff80 2024-04-25T15:46:00.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.858+0000 7f152654e640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f15040744b0 0x7f15040769c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f151c000c00 tx=0x7f151c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:00.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:00.862+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f151007efe0 con 0x7f15200cff80 2024-04-25T15:46:01.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.038+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15201447a0 con 0x7f15200cff80 2024-04-25T15:46:01.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.039+0000 7f1516ffd640 1 -- 172.21.15.80:0/3038050198 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16933 (secure 0 0 0) 0x7f15100832e0 con 0x7f15200cff80 2024-04-25T15:46:01.041 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:01.041 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:50.027676+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:01.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f15040744b0 msgr2=0x7f15040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f15040744b0 0x7f15040769c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f151c000c00 tx=0x7f151c009040 comp rx=0 tx=0).stop 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 msgr2=0x7f15201f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 0x7f15201f55a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f151000c360 tx=0x7f15200aee10 comp rx=0 tx=0).stop 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 shutdown_connections 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f15040744b0 0x7f15040769c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1520154b60 0x7f15201f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15200cff80 0x7f15201f55a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 --2- 172.21.15.80:0/3038050198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f150c004800 0x7f1520154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 >> 172.21.15.80:0/3038050198 conn(0x7f15200d1e20 msgr2=0x7f15201474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 shutdown_connections 2024-04-25T15:46:01.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.041+0000 7f15287b2640 1 -- 172.21.15.80:0/3038050198 wait complete. 2024-04-25T15:46:01.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:45:46.643187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:45:47.329997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:01.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.163+0000 7f43a6a9f640 1 Processor -- start 2024-04-25T15:46:01.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.163+0000 7f43a6a9f640 1 -- start start 2024-04-25T15:46:01.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f43a6a9f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43a006d870 0x7f43a00d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f43a6a9f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a00cfc90 con 0x7f43a006cc10 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f43a6a9f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a006c9a0 con 0x7f43a00b37b0 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f43a6a9f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43a00d2c10 con 0x7f43a006d870 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f43a483b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f43a006cc10 0x7f43a006d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36100/0 (socket says 172.21.15.80:36100) 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f43a483b640 1 -- 172.21.15.80:0/4182204128 learned_addr learned my addr 172.21.15.80:0/4182204128 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f439ffff640 1 --2- 172.21.15.80:0/4182204128 >> v2:172.21.15.195:3300/0 conn(0x7f43a006d870 0x7f43a00d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f439f7fe640 1 -- 172.21.15.80:0/4182204128 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714334520 0 0) 0x7f43a00cfc90 con 0x7f43a006cc10 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f439f7fe640 1 -- 172.21.15.80:0/4182204128 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4388003520 con 0x7f43a006cc10 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f439ffff640 1 -- 172.21.15.80:0/4182204128 >> v1:172.21.15.195:6789/0 conn(0x7f43a00b37b0 legacy=0x7f43a00d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f439ffff640 1 -- 172.21.15.80:0/4182204128 >> v1:172.21.15.80:6789/0 conn(0x7f43a006cc10 legacy=0x7f43a006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.165+0000 7f439ffff640 1 -- 172.21.15.80:0/4182204128 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a00cff30 con 0x7f43a006d870 2024-04-25T15:46:01.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.166+0000 7f439ffff640 1 --2- 172.21.15.80:0/4182204128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a006d870 0x7f43a00d0450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f43a00cfe60 tx=0x7f439402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca59720dc33b4073 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.166+0000 7f439f7fe640 1 -- 172.21.15.80:0/4182204128 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394037070 con 0x7f43a006d870 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.166+0000 7f439f7fe640 1 -- 172.21.15.80:0/4182204128 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4394032440 con 0x7f43a006d870 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.166+0000 7f439f7fe640 1 -- 172.21.15.80:0/4182204128 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43940327f0 con 0x7f43a006d870 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 -- 172.21.15.80:0/4182204128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a006d870 msgr2=0x7f43a00d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/4182204128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a006d870 0x7f43a00d0450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f43a00cfe60 tx=0x7f439402a210 comp rx=0 tx=0).stop 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 -- 172.21.15.80:0/4182204128 shutdown_connections 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/4182204128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a006d870 0x7f43a00d0450 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 -- 172.21.15.80:0/4182204128 >> 172.21.15.80:0/4182204128 conn(0x7f43a009b410 msgr2=0x7f43a00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 -- 172.21.15.80:0/4182204128 shutdown_connections 2024-04-25T15:46:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.167+0000 7f43a6a9f640 1 -- 172.21.15.80:0/4182204128 wait complete. 2024-04-25T15:46:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.169+0000 7f43a6a9f640 1 Processor -- start 2024-04-25T15:46:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.169+0000 7f43a6a9f640 1 -- start start 2024-04-25T15:46:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a6a9f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43a006cc10 0x7f43a00b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a6a9f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 0x7f43a00d1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a6a9f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a00c5b50 0x7f43a00d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a6a9f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0076230 con 0x7f43a00b37b0 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a6a9f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43a006c670 con 0x7f43a00c5b50 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a6a9f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43a0163860 con 0x7f43a006cc10 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f439ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 0x7f43a00d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f439ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 0x7f43a00d1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33826/0 (socket says 172.21.15.80:33826) 2024-04-25T15:46:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f439ffff640 1 -- 172.21.15.80:0/668252771 learned_addr learned my addr 172.21.15.80:0/668252771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:01.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f43a483b640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43a006cc10 0x7f43a00b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.170+0000 7f439ffff640 1 -- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43a006cc10 msgr2=0x7f43a00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439ffff640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43a006cc10 0x7f43a00b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439ffff640 1 -- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a00c5b50 msgr2=0x7f43a00d1d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439ffff640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a00c5b50 0x7f43a00d1d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439ffff640 1 -- 172.21.15.80:0/668252771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a00d0a90 con 0x7f43a00b37b0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f43a483b640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43a006cc10 0x7f43a00b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439ffff640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 0x7f43a00d1850 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4394035040 tx=0x7f43940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394037050 con 0x7f43a00b37b0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4394038040 con 0x7f43a00b37b0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a00d0d70 con 0x7f43a00b37b0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394004450 con 0x7f43a00b37b0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.171+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a00b1260 con 0x7f43a00b37b0 2024-04-25T15:46:01.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.172+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a00b1510 con 0x7f43a00b37b0 2024-04-25T15:46:01.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.172+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f439403c6d0 con 0x7f43a00b37b0 2024-04-25T15:46:01.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.173+0000 7f439d7fa640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f438c0744b0 0x7f438c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.173+0000 7f43a483b640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f438c0744b0 0x7f438c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.173+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f43940b5e70 con 0x7f43a00b37b0 2024-04-25T15:46:01.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.173+0000 7f43a483b640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f438c0744b0 0x7f438c0769c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f43900011e0 tx=0x7f4390009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.178+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4394080470 con 0x7f43a00b37b0 2024-04-25T15:46:01.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.351+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f43a006a100 con 0x7f43a00b37b0 2024-04-25T15:46:01.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.352+0000 7f439d7fa640 1 -- 172.21.15.80:0/668252771 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f439407fd70 con 0x7f43a00b37b0 2024-04-25T15:46:01.353 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:01.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f438c0744b0 msgr2=0x7f438c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f438c0744b0 0x7f438c0769c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f43900011e0 tx=0x7f4390009040 comp rx=0 tx=0).stop 2024-04-25T15:46:01.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 msgr2=0x7f43a00d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 0x7f43a00d1850 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4394035040 tx=0x7f43940046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 shutdown_connections 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f438c0744b0 0x7f438c0769c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a00c5b50 0x7f43a00d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43a00b37b0 0x7f43a00d1850 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 --2- 172.21.15.80:0/668252771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43a006cc10 0x7f43a00b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 >> 172.21.15.80:0/668252771 conn(0x7f43a009b410 msgr2=0x7f43a00b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 shutdown_connections 2024-04-25T15:46:01.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.354+0000 7f43a6a9f640 1 -- 172.21.15.80:0/668252771 wait complete. 2024-04-25T15:46:01.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.475+0000 7f03ae900640 1 Processor -- start 2024-04-25T15:46:01.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.475+0000 7f03ae900640 1 -- start start 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03ae900640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03a806d870 0x7f03a80d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03ae900640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a80d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03ae900640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a80cfc90 con 0x7f03a806cc10 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03ae900640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f03a806c9a0 con 0x7f03a806d870 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03ae900640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03a80d2c10 con 0x7f03a80b37b0 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03a806d870 0x7f03a80d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03a806d870 0x7f03a80d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33838/0 (socket says 172.21.15.80:33838) 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 -- 172.21.15.80:0/1102414172 learned_addr learned my addr 172.21.15.80:0/1102414172 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f03a806cc10 0x7f03a806d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36114/0 (socket says 172.21.15.80:36114) 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 -- 172.21.15.80:0/1102414172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 msgr2=0x7f03a80d0990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 --2- 172.21.15.80:0/1102414172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a80d0990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 -- 172.21.15.80:0/1102414172 >> v1:172.21.15.80:6789/0 conn(0x7f03a806cc10 legacy=0x7f03a806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a77fe640 1 -- 172.21.15.80:0/1102414172 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a80cff30 con 0x7f03a806d870 2024-04-25T15:46:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.477+0000 7f03a6ffd640 1 -- 172.21.15.80:0/1102414172 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343437016 0 0) 0x7f03a80cfc90 con 0x7f03a806cc10 2024-04-25T15:46:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.478+0000 7f03a77fe640 1 --2- 172.21.15.80:0/1102414172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a806d870 0x7f03a80d0450 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f039c009870 tx=0x7f039c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bca6b447d6863a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.478+0000 7f03a6ffd640 1 -- 172.21.15.80:0/1102414172 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c037070 con 0x7f03a806d870 2024-04-25T15:46:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.478+0000 7f03a6ffd640 1 -- 172.21.15.80:0/1102414172 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f039c032440 con 0x7f03a806d870 2024-04-25T15:46:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.478+0000 7f03a6ffd640 1 -- 172.21.15.80:0/1102414172 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c032810 con 0x7f03a806d870 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 -- 172.21.15.80:0/1102414172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a806d870 msgr2=0x7f03a80d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 --2- 172.21.15.80:0/1102414172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a806d870 0x7f03a80d0450 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f039c009870 tx=0x7f039c02a270 comp rx=0 tx=0).stop 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 -- 172.21.15.80:0/1102414172 shutdown_connections 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 --2- 172.21.15.80:0/1102414172 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a80d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 --2- 172.21.15.80:0/1102414172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a806d870 0x7f03a80d0450 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 -- 172.21.15.80:0/1102414172 >> 172.21.15.80:0/1102414172 conn(0x7f03a809b410 msgr2=0x7f03a80b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 -- 172.21.15.80:0/1102414172 shutdown_connections 2024-04-25T15:46:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.479+0000 7f03ae900640 1 -- 172.21.15.80:0/1102414172 wait complete. 2024-04-25T15:46:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.480+0000 7f03ae900640 1 Processor -- start 2024-04-25T15:46:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.481+0000 7f03ae900640 1 -- start start 2024-04-25T15:46:01.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ae900640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a806cc10 0x7f03a815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ae900640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a8152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ae900640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 0x7f03a80ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ae900640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8076230 con 0x7f03a80cde90 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ae900640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03a806c670 con 0x7f03a806cc10 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ae900640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03a8163860 con 0x7f03a80b37b0 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 0x7f03a80ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 0x7f03a80ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33840/0 (socket says 172.21.15.80:33840) 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 -- 172.21.15.80:0/2374169488 learned_addr learned my addr 172.21.15.80:0/2374169488 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03a7fff640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a806cc10 0x7f03a815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03a77fe640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a8152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 -- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 msgr2=0x7f03a8152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a8152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 -- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a806cc10 msgr2=0x7f03a815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a806cc10 0x7f03a815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 -- 172.21.15.80:0/2374169488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a8153ac0 con 0x7f03a80cde90 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.482+0000 7f03ace9d640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 0x7f03a80ce2a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f03a000b960 tx=0x7f03a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.483+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0019070 con 0x7f03a80cde90 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.483+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a000cb20 con 0x7f03a80cde90 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.483+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a8153530 con 0x7f03a80cde90 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.483+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0014440 con 0x7f03a80cde90 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.483+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a80cef40 con 0x7f03a80cde90 2024-04-25T15:46:01.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.484+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a80c88d0 con 0x7f03a80cde90 2024-04-25T15:46:01.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.485+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f03a001c070 con 0x7f03a80cde90 2024-04-25T15:46:01.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.485+0000 7f03a4ff9640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03940744b0 0x7f03940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.485+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f03a0094f00 con 0x7f03a80cde90 2024-04-25T15:46:01.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.485+0000 7f03a7fff640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03940744b0 0x7f03940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.486+0000 7f03a7fff640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03940744b0 0x7f03940769c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0398000f60 tx=0x7f0398007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.490+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03a8153ac0 con 0x7f03a80cde90 2024-04-25T15:46:01.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.664+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f03a806a100 con 0x7f03a80cde90 2024-04-25T15:46:01.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.664+0000 7f03a4ff9640 1 -- 172.21.15.80:0/2374169488 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f03a005efd0 con 0x7f03a80cde90 2024-04-25T15:46:01.666 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:46:01.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03940744b0 msgr2=0x7f03940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03940744b0 0x7f03940769c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0398000f60 tx=0x7f0398007e40 comp rx=0 tx=0).stop 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 msgr2=0x7f03a80ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 0x7f03a80ce2a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f03a000b960 tx=0x7f03a000be20 comp rx=0 tx=0).stop 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 shutdown_connections 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03940744b0 0x7f03940769c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03a80cde90 0x7f03a80ce2a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03a80b37b0 0x7f03a8152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 --2- 172.21.15.80:0/2374169488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a806cc10 0x7f03a815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.666+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 >> 172.21.15.80:0/2374169488 conn(0x7f03a809b410 msgr2=0x7f03a8160d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.667+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 shutdown_connections 2024-04-25T15:46:01.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.667+0000 7f03ae900640 1 -- 172.21.15.80:0/2374169488 wait complete. 2024-04-25T15:46:01.679 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:01.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.786+0000 7f743d6aa640 1 Processor -- start 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.786+0000 7f743d6aa640 1 -- start start 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.787+0000 7f743d6aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74380d0b00 0x7f74380d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.787+0000 7f743d6aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.787+0000 7f743d6aa640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74381643f0 con 0x7f74380b5490 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.787+0000 7f743d6aa640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f74381646d0 con 0x7f74380d0b00 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.787+0000 7f743d6aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74381649b0 con 0x7f74380d2b80 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74367fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74380d0b00 0x7f74380d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f7436ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f74380b5490 0x7f7438160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36120/0 (socket says 172.21.15.80:36120) 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74367fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74380d0b00 0x7f74380d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33850/0 (socket says 172.21.15.80:33850) 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f7436ffd640 1 -- 172.21.15.80:0/2990546483 learned_addr learned my addr 172.21.15.80:0/2990546483 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74377fe640 1 --2- 172.21.15.80:0/2990546483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74367fc640 1 -- 172.21.15.80:0/2990546483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 msgr2=0x7f74380d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:01.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74367fc640 1 --2- 172.21.15.80:0/2990546483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380d47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74367fc640 1 -- 172.21.15.80:0/2990546483 >> v1:172.21.15.80:6789/0 conn(0x7f74380b5490 legacy=0x7f7438160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f74367fc640 1 -- 172.21.15.80:0/2990546483 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438164c90 con 0x7f74380d0b00 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.788+0000 7f7435ffb640 1 -- 172.21.15.80:0/2990546483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557193895 0 0) 0x7f74381643f0 con 0x7f74380b5490 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.789+0000 7f74367fc640 1 --2- 172.21.15.80:0/2990546483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74380d2640 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f742c0097a0 tx=0x7f742c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f92517e40274ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.789+0000 7f7435ffb640 1 -- 172.21.15.80:0/2990546483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c037070 con 0x7f74380d0b00 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.789+0000 7f7435ffb640 1 -- 172.21.15.80:0/2990546483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c032440 con 0x7f74380d0b00 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.789+0000 7f7435ffb640 1 -- 172.21.15.80:0/2990546483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c032810 con 0x7f74380d0b00 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.789+0000 7f743d6aa640 1 -- 172.21.15.80:0/2990546483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 msgr2=0x7f74380d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.789+0000 7f743d6aa640 1 --2- 172.21.15.80:0/2990546483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74380d2640 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f742c0097a0 tx=0x7f742c02a180 comp rx=0 tx=0).stop 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.790+0000 7f743d6aa640 1 -- 172.21.15.80:0/2990546483 shutdown_connections 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.790+0000 7f743d6aa640 1 --2- 172.21.15.80:0/2990546483 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.790+0000 7f743d6aa640 1 --2- 172.21.15.80:0/2990546483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74380d2640 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.790+0000 7f743d6aa640 1 -- 172.21.15.80:0/2990546483 >> 172.21.15.80:0/2990546483 conn(0x7f743806e650 msgr2=0x7f743806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.790+0000 7f743d6aa640 1 -- 172.21.15.80:0/2990546483 shutdown_connections 2024-04-25T15:46:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.790+0000 7f743d6aa640 1 -- 172.21.15.80:0/2990546483 wait complete. 2024-04-25T15:46:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.791+0000 7f743d6aa640 1 Processor -- start 2024-04-25T15:46:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.791+0000 7f743d6aa640 1 -- start start 2024-04-25T15:46:01.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f743d6aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74381511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f743d6aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f743d6aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74380b76c0 0x7f74381f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f743d6aa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f74380b94e0 con 0x7f74380d0b00 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f743d6aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f74380b9360 con 0x7f74380b76c0 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f743d6aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7438163f80 con 0x7f74380d2b80 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74381511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74381511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33856/0 (socket says 172.21.15.80:33856) 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 -- 172.21.15.80:0/3666574586 learned_addr learned my addr 172.21.15.80:0/3666574586 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f74367fc640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 -- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 msgr2=0x7f74380b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 -- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74380b76c0 msgr2=0x7f74381f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74380b76c0 0x7f74381f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 -- 172.21.15.80:0/3666574586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74380b7ad0 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f74367fc640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f7436ffd640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74381511a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f742800c7b0 tx=0x7f742800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.793+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428018070 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.794+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742800a640 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.794+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74380ad740 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.794+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800aa30 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.794+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74380add00 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.795+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74380ae420 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.795+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f742801b070 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.796+0000 7f741f7fe640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74240744b0 0x7f74240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.796+0000 7f74367fc640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74240744b0 0x7f74240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.796+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f7428094930 con 0x7f74380d0b00 2024-04-25T15:46:01.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.796+0000 7f74367fc640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74240744b0 0x7f74240769c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f742c034000 tx=0x7f742c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.801+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74380b7ad0 con 0x7f74380d0b00 2024-04-25T15:46:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.976+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f743806a100 con 0x7f74380d0b00 2024-04-25T15:46:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.977+0000 7f741f7fe640 1 -- 172.21.15.80:0/3666574586 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f742805efc0 con 0x7f74380d0b00 2024-04-25T15:46:01.978 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74240744b0 msgr2=0x7f74240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74240744b0 0x7f74240769c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f742c034000 tx=0x7f742c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 msgr2=0x7f74381511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74381511a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f742800c7b0 tx=0x7f742800cc70 comp rx=0 tx=0).stop 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 shutdown_connections 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f74240744b0 0x7f74240769c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74380b76c0 0x7f74381f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74380d2b80 0x7f74380b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 --2- 172.21.15.80:0/3666574586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74380d0b00 0x7f74381511a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 >> 172.21.15.80:0/3666574586 conn(0x7f743806e650 msgr2=0x7f74380b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 shutdown_connections 2024-04-25T15:46:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:01.979+0000 7f743d6aa640 1 -- 172.21.15.80:0/3666574586 wait complete. 2024-04-25T15:46:01.991 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:46:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.098+0000 7f1a8104a640 1 Processor -- start 2024-04-25T15:46:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.098+0000 7f1a8104a640 1 -- start start 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a8104a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1a7c071950 0x7f1a7c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a8104a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1a7c0d2a90 0x7f1a7c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a8104a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7c0d33e0 con 0x7f1a7c161c80 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a8104a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7c072aa0 con 0x7f1a7c0d2a90 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a8104a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7c1624d0 con 0x7f1a7c071950 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1a7c0d2a90 0x7f1a7c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1a7c0d2a90 0x7f1a7c0d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33868/0 (socket says 172.21.15.80:33868) 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1078222105 learned_addr learned my addr 172.21.15.80:0/1078222105 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7259c640 1 --1- 172.21.15.80:0/1078222105 >> v1:172.21.15.80:6789/0 conn(0x7f1a7c161c80 0x7f1a7c0b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36128/0 (socket says 172.21.15.80:36128) 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7ad9d640 1 --2- 172.21.15.80:0/1078222105 >> v2:172.21.15.195:3300/0 conn(0x7f1a7c071950 0x7f1a7c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1078222105 >> v2:172.21.15.195:3300/0 conn(0x7f1a7c071950 msgr2=0x7f1a7c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.099+0000 7f1a7b59e640 1 --2- 172.21.15.80:0/1078222105 >> v2:172.21.15.195:3300/0 conn(0x7f1a7c071950 0x7f1a7c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1078222105 >> v1:172.21.15.80:6789/0 conn(0x7f1a7c161c80 legacy=0x7f1a7c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1078222105 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c1627b0 con 0x7f1a7c0d2a90 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7a59c640 1 -- 172.21.15.80:0/1078222105 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544479102 0 0) 0x7f1a640011d0 con 0x7f1a7c161c80 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7b59e640 1 --2- 172.21.15.80:0/1078222105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0d2ea0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c08cc70 tx=0x7f1a7402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbce03ed35b7e9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7a59c640 1 -- 172.21.15.80:0/1078222105 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a74036070 con 0x7f1a7c0d2a90 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7a59c640 1 -- 172.21.15.80:0/1078222105 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a74031600 con 0x7f1a7c0d2a90 2024-04-25T15:46:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.100+0000 7f1a7a59c640 1 -- 172.21.15.80:0/1078222105 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a740319d0 con 0x7f1a7c0d2a90 2024-04-25T15:46:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 -- 172.21.15.80:0/1078222105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c0d2a90 msgr2=0x7f1a7c0d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1078222105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0d2ea0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c08cc70 tx=0x7f1a7402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 -- 172.21.15.80:0/1078222105 shutdown_connections 2024-04-25T15:46:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1078222105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0d2ea0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1078222105 >> v2:172.21.15.195:3300/0 conn(0x7f1a7c071950 0x7f1a7c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 -- 172.21.15.80:0/1078222105 >> 172.21.15.80:0/1078222105 conn(0x7f1a7c0d3ea0 msgr2=0x7f1a7c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 -- 172.21.15.80:0/1078222105 shutdown_connections 2024-04-25T15:46:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.101+0000 7f1a8104a640 1 -- 172.21.15.80:0/1078222105 wait complete. 2024-04-25T15:46:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.103+0000 7f1a8104a640 1 Processor -- start 2024-04-25T15:46:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.103+0000 7f1a8104a640 1 -- start start 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.104+0000 7f1a8104a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a7c071950 0x7f1a7c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.104+0000 7f1a8104a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.104+0000 7f1a8104a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 0x7f1a7c1e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.104+0000 7f1a8104a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c0b7690 con 0x7f1a7c161c80 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a8104a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c0d2290 con 0x7f1a7c0d2a90 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a8104a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7c0b7810 con 0x7f1a7c071950 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 0x7f1a7c1e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 0x7f1a7c1e7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33884/0 (socket says 172.21.15.80:33884) 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1673997825 learned_addr learned my addr 172.21.15.80:0/1673997825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:02.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7259c640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7ad9d640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a7c071950 0x7f1a7c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a7c071950 msgr2=0x7f1a7c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a7c071950 0x7f1a7c0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a7c0d2a90 msgr2=0x7f1a7c0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 -- 172.21.15.80:0/1673997825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c151a00 con 0x7f1a7c161c80 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7259c640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a7b59e640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 0x7f1a7c1e7ab0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009f40 tx=0x7f1a74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a74041020 con 0x7f1a7c161c80 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a74037040 con 0x7f1a7c161c80 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7c151ca0 con 0x7f1a7c161c80 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a74036050 con 0x7f1a7c161c80 2024-04-25T15:46:02.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.105+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7c152260 con 0x7f1a7c161c80 2024-04-25T15:46:02.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.106+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7c0abfd0 con 0x7f1a7c161c80 2024-04-25T15:46:02.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.107+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1a74007c30 con 0x7f1a7c161c80 2024-04-25T15:46:02.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.108+0000 7f1a73fff640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1a5c0744b0 0x7f1a5c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.108+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f1a740b5c20 con 0x7f1a7c161c80 2024-04-25T15:46:02.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.108+0000 7f1a7ad9d640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1a5c0744b0 0x7f1a5c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.108+0000 7f1a7ad9d640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1a5c0744b0 0x7f1a5c0769c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0d15f0 tx=0x7f1a6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.112+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a7404b060 con 0x7f1a7c161c80 2024-04-25T15:46:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.301+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1a7c0d1e40 con 0x7f1a7c161c80 2024-04-25T15:46:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.301+0000 7f1a73fff640 1 -- 172.21.15.80:0/1673997825 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7f1a74080340 con 0x7f1a7c161c80 2024-04-25T15:46:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1a5c0744b0 msgr2=0x7f1a5c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1a5c0744b0 0x7f1a5c0769c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0d15f0 tx=0x7f1a6c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 msgr2=0x7f1a7c1e7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 0x7f1a7c1e7ab0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009f40 tx=0x7f1a74004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 shutdown_connections 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1a5c0744b0 0x7f1a5c0769c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a7c161c80 0x7f1a7c1e7ab0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a7c0d2a90 0x7f1a7c0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 --2- 172.21.15.80:0/1673997825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a7c071950 0x7f1a7c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 >> 172.21.15.80:0/1673997825 conn(0x7f1a7c0d3ea0 msgr2=0x7f1a7c0b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 shutdown_connections 2024-04-25T15:46:02.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.303+0000 7f1a8104a640 1 -- 172.21.15.80:0/1673997825 wait complete. 2024-04-25T15:46:02.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:46:02.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:02.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:02.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:46:02.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:02.345 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:46:02.404 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:02.404 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:02.422 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:02.422 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:02.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:02.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.587+0000 7fda7179d640 1 Processor -- start 2024-04-25T15:46:02.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.587+0000 7fda7179d640 1 -- start start 2024-04-25T15:46:02.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda7179d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 0x7fda6c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda7179d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fda6c0b7d60 0x7fda6c0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda7179d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c163fb0 con 0x7fda6c1602a0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda7179d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fda6c164270 con 0x7fda6c0b7d60 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda7179d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda6c164550 con 0x7fda6c0d41b0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda6a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda6c1602a0 0x7fda6c0b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36134/0 (socket says 172.21.15.80:36134) 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda6a7fc640 1 -- 172.21.15.80:0/3986625303 learned_addr learned my addr 172.21.15.80:0/3986625303 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda6affd640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 0x7fda6c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102405326 0 0) 0x7fda6c163fb0 con 0x7fda6c1602a0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda54003520 con 0x7fda6c1602a0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda6b7fe640 1 --2- 172.21.15.80:0/3986625303 >> v2:172.21.15.195:3300/0 conn(0x7fda6c0b7d60 0x7fda6c0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2364304762 0 0) 0x7fda54003520 con 0x7fda6c1602a0 2024-04-25T15:46:02.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 msgr2=0x7fda6c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 0x7fda6c0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 >> v2:172.21.15.195:3300/0 conn(0x7fda6c0b7d60 msgr2=0x7fda6c0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 --2- 172.21.15.80:0/3986625303 >> v2:172.21.15.195:3300/0 conn(0x7fda6c0b7d60 0x7fda6c0d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c164830 con 0x7fda6c1602a0 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fda60001670 con 0x7fda6c1602a0 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 >> v1:172.21.15.80:6789/0 conn(0x7fda6c1602a0 legacy=0x7fda6c0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda540039b0 0x7fda54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 0x7fda54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda54004d40 0x7fda54005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c164270 con 0x7fda54004d40 2024-04-25T15:46:02.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c164550 con 0x7fda540039b0 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.589+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda5400b9c0 con 0x7fda6c0d41b0 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6b7fe640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda54004d40 0x7fda54005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6a7fc640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 0x7fda54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6b7fe640 1 -- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 msgr2=0x7fda54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6b7fe640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c0d41b0 0x7fda54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6b7fe640 1 -- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda540039b0 msgr2=0x7fda54003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6b7fe640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda540039b0 0x7fda54003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.590+0000 7fda6b7fe640 1 -- 172.21.15.80:0/3986625303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda54003520 con 0x7fda54004d40 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda6b7fe640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda54004d40 0x7fda54005150 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fda64009a90 tx=0x7fda54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18156571e919034f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64036070 con 0x7fda54004d40 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64031400 con 0x7fda54004d40 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda69ffb640 1 -- 172.21.15.80:0/3986625303 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64009690 con 0x7fda54004d40 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda7179d640 1 -- 172.21.15.80:0/3986625303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda54004d40 msgr2=0x7fda54005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda7179d640 1 --2- 172.21.15.80:0/3986625303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda54004d40 0x7fda54005150 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fda64009a90 tx=0x7fda54005830 comp rx=0 tx=0).stop 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda6b7fe640 1 -- 172.21.15.80:0/3986625303 reap_dead start 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda7179d640 1 -- 172.21.15.80:0/3986625303 shutdown_connections 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda7179d640 1 -- 172.21.15.80:0/3986625303 >> 172.21.15.80:0/3986625303 conn(0x7fda6c06e9f0 msgr2=0x7fda6c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda7179d640 1 -- 172.21.15.80:0/3986625303 shutdown_connections 2024-04-25T15:46:02.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.591+0000 7fda7179d640 1 -- 172.21.15.80:0/3986625303 wait complete. 2024-04-25T15:46:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.593+0000 7fda7179d640 1 Processor -- start 2024-04-25T15:46:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.593+0000 7fda7179d640 1 -- start start 2024-04-25T15:46:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 0x7fda6c1f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6c148c10 0x7fda6c1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c15c270 0x7fda6c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c0b5150 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c0b4fd0 con 0x7fda6c148c10 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda6c0b9220 con 0x7fda6c15c270 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 0x7fda6c1f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 0x7fda6c1f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33916/0 (socket says 172.21.15.80:33916) 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 -- 172.21.15.80:0/3171668213 learned_addr learned my addr 172.21.15.80:0/3171668213 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6a7fc640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6c148c10 0x7fda6c1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6b7fe640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c15c270 0x7fda6c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 -- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c15c270 msgr2=0x7fda6c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c15c270 0x7fda6c15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 -- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6c148c10 msgr2=0x7fda6c1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6c148c10 0x7fda6c1589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 -- 172.21.15.80:0/3171668213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c15cbc0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda6affd640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 0x7fda6c1f8bd0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00eed0 tx=0x7fda5c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c018020 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c014400 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c1592d0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.595+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0147f0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.596+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c1f98c0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.596+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c1f93d0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.597+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fda5c005d10 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.598+0000 7fda537fe640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fda580744b0 0x7fda580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.598+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fda5c095bf0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.598+0000 7fda6a7fc640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fda580744b0 0x7fda580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.598+0000 7fda6a7fc640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fda580744b0 0x7fda580769c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fda6c1fa4d0 tx=0x7fda60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.602+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda5c022030 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.780+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda6c0d3070 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.781+0000 7fda537fe640 1 -- 172.21.15.80:0/3171668213 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16933 (secure 0 0 0) 0x7fda6c15cbc0 con 0x7fda6c1fa0c0 2024-04-25T15:46:02.782 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:02.783 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:50.027676+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fda580744b0 msgr2=0x7fda580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fda580744b0 0x7fda580769c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fda6c1fa4d0 tx=0x7fda60009040 comp rx=0 tx=0).stop 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 msgr2=0x7fda6c1f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 0x7fda6c1f8bd0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00eed0 tx=0x7fda5c00b480 comp rx=0 tx=0).stop 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 shutdown_connections 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fda580744b0 0x7fda580769c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6c15c270 0x7fda6c15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6c148c10 0x7fda6c1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 --2- 172.21.15.80:0/3171668213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda6c1fa0c0 0x7fda6c1f8bd0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 >> 172.21.15.80:0/3171668213 conn(0x7fda6c06e9f0 msgr2=0x7fda6c160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 shutdown_connections 2024-04-25T15:46:02.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.783+0000 7fda7179d640 1 -- 172.21.15.80:0/3171668213 wait complete. 2024-04-25T15:46:02.796 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:45:46.643187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:45:47.329997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:02.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:02.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.906+0000 7f5bd6784640 1 Processor -- start 2024-04-25T15:46:02.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.906+0000 7f5bd6784640 1 -- start start 2024-04-25T15:46:02.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd6784640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 0x7f5bd009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd6784640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5bd00d3110 0x7f5bd00d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd6784640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd0160760 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd6784640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd009b920 con 0x7f5bd00d3110 2024-04-25T15:46:02.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd6784640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd00b3410 con 0x7f5bd009b410 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bcf7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5bd00d3110 0x7f5bd00d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd4d21640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5bd00d1fc0 0x7f5bd00b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36138/0 (socket says 172.21.15.80:36138) 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bd4d21640 1 -- 172.21.15.80:0/736999756 learned_addr learned my addr 172.21.15.80:0/736999756 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/736999756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 msgr2=0x7f5bd009bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bcf7fe640 1 --2- 172.21.15.80:0/736999756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 0x7f5bd009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/736999756 >> v1:172.21.15.80:6789/0 conn(0x7f5bd00d1fc0 legacy=0x7f5bd00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bceffd640 1 -- 172.21.15.80:0/736999756 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121059797 0 0) 0x7f5bd0160760 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.908+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/736999756 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd00b3c00 con 0x7f5bd00d3110 2024-04-25T15:46:02.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.909+0000 7f5bcf7fe640 1 --2- 172.21.15.80:0/736999756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d3110 0x7f5bd00d1a80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40097a0 tx=0x7f5bc402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5749bd57f7709b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.909+0000 7f5bceffd640 1 -- 172.21.15.80:0/736999756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4037070 con 0x7f5bd00d3110 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.909+0000 7f5bceffd640 1 -- 172.21.15.80:0/736999756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc4032440 con 0x7f5bd00d3110 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.909+0000 7f5bceffd640 1 -- 172.21.15.80:0/736999756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4032810 con 0x7f5bd00d3110 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 -- 172.21.15.80:0/736999756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d3110 msgr2=0x7f5bd00d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 --2- 172.21.15.80:0/736999756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d3110 0x7f5bd00d1a80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40097a0 tx=0x7f5bc402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 -- 172.21.15.80:0/736999756 shutdown_connections 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 --2- 172.21.15.80:0/736999756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d3110 0x7f5bd00d1a80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 --2- 172.21.15.80:0/736999756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 0x7f5bd009bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 -- 172.21.15.80:0/736999756 >> 172.21.15.80:0/736999756 conn(0x7f5bd00b7620 msgr2=0x7f5bd00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 -- 172.21.15.80:0/736999756 shutdown_connections 2024-04-25T15:46:02.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.910+0000 7f5bd6784640 1 -- 172.21.15.80:0/736999756 wait complete. 2024-04-25T15:46:02.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.911+0000 7f5bd6784640 1 Processor -- start 2024-04-25T15:46:02.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.912+0000 7f5bd6784640 1 -- start start 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bd6784640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 0x7f5bd00af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bd6784640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 0x7f5bd00afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bd6784640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd00d3110 0x7f5bd0161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bd6784640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd00cea40 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bd6784640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd00b41a0 con 0x7f5bd00d3110 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bd6784640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd00d23d0 con 0x7f5bd009b410 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 0x7f5bd00afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 0x7f5bd00afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33936/0 (socket says 172.21.15.80:33936) 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/3294213403 learned_addr learned my addr 172.21.15.80:0/3294213403 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:02.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/3294213403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 msgr2=0x7f5bd00af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 0x7f5bd00af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/3294213403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd00d3110 msgr2=0x7f5bd0161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd00d3110 0x7f5bd0161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 -- 172.21.15.80:0/3294213403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd01f6310 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.913+0000 7f5bcf7fe640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 0x7f5bd00afd30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5bc402a790 tx=0x7f5bc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.914+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4041070 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.914+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc403c870 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.914+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd01f65f0 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.914+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4037040 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.914+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd00b05b0 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.915+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd006a100 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.915+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5bc4044070 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.916+0000 7f5bccff9640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5bbc0744e0 0x7f5bbc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.916+0000 7f5bcffff640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5bbc0744e0 0x7f5bbc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.916+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f5bc40b5f30 con 0x7f5bd00d1fc0 2024-04-25T15:46:02.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.916+0000 7f5bcffff640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5bbc0744e0 0x7f5bbc0769f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009670 tx=0x7f5bc0006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:02.920+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bc4080530 con 0x7f5bd00d1fc0 2024-04-25T15:46:03.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.096+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5bd006efd0 con 0x7f5bd00d1fc0 2024-04-25T15:46:03.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.096+0000 7f5bccff9640 1 -- 172.21.15.80:0/3294213403 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f5bc407fe30 con 0x7f5bd00d1fc0 2024-04-25T15:46:03.098 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5bbc0744e0 msgr2=0x7f5bbc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5bbc0744e0 0x7f5bbc0769f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009670 tx=0x7f5bc0006bf0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 msgr2=0x7f5bd00afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 0x7f5bd00afd30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5bc402a790 tx=0x7f5bc40046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 shutdown_connections 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5bbc0744e0 0x7f5bbc0769f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bd00d3110 0x7f5bd0161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5bd00d1fc0 0x7f5bd00afd30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 --2- 172.21.15.80:0/3294213403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5bd009b410 0x7f5bd00af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.098+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 >> 172.21.15.80:0/3294213403 conn(0x7f5bd00b7620 msgr2=0x7f5bd00b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.099+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 shutdown_connections 2024-04-25T15:46:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.099+0000 7f5bd6784640 1 -- 172.21.15.80:0/3294213403 wait complete. 2024-04-25T15:46:03.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.220+0000 7f1fdfc96640 1 Processor -- start 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.220+0000 7f1fdfc96640 1 -- start start 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdfc96640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1fd806dce0 0x7f1fd80b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdfc96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd80b0ca0 0x7f1fd80b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdfc96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd80b4850 con 0x7f1fd815cc80 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdfc96640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd80d1620 con 0x7f1fd806dce0 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdfc96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd80b5460 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdd231640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1fd806dce0 0x7f1fd80b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdd231640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1fd806dce0 0x7f1fd80b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33940/0 (socket says 172.21.15.80:33940) 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.221+0000 7f1fdd231640 1 -- 172.21.15.80:0/3651650598 learned_addr learned my addr 172.21.15.80:0/3651650598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fde233640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd80b0ca0 0x7f1fd80b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fdd231640 1 -- 172.21.15.80:0/3651650598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd80b0ca0 msgr2=0x7f1fd80b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fdd231640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd80b0ca0 0x7f1fd80b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fdd231640 1 -- 172.21.15.80:0/3651650598 >> v1:172.21.15.195:6789/0 conn(0x7f1fd815cc80 legacy=0x7f1fd806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fdd231640 1 -- 172.21.15.80:0/3651650598 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd80b4b30 con 0x7f1fd806dce0 2024-04-25T15:46:03.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fde233640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd80b0ca0 0x7f1fd80b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.222+0000 7f1fdd231640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd806dce0 0x7f1fd80b0760 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009870 tx=0x7f1fc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b4545ae34b5a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdca30640 1 -- 172.21.15.80:0/3651650598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8037070 con 0x7f1fd806dce0 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdca30640 1 -- 172.21.15.80:0/3651650598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc8032440 con 0x7f1fd806dce0 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdca30640 1 -- 172.21.15.80:0/3651650598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8032810 con 0x7f1fd806dce0 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3651650598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd806dce0 msgr2=0x7f1fd80b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd806dce0 0x7f1fd80b0760 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009870 tx=0x7f1fc802a270 comp rx=0 tx=0).stop 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3651650598 shutdown_connections 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd80b0ca0 0x7f1fd80b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3651650598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd806dce0 0x7f1fd80b0760 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3651650598 >> 172.21.15.80:0/3651650598 conn(0x7f1fd80734b0 msgr2=0x7f1fd80738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3651650598 shutdown_connections 2024-04-25T15:46:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.223+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3651650598 wait complete. 2024-04-25T15:46:03.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.225+0000 7f1fdfc96640 1 Processor -- start 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.225+0000 7f1fdfc96640 1 -- start start 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdfc96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 0x7f1fd815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdfc96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd815cc80 0x7f1fd815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdfc96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd815bcb0 0x7f1fd80b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdfc96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd815d090 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdfc96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd80b50f0 con 0x7f1fd815cc80 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdfc96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd80b10b0 con 0x7f1fd815bcb0 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.226+0000 7f1fdda32640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 0x7f1fd815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 0x7f1fd815ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33948/0 (socket says 172.21.15.80:33948) 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 -- 172.21.15.80:0/3790452228 learned_addr learned my addr 172.21.15.80:0/3790452228 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 -- 172.21.15.80:0/3790452228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd815bcb0 msgr2=0x7f1fd80b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd815bcb0 0x7f1fd80b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 -- 172.21.15.80:0/3790452228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd815cc80 msgr2=0x7f1fd815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd815cc80 0x7f1fd815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 -- 172.21.15.80:0/3790452228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd815d830 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdda32640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 0x7f1fd815ede0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c3f0 tx=0x7f1fd400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40052d0 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd4005490 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd815dd40 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4007260 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.227+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd815e300 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.228+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd806a100 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.229+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1fd4007400 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.229+0000 7f1fce7fc640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1fbc0744b0 0x7f1fbc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.229+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f1fd40947e0 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.229+0000 7f1fdd231640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1fbc0744b0 0x7f1fbc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.230+0000 7f1fdd231640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1fbc0744b0 0x7f1fbc0769c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8034000 tx=0x7f1fc802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.234+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fd405ee70 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.409+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1fd80d1020 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.410+0000 7f1fce7fc640 1 -- 172.21.15.80:0/3790452228 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f1fd405e770 con 0x7f1fd80b0ca0 2024-04-25T15:46:03.411 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:46:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1fbc0744b0 msgr2=0x7f1fbc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1fbc0744b0 0x7f1fbc0769c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8034000 tx=0x7f1fc802c000 comp rx=0 tx=0).stop 2024-04-25T15:46:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 msgr2=0x7f1fd815ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 0x7f1fd815ede0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c3f0 tx=0x7f1fd400c8b0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 shutdown_connections 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1fbc0744b0 0x7f1fbc0769c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1fd815bcb0 0x7f1fd80b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd815cc80 0x7f1fd815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 --2- 172.21.15.80:0/3790452228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fd80b0ca0 0x7f1fd815ede0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 >> 172.21.15.80:0/3790452228 conn(0x7f1fd80734b0 msgr2=0x7f1fd806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 shutdown_connections 2024-04-25T15:46:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.412+0000 7f1fdfc96640 1 -- 172.21.15.80:0/3790452228 wait complete. 2024-04-25T15:46:03.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:03.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.536+0000 7f435a096640 1 Processor -- start 2024-04-25T15:46:03.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.536+0000 7f435a096640 1 -- start start 2024-04-25T15:46:03.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f435a096640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43540727c0 0x7f43540b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f435a096640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43540718d0 0x7f43540d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f435a096640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540d3160 0x7f43540ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f435a096640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4354072400 con 0x7f43540727c0 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f435a096640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43540d2790 con 0x7f43540718d0 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f435a096640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43540b3290 con 0x7f43540d3160 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43540727c0 0x7f43540b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f43540727c0 0x7f43540b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33956/0 (socket says 172.21.15.80:33956) 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 -- 172.21.15.80:0/3513085111 learned_addr learned my addr 172.21.15.80:0/3513085111 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f4353fff640 1 --2- 172.21.15.80:0/3513085111 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540d3160 0x7f43540ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f4352ffd640 1 --2- 172.21.15.80:0/3513085111 >> v2:172.21.15.195:3300/0 conn(0x7f43540718d0 0x7f43540d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 -- 172.21.15.80:0/3513085111 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540d3160 msgr2=0x7f43540ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 --2- 172.21.15.80:0/3513085111 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540d3160 0x7f43540ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 -- 172.21.15.80:0/3513085111 >> v2:172.21.15.195:3300/0 conn(0x7f43540718d0 msgr2=0x7f43540d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:03.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 --2- 172.21.15.80:0/3513085111 >> v2:172.21.15.195:3300/0 conn(0x7f43540718d0 0x7f43540d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.537+0000 7f43537fe640 1 -- 172.21.15.80:0/3513085111 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4354072120 con 0x7f43540727c0 2024-04-25T15:46:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.538+0000 7f4352ffd640 1 --2- 172.21.15.80:0/3513085111 >> v2:172.21.15.195:3300/0 conn(0x7f43540718d0 0x7f43540d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.538+0000 7f43537fe640 1 --2- 172.21.15.80:0/3513085111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540727c0 0x7f43540b2d50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f43540d2910 tx=0x7f434402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70a9b7eb6a66d31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.538+0000 7f43527fc640 1 -- 172.21.15.80:0/3513085111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344036070 con 0x7f43540727c0 2024-04-25T15:46:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.538+0000 7f43527fc640 1 -- 172.21.15.80:0/3513085111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4344031600 con 0x7f43540727c0 2024-04-25T15:46:03.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.538+0000 7f43527fc640 1 -- 172.21.15.80:0/3513085111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43440319d0 con 0x7f43540727c0 2024-04-25T15:46:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 -- 172.21.15.80:0/3513085111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540727c0 msgr2=0x7f43540b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 --2- 172.21.15.80:0/3513085111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540727c0 0x7f43540b2d50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f43540d2910 tx=0x7f434402a5f0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 -- 172.21.15.80:0/3513085111 shutdown_connections 2024-04-25T15:46:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 --2- 172.21.15.80:0/3513085111 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540d3160 0x7f43540ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 --2- 172.21.15.80:0/3513085111 >> v2:172.21.15.195:3300/0 conn(0x7f43540718d0 0x7f43540d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 --2- 172.21.15.80:0/3513085111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540727c0 0x7f43540b2d50 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 -- 172.21.15.80:0/3513085111 >> 172.21.15.80:0/3513085111 conn(0x7f43540d3a30 msgr2=0x7f43540d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 -- 172.21.15.80:0/3513085111 shutdown_connections 2024-04-25T15:46:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.539+0000 7f435a096640 1 -- 172.21.15.80:0/3513085111 wait complete. 2024-04-25T15:46:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.541+0000 7f435a096640 1 Processor -- start 2024-04-25T15:46:03.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.541+0000 7f435a096640 1 -- start start 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.542+0000 7f435a096640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43540718d0 0x7f43540ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.542+0000 7f435a096640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540727c0 0x7f43541f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.542+0000 7f435a096640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 0x7f43540cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.542+0000 7f435a096640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4354071ce0 con 0x7f43540d3160 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.542+0000 7f435a096640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43540d2420 con 0x7f43540718d0 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.542+0000 7f435a096640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4354071e60 con 0x7f43540727c0 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 0x7f43540cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 0x7f43540cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33962/0 (socket says 172.21.15.80:33962) 2024-04-25T15:46:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 -- 172.21.15.80:0/1850377654 learned_addr learned my addr 172.21.15.80:0/1850377654 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f43537fe640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43540718d0 0x7f43540ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4352ffd640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540727c0 0x7f43541f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 -- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540727c0 msgr2=0x7f43541f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540727c0 0x7f43541f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 -- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43540718d0 msgr2=0x7f43540ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43540718d0 0x7f43540ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 -- 172.21.15.80:0/1850377654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43540cac30 con 0x7f43540d3160 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f4353fff640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 0x7f43540cd2f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f434c00d5d0 tx=0x7f434c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c0125f0 con 0x7f43540d3160 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c019070 con 0x7f43540d3160 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c0129f0 con 0x7f43540d3160 2024-04-25T15:46:03.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43541f75b0 con 0x7f43540d3160 2024-04-25T15:46:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.543+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43540cb420 con 0x7f43540d3160 2024-04-25T15:46:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.544+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435406a100 con 0x7f43540d3160 2024-04-25T15:46:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.545+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f434c012b90 con 0x7f43540d3160 2024-04-25T15:46:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.545+0000 7f433bfff640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43400744b0 0x7f43400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.545+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f434c095820 con 0x7f43540d3160 2024-04-25T15:46:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.545+0000 7f43537fe640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43400744b0 0x7f43400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.546+0000 7f43537fe640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43400744b0 0x7f43400769c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4344033000 tx=0x7f4344009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.550+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f434c05fe30 con 0x7f43540d3160 2024-04-25T15:46:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.725+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f43540b3070 con 0x7f43540d3160 2024-04-25T15:46:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.725+0000 7f433bfff640 1 -- 172.21.15.80:0/1850377654 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f434c05f730 con 0x7f43540d3160 2024-04-25T15:46:03.727 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.727+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43400744b0 msgr2=0x7f43400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.727+0000 7f435a096640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43400744b0 0x7f43400769c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4344033000 tx=0x7f4344009000 comp rx=0 tx=0).stop 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.727+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 msgr2=0x7f43540cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.727+0000 7f435a096640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 0x7f43540cd2f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f434c00d5d0 tx=0x7f434c00da90 comp rx=0 tx=0).stop 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 shutdown_connections 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f43400744b0 0x7f43400769c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43540d3160 0x7f43540cd2f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43540727c0 0x7f43541f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 --2- 172.21.15.80:0/1850377654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43540718d0 0x7f43540ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 >> 172.21.15.80:0/1850377654 conn(0x7f43540d3a30 msgr2=0x7f43540b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 shutdown_connections 2024-04-25T15:46:03.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.728+0000 7f435a096640 1 -- 172.21.15.80:0/1850377654 wait complete. 2024-04-25T15:46:03.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:46:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.847+0000 7f1cdda42640 1 Processor -- start 2024-04-25T15:46:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.847+0000 7f1cdda42640 1 -- start start 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cdda42640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1cd809b950 0x7f1cd80d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cdda42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd80d2d00 0x7f1cd80d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cdda42640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cd806e990 con 0x7f1cd815d310 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cdda42640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1cd80d0610 con 0x7f1cd809b950 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cdda42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd80d3110 con 0x7f1cd80d2d00 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1cd809b950 0x7f1cd80d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1cd809b950 0x7f1cd80d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33978/0 (socket says 172.21.15.80:33978) 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd6ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1cd815d310 0x7f1cd80cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36144/0 (socket says 172.21.15.80:36144) 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 -- 172.21.15.80:0/3093040472 learned_addr learned my addr 172.21.15.80:0/3093040472 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd77fe640 1 --2- 172.21.15.80:0/3093040472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd80d2d00 0x7f1cd80d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 -- 172.21.15.80:0/3093040472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd80d2d00 msgr2=0x7f1cd80d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:03.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 --2- 172.21.15.80:0/3093040472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd80d2d00 0x7f1cd80d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 -- 172.21.15.80:0/3093040472 >> v1:172.21.15.80:6789/0 conn(0x7f1cd815d310 legacy=0x7f1cd80cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd5ffb640 1 -- 172.21.15.80:0/3093040472 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565383827 0 0) 0x7f1cd806e990 con 0x7f1cd815d310 2024-04-25T15:46:03.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.848+0000 7f1cd67fc640 1 -- 172.21.15.80:0/3093040472 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd806ec00 con 0x7f1cd809b950 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.849+0000 7f1cd67fc640 1 --2- 172.21.15.80:0/3093040472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd809b950 0x7f1cd80d27c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00bb10 tx=0x7f1ccc02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35796b0396dc73a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.849+0000 7f1cd5ffb640 1 -- 172.21.15.80:0/3093040472 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc032790 con 0x7f1cd809b950 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.849+0000 7f1cd5ffb640 1 -- 172.21.15.80:0/3093040472 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc038070 con 0x7f1cd809b950 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.849+0000 7f1cd5ffb640 1 -- 172.21.15.80:0/3093040472 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc032b50 con 0x7f1cd809b950 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 -- 172.21.15.80:0/3093040472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd809b950 msgr2=0x7f1cd80d27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 --2- 172.21.15.80:0/3093040472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd809b950 0x7f1cd80d27c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00bb10 tx=0x7f1ccc02c890 comp rx=0 tx=0).stop 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 -- 172.21.15.80:0/3093040472 shutdown_connections 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 --2- 172.21.15.80:0/3093040472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd80d2d00 0x7f1cd80d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 --2- 172.21.15.80:0/3093040472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd809b950 0x7f1cd80d27c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 -- 172.21.15.80:0/3093040472 >> 172.21.15.80:0/3093040472 conn(0x7f1cd80b7750 msgr2=0x7f1cd80b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 -- 172.21.15.80:0/3093040472 shutdown_connections 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.850+0000 7f1cdda42640 1 -- 172.21.15.80:0/3093040472 wait complete. 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.852+0000 7f1cdda42640 1 Processor -- start 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.852+0000 7f1cdda42640 1 -- start start 2024-04-25T15:46:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cdda42640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd809b950 0x7f1cd8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cdda42640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cd80d2d00 0x7f1cd80ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cdda42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 0x7f1cd80cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cdda42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd80d1440 con 0x7f1cd815d310 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cdda42640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd80d12c0 con 0x7f1cd80d2d00 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cdda42640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd80d15c0 con 0x7f1cd809b950 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.853+0000 7f1cd77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 0x7f1cd80cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 0x7f1cd80cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33994/0 (socket says 172.21.15.80:33994) 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 -- 172.21.15.80:0/254692408 learned_addr learned my addr 172.21.15.80:0/254692408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 -- 172.21.15.80:0/254692408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd809b950 msgr2=0x7f1cd8152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd809b950 0x7f1cd8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 -- 172.21.15.80:0/254692408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cd80d2d00 msgr2=0x7f1cd80ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cd80d2d00 0x7f1cd80ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 -- 172.21.15.80:0/254692408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd81530f0 con 0x7f1cd815d310 2024-04-25T15:46:03.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cd77fe640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 0x7f1cd80cf250 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c4f0 tx=0x7f1cd000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0015070 con 0x7f1cd815d310 2024-04-25T15:46:03.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0004220 con 0x7f1cd815d310 2024-04-25T15:46:03.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd80cd120 con 0x7f1cd815d310 2024-04-25T15:46:03.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0003610 con 0x7f1cd815d310 2024-04-25T15:46:03.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.854+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd80c86d0 con 0x7f1cd815d310 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.855+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd80cd3a0 con 0x7f1cd815d310 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.856+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1cd00037b0 con 0x7f1cd815d310 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.856+0000 7f1cbffff640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1cc40744e0 0x7f1cc40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.856+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f1cd00950f0 con 0x7f1cd815d310 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.856+0000 7f1cd6ffd640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1cc40744e0 0x7f1cc40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.857+0000 7f1cd6ffd640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1cc40744e0 0x7f1cc40769f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007fd0 tx=0x7f1cc8007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:03.861+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1cd005f6f0 con 0x7f1cd815d310 2024-04-25T15:46:03.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:03.913 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:04.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.057+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1cd80b2c00 con 0x7f1cd815d310 2024-04-25T15:46:04.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.057+0000 7f1cbffff640 1 -- 172.21.15.80:0/254692408 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7f1cd005eff0 con 0x7f1cd815d310 2024-04-25T15:46:04.058 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:46:04.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1cc40744e0 msgr2=0x7f1cc40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1cc40744e0 0x7f1cc40769f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007fd0 tx=0x7f1cc8007ce0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 msgr2=0x7f1cd80cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 0x7f1cd80cf250 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c4f0 tx=0x7f1cd000c9b0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 shutdown_connections 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1cc40744e0 0x7f1cc40769f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cd815d310 0x7f1cd80cf250 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cd80d2d00 0x7f1cd80ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 --2- 172.21.15.80:0/254692408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cd809b950 0x7f1cd8152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 >> 172.21.15.80:0/254692408 conn(0x7f1cd80b7750 msgr2=0x7f1cd806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 shutdown_connections 2024-04-25T15:46:04.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.059+0000 7f1cdda42640 1 -- 172.21.15.80:0/254692408 wait complete. 2024-04-25T15:46:04.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:46:04.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:04.072 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:04.104 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:46:04.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:04.104 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:46:04.163 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.270+0000 7f9d3c81a640 1 Processor -- start 2024-04-25T15:46:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.270+0000 7f9d3c81a640 1 -- start start 2024-04-25T15:46:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.271+0000 7f9d3c81a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9d3809bdf0 0x7f9d380cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.271+0000 7f9d3c81a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d380b3fe0 con 0x7f9d380d21f0 2024-04-25T15:46:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.271+0000 7f9d3c81a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d380ce110 con 0x7f9d381604d0 2024-04-25T15:46:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.271+0000 7f9d3c81a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9d380ce6d0 con 0x7f9d3809bdf0 2024-04-25T15:46:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.271+0000 7f9d2ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9d380d21f0 0x7f9d380cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36160/0 (socket says 172.21.15.80:36160) 2024-04-25T15:46:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.271+0000 7f9d2ffff640 1 -- 172.21.15.80:0/1080901446 learned_addr learned my addr 172.21.15.80:0/1080901446 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653766068 0 0) 0x7f9d380b3fe0 con 0x7f9d380d21f0 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d24003520 con 0x7f9d380d21f0 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d36d9d640 1 --2- 172.21.15.80:0/1080901446 >> v2:172.21.15.195:3300/0 conn(0x7f9d3809bdf0 0x7f9d380cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1187007374 0 0) 0x7f9d24003520 con 0x7f9d380d21f0 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 >> v2:172.21.15.195:3300/0 conn(0x7f9d3809bdf0 msgr2=0x7f9d380cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 --2- 172.21.15.80:0/1080901446 >> v2:172.21.15.195:3300/0 conn(0x7f9d3809bdf0 0x7f9d380cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 >> v1:172.21.15.195:6789/0 conn(0x7f9d381604d0 legacy=0x7f9d380d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d380ce3f0 con 0x7f9d380d21f0 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f9d20001670 con 0x7f9d380d21f0 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 >> v1:172.21.15.80:6789/0 conn(0x7f9d380d21f0 legacy=0x7f9d380cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d240039b0 0x7f9d24003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d24004800 0x7f9d24004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9d380ce6d0 con 0x7f9d24005270 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2400c200 con 0x7f9d24004800 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2400c400 con 0x7f9d240039b0 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d2ffff640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d24004800 0x7f9d24004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d36d9d640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.272+0000 7f9d3659c640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d240039b0 0x7f9d24003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 -- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d240039b0 msgr2=0x7f9d24003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d240039b0 0x7f9d24003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 -- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d24004800 msgr2=0x7f9d24004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d24004800 0x7f9d24004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 -- 172.21.15.80:0/1080901446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d24003520 con 0x7f9d24005270 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 -- 172.21.15.80:0/1080901446 reap_dead start 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d36d9d640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d2400b9c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f9d30007330 tx=0x7f9d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6e3f5320478189 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30009be0 con 0x7f9d24005270 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30036600 con 0x7f9d24005270 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.273+0000 7f9d35d9b640 1 -- 172.21.15.80:0/1080901446 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d300369f0 con 0x7f9d24005270 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 -- 172.21.15.80:0/1080901446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 msgr2=0x7f9d2400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d2400b9c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f9d30007330 tx=0x7f9d24005830 comp rx=0 tx=0).stop 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 -- 172.21.15.80:0/1080901446 shutdown_connections 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/1080901446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d2400b9c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 -- 172.21.15.80:0/1080901446 >> 172.21.15.80:0/1080901446 conn(0x7f9d380b7620 msgr2=0x7f9d380b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 -- 172.21.15.80:0/1080901446 shutdown_connections 2024-04-25T15:46:04.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.274+0000 7f9d3c81a640 1 -- 172.21.15.80:0/1080901446 wait complete. 2024-04-25T15:46:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.276+0000 7f9d3c81a640 1 Processor -- start 2024-04-25T15:46:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.276+0000 7f9d3c81a640 1 -- start start 2024-04-25T15:46:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.277+0000 7f9d3c81a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d380a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.277+0000 7f9d3c81a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d380caf40 0x7f9d380cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.277+0000 7f9d3c81a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d380c8be0 0x7f9d380c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.277+0000 7f9d3c81a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9d380b3b70 con 0x7f9d24005270 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.277+0000 7f9d3c81a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3806ef30 con 0x7f9d380c8be0 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.277+0000 7f9d3c81a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d380b3cf0 con 0x7f9d380caf40 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d380a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d380a0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34026/0 (socket says 172.21.15.80:34026) 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 -- 172.21.15.80:0/212797051 learned_addr learned my addr 172.21.15.80:0/212797051 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d36d9d640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d380c8be0 0x7f9d380c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 -- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d380caf40 msgr2=0x7f9d380cb350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d380caf40 0x7f9d380cb350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 -- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d380c8be0 msgr2=0x7f9d380c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d380c8be0 0x7f9d380c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 -- 172.21.15.80:0/212797051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d380c9530 con 0x7f9d24005270 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3659c640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d380a0090 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800f5f0 tx=0x7f9d2800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280052e0 con 0x7f9d24005270 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d28018070 con 0x7f9d24005270 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003810 con 0x7f9d24005270 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d381f62f0 con 0x7f9d24005270 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.278+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d381f6890 con 0x7f9d24005270 2024-04-25T15:46:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.279+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3806a100 con 0x7f9d24005270 2024-04-25T15:46:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.280+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9d280039b0 con 0x7f9d24005270 2024-04-25T15:46:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.280+0000 7f9d2effd640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d180744e0 0x7f9d180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.281+0000 7f9d2ffff640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d180744e0 0x7f9d180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.281+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f9d28095130 con 0x7f9d24005270 2024-04-25T15:46:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.281+0000 7f9d2ffff640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d180744e0 0x7f9d180769f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9d20001b80 tx=0x7f9d20001af0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.285+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d380c9530 con 0x7f9d24005270 2024-04-25T15:46:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.494+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d380c61f0 con 0x7f9d24005270 2024-04-25T15:46:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.495+0000 7f9d2effd640 1 -- 172.21.15.80:0/212797051 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7f9d2805f7c0 con 0x7f9d24005270 2024-04-25T15:46:04.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:04.496 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:46:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.496+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d180744e0 msgr2=0x7f9d180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.496+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d180744e0 0x7f9d180769f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9d20001b80 tx=0x7f9d20001af0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.496+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 msgr2=0x7f9d380a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.496+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d380a0090 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800f5f0 tx=0x7f9d2800fab0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 shutdown_connections 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d180744e0 0x7f9d180769f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d380c8be0 0x7f9d380c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d380caf40 0x7f9d380cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 --2- 172.21.15.80:0/212797051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d24005270 0x7f9d380a0090 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 >> 172.21.15.80:0/212797051 conn(0x7f9d380b7620 msgr2=0x7f9d380cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 shutdown_connections 2024-04-25T15:46:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.497+0000 7f9d3c81a640 1 -- 172.21.15.80:0/212797051 wait complete. 2024-04-25T15:46:04.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-04-25T15:46:04.633 INFO:teuthology.orchestra.run.smithi080.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":69,"msgr_send_messages":63,"msgr_recv_bytes":122270,"msgr_send_bytes":17258,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.009139116,"msgr_running_send_time":0.002547673,"msgr_running_recv_time":0.009625382,"msgr_running_fast_dispatch_time":0.000458399,"msgr_send_messages_queue_lat":{"avgcount":63,"sum":0.059593712,"avgtime":0.000945931},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":119072,"msgr_send_encrypted_bytes":11712},"AsyncMessenger::Worker-1":{"msgr_recv_messages":41,"msgr_send_messages":45,"msgr_recv_bytes":10198,"msgr_send_bytes":136022,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.006093231,"msgr_running_send_time":0.001426888,"msgr_running_recv_time":0.004534542,"msgr_running_fast_dispatch_time":0.000308174,"msgr_send_messages_queue_lat":{"avgcount":44,"sum":0.056078667,"avgtime":0.001274515},"msgr_handle_ack_lat":{"avgcount":58,"sum":0.000009162,"avgtime":0.000000157},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":95520},"AsyncMessenger::Worker-2":{"msgr_recv_messages":40,"msgr_send_messages":36,"msgr_recv_bytes":11193,"msgr_send_bytes":23084,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.006045547,"msgr_running_send_time":0.000648509,"msgr_running_recv_time":0.004579069,"msgr_running_fast_dispatch_time":0.000765194,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.291659910,"avgtime":0.008333140},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000002481,"avgtime":0.000000177},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":36,"sum":0.004217367,"avgtime":0.000117149}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000011724,"avgtime":0.000005862}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.006426252,"avgtime":0.000221594},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197025,"rdpos":0,"jlat":{"avgcount":5,"sum":0.011186921,"avgtime":0.002237384},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":109712,"heap":231804},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.005601472,"avgtime":0.000215441},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000415465,"avgtime":0.000207732},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000409315,"avgtime":0.000409315},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":3,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":224237,"buffer_anon_items":80,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53424,"mds_co_items":217,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13931,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.967978190,"avgtime":0.021999504},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":74,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":144,"get_sum":126232,"get_or_fail_fail":0,"get_or_fail_success":144,"take":0,"take_sum":0,"put":144,"put_sum":126232,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13931,"put":44,"put_sum":13931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d36aa06820":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2721,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-25T15:46:04.634 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 122270, "msgr_recv_encrypted_bytes": 119072, "msgr_recv_messages": 69, "msgr_running_fast_dispatch_time": 0.000458399, "msgr_running_recv_time": 0.009625382, "msgr_running_send_time": 0.002547673, "msgr_running_total_time": 0.009139116, "msgr_send_bytes": 17258, "msgr_send_encrypted_bytes": 11712, "msgr_send_messages": 63, "msgr_send_messages_queue_lat": { "avgcount": 63, "avgtime": 0.000945931, "sum": 0.059593712 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 58, "avgtime": 1.57e-07, "sum": 9.162e-06 }, "msgr_recv_bytes": 10198, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 41, "msgr_running_fast_dispatch_time": 0.000308174, "msgr_running_recv_time": 0.004534542, "msgr_running_send_time": 0.001426888, "msgr_running_total_time": 0.006093231, "msgr_send_bytes": 136022, "msgr_send_encrypted_bytes": 95520, "msgr_send_messages": 45, "msgr_send_messages_queue_lat": { "avgcount": 44, "avgtime": 0.001274515, "sum": 0.056078667 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 1.77e-07, "sum": 2.481e-06 }, "msgr_recv_bytes": 11193, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.000765194, "msgr_running_recv_time": 0.004579069, "msgr_running_send_time": 0.000648509, "msgr_running_total_time": 0.006045547, "msgr_send_bytes": 23084, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.00833314, "sum": 0.29165991 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 36, "avgtime": 0.000117149, "sum": 0.004217367 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.862e-06, "sum": 1.1724e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000221594, "sum": 0.006426252 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002237384, "sum": 0.011186921 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197025 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 231804, "ino": 13, "ino+": 13, "ino-": 0, "rss": 109712 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000215441, "sum": 0.005601472 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000207732, "sum": 0.000415465 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000409315, "sum": 0.000409315 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 3, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 224237, "buffer_anon_items": 80, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53424, "mds_co_items": 217, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 74, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.021999504, "sum": 0.96797819 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13931, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 144, "get_or_fail_fail": 0, "get_or_fail_success": 144, "get_started": 0, "get_sum": 126232, "max": 104857600, "put": 144, "put_sum": 126232, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13931, "take": 44, "take_sum": 13931, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d36aa06820": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2721, "max": 3758096384, "put": 5, "put_sum": 2721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-25T15:46:04.635 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 session ls 2024-04-25T15:46:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.742+0000 7f3244c51640 1 Processor -- start 2024-04-25T15:46:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.742+0000 7f3244c51640 1 -- start start 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f3244c51640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f32400b21f0 0x7f32400b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f3244c51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 0x7f32401627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f3244c51640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324006da30 con 0x7f324009b4a0 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f3244c51640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f324006d7e0 con 0x7f32400b21f0 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f3244c51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f324006dd10 con 0x7f3240162390 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f323e59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f324009b4a0 0x7f32401612b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42210/0 (socket says 172.21.15.80:42210) 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f323e59c640 1 -- 172.21.15.80:0/2878712544 learned_addr learned my addr 172.21.15.80:0/2878712544 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 0x7f32401627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455170156 0 0) 0x7f324006da30 con 0x7f324009b4a0 2024-04-25T15:46:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2878712544 >> v2:172.21.15.195:3300/0 conn(0x7f32400b21f0 0x7f32400b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.744+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3228003520 con 0x7f324009b4a0 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2030535452 0 0) 0x7f3228003520 con 0x7f324009b4a0 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 msgr2=0x7f32401627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 0x7f32401627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 >> v2:172.21.15.195:3300/0 conn(0x7f32400b21f0 msgr2=0x7f32400b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 --2- 172.21.15.80:0/2878712544 >> v2:172.21.15.195:3300/0 conn(0x7f32400b21f0 0x7f32400b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3240161b90 con 0x7f324009b4a0 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f3230001a10 con 0x7f324009b4a0 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 >> v1:172.21.15.80:6789/0 conn(0x7f324009b4a0 legacy=0x7f32401612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 0x7f32280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3228003f30 0x7f3228004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3228004d40 0x7f3228005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f324006d7e0 con 0x7f3228004d40 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f324006dd10 con 0x7f3228003f30 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f322800bac0 con 0x7f3240162390 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3228004d40 0x7f3228005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323e59c640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 0x7f32280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3228003f30 0x7f3228004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323ed9d640 1 -- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 msgr2=0x7f32280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3240162390 0x7f32280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323ed9d640 1 -- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3228003f30 msgr2=0x7f3228004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3228003f30 0x7f3228004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.745+0000 7f323ed9d640 1 -- 172.21.15.80:0/2878712544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3228003520 con 0x7f3228004d40 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.746+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3228004d40 0x7f3228005150 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3238009ac0 tx=0x7f3228005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c1daf6a71b1a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.746+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238036070 con 0x7f3228004d40 2024-04-25T15:46:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.746+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3238031400 con 0x7f3228004d40 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.746+0000 7f323d59a640 1 -- 172.21.15.80:0/2878712544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238009690 con 0x7f3228004d40 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f3244c51640 1 -- 172.21.15.80:0/2878712544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3228004d40 msgr2=0x7f3228005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f3244c51640 1 --2- 172.21.15.80:0/2878712544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3228004d40 0x7f3228005150 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3238009ac0 tx=0x7f3228005830 comp rx=0 tx=0).stop 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f323ed9d640 1 -- 172.21.15.80:0/2878712544 reap_dead start 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f3244c51640 1 -- 172.21.15.80:0/2878712544 shutdown_connections 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f3244c51640 1 -- 172.21.15.80:0/2878712544 >> 172.21.15.80:0/2878712544 conn(0x7f3240073b50 msgr2=0x7f32400b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f3244c51640 1 -- 172.21.15.80:0/2878712544 shutdown_connections 2024-04-25T15:46:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.747+0000 7f3244c51640 1 -- 172.21.15.80:0/2878712544 wait complete. 2024-04-25T15:46:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.749+0000 7f3244c51640 1 Processor -- start 2024-04-25T15:46:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.749+0000 7f3244c51640 1 -- start start 2024-04-25T15:46:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f3244c51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3228004d40 0x7f3240155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f3244c51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 0x7f324009ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f3244c51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f324015bb20 0x7f324015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f3244c51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3240162b30 con 0x7f324009eb30 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f3244c51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f32401629b0 con 0x7f324015bb20 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f3244c51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3240162cb0 con 0x7f3228004d40 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 0x7f324009ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 0x7f324009ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41260/0 (socket says 172.21.15.80:41260) 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 -- 172.21.15.80:0/2108665594 learned_addr learned my addr 172.21.15.80:0/2108665594 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323e59c640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3228004d40 0x7f3240155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f324015bb20 0x7f324015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 -- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3228004d40 msgr2=0x7f3240155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3228004d40 0x7f3240155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 -- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f324015bb20 msgr2=0x7f324015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f324015bb20 0x7f324015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 -- 172.21.15.80:0/2108665594 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324015c470 con 0x7f324009eb30 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.750+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 0x7f324009ef40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3234011960 tx=0x7f3234011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.751+0000 7f322effd640 1 -- 172.21.15.80:0/2108665594 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323400faf0 con 0x7f324009eb30 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.751+0000 7f322effd640 1 -- 172.21.15.80:0/2108665594 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323400fc90 con 0x7f324009eb30 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.751+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324009f880 con 0x7f324009eb30 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.751+0000 7f322effd640 1 -- 172.21.15.80:0/2108665594 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234014440 con 0x7f324009eb30 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.751+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32401f5fa0 con 0x7f324009eb30 2024-04-25T15:46:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.753+0000 7f322effd640 1 -- 172.21.15.80:0/2108665594 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3234012040 con 0x7f324009eb30 2024-04-25T15:46:04.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.753+0000 7f322effd640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32200744e0 0x7f32200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.753+0000 7f322effd640 1 -- 172.21.15.80:0/2108665594 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f3234095ad0 con 0x7f324009eb30 2024-04-25T15:46:04.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.753+0000 7f323e59c640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32200744e0 0x7f32200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.754+0000 7f323e59c640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32200744e0 0x7f32200769f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3240071df0 tx=0x7f3230006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.754+0000 7f324bbe5740 1 Processor -- start 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.754+0000 7f324bbe5740 1 -- start start 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.755+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb28b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb28f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f324bbe5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564ffb1f4d80 con 0x564ffaeee390 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x564ffb1aea20 con 0x564ffaec54d0 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564ffb1f0d40 con 0x564ffaecd6b0 2024-04-25T15:46:04.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb28b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb28b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41270/0 (socket says 172.21.15.80:41270) 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 -- 172.21.15.80:0/3411120674 learned_addr learned my addr 172.21.15.80:0/3411120674 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323dd9b640 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb28f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323ed9d640 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 -- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 msgr2=0x564ffb2bb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 -- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 msgr2=0x564ffb28f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb28f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 -- 172.21.15.80:0/3411120674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ffb1b9c30 con 0x564ffaeee390 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323dd9b640 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb28f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:04.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f323e59c640 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb28b920 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f32300155f0 tx=0x7f3230014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208dd9b6ff6a3897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f321ffff640 1 -- 172.21.15.80:0/3411120674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230014720 con 0x564ffaeee390 2024-04-25T15:46:04.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f321ffff640 1 -- 172.21.15.80:0/3411120674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230026070 con 0x564ffaeee390 2024-04-25T15:46:04.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.756+0000 7f321ffff640 1 -- 172.21.15.80:0/3411120674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230014ac0 con 0x564ffaeee390 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 -- 172.21.15.80:0/3411120674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 msgr2=0x564ffb28b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb28b920 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f32300155f0 tx=0x7f3230014000 comp rx=0 tx=0).stop 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 -- 172.21.15.80:0/3411120674 shutdown_connections 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb28f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3411120674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb28b920 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 -- 172.21.15.80:0/3411120674 >> 172.21.15.80:0/3411120674 conn(0x564ffaee24e0 msgr2=0x564ffb290ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 -- 172.21.15.80:0/3411120674 shutdown_connections 2024-04-25T15:46:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.757+0000 7f324bbe5740 1 -- 172.21.15.80:0/3411120674 wait complete. 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.758+0000 7f324bbe5740 1 -- start start 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.758+0000 7f324bbe5740 1 Processor -- start 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb2b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaeee390 0x564ffb2b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564ffb2b92b0 con 0x564ffaec54d0 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x564ffb17bdc0 con 0x564ffaeee390 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564ffb28be60 con 0x564ffaecd6b0 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 10 client.0 _ll_register_callbacks cb 0x564ffb197600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb2b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb2b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41276/0 (socket says 172.21.15.80:41276) 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 -- 172.21.15.80:0/3414131929 learned_addr learned my addr 172.21.15.80:0/3414131929 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323dd9b640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323ed9d640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaeee390 0x564ffb2b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 -- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 msgr2=0x564ffb2bc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 -- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaeee390 msgr2=0x564ffb2b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaeee390 0x564ffb2b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 -- 172.21.15.80:0/3414131929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ffaf063f0 con 0x564ffaec54d0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323ed9d640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaeee390 0x564ffb2b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f323e59c640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb2b6dd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3230001b80 tx=0x7f3230001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba98da982816ffe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f321d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f321d7fa640 1 -- 172.21.15.80:0/3414131929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32300219a0 con 0x564ffaec54d0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f321d7fa640 1 -- 172.21.15.80:0/3414131929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f3230021b40 con 0x564ffaec54d0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3230026070 con 0x564ffaec54d0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f321d7fa640 1 -- 172.21.15.80:0/3414131929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f323003c050 con 0x564ffaec54d0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 10 client.6975 fetch_fsmap learned FSMap version 35 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.760+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x564ffafd07d0 con 0x564ffaec54d0 2024-04-25T15:46:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f321d7fa640 1 -- 172.21.15.80:0/3414131929 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230026070 con 0x564ffaec54d0 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f321d7fa640 1 -- 172.21.15.80:0/3414131929 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f323003f020 con 0x564ffaec54d0 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f324bbe5740 10 client.6975 fetch_fsmap finished waiting for FSMap version 35 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f324bbe5740 10 client.6975 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f324bbe5740 20 client.6975 populate_metadata read hostname 'smithi080' 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffaeacf60 0x564ffb2e9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f324bbe5740 4 client.6975 mds_command: new command op to 6684 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 --> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ffb202990 con 0x564ffaeacf60 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f323dd9b640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffaeacf60 0x564ffb2e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f321d7fa640 10 client.6975 ms_handle_connect on v2:172.21.15.80:6835/231548395 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.761+0000 7f323dd9b640 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffaeacf60 0x564ffb2e9380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe8f029843e7d07 server_cookie=6ef94fd727edd339 in_seq=0 out_seq=0 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f321d7fa640 1 -- 172.21.15.80:0/3414131929 <== mds.0 v2:172.21.15.80:6835/231548395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564ffb202990 con 0x564ffaeacf60 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f321d7fa640 10 client.6975 handle_command_reply: tid=0 2024-04-25T15:46:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 client.6975 shutdown 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 msgr2=0x564ffb2b6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb2b6dd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3230001b80 tx=0x7f3230001de0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 shutdown_connections 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffaeacf60 0x564ffb2e9380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaeee390 0x564ffb2b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 --2- 172.21.15.80:0/3414131929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb2b6dd0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 >> 172.21.15.80:0/3414131929 conn(0x564ffaee24e0 msgr2=0x564ffb290ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f321d7fa640 0 client.6975 ms_handle_reset on v2:172.21.15.80:6835/231548395 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 shutdown_connections 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 1 -- 172.21.15.80:0/3414131929 wait complete. 2024-04-25T15:46:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.762+0000 7f324bbe5740 20 client.6975 trim_cache size 0 max 16384 2024-04-25T15:46:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.781+0000 7f324bbe5740 1 Processor -- start 2024-04-25T15:46:04.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.781+0000 7f324bbe5740 1 -- start start 2024-04-25T15:46:04.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb2bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb290600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f324bbe5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3240203750 con 0x564ffaeee390 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3240202770 con 0x564ffaec54d0 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f32401f74c0 con 0x564ffaecd6b0 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f323ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb290600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f323ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb290600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41286/0 (socket says 172.21.15.80:41286) 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.782+0000 7f323ed9d640 1 -- 172.21.15.80:0/2064975909 learned_addr learned my addr 172.21.15.80:0/2064975909 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323ed9d640 1 -- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 msgr2=0x564ffb2bced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323e59c640 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb2bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323ed9d640 1 -- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 msgr2=0x564ffb2bc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb2bc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323ed9d640 1 -- 172.21.15.80:0/2064975909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ffb28cf40 con 0x564ffaeee390 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323dd9b640 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f323ed9d640 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb290600 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f323800f090 tx=0x7f323802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a976247e70f06ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f321f7fe640 1 -- 172.21.15.80:0/2064975909 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238042070 con 0x564ffaeee390 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f321f7fe640 1 -- 172.21.15.80:0/2064975909 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3238004230 con 0x564ffaeee390 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.783+0000 7f321f7fe640 1 -- 172.21.15.80:0/2064975909 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238036040 con 0x564ffaeee390 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 -- 172.21.15.80:0/2064975909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 msgr2=0x564ffb290600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb290600 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f323800f090 tx=0x7f323802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 -- 172.21.15.80:0/2064975909 shutdown_connections 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaeee390 0x564ffb290600 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaecd6b0 0x564ffb2bced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 --2- 172.21.15.80:0/2064975909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaec54d0 0x564ffb2bc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 -- 172.21.15.80:0/2064975909 >> 172.21.15.80:0/2064975909 conn(0x564ffaee24e0 msgr2=0x564ffb28f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 -- 172.21.15.80:0/2064975909 shutdown_connections 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.784+0000 7f324bbe5740 1 -- 172.21.15.80:0/2064975909 wait complete. 2024-04-25T15:46:04.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.785+0000 7f324bbe5740 1 -- start start 2024-04-25T15:46:04.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.785+0000 7f324bbe5740 1 Processor -- start 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb290d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaecd6b0 0x564ffb2cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaeee390 0x564ffb2cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564ffb2d3b30 con 0x564ffaec54d0 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3240202120 con 0x564ffaecd6b0 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564ffb2b6be0 con 0x564ffaeee390 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f324bbe5740 10 client.0 _ll_register_callbacks cb 0x7f32300154c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f323e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb290d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f323e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb290d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41300/0 (socket says 172.21.15.80:41300) 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f323e59c640 1 -- 172.21.15.80:0/1146146318 learned_addr learned my addr 172.21.15.80:0/1146146318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f323ed9d640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaeee390 0x564ffb2cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f323e59c640 1 -- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaeee390 msgr2=0x564ffb2cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.786+0000 7f323e59c640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaeee390 0x564ffb2cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323e59c640 1 -- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaecd6b0 msgr2=0x564ffb2cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323dd9b640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaecd6b0 0x564ffb2cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323e59c640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaecd6b0 0x564ffb2cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323e59c640 1 -- 172.21.15.80:0/1146146318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ffb28b570 con 0x564ffaec54d0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323dd9b640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaecd6b0 0x564ffb2cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323e59c640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb290d80 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f323002c740 tx=0x7f3230020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429271dc2e9acf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f321d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f321d7fa640 1 -- 172.21.15.80:0/1146146318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323002cd30 con 0x564ffaec54d0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f321d7fa640 1 -- 172.21.15.80:0/1146146318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f323002a420 con 0x564ffaec54d0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3238004230 con 0x564ffaec54d0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f321d7fa640 1 -- 172.21.15.80:0/1146146318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3230048050 con 0x564ffaec54d0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 10 client.6981 fetch_fsmap learned FSMap version 35 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x564ffb28b000 con 0x564ffaec54d0 2024-04-25T15:46:04.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f321d7fa640 1 -- 172.21.15.80:0/1146146318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3238004230 con 0x564ffaec54d0 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f321d7fa640 1 -- 172.21.15.80:0/1146146318 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f323004b020 con 0x564ffaec54d0 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 10 client.6981 fetch_fsmap finished waiting for FSMap version 35 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 10 client.6981 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 20 client.6981 populate_metadata read hostname 'smithi080' 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffb2e3b80 0x564ffb2e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 4 client.6981 mds_command: new command op to 6684 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 --> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] -- command(tid 0: {"prefix": "session ls"}) -- 0x564ffb1fc800 con 0x564ffb2e3b80 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.787+0000 7f323dd9b640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffb2e3b80 0x564ffb2e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f321d7fa640 10 client.6981 ms_handle_connect on v2:172.21.15.80:6835/231548395 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f323dd9b640 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffb2e3b80 0x564ffb2e3f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c45b2e6d6b8306 server_cookie=8b4f8b87f96747c1 in_seq=0 out_seq=0 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f321d7fa640 1 -- 172.21.15.80:0/1146146318 <== mds.0 v2:172.21.15.80:6835/231548395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ffb1fc800 con 0x564ffb2e3b80 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f321d7fa640 10 client.6981 handle_command_reply: tid=0 2024-04-25T15:46:04.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 client.6981 shutdown 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 msgr2=0x564ffb290d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb290d80 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f323002c740 tx=0x7f3230020000 comp rx=0 tx=0).stop 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 shutdown_connections 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:6835/231548395,v1:172.21.15.80:6837/231548395] conn(0x564ffb2e3b80 0x564ffb2e3f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564ffaeee390 0x564ffb2cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ffaecd6b0 0x564ffb2cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f321d7fa640 0 client.6981 ms_handle_reset on v2:172.21.15.80:6835/231548395 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 --2- 172.21.15.80:0/1146146318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564ffaec54d0 0x564ffb290d80 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 >> 172.21.15.80:0/1146146318 conn(0x564ffaee24e0 msgr2=0x564ffb290600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 shutdown_connections 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.788+0000 7f324bbe5740 1 -- 172.21.15.80:0/1146146318 wait complete. 2024-04-25T15:46:04.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f324bbe5740 20 client.6981 trim_cache size 0 max 16384 2024-04-25T15:46:04.796 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32200744e0 msgr2=0x7f32200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32200744e0 0x7f32200769f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3240071df0 tx=0x7f3230006040 comp rx=0 tx=0).stop 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 msgr2=0x7f324009ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 0x7f324009ef40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3234011960 tx=0x7f3234011e20 comp rx=0 tx=0).stop 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 shutdown_connections 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32200744e0 0x7f32200769f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f324015bb20 0x7f324015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324009eb30 0x7f324009ef40 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 --2- 172.21.15.80:0/2108665594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3228004d40 0x7f3240155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 >> 172.21.15.80:0/2108665594 conn(0x7f3240073b50 msgr2=0x7f32400b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 shutdown_connections 2024-04-25T15:46:04.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:04.789+0000 7f3244c51640 1 -- 172.21.15.80:0/2108665594 wait complete. 2024-04-25T15:46:04.801 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-04-25T15:46:04.925 INFO:teuthology.orchestra.run.smithi080.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":69,"msgr_send_messages":63,"msgr_recv_bytes":122270,"msgr_send_bytes":17258,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.009236336,"msgr_running_send_time":0.002547673,"msgr_running_recv_time":0.009625382,"msgr_running_fast_dispatch_time":0.000458399,"msgr_send_messages_queue_lat":{"avgcount":63,"sum":0.059593712,"avgtime":0.000945931},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":119072,"msgr_send_encrypted_bytes":11712},"AsyncMessenger::Worker-1":{"msgr_recv_messages":43,"msgr_send_messages":47,"msgr_recv_bytes":10488,"msgr_send_bytes":159869,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.006764306,"msgr_running_send_time":0.001496645,"msgr_running_recv_time":0.005082372,"msgr_running_fast_dispatch_time":0.000308174,"msgr_send_messages_queue_lat":{"avgcount":46,"sum":0.056097839,"avgtime":0.001219518},"msgr_handle_ack_lat":{"avgcount":60,"sum":0.000009412,"avgtime":0.000000156},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":95520},"AsyncMessenger::Worker-2":{"msgr_recv_messages":40,"msgr_send_messages":36,"msgr_recv_bytes":11193,"msgr_send_bytes":23084,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.006045547,"msgr_running_send_time":0.000648509,"msgr_running_recv_time":0.004579069,"msgr_running_fast_dispatch_time":0.000765194,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.291659910,"avgtime":0.008333140},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000002481,"avgtime":0.000000177},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":36,"sum":0.004217367,"avgtime":0.000117149}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000011724,"avgtime":0.000005862}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.006426252,"avgtime":0.000221594},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197025,"rdpos":0,"jlat":{"avgcount":5,"sum":0.011186921,"avgtime":0.002237384},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":109712,"heap":231804},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.005601472,"avgtime":0.000215441},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000415465,"avgtime":0.000207732},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000409315,"avgtime":0.000409315},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":3,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":224237,"buffer_anon_items":80,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53424,"mds_co_items":217,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13931,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.967978190,"avgtime":0.021999504},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":74,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":146,"get_sum":126342,"get_or_fail_fail":0,"get_or_fail_success":146,"take":0,"take_sum":0,"put":146,"put_sum":126342,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13931,"put":44,"put_sum":13931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d36aa06820":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2721,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-25T15:46:04.926 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 122270, "msgr_recv_encrypted_bytes": 119072, "msgr_recv_messages": 69, "msgr_running_fast_dispatch_time": 0.000458399, "msgr_running_recv_time": 0.009625382, "msgr_running_send_time": 0.002547673, "msgr_running_total_time": 0.009236336, "msgr_send_bytes": 17258, "msgr_send_encrypted_bytes": 11712, "msgr_send_messages": 63, "msgr_send_messages_queue_lat": { "avgcount": 63, "avgtime": 0.000945931, "sum": 0.059593712 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 60, "avgtime": 1.56e-07, "sum": 9.412e-06 }, "msgr_recv_bytes": 10488, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 43, "msgr_running_fast_dispatch_time": 0.000308174, "msgr_running_recv_time": 0.005082372, "msgr_running_send_time": 0.001496645, "msgr_running_total_time": 0.006764306, "msgr_send_bytes": 159869, "msgr_send_encrypted_bytes": 95520, "msgr_send_messages": 47, "msgr_send_messages_queue_lat": { "avgcount": 46, "avgtime": 0.001219518, "sum": 0.056097839 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 1.77e-07, "sum": 2.481e-06 }, "msgr_recv_bytes": 11193, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.000765194, "msgr_running_recv_time": 0.004579069, "msgr_running_send_time": 0.000648509, "msgr_running_total_time": 0.006045547, "msgr_send_bytes": 23084, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.00833314, "sum": 0.29165991 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 36, "avgtime": 0.000117149, "sum": 0.004217367 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.862e-06, "sum": 1.1724e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000221594, "sum": 0.006426252 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002237384, "sum": 0.011186921 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197025 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 231804, "ino": 13, "ino+": 13, "ino-": 0, "rss": 109712 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000215441, "sum": 0.005601472 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000207732, "sum": 0.000415465 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000409315, "sum": 0.000409315 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 3, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 224237, "buffer_anon_items": 80, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53424, "mds_co_items": 217, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 74, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.021999504, "sum": 0.96797819 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13931, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 146, "get_or_fail_fail": 0, "get_or_fail_success": 146, "get_started": 0, "get_sum": 126342, "max": 104857600, "put": 146, "put_sum": 126342, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13931, "take": 44, "take_sum": 13931, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d36aa06820": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2721, "max": 3758096384, "put": 5, "put_sum": 2721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-25T15:46:04.926 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T15:46:04.927 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:46:04.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:04.966 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:05.010 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:46:05.010 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:05.010 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:05.010 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:05.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:05.026 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:05.026 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:05.026 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:05.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:05.070 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:05.070 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:05.071 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:05.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:05.086 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:05.086 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:05.086 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:05.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:05.128 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:05.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.236+0000 7f12fc427640 1 Processor -- start 2024-04-25T15:46:05.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.236+0000 7f12fc427640 1 -- start start 2024-04-25T15:46:05.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.237+0000 7f12fc427640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 0x7f12f40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12fc427640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f4071df0 con 0x7f12f406db10 2024-04-25T15:46:05.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12fc427640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f41589c0 con 0x7f12f415ff80 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12fc427640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f12f415faf0 con 0x7f12f40714a0 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12fa1c3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f12f406db10 0x7f12f415e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42220/0 (socket says 172.21.15.80:42220) 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12fa1c3640 1 -- 172.21.15.80:0/916658137 learned_addr learned my addr 172.21.15.80:0/916658137 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f99c2640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 0x7f12f40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529212234 0 0) 0x7f12f0001490 con 0x7f12f406db10 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e0003520 con 0x7f12f406db10 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2641011612 0 0) 0x7f12e0003520 con 0x7f12f406db10 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 msgr2=0x7f12f40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 0x7f12f40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 >> v1:172.21.15.195:6789/0 conn(0x7f12f415ff80 legacy=0x7f12f4160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f415ee90 con 0x7f12f406db10 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f12f0001bc0 con 0x7f12f406db10 2024-04-25T15:46:05.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 >> v1:172.21.15.80:6789/0 conn(0x7f12f406db10 legacy=0x7f12f415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e00039e0 0x7f12e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e0004800 0x7f12e0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 0x7f12e0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415faf0 con 0x7f12e0004800 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f12e000baa0 con 0x7f12e00039e0 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f12e000bca0 con 0x7f12f40714a0 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.238+0000 7f12f99c2640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e0004800 0x7f12e0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12fa1c3640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e00039e0 0x7f12e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12fa9c4640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 0x7f12e0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12f99c2640 1 -- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 msgr2=0x7f12e0005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12f99c2640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40714a0 0x7f12e0005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12f99c2640 1 -- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e00039e0 msgr2=0x7f12e0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12f99c2640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e00039e0 0x7f12e0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12f99c2640 1 -- 172.21.15.80:0/916658137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e0003520 con 0x7f12e0004800 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12fa1c3640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e00039e0 0x7f12e0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.239+0000 7f12f99c2640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e0004800 0x7f12e0004c10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f12f40d3090 tx=0x7f12e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4619508137bf91f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4036070 con 0x7f12e0004800 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e4031400 con 0x7f12e0004800 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12f91c1640 1 -- 172.21.15.80:0/916658137 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4009690 con 0x7f12e0004800 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fc427640 1 -- 172.21.15.80:0/916658137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e0004800 msgr2=0x7f12e0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fc427640 1 --2- 172.21.15.80:0/916658137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12e0004800 0x7f12e0004c10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f12f40d3090 tx=0x7f12e0005830 comp rx=0 tx=0).stop 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fa9c4640 1 -- 172.21.15.80:0/916658137 reap_dead start 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fc427640 1 -- 172.21.15.80:0/916658137 shutdown_connections 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fc427640 1 -- 172.21.15.80:0/916658137 >> 172.21.15.80:0/916658137 conn(0x7f12f40d2080 msgr2=0x7f12f40d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fc427640 1 -- 172.21.15.80:0/916658137 shutdown_connections 2024-04-25T15:46:05.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.240+0000 7f12fc427640 1 -- 172.21.15.80:0/916658137 wait complete. 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.242+0000 7f12fc427640 1 Processor -- start 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.242+0000 7f12fc427640 1 -- start start 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12fc427640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e0004800 0x7f12f4147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12fc427640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 0x7f12f41461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12fc427640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40b0540 0x7f12f41f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12fc427640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415f780 con 0x7f12f40b0130 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12fc427640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415ec30 con 0x7f12e0004800 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12fc427640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f12f415f450 con 0x7f12f40b0540 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12f99c2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 0x7f12f41461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12f99c2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 0x7f12f41461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41318/0 (socket says 172.21.15.80:41318) 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.243+0000 7f12f99c2640 1 -- 172.21.15.80:0/370563976 learned_addr learned my addr 172.21.15.80:0/370563976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:05.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12fa9c4640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40b0540 0x7f12f41f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12fa1c3640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e0004800 0x7f12f4147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12f99c2640 1 -- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40b0540 msgr2=0x7f12f41f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12f99c2640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40b0540 0x7f12f41f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12f99c2640 1 -- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e0004800 msgr2=0x7f12f4147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12f99c2640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e0004800 0x7f12f4147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12f99c2640 1 -- 172.21.15.80:0/370563976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41455d0 con 0x7f12f40b0130 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12fa1c3640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e0004800 0x7f12f4147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12f99c2640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 0x7f12f41461e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009b80 tx=0x7f12e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4041020 con 0x7f12f40b0130 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e403c470 con 0x7f12f40b0130 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f4146d80 con 0x7f12f40b0130 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4036040 con 0x7f12f40b0130 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.244+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f4147340 con 0x7f12f40b0130 2024-04-25T15:46:05.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.245+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f406a100 con 0x7f12f40b0130 2024-04-25T15:46:05.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.246+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f12e4044020 con 0x7f12f40b0130 2024-04-25T15:46:05.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.246+0000 7f12eaffd640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12d80744e0 0x7f12d80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.246+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f12e40b5c00 con 0x7f12f40b0130 2024-04-25T15:46:05.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.246+0000 7f12fa1c3640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12d80744e0 0x7f12d80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.247+0000 7f12fa1c3640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12d80744e0 0x7f12d80769f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f12f0001750 tx=0x7f12f0001250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.251+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12e40bc080 con 0x7f12f40b0130 2024-04-25T15:46:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.462+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12f415e0f0 con 0x7f12f40b0130 2024-04-25T15:46:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.463+0000 7f12eaffd640 1 -- 172.21.15.80:0/370563976 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7f12e404b030 con 0x7f12f40b0130 2024-04-25T15:46:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:05.464 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:46:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12d80744e0 msgr2=0x7f12d80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12d80744e0 0x7f12d80769f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f12f0001750 tx=0x7f12f0001250 comp rx=0 tx=0).stop 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 msgr2=0x7f12f41461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 0x7f12f41461e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009b80 tx=0x7f12e4004730 comp rx=0 tx=0).stop 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 shutdown_connections 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f12d80744e0 0x7f12d80769f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f12f40b0540 0x7f12f41f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f40b0130 0x7f12f41461e0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 --2- 172.21.15.80:0/370563976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12e0004800 0x7f12f4147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 >> 172.21.15.80:0/370563976 conn(0x7f12f40d2080 msgr2=0x7f12f406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 shutdown_connections 2024-04-25T15:46:05.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.465+0000 7f12fc427640 1 -- 172.21.15.80:0/370563976 wait complete. 2024-04-25T15:46:05.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:05.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.583+0000 7f9d6c449640 1 Processor -- start 2024-04-25T15:46:05.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.583+0000 7f9d6c449640 1 -- start start 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6c449640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d640d41b0 0x7f9d640b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6c449640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9d641602a0 0x7f9d640b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6c449640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d640b7b90 0x7f9d640d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6c449640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9d640b7fa0 con 0x7f9d640b7b90 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6c449640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9d64163fb0 con 0x7f9d641602a0 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6c449640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d64164270 con 0x7f9d640d41b0 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6a9e6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d640b7b90 0x7f9d640d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6a9e6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d640b7b90 0x7f9d640d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41326/0 (socket says 172.21.15.80:41326) 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6a9e6640 1 -- 172.21.15.80:0/2366169609 learned_addr learned my addr 172.21.15.80:0/2366169609 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d6a1e5640 1 --2- 172.21.15.80:0/2366169609 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d640d41b0 0x7f9d640b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.584+0000 7f9d699e4640 1 --2- 172.21.15.80:0/2366169609 >> v2:172.21.15.195:3300/0 conn(0x7f9d641602a0 0x7f9d640b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.585+0000 7f9d6a9e6640 1 -- 172.21.15.80:0/2366169609 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d640d41b0 msgr2=0x7f9d640b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.585+0000 7f9d6a9e6640 1 --2- 172.21.15.80:0/2366169609 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d640d41b0 0x7f9d640b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.585+0000 7f9d6a9e6640 1 -- 172.21.15.80:0/2366169609 >> v2:172.21.15.195:3300/0 conn(0x7f9d641602a0 msgr2=0x7f9d640b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.585+0000 7f9d6a9e6640 1 --2- 172.21.15.80:0/2366169609 >> v2:172.21.15.195:3300/0 conn(0x7f9d641602a0 0x7f9d640b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.585+0000 7f9d6a9e6640 1 -- 172.21.15.80:0/2366169609 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d64164550 con 0x7f9d640b7b90 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.585+0000 7f9d6a9e6640 1 --2- 172.21.15.80:0/2366169609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d640d0980 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9d6408e170 tx=0x7f9d5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732716feca12e113 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d691e3640 1 -- 172.21.15.80:0/2366169609 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c037070 con 0x7f9d640b7b90 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d691e3640 1 -- 172.21.15.80:0/2366169609 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c032440 con 0x7f9d640b7b90 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d691e3640 1 -- 172.21.15.80:0/2366169609 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c032810 con 0x7f9d640b7b90 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 -- 172.21.15.80:0/2366169609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 msgr2=0x7f9d640d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 --2- 172.21.15.80:0/2366169609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d640d0980 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9d6408e170 tx=0x7f9d5c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 -- 172.21.15.80:0/2366169609 shutdown_connections 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 --2- 172.21.15.80:0/2366169609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d640d0980 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 --2- 172.21.15.80:0/2366169609 >> v2:172.21.15.195:3300/0 conn(0x7f9d641602a0 0x7f9d640b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 --2- 172.21.15.80:0/2366169609 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d640d41b0 0x7f9d640b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 -- 172.21.15.80:0/2366169609 >> 172.21.15.80:0/2366169609 conn(0x7f9d6406e9f0 msgr2=0x7f9d640d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 -- 172.21.15.80:0/2366169609 shutdown_connections 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.586+0000 7f9d6c449640 1 -- 172.21.15.80:0/2366169609 wait complete. 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.588+0000 7f9d6c449640 1 Processor -- start 2024-04-25T15:46:05.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.588+0000 7f9d6c449640 1 -- start start 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6c449640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d6414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6c449640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d640d41b0 0x7f9d6414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6c449640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d641602a0 0x7f9d640c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6c449640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9d640b4fd0 con 0x7f9d640b7b90 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6c449640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64164b10 con 0x7f9d640d41b0 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6c449640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d640b5150 con 0x7f9d641602a0 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.589+0000 7f9d6a1e5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d6414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d6414dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41340/0 (socket says 172.21.15.80:41340) 2024-04-25T15:46:05.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 -- 172.21.15.80:0/473493455 learned_addr learned my addr 172.21.15.80:0/473493455 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d699e4640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d640d41b0 0x7f9d6414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a9e6640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d641602a0 0x7f9d640c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 -- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d641602a0 msgr2=0x7f9d640c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d641602a0 0x7f9d640c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 -- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d640d41b0 msgr2=0x7f9d6414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d640d41b0 0x7f9d6414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 -- 172.21.15.80:0/473493455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d64159450 con 0x7f9d640b7b90 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d699e4640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d640d41b0 0x7f9d6414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a9e6640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d641602a0 0x7f9d640c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6a1e5640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d6414dbc0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000eed0 tx=0x7f9d6000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60018020 con 0x7f9d640b7b90 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6000bd90 con 0x7f9d640b7b90 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d64159730 con 0x7f9d640b7b90 2024-04-25T15:46:05.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60014620 con 0x7f9d640b7b90 2024-04-25T15:46:05.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.590+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d64159cf0 con 0x7f9d640b7b90 2024-04-25T15:46:05.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.591+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6406a100 con 0x7f9d640b7b90 2024-04-25T15:46:05.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.592+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9d60005d10 con 0x7f9d640b7b90 2024-04-25T15:46:05.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.592+0000 7f9d5affd640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d480744e0 0x7f9d480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.592+0000 7f9d699e4640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d480744e0 0x7f9d480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.592+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f9d60095c60 con 0x7f9d640b7b90 2024-04-25T15:46:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.593+0000 7f9d699e4640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d480744e0 0x7f9d480769f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9d640b4830 tx=0x7f9d54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.597+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d60022070 con 0x7f9d640b7b90 2024-04-25T15:46:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.773+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d640d3070 con 0x7f9d640b7b90 2024-04-25T15:46:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.774+0000 7f9d5affd640 1 -- 172.21.15.80:0/473493455 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16933 (secure 0 0 0) 0x7f9d60060260 con 0x7f9d640b7b90 2024-04-25T15:46:05.775 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:05.776 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:50.027676+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d480744e0 msgr2=0x7f9d480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d480744e0 0x7f9d480769f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9d640b4830 tx=0x7f9d54008040 comp rx=0 tx=0).stop 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 msgr2=0x7f9d6414dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d6414dbc0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000eed0 tx=0x7f9d6000b480 comp rx=0 tx=0).stop 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 shutdown_connections 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d480744e0 0x7f9d480769f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d641602a0 0x7f9d640c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d640d41b0 0x7f9d6414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 --2- 172.21.15.80:0/473493455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d640b7b90 0x7f9d6414dbc0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.776+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 >> 172.21.15.80:0/473493455 conn(0x7f9d6406e9f0 msgr2=0x7f9d640ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.777+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 shutdown_connections 2024-04-25T15:46:05.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.777+0000 7f9d6c449640 1 -- 172.21.15.80:0/473493455 wait complete. 2024-04-25T15:46:05.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:45:46.643187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:45:47.329997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:05.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:05.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.899+0000 7f656f884640 1 Processor -- start 2024-04-25T15:46:05.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.899+0000 7f656f884640 1 -- start start 2024-04-25T15:46:05.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.900+0000 7f656f884640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f65681618b0 0x7f65680b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656f884640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65680d26a0 0x7f65680cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656f884640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65680b2b00 con 0x7f656806c5c0 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656f884640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f656806cb80 con 0x7f65680d26a0 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656f884640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f656806ce60 con 0x7f65681618b0 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656de21640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65680d26a0 0x7f65680cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656ce1f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f656806c5c0 0x7f65680d1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42226/0 (socket says 172.21.15.80:42226) 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656de21640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65680d26a0 0x7f65680cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41354/0 (socket says 172.21.15.80:41354) 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656ce1f640 1 -- 172.21.15.80:0/2010711432 learned_addr learned my addr 172.21.15.80:0/2010711432 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656d620640 1 --2- 172.21.15.80:0/2010711432 >> v2:172.21.15.195:3300/0 conn(0x7f65681618b0 0x7f65680b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656de21640 1 -- 172.21.15.80:0/2010711432 >> v2:172.21.15.195:3300/0 conn(0x7f65681618b0 msgr2=0x7f65680b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656de21640 1 --2- 172.21.15.80:0/2010711432 >> v2:172.21.15.195:3300/0 conn(0x7f65681618b0 0x7f65680b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656de21640 1 -- 172.21.15.80:0/2010711432 >> v1:172.21.15.80:6789/0 conn(0x7f656806c5c0 legacy=0x7f65680d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f655ffff640 1 -- 172.21.15.80:0/2010711432 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899486654 0 0) 0x7f6558001110 con 0x7f656806c5c0 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656de21640 1 -- 172.21.15.80:0/2010711432 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65680b2d80 con 0x7f65680d26a0 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.901+0000 7f656d620640 1 --2- 172.21.15.80:0/2010711432 >> v2:172.21.15.195:3300/0 conn(0x7f65681618b0 0x7f65680b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.902+0000 7f656de21640 1 --2- 172.21.15.80:0/2010711432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65680d26a0 0x7f65680cf530 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f65680b3bc0 tx=0x7f656002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6f4cae2c6be1f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.902+0000 7f655ffff640 1 -- 172.21.15.80:0/2010711432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560037070 con 0x7f65680d26a0 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.902+0000 7f655ffff640 1 -- 172.21.15.80:0/2010711432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6560032440 con 0x7f65680d26a0 2024-04-25T15:46:05.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.902+0000 7f655ffff640 1 -- 172.21.15.80:0/2010711432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560032810 con 0x7f65680d26a0 2024-04-25T15:46:05.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.902+0000 7f656f884640 1 -- 172.21.15.80:0/2010711432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65680d26a0 msgr2=0x7f65680cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.902+0000 7f656f884640 1 --2- 172.21.15.80:0/2010711432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65680d26a0 0x7f65680cf530 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f65680b3bc0 tx=0x7f656002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.903+0000 7f656f884640 1 -- 172.21.15.80:0/2010711432 shutdown_connections 2024-04-25T15:46:05.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.903+0000 7f656f884640 1 --2- 172.21.15.80:0/2010711432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65680d26a0 0x7f65680cf530 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.903+0000 7f656f884640 1 --2- 172.21.15.80:0/2010711432 >> v2:172.21.15.195:3300/0 conn(0x7f65681618b0 0x7f65680b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.903+0000 7f656f884640 1 -- 172.21.15.80:0/2010711432 >> 172.21.15.80:0/2010711432 conn(0x7f656809b410 msgr2=0x7f65680b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.903+0000 7f656f884640 1 -- 172.21.15.80:0/2010711432 shutdown_connections 2024-04-25T15:46:05.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.903+0000 7f656f884640 1 -- 172.21.15.80:0/2010711432 wait complete. 2024-04-25T15:46:05.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.904+0000 7f656f884640 1 Processor -- start 2024-04-25T15:46:05.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.904+0000 7f656f884640 1 -- start start 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 0x7f65681505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656815c8b0 0x7f65680cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65680ce110 0x7f65680cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65680cc670 con 0x7f656806c5c0 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6568076270 con 0x7f656815c8b0 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65680cc7f0 con 0x7f65680ce110 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 0x7f65681505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 0x7f65681505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41360/0 (socket says 172.21.15.80:41360) 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 -- 172.21.15.80:0/323799039 learned_addr learned my addr 172.21.15.80:0/323799039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656de21640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65680ce110 0x7f65680cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656ce1f640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656815c8b0 0x7f65680cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 -- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65680ce110 msgr2=0x7f65680cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65680ce110 0x7f65680cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 -- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656815c8b0 msgr2=0x7f65680cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656815c8b0 0x7f65680cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 -- 172.21.15.80:0/323799039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65680ce520 con 0x7f656806c5c0 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656de21640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65680ce110 0x7f65680cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656ce1f640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656815c8b0 0x7f65680cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656d620640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 0x7f65681505a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f656400cde0 tx=0x7f656400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400f680 con 0x7f656806c5c0 2024-04-25T15:46:05.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656400f820 con 0x7f656806c5c0 2024-04-25T15:46:05.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6568150cc0 con 0x7f656806c5c0 2024-04-25T15:46:05.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.906+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400fc10 con 0x7f656806c5c0 2024-04-25T15:46:05.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.907+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65680c6a00 con 0x7f656806c5c0 2024-04-25T15:46:05.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.907+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656806a100 con 0x7f656806c5c0 2024-04-25T15:46:05.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.908+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6564018400 con 0x7f656806c5c0 2024-04-25T15:46:05.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.909+0000 7f655dffb640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.909+0000 7f656ce1f640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.909+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f6564096190 con 0x7f656806c5c0 2024-04-25T15:46:05.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.909+0000 7f656ce1f640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6558000f60 tx=0x7f6558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:05.913+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65680ce520 con 0x7f656806c5c0 2024-04-25T15:46:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.087+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f65680b3ec0 con 0x7f656806c5c0 2024-04-25T15:46:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.087+0000 7f655dffb640 1 -- 172.21.15.80:0/323799039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f6564014030 con 0x7f656806c5c0 2024-04-25T15:46:06.088 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:06.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 msgr2=0x7f654c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6558000f60 tx=0x7f6558009040 comp rx=0 tx=0).stop 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 msgr2=0x7f65681505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 0x7f65681505a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f656400cde0 tx=0x7f656400a650 comp rx=0 tx=0).stop 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 shutdown_connections 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65680ce110 0x7f65680cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656815c8b0 0x7f65680cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 --2- 172.21.15.80:0/323799039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f656806c5c0 0x7f65681505a0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 >> 172.21.15.80:0/323799039 conn(0x7f656809b410 msgr2=0x7f65680b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 shutdown_connections 2024-04-25T15:46:06.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.089+0000 7f656f884640 1 -- 172.21.15.80:0/323799039 wait complete. 2024-04-25T15:46:06.102 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.212+0000 7f29a25a8640 1 Processor -- start 2024-04-25T15:46:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.212+0000 7f29a25a8640 1 -- start start 2024-04-25T15:46:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.213+0000 7f29a25a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f299c06dce0 0x7f299c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.213+0000 7f29a25a8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f299c0b0ca0 0x7f299c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.213+0000 7f29a25a8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299c0b4850 con 0x7f299c15cc80 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.213+0000 7f29a25a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f299c0d1620 con 0x7f299c06dce0 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.213+0000 7f29a25a8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f299c0b5460 con 0x7f299c0b0ca0 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.213+0000 7f299b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f299c06dce0 0x7f299c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f299c15cc80 0x7f299c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42236/0 (socket says 172.21.15.80:42236) 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f299c06dce0 0x7f299c0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41362/0 (socket says 172.21.15.80:41362) 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299bfff640 1 -- 172.21.15.80:0/774788684 learned_addr learned my addr 172.21.15.80:0/774788684 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f29a0b45640 1 --2- 172.21.15.80:0/774788684 >> v2:172.21.15.195:3300/0 conn(0x7f299c0b0ca0 0x7f299c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299b7fe640 1 -- 172.21.15.80:0/774788684 >> v2:172.21.15.195:3300/0 conn(0x7f299c0b0ca0 msgr2=0x7f299c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299b7fe640 1 --2- 172.21.15.80:0/774788684 >> v2:172.21.15.195:3300/0 conn(0x7f299c0b0ca0 0x7f299c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299b7fe640 1 -- 172.21.15.80:0/774788684 >> v1:172.21.15.80:6789/0 conn(0x7f299c15cc80 legacy=0x7f299c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299b7fe640 1 -- 172.21.15.80:0/774788684 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c0b4b30 con 0x7f299c06dce0 2024-04-25T15:46:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.214+0000 7f299affd640 1 -- 172.21.15.80:0/774788684 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586671089 0 0) 0x7f299c0b4850 con 0x7f299c15cc80 2024-04-25T15:46:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f299b7fe640 1 --2- 172.21.15.80:0/774788684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c06dce0 0x7f299c0b0760 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f299c074410 tx=0x7f299002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babd7c46f1610e43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f299affd640 1 -- 172.21.15.80:0/774788684 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990037070 con 0x7f299c06dce0 2024-04-25T15:46:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f299affd640 1 -- 172.21.15.80:0/774788684 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2990032440 con 0x7f299c06dce0 2024-04-25T15:46:06.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f299affd640 1 -- 172.21.15.80:0/774788684 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990032810 con 0x7f299c06dce0 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 -- 172.21.15.80:0/774788684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c06dce0 msgr2=0x7f299c0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 --2- 172.21.15.80:0/774788684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c06dce0 0x7f299c0b0760 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f299c074410 tx=0x7f299002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 -- 172.21.15.80:0/774788684 shutdown_connections 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 --2- 172.21.15.80:0/774788684 >> v2:172.21.15.195:3300/0 conn(0x7f299c0b0ca0 0x7f299c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 --2- 172.21.15.80:0/774788684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c06dce0 0x7f299c0b0760 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 -- 172.21.15.80:0/774788684 >> 172.21.15.80:0/774788684 conn(0x7f299c0734b0 msgr2=0x7f299c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 -- 172.21.15.80:0/774788684 shutdown_connections 2024-04-25T15:46:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.215+0000 7f29a25a8640 1 -- 172.21.15.80:0/774788684 wait complete. 2024-04-25T15:46:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.217+0000 7f29a25a8640 1 Processor -- start 2024-04-25T15:46:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.217+0000 7f29a25a8640 1 -- start start 2024-04-25T15:46:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f299c0b0ca0 0x7f299c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f299c15cc80 0x7f299c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 0x7f299c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f299c15d090 con 0x7f299c151460 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f299c0b50f0 con 0x7f299c15cc80 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f299c0b10b0 con 0x7f299c0b0ca0 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 0x7f299c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 0x7f299c157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41372/0 (socket says 172.21.15.80:41372) 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 -- 172.21.15.80:0/1397652302 learned_addr learned my addr 172.21.15.80:0/1397652302 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f299bfff640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f299c0b0ca0 0x7f299c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f299b7fe640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f299c15cc80 0x7f299c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 -- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f299c0b0ca0 msgr2=0x7f299c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f299c0b0ca0 0x7f299c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 -- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f299c15cc80 msgr2=0x7f299c155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f299c15cc80 0x7f299c155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 -- 172.21.15.80:0/1397652302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c15dd20 con 0x7f299c151460 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f299bfff640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f299c0b0ca0 0x7f299c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f299b7fe640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f299c15cc80 0x7f299c155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a0b45640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 0x7f299c157b80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2994007e90 tx=0x7f299400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994014420 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2994019070 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c1553c0 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994014800 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.219+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c156630 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.220+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c06a100 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.221+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f29940149a0 con 0x7f299c151460 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.221+0000 7f2998ff9640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29880744b0 0x7f29880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.221+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f2994095b00 con 0x7f299c151460 2024-04-25T15:46:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.221+0000 7f299bfff640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29880744b0 0x7f29880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.222+0000 7f299bfff640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29880744b0 0x7f29880769c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f298c000f60 tx=0x7f298c007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.226+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f299405fbd0 con 0x7f299c151460 2024-04-25T15:46:06.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.402+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f299c0d1020 con 0x7f299c151460 2024-04-25T15:46:06.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.403+0000 7f2998ff9640 1 -- 172.21.15.80:0/1397652302 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f2994068210 con 0x7f299c151460 2024-04-25T15:46:06.404 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.404+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29880744b0 msgr2=0x7f29880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.404+0000 7f29a25a8640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29880744b0 0x7f29880769c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f298c000f60 tx=0x7f298c007ca0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.404+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 msgr2=0x7f299c157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.404+0000 7f29a25a8640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 0x7f299c157b80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2994007e90 tx=0x7f299400e4b0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 shutdown_connections 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29880744b0 0x7f29880769c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f299c151460 0x7f299c157b80 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f299c15cc80 0x7f299c155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 --2- 172.21.15.80:0/1397652302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f299c0b0ca0 0x7f299c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 >> 172.21.15.80:0/1397652302 conn(0x7f299c0734b0 msgr2=0x7f299c158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 shutdown_connections 2024-04-25T15:46:06.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.405+0000 7f29a25a8640 1 -- 172.21.15.80:0/1397652302 wait complete. 2024-04-25T15:46:06.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.526+0000 7f49c8a20640 1 Processor -- start 2024-04-25T15:46:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.526+0000 7f49c8a20640 1 -- start start 2024-04-25T15:46:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c8a20640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f49c40cebe0 0x7f49c40cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c8a20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c8a20640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c40b3650 con 0x7f49c40b2550 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c8a20640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40b2a40 con 0x7f49c40cebe0 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c8a20640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f49c40b2d20 con 0x7f49c40b2140 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c259c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f49c40cebe0 0x7f49c40cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c1d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c259c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f49c40cebe0 0x7f49c40cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:33310/0 (socket says 172.21.15.80:33310) 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c259c640 1 -- 172.21.15.80:0/3816238664 learned_addr learned my addr 172.21.15.80:0/3816238664 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.527+0000 7f49c1d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40d1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:57990/0 (socket says 172.21.15.80:57990) 2024-04-25T15:46:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.528+0000 7f49c259c640 1 -- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 msgr2=0x7f49c40d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.528+0000 7f49c259c640 1 --2- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.528+0000 7f49c259c640 1 -- 172.21.15.80:0/3816238664 >> v1:172.21.15.195:6789/0 conn(0x7f49c40b2550 legacy=0x7f49c40d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.528+0000 7f49c259c640 1 -- 172.21.15.80:0/3816238664 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40b3000 con 0x7f49c40cebe0 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.528+0000 7f49c1d9b640 1 --2- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.529+0000 7f49c259c640 1 --2- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c40cf760 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009e50 tx=0x7f49b402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1316396d63cff762 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.529+0000 7f49c159a640 1 -- 172.21.15.80:0/3816238664 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4036070 con 0x7f49c40cebe0 2024-04-25T15:46:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.529+0000 7f49c159a640 1 -- 172.21.15.80:0/3816238664 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b4031600 con 0x7f49c40cebe0 2024-04-25T15:46:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.529+0000 7f49c159a640 1 -- 172.21.15.80:0/3816238664 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40319d0 con 0x7f49c40cebe0 2024-04-25T15:46:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.529+0000 7f49c8a20640 1 -- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 msgr2=0x7f49c40cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.529+0000 7f49c8a20640 1 --2- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c40cf760 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009e50 tx=0x7f49b402a710 comp rx=0 tx=0).stop 2024-04-25T15:46:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.530+0000 7f49c8a20640 1 -- 172.21.15.80:0/3816238664 shutdown_connections 2024-04-25T15:46:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.530+0000 7f49c8a20640 1 --2- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.530+0000 7f49c8a20640 1 --2- 172.21.15.80:0/3816238664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c40cf760 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.530+0000 7f49c8a20640 1 -- 172.21.15.80:0/3816238664 >> 172.21.15.80:0/3816238664 conn(0x7f49c40b75f0 msgr2=0x7f49c40b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.530+0000 7f49c8a20640 1 -- 172.21.15.80:0/3816238664 shutdown_connections 2024-04-25T15:46:06.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.530+0000 7f49c8a20640 1 -- 172.21.15.80:0/3816238664 wait complete. 2024-04-25T15:46:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.532+0000 7f49c8a20640 1 Processor -- start 2024-04-25T15:46:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.532+0000 7f49c8a20640 1 -- start start 2024-04-25T15:46:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c8a20640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c8a20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 0x7f49c40cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c8a20640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c4158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c8a20640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40b4d40 con 0x7f49c40b2550 2024-04-25T15:46:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c8a20640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40b4bc0 con 0x7f49c40cebe0 2024-04-25T15:46:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c8a20640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f49c40b4ec0 con 0x7f49c40b2140 2024-04-25T15:46:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 0x7f49c40cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 0x7f49c40cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41384/0 (socket says 172.21.15.80:41384) 2024-04-25T15:46:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 -- 172.21.15.80:0/275273181 learned_addr learned my addr 172.21.15.80:0/275273181 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c259c640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c2d9d640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c4158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 -- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 msgr2=0x7f49c40ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 -- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 msgr2=0x7f49c4158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c4158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.533+0000 7f49c1d9b640 1 -- 172.21.15.80:0/275273181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40ca8e0 con 0x7f49c40b2550 2024-04-25T15:46:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.534+0000 7f49c1d9b640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 0x7f49c40cbb50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f49b800e960 tx=0x7f49b800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.534+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8017070 con 0x7f49c40b2550 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.534+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b800ca00 con 0x7f49c40b2550 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.534+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c40cadf0 con 0x7f49c40b2550 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.534+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b800cdd0 con 0x7f49c40b2550 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.534+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c40afa70 con 0x7f49c40b2550 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.535+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c40cab60 con 0x7f49c40b2550 2024-04-25T15:46:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.536+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f49b801a070 con 0x7f49c40b2550 2024-04-25T15:46:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.536+0000 7f49b2ffd640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49a40744b0 0x7f49a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.536+0000 7f49c259c640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49a40744b0 0x7f49a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.536+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f49b8095260 con 0x7f49c40b2550 2024-04-25T15:46:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.537+0000 7f49c259c640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49a40744b0 0x7f49a40769c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f49b4033000 tx=0x7f49b4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.541+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49b805f8f0 con 0x7f49c40b2550 2024-04-25T15:46:06.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.715+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f49c4071bf0 con 0x7f49c40b2550 2024-04-25T15:46:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.716+0000 7f49b2ffd640 1 -- 172.21.15.80:0/275273181 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f49c4071bf0 con 0x7f49c40b2550 2024-04-25T15:46:06.717 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49a40744b0 msgr2=0x7f49a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49a40744b0 0x7f49a40769c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f49b4033000 tx=0x7f49b4009000 comp rx=0 tx=0).stop 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 msgr2=0x7f49c40cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 0x7f49c40cbb50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f49b800e960 tx=0x7f49b800ee20 comp rx=0 tx=0).stop 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 shutdown_connections 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f49a40744b0 0x7f49a40769c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49c40cebe0 0x7f49c4158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49c40b2550 0x7f49c40cbb50 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 --2- 172.21.15.80:0/275273181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49c40b2140 0x7f49c40ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 >> 172.21.15.80:0/275273181 conn(0x7f49c40b75f0 msgr2=0x7f49c40714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 shutdown_connections 2024-04-25T15:46:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.718+0000 7f49c8a20640 1 -- 172.21.15.80:0/275273181 wait complete. 2024-04-25T15:46:06.730 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.836+0000 7f4270a6e640 1 Processor -- start 2024-04-25T15:46:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.836+0000 7f4270a6e640 1 -- start start 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.837+0000 7f4270a6e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f426c0b91c0 0x7f426c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.837+0000 7f4270a6e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f426c0d2480 0x7f426c0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.837+0000 7f4270a6e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426c0b2f30 con 0x7f426c0b4b60 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.837+0000 7f4270a6e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f426c06eb60 con 0x7f426c0d2480 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.837+0000 7f4270a6e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f426c0b2c90 con 0x7f426c0b91c0 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426a59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f426c0b4b60 0x7f426c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42240/0 (socket says 172.21.15.80:42240) 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426a59c640 1 -- 172.21.15.80:0/2527715616 learned_addr learned my addr 172.21.15.80:0/2527715616 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426ad9d640 1 --2- 172.21.15.80:0/2527715616 >> v2:172.21.15.80:3300/0 conn(0x7f426c0d2480 0x7f426c0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f4269d9b640 1 --2- 172.21.15.80:0/2527715616 >> v2:172.21.15.195:3300/0 conn(0x7f426c0b91c0 0x7f426c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426ad9d640 1 -- 172.21.15.80:0/2527715616 >> v2:172.21.15.195:3300/0 conn(0x7f426c0b91c0 msgr2=0x7f426c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426ad9d640 1 --2- 172.21.15.80:0/2527715616 >> v2:172.21.15.195:3300/0 conn(0x7f426c0b91c0 0x7f426c0d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426ad9d640 1 -- 172.21.15.80:0/2527715616 >> v1:172.21.15.80:6789/0 conn(0x7f426c0b4b60 legacy=0x7f426c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426ad9d640 1 -- 172.21.15.80:0/2527715616 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c0d10a0 con 0x7f426c0d2480 2024-04-25T15:46:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.838+0000 7f426959a640 1 -- 172.21.15.80:0/2527715616 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721446574 0 0) 0x7f426c0b2f30 con 0x7f426c0b4b60 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.839+0000 7f426ad9d640 1 --2- 172.21.15.80:0/2527715616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0d2480 0x7f426c0d2890 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4264009d90 tx=0x7f426402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334f23d7d4389c5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.839+0000 7f426959a640 1 -- 172.21.15.80:0/2527715616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264031600 con 0x7f426c0d2480 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.839+0000 7f426959a640 1 -- 172.21.15.80:0/2527715616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640317a0 con 0x7f426c0d2480 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.839+0000 7f426959a640 1 -- 172.21.15.80:0/2527715616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264031b70 con 0x7f426c0d2480 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.839+0000 7f4270a6e640 1 -- 172.21.15.80:0/2527715616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0d2480 msgr2=0x7f426c0d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.839+0000 7f4270a6e640 1 --2- 172.21.15.80:0/2527715616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0d2480 0x7f426c0d2890 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4264009d90 tx=0x7f426402a610 comp rx=0 tx=0).stop 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.840+0000 7f4270a6e640 1 -- 172.21.15.80:0/2527715616 shutdown_connections 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.840+0000 7f4270a6e640 1 --2- 172.21.15.80:0/2527715616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0d2480 0x7f426c0d2890 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.840+0000 7f4270a6e640 1 --2- 172.21.15.80:0/2527715616 >> v2:172.21.15.195:3300/0 conn(0x7f426c0b91c0 0x7f426c0d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.840+0000 7f4270a6e640 1 -- 172.21.15.80:0/2527715616 >> 172.21.15.80:0/2527715616 conn(0x7f426c0d0450 msgr2=0x7f426c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.840+0000 7f4270a6e640 1 -- 172.21.15.80:0/2527715616 shutdown_connections 2024-04-25T15:46:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.840+0000 7f4270a6e640 1 -- 172.21.15.80:0/2527715616 wait complete. 2024-04-25T15:46:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.841+0000 7f4270a6e640 1 Processor -- start 2024-04-25T15:46:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.842+0000 7f4270a6e640 1 -- start start 2024-04-25T15:46:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4270a6e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 0x7f426c1d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4270a6e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426c0b91c0 0x7f426c1f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4270a6e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426c0d2480 0x7f426c1d5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4270a6e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f426c09d0e0 con 0x7f426c0b4b60 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4270a6e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f426c09cbe0 con 0x7f426c0b91c0 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4270a6e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f426c09d260 con 0x7f426c0d2480 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 0x7f426c1d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 0x7f426c1d83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41404/0 (socket says 172.21.15.80:41404) 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 -- 172.21.15.80:0/334706022 learned_addr learned my addr 172.21.15.80:0/334706022 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426ad9d640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426c0d2480 0x7f426c1d5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4269d9b640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426c0b91c0 0x7f426c1f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 -- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426c0d2480 msgr2=0x7f426c1d5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426c0d2480 0x7f426c1d5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 -- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426c0b91c0 msgr2=0x7f426c1f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426c0b91c0 0x7f426c1f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 -- 172.21.15.80:0/334706022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c1d8e70 con 0x7f426c0b4b60 2024-04-25T15:46:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426ad9d640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426c0d2480 0x7f426c1d5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f4269d9b640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426c0b91c0 0x7f426c1f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.843+0000 7f426a59c640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 0x7f426c1d83e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c400 tx=0x7f425c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.844+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c017070 con 0x7f426c0b4b60 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.844+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c0074e0 con 0x7f426c0b4b60 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.844+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0059e0 con 0x7f426c0b4b60 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.844+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426c1d9150 con 0x7f426c0b4b60 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.844+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426c1f6a00 con 0x7f426c0b4b60 2024-04-25T15:46:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.845+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426c075c90 con 0x7f426c0b4b60 2024-04-25T15:46:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.845+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f425c01a070 con 0x7f426c0b4b60 2024-04-25T15:46:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.846+0000 7f425affd640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f424c0744b0 0x7f424c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.846+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f425c094750 con 0x7f426c0b4b60 2024-04-25T15:46:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.846+0000 7f4269d9b640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f424c0744b0 0x7f424c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.846+0000 7f4269d9b640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f424c0744b0 0x7f424c0769c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4260006fd0 tx=0x7f4260008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:06.851+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f425c05ed50 con 0x7f426c0b4b60 2024-04-25T15:46:07.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.063+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f426c1f6530 con 0x7f426c0b4b60 2024-04-25T15:46:07.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.063+0000 7f425affd640 1 -- 172.21.15.80:0/334706022 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7f425c05e650 con 0x7f426c0b4b60 2024-04-25T15:46:07.065 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:07.065 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:46:07.065 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f424c0744b0 msgr2=0x7f424c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f424c0744b0 0x7f424c0769c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4260006fd0 tx=0x7f4260008040 comp rx=0 tx=0).stop 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 msgr2=0x7f426c1d83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 0x7f426c1d83e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c400 tx=0x7f425c00c8c0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 shutdown_connections 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f424c0744b0 0x7f424c0769c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426c0d2480 0x7f426c1d5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426c0b91c0 0x7f426c1f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 --2- 172.21.15.80:0/334706022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f426c0b4b60 0x7f426c1d83e0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 >> 172.21.15.80:0/334706022 conn(0x7f426c0d0450 msgr2=0x7f426c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 shutdown_connections 2024-04-25T15:46:07.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.065+0000 7f4270a6e640 1 -- 172.21.15.80:0/334706022 wait complete. 2024-04-25T15:46:07.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:07.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.184+0000 7fef00bf3640 1 Processor -- start 2024-04-25T15:46:07.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.184+0000 7fef00bf3640 1 -- start start 2024-04-25T15:46:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7fef00bf3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feefc0b0d80 0x7feefc15c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7fef00bf3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feefc073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7fef00bf3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc0703e0 con 0x7feefc06fe10 2024-04-25T15:46:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7fef00bf3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7feefc0affc0 con 0x7feefc0b0d80 2024-04-25T15:46:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7fef00bf3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feefc0b02a0 con 0x7feefc0b65a0 2024-04-25T15:46:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7feefad9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7feefc06fe10 0x7feefc160220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:37808/0 (socket says 172.21.15.80:37808) 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7feefad9d640 1 -- 172.21.15.80:0/3920592480 learned_addr learned my addr 172.21.15.80:0/3920592480 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7feefa59c640 1 --2- 172.21.15.80:0/3920592480 >> v2:172.21.15.195:3300/0 conn(0x7feefc0b0d80 0x7feefc15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7feef9d9b640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feefc073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309037880 0 0) 0x7feefc0703e0 con 0x7feefc06fe10 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.186+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee4003520 con 0x7feefc06fe10 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 525063250 0 0) 0x7feee4003520 con 0x7feefc06fe10 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 msgr2=0x7feefc073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feefc073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 >> v2:172.21.15.195:3300/0 conn(0x7feefc0b0d80 msgr2=0x7feefc15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 --2- 172.21.15.80:0/3920592480 >> v2:172.21.15.195:3300/0 conn(0x7feefc0b0d80 0x7feefc15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc0b0580 con 0x7feefc06fe10 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7feef4001670 con 0x7feefc06fe10 2024-04-25T15:46:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 >> v1:172.21.15.195:6789/0 conn(0x7feefc06fe10 legacy=0x7feefc160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feee40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee4003f30 0x7feee4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee4004d40 0x7feee4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0affc0 con 0x7feee4003f30 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0b02a0 con 0x7feee4004d40 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feee400ba10 con 0x7feefc0b65a0 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef9d9b640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee4003f30 0x7feee4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feefad9d640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee4004d40 0x7feee4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feefa59c640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feee40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef9d9b640 1 -- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 msgr2=0x7feee40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef9d9b640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feee40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef9d9b640 1 -- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee4004d40 msgr2=0x7feee4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef9d9b640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee4004d40 0x7feee4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feef9d9b640 1 -- 172.21.15.80:0/3920592480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee4003520 con 0x7feee4003f30 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feefa59c640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feefc0b65a0 0x7feee40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.187+0000 7feefad9d640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee4004d40 0x7feee4005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.188+0000 7feef9d9b640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee4003f30 0x7feee4004800 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7feef0009a90 tx=0x7feee4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea5a1e8fdbe6ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.188+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0036070 con 0x7feee4003f30 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.188+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef0031400 con 0x7feee4003f30 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.188+0000 7feef959a640 1 -- 172.21.15.80:0/3920592480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0009690 con 0x7feee4003f30 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7fef00bf3640 1 -- 172.21.15.80:0/3920592480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee4003f30 msgr2=0x7feee4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7fef00bf3640 1 --2- 172.21.15.80:0/3920592480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee4003f30 0x7feee4004800 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7feef0009a90 tx=0x7feee4005830 comp rx=0 tx=0).stop 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7feefad9d640 1 -- 172.21.15.80:0/3920592480 reap_dead start 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7fef00bf3640 1 -- 172.21.15.80:0/3920592480 shutdown_connections 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7fef00bf3640 1 -- 172.21.15.80:0/3920592480 >> 172.21.15.80:0/3920592480 conn(0x7feefc0d1e20 msgr2=0x7feefc073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7fef00bf3640 1 -- 172.21.15.80:0/3920592480 shutdown_connections 2024-04-25T15:46:07.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.189+0000 7fef00bf3640 1 -- 172.21.15.80:0/3920592480 wait complete. 2024-04-25T15:46:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.191+0000 7fef00bf3640 1 Processor -- start 2024-04-25T15:46:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.191+0000 7fef00bf3640 1 -- start start 2024-04-25T15:46:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7fef00bf3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feee4003f30 0x7feefc15f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7fef00bf3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 0x7feefc151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7fef00bf3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feefc0d0c70 0x7feefc151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7fef00bf3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feefc06d5d0 con 0x7feefc0cf4f0 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7fef00bf3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0ae7c0 con 0x7feefc0d0c70 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7fef00bf3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feefc06d750 con 0x7feee4003f30 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7feef9d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 0x7feefc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7feef9d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 0x7feefc151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41418/0 (socket says 172.21.15.80:41418) 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7feef9d9b640 1 -- 172.21.15.80:0/700911625 learned_addr learned my addr 172.21.15.80:0/700911625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7feefa59c640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feee4003f30 0x7feefc15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.192+0000 7feefad9d640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feefc0d0c70 0x7feefc151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feef9d9b640 1 -- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feee4003f30 msgr2=0x7feefc15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feef9d9b640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feee4003f30 0x7feefc15f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feef9d9b640 1 -- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feefc0d0c70 msgr2=0x7feefc151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feef9d9b640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feefc0d0c70 0x7feefc151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feef9d9b640 1 -- 172.21.15.80:0/700911625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc0cfbd0 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feef9d9b640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 0x7feefc151300 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7feef0009a90 tx=0x7feef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0003a20 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef0003be0 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef00315b0 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc0cfeb0 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.193+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc0d0470 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.194+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc06a100 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.195+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feef0031750 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.195+0000 7feeeaffd640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feedc0744b0 0x7feedc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.195+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7feef00b74e0 con 0x7feefc0cf4f0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.195+0000 7feefa59c640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feedc0744b0 0x7feedc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.196+0000 7feefa59c640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feedc0744b0 0x7feedc0769c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feeec009fd0 tx=0x7feeec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.200+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feef0081490 con 0x7feefc0cf4f0 2024-04-25T15:46:07.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.376+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feefc0cf960 con 0x7feefc0cf4f0 2024-04-25T15:46:07.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.377+0000 7feeeaffd640 1 -- 172.21.15.80:0/700911625 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16933 (secure 0 0 0) 0x7feef0085790 con 0x7feefc0cf4f0 2024-04-25T15:46:07.378 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:07.378 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:50.027676+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feedc0744b0 msgr2=0x7feedc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feedc0744b0 0x7feedc0769c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feeec009fd0 tx=0x7feeec00b040 comp rx=0 tx=0).stop 2024-04-25T15:46:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 msgr2=0x7feefc151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 0x7feefc151300 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7feef0009a90 tx=0x7feef0004730 comp rx=0 tx=0).stop 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 shutdown_connections 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feedc0744b0 0x7feedc0769c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feefc0d0c70 0x7feefc151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feefc0cf4f0 0x7feefc151300 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 --2- 172.21.15.80:0/700911625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feee4003f30 0x7feefc15f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 >> 172.21.15.80:0/700911625 conn(0x7feefc0d1e20 msgr2=0x7feefc0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 shutdown_connections 2024-04-25T15:46:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.379+0000 7fef00bf3640 1 -- 172.21.15.80:0/700911625 wait complete. 2024-04-25T15:46:07.392 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:46:07.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:07.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.498+0000 7effe2d1f640 1 Processor -- start 2024-04-25T15:46:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.499+0000 7effe2d1f640 1 -- start start 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe2d1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe2d1f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7effdc06da90 0x7effdc06e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe2d1f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7effdc06eaa0 0x7effdc0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe2d1f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7effdc0d1010 con 0x7effdc06eaa0 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe2d1f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7effdc09cdf0 con 0x7effdc06da90 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe2d1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7effdc09d0d0 con 0x7effdc0d34a0 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7effdc06eaa0 0x7effdc0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7effdc06eaa0 0x7effdc0b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41430/0 (socket says 172.21.15.80:41430) 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 -- 172.21.15.80:0/739495274 learned_addr learned my addr 172.21.15.80:0/739495274 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe0abb640 1 --2- 172.21.15.80:0/739495274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 -- 172.21.15.80:0/739495274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 msgr2=0x7effdc0b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 --2- 172.21.15.80:0/739495274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc0b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 -- 172.21.15.80:0/739495274 >> v2:172.21.15.195:3300/0 conn(0x7effdc06da90 msgr2=0x7effdc06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 --2- 172.21.15.80:0/739495274 >> v2:172.21.15.195:3300/0 conn(0x7effdc06da90 0x7effdc06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.500+0000 7effe12bc640 1 -- 172.21.15.80:0/739495274 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0d12f0 con 0x7effdc06eaa0 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.501+0000 7effe12bc640 1 --2- 172.21.15.80:0/739495274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06eaa0 0x7effdc0b3ac0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7effdc074690 tx=0x7effd402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64144feb52c609d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.501+0000 7effdb7fe640 1 -- 172.21.15.80:0/739495274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4036070 con 0x7effdc06eaa0 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.501+0000 7effdb7fe640 1 -- 172.21.15.80:0/739495274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd4031600 con 0x7effdc06eaa0 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.501+0000 7effdb7fe640 1 -- 172.21.15.80:0/739495274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40319d0 con 0x7effdc06eaa0 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 -- 172.21.15.80:0/739495274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06eaa0 msgr2=0x7effdc0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 --2- 172.21.15.80:0/739495274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06eaa0 0x7effdc0b3ac0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7effdc074690 tx=0x7effd402a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 -- 172.21.15.80:0/739495274 shutdown_connections 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 --2- 172.21.15.80:0/739495274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06eaa0 0x7effdc0b3ac0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 --2- 172.21.15.80:0/739495274 >> v2:172.21.15.195:3300/0 conn(0x7effdc06da90 0x7effdc06e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 --2- 172.21.15.80:0/739495274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 -- 172.21.15.80:0/739495274 >> 172.21.15.80:0/739495274 conn(0x7effdc0d0450 msgr2=0x7effdc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 -- 172.21.15.80:0/739495274 shutdown_connections 2024-04-25T15:46:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.502+0000 7effe2d1f640 1 -- 172.21.15.80:0/739495274 wait complete. 2024-04-25T15:46:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.504+0000 7effe2d1f640 1 Processor -- start 2024-04-25T15:46:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.504+0000 7effe2d1f640 1 -- start start 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe2d1f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 0x7effdc09d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe2d1f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effdc06eaa0 0x7effdc09f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe2d1f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe2d1f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0b4180 con 0x7effdc06da90 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe2d1f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0b4000 con 0x7effdc06eaa0 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe2d1f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7effdc0b4300 con 0x7effdc0d34a0 2024-04-25T15:46:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe0abb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 0x7effdc09d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe0abb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 0x7effdc09d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41442/0 (socket says 172.21.15.80:41442) 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.505+0000 7effe0abb640 1 -- 172.21.15.80:0/4038692519 learned_addr learned my addr 172.21.15.80:0/4038692519 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe0abb640 1 -- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 msgr2=0x7effdc156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe0abb640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe0abb640 1 -- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effdc06eaa0 msgr2=0x7effdc09f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effdbfff640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effdc06eaa0 0x7effdc09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe0abb640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effdc06eaa0 0x7effdc09f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe0abb640 1 -- 172.21.15.80:0/4038692519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc1622d0 con 0x7effdc06da90 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effdbfff640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effdc06eaa0 0x7effdc09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe0abb640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 0x7effdc09d790 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7effcc00e870 tx=0x7effcc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc017070 con 0x7effdc06da90 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc00c940 con 0x7effdc06da90 2024-04-25T15:46:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc09e3e0 con 0x7effdc06da90 2024-04-25T15:46:07.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc00ccf0 con 0x7effdc06da90 2024-04-25T15:46:07.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.506+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc160770 con 0x7effdc06da90 2024-04-25T15:46:07.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.507+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc06a100 con 0x7effdc06da90 2024-04-25T15:46:07.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.508+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7effcc01a070 con 0x7effdc06da90 2024-04-25T15:46:07.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.508+0000 7effd97fa640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7effc80744b0 0x7effc80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.508+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7effcc0956f0 con 0x7effdc06da90 2024-04-25T15:46:07.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.508+0000 7effdbfff640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7effc80744b0 0x7effc80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.508+0000 7effdbfff640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7effc80744b0 0x7effc80769c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7effdc160720 tx=0x7effd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.513+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effcc05fdb0 con 0x7effdc06da90 2024-04-25T15:46:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.724+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effdc0b52a0 con 0x7effdc06da90 2024-04-25T15:46:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.724+0000 7effd97fa640 1 -- 172.21.15.80:0/4038692519 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7effcc05f6b0 con 0x7effdc06da90 2024-04-25T15:46:07.725 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:07.726 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:46:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:46:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7effc80744b0 msgr2=0x7effc80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7effc80744b0 0x7effc80769c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7effdc160720 tx=0x7effd0008040 comp rx=0 tx=0).stop 2024-04-25T15:46:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 msgr2=0x7effdc09d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 0x7effdc09d790 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7effcc00e870 tx=0x7effcc00ed30 comp rx=0 tx=0).stop 2024-04-25T15:46:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 shutdown_connections 2024-04-25T15:46:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7effc80744b0 0x7effc80769c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effdc0d34a0 0x7effdc156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effdc06eaa0 0x7effdc09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 --2- 172.21.15.80:0/4038692519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7effdc06da90 0x7effdc09d790 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 >> 172.21.15.80:0/4038692519 conn(0x7effdc0d0450 msgr2=0x7effdc0d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 shutdown_connections 2024-04-25T15:46:07.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.726+0000 7effe2d1f640 1 -- 172.21.15.80:0/4038692519 wait complete. 2024-04-25T15:46:07.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.844+0000 7ff6e6900640 1 Processor -- start 2024-04-25T15:46:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.844+0000 7ff6e6900640 1 -- start start 2024-04-25T15:46:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.845+0000 7ff6e6900640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff6e00d34a0 0x7ff6e00b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.845+0000 7ff6e6900640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6e00b3ac0 0x7ff6e00b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.845+0000 7ff6e6900640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e00d1010 con 0x7ff6e006da90 2024-04-25T15:46:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.845+0000 7ff6e6900640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e009cdf0 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.845+0000 7ff6e6900640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e009d0d0 con 0x7ff6e00d34a0 2024-04-25T15:46:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6e00b3ac0 0x7ff6e00b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6e00b3ac0 0x7ff6e00b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41452/0 (socket says 172.21.15.80:41452) 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 -- 172.21.15.80:0/1191939610 learned_addr learned my addr 172.21.15.80:0/1191939610 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6dffff640 1 --2- 172.21.15.80:0/1191939610 >> v2:172.21.15.195:3300/0 conn(0x7ff6e00d34a0 0x7ff6e00b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 -- 172.21.15.80:0/1191939610 >> v2:172.21.15.195:3300/0 conn(0x7ff6e00d34a0 msgr2=0x7ff6e00b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 --2- 172.21.15.80:0/1191939610 >> v2:172.21.15.195:3300/0 conn(0x7ff6e00d34a0 0x7ff6e00b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 -- 172.21.15.80:0/1191939610 >> v1:172.21.15.195:6789/0 conn(0x7ff6e006da90 legacy=0x7ff6e006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6e4e9d640 1 -- 172.21.15.80:0/1191939610 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e006ec70 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.846+0000 7ff6dffff640 1 --2- 172.21.15.80:0/1191939610 >> v2:172.21.15.195:3300/0 conn(0x7ff6e00d34a0 0x7ff6e00b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e4e9d640 1 --2- 172.21.15.80:0/1191939610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e00b3ed0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0074480 tx=0x7ff6d802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41e30678381ba5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6deffd640 1 -- 172.21.15.80:0/1191939610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8036070 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6deffd640 1 -- 172.21.15.80:0/1191939610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d8031600 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6deffd640 1 -- 172.21.15.80:0/1191939610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80319d0 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 -- 172.21.15.80:0/1191939610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 msgr2=0x7ff6e00b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 --2- 172.21.15.80:0/1191939610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e00b3ed0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0074480 tx=0x7ff6d802a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 -- 172.21.15.80:0/1191939610 shutdown_connections 2024-04-25T15:46:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 --2- 172.21.15.80:0/1191939610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e00b3ed0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 --2- 172.21.15.80:0/1191939610 >> v2:172.21.15.195:3300/0 conn(0x7ff6e00d34a0 0x7ff6e00b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 -- 172.21.15.80:0/1191939610 >> 172.21.15.80:0/1191939610 conn(0x7ff6e00d0450 msgr2=0x7ff6e00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 -- 172.21.15.80:0/1191939610 shutdown_connections 2024-04-25T15:46:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.847+0000 7ff6e6900640 1 -- 172.21.15.80:0/1191939610 wait complete. 2024-04-25T15:46:07.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.849+0000 7ff6e6900640 1 Processor -- start 2024-04-25T15:46:07.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.849+0000 7ff6e6900640 1 -- start start 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e006da90 0x7ff6e0160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e00d34a0 0x7ff6e01f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00b4410 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e006d7b0 con 0x7ff6e006da90 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e00b4590 con 0x7ff6e00d34a0 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41454/0 (socket says 172.21.15.80:41454) 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 -- 172.21.15.80:0/3210528916 learned_addr learned my addr 172.21.15.80:0/3210528916 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6dffff640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e006da90 0x7ff6e0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e4e9d640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e00d34a0 0x7ff6e01f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 -- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e00d34a0 msgr2=0x7ff6e01f9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e00d34a0 0x7ff6e01f9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 -- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e006da90 msgr2=0x7ff6e0160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e006da90 0x7ff6e0160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 -- 172.21.15.80:0/3210528916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e00a1620 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6df7fe640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e015b600 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400b420 tx=0x7ff6d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011830 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4016070 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e015e0e0 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.851+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011c10 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.852+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e015e6a0 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.852+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e015de50 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.853+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff6d401b460 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.854+0000 7ff6dcff9640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6cc0744b0 0x7ff6cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.854+0000 7ff6dffff640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6cc0744b0 0x7ff6cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.854+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7ff6d4094d20 con 0x7ff6e00b3ac0 2024-04-25T15:46:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.854+0000 7ff6dffff640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6cc0744b0 0x7ff6cc0769c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0006fd0 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:07.858+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff6d4020020 con 0x7ff6e00b3ac0 2024-04-25T15:46:08.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.069+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6e006e560 con 0x7ff6e00b3ac0 2024-04-25T15:46:08.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.069+0000 7ff6dcff9640 1 -- 172.21.15.80:0/3210528916 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5183 (secure 0 0 0) 0x7ff6d405ecd0 con 0x7ff6e00b3ac0 2024-04-25T15:46:08.070 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:08.071 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:45:48.382037+0000","modified":"2024-04-25T15:45:50.377180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6684":{"gid":6684,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/231548395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":231548395},{"type":"v1","addr":"172.21.15.80:6837","nonce":231548395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6684,"qdb_cluster":[6684]},"id":5}]} 2024-04-25T15:46:08.071 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2024-04-25T15:46:08.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6cc0744b0 msgr2=0x7ff6cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6cc0744b0 0x7ff6cc0769c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0006fd0 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 msgr2=0x7ff6e015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e015b600 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400b420 tx=0x7ff6d400b8e0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 shutdown_connections 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff6cc0744b0 0x7ff6cc0769c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6e00d34a0 0x7ff6e01f9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6e00b3ac0 0x7ff6e015b600 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 --2- 172.21.15.80:0/3210528916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6e006da90 0x7ff6e0160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 >> 172.21.15.80:0/3210528916 conn(0x7ff6e00d0450 msgr2=0x7ff6e00b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 shutdown_connections 2024-04-25T15:46:08.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.071+0000 7ff6e6900640 1 -- 172.21.15.80:0/3210528916 wait complete. 2024-04-25T15:46:08.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:08.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.191+0000 7f01a4aaa640 1 Processor -- start 2024-04-25T15:46:08.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.191+0000 7f01a4aaa640 1 -- start start 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f01a4aaa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01a00cf960 0x7f01a00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f01a4aaa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f01a00b1ef0 0x7f01a00b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f01a4aaa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a01607c0 con 0x7f01a00ce220 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f01a4aaa640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f01a00cf4d0 con 0x7f01a00cf960 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f01a4aaa640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f01a00ce630 con 0x7f01a00b1ef0 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01a00cf960 0x7f01a00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01a00cf960 0x7f01a00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41468/0 (socket says 172.21.15.80:41468) 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 -- 172.21.15.80:0/1644721172 learned_addr learned my addr 172.21.15.80:0/1644721172 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019ed9d640 1 --2- 172.21.15.80:0/1644721172 >> v2:172.21.15.195:3300/0 conn(0x7f01a00b1ef0 0x7f01a00b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 -- 172.21.15.80:0/1644721172 >> v2:172.21.15.195:3300/0 conn(0x7f01a00b1ef0 msgr2=0x7f01a00b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 --2- 172.21.15.80:0/1644721172 >> v2:172.21.15.195:3300/0 conn(0x7f01a00b1ef0 0x7f01a00b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 -- 172.21.15.80:0/1644721172 >> v1:172.21.15.195:6789/0 conn(0x7f01a00ce220 legacy=0x7f01a009bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.193+0000 7f019dd9b640 1 -- 172.21.15.80:0/1644721172 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a00ceba0 con 0x7f01a00cf960 2024-04-25T15:46:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.194+0000 7f019dd9b640 1 --2- 172.21.15.80:0/1644721172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cfd70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f01a0073ce0 tx=0x7f019402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8ec65ffcca3db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.194+0000 7f019d59a640 1 -- 172.21.15.80:0/1644721172 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194037070 con 0x7f01a00cf960 2024-04-25T15:46:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.194+0000 7f019d59a640 1 -- 172.21.15.80:0/1644721172 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019402ae50 con 0x7f01a00cf960 2024-04-25T15:46:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.194+0000 7f019d59a640 1 -- 172.21.15.80:0/1644721172 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194032860 con 0x7f01a00cf960 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1644721172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 msgr2=0x7f01a00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1644721172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cfd70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f01a0073ce0 tx=0x7f019402a300 comp rx=0 tx=0).stop 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1644721172 shutdown_connections 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1644721172 >> v2:172.21.15.195:3300/0 conn(0x7f01a00b1ef0 0x7f01a00b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1644721172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cfd70 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1644721172 >> 172.21.15.80:0/1644721172 conn(0x7f01a00b7620 msgr2=0x7f01a00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1644721172 shutdown_connections 2024-04-25T15:46:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.195+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1644721172 wait complete. 2024-04-25T15:46:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.197+0000 7f01a4aaa640 1 Processor -- start 2024-04-25T15:46:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.197+0000 7f01a4aaa640 1 -- start start 2024-04-25T15:46:08.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f01a4aaa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01a00b1ef0 0x7f01a00ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f01a4aaa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01a00ce220 0x7f01a0152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f01a4aaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f01a4aaa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00d3530 con 0x7f01a00cf960 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f01a4aaa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00cf160 con 0x7f01a00ce220 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f01a4aaa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01a0162500 con 0x7f01a00b1ef0 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41476/0 (socket says 172.21.15.80:41476) 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 -- 172.21.15.80:0/1719737997 learned_addr learned my addr 172.21.15.80:0/1719737997 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019dd9b640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01a00ce220 0x7f01a0152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019e59c640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01a00b1ef0 0x7f01a00ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 -- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01a00b1ef0 msgr2=0x7f01a00ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01a00b1ef0 0x7f01a00ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 -- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01a00ce220 msgr2=0x7f01a0152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01a00ce220 0x7f01a0152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019ed9d640 1 -- 172.21.15.80:0/1719737997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a0160a30 con 0x7f01a00cf960 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.198+0000 7f019e59c640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01a00b1ef0 0x7f01a00ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.199+0000 7f019ed9d640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cb830 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f019800d5a0 tx=0x7f019800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.199+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980125f0 con 0x7f01a00cf960 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.199+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198019070 con 0x7f01a00cf960 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.199+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980129f0 con 0x7f01a00cf960 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.199+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a00cae50 con 0x7f01a00cf960 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.199+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a0160ca0 con 0x7f01a00cf960 2024-04-25T15:46:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.200+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a006a100 con 0x7f01a00cf960 2024-04-25T15:46:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.201+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0198012b90 con 0x7f01a00cf960 2024-04-25T15:46:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.201+0000 7f018effd640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01800744b0 0x7f01800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.201+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f01980956d0 con 0x7f01a00cf960 2024-04-25T15:46:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.201+0000 7f019e59c640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01800744b0 0x7f01800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.202+0000 7f019e59c640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01800744b0 0x7f01800769c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0190001d60 tx=0x7f0190009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.206+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f019805fce0 con 0x7f01a00cf960 2024-04-25T15:46:08.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.382+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01a00ca910 con 0x7f01a00cf960 2024-04-25T15:46:08.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.383+0000 7f018effd640 1 -- 172.21.15.80:0/1719737997 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16933 (secure 0 0 0) 0x7f019805f5e0 con 0x7f01a00cf960 2024-04-25T15:46:08.384 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:08.384 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:45:50.027676+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:45:46.643187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T15:45:47.329997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01800744b0 msgr2=0x7f01800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01800744b0 0x7f01800769c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0190001d60 tx=0x7f0190009040 comp rx=0 tx=0).stop 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 msgr2=0x7f01a00cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cb830 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f019800d5a0 tx=0x7f019800da60 comp rx=0 tx=0).stop 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 shutdown_connections 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f01800744b0 0x7f01800769c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01a00cf960 0x7f01a00cb830 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01a00ce220 0x7f01a0152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 --2- 172.21.15.80:0/1719737997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01a00b1ef0 0x7f01a00ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 >> 172.21.15.80:0/1719737997 conn(0x7f01a00b7620 msgr2=0x7f01a006e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 shutdown_connections 2024-04-25T15:46:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.385+0000 7f01a4aaa640 1 -- 172.21.15.80:0/1719737997 wait complete. 2024-04-25T15:46:08.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:46:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.504+0000 7fadecdce640 1 Processor -- start 2024-04-25T15:46:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.504+0000 7fadecdce640 1 -- start start 2024-04-25T15:46:08.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fadecdce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fade80b4b60 0x7fade80b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fadecdce640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fade80b3850 0x7fade816a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fadecdce640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade80b2f30 con 0x7fade806d6d0 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fadecdce640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fade806eb60 con 0x7fade80b4b60 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fadecdce640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fade80b2c90 con 0x7fade80b3850 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fade80b4b60 0x7fade80b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fade80b4b60 0x7fade80b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41490/0 (socket says 172.21.15.80:41490) 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 -- 172.21.15.80:0/3690436156 learned_addr learned my addr 172.21.15.80:0/3690436156 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade6d9d640 1 --2- 172.21.15.80:0/3690436156 >> v2:172.21.15.195:3300/0 conn(0x7fade80b3850 0x7fade816a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 -- 172.21.15.80:0/3690436156 >> v2:172.21.15.195:3300/0 conn(0x7fade80b3850 msgr2=0x7fade816a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 --2- 172.21.15.80:0/3690436156 >> v2:172.21.15.195:3300/0 conn(0x7fade80b3850 0x7fade816a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 -- 172.21.15.80:0/3690436156 >> v1:172.21.15.195:6789/0 conn(0x7fade806d6d0 legacy=0x7fade80b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.506+0000 7fade659c640 1 -- 172.21.15.80:0/3690436156 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade80d10a0 con 0x7fade80b4b60 2024-04-25T15:46:08.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.507+0000 7fade659c640 1 --2- 172.21.15.80:0/3690436156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade80b4b60 0x7fade80b91c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fade808ccd0 tx=0x7fadd802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80cc4361c1c19c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.507+0000 7fade559a640 1 -- 172.21.15.80:0/3690436156 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8036070 con 0x7fade80b4b60 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.507+0000 7fade559a640 1 -- 172.21.15.80:0/3690436156 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd8031600 con 0x7fade80b4b60 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.507+0000 7fade559a640 1 -- 172.21.15.80:0/3690436156 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd80319d0 con 0x7fade80b4b60 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 -- 172.21.15.80:0/3690436156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade80b4b60 msgr2=0x7fade80b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 --2- 172.21.15.80:0/3690436156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade80b4b60 0x7fade80b91c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fade808ccd0 tx=0x7fadd802a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 -- 172.21.15.80:0/3690436156 shutdown_connections 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 --2- 172.21.15.80:0/3690436156 >> v2:172.21.15.195:3300/0 conn(0x7fade80b3850 0x7fade816a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 --2- 172.21.15.80:0/3690436156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade80b4b60 0x7fade80b91c0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 -- 172.21.15.80:0/3690436156 >> 172.21.15.80:0/3690436156 conn(0x7fade80d0450 msgr2=0x7fade80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 -- 172.21.15.80:0/3690436156 shutdown_connections 2024-04-25T15:46:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.508+0000 7fadecdce640 1 -- 172.21.15.80:0/3690436156 wait complete. 2024-04-25T15:46:08.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.510+0000 7fadecdce640 1 Processor -- start 2024-04-25T15:46:08.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.510+0000 7fadecdce640 1 -- start start 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fadecdce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 0x7fade81d9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fadecdce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fade80b3850 0x7fade81f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fadecdce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fade80b4b60 0x7fade81d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fadecdce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fade80d2f50 con 0x7fade806d6d0 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fadecdce640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fade80d1400 con 0x7fade80b4b60 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fadecdce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fade809d0e0 con 0x7fade80b3850 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fade659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 0x7fade81d9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fade659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 0x7fade81d9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41500/0 (socket says 172.21.15.80:41500) 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.511+0000 7fade659c640 1 -- 172.21.15.80:0/3040766565 learned_addr learned my addr 172.21.15.80:0/3040766565 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade5d9b640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fade80b3850 0x7fade81f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade6d9d640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fade80b4b60 0x7fade81d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade659c640 1 -- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fade80b3850 msgr2=0x7fade81f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade659c640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fade80b3850 0x7fade81f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade659c640 1 -- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fade80b4b60 msgr2=0x7fade81d89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade659c640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fade80b4b60 0x7fade81d89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade659c640 1 -- 172.21.15.80:0/3040766565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade81f7210 con 0x7fade806d6d0 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade5d9b640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fade80b3850 0x7fade81f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fade659c640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 0x7fade81d9380 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009f90 tx=0x7fadd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd803f020 con 0x7fade806d6d0 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd8037040 con 0x7fade806d6d0 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade809fd40 con 0x7fade806d6d0 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8036070 con 0x7fade806d6d0 2024-04-25T15:46:08.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.512+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade80a0300 con 0x7fade806d6d0 2024-04-25T15:46:08.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.513+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade8075c90 con 0x7fade806d6d0 2024-04-25T15:46:08.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.514+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fadd8042020 con 0x7fade806d6d0 2024-04-25T15:46:08.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.514+0000 7fadd6ffd640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadc80744b0 0x7fadc80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.514+0000 7fade5d9b640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadc80744b0 0x7fadc80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.515+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fadd80b5910 con 0x7fade806d6d0 2024-04-25T15:46:08.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.515+0000 7fade5d9b640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadc80744b0 0x7fadc80769c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fade80a19d0 tx=0x7faddc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.519+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fadd8049030 con 0x7fade806d6d0 2024-04-25T15:46:08.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.730+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fade806a100 con 0x7fade806d6d0 2024-04-25T15:46:08.732 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:46:08.731+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:46:08.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.734+0000 7fadd6ffd640 1 -- 172.21.15.80:0/3040766565 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7fade81f7210 con 0x7fade806d6d0 2024-04-25T15:46:08.735 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:46:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadc80744b0 msgr2=0x7fadc80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadc80744b0 0x7fadc80769c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fade80a19d0 tx=0x7faddc009040 comp rx=0 tx=0).stop 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 msgr2=0x7fade81d9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 0x7fade81d9380 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009f90 tx=0x7fadd8004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 shutdown_connections 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fadc80744b0 0x7fadc80769c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fade80b4b60 0x7fade81d89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fade80b3850 0x7fade81f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 --2- 172.21.15.80:0/3040766565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fade806d6d0 0x7fade81d9380 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 >> 172.21.15.80:0/3040766565 conn(0x7fade80d0450 msgr2=0x7fade80717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 shutdown_connections 2024-04-25T15:46:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.737+0000 7fadecdce640 1 -- 172.21.15.80:0/3040766565 wait complete. 2024-04-25T15:46:08.740 INFO:tasks.ceph.mds.c.smithi080.stderr: -2385> 2024-04-25T15:45:50.999+0000 7f7b9c6e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:46:08.756 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:46:08.793 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.865+0000 7f775cbb2640 1 Processor -- start 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.865+0000 7f775cbb2640 1 -- start start 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f775cbb2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f775806e0e0 0x7f77580d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f775cbb2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77580d2b00 0x7f77580d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f775cbb2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77580d2f10 con 0x7f775815d080 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f775cbb2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f775806e660 con 0x7f77580d2b00 2024-04-25T15:46:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f775cbb2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f775806e940 con 0x7f775806e0e0 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77580d2b00 0x7f77580d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77580d2b00 0x7f77580d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41538/0 (socket says 172.21.15.80:41538) 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 -- 172.21.15.80:0/1641297801 learned_addr learned my addr 172.21.15.80:0/1641297801 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7755d9b640 1 --2- 172.21.15.80:0/1641297801 >> v2:172.21.15.195:3300/0 conn(0x7f775806e0e0 0x7f77580d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 -- 172.21.15.80:0/1641297801 >> v2:172.21.15.195:3300/0 conn(0x7f775806e0e0 msgr2=0x7f77580d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 --2- 172.21.15.80:0/1641297801 >> v2:172.21.15.195:3300/0 conn(0x7f775806e0e0 0x7f77580d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 -- 172.21.15.80:0/1641297801 >> v1:172.21.15.195:6789/0 conn(0x7f775815d080 legacy=0x7f775809b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.867+0000 7f7756d9d640 1 -- 172.21.15.80:0/1641297801 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775806ec20 con 0x7f77580d2b00 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.868+0000 7f7756d9d640 1 --2- 172.21.15.80:0/1641297801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580d0840 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f77580b2a80 tx=0x7f775002c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2607b487ef9c719f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.868+0000 7f775559a640 1 -- 172.21.15.80:0/1641297801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750039070 con 0x7f77580d2b00 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.868+0000 7f775559a640 1 -- 172.21.15.80:0/1641297801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775000b2e0 con 0x7f77580d2b00 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.868+0000 7f775559a640 1 -- 172.21.15.80:0/1641297801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750009820 con 0x7f77580d2b00 2024-04-25T15:46:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 -- 172.21.15.80:0/1641297801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 msgr2=0x7f77580d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 --2- 172.21.15.80:0/1641297801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580d0840 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f77580b2a80 tx=0x7f775002c860 comp rx=0 tx=0).stop 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 -- 172.21.15.80:0/1641297801 shutdown_connections 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 --2- 172.21.15.80:0/1641297801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580d0840 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 --2- 172.21.15.80:0/1641297801 >> v2:172.21.15.195:3300/0 conn(0x7f775806e0e0 0x7f77580d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 -- 172.21.15.80:0/1641297801 >> 172.21.15.80:0/1641297801 conn(0x7f77580b7620 msgr2=0x7f77580b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 -- 172.21.15.80:0/1641297801 shutdown_connections 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.869+0000 7f775cbb2640 1 -- 172.21.15.80:0/1641297801 wait complete. 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.871+0000 7f775cbb2640 1 Processor -- start 2024-04-25T15:46:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.871+0000 7f775cbb2640 1 -- start start 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775cbb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f775806e0e0 0x7f7758151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775cbb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775cbb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f775815d080 0x7f775815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775cbb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77580d0f00 con 0x7f77580d2b00 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775cbb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f77580d0d80 con 0x7f775815d080 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775cbb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f77580d1080 con 0x7f775806e0e0 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f7755d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f7755d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41548/0 (socket says 172.21.15.80:41548) 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f7755d9b640 1 -- 172.21.15.80:0/2644398233 learned_addr learned my addr 172.21.15.80:0/2644398233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f775659c640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f775806e0e0 0x7f7758151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.872+0000 7f7756d9d640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f775815d080 0x7f775815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7755d9b640 1 -- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f775806e0e0 msgr2=0x7f7758151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7755d9b640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f775806e0e0 0x7f7758151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7755d9b640 1 -- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f775815d080 msgr2=0x7f775815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7755d9b640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f775815d080 0x7f775815e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7755d9b640 1 -- 172.21.15.80:0/2644398233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580af9b0 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7756d9d640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f775815d080 0x7f775815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7755d9b640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580b16e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f774800c820 tx=0x7f774800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748015070 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7748004020 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77580afc90 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480043f0 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.873+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7758151ea0 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.874+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775806de00 con 0x7f77580d2b00 2024-04-25T15:46:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.874+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7748007830 con 0x7f77580d2b00 2024-04-25T15:46:08.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.875+0000 7f7746ffd640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77380744b0 0x7f77380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.875+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6187+0+0 (secure 0 0 0) 0x7f7748095020 con 0x7f77580d2b00 2024-04-25T15:46:08.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.875+0000 7f775659c640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77380744b0 0x7f77380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.875+0000 7f775659c640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77380744b0 0x7f77380769c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f774c006fd0 tx=0x7f774c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:08.880+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f775806de00 con 0x7f77580d2b00 2024-04-25T15:46:09.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.091+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f775806a100 con 0x7f77580d2b00 2024-04-25T15:46:09.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.739+0000 7f7746ffd640 1 -- 172.21.15.80:0/2644398233 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f774805f0a0 con 0x7f77580d2b00 2024-04-25T15:46:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.741+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77380744b0 msgr2=0x7f77380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.741+0000 7f775cbb2640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77380744b0 0x7f77380769c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f774c006fd0 tx=0x7f774c009060 comp rx=0 tx=0).stop 2024-04-25T15:46:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.741+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 msgr2=0x7f77580b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.741+0000 7f775cbb2640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580b16e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f774800c820 tx=0x7f774800cce0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 shutdown_connections 2024-04-25T15:46:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f77380744b0 0x7f77380769c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f775815d080 0x7f775815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77580d2b00 0x7f77580b16e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 --2- 172.21.15.80:0/2644398233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f775806e0e0 0x7f7758151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 >> 172.21.15.80:0/2644398233 conn(0x7f77580b7620 msgr2=0x7f77580b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 shutdown_connections 2024-04-25T15:46:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.742+0000 7f775cbb2640 1 -- 172.21.15.80:0/2644398233 wait complete. 2024-04-25T15:46:09.755 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:46:09.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.907+0000 7fd8d2b9d640 1 Processor -- start 2024-04-25T15:46:09.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.907+0000 7fd8d2b9d640 1 -- start start 2024-04-25T15:46:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.908+0000 7fd8d2b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8cc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.908+0000 7fd8d2b9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc1607c0 con 0x7fd8cc0b1ef0 2024-04-25T15:46:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8d2b9d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8cc0ceba0 con 0x7fd8cc0ce220 2024-04-25T15:46:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8d2b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd8cc0cf4d0 con 0x7fd8cc0cf960 2024-04-25T15:46:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8d113a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd8cc0b1ef0 0x7fd8cc0d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42242/0 (socket says 172.21.15.80:42242) 2024-04-25T15:46:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8d113a640 1 -- 172.21.15.80:0/1767298326 learned_addr learned my addr 172.21.15.80:0/1767298326 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cbfff640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8cc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627880849 0 0) 0x7fd8cc1607c0 con 0x7fd8cc0b1ef0 2024-04-25T15:46:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b4003520 con 0x7fd8cc0b1ef0 2024-04-25T15:46:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3993248468 0 0) 0x7fd8b4003520 con 0x7fd8cc0b1ef0 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 msgr2=0x7fd8cc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8cc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 >> v1:172.21.15.195:6789/0 conn(0x7fd8cc0ce220 legacy=0x7fd8cc09bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc0cee80 con 0x7fd8cc0b1ef0 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fd8c40019f0 con 0x7fd8cc0b1ef0 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 >> v1:172.21.15.80:6789/0 conn(0x7fd8cc0b1ef0 legacy=0x7fd8cc0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b40039e0 0x7fd8b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b4004d40 0x7fd8b4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc0cf4d0 con 0x7fd8b40039e0 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b400ba70 con 0x7fd8b4004d40 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b400bc70 con 0x7fd8cc0cf960 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.909+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b40039e0 0x7fd8b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8cbfff640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d113a640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b4004d40 0x7fd8b4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d0939640 1 -- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 msgr2=0x7fd8b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d0939640 1 -- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b4004d40 msgr2=0x7fd8b4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b4004d40 0x7fd8b4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d0939640 1 -- 172.21.15.80:0/1767298326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b4003520 con 0x7fd8b40039e0 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8cbfff640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc0cf960 0x7fd8b4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d113a640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b4004d40 0x7fd8b4005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b40039e0 0x7fd8b4003e10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc001860 tx=0x7fd8b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1322f8146dc28e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc037070 con 0x7fd8b40039e0 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8bc02ac30 con 0x7fd8b40039e0 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.910+0000 7fd8cb7fe640 1 -- 172.21.15.80:0/1767298326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc001430 con 0x7fd8b40039e0 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1767298326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b40039e0 msgr2=0x7fd8b4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1767298326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b40039e0 0x7fd8b4003e10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc001860 tx=0x7fd8b4005830 comp rx=0 tx=0).stop 2024-04-25T15:46:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d113a640 1 -- 172.21.15.80:0/1767298326 reap_dead start 2024-04-25T15:46:09.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1767298326 shutdown_connections 2024-04-25T15:46:09.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1767298326 >> 172.21.15.80:0/1767298326 conn(0x7fd8cc0b7620 msgr2=0x7fd8cc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:09.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1767298326 shutdown_connections 2024-04-25T15:46:09.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.911+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1767298326 wait complete. 2024-04-25T15:46:09.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.913+0000 7fd8d2b9d640 1 Processor -- start 2024-04-25T15:46:09.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.913+0000 7fd8d2b9d640 1 -- start start 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d2b9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b40039e0 0x7fd8cc161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d2b9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc156170 0x7fd8cc0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d2b9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 0x7fd8cc0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d2b9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc0d3530 con 0x7fd8cc161da0 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d2b9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc0ce630 con 0x7fd8b40039e0 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d2b9d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd8cc0cb530 con 0x7fd8cc156170 2024-04-25T15:46:09.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d113a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 0x7fd8cc0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d113a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 0x7fd8cc0c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41566/0 (socket says 172.21.15.80:41566) 2024-04-25T15:46:09.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.914+0000 7fd8d113a640 1 -- 172.21.15.80:0/1546863246 learned_addr learned my addr 172.21.15.80:0/1546863246 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:09.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b40039e0 0x7fd8cc161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d113a640 1 -- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc156170 msgr2=0x7fd8cc0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8cbfff640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc156170 0x7fd8cc0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d113a640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc156170 0x7fd8cc0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d113a640 1 -- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b40039e0 msgr2=0x7fd8cc161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d113a640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b40039e0 0x7fd8cc161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d113a640 1 -- 172.21.15.80:0/1546863246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc0c70a0 con 0x7fd8cc161da0 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b40039e0 0x7fd8cc161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8cbfff640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc156170 0x7fd8cc0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d113a640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 0x7fd8cc0c8a20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0d0c60 tx=0x7fd8c400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400eda0 con 0x7fd8cc161da0 2024-04-25T15:46:09.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c4014430 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4014800 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc0c7380 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.915+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc0c7940 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.916+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8cc06a100 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.917+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd8c40149a0 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.917+0000 7fd8c97fa640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd8b80744e0 0x7fd8b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.917+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6187+0+0 (secure 0 0 0) 0x7fd8c4095280 con 0x7fd8cc161da0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.917+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd8b80744e0 0x7fd8b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:09.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.918+0000 7fd8d0939640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd8b80744e0 0x7fd8b80769f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc034000 tx=0x7fd8bc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:09.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:09.922+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8c405f830 con 0x7fd8cc161da0 2024-04-25T15:46:10.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.097+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd8cc0cdcc0 con 0x7fd8cc161da0 2024-04-25T15:46:10.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.741+0000 7fd8c97fa640 1 -- 172.21.15.80:0/1546863246 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) ==== 181+0+0 (secure 0 0 0) 0x7fd8c405f130 con 0x7fd8cc161da0 2024-04-25T15:46:10.742 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:46:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd8b80744e0 msgr2=0x7fd8b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd8b80744e0 0x7fd8b80769f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc034000 tx=0x7fd8bc009030 comp rx=0 tx=0).stop 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 msgr2=0x7fd8cc0c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 0x7fd8cc0c8a20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0d0c60 tx=0x7fd8c400e530 comp rx=0 tx=0).stop 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 shutdown_connections 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd8b80744e0 0x7fd8b80769f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8cc161da0 0x7fd8cc0c8a20 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd8cc156170 0x7fd8cc0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 --2- 172.21.15.80:0/1546863246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8b40039e0 0x7fd8cc161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 >> 172.21.15.80:0/1546863246 conn(0x7fd8cc0b7620 msgr2=0x7fd8cc06e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 shutdown_connections 2024-04-25T15:46:10.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.744+0000 7fd8d2b9d640 1 -- 172.21.15.80:0/1546863246 wait complete. 2024-04-25T15:46:10.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:46:10.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.868+0000 7f0358242640 1 Processor -- start 2024-04-25T15:46:10.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.868+0000 7f0358242640 1 -- start start 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.869+0000 7f0358242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03500b4b60 0x7f03500b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.869+0000 7f0358242640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f035006d6d0 0x7f03500b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f0358242640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03500b2f30 con 0x7f03500b3680 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f0358242640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f035006eb60 con 0x7f035006d6d0 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f0358242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03500b2c90 con 0x7f03500b4b60 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f035006d6d0 0x7f03500b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f035006d6d0 0x7f03500b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41580/0 (socket says 172.21.15.80:41580) 2024-04-25T15:46:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 -- 172.21.15.80:0/3222711738 learned_addr learned my addr 172.21.15.80:0/3222711738 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:10.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f0355fde640 1 --2- 172.21.15.80:0/3222711738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03500b4b60 0x7f03500b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:10.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 -- 172.21.15.80:0/3222711738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03500b4b60 msgr2=0x7f03500b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:10.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 --2- 172.21.15.80:0/3222711738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03500b4b60 0x7f03500b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 -- 172.21.15.80:0/3222711738 >> v1:172.21.15.195:6789/0 conn(0x7f03500b3680 legacy=0x7f03500d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:10.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.870+0000 7f03557dd640 1 -- 172.21.15.80:0/3222711738 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03500d10a0 con 0x7f035006d6d0 2024-04-25T15:46:10.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.871+0000 7f03557dd640 1 --2- 172.21.15.80:0/3222711738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f035006d6d0 0x7f03500b3140 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0340009870 tx=0x7f034002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad442ce4f8b0e81d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:10.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.871+0000 7f0354fdc640 1 -- 172.21.15.80:0/3222711738 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340037070 con 0x7f035006d6d0 2024-04-25T15:46:10.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.871+0000 7f0354fdc640 1 -- 172.21.15.80:0/3222711738 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0340032440 con 0x7f035006d6d0 2024-04-25T15:46:10.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.871+0000 7f0354fdc640 1 -- 172.21.15.80:0/3222711738 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340032810 con 0x7f035006d6d0 2024-04-25T15:46:10.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 -- 172.21.15.80:0/3222711738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f035006d6d0 msgr2=0x7f03500b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 --2- 172.21.15.80:0/3222711738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f035006d6d0 0x7f03500b3140 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0340009870 tx=0x7f034002a180 comp rx=0 tx=0).stop 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 -- 172.21.15.80:0/3222711738 shutdown_connections 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 --2- 172.21.15.80:0/3222711738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f035006d6d0 0x7f03500b3140 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 --2- 172.21.15.80:0/3222711738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03500b4b60 0x7f03500b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 -- 172.21.15.80:0/3222711738 >> 172.21.15.80:0/3222711738 conn(0x7f03500d0450 msgr2=0x7f03500d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 -- 172.21.15.80:0/3222711738 shutdown_connections 2024-04-25T15:46:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.872+0000 7f0358242640 1 -- 172.21.15.80:0/3222711738 wait complete. 2024-04-25T15:46:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.873+0000 7f0358242640 1 Processor -- start 2024-04-25T15:46:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.874+0000 7f0358242640 1 -- start start 2024-04-25T15:46:10.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0358242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f035006d6d0 0x7f03501d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:10.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0358242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 0x7f035009d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:10.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0358242640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03500b4b60 0x7f035009dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:10.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0358242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f035009d0e0 con 0x7f03500b3680 2024-04-25T15:46:10.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0358242640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f035009cbe0 con 0x7f03500b4b60 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0358242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f035009d260 con 0x7f035006d6d0 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 0x7f035009d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 0x7f035009d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41590/0 (socket says 172.21.15.80:41590) 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 -- 172.21.15.80:0/3078261192 learned_addr learned my addr 172.21.15.80:0/3078261192 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f0355fde640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f035006d6d0 0x7f03501d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03567df640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03500b4b60 0x7f035009dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 -- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f035006d6d0 msgr2=0x7f03501d89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:10.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f035006d6d0 0x7f03501d89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 -- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03500b4b60 msgr2=0x7f035009dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03500b4b60 0x7f035009dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 -- 172.21.15.80:0/3078261192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035009faf0 con 0x7f03500b3680 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.875+0000 7f03557dd640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 0x7f035009d790 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0340009870 tx=0x7f03400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.876+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340041020 con 0x7f03500b3680 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.876+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03400306c0 con 0x7f03500b3680 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.876+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03501e9160 con 0x7f03500b3680 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.876+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340037040 con 0x7f03500b3680 2024-04-25T15:46:10.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.876+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035009f580 con 0x7f03500b3680 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.877+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035009f860 con 0x7f03500b3680 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.877+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0340044020 con 0x7f03500b3680 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.878+0000 7f03467fc640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03340744b0 0x7f03340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.878+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5749+0+0 (secure 0 0 0) 0x7f03400b5880 con 0x7f03500b3680 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.878+0000 7f0355fde640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03340744b0 0x7f03340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.878+0000 7f0355fde640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03340744b0 0x7f03340769c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f034c005f80 tx=0x7f034c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:10.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:10.882+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f034004b030 con 0x7f03500b3680 2024-04-25T15:46:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.057+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0350075c90 con 0x7f03500b3680 2024-04-25T15:46:11.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.747+0000 7f03467fc640 1 -- 172.21.15.80:0/3078261192 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) ==== 169+0+0 (secure 0 0 0) 0x7f03400880f0 con 0x7f03500b3680 2024-04-25T15:46:11.748 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:46:11.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03340744b0 msgr2=0x7f03340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:11.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03340744b0 0x7f03340769c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f034c005f80 tx=0x7f034c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:11.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 msgr2=0x7f035009d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 0x7f035009d790 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0340009870 tx=0x7f03400046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 shutdown_connections 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03340744b0 0x7f03340769c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03500b4b60 0x7f035009dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03500b3680 0x7f035009d790 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 --2- 172.21.15.80:0/3078261192 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f035006d6d0 0x7f03501d89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 >> 172.21.15.80:0/3078261192 conn(0x7f03500d0450 msgr2=0x7f03500b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 shutdown_connections 2024-04-25T15:46:11.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.749+0000 7f0358242640 1 -- 172.21.15.80:0/3078261192 wait complete. 2024-04-25T15:46:11.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T15:46:11.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.870+0000 7fe548c84640 1 Processor -- start 2024-04-25T15:46:11.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.870+0000 7fe548c84640 1 -- start start 2024-04-25T15:46:11.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe548c84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5440af840 0x7fe544168d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:11.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe548c84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe544161a00 con 0x7fe5440d0ff0 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe548c84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe544161ce0 con 0x7fe54415f170 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe548c84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe544071320 con 0x7fe5440af840 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe542d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5440af840 0x7fe544168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe542d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe5440af840 0x7fe544168d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41598/0 (socket says 172.21.15.80:41598) 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe541d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe5440d0ff0 0x7fe54406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42244/0 (socket says 172.21.15.80:42244) 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe542d9d640 1 -- 172.21.15.80:0/200314659 learned_addr learned my addr 172.21.15.80:0/200314659 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe542d9d640 1 -- 172.21.15.80:0/200314659 >> v1:172.21.15.195:6789/0 conn(0x7fe54415f170 legacy=0x7fe544070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe542d9d640 1 -- 172.21.15.80:0/200314659 >> v1:172.21.15.80:6789/0 conn(0x7fe5440d0ff0 legacy=0x7fe54406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe542d9d640 1 -- 172.21.15.80:0/200314659 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe544161fc0 con 0x7fe5440af840 2024-04-25T15:46:11.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.872+0000 7fe54159a640 1 -- 172.21.15.80:0/200314659 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576114631 0 0) 0x7fe544161a00 con 0x7fe5440d0ff0 2024-04-25T15:46:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.873+0000 7fe542d9d640 1 --2- 172.21.15.80:0/200314659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440af840 0x7fe544168d90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009870 tx=0x7fe53c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f0c07c961801a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.873+0000 7fe54159a640 1 -- 172.21.15.80:0/200314659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c037070 con 0x7fe5440af840 2024-04-25T15:46:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.873+0000 7fe54159a640 1 -- 172.21.15.80:0/200314659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c032440 con 0x7fe5440af840 2024-04-25T15:46:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.873+0000 7fe54159a640 1 -- 172.21.15.80:0/200314659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c032810 con 0x7fe5440af840 2024-04-25T15:46:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 -- 172.21.15.80:0/200314659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440af840 msgr2=0x7fe544168d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 --2- 172.21.15.80:0/200314659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440af840 0x7fe544168d90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009870 tx=0x7fe53c02a2a0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 -- 172.21.15.80:0/200314659 shutdown_connections 2024-04-25T15:46:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 --2- 172.21.15.80:0/200314659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440af840 0x7fe544168d90 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 -- 172.21.15.80:0/200314659 >> 172.21.15.80:0/200314659 conn(0x7fe5440734b0 msgr2=0x7fe5440738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 -- 172.21.15.80:0/200314659 shutdown_connections 2024-04-25T15:46:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.874+0000 7fe548c84640 1 -- 172.21.15.80:0/200314659 wait complete. 2024-04-25T15:46:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.876+0000 7fe548c84640 1 Processor -- start 2024-04-25T15:46:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.876+0000 7fe548c84640 1 -- start start 2024-04-25T15:46:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.878+0000 7fe548c84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440d0ff0 0x7fe5441523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.878+0000 7fe548c84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe54415f170 0x7fe5440b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.878+0000 7fe548c84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5440b56f0 0x7fe5440cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.878+0000 7fe548c84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5440d1400 con 0x7fe5440d0ff0 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.878+0000 7fe548c84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe544162610 con 0x7fe5440b56f0 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.878+0000 7fe548c84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe54406dce0 con 0x7fe54415f170 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe54259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440d0ff0 0x7fe5441523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe54259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440d0ff0 0x7fe5441523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41610/0 (socket says 172.21.15.80:41610) 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe54259c640 1 -- 172.21.15.80:0/627037955 learned_addr learned my addr 172.21.15.80:0/627037955 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe541d9b640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe54415f170 0x7fe5440b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe542d9d640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5440b56f0 0x7fe5440cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe541d9b640 1 -- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5440b56f0 msgr2=0x7fe5440cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe541d9b640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5440b56f0 0x7fe5440cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe541d9b640 1 -- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440d0ff0 msgr2=0x7fe5441523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.879+0000 7fe541d9b640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440d0ff0 0x7fe5441523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.880+0000 7fe541d9b640 1 -- 172.21.15.80:0/627037955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440b5f20 con 0x7fe54415f170 2024-04-25T15:46:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.880+0000 7fe541d9b640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe54415f170 0x7fe5440b51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe53800c410 tx=0x7fe53800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.880+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5380074e0 con 0x7fe54415f170 2024-04-25T15:46:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.880+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5380047e0 con 0x7fe54415f170 2024-04-25T15:46:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.880+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5380074e0 con 0x7fe54415f170 2024-04-25T15:46:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.881+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5440b6200 con 0x7fe54415f170 2024-04-25T15:46:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.881+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5440b67c0 con 0x7fe54415f170 2024-04-25T15:46:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.882+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54406a100 con 0x7fe54415f170 2024-04-25T15:46:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.883+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe538011070 con 0x7fe54415f170 2024-04-25T15:46:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.883+0000 7fe532ffd640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5240746b0 0x7fe524076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.883+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7fe538094680 con 0x7fe54415f170 2024-04-25T15:46:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.883+0000 7fe54259c640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5240746b0 0x7fe524076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.884+0000 7fe54259c640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5240746b0 0x7fe524076bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe53400e250 tx=0x7fe53400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:11.888+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe53805e9c0 con 0x7fe54415f170 2024-04-25T15:46:12.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.064+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe5440b5cb0 con 0x7fe54415f170 2024-04-25T15:46:12.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.071+0000 7fe532ffd640 1 -- 172.21.15.80:0/627037955 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fe538062cc0 con 0x7fe54415f170 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5240746b0 msgr2=0x7fe524076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5240746b0 0x7fe524076bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe53400e250 tx=0x7fe53400b040 comp rx=0 tx=0).stop 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe54415f170 msgr2=0x7fe5440b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe54415f170 0x7fe5440b51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe53800c410 tx=0x7fe53800c8d0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 shutdown_connections 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe5240746b0 0x7fe524076bc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5440b56f0 0x7fe5440cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe54415f170 0x7fe5440b51b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 --2- 172.21.15.80:0/627037955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5440d0ff0 0x7fe5441523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 >> 172.21.15.80:0/627037955 conn(0x7fe5440734b0 msgr2=0x7fe54415e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:12.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 shutdown_connections 2024-04-25T15:46:12.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.073+0000 7fe548c84640 1 -- 172.21.15.80:0/627037955 wait complete. 2024-04-25T15:46:12.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-04-25T15:46:12.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.193+0000 7f0658140640 1 Processor -- start 2024-04-25T15:46:12.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.193+0000 7f0658140640 1 -- start start 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0658140640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06500d0b00 0x7f06500d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0658140640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f06500d2b80 0x7f06500d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0658140640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06501643f0 con 0x7f06500b5490 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0658140640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f06501646d0 con 0x7f06500d2b80 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0658140640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f06501649b0 con 0x7f06500d0b00 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0655edc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f06500b5490 0x7f0650160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42256/0 (socket says 172.21.15.80:42256) 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f0655edc640 1 -- 172.21.15.80:0/373490817 learned_addr learned my addr 172.21.15.80:0/373490817 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.194+0000 7f06556db640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06500d0b00 0x7f06500d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f06566dd640 1 --2- 172.21.15.80:0/373490817 >> v2:172.21.15.195:3300/0 conn(0x7f06500d2b80 0x7f06500d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f0654eda640 1 -- 172.21.15.80:0/373490817 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397331983 0 0) 0x7f06501643f0 con 0x7f06500b5490 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f0654eda640 1 -- 172.21.15.80:0/373490817 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0638003520 con 0x7f06500b5490 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f0654eda640 1 -- 172.21.15.80:0/373490817 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4264059309 0 0) 0x7f0638003520 con 0x7f06500b5490 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f06566dd640 1 -- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06500d0b00 msgr2=0x7f06500d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f06566dd640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06500d0b00 0x7f06500d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f06566dd640 1 -- 172.21.15.80:0/373490817 >> v1:172.21.15.80:6789/0 conn(0x7f06500b5490 legacy=0x7f0650160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f06566dd640 1 -- 172.21.15.80:0/373490817 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0650164c90 con 0x7f06500d2b80 2024-04-25T15:46:12.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.195+0000 7f06556db640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06500d0b00 0x7f06500d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.196+0000 7f06566dd640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f06500d47d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06480097a0 tx=0x7f064802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47443ff586766d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.196+0000 7f0654eda640 1 -- 172.21.15.80:0/373490817 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648037070 con 0x7f06500d2b80 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.196+0000 7f0654eda640 1 -- 172.21.15.80:0/373490817 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064802aba0 con 0x7f06500d2b80 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.196+0000 7f0654eda640 1 -- 172.21.15.80:0/373490817 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06400019f0 con 0x7f06500d2b80 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 -- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 msgr2=0x7f06500d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f06500d47d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06480097a0 tx=0x7f064802a110 comp rx=0 tx=0).stop 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 -- 172.21.15.80:0/373490817 shutdown_connections 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f06500d47d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 --2- 172.21.15.80:0/373490817 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06500d0b00 0x7f06500d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 -- 172.21.15.80:0/373490817 >> 172.21.15.80:0/373490817 conn(0x7f065006e650 msgr2=0x7f065006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 -- 172.21.15.80:0/373490817 shutdown_connections 2024-04-25T15:46:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.197+0000 7f0658140640 1 -- 172.21.15.80:0/373490817 wait complete. 2024-04-25T15:46:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.198+0000 7f0658140640 1 Processor -- start 2024-04-25T15:46:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.199+0000 7f0658140640 1 -- start start 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0658140640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 0x7f0650162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0658140640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f065014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0658140640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065014c9f0 0x7f065014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0658140640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f06500b94e0 con 0x7f06500d0b00 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0658140640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f06500b9360 con 0x7f06500d2b80 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0658140640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0650163f80 con 0x7f065014c9f0 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 0x7f0650162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 0x7f0650162ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41614/0 (socket says 172.21.15.80:41614) 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 -- 172.21.15.80:0/953980261 learned_addr learned my addr 172.21.15.80:0/953980261 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f06556db640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f065014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f06566dd640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065014c9f0 0x7f065014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 -- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065014c9f0 msgr2=0x7f065014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065014c9f0 0x7f065014e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 -- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 msgr2=0x7f065014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f065014c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 -- 172.21.15.80:0/953980261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065014d130 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f0655edc640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 0x7f0650162ce0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f064000cc60 tx=0x7f064000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.200+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640017070 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.201+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0640012400 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.201+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065014d410 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.201+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06400127b0 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.201+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065014d9d0 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.202+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06500b5490 con 0x7f06500d0b00 2024-04-25T15:46:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.202+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f064001a070 con 0x7f06500d0b00 2024-04-25T15:46:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.202+0000 7f064e7fc640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f063c0744e0 0x7f063c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.203+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7f0640094e20 con 0x7f06500d0b00 2024-04-25T15:46:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.203+0000 7f06556db640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f063c0744e0 0x7f063c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.203+0000 7f06556db640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f063c0744e0 0x7f063c0769f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0650163580 tx=0x7f0644008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.207+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f06500b5490 con 0x7f06500d0b00 2024-04-25T15:46:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.381+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) -- 0x7f065006a100 con 0x7f06500d0b00 2024-04-25T15:46:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.384+0000 7f064e7fc640 1 -- 172.21.15.80:0/953980261 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7f064005f170 con 0x7f06500d0b00 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f063c0744e0 msgr2=0x7f063c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f063c0744e0 0x7f063c0769f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0650163580 tx=0x7f0644008040 comp rx=0 tx=0).stop 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 msgr2=0x7f0650162ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 0x7f0650162ce0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f064000cc60 tx=0x7f064000a430 comp rx=0 tx=0).stop 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 shutdown_connections 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f063c0744e0 0x7f063c0769f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065014c9f0 0x7f065014e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06500d2b80 0x7f065014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 --2- 172.21.15.80:0/953980261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06500d0b00 0x7f0650162ce0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 >> 172.21.15.80:0/953980261 conn(0x7f065006e650 msgr2=0x7f065015d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 shutdown_connections 2024-04-25T15:46:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.387+0000 7f0658140640 1 -- 172.21.15.80:0/953980261 wait complete. 2024-04-25T15:46:12.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-04-25T15:46:12.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.505+0000 7f006d7a8640 1 Processor -- start 2024-04-25T15:46:12.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.505+0000 7f006d7a8640 1 -- start start 2024-04-25T15:46:12.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f006d7a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00680d12e0 0x7f00680d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f006d7a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00680b7de0 0x7f00680ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f006d7a8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00680b9620 con 0x7f00681604b0 2024-04-25T15:46:12.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f006d7a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f00680d16f0 con 0x7f00680d12e0 2024-04-25T15:46:12.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f006d7a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f00680d1c10 con 0x7f00680b7de0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00680d12e0 0x7f00680d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00680d12e0 0x7f00680d4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41624/0 (socket says 172.21.15.80:41624) 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 -- 172.21.15.80:0/1959830567 learned_addr learned my addr 172.21.15.80:0/1959830567 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f00677fe640 1 --2- 172.21.15.80:0/1959830567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00680b7de0 0x7f00680ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 -- 172.21.15.80:0/1959830567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00680b7de0 msgr2=0x7f00680ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 --2- 172.21.15.80:0/1959830567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00680b7de0 0x7f00680ba380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 -- 172.21.15.80:0/1959830567 >> v1:172.21.15.195:6789/0 conn(0x7f00681604b0 legacy=0x7f00680b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.506+0000 7f0066ffd640 1 -- 172.21.15.80:0/1959830567 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00680d1930 con 0x7f00680d12e0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.507+0000 7f0066ffd640 1 --2- 172.21.15.80:0/1959830567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00680d12e0 0x7f00680d4230 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0058009e80 tx=0x7f005802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c695db2c967c7c8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.507+0000 7f0065ffb640 1 -- 172.21.15.80:0/1959830567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058036070 con 0x7f00680d12e0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.507+0000 7f0065ffb640 1 -- 172.21.15.80:0/1959830567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0058031600 con 0x7f00680d12e0 2024-04-25T15:46:12.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.507+0000 7f0065ffb640 1 -- 172.21.15.80:0/1959830567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580319d0 con 0x7f00680d12e0 2024-04-25T15:46:12.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 -- 172.21.15.80:0/1959830567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00680d12e0 msgr2=0x7f00680d4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1959830567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00680d12e0 0x7f00680d4230 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0058009e80 tx=0x7f005802a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 -- 172.21.15.80:0/1959830567 shutdown_connections 2024-04-25T15:46:12.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1959830567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00680b7de0 0x7f00680ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1959830567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00680d12e0 0x7f00680d4230 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 -- 172.21.15.80:0/1959830567 >> 172.21.15.80:0/1959830567 conn(0x7f006806e7c0 msgr2=0x7f006806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:12.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 -- 172.21.15.80:0/1959830567 shutdown_connections 2024-04-25T15:46:12.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.508+0000 7f006d7a8640 1 -- 172.21.15.80:0/1959830567 wait complete. 2024-04-25T15:46:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.510+0000 7f006d7a8640 1 Processor -- start 2024-04-25T15:46:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.510+0000 7f006d7a8640 1 -- start start 2024-04-25T15:46:12.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f006d7a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00680d12e0 0x7f0068158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f006d7a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 0x7f00680cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f006d7a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00681f9c70 0x7f00681fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f006d7a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f00680b9e60 con 0x7f00681604b0 2024-04-25T15:46:12.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f006d7a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f00680b9b80 con 0x7f00680d12e0 2024-04-25T15:46:12.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f006d7a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f00681608c0 con 0x7f00681f9c70 2024-04-25T15:46:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f00667fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 0x7f00680cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f00667fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 0x7f00680cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41634/0 (socket says 172.21.15.80:41634) 2024-04-25T15:46:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.511+0000 7f00667fc640 1 -- 172.21.15.80:0/1056728861 learned_addr learned my addr 172.21.15.80:0/1056728861 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f00667fc640 1 -- 172.21.15.80:0/1056728861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00681f9c70 msgr2=0x7f00681fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f00667fc640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00681f9c70 0x7f00681fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f00667fc640 1 -- 172.21.15.80:0/1056728861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00680d12e0 msgr2=0x7f0068158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f00667fc640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00680d12e0 0x7f0068158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f00667fc640 1 -- 172.21.15.80:0/1056728861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00681f9a30 con 0x7f00681604b0 2024-04-25T15:46:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f00667fc640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 0x7f00680cb0f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f005c00b3f0 tx=0x7f005c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c015020 con 0x7f00681604b0 2024-04-25T15:46:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c011830 con 0x7f00681604b0 2024-04-25T15:46:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c011c20 con 0x7f00681604b0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0068158f50 con 0x7f00681604b0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.512+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00680cbe90 con 0x7f00681604b0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.513+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00680cb920 con 0x7f00681604b0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.514+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f005c018020 con 0x7f00681604b0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.514+0000 7f004f7fe640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00540744e0 0x7f00540769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.514+0000 7f0066ffd640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00540744e0 0x7f00540769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.514+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7f005c0950e0 con 0x7f00681604b0 2024-04-25T15:46:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.515+0000 7f0066ffd640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00540744e0 0x7f00540769f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0058033000 tx=0x7f005802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.518+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f005c01f030 con 0x7f00681604b0 2024-04-25T15:46:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:12.761+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) -- 0x7f00680cbbb0 con 0x7f00681604b0 2024-04-25T15:46:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.753+0000 7f004f7fe640 1 -- 172.21.15.80:0/1056728861 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v207) ==== 143+0+0 (secure 0 0 0) 0x7f005c05f9c0 con 0x7f00681604b0 2024-04-25T15:46:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00540744e0 msgr2=0x7f00540769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00540744e0 0x7f00540769f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0058033000 tx=0x7f005802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 msgr2=0x7f00680cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 0x7f00680cb0f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f005c00b3f0 tx=0x7f005c00b8b0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 shutdown_connections 2024-04-25T15:46:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00540744e0 0x7f00540769f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00681f9c70 0x7f00681fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681604b0 0x7f00680cb0f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 --2- 172.21.15.80:0/1056728861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00680d12e0 0x7f0068158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 >> 172.21.15.80:0/1056728861 conn(0x7f006806e7c0 msgr2=0x7f0068161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 shutdown_connections 2024-04-25T15:46:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.756+0000 7f006d7a8640 1 -- 172.21.15.80:0/1056728861 wait complete. 2024-04-25T15:46:13.770 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-04-25T15:46:13.770 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-04-25T15:46:13.770 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-25T15:46:13.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:13.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.881+0000 7f083af84640 1 Processor -- start 2024-04-25T15:46:13.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.881+0000 7f083af84640 1 -- start start 2024-04-25T15:46:13.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f083af84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08340b48d0 0x7f08340b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f083af84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f08340d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f083af84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08340b7fa0 con 0x7f08340d41b0 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f083af84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0834163fb0 con 0x7f08340b48d0 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f083af84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0834164270 con 0x7f08340b7b90 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0833fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08340b48d0 0x7f08340b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0838d20640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f08340d41b0 0x7f08341602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42270/0 (socket says 172.21.15.80:42270) 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0833fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08340b48d0 0x7f08340b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41644/0 (socket says 172.21.15.80:41644) 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0838d20640 1 -- 172.21.15.80:0/1531336787 learned_addr learned my addr 172.21.15.80:0/1531336787 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0839521640 1 --2- 172.21.15.80:0/1531336787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f08340d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0833fff640 1 -- 172.21.15.80:0/1531336787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 msgr2=0x7f08340d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0833fff640 1 --2- 172.21.15.80:0/1531336787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f08340d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0833fff640 1 -- 172.21.15.80:0/1531336787 >> v1:172.21.15.80:6789/0 conn(0x7f08340d41b0 legacy=0x7f08341602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f0833fff640 1 -- 172.21.15.80:0/1531336787 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0834164550 con 0x7f08340b48d0 2024-04-25T15:46:13.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.882+0000 7f08337fe640 1 -- 172.21.15.80:0/1531336787 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028169030 0 0) 0x7f081c001110 con 0x7f08340d41b0 2024-04-25T15:46:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.883+0000 7f0833fff640 1 --2- 172.21.15.80:0/1531336787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f08340b7650 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f08240097a0 tx=0x7f082402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644a7a159a01f9d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.883+0000 7f08337fe640 1 -- 172.21.15.80:0/1531336787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824037070 con 0x7f08340b48d0 2024-04-25T15:46:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.883+0000 7f08337fe640 1 -- 172.21.15.80:0/1531336787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0824032440 con 0x7f08340b48d0 2024-04-25T15:46:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.883+0000 7f08337fe640 1 -- 172.21.15.80:0/1531336787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824032810 con 0x7f08340b48d0 2024-04-25T15:46:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 -- 172.21.15.80:0/1531336787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 msgr2=0x7f08340b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 --2- 172.21.15.80:0/1531336787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f08340b7650 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f08240097a0 tx=0x7f082402a180 comp rx=0 tx=0).stop 2024-04-25T15:46:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 -- 172.21.15.80:0/1531336787 shutdown_connections 2024-04-25T15:46:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 --2- 172.21.15.80:0/1531336787 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f08340d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 --2- 172.21.15.80:0/1531336787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f08340b7650 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 -- 172.21.15.80:0/1531336787 >> 172.21.15.80:0/1531336787 conn(0x7f083406e9f0 msgr2=0x7f08340d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 -- 172.21.15.80:0/1531336787 shutdown_connections 2024-04-25T15:46:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.884+0000 7f083af84640 1 -- 172.21.15.80:0/1531336787 wait complete. 2024-04-25T15:46:13.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.886+0000 7f083af84640 1 Processor -- start 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.886+0000 7f083af84640 1 -- start start 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f083af84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f083414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f083af84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f0834162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f083af84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08340d41b0 0x7f083415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f083af84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08340b4fd0 con 0x7f08340b48d0 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f083af84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0834164b10 con 0x7f08340d41b0 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f083af84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f08340b5150 con 0x7f08340b7b90 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f0838d20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f083414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f0838d20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f083414aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41656/0 (socket says 172.21.15.80:41656) 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.887+0000 7f0838d20640 1 -- 172.21.15.80:0/136206318 learned_addr learned my addr 172.21.15.80:0/136206318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0833fff640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f0834162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:13.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0839521640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08340d41b0 0x7f083415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0838d20640 1 -- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 msgr2=0x7f0834162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0838d20640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f0834162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0838d20640 1 -- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08340d41b0 msgr2=0x7f083415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0838d20640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08340d41b0 0x7f083415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0838d20640 1 -- 172.21.15.80:0/136206318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08341637a0 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f0838d20640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f083414aea0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c430 tx=0x7f081c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c0074e0 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f081c0047e0 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c004bd0 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0834163a80 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.888+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08340cb940 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.889+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083406a100 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.890+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f081c011070 con 0x7f08340b48d0 2024-04-25T15:46:13.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.890+0000 7f08317fa640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08140744e0 0x7f08140769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:13.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.890+0000 7f0833fff640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08140744e0 0x7f08140769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:13.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.890+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7f081c094cc0 con 0x7f08340b48d0 2024-04-25T15:46:13.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.891+0000 7f0833fff640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08140744e0 0x7f08140769f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0824034000 tx=0x7f082402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:13.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:13.895+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08340b7fa0 con 0x7f08340b48d0 2024-04-25T15:46:14.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.071+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0834163c50 con 0x7f08340b48d0 2024-04-25T15:46:14.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.072+0000 7f08317fa640 1 -- 172.21.15.80:0/136206318 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+13280 (secure 0 0 0) 0x7f081c05f650 con 0x7f08340b48d0 2024-04-25T15:46:14.073 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:14.073 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:11.742683+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/231548395":"2024-04-26T15:46:08.732227+0000","172.21.15.80:6835/231548395":"2024-04-26T15:46:08.732227+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:14.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08140744e0 msgr2=0x7f08140769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08140744e0 0x7f08140769f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0824034000 tx=0x7f082402e000 comp rx=0 tx=0).stop 2024-04-25T15:46:14.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 msgr2=0x7f083414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f083414aea0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c430 tx=0x7f081c00c8f0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 shutdown_connections 2024-04-25T15:46:14.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08140744e0 0x7f08140769f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08340d41b0 0x7f083415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08340b7b90 0x7f0834162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 --2- 172.21.15.80:0/136206318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08340b48d0 0x7f083414aea0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 >> 172.21.15.80:0/136206318 conn(0x7f083406e9f0 msgr2=0x7f08340b9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:14.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 shutdown_connections 2024-04-25T15:46:14.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.074+0000 7f083af84640 1 -- 172.21.15.80:0/136206318 wait complete. 2024-04-25T15:46:14.086 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:14.086 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:14.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.196+0000 7f4dab3d7640 1 Processor -- start 2024-04-25T15:46:14.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.196+0000 7f4dab3d7640 1 -- start start 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.197+0000 7f4dab3d7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.197+0000 7f4dab3d7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4da4070c10 0x7f4da406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.197+0000 7f4dab3d7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da4161a00 con 0x7f4da4071020 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.197+0000 7f4dab3d7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4da40d1530 con 0x7f4da4070c10 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.197+0000 7f4dab3d7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4da4162610 con 0x7f4da415f170 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da8972640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4da4070c10 0x7f4da406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da9974640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4da4071020 0x7f4da406f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42286/0 (socket says 172.21.15.80:42286) 2024-04-25T15:46:14.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da8972640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4da4070c10 0x7f4da406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41660/0 (socket says 172.21.15.80:41660) 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da9974640 1 -- 172.21.15.80:0/3381767182 learned_addr learned my addr 172.21.15.80:0/3381767182 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da9173640 1 --2- 172.21.15.80:0/3381767182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da8972640 1 -- 172.21.15.80:0/3381767182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 msgr2=0x7f4da40d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da8972640 1 --2- 172.21.15.80:0/3381767182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da8972640 1 -- 172.21.15.80:0/3381767182 >> v1:172.21.15.80:6789/0 conn(0x7f4da4071020 legacy=0x7f4da406f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4d9bfff640 1 -- 172.21.15.80:0/3381767182 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139131884 0 0) 0x7f4da4161a00 con 0x7f4da4071020 2024-04-25T15:46:14.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.198+0000 7f4da8972640 1 -- 172.21.15.80:0/3381767182 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da4161ce0 con 0x7f4da4070c10 2024-04-25T15:46:14.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4da8972640 1 --2- 172.21.15.80:0/3381767182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4070c10 0x7f4da406d5d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097a0 tx=0x7f4d9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd7248363e3acf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:14.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4d9bfff640 1 -- 172.21.15.80:0/3381767182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94037070 con 0x7f4da4070c10 2024-04-25T15:46:14.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4d9bfff640 1 -- 172.21.15.80:0/3381767182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94032440 con 0x7f4da4070c10 2024-04-25T15:46:14.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4d9bfff640 1 -- 172.21.15.80:0/3381767182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94032810 con 0x7f4da4070c10 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4dab3d7640 1 -- 172.21.15.80:0/3381767182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4070c10 msgr2=0x7f4da406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/3381767182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4070c10 0x7f4da406d5d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097a0 tx=0x7f4d9402a180 comp rx=0 tx=0).stop 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4dab3d7640 1 -- 172.21.15.80:0/3381767182 shutdown_connections 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/3381767182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4070c10 0x7f4da406d5d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/3381767182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.199+0000 7f4dab3d7640 1 -- 172.21.15.80:0/3381767182 >> 172.21.15.80:0/3381767182 conn(0x7f4da40734b0 msgr2=0x7f4da40738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.200+0000 7f4dab3d7640 1 -- 172.21.15.80:0/3381767182 shutdown_connections 2024-04-25T15:46:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.200+0000 7f4dab3d7640 1 -- 172.21.15.80:0/3381767182 wait complete. 2024-04-25T15:46:14.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.201+0000 7f4dab3d7640 1 Processor -- start 2024-04-25T15:46:14.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.201+0000 7f4dab3d7640 1 -- start start 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da4070c10 0x7f4da41453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 0x7f4da4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40af840 con 0x7f4da4071020 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41622a0 con 0x7f4da4070c10 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4da40af9c0 con 0x7f4da415f170 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 0x7f4da4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 0x7f4da4158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41666/0 (socket says 172.21.15.80:41666) 2024-04-25T15:46:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 -- 172.21.15.80:0/2311628076 learned_addr learned my addr 172.21.15.80:0/2311628076 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da9173640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da4070c10 0x7f4da41453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da9974640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 -- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 msgr2=0x7f4da40cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 -- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da4070c10 msgr2=0x7f4da41453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da4070c10 0x7f4da41453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 -- 172.21.15.80:0/2311628076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da40cb110 con 0x7f4da4071020 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da9173640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da4070c10 0x7f4da41453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da9974640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4da8972640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 0x7f4da4158ea0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097a0 tx=0x7f4d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94037050 con 0x7f4da4071020 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94038040 con 0x7f4da4071020 2024-04-25T15:46:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da40b4a80 con 0x7f4da4071020 2024-04-25T15:46:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.203+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004490 con 0x7f4da4071020 2024-04-25T15:46:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.204+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da40b5000 con 0x7f4da4071020 2024-04-25T15:46:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.205+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da406a100 con 0x7f4da4071020 2024-04-25T15:46:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.205+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4d9403c6d0 con 0x7f4da4071020 2024-04-25T15:46:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.206+0000 7f4d99ffb640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d880744b0 0x7f4d880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.206+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7f4d940b5a00 con 0x7f4da4071020 2024-04-25T15:46:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.206+0000 7f4da9173640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d880744b0 0x7f4d880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.206+0000 7f4da9173640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d880744b0 0x7f4d880769c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4da4073090 tx=0x7f4da0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:14.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.210+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d94080420 con 0x7f4da4071020 2024-04-25T15:46:14.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.383+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4da4074570 con 0x7f4da4071020 2024-04-25T15:46:14.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.383+0000 7f4d99ffb640 1 -- 172.21.15.80:0/2311628076 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f4d94088410 con 0x7f4da4071020 2024-04-25T15:46:14.385 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.385+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d880744b0 msgr2=0x7f4d880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.385+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d880744b0 0x7f4d880769c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4da4073090 tx=0x7f4da0008040 comp rx=0 tx=0).stop 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.385+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 msgr2=0x7f4da4158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.385+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 0x7f4da4158ea0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097a0 tx=0x7f4d940046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 shutdown_connections 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d880744b0 0x7f4d880769c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4da415f170 0x7f4da40cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4da4071020 0x7f4da4158ea0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 --2- 172.21.15.80:0/2311628076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da4070c10 0x7f4da41453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 >> 172.21.15.80:0/2311628076 conn(0x7f4da40734b0 msgr2=0x7f4da40cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:14.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 shutdown_connections 2024-04-25T15:46:14.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.386+0000 7f4dab3d7640 1 -- 172.21.15.80:0/2311628076 wait complete. 2024-04-25T15:46:14.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-04-25T15:46:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.504+0000 7fc3c68af640 1 Processor -- start 2024-04-25T15:46:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.504+0000 7fc3c68af640 1 -- start start 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3c68af640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3c00cfc40 0x7fc3c0160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3c68af640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c0071bb0 0x7fc3c00b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3c68af640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c00b6eb0 con 0x7fc3c0164690 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3c68af640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c00b7150 con 0x7fc3c00cfc40 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3c68af640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c00b51e0 con 0x7fc3c0071bb0 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3c00cfc40 0x7fc3c0160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bf7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3c0164690 0x7fc3c00714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36474/0 (socket says 172.21.15.80:36474) 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bf7fe640 1 -- 172.21.15.80:0/2087429119 learned_addr learned my addr 172.21.15.80:0/2087429119 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:14.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3c4e4c640 1 --2- 172.21.15.80:0/2087429119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c0071bb0 0x7fc3c00b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bffff640 1 -- 172.21.15.80:0/2087429119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c0071bb0 msgr2=0x7fc3c00b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bffff640 1 --2- 172.21.15.80:0/2087429119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c0071bb0 0x7fc3c00b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bffff640 1 -- 172.21.15.80:0/2087429119 >> v1:172.21.15.80:6789/0 conn(0x7fc3c0164690 legacy=0x7fc3c00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3bffff640 1 -- 172.21.15.80:0/2087429119 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00b54c0 con 0x7fc3c00cfc40 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.506+0000 7fc3beffd640 1 -- 172.21.15.80:0/2087429119 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035872656 0 0) 0x7fc3c00b6eb0 con 0x7fc3c0164690 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.507+0000 7fc3bffff640 1 --2- 172.21.15.80:0/2087429119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c00cfc40 0x7fc3c0160200 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00097a0 tx=0x7fc3b002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e38fb6d052eb80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.507+0000 7fc3beffd640 1 -- 172.21.15.80:0/2087429119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0037070 con 0x7fc3c00cfc40 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.507+0000 7fc3beffd640 1 -- 172.21.15.80:0/2087429119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b002ae50 con 0x7fc3c00cfc40 2024-04-25T15:46:14.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.507+0000 7fc3beffd640 1 -- 172.21.15.80:0/2087429119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0032660 con 0x7fc3c00cfc40 2024-04-25T15:46:14.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 -- 172.21.15.80:0/2087429119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c00cfc40 msgr2=0x7fc3c0160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 --2- 172.21.15.80:0/2087429119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c00cfc40 0x7fc3c0160200 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00097a0 tx=0x7fc3b002a100 comp rx=0 tx=0).stop 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 -- 172.21.15.80:0/2087429119 shutdown_connections 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 --2- 172.21.15.80:0/2087429119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c0071bb0 0x7fc3c00b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 --2- 172.21.15.80:0/2087429119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c00cfc40 0x7fc3c0160200 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 -- 172.21.15.80:0/2087429119 >> 172.21.15.80:0/2087429119 conn(0x7fc3c00d2080 msgr2=0x7fc3c00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 -- 172.21.15.80:0/2087429119 shutdown_connections 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.508+0000 7fc3c68af640 1 -- 172.21.15.80:0/2087429119 wait complete. 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.509+0000 7fc3c68af640 1 Processor -- start 2024-04-25T15:46:14.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.510+0000 7fc3c68af640 1 -- start start 2024-04-25T15:46:14.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c68af640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c00cfc40 0x7fc3c01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c68af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 0x7fc3c00cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c68af640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3c01597a0 0x7fc3c0159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c68af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00b6b70 con 0x7fc3c0164690 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c68af640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c0072040 con 0x7fc3c01597a0 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c68af640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c0164aa0 con 0x7fc3c00cfc40 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 0x7fc3c00cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 0x7fc3c00cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35072/0 (socket says 172.21.15.80:35072) 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 -- 172.21.15.80:0/3671404222 learned_addr learned my addr 172.21.15.80:0/3671404222 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bffff640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c00cfc40 0x7fc3c01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3c4e4c640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3c01597a0 0x7fc3c0159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 -- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c00cfc40 msgr2=0x7fc3c01509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c00cfc40 0x7fc3c01509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 -- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3c01597a0 msgr2=0x7fc3c0159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3c01597a0 0x7fc3c0159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 -- 172.21.15.80:0/3671404222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c015a0f0 con 0x7fc3c0164690 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bffff640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c00cfc40 0x7fc3c01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bf7fe640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 0x7fc3c00cc0e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c430 tx=0x7fc3a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.511+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8017070 con 0x7fc3c0164690 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.512+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a8005ce0 con 0x7fc3c0164690 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.512+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c00ccb60 con 0x7fc3c0164690 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.512+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8007310 con 0x7fc3c0164690 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.512+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c00cd340 con 0x7fc3c0164690 2024-04-25T15:46:14.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.512+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c00ccdd0 con 0x7fc3c0164690 2024-04-25T15:46:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.513+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc3a801a070 con 0x7fc3c0164690 2024-04-25T15:46:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.514+0000 7fc3bcff9640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3a00744b0 0x7fc3a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.514+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7fc3a80944b0 con 0x7fc3c0164690 2024-04-25T15:46:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.514+0000 7fc3bffff640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3a00744b0 0x7fc3a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:14.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.514+0000 7fc3bffff640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3a00744b0 0x7fc3a00769c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0034000 tx=0x7fc3b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:14.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.518+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3c015a0f0 con 0x7fc3c0164690 2024-04-25T15:46:14.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:14.759+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) -- 0x7fc3c006a100 con 0x7fc3c0164690 2024-04-25T15:46:15.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.759+0000 7fc3bcff9640 1 -- 172.21.15.80:0/3671404222 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v209) ==== 148+0+0 (secure 0 0 0) 0x7fc3a805edb0 con 0x7fc3c0164690 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.762+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3a00744b0 msgr2=0x7fc3a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.762+0000 7fc3c68af640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3a00744b0 0x7fc3a00769c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0034000 tx=0x7fc3b002e000 comp rx=0 tx=0).stop 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.762+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 msgr2=0x7fc3c00cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.762+0000 7fc3c68af640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 0x7fc3c00cc0e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c430 tx=0x7fc3a800c8f0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 shutdown_connections 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3a00744b0 0x7fc3a00769c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3c01597a0 0x7fc3c0159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3c0164690 0x7fc3c00cc0e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 --2- 172.21.15.80:0/3671404222 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3c00cfc40 0x7fc3c01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 >> 172.21.15.80:0/3671404222 conn(0x7fc3c00d2080 msgr2=0x7fc3c00b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 shutdown_connections 2024-04-25T15:46:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.763+0000 7fc3c68af640 1 -- 172.21.15.80:0/3671404222 wait complete. 2024-04-25T15:46:15.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T15:46:15.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.890+0000 7fb1fe14e640 1 Processor -- start 2024-04-25T15:46:15.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.890+0000 7fb1fe14e640 1 -- start start 2024-04-25T15:46:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1fe14e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1f80d0b00 0x7fb1f80d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1fe14e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb1f80d2b80 0x7fb1f80d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1fe14e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f81643f0 con 0x7fb1f80b5490 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1fe14e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f81646d0 con 0x7fb1f80d0b00 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1fe14e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f81649b0 con 0x7fb1f80d2b80 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1f77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb1f80b5490 0x7fb1f8160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36482/0 (socket says 172.21.15.80:36482) 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1f77fe640 1 -- 172.21.15.80:0/84003451 learned_addr learned my addr 172.21.15.80:0/84003451 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.891+0000 7fb1f6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1f80d0b00 0x7fb1f80d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f67fc640 1 -- 172.21.15.80:0/84003451 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288513379 0 0) 0x7fb1f81643f0 con 0x7fb1f80b5490 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f67fc640 1 -- 172.21.15.80:0/84003451 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e0003520 con 0x7fb1f80b5490 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f6ffd640 1 -- 172.21.15.80:0/84003451 >> v2:172.21.15.195:3300/0 conn(0x7fb1f80d2b80 msgr2=0x7fb1f80d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f7fff640 1 --2- 172.21.15.80:0/84003451 >> v2:172.21.15.195:3300/0 conn(0x7fb1f80d2b80 0x7fb1f80d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f6ffd640 1 --2- 172.21.15.80:0/84003451 >> v2:172.21.15.195:3300/0 conn(0x7fb1f80d2b80 0x7fb1f80d47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f6ffd640 1 -- 172.21.15.80:0/84003451 >> v1:172.21.15.80:6789/0 conn(0x7fb1f80b5490 legacy=0x7fb1f8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f6ffd640 1 -- 172.21.15.80:0/84003451 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f8164c90 con 0x7fb1f80d0b00 2024-04-25T15:46:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f6ffd640 1 --2- 172.21.15.80:0/84003451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80d0b00 0x7fb1f80d2640 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb1f808f0b0 tx=0x7fb1ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a3230110136440 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:15.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f67fc640 1 -- 172.21.15.80:0/84003451 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec037070 con 0x7fb1f80d0b00 2024-04-25T15:46:15.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f67fc640 1 -- 172.21.15.80:0/84003451 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec032440 con 0x7fb1f80d0b00 2024-04-25T15:46:15.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.892+0000 7fb1f67fc640 1 -- 172.21.15.80:0/84003451 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec032810 con 0x7fb1f80d0b00 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 -- 172.21.15.80:0/84003451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80d0b00 msgr2=0x7fb1f80d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/84003451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80d0b00 0x7fb1f80d2640 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb1f808f0b0 tx=0x7fb1ec02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 -- 172.21.15.80:0/84003451 shutdown_connections 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/84003451 >> v2:172.21.15.195:3300/0 conn(0x7fb1f80d2b80 0x7fb1f80d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/84003451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80d0b00 0x7fb1f80d2640 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 -- 172.21.15.80:0/84003451 >> 172.21.15.80:0/84003451 conn(0x7fb1f806e650 msgr2=0x7fb1f806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 -- 172.21.15.80:0/84003451 shutdown_connections 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.893+0000 7fb1fe14e640 1 -- 172.21.15.80:0/84003451 wait complete. 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.895+0000 7fb1fe14e640 1 Processor -- start 2024-04-25T15:46:15.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.895+0000 7fb1fe14e640 1 -- start start 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1fe14e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f80d0b00 0x7fb1f81500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1fe14e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1f80d2b80 0x7fb1f81f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1fe14e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 0x7fb1f81f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1fe14e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f80b94e0 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1fe14e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f80b9360 con 0x7fb1f80d0b00 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1fe14e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f8163f80 con 0x7fb1f80d2b80 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.896+0000 7fb1f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 0x7fb1f81f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:15.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 0x7fb1f81f9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35098/0 (socket says 172.21.15.80:35098) 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 -- 172.21.15.80:0/4086112418 learned_addr learned my addr 172.21.15.80:0/4086112418 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f6ffd640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1f80d2b80 0x7fb1f81f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f77fe640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f80d0b00 0x7fb1f81500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 -- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1f80d2b80 msgr2=0x7fb1f81f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1f80d2b80 0x7fb1f81f9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 -- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f80d0b00 msgr2=0x7fb1f81500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f80d0b00 0x7fb1f81500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 -- 172.21.15.80:0/4086112418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f81fa6b0 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f77fe640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f80d0b00 0x7fb1f81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1f7fff640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 0x7fb1f81f9d50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000cc00 tx=0x7fb1f000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000ce10 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f0003990 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f81f6270 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0003d60 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.897+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f80b6790 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.898+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f81fa420 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.899+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb1f0003f00 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.899+0000 7fb1dffff640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1e40744e0 0x7fb1e40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:15.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.900+0000 7fb1f77fe640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1e40744e0 0x7fb1e40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:15.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.900+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7fb1f0095590 con 0x7fb1f80ac7c0 2024-04-25T15:46:15.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.900+0000 7fb1f77fe640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1e40744e0 0x7fb1e40769f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8005880 tx=0x7fb1e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:15.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:15.904+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1f0014030 con 0x7fb1f80ac7c0 2024-04-25T15:46:16.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.079+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb1f806a100 con 0x7fb1f80ac7c0 2024-04-25T15:46:16.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.083+0000 7fb1dffff640 1 -- 172.21.15.80:0/4086112418 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fb1f005fe00 con 0x7fb1f80ac7c0 2024-04-25T15:46:16.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1e40744e0 msgr2=0x7fb1e40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1e40744e0 0x7fb1e40769f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8005880 tx=0x7fb1e8009040 comp rx=0 tx=0).stop 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 msgr2=0x7fb1f81f9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 0x7fb1f81f9d50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000cc00 tx=0x7fb1f000a5c0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 shutdown_connections 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1e40744e0 0x7fb1e40769f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1f80ac7c0 0x7fb1f81f9d50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1f80d2b80 0x7fb1f81f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 --2- 172.21.15.80:0/4086112418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f80d0b00 0x7fb1f81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 >> 172.21.15.80:0/4086112418 conn(0x7fb1f806e650 msgr2=0x7fb1f815f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 shutdown_connections 2024-04-25T15:46:16.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.085+0000 7fb1fe14e640 1 -- 172.21.15.80:0/4086112418 wait complete. 2024-04-25T15:46:16.097 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:46:16.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:16.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:16.184 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:46:16.185 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:16.185 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:16.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:16.200 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:16.200 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:16.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:16.242 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:16.242 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:16.257 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:16.257 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:16.257 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:16.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:16.300 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T15:46:16.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.405+0000 7fc984f3f640 1 Processor -- start 2024-04-25T15:46:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.405+0000 7fc984f3f640 1 -- start start 2024-04-25T15:46:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc984f3f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 0x7fc9800d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc984f3f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9800d33e0 con 0x7fc980072560 2024-04-25T15:46:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc984f3f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9801624d0 con 0x7fc980071950 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc984f3f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9801627b0 con 0x7fc9800d2a90 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97dd9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc980072560 0x7fc9800b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36486/0 (socket says 172.21.15.80:36486) 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97dd9b640 1 -- 172.21.15.80:0/1579063907 learned_addr learned my addr 172.21.15.80:0/1579063907 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97ed9d640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 0x7fc9800d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980872638 0 0) 0x7fc974001290 con 0x7fc980072560 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc968003520 con 0x7fc980072560 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 421910902 0 0) 0x7fc968003520 con 0x7fc980072560 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 msgr2=0x7fc9800d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 0x7fc9800d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 >> v1:172.21.15.195:6789/0 conn(0x7fc980071950 legacy=0x7fc980161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc980162a90 con 0x7fc980072560 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc9740019c0 con 0x7fc980072560 2024-04-25T15:46:16.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 >> v1:172.21.15.80:6789/0 conn(0x7fc980072560 legacy=0x7fc9800b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9680039e0 0x7fc968003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 0x7fc968004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc968004d40 0x7fc968005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc9801627b0 con 0x7fc9680039e0 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc96800bb50 con 0x7fc968004d40 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.407+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc96800bd20 con 0x7fc9800d2a90 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9680039e0 0x7fc968003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97ed9d640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc968004d40 0x7fc968005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97dd9b640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 0x7fc968004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 -- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 msgr2=0x7fc968004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9800d2a90 0x7fc968004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 -- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc968004d40 msgr2=0x7fc968005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc968004d40 0x7fc968005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 -- 172.21.15.80:0/1579063907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc968003520 con 0x7fc9680039e0 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.408+0000 7fc97e59c640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9680039e0 0x7fc968003e10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc970001830 tx=0x7fc968005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869dc0912326328a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970037070 con 0x7fc9680039e0 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97002abf0 con 0x7fc9680039e0 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc97d59a640 1 -- 172.21.15.80:0/1579063907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970001430 con 0x7fc9680039e0 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc984f3f640 1 -- 172.21.15.80:0/1579063907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9680039e0 msgr2=0x7fc968003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc984f3f640 1 --2- 172.21.15.80:0/1579063907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9680039e0 0x7fc968003e10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc970001830 tx=0x7fc968005830 comp rx=0 tx=0).stop 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc97ed9d640 1 -- 172.21.15.80:0/1579063907 reap_dead start 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc984f3f640 1 -- 172.21.15.80:0/1579063907 shutdown_connections 2024-04-25T15:46:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc984f3f640 1 -- 172.21.15.80:0/1579063907 >> 172.21.15.80:0/1579063907 conn(0x7fc9800d3ea0 msgr2=0x7fc9800d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc984f3f640 1 -- 172.21.15.80:0/1579063907 shutdown_connections 2024-04-25T15:46:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.409+0000 7fc984f3f640 1 -- 172.21.15.80:0/1579063907 wait complete. 2024-04-25T15:46:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.411+0000 7fc984f3f640 1 Processor -- start 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.411+0000 7fc984f3f640 1 -- start start 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9680039e0 0x7fc9801591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98006d6d0 0x7fc98006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 0x7fc9800cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800b7690 con 0x7fc9800cdbc0 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc980072970 con 0x7fc9680039e0 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9800b7810 con 0x7fc98006d6d0 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 0x7fc9800cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 0x7fc9800cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35122/0 (socket says 172.21.15.80:35122) 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 -- 172.21.15.80:0/987150264 learned_addr learned my addr 172.21.15.80:0/987150264 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97dd9b640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98006d6d0 0x7fc98006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97e59c640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9680039e0 0x7fc9801591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 -- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98006d6d0 msgr2=0x7fc98006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98006d6d0 0x7fc98006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 -- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9680039e0 msgr2=0x7fc9801591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9680039e0 0x7fc9801591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 -- 172.21.15.80:0/987150264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9800ce510 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97e59c640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9680039e0 0x7fc9801591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc97ed9d640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 0x7fc9800cdfd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc9800b9740 tx=0x7fc9780115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978011db0 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97801b070 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98006ddb0 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978003990 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.413+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98006e370 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.414+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98006a100 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.415+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc978005d10 con 0x7fc9800cdbc0 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.415+0000 7fc96effd640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.415+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5335+0+0 (secure 0 0 0) 0x7fc9780954f0 con 0x7fc9800cdbc0 2024-04-25T15:46:16.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.415+0000 7fc97e59c640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.416+0000 7fc97e59c640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc970034000 tx=0x7fc970009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.420+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc978025020 con 0x7fc9800cdbc0 2024-04-25T15:46:16.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.630+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc980162150 con 0x7fc9800cdbc0 2024-04-25T15:46:16.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.630+0000 7fc96effd640 1 -- 172.21.15.80:0/987150264 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+3872 (secure 0 0 0) 0x7fc9800ce510 con 0x7fc9800cdbc0 2024-04-25T15:46:16.631 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:16.632 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3543589774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3543589774},{"type":"v1","addr":"172.21.15.195:6834","nonce":3543589774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6112,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/569843588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":569843588},{"type":"v1","addr":"172.21.15.195:6835","nonce":569843588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2736823327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2736823327},{"type":"v1","addr":"172.21.15.80:6836","nonce":2736823327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":7056,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1871242272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1871242272},{"type":"v1","addr":"172.21.15.80:6837","nonce":1871242272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[]} 2024-04-25T15:46:16.632 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 37 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.632+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 msgr2=0x7fc9600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.632+0000 7fc984f3f640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc970034000 tx=0x7fc970009030 comp rx=0 tx=0).stop 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.632+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 msgr2=0x7fc9800cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.632+0000 7fc984f3f640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 0x7fc9800cdfd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc9800b9740 tx=0x7fc9780115a0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 shutdown_connections 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9800cdbc0 0x7fc9800cdfd0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc98006d6d0 0x7fc98006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 --2- 172.21.15.80:0/987150264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9680039e0 0x7fc9801591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 >> 172.21.15.80:0/987150264 conn(0x7fc9800d3ea0 msgr2=0x7fc9800c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:16.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 shutdown_connections 2024-04-25T15:46:16.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:16.633+0000 7fc984f3f640 1 -- 172.21.15.80:0/987150264 wait complete. 2024-04-25T15:46:16.645 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:46:16.645 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T15:46:16.645 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:46:16.646 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:16.646 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:46:16.646 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T15:46:16.646 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:46:16.646 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:16.646 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:46:16.646 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T15:46:16.647 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:46:16.647 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:16.647 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:46:16.647 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T15:46:16.647 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:46:16.647 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:16.657 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:46:16.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:46:16.659 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:46:16.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:46:16.661 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:46:16.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:46:16.703 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:46:16.703 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:46:16.703 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:16.703 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:16.704 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:46:16.704 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:16.785 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:46:16.785 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:46:16.792 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:46:20.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T15:46:22.659 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:46:22.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:46:22.662 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:46:22.662 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:22.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T15:46:22.756 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:46:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.782+0000 7f6eca738640 1 Processor -- start 2024-04-25T15:46:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.782+0000 7f6eca738640 1 -- start start 2024-04-25T15:46:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6eca738640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ec4071950 0x7f6ec4072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6eca738640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6eca738640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec40d33e0 con 0x7f6ec4161c80 2024-04-25T15:46:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6eca738640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec4072aa0 con 0x7f6ec4071950 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6eca738640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec41624d0 con 0x7f6ec40d2a90 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ec4071950 0x7f6ec4072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ec4071950 0x7f6ec4072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35148/0 (socket says 172.21.15.80:35148) 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 -- 172.21.15.80:0/3450911827 learned_addr learned my addr 172.21.15.80:0/3450911827 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec8cd5640 1 --2- 172.21.15.80:0/3450911827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 -- 172.21.15.80:0/3450911827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 msgr2=0x7f6ec40d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 --2- 172.21.15.80:0/3450911827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 -- 172.21.15.80:0/3450911827 >> v1:172.21.15.195:6789/0 conn(0x7f6ec4161c80 legacy=0x7f6ec40b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:22.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.784+0000 7f6ec3fff640 1 -- 172.21.15.80:0/3450911827 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec41627b0 con 0x7f6ec4071950 2024-04-25T15:46:22.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.785+0000 7f6ec3fff640 1 --2- 172.21.15.80:0/3450911827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec4072560 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009870 tx=0x7f6eb402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899f4a7a4b2a4df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:22.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.787+0000 7f6ec2ffd640 1 -- 172.21.15.80:0/3450911827 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4037070 con 0x7f6ec4071950 2024-04-25T15:46:22.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.787+0000 7f6ec2ffd640 1 -- 172.21.15.80:0/3450911827 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4032440 con 0x7f6ec4071950 2024-04-25T15:46:22.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.787+0000 7f6ec2ffd640 1 -- 172.21.15.80:0/3450911827 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4032810 con 0x7f6ec4071950 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.787+0000 7f6eca738640 1 -- 172.21.15.80:0/3450911827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 msgr2=0x7f6ec4072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.787+0000 7f6eca738640 1 --2- 172.21.15.80:0/3450911827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec4072560 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009870 tx=0x7f6eb402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.788+0000 7f6eca738640 1 -- 172.21.15.80:0/3450911827 shutdown_connections 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.788+0000 7f6eca738640 1 --2- 172.21.15.80:0/3450911827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.788+0000 7f6eca738640 1 --2- 172.21.15.80:0/3450911827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec4072560 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.788+0000 7f6eca738640 1 -- 172.21.15.80:0/3450911827 >> 172.21.15.80:0/3450911827 conn(0x7f6ec40d3ea0 msgr2=0x7f6ec40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.788+0000 7f6eca738640 1 -- 172.21.15.80:0/3450911827 shutdown_connections 2024-04-25T15:46:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.788+0000 7f6eca738640 1 -- 172.21.15.80:0/3450911827 wait complete. 2024-04-25T15:46:22.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.789+0000 7f6eca738640 1 Processor -- start 2024-04-25T15:46:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.790+0000 7f6eca738640 1 -- start start 2024-04-25T15:46:22.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6eca738640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec40c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:22.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6eca738640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:22.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6eca738640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ec4161c80 0x7f6ec406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6eca738640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40b7690 con 0x7f6ec4071950 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6eca738640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40d2290 con 0x7f6ec4161c80 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6eca738640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec40b7810 con 0x7f6ec40d2a90 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6ec3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec40c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6ec3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec40c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35158/0 (socket says 172.21.15.80:35158) 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6ec3fff640 1 -- 172.21.15.80:0/1230306133 learned_addr learned my addr 172.21.15.80:0/1230306133 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6ec37fe640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.791+0000 7f6ec8cd5640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ec4161c80 0x7f6ec406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec3fff640 1 -- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 msgr2=0x7f6ec40cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec3fff640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec3fff640 1 -- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ec4161c80 msgr2=0x7f6ec406ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec3fff640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ec4161c80 0x7f6ec406ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec3fff640 1 -- 172.21.15.80:0/1230306133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec40b2460 con 0x7f6ec4071950 2024-04-25T15:46:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec3fff640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec40c81e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6eb402a200 tx=0x7f6eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4037040 con 0x7f6ec4071950 2024-04-25T15:46:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4042070 con 0x7f6ec4071950 2024-04-25T15:46:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec406def0 con 0x7f6ec4071950 2024-04-25T15:46:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4030880 con 0x7f6ec4071950 2024-04-25T15:46:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.792+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec406e4b0 con 0x7f6ec4071950 2024-04-25T15:46:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.793+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec406a100 con 0x7f6ec4071950 2024-04-25T15:46:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.794+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6eb402ad10 con 0x7f6ec4071950 2024-04-25T15:46:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.794+0000 7f6ec0ff9640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6eb00744e0 0x7f6eb00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.794+0000 7f6ec37fe640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6eb00744e0 0x7f6eb00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.794+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5335+0+0 (secure 0 0 0) 0x7f6eb40b5580 con 0x7f6ec4071950 2024-04-25T15:46:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.795+0000 7f6ec37fe640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6eb00744e0 0x7f6eb00769f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40725d0 tx=0x7f6eb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.799+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6eb407f830 con 0x7f6ec4071950 2024-04-25T15:46:22.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:22.986+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6ec40d1e40 con 0x7f6ec4071950 2024-04-25T15:46:23.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.796+0000 7f6ec0ff9640 1 -- 172.21.15.80:0/1230306133 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) ==== 97+0+0 (secure 0 0 0) 0x7f6eb4083b30 con 0x7f6ec4071950 2024-04-25T15:46:23.797 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-25T15:46:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6eb00744e0 msgr2=0x7f6eb00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6eb00744e0 0x7f6eb00769f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40725d0 tx=0x7f6eb8009040 comp rx=0 tx=0).stop 2024-04-25T15:46:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 msgr2=0x7f6ec40c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec40c81e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6eb402a200 tx=0x7f6eb40046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 shutdown_connections 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6eb00744e0 0x7f6eb00769f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ec4161c80 0x7f6ec406ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ec40d2a90 0x7f6ec40cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 --2- 172.21.15.80:0/1230306133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ec4071950 0x7f6ec40c81e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 >> 172.21.15.80:0/1230306133 conn(0x7f6ec40d3ea0 msgr2=0x7f6ec41610d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 shutdown_connections 2024-04-25T15:46:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.799+0000 7f6eca738640 1 -- 172.21.15.80:0/1230306133 wait complete. 2024-04-25T15:46:23.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T15:46:23.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.924+0000 7f4c3f140640 1 Processor -- start 2024-04-25T15:46:23.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.924+0000 7f4c3f140640 1 -- start start 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.925+0000 7f4c3f140640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c38160200 0x7f4c380714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.925+0000 7f4c3f140640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c38071df0 con 0x7f4c380719e0 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.925+0000 7f4c3f140640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c380b6eb0 con 0x7f4c380cfc40 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.925+0000 7f4c3f140640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4c38160610 con 0x7f4c38160200 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c37fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c38160200 0x7f4c380714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c3d6dd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4c380719e0 0x7f4c380b59e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36504/0 (socket says 172.21.15.80:36504) 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c37fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c38160200 0x7f4c380714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35170/0 (socket says 172.21.15.80:35170) 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c3d6dd640 1 -- 172.21.15.80:0/1556428993 learned_addr learned my addr 172.21.15.80:0/1556428993 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c37fff640 1 -- 172.21.15.80:0/1556428993 >> v1:172.21.15.195:6789/0 conn(0x7f4c380cfc40 legacy=0x7f4c38164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:23.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c37fff640 1 -- 172.21.15.80:0/1556428993 >> v1:172.21.15.80:6789/0 conn(0x7f4c380719e0 legacy=0x7f4c380b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c37fff640 1 -- 172.21.15.80:0/1556428993 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c380b7150 con 0x7f4c38160200 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.926+0000 7f4c37fff640 1 --2- 172.21.15.80:0/1556428993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c380714a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4c240097a0 tx=0x7f4c2402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c294ec9a7433777 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c377fe640 1 -- 172.21.15.80:0/1556428993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24037070 con 0x7f4c38160200 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c377fe640 1 -- 172.21.15.80:0/1556428993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2402ae50 con 0x7f4c38160200 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c377fe640 1 -- 172.21.15.80:0/1556428993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24032660 con 0x7f4c38160200 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 -- 172.21.15.80:0/1556428993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 msgr2=0x7f4c380714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 --2- 172.21.15.80:0/1556428993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c380714a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4c240097a0 tx=0x7f4c2402a140 comp rx=0 tx=0).stop 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 -- 172.21.15.80:0/1556428993 shutdown_connections 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 --2- 172.21.15.80:0/1556428993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c380714a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 -- 172.21.15.80:0/1556428993 >> 172.21.15.80:0/1556428993 conn(0x7f4c380d2080 msgr2=0x7f4c380d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:23.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 -- 172.21.15.80:0/1556428993 shutdown_connections 2024-04-25T15:46:23.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.927+0000 7f4c3f140640 1 -- 172.21.15.80:0/1556428993 wait complete. 2024-04-25T15:46:23.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.929+0000 7f4c3f140640 1 Processor -- start 2024-04-25T15:46:23.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.929+0000 7f4c3f140640 1 -- start start 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c380719e0 0x7f4c381eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c380cfc40 0x7f4c38161d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c381f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4c380b7430 con 0x7f4c38160200 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4c380b54c0 con 0x7f4c380cfc40 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c38072040 con 0x7f4c380719e0 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c381f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c381f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35172/0 (socket says 172.21.15.80:35172) 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 -- 172.21.15.80:0/2519863532 learned_addr learned my addr 172.21.15.80:0/2519863532 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c37fff640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c380cfc40 0x7f4c38161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3cedc640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c380719e0 0x7f4c381eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 -- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c380719e0 msgr2=0x7f4c381eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c380719e0 0x7f4c381eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 -- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c380cfc40 msgr2=0x7f4c38161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c380cfc40 0x7f4c38161d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 -- 172.21.15.80:0/2519863532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c381fa190 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3d6dd640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c381f6870 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000ca20 tx=0x7f4c3000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30017070 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3000abd0 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c381f74c0 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30012400 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.931+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c381ea460 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.932+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c380cef80 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.933+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4c3001a070 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.933+0000 7f4c357fa640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c1c0744b0 0x7f4c1c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.934+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f4c30094c40 con 0x7f4c38160200 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.934+0000 7f4c3cedc640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c1c0744b0 0x7f4c1c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.934+0000 7f4c3cedc640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c1c0744b0 0x7f4c1c0769c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c006fd0 tx=0x7f4c2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:23.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:23.938+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c380cef80 con 0x7f4c38160200 2024-04-25T15:46:24.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.179+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4c381f7250 con 0x7f4c38160200 2024-04-25T15:46:24.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.180+0000 7f4c357fa640 1 -- 172.21.15.80:0/2519863532 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f4c381fa190 con 0x7f4c38160200 2024-04-25T15:46:24.181 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:24.181 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:46:24.181 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-25T15:46:24.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw==", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q==", 2024-04-25T15:46:24.182 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA==", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw==", 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g==", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw==", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw==", 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q==", 2024-04-25T15:46:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw==", 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA==", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA==", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg==", 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw==", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw==", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:46:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g==", 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw==", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDMeSpmVFP1JxAAQ3NwNePUywfB5CkeGWRjfA==", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:46:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA==", 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:24.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og==", 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:46:24.194 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c1c0744b0 msgr2=0x7f4c1c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c1c0744b0 0x7f4c1c0769c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c006fd0 tx=0x7f4c2c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 msgr2=0x7f4c381f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c381f6870 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000ca20 tx=0x7f4c3000cee0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 shutdown_connections 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c1c0744b0 0x7f4c1c0769c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c38160200 0x7f4c381f6870 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c380cfc40 0x7f4c38161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 --2- 172.21.15.80:0/2519863532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c380719e0 0x7f4c381eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 >> 172.21.15.80:0/2519863532 conn(0x7f4c380d2080 msgr2=0x7f4c3806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 shutdown_connections 2024-04-25T15:46:24.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.182+0000 7f4c3f140640 1 -- 172.21.15.80:0/2519863532 wait complete. 2024-04-25T15:46:24.197 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:24.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.303+0000 7f64eaf7a640 1 Processor -- start 2024-04-25T15:46:24.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.303+0000 7f64eaf7a640 1 -- start start 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64eaf7a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f64e4071950 0x7f64e4072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64eaf7a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64e40d2a90 0x7f64e40d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64eaf7a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e40d33e0 con 0x7f64e4161c80 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64eaf7a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f64e4072aa0 con 0x7f64e40d2a90 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64eaf7a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f64e41624d0 con 0x7f64e4071950 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64e40d2a90 0x7f64e40d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64e40d2a90 0x7f64e40d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35186/0 (socket says 172.21.15.80:35186) 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 -- 172.21.15.80:0/1185212972 learned_addr learned my addr 172.21.15.80:0/1185212972 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e8d16640 1 --2- 172.21.15.80:0/1185212972 >> v2:172.21.15.195:3300/0 conn(0x7f64e4071950 0x7f64e4072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 -- 172.21.15.80:0/1185212972 >> v2:172.21.15.195:3300/0 conn(0x7f64e4071950 msgr2=0x7f64e4072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 --2- 172.21.15.80:0/1185212972 >> v2:172.21.15.195:3300/0 conn(0x7f64e4071950 0x7f64e4072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 -- 172.21.15.80:0/1185212972 >> v1:172.21.15.195:6789/0 conn(0x7f64e4161c80 legacy=0x7f64e40b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e9517640 1 -- 172.21.15.80:0/1185212972 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e41627b0 con 0x7f64e40d2a90 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.305+0000 7f64e8d16640 1 --2- 172.21.15.80:0/1185212972 >> v2:172.21.15.195:3300/0 conn(0x7f64e4071950 0x7f64e4072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.306+0000 7f64e9517640 1 --2- 172.21.15.80:0/1185212972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e40d2ea0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f64e408cc70 tx=0x7f64dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f176d97d9dcd442 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.306+0000 7f64e37fe640 1 -- 172.21.15.80:0/1185212972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc036070 con 0x7f64e40d2a90 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.306+0000 7f64e37fe640 1 -- 172.21.15.80:0/1185212972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc031600 con 0x7f64e40d2a90 2024-04-25T15:46:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.306+0000 7f64e37fe640 1 -- 172.21.15.80:0/1185212972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0319d0 con 0x7f64e40d2a90 2024-04-25T15:46:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1185212972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 msgr2=0x7f64e40d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1185212972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e40d2ea0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f64e408cc70 tx=0x7f64dc02a660 comp rx=0 tx=0).stop 2024-04-25T15:46:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1185212972 shutdown_connections 2024-04-25T15:46:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1185212972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e40d2ea0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1185212972 >> v2:172.21.15.195:3300/0 conn(0x7f64e4071950 0x7f64e4072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1185212972 >> 172.21.15.80:0/1185212972 conn(0x7f64e40d3ea0 msgr2=0x7f64e40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1185212972 shutdown_connections 2024-04-25T15:46:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.307+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1185212972 wait complete. 2024-04-25T15:46:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.308+0000 7f64eaf7a640 1 Processor -- start 2024-04-25T15:46:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.308+0000 7f64eaf7a640 1 -- start start 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64eaf7a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64e4071950 0x7f64e415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64eaf7a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e41e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64eaf7a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e4161c80 0x7f64e41ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64eaf7a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f64e40b7690 con 0x7f64e40d2a90 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64eaf7a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f64e40d2290 con 0x7f64e4161c80 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64eaf7a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f64e40b7810 con 0x7f64e4071950 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e41e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e41e9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35190/0 (socket says 172.21.15.80:35190) 2024-04-25T15:46:24.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 -- 172.21.15.80:0/1669335680 learned_addr learned my addr 172.21.15.80:0/1669335680 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e9517640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e4161c80 0x7f64e41ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e8d16640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64e4071950 0x7f64e415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 -- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64e4071950 msgr2=0x7f64e415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64e4071950 0x7f64e415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 -- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e4161c80 msgr2=0x7f64e41ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e4161c80 0x7f64e41ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 -- 172.21.15.80:0/1669335680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e40ab270 con 0x7f64e40d2a90 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e8d16640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64e4071950 0x7f64e415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.310+0000 7f64e3fff640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e41e9c80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f64d800b3e0 tx=0x7f64d800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.311+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8015020 con 0x7f64e40d2a90 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.311+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d8011850 con 0x7f64e40d2a90 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.311+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011c80 con 0x7f64e40d2a90 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.311+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e415ff30 con 0x7f64e40d2a90 2024-04-25T15:46:24.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.311+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e40c8840 con 0x7f64e40d2a90 2024-04-25T15:46:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.312+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e406a100 con 0x7f64e40d2a90 2024-04-25T15:46:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.312+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f64d8018020 con 0x7f64e40d2a90 2024-04-25T15:46:24.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.313+0000 7f64e17fa640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64d00744e0 0x7f64d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.313+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f64d8094dd0 con 0x7f64e40d2a90 2024-04-25T15:46:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.313+0000 7f64e8d16640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64d00744e0 0x7f64d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.313+0000 7f64e8d16640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64d00744e0 0x7f64d00769f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64e40d15f0 tx=0x7f64d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.317+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64d8011e20 con 0x7f64e40d2a90 2024-04-25T15:46:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.494+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64e40d1e40 con 0x7f64e40d2a90 2024-04-25T15:46:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.495+0000 7f64e17fa640 1 -- 172.21.15.80:0/1669335680 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+13153 (secure 0 0 0) 0x7f64d8096020 con 0x7f64e40d2a90 2024-04-25T15:46:24.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:24.496 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":82,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:23.791191+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64d00744e0 msgr2=0x7f64d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64d00744e0 0x7f64d00769f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64e40d15f0 tx=0x7f64d4008040 comp rx=0 tx=0).stop 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 msgr2=0x7f64e41e9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e41e9c80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f64d800b3e0 tx=0x7f64d800b8a0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 shutdown_connections 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f64d00744e0 0x7f64d00769f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e4161c80 0x7f64e41ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64e40d2a90 0x7f64e41e9c80 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 --2- 172.21.15.80:0/1669335680 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64e4071950 0x7f64e415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 >> 172.21.15.80:0/1669335680 conn(0x7f64e40d3ea0 msgr2=0x7f64e40b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 shutdown_connections 2024-04-25T15:46:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.497+0000 7f64eaf7a640 1 -- 172.21.15.80:0/1669335680 wait complete. 2024-04-25T15:46:24.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:24.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:24.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.619+0000 7f42277f3640 1 Processor -- start 2024-04-25T15:46:24.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.619+0000 7f42277f3640 1 -- start start 2024-04-25T15:46:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f42277f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f42277f3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f422006dce0 0x7f42200ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f42277f3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4220161a00 con 0x7f4220070c10 2024-04-25T15:46:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f42277f3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f42200d1530 con 0x7f422006dce0 2024-04-25T15:46:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f42277f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4220162610 con 0x7f422015f170 2024-04-25T15:46:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f422558f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f4225d90640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f422006dce0 0x7f42200ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f4224d8e640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4220070c10 0x7f422006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:47460/0 (socket says 172.21.15.80:47460) 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f4224d8e640 1 -- 172.21.15.80:0/1677488028 learned_addr learned my addr 172.21.15.80:0/1677488028 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f422558f640 1 -- 172.21.15.80:0/1677488028 >> v2:172.21.15.195:3300/0 conn(0x7f422006dce0 msgr2=0x7f42200ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f422558f640 1 --2- 172.21.15.80:0/1677488028 >> v2:172.21.15.195:3300/0 conn(0x7f422006dce0 0x7f42200ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f422558f640 1 -- 172.21.15.80:0/1677488028 >> v1:172.21.15.195:6789/0 conn(0x7f4220070c10 legacy=0x7f422006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.621+0000 7f422558f640 1 -- 172.21.15.80:0/1677488028 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4220161ce0 con 0x7f422015f170 2024-04-25T15:46:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.622+0000 7f422558f640 1 --2- 172.21.15.80:0/1677488028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200d0ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f421c009d90 tx=0x7f421c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fca53ce195ffbfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.622+0000 7f4217fff640 1 -- 172.21.15.80:0/1677488028 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c007740 con 0x7f422015f170 2024-04-25T15:46:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.622+0000 7f4217fff640 1 -- 172.21.15.80:0/1677488028 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c0078e0 con 0x7f422015f170 2024-04-25T15:46:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.622+0000 7f4217fff640 1 -- 172.21.15.80:0/1677488028 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c007cb0 con 0x7f422015f170 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 -- 172.21.15.80:0/1677488028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 msgr2=0x7f42200d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 --2- 172.21.15.80:0/1677488028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200d0ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f421c009d90 tx=0x7f421c02a660 comp rx=0 tx=0).stop 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 -- 172.21.15.80:0/1677488028 shutdown_connections 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 --2- 172.21.15.80:0/1677488028 >> v2:172.21.15.195:3300/0 conn(0x7f422006dce0 0x7f42200ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 --2- 172.21.15.80:0/1677488028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200d0ff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 -- 172.21.15.80:0/1677488028 >> 172.21.15.80:0/1677488028 conn(0x7f42200734b0 msgr2=0x7f42200738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 -- 172.21.15.80:0/1677488028 shutdown_connections 2024-04-25T15:46:24.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.623+0000 7f42277f3640 1 -- 172.21.15.80:0/1677488028 wait complete. 2024-04-25T15:46:24.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.625+0000 7f42277f3640 1 Processor -- start 2024-04-25T15:46:24.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.625+0000 7f42277f3640 1 -- start start 2024-04-25T15:46:24.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f42277f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 0x7f42201573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f42277f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f42277f3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42200b2930 0x7f42200ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f42277f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4220071020 con 0x7f4220070c10 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f42277f3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f42201622a0 con 0x7f42200b2930 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f42277f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42200711a0 con 0x7f422015f170 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f422558f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 0x7f42201573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f422558f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 0x7f42201573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52020/0 (socket says 172.21.15.80:52020) 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f422558f640 1 -- 172.21.15.80:0/2308121920 learned_addr learned my addr 172.21.15.80:0/2308121920 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f4225d90640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42200b2930 0x7f42200ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.626+0000 7f4224d8e640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f422558f640 1 -- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 msgr2=0x7f42200cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f422558f640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200cabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f422558f640 1 -- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42200b2930 msgr2=0x7f42200ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f422558f640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42200b2930 0x7f42200ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f422558f640 1 -- 172.21.15.80:0/2308121920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42200b3110 con 0x7f4220070c10 2024-04-25T15:46:24.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f422558f640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 0x7f42201573a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f421c009eb0 tx=0x7f421c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c03f070 con 0x7f4220070c10 2024-04-25T15:46:24.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c031c40 con 0x7f4220070c10 2024-04-25T15:46:24.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42200b5490 con 0x7f4220070c10 2024-04-25T15:46:24.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c009450 con 0x7f4220070c10 2024-04-25T15:46:24.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.627+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42200b5a50 con 0x7f4220070c10 2024-04-25T15:46:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.628+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f422009f910 con 0x7f4220070c10 2024-04-25T15:46:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.629+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f421c03b410 con 0x7f4220070c10 2024-04-25T15:46:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.629+0000 7f4215ffb640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42040744e0 0x7f42040769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.629+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f421c0b64a0 con 0x7f4220070c10 2024-04-25T15:46:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.629+0000 7f4224d8e640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42040744e0 0x7f42040769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.630+0000 7f4224d8e640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42040744e0 0x7f42040769f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f422006d440 tx=0x7f4210009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.634+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f422009f910 con 0x7f4220070c10 2024-04-25T15:46:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.808+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f422006a100 con 0x7f4220070c10 2024-04-25T15:46:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.808+0000 7f4215ffb640 1 -- 172.21.15.80:0/2308121920 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f421c087e20 con 0x7f4220070c10 2024-04-25T15:46:24.809 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42040744e0 msgr2=0x7f42040769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42040744e0 0x7f42040769f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f422006d440 tx=0x7f4210009040 comp rx=0 tx=0).stop 2024-04-25T15:46:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 msgr2=0x7f42201573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 0x7f42201573a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f421c009eb0 tx=0x7f421c004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 shutdown_connections 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f42040744e0 0x7f42040769f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42200b2930 0x7f42200ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f422015f170 0x7f42200cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 --2- 172.21.15.80:0/2308121920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4220070c10 0x7f42201573a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 >> 172.21.15.80:0/2308121920 conn(0x7f42200734b0 msgr2=0x7f422006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 shutdown_connections 2024-04-25T15:46:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.810+0000 7f42277f3640 1 -- 172.21.15.80:0/2308121920 wait complete. 2024-04-25T15:46:24.823 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:46:24.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.928+0000 7f116cc13640 1 Processor -- start 2024-04-25T15:46:24.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.928+0000 7f116cc13640 1 -- start start 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116cc13640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f11680b0d80 0x7f116815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116cc13640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1168074240 0x7f11680b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116cc13640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11680703e0 con 0x7f11680b65a0 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116cc13640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f11680affc0 con 0x7f11680b0d80 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116cc13640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11680b02a0 con 0x7f1168074240 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f11680b0d80 0x7f116815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f1165d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f11680b65a0 0x7f1168073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52274/0 (socket says 172.21.15.80:52274) 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f1165d9b640 1 -- 172.21.15.80:0/1357285094 learned_addr learned my addr 172.21.15.80:0/1357285094 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:24.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116659c640 1 -- 172.21.15.80:0/1357285094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1168074240 msgr2=0x7f11680b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f1166d9d640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1168074240 0x7f11680b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116559a640 1 -- 172.21.15.80:0/1357285094 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303851872 0 0) 0x7f11680703e0 con 0x7f11680b65a0 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116659c640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1168074240 0x7f11680b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116659c640 1 -- 172.21.15.80:0/1357285094 >> v1:172.21.15.80:6789/0 conn(0x7f11680b65a0 legacy=0x7f1168073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f116659c640 1 -- 172.21.15.80:0/1357285094 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11680b0580 con 0x7f11680b0d80 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.930+0000 7f1166d9d640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1168074240 0x7f11680b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.931+0000 7f116659c640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116815c670 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f115800a940 tx=0x7f115802b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61cc4a47cf460c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.931+0000 7f116559a640 1 -- 172.21.15.80:0/1357285094 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115800b040 con 0x7f11680b0d80 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.931+0000 7f116559a640 1 -- 172.21.15.80:0/1357285094 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1158030710 con 0x7f11680b0d80 2024-04-25T15:46:24.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.931+0000 7f116559a640 1 -- 172.21.15.80:0/1357285094 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158030ae0 con 0x7f11680b0d80 2024-04-25T15:46:24.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 -- 172.21.15.80:0/1357285094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 msgr2=0x7f116815c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116815c670 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f115800a940 tx=0x7f115802b550 comp rx=0 tx=0).stop 2024-04-25T15:46:24.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 -- 172.21.15.80:0/1357285094 shutdown_connections 2024-04-25T15:46:24.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1168074240 0x7f11680b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 --2- 172.21.15.80:0/1357285094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116815c670 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 -- 172.21.15.80:0/1357285094 >> 172.21.15.80:0/1357285094 conn(0x7f11680d1e20 msgr2=0x7f1168073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 -- 172.21.15.80:0/1357285094 shutdown_connections 2024-04-25T15:46:24.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.932+0000 7f116cc13640 1 -- 172.21.15.80:0/1357285094 wait complete. 2024-04-25T15:46:24.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.934+0000 7f116cc13640 1 Processor -- start 2024-04-25T15:46:24.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.934+0000 7f116cc13640 1 -- start start 2024-04-25T15:46:24.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116cc13640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116809efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116cc13640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11680b65a0 0x7f11681563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116cc13640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f116809d580 0x7f1168154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116cc13640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f116806fe10 con 0x7f11680b0d80 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116cc13640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f11680ae7c0 con 0x7f11680b65a0 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116cc13640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f116806ff90 con 0x7f116809d580 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116809efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116809efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52024/0 (socket says 172.21.15.80:52024) 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f116659c640 1 -- 172.21.15.80:0/1016079116 learned_addr learned my addr 172.21.15.80:0/1016079116 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f1166d9d640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f116809d580 0x7f1168154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.935+0000 7f1165d9b640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11680b65a0 0x7f11681563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116659c640 1 -- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f116809d580 msgr2=0x7f1168154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116659c640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f116809d580 0x7f1168154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116659c640 1 -- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11680b65a0 msgr2=0x7f11681563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116659c640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11680b65a0 0x7f11681563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116659c640 1 -- 172.21.15.80:0/1016079116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116809df40 con 0x7f11680b0d80 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116659c640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116809efe0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f115800aa60 tx=0x7f1158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158040070 con 0x7f11680b0d80 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1158032d40 con 0x7f11680b0d80 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116809e220 con 0x7f11680b0d80 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115803b660 con 0x7f11680b0d80 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.936+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116809e7e0 con 0x7f11680b0d80 2024-04-25T15:46:24.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.937+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11680aee80 con 0x7f11680b0d80 2024-04-25T15:46:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.938+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1158043070 con 0x7f11680b0d80 2024-04-25T15:46:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.938+0000 7f1156ffd640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11480744b0 0x7f11480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.938+0000 7f1165d9b640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11480744b0 0x7f11480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.938+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f11580b51b0 con 0x7f11680b0d80 2024-04-25T15:46:24.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.939+0000 7f1165d9b640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11480744b0 0x7f11480769c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1168073770 tx=0x7f115c007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:24.943+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11680aee80 con 0x7f11680b0d80 2024-04-25T15:46:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.121+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f116806a100 con 0x7f11680b0d80 2024-04-25T15:46:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.121+0000 7f1156ffd640 1 -- 172.21.15.80:0/1016079116 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f115800a030 con 0x7f11680b0d80 2024-04-25T15:46:25.122 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:46:25.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:25.123 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:46:25.123 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:46:25.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:46:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11480744b0 msgr2=0x7f11480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11480744b0 0x7f11480769c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1168073770 tx=0x7f115c007c00 comp rx=0 tx=0).stop 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 msgr2=0x7f116809efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116809efe0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f115800aa60 tx=0x7f1158004730 comp rx=0 tx=0).stop 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 shutdown_connections 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11480744b0 0x7f11480769c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f116809d580 0x7f1168154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11680b65a0 0x7f11681563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 --2- 172.21.15.80:0/1016079116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11680b0d80 0x7f116809efe0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 >> 172.21.15.80:0/1016079116 conn(0x7f11680d1e20 msgr2=0x7f116806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 shutdown_connections 2024-04-25T15:46:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.123+0000 7f116cc13640 1 -- 172.21.15.80:0/1016079116 wait complete. 2024-04-25T15:46:25.135 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:46:25.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:46:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.245+0000 7f040973c640 1 Processor -- start 2024-04-25T15:46:25.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.245+0000 7f040973c640 1 -- start start 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.246+0000 7f040973c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04040b7de0 0x7f04040d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.246+0000 7f040973c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f04041604b0 0x7f04040ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.246+0000 7f040973c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04040b9620 con 0x7f04040d12e0 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.246+0000 7f040973c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f04040d16f0 con 0x7f04040b7de0 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.246+0000 7f040973c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f04040d1c10 con 0x7f04041604b0 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04040b7de0 0x7f04040d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04040b7de0 0x7f04040d4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52030/0 (socket says 172.21.15.80:52030) 2024-04-25T15:46:25.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 -- 172.21.15.80:0/103482156 learned_addr learned my addr 172.21.15.80:0/103482156 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04037fe640 1 --2- 172.21.15.80:0/103482156 >> v2:172.21.15.195:3300/0 conn(0x7f04041604b0 0x7f04040ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 -- 172.21.15.80:0/103482156 >> v2:172.21.15.195:3300/0 conn(0x7f04041604b0 msgr2=0x7f04040ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 --2- 172.21.15.80:0/103482156 >> v2:172.21.15.195:3300/0 conn(0x7f04041604b0 0x7f04040ba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 -- 172.21.15.80:0/103482156 >> v1:172.21.15.195:6789/0 conn(0x7f04040d12e0 legacy=0x7f04040b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:25.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.247+0000 7f04027fc640 1 -- 172.21.15.80:0/103482156 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04040d1930 con 0x7f04040b7de0 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f04027fc640 1 --2- 172.21.15.80:0/103482156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04040b7de0 0x7f04040d4230 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f04040d5b30 tx=0x7f03f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412e47dc8627e4b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f0401ffb640 1 -- 172.21.15.80:0/103482156 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8037070 con 0x7f04040b7de0 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f0401ffb640 1 -- 172.21.15.80:0/103482156 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8032440 con 0x7f04040b7de0 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f0401ffb640 1 -- 172.21.15.80:0/103482156 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8032810 con 0x7f04040b7de0 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f040973c640 1 -- 172.21.15.80:0/103482156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04040b7de0 msgr2=0x7f04040d4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f040973c640 1 --2- 172.21.15.80:0/103482156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04040b7de0 0x7f04040d4230 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f04040d5b30 tx=0x7f03f802a1a0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f040973c640 1 -- 172.21.15.80:0/103482156 shutdown_connections 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f040973c640 1 --2- 172.21.15.80:0/103482156 >> v2:172.21.15.195:3300/0 conn(0x7f04041604b0 0x7f04040ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.248+0000 7f040973c640 1 --2- 172.21.15.80:0/103482156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04040b7de0 0x7f04040d4230 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.249+0000 7f040973c640 1 -- 172.21.15.80:0/103482156 >> 172.21.15.80:0/103482156 conn(0x7f040406e7c0 msgr2=0x7f040406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:25.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.249+0000 7f040973c640 1 -- 172.21.15.80:0/103482156 shutdown_connections 2024-04-25T15:46:25.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.249+0000 7f040973c640 1 -- 172.21.15.80:0/103482156 wait complete. 2024-04-25T15:46:25.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.250+0000 7f040973c640 1 Processor -- start 2024-04-25T15:46:25.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.250+0000 7f040973c640 1 -- start start 2024-04-25T15:46:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f040973c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04040d12e0 0x7f04040d0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f040973c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04041604b0 0x7f04040c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f040973c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 0x7f040415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f040973c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f04040b9e60 con 0x7f040415b460 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f040973c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f04040b9bc0 con 0x7f04041604b0 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f040973c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f04041608c0 con 0x7f04040d12e0 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 0x7f040415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 0x7f040415b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52034/0 (socket says 172.21.15.80:52034) 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 -- 172.21.15.80:0/1805621205 learned_addr learned my addr 172.21.15.80:0/1805621205 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f0402ffd640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04040d12e0 0x7f04040d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04027fc640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04041604b0 0x7f04040c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 -- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04040d12e0 msgr2=0x7f04040d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04040d12e0 0x7f04040d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 -- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04041604b0 msgr2=0x7f04040c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04041604b0 0x7f04040c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 -- 172.21.15.80:0/1805621205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040415bdb0 con 0x7f040415b460 2024-04-25T15:46:25.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f04037fe640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 0x7f040415b870 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007e90 tx=0x7f03fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.252+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc014420 con 0x7f040415b460 2024-04-25T15:46:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.253+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc019070 con 0x7f040415b460 2024-04-25T15:46:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.253+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04040d0980 con 0x7f040415b460 2024-04-25T15:46:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.253+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc014800 con 0x7f040415b460 2024-04-25T15:46:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.253+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04040ca640 con 0x7f040415b460 2024-04-25T15:46:25.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.254+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04040c91f0 con 0x7f040415b460 2024-04-25T15:46:25.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.254+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f03fc0149a0 con 0x7f040415b460 2024-04-25T15:46:25.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.255+0000 7f03eb7fe640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03f00744b0 0x7f03f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.255+0000 7f0402ffd640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03f00744b0 0x7f03f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.255+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f03fc095660 con 0x7f040415b460 2024-04-25T15:46:25.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.255+0000 7f0402ffd640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03f00744b0 0x7f03f00769c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f03f4006fd0 tx=0x7f03f4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:25.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.259+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f04040c91f0 con 0x7f040415b460 2024-04-25T15:46:25.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.433+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f040406a100 con 0x7f040415b460 2024-04-25T15:46:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.802+0000 7f03eb7fe640 1 -- 172.21.15.80:0/1805621205 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f040415bdb0 con 0x7f040415b460 2024-04-25T15:46:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:46:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03f00744b0 msgr2=0x7f03f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03f00744b0 0x7f03f00769c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f03f4006fd0 tx=0x7f03f4009060 comp rx=0 tx=0).stop 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 msgr2=0x7f040415b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 0x7f040415b870 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007e90 tx=0x7f03fc00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 shutdown_connections 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f03f00744b0 0x7f03f00769c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f040415b460 0x7f040415b870 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04041604b0 0x7f04040c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 --2- 172.21.15.80:0/1805621205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04040d12e0 0x7f04040d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 >> 172.21.15.80:0/1805621205 conn(0x7f040406e7c0 msgr2=0x7f040415eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 shutdown_connections 2024-04-25T15:46:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.805+0000 7f040973c640 1 -- 172.21.15.80:0/1805621205 wait complete. 2024-04-25T15:46:25.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:46:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.935+0000 7f7174a30640 1 Processor -- start 2024-04-25T15:46:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.935+0000 7f7174a30640 1 -- start start 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f7174a30640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71700b2a40 0x7f71700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f7174a30640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f717009ce90 0x7f71700d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f7174a30640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717009d2a0 con 0x7f71700cff30 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f7174a30640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f71700cfb70 con 0x7f71700b2a40 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f7174a30640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f71700b9350 con 0x7f717009ce90 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71700b2a40 0x7f71700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71700b2a40 0x7f71700b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52046/0 (socket says 172.21.15.80:52046) 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 -- 172.21.15.80:0/331219712 learned_addr learned my addr 172.21.15.80:0/331219712 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716ed9d640 1 --2- 172.21.15.80:0/331219712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f717009ce90 0x7f71700d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 -- 172.21.15.80:0/331219712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f717009ce90 msgr2=0x7f71700d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 --2- 172.21.15.80:0/331219712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f717009ce90 0x7f71700d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 -- 172.21.15.80:0/331219712 >> v1:172.21.15.195:6789/0 conn(0x7f71700cff30 legacy=0x7f71700d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.937+0000 7f716dd9b640 1 -- 172.21.15.80:0/331219712 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71700cf890 con 0x7f71700b2a40 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.938+0000 7f716dd9b640 1 --2- 172.21.15.80:0/331219712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71700b2a40 0x7f71700b7230 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f71700cfcf0 tx=0x7f716402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21eda76a6b87d3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.938+0000 7f716d59a640 1 -- 172.21.15.80:0/331219712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164037070 con 0x7f71700b2a40 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.938+0000 7f716d59a640 1 -- 172.21.15.80:0/331219712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7164032440 con 0x7f71700b2a40 2024-04-25T15:46:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.938+0000 7f716d59a640 1 -- 172.21.15.80:0/331219712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164032810 con 0x7f71700b2a40 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 -- 172.21.15.80:0/331219712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71700b2a40 msgr2=0x7f71700b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 --2- 172.21.15.80:0/331219712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71700b2a40 0x7f71700b7230 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f71700cfcf0 tx=0x7f716402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 -- 172.21.15.80:0/331219712 shutdown_connections 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 --2- 172.21.15.80:0/331219712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f717009ce90 0x7f71700d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 --2- 172.21.15.80:0/331219712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71700b2a40 0x7f71700b7230 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 -- 172.21.15.80:0/331219712 >> 172.21.15.80:0/331219712 conn(0x7f71700d0450 msgr2=0x7f71700d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 -- 172.21.15.80:0/331219712 shutdown_connections 2024-04-25T15:46:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.939+0000 7f7174a30640 1 -- 172.21.15.80:0/331219712 wait complete. 2024-04-25T15:46:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.941+0000 7f7174a30640 1 Processor -- start 2024-04-25T15:46:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.941+0000 7f7174a30640 1 -- start start 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f7174a30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 0x7f71700a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f7174a30640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71700b2a40 0x7f7170152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f7174a30640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71700cff30 0x7f7170160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f7174a30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f71700d0f70 con 0x7f717009ce90 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f7174a30640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f71700b9020 con 0x7f71700cff30 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f7174a30640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f71700d10f0 con 0x7f71700b2a40 2024-04-25T15:46:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 0x7f71700a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 0x7f71700a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52058/0 (socket says 172.21.15.80:52058) 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 -- 172.21.15.80:0/308784910 learned_addr learned my addr 172.21.15.80:0/308784910 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716dd9b640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71700b2a40 0x7f7170152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716ed9d640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71700cff30 0x7f7170160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 -- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71700b2a40 msgr2=0x7f7170152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71700b2a40 0x7f7170152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 -- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71700cff30 msgr2=0x7f7170160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71700cff30 0x7f7170160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 -- 172.21.15.80:0/308784910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717015ed10 con 0x7f717009ce90 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716ed9d640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71700cff30 0x7f7170160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.942+0000 7f716e59c640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 0x7f71700a1230 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f716000c3c0 tx=0x7f716000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.943+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71600052d0 con 0x7f717009ce90 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.943+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7160005490 con 0x7f717009ce90 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.943+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717015efd0 con 0x7f717009ce90 2024-04-25T15:46:25.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.943+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160006a20 con 0x7f717009ce90 2024-04-25T15:46:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.943+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717015f590 con 0x7f717009ce90 2024-04-25T15:46:25.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.944+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717006a100 con 0x7f717009ce90 2024-04-25T15:46:25.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.945+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7160003640 con 0x7f717009ce90 2024-04-25T15:46:25.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.945+0000 7f715effd640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71500744b0 0x7f71500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:25.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.945+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5619+0+0 (secure 0 0 0) 0x7f7160094df0 con 0x7f717009ce90 2024-04-25T15:46:25.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.945+0000 7f716dd9b640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71500744b0 0x7f71500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:25.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.946+0000 7f716dd9b640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71500744b0 0x7f71500769c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7164034000 tx=0x7f716402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:25.950+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f717009d2a0 con 0x7f717009ce90 2024-04-25T15:46:26.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.124+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f71700b6ce0 con 0x7f717009ce90 2024-04-25T15:46:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.804+0000 7f715effd640 1 -- 172.21.15.80:0/308784910 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7f716005f6b0 con 0x7f717009ce90 2024-04-25T15:46:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:46:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71500744b0 msgr2=0x7f71500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71500744b0 0x7f71500769c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7164034000 tx=0x7f716402e000 comp rx=0 tx=0).stop 2024-04-25T15:46:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 msgr2=0x7f71700a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 0x7f71700a1230 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f716000c3c0 tx=0x7f716000c880 comp rx=0 tx=0).stop 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 shutdown_connections 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71500744b0 0x7f71500769c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71700cff30 0x7f7170160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71700b2a40 0x7f7170152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 --2- 172.21.15.80:0/308784910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717009ce90 0x7f71700a1230 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 >> 172.21.15.80:0/308784910 conn(0x7f71700d0450 msgr2=0x7f71700d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 shutdown_connections 2024-04-25T15:46:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.807+0000 7f7174a30640 1 -- 172.21.15.80:0/308784910 wait complete. 2024-04-25T15:46:26.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:46:26.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.944+0000 7f3d44585640 1 Processor -- start 2024-04-25T15:46:26.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.944+0000 7f3d44585640 1 -- start start 2024-04-25T15:46:26.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d44585640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d3c15cc80 0x7f3d3c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d44585640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d44585640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d3c0b0ca0 0x7f3d3c1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d44585640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3d3c0d1620 con 0x7f3d3c0b0ca0 2024-04-25T15:46:26.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d44585640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3d3c0b5460 con 0x7f3d3c15cc80 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d44585640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3c06df20 con 0x7f3d3c06db10 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d3c0b0ca0 0x7f3d3c1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d3c0b0ca0 0x7f3d3c1608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52066/0 (socket says 172.21.15.80:52066) 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 -- 172.21.15.80:0/2394203615 learned_addr learned my addr 172.21.15.80:0/2394203615 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42321640 1 --2- 172.21.15.80:0/2394203615 >> v2:172.21.15.195:3300/0 conn(0x7f3d3c15cc80 0x7f3d3c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 -- 172.21.15.80:0/2394203615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 msgr2=0x7f3d3c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d41b20640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 -- 172.21.15.80:0/2394203615 >> v2:172.21.15.195:3300/0 conn(0x7f3d3c15cc80 msgr2=0x7f3d3c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 --2- 172.21.15.80:0/2394203615 >> v2:172.21.15.195:3300/0 conn(0x7f3d3c15cc80 0x7f3d3c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42b22640 1 -- 172.21.15.80:0/2394203615 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c0b4850 con 0x7f3d3c0b0ca0 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d42321640 1 --2- 172.21.15.80:0/2394203615 >> v2:172.21.15.195:3300/0 conn(0x7f3d3c15cc80 0x7f3d3c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.946+0000 7f3d41b20640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.947+0000 7f3d42b22640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c0b0ca0 0x7f3d3c1608d0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c072c80 tx=0x7f3d3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5474afe51fbe646c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.947+0000 7f3d4131f640 1 -- 172.21.15.80:0/2394203615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34037070 con 0x7f3d3c0b0ca0 2024-04-25T15:46:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.947+0000 7f3d4131f640 1 -- 172.21.15.80:0/2394203615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d34032440 con 0x7f3d3c0b0ca0 2024-04-25T15:46:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.947+0000 7f3d4131f640 1 -- 172.21.15.80:0/2394203615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34032810 con 0x7f3d3c0b0ca0 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 -- 172.21.15.80:0/2394203615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c0b0ca0 msgr2=0x7f3d3c1608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c0b0ca0 0x7f3d3c1608d0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c072c80 tx=0x7f3d3402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 -- 172.21.15.80:0/2394203615 shutdown_connections 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c0b0ca0 0x7f3d3c1608d0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 --2- 172.21.15.80:0/2394203615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 --2- 172.21.15.80:0/2394203615 >> v2:172.21.15.195:3300/0 conn(0x7f3d3c15cc80 0x7f3d3c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 -- 172.21.15.80:0/2394203615 >> 172.21.15.80:0/2394203615 conn(0x7f3d3c0734b0 msgr2=0x7f3d3c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 -- 172.21.15.80:0/2394203615 shutdown_connections 2024-04-25T15:46:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.948+0000 7f3d44585640 1 -- 172.21.15.80:0/2394203615 wait complete. 2024-04-25T15:46:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.950+0000 7f3d44585640 1 Processor -- start 2024-04-25T15:46:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.950+0000 7f3d44585640 1 -- start start 2024-04-25T15:46:26.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d44585640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d44585640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d3c0b0ca0 0x7f3d3c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d44585640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 0x7f3d3c1f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d44585640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0b50f0 con 0x7f3d3c15cc80 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d44585640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0b4e10 con 0x7f3d3c0b0ca0 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d44585640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3c15d090 con 0x7f3d3c06db10 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 0x7f3d3c1f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 0x7f3d3c1f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52070/0 (socket says 172.21.15.80:52070) 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 -- 172.21.15.80:0/2913136873 learned_addr learned my addr 172.21.15.80:0/2913136873 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 -- 172.21.15.80:0/2913136873 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 msgr2=0x7f3d3c1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 -- 172.21.15.80:0/2913136873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d3c0b0ca0 msgr2=0x7f3d3c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d3c0b0ca0 0x7f3d3c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.951+0000 7f3d42b22640 1 -- 172.21.15.80:0/2913136873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c153570 con 0x7f3d3c15cc80 2024-04-25T15:46:26.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.952+0000 7f3d42b22640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 0x7f3d3c1f7900 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3d3402a220 tx=0x7f3d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:26.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.952+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34037040 con 0x7f3d3c15cc80 2024-04-25T15:46:26.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.952+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d34042070 con 0x7f3d3c15cc80 2024-04-25T15:46:26.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.952+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c15e5f0 con 0x7f3d3c15cc80 2024-04-25T15:46:26.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.952+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34030bd0 con 0x7f3d3c15cc80 2024-04-25T15:46:26.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.952+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c1569a0 con 0x7f3d3c15cc80 2024-04-25T15:46:26.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.953+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3c06a100 con 0x7f3d3c15cc80 2024-04-25T15:46:26.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.954+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d34047460 con 0x7f3d3c15cc80 2024-04-25T15:46:26.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.954+0000 7f3d32ffd640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d200744e0 0x7f3d200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.954+0000 7f3d42321640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d200744e0 0x7f3d200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.954+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6001+0+0 (secure 0 0 0) 0x7f3d340b5f80 con 0x7f3d3c15cc80 2024-04-25T15:46:26.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.955+0000 7f3d42321640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d200744e0 0x7f3d200769f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3d38007130 tx=0x7f3d38007300 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:26.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:26.959+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d34080020 con 0x7f3d3c15cc80 2024-04-25T15:46:27.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.172+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3d3c153300 con 0x7f3d3c15cc80 2024-04-25T15:46:27.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T15:46:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.826+0000 7f3d32ffd640 1 -- 172.21.15.80:0/2913136873 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v41) ==== 174+0+0 (secure 0 0 0) 0x7f3d34084320 con 0x7f3d3c15cc80 2024-04-25T15:46:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 13 and data pool 14 2024-04-25T15:46:27.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d200744e0 msgr2=0x7f3d200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d200744e0 0x7f3d200769f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3d38007130 tx=0x7f3d38007300 comp rx=0 tx=0).stop 2024-04-25T15:46:27.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 msgr2=0x7f3d3c1f7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 0x7f3d3c1f7900 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3d3402a220 tx=0x7f3d340046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 shutdown_connections 2024-04-25T15:46:27.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d200744e0 0x7f3d200769f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d3c15cc80 0x7f3d3c1f7900 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d3c0b0ca0 0x7f3d3c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 --2- 172.21.15.80:0/2913136873 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d3c06db10 0x7f3d3c1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.832+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 >> 172.21.15.80:0/2913136873 conn(0x7f3d3c0734b0 msgr2=0x7f3d3c0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:27.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.833+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 shutdown_connections 2024-04-25T15:46:27.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.834+0000 7f3d44585640 1 -- 172.21.15.80:0/2913136873 wait complete. 2024-04-25T15:46:27.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.974+0000 7f5006a92640 1 Processor -- start 2024-04-25T15:46:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.974+0000 7f5006a92640 1 -- start start 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.975+0000 7f5006a92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.975+0000 7f5006a92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50000b7fa0 con 0x7f50000d41b0 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.975+0000 7f5006a92640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5000163fb0 con 0x7f50000b7b90 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.975+0000 7f5006a92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5000164270 con 0x7f50000b48d0 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.975+0000 7f500482e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f50000d41b0 0x7f50001602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52282/0 (socket says 172.21.15.80:52282) 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.975+0000 7f500482e640 1 -- 172.21.15.80:0/4082167363 learned_addr learned my addr 172.21.15.80:0/4082167363 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4ffffff640 1 --2- 172.21.15.80:0/4082167363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385921653 0 0) 0x7f4ff4001110 con 0x7f50000d41b0 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff0003520 con 0x7f50000d41b0 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133704317 0 0) 0x7f5000163fb0 con 0x7f50000b7b90 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff4001110 con 0x7f50000b7b90 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4ffffff640 1 -- 172.21.15.80:0/4082167363 >> v1:172.21.15.195:6789/0 conn(0x7f50000b7b90 legacy=0x7f50000d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4ffffff640 1 -- 172.21.15.80:0/4082167363 >> v1:172.21.15.80:6789/0 conn(0x7f50000d41b0 legacy=0x7f50001602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.976+0000 7f4ffffff640 1 -- 172.21.15.80:0/4082167363 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5000164550 con 0x7f50000b48d0 2024-04-25T15:46:27.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.977+0000 7f4ffffff640 1 --2- 172.21.15.80:0/4082167363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000b7650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097d0 tx=0x7f4fec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3235f0661dd96ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:27.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.977+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f50000b48d0 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.977+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec032440 con 0x7f50000b48d0 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.977+0000 7f4fff7fe640 1 -- 172.21.15.80:0/4082167363 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0327f0 con 0x7f50000b48d0 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 -- 172.21.15.80:0/4082167363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 msgr2=0x7f50000b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 --2- 172.21.15.80:0/4082167363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000b7650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097d0 tx=0x7f4fec02a210 comp rx=0 tx=0).stop 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 -- 172.21.15.80:0/4082167363 shutdown_connections 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 --2- 172.21.15.80:0/4082167363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000b7650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 -- 172.21.15.80:0/4082167363 >> 172.21.15.80:0/4082167363 conn(0x7f500006e9f0 msgr2=0x7f50000d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 -- 172.21.15.80:0/4082167363 shutdown_connections 2024-04-25T15:46:27.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.978+0000 7f5006a92640 1 -- 172.21.15.80:0/4082167363 wait complete. 2024-04-25T15:46:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.979+0000 7f5006a92640 1 Processor -- start 2024-04-25T15:46:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.980+0000 7f5006a92640 1 -- start start 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f5006a92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f5006a92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50000b7b90 0x7f50000cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f5006a92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 0x7f50000cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f5006a92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50000b4fd0 con 0x7f50000d41b0 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f5006a92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5000164b10 con 0x7f50000b7b90 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f5006a92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50000b5150 con 0x7f50000b48d0 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 0x7f50000cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 0x7f50000cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52072/0 (socket says 172.21.15.80:52072) 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 -- 172.21.15.80:0/514503439 learned_addr learned my addr 172.21.15.80:0/514503439 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f4ffffff640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50000b7b90 0x7f50000cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500482e640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 -- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 msgr2=0x7f50000ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 -- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50000b7b90 msgr2=0x7f50000cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50000b7b90 0x7f50000cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f500502f640 1 -- 172.21.15.80:0/514503439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50001610a0 con 0x7f50000d41b0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.981+0000 7f4ffffff640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50000b7b90 0x7f50000cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.982+0000 7f500502f640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 0x7f50000cb190 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c6e0 tx=0x7f4ff800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.982+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8003b70 con 0x7f50000d41b0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.982+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8003d10 con 0x7f50000d41b0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.982+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5000161380 con 0x7f50000d41b0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.982+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80052d0 con 0x7f50000d41b0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.982+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5000161940 con 0x7f50000d41b0 2024-04-25T15:46:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.983+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50000ce3f0 con 0x7f50000d41b0 2024-04-25T15:46:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.983+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ff8005470 con 0x7f50000d41b0 2024-04-25T15:46:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.984+0000 7f4ffd7fa640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fe40744b0 0x7f4fe40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.984+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f4ff8095320 con 0x7f50000d41b0 2024-04-25T15:46:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.984+0000 7f500482e640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fe40744b0 0x7f4fe40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.984+0000 7f500482e640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fe40744b0 0x7f4fe40769c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40013b0 tx=0x7f4ff4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:27.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:27.989+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ff805f8a0 con 0x7f50000d41b0 2024-04-25T15:46:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.168+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5000163ee0 con 0x7f50000d41b0 2024-04-25T15:46:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.169+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/514503439 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16886 (secure 0 0 0) 0x7f4ff805f1a0 con 0x7f50000d41b0 2024-04-25T15:46:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:28.171 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":85,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:27.174490+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fe40744b0 msgr2=0x7f4fe40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fe40744b0 0x7f4fe40769c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40013b0 tx=0x7f4ff4009040 comp rx=0 tx=0).stop 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 msgr2=0x7f50000cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 0x7f50000cb190 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c6e0 tx=0x7f4ff800cba0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 shutdown_connections 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fe40744b0 0x7f4fe40769c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50000d41b0 0x7f50000cb190 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50000b7b90 0x7f50000cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 --2- 172.21.15.80:0/514503439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50000b48d0 0x7f50000ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.171+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 >> 172.21.15.80:0/514503439 conn(0x7f500006e9f0 msgr2=0x7f500015f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.172+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 shutdown_connections 2024-04-25T15:46:28.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.172+0000 7f5006a92640 1 -- 172.21.15.80:0/514503439 wait complete. 2024-04-25T15:46:28.184 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.290+0000 7f6714242640 1 Processor -- start 2024-04-25T15:46:28.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.291+0000 7f6714242640 1 -- start start 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f6714242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 0x7f670c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f6714242640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670c0b3fe0 con 0x7f670c0d21f0 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f6714242640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670c0ce110 con 0x7f670c1604d0 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f6714242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f670c0ce6d0 con 0x7f670c09bdf0 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f67117dd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f670c0d21f0 0x7f670c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52298/0 (socket says 172.21.15.80:52298) 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f67117dd640 1 -- 172.21.15.80:0/3806546534 learned_addr learned my addr 172.21.15.80:0/3806546534 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995594958 0 0) 0x7f670c0b3fe0 con 0x7f670c0d21f0 2024-04-25T15:46:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f67127df640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 0x7f670c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.292+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66f8003520 con 0x7f670c0d21f0 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 409935298 0 0) 0x7f66f8003520 con 0x7f670c0d21f0 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 msgr2=0x7f670c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 0x7f670c0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 >> v1:172.21.15.195:6789/0 conn(0x7f670c1604d0 legacy=0x7f670c0d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c0ce3f0 con 0x7f670c0d21f0 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f66fc001670 con 0x7f670c0d21f0 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 >> v1:172.21.15.80:6789/0 conn(0x7f670c0d21f0 legacy=0x7f670c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 0x7f66f80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f66f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f8004d40 0x7f66f8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f670c0ce6d0 con 0x7f66f8003f60 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f66f800bb50 con 0x7f66f8004d40 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f66f800bd50 con 0x7f670c09bdf0 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67117dd640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f66f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f6711fde640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 0x7f66f80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67127df640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f8004d40 0x7f66f8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67117dd640 1 -- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 msgr2=0x7f66f80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67117dd640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c09bdf0 0x7f66f80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67117dd640 1 -- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f8004d40 msgr2=0x7f66f8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67117dd640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f8004d40 0x7f66f8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.293+0000 7f67117dd640 1 -- 172.21.15.80:0/3806546534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f8003520 con 0x7f66f8003f60 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.294+0000 7f67117dd640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f66f8004800 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f670c073740 tx=0x7f66f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74da7a5193e9d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.294+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc007d10 con 0x7f66f8003f60 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.294+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc005ad0 con 0x7f66f8003f60 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.294+0000 7f6710fdc640 1 -- 172.21.15.80:0/3806546534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc007070 con 0x7f66f8003f60 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f6714242640 1 -- 172.21.15.80:0/3806546534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 msgr2=0x7f66f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f6714242640 1 --2- 172.21.15.80:0/3806546534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f66f8004800 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f670c073740 tx=0x7f66f8005830 comp rx=0 tx=0).stop 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f67127df640 1 -- 172.21.15.80:0/3806546534 reap_dead start 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f6714242640 1 -- 172.21.15.80:0/3806546534 shutdown_connections 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f6714242640 1 -- 172.21.15.80:0/3806546534 >> 172.21.15.80:0/3806546534 conn(0x7f670c0b7620 msgr2=0x7f670c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f6714242640 1 -- 172.21.15.80:0/3806546534 shutdown_connections 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.295+0000 7f6714242640 1 -- 172.21.15.80:0/3806546534 wait complete. 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.297+0000 7f6714242640 1 Processor -- start 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.297+0000 7f6714242640 1 -- start start 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6714242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f670c160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6714242640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f670c14fb30 0x7f670c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6714242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c14c870 0x7f670c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6714242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f670c0b3b70 con 0x7f66f8003f60 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6714242640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f670c06ef30 con 0x7f670c14fb30 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6714242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f670c0b3cf0 con 0x7f670c14c870 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f670c160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f670c160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52088/0 (socket says 172.21.15.80:52088) 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 -- 172.21.15.80:0/442796398 learned_addr learned my addr 172.21.15.80:0/442796398 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f67127df640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c14c870 0x7f670c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f67117dd640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f670c14fb30 0x7f670c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 -- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c14c870 msgr2=0x7f670c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c14c870 0x7f670c0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 -- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f670c14fb30 msgr2=0x7f670c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f670c14fb30 0x7f670c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 -- 172.21.15.80:0/442796398 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c1614e0 con 0x7f66f8003f60 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.298+0000 7f6711fde640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f670c160970 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f670800fb90 tx=0x7f670800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.299+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670800fe90 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.299+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6708018070 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.299+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c14f050 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.299+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708003970 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.299+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c14f610 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.299+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670c06a100 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.300+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6708003b10 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.301+0000 7f67027fc640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66f0074650 0x7f66f0076b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.301+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f6708095ff0 con 0x7f66f8003f60 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.301+0000 7f67117dd640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66f0074650 0x7f66f0076b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.301+0000 7f67117dd640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66f0074650 0x7f66f0076b60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f670c073740 tx=0x7f66fc02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.305+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6708060760 con 0x7f66f8003f60 2024-04-25T15:46:28.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.481+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f670c0cde50 con 0x7f66f8003f60 2024-04-25T15:46:28.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.482+0000 7f67027fc640 1 -- 172.21.15.80:0/442796398 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16886 (secure 0 0 0) 0x7f6708060060 con 0x7f66f8003f60 2024-04-25T15:46:28.484 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:28.484 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":85,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:27.174490+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66f0074650 msgr2=0x7f66f0076b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66f0074650 0x7f66f0076b60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f670c073740 tx=0x7f66fc02d000 comp rx=0 tx=0).stop 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 msgr2=0x7f670c160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f670c160970 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f670800fb90 tx=0x7f670800d520 comp rx=0 tx=0).stop 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 shutdown_connections 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f66f0074650 0x7f66f0076b60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f670c14c870 0x7f670c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f670c14fb30 0x7f670c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 --2- 172.21.15.80:0/442796398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66f8003f60 0x7f670c160970 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 >> 172.21.15.80:0/442796398 conn(0x7f670c0b7620 msgr2=0x7f670c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 shutdown_connections 2024-04-25T15:46:28.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.485+0000 7f6714242640 1 -- 172.21.15.80:0/442796398 wait complete. 2024-04-25T15:46:28.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:46:28.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.606+0000 7f16812d8640 1 Processor -- start 2024-04-25T15:46:28.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.606+0000 7f16812d8640 1 -- start start 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.607+0000 7f16812d8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f167c15e220 0x7f167c0d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f16812d8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167c0d3500 con 0x7f167c0cebe0 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f16812d8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167c0d37e0 con 0x7f167c0d2ff0 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f16812d8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f167c0d3ac0 con 0x7f167c15e220 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f167c15e220 0x7f167c0d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f167c15e220 0x7f167c0d2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52098/0 (socket says 172.21.15.80:52098) 2024-04-25T15:46:28.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167affd640 1 -- 172.21.15.80:0/2724916396 learned_addr learned my addr 172.21.15.80:0/2724916396 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:28.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167b7fe640 1 --1- 172.21.15.80:0/2724916396 >> v1:172.21.15.80:6789/0 conn(0x7f167c0cebe0 0x7f167c0b6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52310/0 (socket says 172.21.15.80:52310) 2024-04-25T15:46:28.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167affd640 1 -- 172.21.15.80:0/2724916396 >> v1:172.21.15.195:6789/0 conn(0x7f167c0d2ff0 legacy=0x7f167c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:28.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167affd640 1 -- 172.21.15.80:0/2724916396 >> v1:172.21.15.80:6789/0 conn(0x7f167c0cebe0 legacy=0x7f167c0b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.608+0000 7f167affd640 1 -- 172.21.15.80:0/2724916396 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c0d3da0 con 0x7f167c15e220 2024-04-25T15:46:28.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.609+0000 7f167affd640 1 --2- 172.21.15.80:0/2724916396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15e220 0x7f167c0d2ab0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1670009870 tx=0x7f167002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c6ad966044a79e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.609+0000 7f1679ffb640 1 -- 172.21.15.80:0/2724916396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670037070 con 0x7f167c15e220 2024-04-25T15:46:28.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.609+0000 7f1679ffb640 1 -- 172.21.15.80:0/2724916396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1670032640 con 0x7f167c15e220 2024-04-25T15:46:28.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.609+0000 7f1679ffb640 1 -- 172.21.15.80:0/2724916396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670032a10 con 0x7f167c15e220 2024-04-25T15:46:28.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.609+0000 7f16812d8640 1 -- 172.21.15.80:0/2724916396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15e220 msgr2=0x7f167c0d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.609+0000 7f16812d8640 1 --2- 172.21.15.80:0/2724916396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15e220 0x7f167c0d2ab0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1670009870 tx=0x7f167002a330 comp rx=0 tx=0).stop 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.610+0000 7f16812d8640 1 -- 172.21.15.80:0/2724916396 shutdown_connections 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.610+0000 7f16812d8640 1 --2- 172.21.15.80:0/2724916396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15e220 0x7f167c0d2ab0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.610+0000 7f16812d8640 1 -- 172.21.15.80:0/2724916396 >> 172.21.15.80:0/2724916396 conn(0x7f167c0b5510 msgr2=0x7f167c0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.610+0000 7f16812d8640 1 -- 172.21.15.80:0/2724916396 shutdown_connections 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.610+0000 7f16812d8640 1 -- 172.21.15.80:0/2724916396 wait complete. 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.611+0000 7f16812d8640 1 Processor -- start 2024-04-25T15:46:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.611+0000 7f16812d8640 1 -- start start 2024-04-25T15:46:28.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16812d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0d2ff0 0x7f167c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16812d8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c15e220 0x7f167c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16812d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 0x7f167c14b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16812d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f167c0cf3a0 con 0x7f167c15f290 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16812d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f167c0cf220 con 0x7f167c0d2ff0 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16812d8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f167c0b74e0 con 0x7f167c15e220 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 0x7f167c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 0x7f167c14b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52112/0 (socket says 172.21.15.80:52112) 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 -- 172.21.15.80:0/2190495434 learned_addr learned my addr 172.21.15.80:0/2190495434 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167affd640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0d2ff0 0x7f167c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167a7fc640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c15e220 0x7f167c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 -- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c15e220 msgr2=0x7f167c14b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c15e220 0x7f167c14b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 -- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0d2ff0 msgr2=0x7f167c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0d2ff0 0x7f167c0ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 -- 172.21.15.80:0/2190495434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c14a320 con 0x7f167c15f290 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167a7fc640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c15e220 0x7f167c14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f167b7fe640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 0x7f167c14b900 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f167400c3c0 tx=0x7f167400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.613+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16740074e0 con 0x7f167c15f290 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.614+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1674007680 con 0x7f167c15f290 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.614+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167c14a600 con 0x7f167c15f290 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.614+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674004a20 con 0x7f167c15f290 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.614+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167c14abc0 con 0x7f167c15f290 2024-04-25T15:46:28.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.614+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167c15ffb0 con 0x7f167c15f290 2024-04-25T15:46:28.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.615+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f167401a020 con 0x7f167c15f290 2024-04-25T15:46:28.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.615+0000 7f16637fe640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16680744b0 0x7f16680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.616+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f16740949d0 con 0x7f167c15f290 2024-04-25T15:46:28.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.616+0000 7f167affd640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16680744b0 0x7f16680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.616+0000 7f167affd640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16680744b0 0x7f16680769c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1670034000 tx=0x7f167002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.620+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f167c15ffb0 con 0x7f167c15f290 2024-04-25T15:46:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:28.834+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f167c06a100 con 0x7f167c15f290 2024-04-25T15:46:29.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.828+0000 7f16637fe640 1 -- 172.21.15.80:0/2190495434 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) ==== 118+0+0 (secure 0 0 0) 0x7f167405f060 con 0x7f167c15f290 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.830+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16680744b0 msgr2=0x7f16680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.830+0000 7f16812d8640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16680744b0 0x7f16680769c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1670034000 tx=0x7f167002e000 comp rx=0 tx=0).stop 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.830+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 msgr2=0x7f167c14b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.830+0000 7f16812d8640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 0x7f167c14b900 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f167400c3c0 tx=0x7f167400c880 comp rx=0 tx=0).stop 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 shutdown_connections 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f16680744b0 0x7f16680769c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f167c15f290 0x7f167c14b900 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c15e220 0x7f167c14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 --2- 172.21.15.80:0/2190495434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0d2ff0 0x7f167c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 >> 172.21.15.80:0/2190495434 conn(0x7f167c0b5510 msgr2=0x7f167c0b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 shutdown_connections 2024-04-25T15:46:29.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.831+0000 7f16812d8640 1 -- 172.21.15.80:0/2190495434 wait complete. 2024-04-25T15:46:29.846 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:46:29.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:46:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 Processor -- start 2024-04-25T15:46:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 -- start start 2024-04-25T15:46:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc8c40d0b00 0x7fc8c40d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 0x7fc8c40d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c41643f0 con 0x7fc8c40b5490 2024-04-25T15:46:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c41646d0 con 0x7fc8c40d0b00 2024-04-25T15:46:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8cbb57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c41649b0 con 0x7fc8c40d2b80 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8c98f3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc8c40b5490 0x7fc8c4160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52322/0 (socket says 172.21.15.80:52322) 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.961+0000 7fc8c98f3640 1 -- 172.21.15.80:0/891366750 learned_addr learned my addr 172.21.15.80:0/891366750 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8ca0f4640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 0x7fc8c40d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 --2- 172.21.15.80:0/891366750 >> v2:172.21.15.195:3300/0 conn(0x7fc8c40d0b00 0x7fc8c40d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040189723 0 0) 0x7fc8c41643f0 con 0x7fc8c40b5490 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8b0003520 con 0x7fc8c40b5490 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2707202810 0 0) 0x7fc8b0003520 con 0x7fc8c40b5490 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 msgr2=0x7fc8c40d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 0x7fc8c40d47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 >> v2:172.21.15.195:3300/0 conn(0x7fc8c40d0b00 msgr2=0x7fc8c40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 --2- 172.21.15.80:0/891366750 >> v2:172.21.15.195:3300/0 conn(0x7fc8c40d0b00 0x7fc8c40d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c4164c90 con 0x7fc8c40b5490 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc8c0001670 con 0x7fc8c40b5490 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 >> v1:172.21.15.80:6789/0 conn(0x7fc8c40b5490 legacy=0x7fc8c4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 0x7fc8b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b0003f30 0x7fc8b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0004d40 0x7fc8b0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41646d0 con 0x7fc8b0003f30 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41649b0 con 0x7fc8b0004d40 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b000ba10 con 0x7fc8c40d2b80 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b0003f30 0x7fc8b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c98f3640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 0x7fc8b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8ca0f4640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0004d40 0x7fc8b0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 -- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 msgr2=0x7fc8b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c40d2b80 0x7fc8b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 -- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0004d40 msgr2=0x7fc8b0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0004d40 0x7fc8b0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.962+0000 7fc8c90f2640 1 -- 172.21.15.80:0/891366750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b0003520 con 0x7fc8b0003f30 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.963+0000 7fc8c90f2640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b0003f30 0x7fc8b0004800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009a90 tx=0x7fc8b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e5b08a89bead41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.963+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4036070 con 0x7fc8b0003f30 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.963+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b4031400 con 0x7fc8b0003f30 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.963+0000 7fc8c88f1640 1 -- 172.21.15.80:0/891366750 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4009690 con 0x7fc8b0003f30 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8cbb57640 1 -- 172.21.15.80:0/891366750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b0003f30 msgr2=0x7fc8b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/891366750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8b0003f30 0x7fc8b0004800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009a90 tx=0x7fc8b0005830 comp rx=0 tx=0).stop 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8ca0f4640 1 -- 172.21.15.80:0/891366750 reap_dead start 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8cbb57640 1 -- 172.21.15.80:0/891366750 shutdown_connections 2024-04-25T15:46:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8cbb57640 1 -- 172.21.15.80:0/891366750 >> 172.21.15.80:0/891366750 conn(0x7fc8c406e650 msgr2=0x7fc8c406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8cbb57640 1 -- 172.21.15.80:0/891366750 shutdown_connections 2024-04-25T15:46:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.964+0000 7fc8cbb57640 1 -- 172.21.15.80:0/891366750 wait complete. 2024-04-25T15:46:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.966+0000 7fc8cbb57640 1 Processor -- start 2024-04-25T15:46:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.966+0000 7fc8cbb57640 1 -- start start 2024-04-25T15:46:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8cbb57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0003f30 0x7fc8c415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8cbb57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d0d0 0x7fc8c41f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8cbb57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 0x7fc8c40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8cbb57640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c40b94e0 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8cbb57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c40b9360 con 0x7fc8b0003f30 2024-04-25T15:46:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8cbb57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c4163f80 con 0x7fc8c415d0d0 2024-04-25T15:46:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 0x7fc8c40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 0x7fc8c40cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52138/0 (socket says 172.21.15.80:52138) 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 -- 172.21.15.80:0/1608927236 learned_addr learned my addr 172.21.15.80:0/1608927236 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 -- 172.21.15.80:0/1608927236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d0d0 msgr2=0x7fc8c41f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d0d0 0x7fc8c41f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 -- 172.21.15.80:0/1608927236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0003f30 msgr2=0x7fc8c415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0003f30 0x7fc8c415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.967+0000 7fc8ca0f4640 1 -- 172.21.15.80:0/1608927236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c40cc340 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.968+0000 7fc8ca0f4640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 0x7fc8c40cbe00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40d22f0 tx=0x7fc8bc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.968+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00fe10 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.968+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc01d070 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.968+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc015670 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.968+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c415d4e0 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.968+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c415c0b0 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.969+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c415bb40 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.969+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc8bc015810 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.970+0000 7fc8ba7fc640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a80744e0 0x7fc8a80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.970+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fc8bc095cb0 con 0x7fc8c40cb9f0 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.970+0000 7fc8c98f3640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a80744e0 0x7fc8a80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.970+0000 7fc8c98f3640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a80744e0 0x7fc8a80769f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0001ba0 tx=0x7fc8c0001b10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:29.975+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc8c40cc340 con 0x7fc8c40cb9f0 2024-04-25T15:46:30.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.185+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc8c406a100 con 0x7fc8c40cb9f0 2024-04-25T15:46:30.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.834+0000 7fc8ba7fc640 1 -- 172.21.15.80:0/1608927236 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7fc8bc010040 con 0x7fc8c40cb9f0 2024-04-25T15:46:30.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a80744e0 msgr2=0x7fc8a80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a80744e0 0x7fc8a80769f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0001ba0 tx=0x7fc8c0001b10 comp rx=0 tx=0).stop 2024-04-25T15:46:30.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 msgr2=0x7fc8c40cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 0x7fc8c40cbe00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40d22f0 tx=0x7fc8bc00f580 comp rx=0 tx=0).stop 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 shutdown_connections 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc8a80744e0 0x7fc8a80769f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8c40cb9f0 0x7fc8c40cbe00 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8c415d0d0 0x7fc8c41f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 --2- 172.21.15.80:0/1608927236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b0003f30 0x7fc8c415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 >> 172.21.15.80:0/1608927236 conn(0x7fc8c406e650 msgr2=0x7fc8c41630d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 shutdown_connections 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.837+0000 7fc8cbb57640 1 -- 172.21.15.80:0/1608927236 wait complete. 2024-04-25T15:46:30.850 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:46:30.850 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.961+0000 7fd284df3640 1 Processor -- start 2024-04-25T15:46:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.961+0000 7fd284df3640 1 -- start start 2024-04-25T15:46:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd284df3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2800d1090 0x7fd28006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd284df3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd28015b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd284df3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28006df20 con 0x7fd28006db10 2024-04-25T15:46:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd284df3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd280070470 con 0x7fd2800d1090 2024-04-25T15:46:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd284df3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd2800ae960 con 0x7fd2800afe30 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2800d1090 0x7fd28006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2800d1090 0x7fd28006d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52140/0 (socket says 172.21.15.80:52140) 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 -- 172.21.15.80:0/3111997368 learned_addr learned my addr 172.21.15.80:0/3111997368 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 -- 172.21.15.80:0/3111997368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 msgr2=0x7fd28015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 --2- 172.21.15.80:0/3111997368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd28015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 -- 172.21.15.80:0/3111997368 >> v1:172.21.15.195:6789/0 conn(0x7fd28006db10 legacy=0x7fd2800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.963+0000 7fd27e59c640 1 -- 172.21.15.80:0/3111997368 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2800aec40 con 0x7fd2800d1090 2024-04-25T15:46:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.964+0000 7fd27e59c640 1 --2- 172.21.15.80:0/3111997368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd28006d5d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd270009e80 tx=0x7fd27002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b575850d9a7118 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.964+0000 7fd27d59a640 1 -- 172.21.15.80:0/3111997368 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270036070 con 0x7fd2800d1090 2024-04-25T15:46:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.964+0000 7fd27d59a640 1 -- 172.21.15.80:0/3111997368 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270031600 con 0x7fd2800d1090 2024-04-25T15:46:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.964+0000 7fd27d59a640 1 -- 172.21.15.80:0/3111997368 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700319d0 con 0x7fd2800d1090 2024-04-25T15:46:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 -- 172.21.15.80:0/3111997368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 msgr2=0x7fd28006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 --2- 172.21.15.80:0/3111997368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd28006d5d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd270009e80 tx=0x7fd27002a660 comp rx=0 tx=0).stop 2024-04-25T15:46:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 -- 172.21.15.80:0/3111997368 shutdown_connections 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 --2- 172.21.15.80:0/3111997368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd28015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 --2- 172.21.15.80:0/3111997368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd28006d5d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 -- 172.21.15.80:0/3111997368 >> 172.21.15.80:0/3111997368 conn(0x7fd2800d1e20 msgr2=0x7fd280073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 -- 172.21.15.80:0/3111997368 shutdown_connections 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.965+0000 7fd284df3640 1 -- 172.21.15.80:0/3111997368 wait complete. 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.967+0000 7fd284df3640 1 Processor -- start 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.967+0000 7fd284df3640 1 -- start start 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd284df3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd28006db10 0x7fd2801e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd284df3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd2801575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd284df3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd2800cf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd284df3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2800d14a0 con 0x7fd2800d1090 2024-04-25T15:46:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd284df3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd2800af200 con 0x7fd28006db10 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd284df3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd2800d1620 con 0x7fd2800afe30 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd2800cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd2800cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52150/0 (socket says 172.21.15.80:52150) 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 -- 172.21.15.80:0/1301540112 learned_addr learned my addr 172.21.15.80:0/1301540112 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27e59c640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd28006db10 0x7fd2801e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27dd9b640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd2801575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 -- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 msgr2=0x7fd2801575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd2801575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 -- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd28006db10 msgr2=0x7fd2801e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd28006db10 0x7fd2801e86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 -- 172.21.15.80:0/1301540112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2801e8ff0 con 0x7fd2800d1090 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.968+0000 7fd27ed9d640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd2800cf820 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b470 tx=0x7fd27800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.969+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278015020 con 0x7fd2800d1090 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.969+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd278011850 con 0x7fd2800d1090 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.969+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd280157b30 con 0x7fd2800d1090 2024-04-25T15:46:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.969+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278011c40 con 0x7fd2800d1090 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.969+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd280158450 con 0x7fd2800d1090 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.970+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2801e8d60 con 0x7fd2800d1090 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.970+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd278018020 con 0x7fd2800d1090 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.971+0000 7fd26effd640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2600744b0 0x7fd2600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.971+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fd278095000 con 0x7fd2800d1090 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.971+0000 7fd27e59c640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2600744b0 0x7fd2600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.971+0000 7fd27e59c640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2600744b0 0x7fd2600769c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd270033000 tx=0x7fd270009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:30.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:30.975+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd27801f020 con 0x7fd2800d1090 2024-04-25T15:46:31.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.191+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd28006a100 con 0x7fd2800d1090 2024-04-25T15:46:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.192+0000 7fd26effd640 1 -- 172.21.15.80:0/1301540112 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7fd27805f0d0 con 0x7fd2800d1090 2024-04-25T15:46:31.192 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:31.192 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2600744b0 msgr2=0x7fd2600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2600744b0 0x7fd2600769c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd270033000 tx=0x7fd270009000 comp rx=0 tx=0).stop 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 msgr2=0x7fd2800cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd2800cf820 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b470 tx=0x7fd27800b870 comp rx=0 tx=0).stop 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 shutdown_connections 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2600744b0 0x7fd2600769c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2800d1090 0x7fd2800cf820 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2800afe30 0x7fd2801575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 --2- 172.21.15.80:0/1301540112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd28006db10 0x7fd2801e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 >> 172.21.15.80:0/1301540112 conn(0x7fd2800d1e20 msgr2=0x7fd2800b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 shutdown_connections 2024-04-25T15:46:31.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.194+0000 7fd284df3640 1 -- 172.21.15.80:0/1301540112 wait complete. 2024-04-25T15:46:31.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:31.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.312+0000 7fde79040640 1 Processor -- start 2024-04-25T15:46:31.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.312+0000 7fde79040640 1 -- start start 2024-04-25T15:46:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde79040640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fde74074240 0x7fde7415c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde79040640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b65a0 0x7fde740b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde79040640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde740703e0 con 0x7fde740b0d80 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde79040640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fde740affc0 con 0x7fde74074240 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde79040640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fde740b02a0 con 0x7fde740b65a0 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7359e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b65a0 0x7fde740b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7259c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fde74074240 0x7fde7415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde72d9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fde740b0d80 0x7fde74073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:47540/0 (socket says 172.21.15.80:47540) 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7259c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fde74074240 0x7fde7415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:55608/0 (socket says 172.21.15.80:55608) 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde72d9d640 1 -- 172.21.15.80:0/3465811485 learned_addr learned my addr 172.21.15.80:0/3465811485 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7359e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b65a0 0x7fde740b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:49680/0 (socket says 172.21.15.80:49680) 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7259c640 1 -- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b65a0 msgr2=0x7fde740b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7259c640 1 --2- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b65a0 0x7fde740b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7259c640 1 -- 172.21.15.80:0/3465811485 >> v1:172.21.15.195:6789/0 conn(0x7fde740b0d80 legacy=0x7fde74073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.314+0000 7fde7259c640 1 -- 172.21.15.80:0/3465811485 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde740b0580 con 0x7fde74074240 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.315+0000 7fde7259c640 1 --2- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74074240 0x7fde7415c670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde680097a0 tx=0x7fde6802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=855a8a916116953e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.315+0000 7fde71d9b640 1 -- 172.21.15.80:0/3465811485 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68037070 con 0x7fde74074240 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.315+0000 7fde71d9b640 1 -- 172.21.15.80:0/3465811485 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde68032440 con 0x7fde74074240 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.315+0000 7fde71d9b640 1 -- 172.21.15.80:0/3465811485 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68032810 con 0x7fde74074240 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 -- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74074240 msgr2=0x7fde7415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 --2- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74074240 0x7fde7415c670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde680097a0 tx=0x7fde6802a180 comp rx=0 tx=0).stop 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 -- 172.21.15.80:0/3465811485 shutdown_connections 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 --2- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b65a0 0x7fde740b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 --2- 172.21.15.80:0/3465811485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74074240 0x7fde7415c670 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 -- 172.21.15.80:0/3465811485 >> 172.21.15.80:0/3465811485 conn(0x7fde740d1e20 msgr2=0x7fde74073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 -- 172.21.15.80:0/3465811485 shutdown_connections 2024-04-25T15:46:31.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.316+0000 7fde79040640 1 -- 172.21.15.80:0/3465811485 wait complete. 2024-04-25T15:46:31.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.318+0000 7fde79040640 1 Processor -- start 2024-04-25T15:46:31.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.318+0000 7fde79040640 1 -- start start 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b0d80 0x7fde74142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde740b65a0 0x7fde74147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 0x7fde7414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fde7406fe10 con 0x7fde74148130 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fde740ae7c0 con 0x7fde740b65a0 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fde7406ff90 con 0x7fde740b0d80 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 0x7fde7414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 0x7fde7414f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52152/0 (socket says 172.21.15.80:52152) 2024-04-25T15:46:31.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 -- 172.21.15.80:0/3128006940 learned_addr learned my addr 172.21.15.80:0/3128006940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7259c640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde740b65a0 0x7fde74147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde72d9d640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b0d80 0x7fde74142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 -- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b0d80 msgr2=0x7fde74142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b0d80 0x7fde74142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 -- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde740b65a0 msgr2=0x7fde74147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde740b65a0 0x7fde74147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 -- 172.21.15.80:0/3128006940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde74148920 con 0x7fde74148130 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde7359e640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 0x7fde7414f380 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00e820 tx=0x7fde6c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c017070 con 0x7fde74148130 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6c00ee70 con 0x7fde74148130 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00cb60 con 0x7fde74148130 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.320+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7414a430 con 0x7fde74148130 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.321+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde7414a9b0 con 0x7fde74148130 2024-04-25T15:46:31.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.322+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7406a100 con 0x7fde74148130 2024-04-25T15:46:31.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.322+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fde6c01a070 con 0x7fde74148130 2024-04-25T15:46:31.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.323+0000 7fde5b7fe640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fde600744b0 0x7fde600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.323+0000 7fde72d9d640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fde600744b0 0x7fde600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.323+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fde6c0950f0 con 0x7fde74148130 2024-04-25T15:46:31.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.323+0000 7fde72d9d640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fde600744b0 0x7fde600769c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fde640012e0 tx=0x7fde64001990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.327+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde6c05f1c0 con 0x7fde74148130 2024-04-25T15:46:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.501+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde7415b280 con 0x7fde74148130 2024-04-25T15:46:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.502+0000 7fde5b7fe640 1 -- 172.21.15.80:0/3128006940 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16873 (secure 0 0 0) 0x7fde6c0634c0 con 0x7fde74148130 2024-04-25T15:46:31.503 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:31.503 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":86,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:28.822992+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fde600744b0 msgr2=0x7fde600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fde600744b0 0x7fde600769c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fde640012e0 tx=0x7fde64001990 comp rx=0 tx=0).stop 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 msgr2=0x7fde7414f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 0x7fde7414f380 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00e820 tx=0x7fde6c00ec20 comp rx=0 tx=0).stop 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 shutdown_connections 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fde600744b0 0x7fde600769c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde74148130 0x7fde7414f380 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde740b65a0 0x7fde74147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 --2- 172.21.15.80:0/3128006940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fde740b0d80 0x7fde74142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 >> 172.21.15.80:0/3128006940 conn(0x7fde740d1e20 msgr2=0x7fde7415b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 shutdown_connections 2024-04-25T15:46:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.504+0000 7fde79040640 1 -- 172.21.15.80:0/3128006940 wait complete. 2024-04-25T15:46:31.516 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:46:31.517 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:31.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.624+0000 7ff387051640 1 Processor -- start 2024-04-25T15:46:31.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.624+0000 7ff387051640 1 -- start start 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.625+0000 7ff387051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 0x7ff380072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.625+0000 7ff387051640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3801624d0 con 0x7ff380161c80 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.625+0000 7ff387051640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3801627b0 con 0x7ff3800d2a90 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.625+0000 7ff387051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff380072aa0 con 0x7ff380071950 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.625+0000 7ff37ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff380161c80 0x7ff3800b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52334/0 (socket says 172.21.15.80:52334) 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.625+0000 7ff37ffff640 1 -- 172.21.15.80:0/2028498916 learned_addr learned my addr 172.21.15.80:0/2028498916 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331996569 0 0) 0x7ff3801624d0 con 0x7ff380161c80 2024-04-25T15:46:31.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff384ded640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 0x7ff380072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff36c003520 con 0x7ff380161c80 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2583804264 0 0) 0x7ff36c003520 con 0x7ff380161c80 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 msgr2=0x7ff380072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 0x7ff380072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 >> v1:172.21.15.195:6789/0 conn(0x7ff3800d2a90 legacy=0x7ff3800d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff380162a90 con 0x7ff380161c80 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7ff3680017f0 con 0x7ff380161c80 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 >> v1:172.21.15.80:6789/0 conn(0x7ff380161c80 legacy=0x7ff3800b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff36c0039e0 0x7ff36c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 0x7ff36c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c004d40 0x7ff36c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c00bb50 con 0x7ff36c004d40 2024-04-25T15:46:31.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c00bd00 con 0x7ff36c0039e0 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c00bf00 con 0x7ff380071950 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff3855ee640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c004d40 0x7ff36c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff37ffff640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 0x7ff36c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff384ded640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff36c0039e0 0x7ff36c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff3855ee640 1 -- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 msgr2=0x7ff36c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff3855ee640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff380071950 0x7ff36c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff3855ee640 1 -- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff36c0039e0 msgr2=0x7ff36c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff3855ee640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff36c0039e0 0x7ff36c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.626+0000 7ff3855ee640 1 -- 172.21.15.80:0/2028498916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c003520 con 0x7ff36c004d40 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.627+0000 7ff3855ee640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c004d40 0x7ff36c005150 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff370001720 tx=0x7ff36c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15fa7633850cebf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.627+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370001370 con 0x7ff36c004d40 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.627+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700052d0 con 0x7ff36c004d40 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.627+0000 7ff37f7fe640 1 -- 172.21.15.80:0/2028498916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37002abc0 con 0x7ff36c004d40 2024-04-25T15:46:31.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff387051640 1 -- 172.21.15.80:0/2028498916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c004d40 msgr2=0x7ff36c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff387051640 1 --2- 172.21.15.80:0/2028498916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c004d40 0x7ff36c005150 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff370001720 tx=0x7ff36c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:31.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff3855ee640 1 -- 172.21.15.80:0/2028498916 reap_dead start 2024-04-25T15:46:31.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff387051640 1 -- 172.21.15.80:0/2028498916 shutdown_connections 2024-04-25T15:46:31.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff387051640 1 -- 172.21.15.80:0/2028498916 >> 172.21.15.80:0/2028498916 conn(0x7ff3800d3ea0 msgr2=0x7ff3800d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff387051640 1 -- 172.21.15.80:0/2028498916 shutdown_connections 2024-04-25T15:46:31.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.628+0000 7ff387051640 1 -- 172.21.15.80:0/2028498916 wait complete. 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.630+0000 7ff387051640 1 Processor -- start 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.630+0000 7ff387051640 1 -- start start 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff387051640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3801590c0 0x7ff380158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff387051640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 0x7ff3800c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff387051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3800c61c0 0x7ff3800c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff387051640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800b7810 con 0x7ff380159970 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff387051640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800b7690 con 0x7ff3801590c0 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff387051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff380162090 con 0x7ff3800c61c0 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 0x7ff3800c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 0x7ff3800c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52158/0 (socket says 172.21.15.80:52158) 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.631+0000 7ff37ffff640 1 -- 172.21.15.80:0/1807170299 learned_addr learned my addr 172.21.15.80:0/1807170299 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37ffff640 1 -- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3800c61c0 msgr2=0x7ff3800c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37ffff640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3800c61c0 0x7ff3800c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37ffff640 1 -- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3801590c0 msgr2=0x7ff380158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff384ded640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3801590c0 0x7ff380158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37ffff640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3801590c0 0x7ff380158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37ffff640 1 -- 172.21.15.80:0/1807170299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800c65d0 con 0x7ff380159970 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff384ded640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3801590c0 0x7ff380158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37ffff640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 0x7ff3800c5c80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff36800f8b0 tx=0x7ff36800fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3680072e0 con 0x7ff380159970 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff368018070 con 0x7ff380159970 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38015a320 con 0x7ff380159970 2024-04-25T15:46:31.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3680057a0 con 0x7ff380159970 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.632+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38015a8e0 con 0x7ff380159970 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.633+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38006a100 con 0x7ff380159970 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.634+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff368005940 con 0x7ff380159970 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.634+0000 7ff37d7fa640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3600744b0 0x7ff3600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.634+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7ff3680953d0 con 0x7ff380159970 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.634+0000 7ff384ded640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3600744b0 0x7ff3600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.635+0000 7ff384ded640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3600744b0 0x7ff3600769c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff3800b1fa0 tx=0x7ff37800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.639+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3800c65d0 con 0x7ff380159970 2024-04-25T15:46:31.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.809+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3800d1e40 con 0x7ff3600744b0 2024-04-25T15:46:31.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.816+0000 7ff37d7fa640 1 -- 172.21.15.80:0/1807170299 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252034 (secure 0 0 0) 0x7ff3800d1e40 con 0x7ff3600744b0 2024-04-25T15:46:31.819 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:31.821 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3600744b0 msgr2=0x7ff3600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3600744b0 0x7ff3600769c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff3800b1fa0 tx=0x7ff37800b040 comp rx=0 tx=0).stop 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 msgr2=0x7ff3800c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 0x7ff3800c5c80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff36800f8b0 tx=0x7ff36800fd70 comp rx=0 tx=0).stop 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 shutdown_connections 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff3600744b0 0x7ff3600769c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3800c61c0 0x7ff3800c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff380159970 0x7ff3800c5c80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 --2- 172.21.15.80:0/1807170299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3801590c0 0x7ff380158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 >> 172.21.15.80:0/1807170299 conn(0x7ff3800d3ea0 msgr2=0x7ff3800b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 shutdown_connections 2024-04-25T15:46:31.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.819+0000 7ff387051640 1 -- 172.21.15.80:0/1807170299 wait complete. 2024-04-25T15:46:31.830 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T15:46:31.040474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246360,"kb_used_data":9364,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728360,"statfs":{"total":773094113280,"available":772841840640,"internally_reserved":0,"allocated":9588736,"data_stored":4968002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.236098"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900351+0000","last_change":"2024-04-25T15:46:27.846628+0000","last_active":"2024-04-25T15:46:28.900351+0000","last_peered":"2024-04-25T15:46:28.900351+0000","last_clean":"2024-04-25T15:46:28.900351+0000","last_became_active":"2024-04-25T15:46:27.846335+0000","last_became_peered":"2024-04-25T15:46:27.846335+0000","last_unstale":"2024-04-25T15:46:28.900351+0000","last_undegraded":"2024-04-25T15:46:28.900351+0000","last_fullsized":"2024-04-25T15:46:28.900351+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:41.566085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.837474+0000","last_change":"2024-04-25T15:46:27.836406+0000","last_active":"2024-04-25T15:46:27.837474+0000","last_peered":"2024-04-25T15:46:27.837474+0000","last_clean":"2024-04-25T15:46:27.837474+0000","last_became_active":"2024-04-25T15:46:27.836080+0000","last_became_peered":"2024-04-25T15:46:27.836080+0000","last_unstale":"2024-04-25T15:46:27.837474+0000","last_undegraded":"2024-04-25T15:46:27.837474+0000","last_fullsized":"2024-04-25T15:46:27.837474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:20.830585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899645+0000","last_change":"2024-04-25T15:46:27.830808+0000","last_active":"2024-04-25T15:46:28.899645+0000","last_peered":"2024-04-25T15:46:28.899645+0000","last_clean":"2024-04-25T15:46:28.899645+0000","last_became_active":"2024-04-25T15:46:27.830473+0000","last_became_peered":"2024-04-25T15:46:27.830473+0000","last_unstale":"2024-04-25T15:46:28.899645+0000","last_undegraded":"2024-04-25T15:46:28.899645+0000","last_fullsized":"2024-04-25T15:46:28.899645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:18.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900101+0000","last_change":"2024-04-25T15:46:27.836444+0000","last_active":"2024-04-25T15:46:28.900101+0000","last_peered":"2024-04-25T15:46:28.900101+0000","last_clean":"2024-04-25T15:46:28.900101+0000","last_became_active":"2024-04-25T15:46:27.836150+0000","last_became_peered":"2024-04-25T15:46:27.836150+0000","last_unstale":"2024-04-25T15:46:28.900101+0000","last_undegraded":"2024-04-25T15:46:28.900101+0000","last_fullsized":"2024-04-25T15:46:28.900101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.134524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833438+0000","last_change":"2024-04-25T15:46:27.830542+0000","last_active":"2024-04-25T15:46:27.833438+0000","last_peered":"2024-04-25T15:46:27.833438+0000","last_clean":"2024-04-25T15:46:27.833438+0000","last_became_active":"2024-04-25T15:46:27.830167+0000","last_became_peered":"2024-04-25T15:46:27.830167+0000","last_unstale":"2024-04-25T15:46:27.833438+0000","last_undegraded":"2024-04-25T15:46:27.833438+0000","last_fullsized":"2024-04-25T15:46:27.833438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:06.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900117+0000","last_change":"2024-04-25T15:46:27.854376+0000","last_active":"2024-04-25T15:46:28.900117+0000","last_peered":"2024-04-25T15:46:28.900117+0000","last_clean":"2024-04-25T15:46:28.900117+0000","last_became_active":"2024-04-25T15:46:27.854032+0000","last_became_peered":"2024-04-25T15:46:27.854032+0000","last_unstale":"2024-04-25T15:46:28.900117+0000","last_undegraded":"2024-04-25T15:46:28.900117+0000","last_fullsized":"2024-04-25T15:46:28.900117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:42.942766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.838084+0000","last_change":"2024-04-25T15:46:27.836213+0000","last_active":"2024-04-25T15:46:27.838084+0000","last_peered":"2024-04-25T15:46:27.838084+0000","last_clean":"2024-04-25T15:46:27.838084+0000","last_became_active":"2024-04-25T15:46:27.835900+0000","last_became_peered":"2024-04-25T15:46:27.835900+0000","last_unstale":"2024-04-25T15:46:27.838084+0000","last_undegraded":"2024-04-25T15:46:27.838084+0000","last_fullsized":"2024-04-25T15:46:27.838084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:41.566085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899542+0000","last_change":"2024-04-25T15:46:27.842138+0000","last_active":"2024-04-25T15:46:28.899542+0000","last_peered":"2024-04-25T15:46:28.899542+0000","last_clean":"2024-04-25T15:46:28.899542+0000","last_became_active":"2024-04-25T15:46:27.839921+0000","last_became_peered":"2024-04-25T15:46:27.839921+0000","last_unstale":"2024-04-25T15:46:28.899542+0000","last_undegraded":"2024-04-25T15:46:28.899542+0000","last_fullsized":"2024-04-25T15:46:28.899542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.760467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833300+0000","last_change":"2024-04-25T15:46:27.829092+0000","last_active":"2024-04-25T15:46:27.833300+0000","last_peered":"2024-04-25T15:46:27.833300+0000","last_clean":"2024-04-25T15:46:27.833300+0000","last_became_active":"2024-04-25T15:46:27.828767+0000","last_became_peered":"2024-04-25T15:46:27.828767+0000","last_unstale":"2024-04-25T15:46:27.833300+0000","last_undegraded":"2024-04-25T15:46:27.833300+0000","last_fullsized":"2024-04-25T15:46:27.833300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:15.156692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.830214+0000","last_change":"2024-04-25T15:46:27.844152+0000","last_active":"2024-04-25T15:46:28.830214+0000","last_peered":"2024-04-25T15:46:28.830214+0000","last_clean":"2024-04-25T15:46:28.830214+0000","last_became_active":"2024-04-25T15:46:27.843838+0000","last_became_peered":"2024-04-25T15:46:27.843838+0000","last_unstale":"2024-04-25T15:46:28.830214+0000","last_undegraded":"2024-04-25T15:46:28.830214+0000","last_fullsized":"2024-04-25T15:46:28.830214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:31.199721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.848244+0000","last_change":"2024-04-25T15:46:27.847514+0000","last_active":"2024-04-25T15:46:27.848244+0000","last_peered":"2024-04-25T15:46:27.848244+0000","last_clean":"2024-04-25T15:46:27.848244+0000","last_became_active":"2024-04-25T15:46:27.847202+0000","last_became_peered":"2024-04-25T15:46:27.847202+0000","last_unstale":"2024-04-25T15:46:27.848244+0000","last_undegraded":"2024-04-25T15:46:27.848244+0000","last_fullsized":"2024-04-25T15:46:27.848244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:05.216309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.830031+0000","last_change":"2024-04-25T15:46:27.836313+0000","last_active":"2024-04-25T15:46:28.830031+0000","last_peered":"2024-04-25T15:46:28.830031+0000","last_clean":"2024-04-25T15:46:28.830031+0000","last_became_active":"2024-04-25T15:46:27.835996+0000","last_became_peered":"2024-04-25T15:46:27.835996+0000","last_unstale":"2024-04-25T15:46:28.830031+0000","last_undegraded":"2024-04-25T15:46:28.830031+0000","last_fullsized":"2024-04-25T15:46:28.830031+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:53.481704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900642+0000","last_change":"2024-04-25T15:46:27.839256+0000","last_active":"2024-04-25T15:46:28.900642+0000","last_peered":"2024-04-25T15:46:28.900642+0000","last_clean":"2024-04-25T15:46:28.900642+0000","last_became_active":"2024-04-25T15:46:27.838947+0000","last_became_peered":"2024-04-25T15:46:27.838947+0000","last_unstale":"2024-04-25T15:46:28.900642+0000","last_undegraded":"2024-04-25T15:46:28.900642+0000","last_fullsized":"2024-04-25T15:46:28.900642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:52.275572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.842777+0000","last_change":"2024-04-25T15:46:27.841581+0000","last_active":"2024-04-25T15:46:27.842777+0000","last_peered":"2024-04-25T15:46:27.842777+0000","last_clean":"2024-04-25T15:46:27.842777+0000","last_became_active":"2024-04-25T15:46:27.841250+0000","last_became_peered":"2024-04-25T15:46:27.841250+0000","last_unstale":"2024-04-25T15:46:27.842777+0000","last_undegraded":"2024-04-25T15:46:27.842777+0000","last_fullsized":"2024-04-25T15:46:27.842777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:53.666321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899636+0000","last_change":"2024-04-25T15:46:27.847267+0000","last_active":"2024-04-25T15:46:28.899636+0000","last_peered":"2024-04-25T15:46:28.899636+0000","last_clean":"2024-04-25T15:46:28.899636+0000","last_became_active":"2024-04-25T15:46:27.846960+0000","last_became_peered":"2024-04-25T15:46:27.846960+0000","last_unstale":"2024-04-25T15:46:28.899636+0000","last_undegraded":"2024-04-25T15:46:28.899636+0000","last_fullsized":"2024-04-25T15:46:28.899636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:21.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899369+0000","last_change":"2024-04-25T15:46:27.848578+0000","last_active":"2024-04-25T15:46:28.899369+0000","last_peered":"2024-04-25T15:46:28.899369+0000","last_clean":"2024-04-25T15:46:28.899369+0000","last_became_active":"2024-04-25T15:46:27.848021+0000","last_became_peered":"2024-04-25T15:46:27.848021+0000","last_unstale":"2024-04-25T15:46:28.899369+0000","last_undegraded":"2024-04-25T15:46:28.899369+0000","last_fullsized":"2024-04-25T15:46:28.899369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:50.335746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900738+0000","last_change":"2024-04-25T15:46:27.846923+0000","last_active":"2024-04-25T15:46:28.900738+0000","last_peered":"2024-04-25T15:46:28.900738+0000","last_clean":"2024-04-25T15:46:28.900738+0000","last_became_active":"2024-04-25T15:46:27.846418+0000","last_became_peered":"2024-04-25T15:46:27.846418+0000","last_unstale":"2024-04-25T15:46:28.900738+0000","last_undegraded":"2024-04-25T15:46:28.900738+0000","last_fullsized":"2024-04-25T15:46:28.900738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:29.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899900+0000","last_change":"2024-04-25T15:46:27.829346+0000","last_active":"2024-04-25T15:46:28.899900+0000","last_peered":"2024-04-25T15:46:28.899900+0000","last_clean":"2024-04-25T15:46:28.899900+0000","last_became_active":"2024-04-25T15:46:27.829035+0000","last_became_peered":"2024-04-25T15:46:27.829035+0000","last_unstale":"2024-04-25T15:46:28.899900+0000","last_undegraded":"2024-04-25T15:46:28.899900+0000","last_fullsized":"2024-04-25T15:46:28.899900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:22.956365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.839829+0000","last_change":"2024-04-25T15:46:27.839166+0000","last_active":"2024-04-25T15:46:27.839829+0000","last_peered":"2024-04-25T15:46:27.839829+0000","last_clean":"2024-04-25T15:46:27.839829+0000","last_became_active":"2024-04-25T15:46:27.838830+0000","last_became_peered":"2024-04-25T15:46:27.838830+0000","last_unstale":"2024-04-25T15:46:27.839829+0000","last_undegraded":"2024-04-25T15:46:27.839829+0000","last_fullsized":"2024-04-25T15:46:27.839829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:53.407481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900240+0000","last_change":"2024-04-25T15:46:27.850518+0000","last_active":"2024-04-25T15:46:28.900240+0000","last_peered":"2024-04-25T15:46:28.900240+0000","last_clean":"2024-04-25T15:46:28.900240+0000","last_became_active":"2024-04-25T15:46:27.850164+0000","last_became_peered":"2024-04-25T15:46:27.850164+0000","last_unstale":"2024-04-25T15:46:28.900240+0000","last_undegraded":"2024-04-25T15:46:28.900240+0000","last_fullsized":"2024-04-25T15:46:28.900240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:26.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.834539+0000","last_change":"2024-04-25T15:46:27.831899+0000","last_active":"2024-04-25T15:46:27.834539+0000","last_peered":"2024-04-25T15:46:27.834539+0000","last_clean":"2024-04-25T15:46:27.834539+0000","last_became_active":"2024-04-25T15:46:27.831583+0000","last_became_peered":"2024-04-25T15:46:27.831583+0000","last_unstale":"2024-04-25T15:46:27.834539+0000","last_undegraded":"2024-04-25T15:46:27.834539+0000","last_fullsized":"2024-04-25T15:46:27.834539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:35.625420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.838981+0000","last_change":"2024-04-25T15:46:27.838378+0000","last_active":"2024-04-25T15:46:27.838981+0000","last_peered":"2024-04-25T15:46:27.838981+0000","last_clean":"2024-04-25T15:46:27.838981+0000","last_became_active":"2024-04-25T15:46:27.837968+0000","last_became_peered":"2024-04-25T15:46:27.837968+0000","last_unstale":"2024-04-25T15:46:27.838981+0000","last_undegraded":"2024-04-25T15:46:27.838981+0000","last_fullsized":"2024-04-25T15:46:27.838981+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:26.988275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899136+0000","last_change":"2024-04-25T15:46:27.838063+0000","last_active":"2024-04-25T15:46:28.899136+0000","last_peered":"2024-04-25T15:46:28.899136+0000","last_clean":"2024-04-25T15:46:28.899136+0000","last_became_active":"2024-04-25T15:46:27.837366+0000","last_became_peered":"2024-04-25T15:46:27.837366+0000","last_unstale":"2024-04-25T15:46:28.899136+0000","last_undegraded":"2024-04-25T15:46:28.899136+0000","last_fullsized":"2024-04-25T15:46:28.899136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:05.216309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899332+0000","last_change":"2024-04-25T15:46:27.827048+0000","last_active":"2024-04-25T15:46:28.899332+0000","last_peered":"2024-04-25T15:46:28.899332+0000","last_clean":"2024-04-25T15:46:28.899332+0000","last_became_active":"2024-04-25T15:46:27.826608+0000","last_became_peered":"2024-04-25T15:46:27.826608+0000","last_unstale":"2024-04-25T15:46:28.899332+0000","last_undegraded":"2024-04-25T15:46:28.899332+0000","last_fullsized":"2024-04-25T15:46:28.899332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:03.187225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833288+0000","last_change":"2024-04-25T15:46:27.831585+0000","last_active":"2024-04-25T15:46:27.833288+0000","last_peered":"2024-04-25T15:46:27.833288+0000","last_clean":"2024-04-25T15:46:27.833288+0000","last_became_active":"2024-04-25T15:46:27.831253+0000","last_became_peered":"2024-04-25T15:46:27.831253+0000","last_unstale":"2024-04-25T15:46:27.833288+0000","last_undegraded":"2024-04-25T15:46:27.833288+0000","last_fullsized":"2024-04-25T15:46:27.833288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:29.625989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.840016+0000","last_change":"2024-04-25T15:46:27.839567+0000","last_active":"2024-04-25T15:46:27.840016+0000","last_peered":"2024-04-25T15:46:27.840016+0000","last_clean":"2024-04-25T15:46:27.840016+0000","last_became_active":"2024-04-25T15:46:27.838288+0000","last_became_peered":"2024-04-25T15:46:27.838288+0000","last_unstale":"2024-04-25T15:46:27.840016+0000","last_undegraded":"2024-04-25T15:46:27.840016+0000","last_fullsized":"2024-04-25T15:46:27.840016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:50.364405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.830068+0000","last_change":"2024-04-25T15:46:27.829886+0000","last_active":"2024-04-25T15:46:28.830068+0000","last_peered":"2024-04-25T15:46:28.830068+0000","last_clean":"2024-04-25T15:46:28.830068+0000","last_became_active":"2024-04-25T15:46:27.829540+0000","last_became_peered":"2024-04-25T15:46:27.829540+0000","last_unstale":"2024-04-25T15:46:28.830068+0000","last_undegraded":"2024-04-25T15:46:28.830068+0000","last_fullsized":"2024-04-25T15:46:28.830068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:38.612507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900245+0000","last_change":"2024-04-25T15:46:27.841632+0000","last_active":"2024-04-25T15:46:28.900245+0000","last_peered":"2024-04-25T15:46:28.900245+0000","last_clean":"2024-04-25T15:46:28.900245+0000","last_became_active":"2024-04-25T15:46:27.841266+0000","last_became_peered":"2024-04-25T15:46:27.841266+0000","last_unstale":"2024-04-25T15:46:28.900245+0000","last_undegraded":"2024-04-25T15:46:28.900245+0000","last_fullsized":"2024-04-25T15:46:28.900245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.830791+0000","last_change":"2024-04-25T15:46:27.827336+0000","last_active":"2024-04-25T15:46:27.830791+0000","last_peered":"2024-04-25T15:46:27.830791+0000","last_clean":"2024-04-25T15:46:27.830791+0000","last_became_active":"2024-04-25T15:46:27.827026+0000","last_became_peered":"2024-04-25T15:46:27.827026+0000","last_unstale":"2024-04-25T15:46:27.830791+0000","last_undegraded":"2024-04-25T15:46:27.830791+0000","last_fullsized":"2024-04-25T15:46:27.830791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:22.956365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833349+0000","last_change":"2024-04-25T15:46:27.828185+0000","last_active":"2024-04-25T15:46:27.833349+0000","last_peered":"2024-04-25T15:46:27.833349+0000","last_clean":"2024-04-25T15:46:27.833349+0000","last_became_active":"2024-04-25T15:46:27.827808+0000","last_became_peered":"2024-04-25T15:46:27.827808+0000","last_unstale":"2024-04-25T15:46:27.833349+0000","last_undegraded":"2024-04-25T15:46:27.833349+0000","last_fullsized":"2024-04-25T15:46:27.833349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:21.010226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.840006+0000","last_change":"2024-04-25T15:46:27.839342+0000","last_active":"2024-04-25T15:46:27.840006+0000","last_peered":"2024-04-25T15:46:27.840006+0000","last_clean":"2024-04-25T15:46:27.840006+0000","last_became_active":"2024-04-25T15:46:27.838979+0000","last_became_peered":"2024-04-25T15:46:27.838979+0000","last_unstale":"2024-04-25T15:46:27.840006+0000","last_undegraded":"2024-04-25T15:46:27.840006+0000","last_fullsized":"2024-04-25T15:46:27.840006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:58.614204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899528+0000","last_change":"2024-04-25T15:46:27.846552+0000","last_active":"2024-04-25T15:46:28.899528+0000","last_peered":"2024-04-25T15:46:28.899528+0000","last_clean":"2024-04-25T15:46:28.899528+0000","last_became_active":"2024-04-25T15:46:27.846176+0000","last_became_peered":"2024-04-25T15:46:27.846176+0000","last_unstale":"2024-04-25T15:46:28.899528+0000","last_undegraded":"2024-04-25T15:46:28.899528+0000","last_fullsized":"2024-04-25T15:46:28.899528+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.273522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900605+0000","last_change":"2024-04-25T15:46:27.842828+0000","last_active":"2024-04-25T15:46:28.900605+0000","last_peered":"2024-04-25T15:46:28.900605+0000","last_clean":"2024-04-25T15:46:28.900605+0000","last_became_active":"2024-04-25T15:46:27.842224+0000","last_became_peered":"2024-04-25T15:46:27.842224+0000","last_unstale":"2024-04-25T15:46:28.900605+0000","last_undegraded":"2024-04-25T15:46:28.900605+0000","last_fullsized":"2024-04-25T15:46:28.900605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:18.746016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899272+0000","last_change":"2024-04-25T15:46:26.828080+0000","last_active":"2024-04-25T15:46:28.899272+0000","last_peered":"2024-04-25T15:46:28.899272+0000","last_clean":"2024-04-25T15:46:28.899272+0000","last_became_active":"2024-04-25T15:46:26.827713+0000","last_became_peered":"2024-04-25T15:46:26.827713+0000","last_unstale":"2024-04-25T15:46:28.899272+0000","last_undegraded":"2024-04-25T15:46:28.899272+0000","last_fullsized":"2024-04-25T15:46:28.899272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:49.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900557+0000","last_change":"2024-04-25T15:46:27.839794+0000","last_active":"2024-04-25T15:46:28.900557+0000","last_peered":"2024-04-25T15:46:28.900557+0000","last_clean":"2024-04-25T15:46:28.900557+0000","last_became_active":"2024-04-25T15:46:27.839377+0000","last_became_peered":"2024-04-25T15:46:27.839377+0000","last_unstale":"2024-04-25T15:46:28.900557+0000","last_undegraded":"2024-04-25T15:46:28.900557+0000","last_fullsized":"2024-04-25T15:46:28.900557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:26.791624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.847494+0000","last_change":"2024-04-25T15:46:26.825590+0000","last_active":"2024-04-25T15:46:27.847494+0000","last_peered":"2024-04-25T15:46:27.847494+0000","last_clean":"2024-04-25T15:46:27.847494+0000","last_became_active":"2024-04-25T15:46:26.823933+0000","last_became_peered":"2024-04-25T15:46:26.823933+0000","last_unstale":"2024-04-25T15:46:27.847494+0000","last_undegraded":"2024-04-25T15:46:27.847494+0000","last_fullsized":"2024-04-25T15:46:27.847494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:07.722159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.838569+0000","last_change":"2024-04-25T15:46:27.837927+0000","last_active":"2024-04-25T15:46:27.838569+0000","last_peered":"2024-04-25T15:46:27.838569+0000","last_clean":"2024-04-25T15:46:27.838569+0000","last_became_active":"2024-04-25T15:46:27.837202+0000","last_became_peered":"2024-04-25T15:46:27.837202+0000","last_unstale":"2024-04-25T15:46:27.838569+0000","last_undegraded":"2024-04-25T15:46:27.838569+0000","last_fullsized":"2024-04-25T15:46:27.838569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:08.203677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.852670+0000","last_change":"2024-04-25T15:46:26.821840+0000","last_active":"2024-04-25T15:46:27.852670+0000","last_peered":"2024-04-25T15:46:27.852670+0000","last_clean":"2024-04-25T15:46:27.852670+0000","last_became_active":"2024-04-25T15:46:26.821508+0000","last_became_peered":"2024-04-25T15:46:26.821508+0000","last_unstale":"2024-04-25T15:46:27.852670+0000","last_undegraded":"2024-04-25T15:46:27.852670+0000","last_fullsized":"2024-04-25T15:46:27.852670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.000716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900848+0000","last_change":"2024-04-25T15:46:27.839103+0000","last_active":"2024-04-25T15:46:28.900848+0000","last_peered":"2024-04-25T15:46:28.900848+0000","last_clean":"2024-04-25T15:46:28.900848+0000","last_became_active":"2024-04-25T15:46:27.838630+0000","last_became_peered":"2024-04-25T15:46:27.838630+0000","last_unstale":"2024-04-25T15:46:28.900848+0000","last_undegraded":"2024-04-25T15:46:28.900848+0000","last_fullsized":"2024-04-25T15:46:28.900848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:41.932690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899464+0000","last_change":"2024-04-25T15:46:26.829101+0000","last_active":"2024-04-25T15:46:28.899464+0000","last_peered":"2024-04-25T15:46:28.899464+0000","last_clean":"2024-04-25T15:46:28.899464+0000","last_became_active":"2024-04-25T15:46:26.828798+0000","last_became_peered":"2024-04-25T15:46:26.828798+0000","last_unstale":"2024-04-25T15:46:28.899464+0000","last_undegraded":"2024-04-25T15:46:28.899464+0000","last_fullsized":"2024-04-25T15:46:28.899464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:20.005582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899683+0000","last_change":"2024-04-25T15:46:27.846110+0000","last_active":"2024-04-25T15:46:28.899683+0000","last_peered":"2024-04-25T15:46:28.899683+0000","last_clean":"2024-04-25T15:46:28.899683+0000","last_became_active":"2024-04-25T15:46:27.845826+0000","last_became_peered":"2024-04-25T15:46:27.845826+0000","last_unstale":"2024-04-25T15:46:28.899683+0000","last_undegraded":"2024-04-25T15:46:28.899683+0000","last_fullsized":"2024-04-25T15:46:28.899683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:34.681753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.851638+0000","last_change":"2024-04-25T15:46:26.827984+0000","last_active":"2024-04-25T15:46:27.851638+0000","last_peered":"2024-04-25T15:46:27.851638+0000","last_clean":"2024-04-25T15:46:27.851638+0000","last_became_active":"2024-04-25T15:46:26.827678+0000","last_became_peered":"2024-04-25T15:46:26.827678+0000","last_unstale":"2024-04-25T15:46:27.851638+0000","last_undegraded":"2024-04-25T15:46:27.851638+0000","last_fullsized":"2024-04-25T15:46:27.851638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:58.489988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899161+0000","last_change":"2024-04-25T15:46:27.842891+0000","last_active":"2024-04-25T15:46:28.899161+0000","last_peered":"2024-04-25T15:46:28.899161+0000","last_clean":"2024-04-25T15:46:28.899161+0000","last_became_active":"2024-04-25T15:46:27.842428+0000","last_became_peered":"2024-04-25T15:46:27.842428+0000","last_unstale":"2024-04-25T15:46:28.899161+0000","last_undegraded":"2024-04-25T15:46:28.899161+0000","last_fullsized":"2024-04-25T15:46:28.899161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:21.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900081+0000","last_change":"2024-04-25T15:46:26.827168+0000","last_active":"2024-04-25T15:46:28.900081+0000","last_peered":"2024-04-25T15:46:28.900081+0000","last_clean":"2024-04-25T15:46:28.900081+0000","last_became_active":"2024-04-25T15:46:26.826427+0000","last_became_peered":"2024-04-25T15:46:26.826427+0000","last_unstale":"2024-04-25T15:46:28.900081+0000","last_undegraded":"2024-04-25T15:46:28.900081+0000","last_fullsized":"2024-04-25T15:46:28.900081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:30.313794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900275+0000","last_change":"2024-04-25T15:46:27.842424+0000","last_active":"2024-04-25T15:46:28.900275+0000","last_peered":"2024-04-25T15:46:28.900275+0000","last_clean":"2024-04-25T15:46:28.900275+0000","last_became_active":"2024-04-25T15:46:27.842110+0000","last_became_peered":"2024-04-25T15:46:27.842110+0000","last_unstale":"2024-04-25T15:46:28.900275+0000","last_undegraded":"2024-04-25T15:46:28.900275+0000","last_fullsized":"2024-04-25T15:46:28.900275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:55.121801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900659+0000","last_change":"2024-04-25T15:46:26.819351+0000","last_active":"2024-04-25T15:46:28.900659+0000","last_peered":"2024-04-25T15:46:28.900659+0000","last_clean":"2024-04-25T15:46:28.900659+0000","last_became_active":"2024-04-25T15:46:26.819026+0000","last_became_peered":"2024-04-25T15:46:26.819026+0000","last_unstale":"2024-04-25T15:46:28.900659+0000","last_undegraded":"2024-04-25T15:46:28.900659+0000","last_fullsized":"2024-04-25T15:46:28.900659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:28.621346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900816+0000","last_change":"2024-04-25T15:46:27.833098+0000","last_active":"2024-04-25T15:46:28.900816+0000","last_peered":"2024-04-25T15:46:28.900816+0000","last_clean":"2024-04-25T15:46:28.900816+0000","last_became_active":"2024-04-25T15:46:27.832761+0000","last_became_peered":"2024-04-25T15:46:27.832761+0000","last_unstale":"2024-04-25T15:46:28.900816+0000","last_undegraded":"2024-04-25T15:46:28.900816+0000","last_fullsized":"2024-04-25T15:46:28.900816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:38.289859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.818580+0000","last_change":"2024-04-25T15:46:26.826323+0000","last_active":"2024-04-25T15:46:27.818580+0000","last_peered":"2024-04-25T15:46:27.818580+0000","last_clean":"2024-04-25T15:46:27.818580+0000","last_became_active":"2024-04-25T15:46:26.825990+0000","last_became_peered":"2024-04-25T15:46:26.825990+0000","last_unstale":"2024-04-25T15:46:27.818580+0000","last_undegraded":"2024-04-25T15:46:27.818580+0000","last_fullsized":"2024-04-25T15:46:27.818580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:57.609560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.830802+0000","last_change":"2024-04-25T15:46:27.824490+0000","last_active":"2024-04-25T15:46:27.830802+0000","last_peered":"2024-04-25T15:46:27.830802+0000","last_clean":"2024-04-25T15:46:27.830802+0000","last_became_active":"2024-04-25T15:46:27.824173+0000","last_became_peered":"2024-04-25T15:46:27.824173+0000","last_unstale":"2024-04-25T15:46:27.830802+0000","last_undegraded":"2024-04-25T15:46:27.830802+0000","last_fullsized":"2024-04-25T15:46:27.830802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.318437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.823781+0000","last_change":"2024-04-25T15:46:26.824640+0000","last_active":"2024-04-25T15:46:27.823781+0000","last_peered":"2024-04-25T15:46:27.823781+0000","last_clean":"2024-04-25T15:46:27.823781+0000","last_became_active":"2024-04-25T15:46:26.824335+0000","last_became_peered":"2024-04-25T15:46:26.824335+0000","last_unstale":"2024-04-25T15:46:27.823781+0000","last_undegraded":"2024-04-25T15:46:27.823781+0000","last_fullsized":"2024-04-25T15:46:27.823781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:16.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.835558+0000","last_change":"2024-04-25T15:46:27.834729+0000","last_active":"2024-04-25T15:46:27.835558+0000","last_peered":"2024-04-25T15:46:27.835558+0000","last_clean":"2024-04-25T15:46:27.835558+0000","last_became_active":"2024-04-25T15:46:27.834376+0000","last_became_peered":"2024-04-25T15:46:27.834376+0000","last_unstale":"2024-04-25T15:46:27.835558+0000","last_undegraded":"2024-04-25T15:46:27.835558+0000","last_fullsized":"2024-04-25T15:46:27.835558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:29.791047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900171+0000","last_change":"2024-04-25T15:46:26.828186+0000","last_active":"2024-04-25T15:46:28.900171+0000","last_peered":"2024-04-25T15:46:28.900171+0000","last_clean":"2024-04-25T15:46:28.900171+0000","last_became_active":"2024-04-25T15:46:26.827899+0000","last_became_peered":"2024-04-25T15:46:26.827899+0000","last_unstale":"2024-04-25T15:46:28.900171+0000","last_undegraded":"2024-04-25T15:46:28.900171+0000","last_fullsized":"2024-04-25T15:46:28.900171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:03.402994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900060+0000","last_change":"2024-04-25T15:46:27.848697+0000","last_active":"2024-04-25T15:46:28.900060+0000","last_peered":"2024-04-25T15:46:28.900060+0000","last_clean":"2024-04-25T15:46:28.900060+0000","last_became_active":"2024-04-25T15:46:27.848377+0000","last_became_peered":"2024-04-25T15:46:27.848377+0000","last_unstale":"2024-04-25T15:46:28.900060+0000","last_undegraded":"2024-04-25T15:46:28.900060+0000","last_fullsized":"2024-04-25T15:46:28.900060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:29.791047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.854938+0000","last_change":"2024-04-25T15:46:26.826651+0000","last_active":"2024-04-25T15:46:27.854938+0000","last_peered":"2024-04-25T15:46:27.854938+0000","last_clean":"2024-04-25T15:46:27.854938+0000","last_became_active":"2024-04-25T15:46:26.826334+0000","last_became_peered":"2024-04-25T15:46:26.826334+0000","last_unstale":"2024-04-25T15:46:27.854938+0000","last_undegraded":"2024-04-25T15:46:27.854938+0000","last_fullsized":"2024-04-25T15:46:27.854938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.406123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900872+0000","last_change":"2024-04-25T15:46:27.840319+0000","last_active":"2024-04-25T15:46:28.900872+0000","last_peered":"2024-04-25T15:46:28.900872+0000","last_clean":"2024-04-25T15:46:28.900872+0000","last_became_active":"2024-04-25T15:46:27.839977+0000","last_became_peered":"2024-04-25T15:46:27.839977+0000","last_unstale":"2024-04-25T15:46:28.900872+0000","last_undegraded":"2024-04-25T15:46:28.900872+0000","last_fullsized":"2024-04-25T15:46:28.900872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:22.364793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900722+0000","last_change":"2024-04-25T15:46:26.830505+0000","last_active":"2024-04-25T15:46:28.900722+0000","last_peered":"2024-04-25T15:46:28.900722+0000","last_clean":"2024-04-25T15:46:28.900722+0000","last_became_active":"2024-04-25T15:46:26.830206+0000","last_became_peered":"2024-04-25T15:46:26.830206+0000","last_unstale":"2024-04-25T15:46:28.900722+0000","last_undegraded":"2024-04-25T15:46:28.900722+0000","last_fullsized":"2024-04-25T15:46:28.900722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:08.178975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899824+0000","last_change":"2024-04-25T15:46:27.840108+0000","last_active":"2024-04-25T15:46:28.899824+0000","last_peered":"2024-04-25T15:46:28.899824+0000","last_clean":"2024-04-25T15:46:28.899824+0000","last_became_active":"2024-04-25T15:46:27.837152+0000","last_became_peered":"2024-04-25T15:46:27.837152+0000","last_unstale":"2024-04-25T15:46:28.899824+0000","last_undegraded":"2024-04-25T15:46:28.899824+0000","last_fullsized":"2024-04-25T15:46:28.899824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:09.809077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.853790+0000","last_change":"2024-04-25T15:46:26.828972+0000","last_active":"2024-04-25T15:46:27.853790+0000","last_peered":"2024-04-25T15:46:27.853790+0000","last_clean":"2024-04-25T15:46:27.853790+0000","last_became_active":"2024-04-25T15:46:26.828328+0000","last_became_peered":"2024-04-25T15:46:26.828328+0000","last_unstale":"2024-04-25T15:46:27.853790+0000","last_undegraded":"2024-04-25T15:46:27.853790+0000","last_fullsized":"2024-04-25T15:46:27.853790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:21.767125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833327+0000","last_change":"2024-04-25T15:46:27.829010+0000","last_active":"2024-04-25T15:46:27.833327+0000","last_peered":"2024-04-25T15:46:27.833327+0000","last_clean":"2024-04-25T15:46:27.833327+0000","last_became_active":"2024-04-25T15:46:27.828498+0000","last_became_peered":"2024-04-25T15:46:27.828498+0000","last_unstale":"2024-04-25T15:46:27.833327+0000","last_undegraded":"2024-04-25T15:46:27.833327+0000","last_fullsized":"2024-04-25T15:46:27.833327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:27.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900384+0000","last_change":"2024-04-25T15:46:26.822053+0000","last_active":"2024-04-25T15:46:28.900384+0000","last_peered":"2024-04-25T15:46:28.900384+0000","last_clean":"2024-04-25T15:46:28.900384+0000","last_became_active":"2024-04-25T15:46:26.821735+0000","last_became_peered":"2024-04-25T15:46:26.821735+0000","last_unstale":"2024-04-25T15:46:28.900384+0000","last_undegraded":"2024-04-25T15:46:28.900384+0000","last_fullsized":"2024-04-25T15:46:28.900384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:22.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829689+0000","last_change":"2024-04-25T15:46:27.845013+0000","last_active":"2024-04-25T15:46:28.829689+0000","last_peered":"2024-04-25T15:46:28.829689+0000","last_clean":"2024-04-25T15:46:28.829689+0000","last_became_active":"2024-04-25T15:46:27.844623+0000","last_became_peered":"2024-04-25T15:46:27.844623+0000","last_unstale":"2024-04-25T15:46:28.829689+0000","last_undegraded":"2024-04-25T15:46:28.829689+0000","last_fullsized":"2024-04-25T15:46:28.829689+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.367730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899801+0000","last_change":"2024-04-25T15:46:26.830152+0000","last_active":"2024-04-25T15:46:28.899801+0000","last_peered":"2024-04-25T15:46:28.899801+0000","last_clean":"2024-04-25T15:46:28.899801+0000","last_became_active":"2024-04-25T15:46:26.829859+0000","last_became_peered":"2024-04-25T15:46:26.829859+0000","last_unstale":"2024-04-25T15:46:28.899801+0000","last_undegraded":"2024-04-25T15:46:28.899801+0000","last_fullsized":"2024-04-25T15:46:28.899801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:34.016829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829770+0000","last_change":"2024-04-25T15:46:27.835324+0000","last_active":"2024-04-25T15:46:28.829770+0000","last_peered":"2024-04-25T15:46:28.829770+0000","last_clean":"2024-04-25T15:46:28.829770+0000","last_became_active":"2024-04-25T15:46:27.834319+0000","last_became_peered":"2024-04-25T15:46:27.834319+0000","last_unstale":"2024-04-25T15:46:28.829770+0000","last_undegraded":"2024-04-25T15:46:28.829770+0000","last_fullsized":"2024-04-25T15:46:28.829770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:41.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899919+0000","last_change":"2024-04-25T15:46:26.826462+0000","last_active":"2024-04-25T15:46:28.899919+0000","last_peered":"2024-04-25T15:46:28.899919+0000","last_clean":"2024-04-25T15:46:28.899919+0000","last_became_active":"2024-04-25T15:46:26.826083+0000","last_became_peered":"2024-04-25T15:46:26.826083+0000","last_unstale":"2024-04-25T15:46:28.899919+0000","last_undegraded":"2024-04-25T15:46:28.899919+0000","last_fullsized":"2024-04-25T15:46:28.899919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:27.599744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900638+0000","last_change":"2024-04-25T15:46:27.838925+0000","last_active":"2024-04-25T15:46:28.900638+0000","last_peered":"2024-04-25T15:46:28.900638+0000","last_clean":"2024-04-25T15:46:28.900638+0000","last_became_active":"2024-04-25T15:46:27.838569+0000","last_became_peered":"2024-04-25T15:46:27.838569+0000","last_unstale":"2024-04-25T15:46:28.900638+0000","last_undegraded":"2024-04-25T15:46:28.900638+0000","last_fullsized":"2024-04-25T15:46:28.900638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899387+0000","last_change":"2024-04-25T15:46:26.822867+0000","last_active":"2024-04-25T15:46:28.899387+0000","last_peered":"2024-04-25T15:46:28.899387+0000","last_clean":"2024-04-25T15:46:28.899387+0000","last_became_active":"2024-04-25T15:46:26.822520+0000","last_became_peered":"2024-04-25T15:46:26.822520+0000","last_unstale":"2024-04-25T15:46:28.899387+0000","last_undegraded":"2024-04-25T15:46:28.899387+0000","last_fullsized":"2024-04-25T15:46:28.899387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:05.838766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899326+0000","last_change":"2024-04-25T15:46:27.831553+0000","last_active":"2024-04-25T15:46:28.899326+0000","last_peered":"2024-04-25T15:46:28.899326+0000","last_clean":"2024-04-25T15:46:28.899326+0000","last_became_active":"2024-04-25T15:46:27.831249+0000","last_became_peered":"2024-04-25T15:46:27.831249+0000","last_unstale":"2024-04-25T15:46:28.899326+0000","last_undegraded":"2024-04-25T15:46:28.899326+0000","last_fullsized":"2024-04-25T15:46:28.899326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:34.681753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.848422+0000","last_change":"2024-04-25T15:46:26.824724+0000","last_active":"2024-04-25T15:46:27.848422+0000","last_peered":"2024-04-25T15:46:27.848422+0000","last_clean":"2024-04-25T15:46:27.848422+0000","last_became_active":"2024-04-25T15:46:26.824401+0000","last_became_peered":"2024-04-25T15:46:26.824401+0000","last_unstale":"2024-04-25T15:46:27.848422+0000","last_undegraded":"2024-04-25T15:46:27.848422+0000","last_fullsized":"2024-04-25T15:46:27.848422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:08.178975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833406+0000","last_change":"2024-04-25T15:46:27.829172+0000","last_active":"2024-04-25T15:46:27.833406+0000","last_peered":"2024-04-25T15:46:27.833406+0000","last_clean":"2024-04-25T15:46:27.833406+0000","last_became_active":"2024-04-25T15:46:27.828842+0000","last_became_peered":"2024-04-25T15:46:27.828842+0000","last_unstale":"2024-04-25T15:46:27.833406+0000","last_undegraded":"2024-04-25T15:46:27.833406+0000","last_fullsized":"2024-04-25T15:46:27.833406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.961224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.856912+0000","last_change":"2024-04-25T15:46:26.829212+0000","last_active":"2024-04-25T15:46:27.856912+0000","last_peered":"2024-04-25T15:46:27.856912+0000","last_clean":"2024-04-25T15:46:27.856912+0000","last_became_active":"2024-04-25T15:46:26.828801+0000","last_became_peered":"2024-04-25T15:46:26.828801+0000","last_unstale":"2024-04-25T15:46:27.856912+0000","last_undegraded":"2024-04-25T15:46:27.856912+0000","last_fullsized":"2024-04-25T15:46:27.856912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:34.016829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899677+0000","last_change":"2024-04-25T15:46:27.854784+0000","last_active":"2024-04-25T15:46:28.899677+0000","last_peered":"2024-04-25T15:46:28.899677+0000","last_clean":"2024-04-25T15:46:28.899677+0000","last_became_active":"2024-04-25T15:46:27.854404+0000","last_became_peered":"2024-04-25T15:46:27.854404+0000","last_unstale":"2024-04-25T15:46:28.899677+0000","last_undegraded":"2024-04-25T15:46:28.899677+0000","last_fullsized":"2024-04-25T15:46:28.899677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:45.896880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.855599+0000","last_change":"2024-04-25T15:46:26.827253+0000","last_active":"2024-04-25T15:46:27.855599+0000","last_peered":"2024-04-25T15:46:27.855599+0000","last_clean":"2024-04-25T15:46:27.855599+0000","last_became_active":"2024-04-25T15:46:26.826924+0000","last_became_peered":"2024-04-25T15:46:26.826924+0000","last_unstale":"2024-04-25T15:46:27.855599+0000","last_undegraded":"2024-04-25T15:46:27.855599+0000","last_fullsized":"2024-04-25T15:46:27.855599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:35.023937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.837480+0000","last_change":"2024-04-25T15:46:27.836396+0000","last_active":"2024-04-25T15:46:27.837480+0000","last_peered":"2024-04-25T15:46:27.837480+0000","last_clean":"2024-04-25T15:46:27.837480+0000","last_became_active":"2024-04-25T15:46:27.836036+0000","last_became_peered":"2024-04-25T15:46:27.836036+0000","last_unstale":"2024-04-25T15:46:27.837480+0000","last_undegraded":"2024-04-25T15:46:27.837480+0000","last_fullsized":"2024-04-25T15:46:27.837480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:22.466482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829781+0000","last_change":"2024-04-25T15:46:26.828732+0000","last_active":"2024-04-25T15:46:28.829781+0000","last_peered":"2024-04-25T15:46:28.829781+0000","last_clean":"2024-04-25T15:46:28.829781+0000","last_became_active":"2024-04-25T15:46:26.828413+0000","last_became_peered":"2024-04-25T15:46:26.828413+0000","last_unstale":"2024-04-25T15:46:28.829781+0000","last_undegraded":"2024-04-25T15:46:28.829781+0000","last_fullsized":"2024-04-25T15:46:28.829781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:48.390650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.842462+0000","last_change":"2024-04-25T15:46:27.841214+0000","last_active":"2024-04-25T15:46:27.842462+0000","last_peered":"2024-04-25T15:46:27.842462+0000","last_clean":"2024-04-25T15:46:27.842462+0000","last_became_active":"2024-04-25T15:46:27.840896+0000","last_became_peered":"2024-04-25T15:46:27.840896+0000","last_unstale":"2024-04-25T15:46:27.842462+0000","last_undegraded":"2024-04-25T15:46:27.842462+0000","last_fullsized":"2024-04-25T15:46:27.842462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:23.147474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.822429+0000","last_change":"2024-04-25T15:46:26.822146+0000","last_active":"2024-04-25T15:46:27.822429+0000","last_peered":"2024-04-25T15:46:27.822429+0000","last_clean":"2024-04-25T15:46:27.822429+0000","last_became_active":"2024-04-25T15:46:26.821857+0000","last_became_peered":"2024-04-25T15:46:26.821857+0000","last_unstale":"2024-04-25T15:46:27.822429+0000","last_undegraded":"2024-04-25T15:46:27.822429+0000","last_fullsized":"2024-04-25T15:46:27.822429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:20.403553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899655+0000","last_change":"2024-04-25T15:46:27.834987+0000","last_active":"2024-04-25T15:46:28.899655+0000","last_peered":"2024-04-25T15:46:28.899655+0000","last_clean":"2024-04-25T15:46:28.899655+0000","last_became_active":"2024-04-25T15:46:27.834668+0000","last_became_peered":"2024-04-25T15:46:27.834668+0000","last_unstale":"2024-04-25T15:46:28.899655+0000","last_undegraded":"2024-04-25T15:46:28.899655+0000","last_fullsized":"2024-04-25T15:46:28.899655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:27.746605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829594+0000","last_change":"2024-04-25T15:46:26.826316+0000","last_active":"2024-04-25T15:46:28.829594+0000","last_peered":"2024-04-25T15:46:28.829594+0000","last_clean":"2024-04-25T15:46:28.829594+0000","last_became_active":"2024-04-25T15:46:26.826022+0000","last_became_peered":"2024-04-25T15:46:26.826022+0000","last_unstale":"2024-04-25T15:46:28.829594+0000","last_undegraded":"2024-04-25T15:46:28.829594+0000","last_fullsized":"2024-04-25T15:46:28.829594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:06.992636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899342+0000","last_change":"2024-04-25T15:46:27.833035+0000","last_active":"2024-04-25T15:46:28.899342+0000","last_peered":"2024-04-25T15:46:28.899342+0000","last_clean":"2024-04-25T15:46:28.899342+0000","last_became_active":"2024-04-25T15:46:27.832711+0000","last_became_peered":"2024-04-25T15:46:27.832711+0000","last_unstale":"2024-04-25T15:46:28.899342+0000","last_undegraded":"2024-04-25T15:46:28.899342+0000","last_fullsized":"2024-04-25T15:46:28.899342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:09.809077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.848060+0000","last_change":"2024-04-25T15:46:26.830287+0000","last_active":"2024-04-25T15:46:27.848060+0000","last_peered":"2024-04-25T15:46:27.848060+0000","last_clean":"2024-04-25T15:46:27.848060+0000","last_became_active":"2024-04-25T15:46:26.829839+0000","last_became_peered":"2024-04-25T15:46:26.829839+0000","last_unstale":"2024-04-25T15:46:27.848060+0000","last_undegraded":"2024-04-25T15:46:27.848060+0000","last_fullsized":"2024-04-25T15:46:27.848060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:02.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900910+0000","last_change":"2024-04-25T15:46:27.837995+0000","last_active":"2024-04-25T15:46:28.900910+0000","last_peered":"2024-04-25T15:46:28.900910+0000","last_clean":"2024-04-25T15:46:28.900910+0000","last_became_active":"2024-04-25T15:46:27.837683+0000","last_became_peered":"2024-04-25T15:46:27.837683+0000","last_unstale":"2024-04-25T15:46:28.900910+0000","last_undegraded":"2024-04-25T15:46:28.900910+0000","last_fullsized":"2024-04-25T15:46:28.900910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:23.640881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.824411+0000","last_change":"2024-04-25T15:46:26.822375+0000","last_active":"2024-04-25T15:46:27.824411+0000","last_peered":"2024-04-25T15:46:27.824411+0000","last_clean":"2024-04-25T15:46:27.824411+0000","last_became_active":"2024-04-25T15:46:26.822014+0000","last_became_peered":"2024-04-25T15:46:26.822014+0000","last_unstale":"2024-04-25T15:46:27.824411+0000","last_undegraded":"2024-04-25T15:46:27.824411+0000","last_fullsized":"2024-04-25T15:46:27.824411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:27.599744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900788+0000","last_change":"2024-04-25T15:46:27.847808+0000","last_active":"2024-04-25T15:46:28.900788+0000","last_peered":"2024-04-25T15:46:28.900788+0000","last_clean":"2024-04-25T15:46:28.900788+0000","last_became_active":"2024-04-25T15:46:27.847521+0000","last_became_peered":"2024-04-25T15:46:27.847521+0000","last_unstale":"2024-04-25T15:46:28.900788+0000","last_undegraded":"2024-04-25T15:46:28.900788+0000","last_fullsized":"2024-04-25T15:46:28.900788+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:56.349994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.824586+0000","last_change":"2024-04-25T15:46:26.823361+0000","last_active":"2024-04-25T15:46:27.824586+0000","last_peered":"2024-04-25T15:46:27.824586+0000","last_clean":"2024-04-25T15:46:27.824586+0000","last_became_active":"2024-04-25T15:46:26.822847+0000","last_became_peered":"2024-04-25T15:46:26.822847+0000","last_unstale":"2024-04-25T15:46:27.824586+0000","last_undegraded":"2024-04-25T15:46:27.824586+0000","last_fullsized":"2024-04-25T15:46:27.824586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:17.003611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.834071+0000","last_change":"2024-04-25T15:46:27.832577+0000","last_active":"2024-04-25T15:46:27.834071+0000","last_peered":"2024-04-25T15:46:27.834071+0000","last_clean":"2024-04-25T15:46:27.834071+0000","last_became_active":"2024-04-25T15:46:27.832243+0000","last_became_peered":"2024-04-25T15:46:27.832243+0000","last_unstale":"2024-04-25T15:46:27.834071+0000","last_undegraded":"2024-04-25T15:46:27.834071+0000","last_fullsized":"2024-04-25T15:46:27.834071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:04.407637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899461+0000","last_change":"2024-04-25T15:46:26.826454+0000","last_active":"2024-04-25T15:46:28.899461+0000","last_peered":"2024-04-25T15:46:28.899461+0000","last_clean":"2024-04-25T15:46:28.899461+0000","last_became_active":"2024-04-25T15:46:26.826134+0000","last_became_peered":"2024-04-25T15:46:26.826134+0000","last_unstale":"2024-04-25T15:46:28.899461+0000","last_undegraded":"2024-04-25T15:46:28.899461+0000","last_fullsized":"2024-04-25T15:46:28.899461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:26.480008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829611+0000","last_change":"2024-04-25T15:46:27.845114+0000","last_active":"2024-04-25T15:46:28.829611+0000","last_peered":"2024-04-25T15:46:28.829611+0000","last_clean":"2024-04-25T15:46:28.829611+0000","last_became_active":"2024-04-25T15:46:27.844367+0000","last_became_peered":"2024-04-25T15:46:27.844367+0000","last_unstale":"2024-04-25T15:46:28.829611+0000","last_undegraded":"2024-04-25T15:46:28.829611+0000","last_fullsized":"2024-04-25T15:46:28.829611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:02.830711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899919+0000","last_change":"2024-04-25T15:46:26.821779+0000","last_active":"2024-04-25T15:46:28.899919+0000","last_peered":"2024-04-25T15:46:28.899919+0000","last_clean":"2024-04-25T15:46:28.899919+0000","last_became_active":"2024-04-25T15:46:26.821481+0000","last_became_peered":"2024-04-25T15:46:26.821481+0000","last_unstale":"2024-04-25T15:46:28.899919+0000","last_undegraded":"2024-04-25T15:46:28.899919+0000","last_fullsized":"2024-04-25T15:46:28.899919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:57.609560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900473+0000","last_change":"2024-04-25T15:46:27.839398+0000","last_active":"2024-04-25T15:46:28.900473+0000","last_peered":"2024-04-25T15:46:28.900473+0000","last_clean":"2024-04-25T15:46:28.900473+0000","last_became_active":"2024-04-25T15:46:27.839077+0000","last_became_peered":"2024-04-25T15:46:27.839077+0000","last_unstale":"2024-04-25T15:46:28.900473+0000","last_undegraded":"2024-04-25T15:46:28.900473+0000","last_fullsized":"2024-04-25T15:46:28.900473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:49.819027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.822735+0000","last_change":"2024-04-25T15:46:26.825743+0000","last_active":"2024-04-25T15:46:27.822735+0000","last_peered":"2024-04-25T15:46:27.822735+0000","last_clean":"2024-04-25T15:46:27.822735+0000","last_became_active":"2024-04-25T15:46:26.825433+0000","last_became_peered":"2024-04-25T15:46:26.825433+0000","last_unstale":"2024-04-25T15:46:27.822735+0000","last_undegraded":"2024-04-25T15:46:27.822735+0000","last_fullsized":"2024-04-25T15:46:27.822735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:01.602265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899140+0000","last_change":"2024-04-25T15:46:27.842670+0000","last_active":"2024-04-25T15:46:28.899140+0000","last_peered":"2024-04-25T15:46:28.899140+0000","last_clean":"2024-04-25T15:46:28.899140+0000","last_became_active":"2024-04-25T15:46:27.841986+0000","last_became_peered":"2024-04-25T15:46:27.841986+0000","last_unstale":"2024-04-25T15:46:28.899140+0000","last_undegraded":"2024-04-25T15:46:28.899140+0000","last_fullsized":"2024-04-25T15:46:28.899140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.760467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899308+0000","last_change":"2024-04-25T15:46:26.825593+0000","last_active":"2024-04-25T15:46:28.899308+0000","last_peered":"2024-04-25T15:46:28.899308+0000","last_clean":"2024-04-25T15:46:28.899308+0000","last_became_active":"2024-04-25T15:46:26.825269+0000","last_became_peered":"2024-04-25T15:46:26.825269+0000","last_unstale":"2024-04-25T15:46:28.899308+0000","last_undegraded":"2024-04-25T15:46:28.899308+0000","last_fullsized":"2024-04-25T15:46:28.899308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:14.152049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899815+0000","last_change":"2024-04-25T15:46:27.847125+0000","last_active":"2024-04-25T15:46:28.899815+0000","last_peered":"2024-04-25T15:46:28.899815+0000","last_clean":"2024-04-25T15:46:28.899815+0000","last_became_active":"2024-04-25T15:46:27.846814+0000","last_became_peered":"2024-04-25T15:46:27.846814+0000","last_unstale":"2024-04-25T15:46:28.899815+0000","last_undegraded":"2024-04-25T15:46:28.899815+0000","last_fullsized":"2024-04-25T15:46:28.899815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:32.187087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.819076+0000","last_change":"2024-04-25T15:46:26.827764+0000","last_active":"2024-04-25T15:46:27.819076+0000","last_peered":"2024-04-25T15:46:27.819076+0000","last_clean":"2024-04-25T15:46:27.819076+0000","last_became_active":"2024-04-25T15:46:26.827438+0000","last_became_peered":"2024-04-25T15:46:26.827438+0000","last_unstale":"2024-04-25T15:46:27.819076+0000","last_undegraded":"2024-04-25T15:46:27.819076+0000","last_fullsized":"2024-04-25T15:46:27.819076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:22.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.837281+0000","last_change":"2024-04-25T15:46:27.836351+0000","last_active":"2024-04-25T15:46:27.837281+0000","last_peered":"2024-04-25T15:46:27.837281+0000","last_clean":"2024-04-25T15:46:27.837281+0000","last_became_active":"2024-04-25T15:46:27.835941+0000","last_became_peered":"2024-04-25T15:46:27.835941+0000","last_unstale":"2024-04-25T15:46:27.837281+0000","last_undegraded":"2024-04-25T15:46:27.837281+0000","last_fullsized":"2024-04-25T15:46:27.837281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:49.819027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900345+0000","last_change":"2024-04-25T15:46:26.826632+0000","last_active":"2024-04-25T15:46:28.900345+0000","last_peered":"2024-04-25T15:46:28.900345+0000","last_clean":"2024-04-25T15:46:28.900345+0000","last_became_active":"2024-04-25T15:46:26.826230+0000","last_became_peered":"2024-04-25T15:46:26.826230+0000","last_unstale":"2024-04-25T15:46:28.900345+0000","last_undegraded":"2024-04-25T15:46:28.900345+0000","last_fullsized":"2024-04-25T15:46:28.900345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:17.003611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":239,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.819150+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:27.819150+0000","last_peered":"2024-04-25T15:46:27.819150+0000","last_clean":"2024-04-25T15:46:27.819150+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:27.819150+0000","last_undegraded":"2024-04-25T15:46:27.819150+0000","last_fullsized":"2024-04-25T15:46:27.819150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":475984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":473768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1056768,"data_stored":480460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":473838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28644,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343196,"statfs":{"total":96636764160,"available":96607432704,"internally_reserved":0,"allocated":1662976,"data_stored":1066454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1626112,"data_stored":1056969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1032192,"data_stored":466601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":473928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:31.835 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.979+0000 7f70c8f97640 1 Processor -- start 2024-04-25T15:46:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.979+0000 7f70c8f97640 1 -- start start 2024-04-25T15:46:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70c8f97640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70c4073a40 0x7f70c40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70c8f97640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c41642e0 con 0x7f70c40ce860 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70c8f97640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c41645c0 con 0x7f70c4163e00 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70c8f97640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f70c41648a0 con 0x7f70c4073a40 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70c259c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70c40ce860 0x7f70c4073330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52348/0 (socket says 172.21.15.80:52348) 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70bbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70c4073a40 0x7f70c40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.980+0000 7f70c259c640 1 -- 172.21.15.80:0/3839162801 learned_addr learned my addr 172.21.15.80:0/3839162801 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.981+0000 7f70bbfff640 1 -- 172.21.15.80:0/3839162801 >> v1:172.21.15.195:6789/0 conn(0x7f70c4163e00 legacy=0x7f70c406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.981+0000 7f70bbfff640 1 -- 172.21.15.80:0/3839162801 >> v1:172.21.15.80:6789/0 conn(0x7f70c40ce860 legacy=0x7f70c4073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.981+0000 7f70bbfff640 1 -- 172.21.15.80:0/3839162801 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c4164b80 con 0x7f70c4073a40 2024-04-25T15:46:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.981+0000 7f70c1d9b640 1 -- 172.21.15.80:0/3839162801 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235131851 0 0) 0x7f70c41642e0 con 0x7f70c40ce860 2024-04-25T15:46:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.981+0000 7f70bbfff640 1 --2- 172.21.15.80:0/3839162801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c4073a40 0x7f70c40b2f20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009790 tx=0x7f70ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902c26ca449f3577 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c1d9b640 1 -- 172.21.15.80:0/3839162801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac037070 con 0x7f70c4073a40 2024-04-25T15:46:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c1d9b640 1 -- 172.21.15.80:0/3839162801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ac032440 con 0x7f70c4073a40 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c1d9b640 1 -- 172.21.15.80:0/3839162801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac032810 con 0x7f70c4073a40 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 -- 172.21.15.80:0/3839162801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c4073a40 msgr2=0x7f70c40b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 --2- 172.21.15.80:0/3839162801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c4073a40 0x7f70c40b2f20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009790 tx=0x7f70ac02a1c0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 -- 172.21.15.80:0/3839162801 shutdown_connections 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 --2- 172.21.15.80:0/3839162801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c4073a40 0x7f70c40b2f20 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 -- 172.21.15.80:0/3839162801 >> 172.21.15.80:0/3839162801 conn(0x7f70c40d3ea0 msgr2=0x7f70c40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 -- 172.21.15.80:0/3839162801 shutdown_connections 2024-04-25T15:46:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.982+0000 7f70c8f97640 1 -- 172.21.15.80:0/3839162801 wait complete. 2024-04-25T15:46:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.984+0000 7f70c8f97640 1 Processor -- start 2024-04-25T15:46:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.984+0000 7f70c8f97640 1 -- start start 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.985+0000 7f70c8f97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 0x7f70c40cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.985+0000 7f70c8f97640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c4163e00 0x7f70c40b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.985+0000 7f70c8f97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70c40b4b60 0x7f70c40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.985+0000 7f70c8f97640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4160320 con 0x7f70c40ce860 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.985+0000 7f70c8f97640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f70c41601a0 con 0x7f70c4163e00 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.985+0000 7f70c8f97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f70c41604a0 con 0x7f70c40b4b60 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 0x7f70c40cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 0x7f70c40cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52168/0 (socket says 172.21.15.80:52168) 2024-04-25T15:46:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 -- 172.21.15.80:0/2547710057 learned_addr learned my addr 172.21.15.80:0/2547710057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70bbfff640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c4163e00 0x7f70c40b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c2d9d640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70c40b4b60 0x7f70c40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 -- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70c40b4b60 msgr2=0x7f70c40b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70c40b4b60 0x7f70c40b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 -- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c4163e00 msgr2=0x7f70c40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c4163e00 0x7f70c40b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 -- 172.21.15.80:0/2547710057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40b4f70 con 0x7f70c40ce860 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70bbfff640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c4163e00 0x7f70c40b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c2d9d640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70c40b4b60 0x7f70c40b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c259c640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 0x7f70c40cd420 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c460 tx=0x7f70b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b40074e0 con 0x7f70c40ce860 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b40047e0 con 0x7f70c40ce860 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c40cd960 con 0x7f70c40ce860 2024-04-25T15:46:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4004bd0 con 0x7f70c40ce860 2024-04-25T15:46:31.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.986+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c40cc380 con 0x7f70c40ce860 2024-04-25T15:46:31.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.987+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c40b9720 con 0x7f70c40ce860 2024-04-25T15:46:31.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.988+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f70b4011070 con 0x7f70c40ce860 2024-04-25T15:46:31.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.989+0000 7f70baffd640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f70a40744b0 0x7f70a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.989+0000 7f70bbfff640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f70a40744b0 0x7f70a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.989+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f70b4094f50 con 0x7f70c40ce860 2024-04-25T15:46:31.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.989+0000 7f70bbfff640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f70a40744b0 0x7f70a40769c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f70ac034000 tx=0x7f70ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:31.993+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f70c40b9720 con 0x7f70c40ce860 2024-04-25T15:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.165+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70c406de90 con 0x7f70a40744b0 2024-04-25T15:46:32.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.171+0000 7f70baffd640 1 -- 172.21.15.80:0/2547710057 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252034 (secure 0 0 0) 0x7f70c406de90 con 0x7f70a40744b0 2024-04-25T15:46:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:32.175 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f70a40744b0 msgr2=0x7f70a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f70a40744b0 0x7f70a40769c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f70ac034000 tx=0x7f70ac02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 msgr2=0x7f70c40cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 0x7f70c40cd420 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c460 tx=0x7f70b400c920 comp rx=0 tx=0).stop 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 shutdown_connections 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f70a40744b0 0x7f70a40769c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70c40b4b60 0x7f70c40b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c4163e00 0x7f70c40b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 --2- 172.21.15.80:0/2547710057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c40ce860 0x7f70c40cd420 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.174+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 >> 172.21.15.80:0/2547710057 conn(0x7f70c40d3ea0 msgr2=0x7f70c406eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.175+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 shutdown_connections 2024-04-25T15:46:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.175+0000 7f70c8f97640 1 -- 172.21.15.80:0/2547710057 wait complete. 2024-04-25T15:46:32.186 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T15:46:31.040474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246360,"kb_used_data":9364,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728360,"statfs":{"total":773094113280,"available":772841840640,"internally_reserved":0,"allocated":9588736,"data_stored":4968002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.236098"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900351+0000","last_change":"2024-04-25T15:46:27.846628+0000","last_active":"2024-04-25T15:46:28.900351+0000","last_peered":"2024-04-25T15:46:28.900351+0000","last_clean":"2024-04-25T15:46:28.900351+0000","last_became_active":"2024-04-25T15:46:27.846335+0000","last_became_peered":"2024-04-25T15:46:27.846335+0000","last_unstale":"2024-04-25T15:46:28.900351+0000","last_undegraded":"2024-04-25T15:46:28.900351+0000","last_fullsized":"2024-04-25T15:46:28.900351+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:41.566085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.837474+0000","last_change":"2024-04-25T15:46:27.836406+0000","last_active":"2024-04-25T15:46:27.837474+0000","last_peered":"2024-04-25T15:46:27.837474+0000","last_clean":"2024-04-25T15:46:27.837474+0000","last_became_active":"2024-04-25T15:46:27.836080+0000","last_became_peered":"2024-04-25T15:46:27.836080+0000","last_unstale":"2024-04-25T15:46:27.837474+0000","last_undegraded":"2024-04-25T15:46:27.837474+0000","last_fullsized":"2024-04-25T15:46:27.837474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:20.830585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899645+0000","last_change":"2024-04-25T15:46:27.830808+0000","last_active":"2024-04-25T15:46:28.899645+0000","last_peered":"2024-04-25T15:46:28.899645+0000","last_clean":"2024-04-25T15:46:28.899645+0000","last_became_active":"2024-04-25T15:46:27.830473+0000","last_became_peered":"2024-04-25T15:46:27.830473+0000","last_unstale":"2024-04-25T15:46:28.899645+0000","last_undegraded":"2024-04-25T15:46:28.899645+0000","last_fullsized":"2024-04-25T15:46:28.899645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:18.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900101+0000","last_change":"2024-04-25T15:46:27.836444+0000","last_active":"2024-04-25T15:46:28.900101+0000","last_peered":"2024-04-25T15:46:28.900101+0000","last_clean":"2024-04-25T15:46:28.900101+0000","last_became_active":"2024-04-25T15:46:27.836150+0000","last_became_peered":"2024-04-25T15:46:27.836150+0000","last_unstale":"2024-04-25T15:46:28.900101+0000","last_undegraded":"2024-04-25T15:46:28.900101+0000","last_fullsized":"2024-04-25T15:46:28.900101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:27.134524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833438+0000","last_change":"2024-04-25T15:46:27.830542+0000","last_active":"2024-04-25T15:46:27.833438+0000","last_peered":"2024-04-25T15:46:27.833438+0000","last_clean":"2024-04-25T15:46:27.833438+0000","last_became_active":"2024-04-25T15:46:27.830167+0000","last_became_peered":"2024-04-25T15:46:27.830167+0000","last_unstale":"2024-04-25T15:46:27.833438+0000","last_undegraded":"2024-04-25T15:46:27.833438+0000","last_fullsized":"2024-04-25T15:46:27.833438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:06.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900117+0000","last_change":"2024-04-25T15:46:27.854376+0000","last_active":"2024-04-25T15:46:28.900117+0000","last_peered":"2024-04-25T15:46:28.900117+0000","last_clean":"2024-04-25T15:46:28.900117+0000","last_became_active":"2024-04-25T15:46:27.854032+0000","last_became_peered":"2024-04-25T15:46:27.854032+0000","last_unstale":"2024-04-25T15:46:28.900117+0000","last_undegraded":"2024-04-25T15:46:28.900117+0000","last_fullsized":"2024-04-25T15:46:28.900117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:42.942766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.838084+0000","last_change":"2024-04-25T15:46:27.836213+0000","last_active":"2024-04-25T15:46:27.838084+0000","last_peered":"2024-04-25T15:46:27.838084+0000","last_clean":"2024-04-25T15:46:27.838084+0000","last_became_active":"2024-04-25T15:46:27.835900+0000","last_became_peered":"2024-04-25T15:46:27.835900+0000","last_unstale":"2024-04-25T15:46:27.838084+0000","last_undegraded":"2024-04-25T15:46:27.838084+0000","last_fullsized":"2024-04-25T15:46:27.838084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:41.566085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899542+0000","last_change":"2024-04-25T15:46:27.842138+0000","last_active":"2024-04-25T15:46:28.899542+0000","last_peered":"2024-04-25T15:46:28.899542+0000","last_clean":"2024-04-25T15:46:28.899542+0000","last_became_active":"2024-04-25T15:46:27.839921+0000","last_became_peered":"2024-04-25T15:46:27.839921+0000","last_unstale":"2024-04-25T15:46:28.899542+0000","last_undegraded":"2024-04-25T15:46:28.899542+0000","last_fullsized":"2024-04-25T15:46:28.899542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.760467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833300+0000","last_change":"2024-04-25T15:46:27.829092+0000","last_active":"2024-04-25T15:46:27.833300+0000","last_peered":"2024-04-25T15:46:27.833300+0000","last_clean":"2024-04-25T15:46:27.833300+0000","last_became_active":"2024-04-25T15:46:27.828767+0000","last_became_peered":"2024-04-25T15:46:27.828767+0000","last_unstale":"2024-04-25T15:46:27.833300+0000","last_undegraded":"2024-04-25T15:46:27.833300+0000","last_fullsized":"2024-04-25T15:46:27.833300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:15.156692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.830214+0000","last_change":"2024-04-25T15:46:27.844152+0000","last_active":"2024-04-25T15:46:28.830214+0000","last_peered":"2024-04-25T15:46:28.830214+0000","last_clean":"2024-04-25T15:46:28.830214+0000","last_became_active":"2024-04-25T15:46:27.843838+0000","last_became_peered":"2024-04-25T15:46:27.843838+0000","last_unstale":"2024-04-25T15:46:28.830214+0000","last_undegraded":"2024-04-25T15:46:28.830214+0000","last_fullsized":"2024-04-25T15:46:28.830214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:31.199721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.848244+0000","last_change":"2024-04-25T15:46:27.847514+0000","last_active":"2024-04-25T15:46:27.848244+0000","last_peered":"2024-04-25T15:46:27.848244+0000","last_clean":"2024-04-25T15:46:27.848244+0000","last_became_active":"2024-04-25T15:46:27.847202+0000","last_became_peered":"2024-04-25T15:46:27.847202+0000","last_unstale":"2024-04-25T15:46:27.848244+0000","last_undegraded":"2024-04-25T15:46:27.848244+0000","last_fullsized":"2024-04-25T15:46:27.848244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:05.216309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.830031+0000","last_change":"2024-04-25T15:46:27.836313+0000","last_active":"2024-04-25T15:46:28.830031+0000","last_peered":"2024-04-25T15:46:28.830031+0000","last_clean":"2024-04-25T15:46:28.830031+0000","last_became_active":"2024-04-25T15:46:27.835996+0000","last_became_peered":"2024-04-25T15:46:27.835996+0000","last_unstale":"2024-04-25T15:46:28.830031+0000","last_undegraded":"2024-04-25T15:46:28.830031+0000","last_fullsized":"2024-04-25T15:46:28.830031+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:53.481704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900642+0000","last_change":"2024-04-25T15:46:27.839256+0000","last_active":"2024-04-25T15:46:28.900642+0000","last_peered":"2024-04-25T15:46:28.900642+0000","last_clean":"2024-04-25T15:46:28.900642+0000","last_became_active":"2024-04-25T15:46:27.838947+0000","last_became_peered":"2024-04-25T15:46:27.838947+0000","last_unstale":"2024-04-25T15:46:28.900642+0000","last_undegraded":"2024-04-25T15:46:28.900642+0000","last_fullsized":"2024-04-25T15:46:28.900642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:52.275572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.842777+0000","last_change":"2024-04-25T15:46:27.841581+0000","last_active":"2024-04-25T15:46:27.842777+0000","last_peered":"2024-04-25T15:46:27.842777+0000","last_clean":"2024-04-25T15:46:27.842777+0000","last_became_active":"2024-04-25T15:46:27.841250+0000","last_became_peered":"2024-04-25T15:46:27.841250+0000","last_unstale":"2024-04-25T15:46:27.842777+0000","last_undegraded":"2024-04-25T15:46:27.842777+0000","last_fullsized":"2024-04-25T15:46:27.842777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:53.666321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899636+0000","last_change":"2024-04-25T15:46:27.847267+0000","last_active":"2024-04-25T15:46:28.899636+0000","last_peered":"2024-04-25T15:46:28.899636+0000","last_clean":"2024-04-25T15:46:28.899636+0000","last_became_active":"2024-04-25T15:46:27.846960+0000","last_became_peered":"2024-04-25T15:46:27.846960+0000","last_unstale":"2024-04-25T15:46:28.899636+0000","last_undegraded":"2024-04-25T15:46:28.899636+0000","last_fullsized":"2024-04-25T15:46:28.899636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:21.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899369+0000","last_change":"2024-04-25T15:46:27.848578+0000","last_active":"2024-04-25T15:46:28.899369+0000","last_peered":"2024-04-25T15:46:28.899369+0000","last_clean":"2024-04-25T15:46:28.899369+0000","last_became_active":"2024-04-25T15:46:27.848021+0000","last_became_peered":"2024-04-25T15:46:27.848021+0000","last_unstale":"2024-04-25T15:46:28.899369+0000","last_undegraded":"2024-04-25T15:46:28.899369+0000","last_fullsized":"2024-04-25T15:46:28.899369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:50.335746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900738+0000","last_change":"2024-04-25T15:46:27.846923+0000","last_active":"2024-04-25T15:46:28.900738+0000","last_peered":"2024-04-25T15:46:28.900738+0000","last_clean":"2024-04-25T15:46:28.900738+0000","last_became_active":"2024-04-25T15:46:27.846418+0000","last_became_peered":"2024-04-25T15:46:27.846418+0000","last_unstale":"2024-04-25T15:46:28.900738+0000","last_undegraded":"2024-04-25T15:46:28.900738+0000","last_fullsized":"2024-04-25T15:46:28.900738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:29.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899900+0000","last_change":"2024-04-25T15:46:27.829346+0000","last_active":"2024-04-25T15:46:28.899900+0000","last_peered":"2024-04-25T15:46:28.899900+0000","last_clean":"2024-04-25T15:46:28.899900+0000","last_became_active":"2024-04-25T15:46:27.829035+0000","last_became_peered":"2024-04-25T15:46:27.829035+0000","last_unstale":"2024-04-25T15:46:28.899900+0000","last_undegraded":"2024-04-25T15:46:28.899900+0000","last_fullsized":"2024-04-25T15:46:28.899900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:22.956365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.839829+0000","last_change":"2024-04-25T15:46:27.839166+0000","last_active":"2024-04-25T15:46:27.839829+0000","last_peered":"2024-04-25T15:46:27.839829+0000","last_clean":"2024-04-25T15:46:27.839829+0000","last_became_active":"2024-04-25T15:46:27.838830+0000","last_became_peered":"2024-04-25T15:46:27.838830+0000","last_unstale":"2024-04-25T15:46:27.839829+0000","last_undegraded":"2024-04-25T15:46:27.839829+0000","last_fullsized":"2024-04-25T15:46:27.839829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:53.407481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900240+0000","last_change":"2024-04-25T15:46:27.850518+0000","last_active":"2024-04-25T15:46:28.900240+0000","last_peered":"2024-04-25T15:46:28.900240+0000","last_clean":"2024-04-25T15:46:28.900240+0000","last_became_active":"2024-04-25T15:46:27.850164+0000","last_became_peered":"2024-04-25T15:46:27.850164+0000","last_unstale":"2024-04-25T15:46:28.900240+0000","last_undegraded":"2024-04-25T15:46:28.900240+0000","last_fullsized":"2024-04-25T15:46:28.900240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:26.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.834539+0000","last_change":"2024-04-25T15:46:27.831899+0000","last_active":"2024-04-25T15:46:27.834539+0000","last_peered":"2024-04-25T15:46:27.834539+0000","last_clean":"2024-04-25T15:46:27.834539+0000","last_became_active":"2024-04-25T15:46:27.831583+0000","last_became_peered":"2024-04-25T15:46:27.831583+0000","last_unstale":"2024-04-25T15:46:27.834539+0000","last_undegraded":"2024-04-25T15:46:27.834539+0000","last_fullsized":"2024-04-25T15:46:27.834539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:35.625420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.838981+0000","last_change":"2024-04-25T15:46:27.838378+0000","last_active":"2024-04-25T15:46:27.838981+0000","last_peered":"2024-04-25T15:46:27.838981+0000","last_clean":"2024-04-25T15:46:27.838981+0000","last_became_active":"2024-04-25T15:46:27.837968+0000","last_became_peered":"2024-04-25T15:46:27.837968+0000","last_unstale":"2024-04-25T15:46:27.838981+0000","last_undegraded":"2024-04-25T15:46:27.838981+0000","last_fullsized":"2024-04-25T15:46:27.838981+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:26.988275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899136+0000","last_change":"2024-04-25T15:46:27.838063+0000","last_active":"2024-04-25T15:46:28.899136+0000","last_peered":"2024-04-25T15:46:28.899136+0000","last_clean":"2024-04-25T15:46:28.899136+0000","last_became_active":"2024-04-25T15:46:27.837366+0000","last_became_peered":"2024-04-25T15:46:27.837366+0000","last_unstale":"2024-04-25T15:46:28.899136+0000","last_undegraded":"2024-04-25T15:46:28.899136+0000","last_fullsized":"2024-04-25T15:46:28.899136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:05.216309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899332+0000","last_change":"2024-04-25T15:46:27.827048+0000","last_active":"2024-04-25T15:46:28.899332+0000","last_peered":"2024-04-25T15:46:28.899332+0000","last_clean":"2024-04-25T15:46:28.899332+0000","last_became_active":"2024-04-25T15:46:27.826608+0000","last_became_peered":"2024-04-25T15:46:27.826608+0000","last_unstale":"2024-04-25T15:46:28.899332+0000","last_undegraded":"2024-04-25T15:46:28.899332+0000","last_fullsized":"2024-04-25T15:46:28.899332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:03.187225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833288+0000","last_change":"2024-04-25T15:46:27.831585+0000","last_active":"2024-04-25T15:46:27.833288+0000","last_peered":"2024-04-25T15:46:27.833288+0000","last_clean":"2024-04-25T15:46:27.833288+0000","last_became_active":"2024-04-25T15:46:27.831253+0000","last_became_peered":"2024-04-25T15:46:27.831253+0000","last_unstale":"2024-04-25T15:46:27.833288+0000","last_undegraded":"2024-04-25T15:46:27.833288+0000","last_fullsized":"2024-04-25T15:46:27.833288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:29.625989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.840016+0000","last_change":"2024-04-25T15:46:27.839567+0000","last_active":"2024-04-25T15:46:27.840016+0000","last_peered":"2024-04-25T15:46:27.840016+0000","last_clean":"2024-04-25T15:46:27.840016+0000","last_became_active":"2024-04-25T15:46:27.838288+0000","last_became_peered":"2024-04-25T15:46:27.838288+0000","last_unstale":"2024-04-25T15:46:27.840016+0000","last_undegraded":"2024-04-25T15:46:27.840016+0000","last_fullsized":"2024-04-25T15:46:27.840016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:50.364405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.830068+0000","last_change":"2024-04-25T15:46:27.829886+0000","last_active":"2024-04-25T15:46:28.830068+0000","last_peered":"2024-04-25T15:46:28.830068+0000","last_clean":"2024-04-25T15:46:28.830068+0000","last_became_active":"2024-04-25T15:46:27.829540+0000","last_became_peered":"2024-04-25T15:46:27.829540+0000","last_unstale":"2024-04-25T15:46:28.830068+0000","last_undegraded":"2024-04-25T15:46:28.830068+0000","last_fullsized":"2024-04-25T15:46:28.830068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:38.612507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900245+0000","last_change":"2024-04-25T15:46:27.841632+0000","last_active":"2024-04-25T15:46:28.900245+0000","last_peered":"2024-04-25T15:46:28.900245+0000","last_clean":"2024-04-25T15:46:28.900245+0000","last_became_active":"2024-04-25T15:46:27.841266+0000","last_became_peered":"2024-04-25T15:46:27.841266+0000","last_unstale":"2024-04-25T15:46:28.900245+0000","last_undegraded":"2024-04-25T15:46:28.900245+0000","last_fullsized":"2024-04-25T15:46:28.900245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.830791+0000","last_change":"2024-04-25T15:46:27.827336+0000","last_active":"2024-04-25T15:46:27.830791+0000","last_peered":"2024-04-25T15:46:27.830791+0000","last_clean":"2024-04-25T15:46:27.830791+0000","last_became_active":"2024-04-25T15:46:27.827026+0000","last_became_peered":"2024-04-25T15:46:27.827026+0000","last_unstale":"2024-04-25T15:46:27.830791+0000","last_undegraded":"2024-04-25T15:46:27.830791+0000","last_fullsized":"2024-04-25T15:46:27.830791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:22.956365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833349+0000","last_change":"2024-04-25T15:46:27.828185+0000","last_active":"2024-04-25T15:46:27.833349+0000","last_peered":"2024-04-25T15:46:27.833349+0000","last_clean":"2024-04-25T15:46:27.833349+0000","last_became_active":"2024-04-25T15:46:27.827808+0000","last_became_peered":"2024-04-25T15:46:27.827808+0000","last_unstale":"2024-04-25T15:46:27.833349+0000","last_undegraded":"2024-04-25T15:46:27.833349+0000","last_fullsized":"2024-04-25T15:46:27.833349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:21.010226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.840006+0000","last_change":"2024-04-25T15:46:27.839342+0000","last_active":"2024-04-25T15:46:27.840006+0000","last_peered":"2024-04-25T15:46:27.840006+0000","last_clean":"2024-04-25T15:46:27.840006+0000","last_became_active":"2024-04-25T15:46:27.838979+0000","last_became_peered":"2024-04-25T15:46:27.838979+0000","last_unstale":"2024-04-25T15:46:27.840006+0000","last_undegraded":"2024-04-25T15:46:27.840006+0000","last_fullsized":"2024-04-25T15:46:27.840006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:58.614204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899528+0000","last_change":"2024-04-25T15:46:27.846552+0000","last_active":"2024-04-25T15:46:28.899528+0000","last_peered":"2024-04-25T15:46:28.899528+0000","last_clean":"2024-04-25T15:46:28.899528+0000","last_became_active":"2024-04-25T15:46:27.846176+0000","last_became_peered":"2024-04-25T15:46:27.846176+0000","last_unstale":"2024-04-25T15:46:28.899528+0000","last_undegraded":"2024-04-25T15:46:28.899528+0000","last_fullsized":"2024-04-25T15:46:28.899528+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.273522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900605+0000","last_change":"2024-04-25T15:46:27.842828+0000","last_active":"2024-04-25T15:46:28.900605+0000","last_peered":"2024-04-25T15:46:28.900605+0000","last_clean":"2024-04-25T15:46:28.900605+0000","last_became_active":"2024-04-25T15:46:27.842224+0000","last_became_peered":"2024-04-25T15:46:27.842224+0000","last_unstale":"2024-04-25T15:46:28.900605+0000","last_undegraded":"2024-04-25T15:46:28.900605+0000","last_fullsized":"2024-04-25T15:46:28.900605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:18.746016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899272+0000","last_change":"2024-04-25T15:46:26.828080+0000","last_active":"2024-04-25T15:46:28.899272+0000","last_peered":"2024-04-25T15:46:28.899272+0000","last_clean":"2024-04-25T15:46:28.899272+0000","last_became_active":"2024-04-25T15:46:26.827713+0000","last_became_peered":"2024-04-25T15:46:26.827713+0000","last_unstale":"2024-04-25T15:46:28.899272+0000","last_undegraded":"2024-04-25T15:46:28.899272+0000","last_fullsized":"2024-04-25T15:46:28.899272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:49.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900557+0000","last_change":"2024-04-25T15:46:27.839794+0000","last_active":"2024-04-25T15:46:28.900557+0000","last_peered":"2024-04-25T15:46:28.900557+0000","last_clean":"2024-04-25T15:46:28.900557+0000","last_became_active":"2024-04-25T15:46:27.839377+0000","last_became_peered":"2024-04-25T15:46:27.839377+0000","last_unstale":"2024-04-25T15:46:28.900557+0000","last_undegraded":"2024-04-25T15:46:28.900557+0000","last_fullsized":"2024-04-25T15:46:28.900557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:26.791624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.847494+0000","last_change":"2024-04-25T15:46:26.825590+0000","last_active":"2024-04-25T15:46:27.847494+0000","last_peered":"2024-04-25T15:46:27.847494+0000","last_clean":"2024-04-25T15:46:27.847494+0000","last_became_active":"2024-04-25T15:46:26.823933+0000","last_became_peered":"2024-04-25T15:46:26.823933+0000","last_unstale":"2024-04-25T15:46:27.847494+0000","last_undegraded":"2024-04-25T15:46:27.847494+0000","last_fullsized":"2024-04-25T15:46:27.847494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:07.722159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.838569+0000","last_change":"2024-04-25T15:46:27.837927+0000","last_active":"2024-04-25T15:46:27.838569+0000","last_peered":"2024-04-25T15:46:27.838569+0000","last_clean":"2024-04-25T15:46:27.838569+0000","last_became_active":"2024-04-25T15:46:27.837202+0000","last_became_peered":"2024-04-25T15:46:27.837202+0000","last_unstale":"2024-04-25T15:46:27.838569+0000","last_undegraded":"2024-04-25T15:46:27.838569+0000","last_fullsized":"2024-04-25T15:46:27.838569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:08.203677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.852670+0000","last_change":"2024-04-25T15:46:26.821840+0000","last_active":"2024-04-25T15:46:27.852670+0000","last_peered":"2024-04-25T15:46:27.852670+0000","last_clean":"2024-04-25T15:46:27.852670+0000","last_became_active":"2024-04-25T15:46:26.821508+0000","last_became_peered":"2024-04-25T15:46:26.821508+0000","last_unstale":"2024-04-25T15:46:27.852670+0000","last_undegraded":"2024-04-25T15:46:27.852670+0000","last_fullsized":"2024-04-25T15:46:27.852670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.000716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900848+0000","last_change":"2024-04-25T15:46:27.839103+0000","last_active":"2024-04-25T15:46:28.900848+0000","last_peered":"2024-04-25T15:46:28.900848+0000","last_clean":"2024-04-25T15:46:28.900848+0000","last_became_active":"2024-04-25T15:46:27.838630+0000","last_became_peered":"2024-04-25T15:46:27.838630+0000","last_unstale":"2024-04-25T15:46:28.900848+0000","last_undegraded":"2024-04-25T15:46:28.900848+0000","last_fullsized":"2024-04-25T15:46:28.900848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:41.932690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899464+0000","last_change":"2024-04-25T15:46:26.829101+0000","last_active":"2024-04-25T15:46:28.899464+0000","last_peered":"2024-04-25T15:46:28.899464+0000","last_clean":"2024-04-25T15:46:28.899464+0000","last_became_active":"2024-04-25T15:46:26.828798+0000","last_became_peered":"2024-04-25T15:46:26.828798+0000","last_unstale":"2024-04-25T15:46:28.899464+0000","last_undegraded":"2024-04-25T15:46:28.899464+0000","last_fullsized":"2024-04-25T15:46:28.899464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:20.005582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899683+0000","last_change":"2024-04-25T15:46:27.846110+0000","last_active":"2024-04-25T15:46:28.899683+0000","last_peered":"2024-04-25T15:46:28.899683+0000","last_clean":"2024-04-25T15:46:28.899683+0000","last_became_active":"2024-04-25T15:46:27.845826+0000","last_became_peered":"2024-04-25T15:46:27.845826+0000","last_unstale":"2024-04-25T15:46:28.899683+0000","last_undegraded":"2024-04-25T15:46:28.899683+0000","last_fullsized":"2024-04-25T15:46:28.899683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:34.681753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.851638+0000","last_change":"2024-04-25T15:46:26.827984+0000","last_active":"2024-04-25T15:46:27.851638+0000","last_peered":"2024-04-25T15:46:27.851638+0000","last_clean":"2024-04-25T15:46:27.851638+0000","last_became_active":"2024-04-25T15:46:26.827678+0000","last_became_peered":"2024-04-25T15:46:26.827678+0000","last_unstale":"2024-04-25T15:46:27.851638+0000","last_undegraded":"2024-04-25T15:46:27.851638+0000","last_fullsized":"2024-04-25T15:46:27.851638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:58.489988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899161+0000","last_change":"2024-04-25T15:46:27.842891+0000","last_active":"2024-04-25T15:46:28.899161+0000","last_peered":"2024-04-25T15:46:28.899161+0000","last_clean":"2024-04-25T15:46:28.899161+0000","last_became_active":"2024-04-25T15:46:27.842428+0000","last_became_peered":"2024-04-25T15:46:27.842428+0000","last_unstale":"2024-04-25T15:46:28.899161+0000","last_undegraded":"2024-04-25T15:46:28.899161+0000","last_fullsized":"2024-04-25T15:46:28.899161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:21.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900081+0000","last_change":"2024-04-25T15:46:26.827168+0000","last_active":"2024-04-25T15:46:28.900081+0000","last_peered":"2024-04-25T15:46:28.900081+0000","last_clean":"2024-04-25T15:46:28.900081+0000","last_became_active":"2024-04-25T15:46:26.826427+0000","last_became_peered":"2024-04-25T15:46:26.826427+0000","last_unstale":"2024-04-25T15:46:28.900081+0000","last_undegraded":"2024-04-25T15:46:28.900081+0000","last_fullsized":"2024-04-25T15:46:28.900081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:30.313794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900275+0000","last_change":"2024-04-25T15:46:27.842424+0000","last_active":"2024-04-25T15:46:28.900275+0000","last_peered":"2024-04-25T15:46:28.900275+0000","last_clean":"2024-04-25T15:46:28.900275+0000","last_became_active":"2024-04-25T15:46:27.842110+0000","last_became_peered":"2024-04-25T15:46:27.842110+0000","last_unstale":"2024-04-25T15:46:28.900275+0000","last_undegraded":"2024-04-25T15:46:28.900275+0000","last_fullsized":"2024-04-25T15:46:28.900275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:55.121801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900659+0000","last_change":"2024-04-25T15:46:26.819351+0000","last_active":"2024-04-25T15:46:28.900659+0000","last_peered":"2024-04-25T15:46:28.900659+0000","last_clean":"2024-04-25T15:46:28.900659+0000","last_became_active":"2024-04-25T15:46:26.819026+0000","last_became_peered":"2024-04-25T15:46:26.819026+0000","last_unstale":"2024-04-25T15:46:28.900659+0000","last_undegraded":"2024-04-25T15:46:28.900659+0000","last_fullsized":"2024-04-25T15:46:28.900659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:28.621346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900816+0000","last_change":"2024-04-25T15:46:27.833098+0000","last_active":"2024-04-25T15:46:28.900816+0000","last_peered":"2024-04-25T15:46:28.900816+0000","last_clean":"2024-04-25T15:46:28.900816+0000","last_became_active":"2024-04-25T15:46:27.832761+0000","last_became_peered":"2024-04-25T15:46:27.832761+0000","last_unstale":"2024-04-25T15:46:28.900816+0000","last_undegraded":"2024-04-25T15:46:28.900816+0000","last_fullsized":"2024-04-25T15:46:28.900816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:38.289859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.818580+0000","last_change":"2024-04-25T15:46:26.826323+0000","last_active":"2024-04-25T15:46:27.818580+0000","last_peered":"2024-04-25T15:46:27.818580+0000","last_clean":"2024-04-25T15:46:27.818580+0000","last_became_active":"2024-04-25T15:46:26.825990+0000","last_became_peered":"2024-04-25T15:46:26.825990+0000","last_unstale":"2024-04-25T15:46:27.818580+0000","last_undegraded":"2024-04-25T15:46:27.818580+0000","last_fullsized":"2024-04-25T15:46:27.818580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:57.609560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.830802+0000","last_change":"2024-04-25T15:46:27.824490+0000","last_active":"2024-04-25T15:46:27.830802+0000","last_peered":"2024-04-25T15:46:27.830802+0000","last_clean":"2024-04-25T15:46:27.830802+0000","last_became_active":"2024-04-25T15:46:27.824173+0000","last_became_peered":"2024-04-25T15:46:27.824173+0000","last_unstale":"2024-04-25T15:46:27.830802+0000","last_undegraded":"2024-04-25T15:46:27.830802+0000","last_fullsized":"2024-04-25T15:46:27.830802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:31.318437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.823781+0000","last_change":"2024-04-25T15:46:26.824640+0000","last_active":"2024-04-25T15:46:27.823781+0000","last_peered":"2024-04-25T15:46:27.823781+0000","last_clean":"2024-04-25T15:46:27.823781+0000","last_became_active":"2024-04-25T15:46:26.824335+0000","last_became_peered":"2024-04-25T15:46:26.824335+0000","last_unstale":"2024-04-25T15:46:27.823781+0000","last_undegraded":"2024-04-25T15:46:27.823781+0000","last_fullsized":"2024-04-25T15:46:27.823781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:16.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.835558+0000","last_change":"2024-04-25T15:46:27.834729+0000","last_active":"2024-04-25T15:46:27.835558+0000","last_peered":"2024-04-25T15:46:27.835558+0000","last_clean":"2024-04-25T15:46:27.835558+0000","last_became_active":"2024-04-25T15:46:27.834376+0000","last_became_peered":"2024-04-25T15:46:27.834376+0000","last_unstale":"2024-04-25T15:46:27.835558+0000","last_undegraded":"2024-04-25T15:46:27.835558+0000","last_fullsized":"2024-04-25T15:46:27.835558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:29.791047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900171+0000","last_change":"2024-04-25T15:46:26.828186+0000","last_active":"2024-04-25T15:46:28.900171+0000","last_peered":"2024-04-25T15:46:28.900171+0000","last_clean":"2024-04-25T15:46:28.900171+0000","last_became_active":"2024-04-25T15:46:26.827899+0000","last_became_peered":"2024-04-25T15:46:26.827899+0000","last_unstale":"2024-04-25T15:46:28.900171+0000","last_undegraded":"2024-04-25T15:46:28.900171+0000","last_fullsized":"2024-04-25T15:46:28.900171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:03.402994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900060+0000","last_change":"2024-04-25T15:46:27.848697+0000","last_active":"2024-04-25T15:46:28.900060+0000","last_peered":"2024-04-25T15:46:28.900060+0000","last_clean":"2024-04-25T15:46:28.900060+0000","last_became_active":"2024-04-25T15:46:27.848377+0000","last_became_peered":"2024-04-25T15:46:27.848377+0000","last_unstale":"2024-04-25T15:46:28.900060+0000","last_undegraded":"2024-04-25T15:46:28.900060+0000","last_fullsized":"2024-04-25T15:46:28.900060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:29.791047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.854938+0000","last_change":"2024-04-25T15:46:26.826651+0000","last_active":"2024-04-25T15:46:27.854938+0000","last_peered":"2024-04-25T15:46:27.854938+0000","last_clean":"2024-04-25T15:46:27.854938+0000","last_became_active":"2024-04-25T15:46:26.826334+0000","last_became_peered":"2024-04-25T15:46:26.826334+0000","last_unstale":"2024-04-25T15:46:27.854938+0000","last_undegraded":"2024-04-25T15:46:27.854938+0000","last_fullsized":"2024-04-25T15:46:27.854938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.406123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900872+0000","last_change":"2024-04-25T15:46:27.840319+0000","last_active":"2024-04-25T15:46:28.900872+0000","last_peered":"2024-04-25T15:46:28.900872+0000","last_clean":"2024-04-25T15:46:28.900872+0000","last_became_active":"2024-04-25T15:46:27.839977+0000","last_became_peered":"2024-04-25T15:46:27.839977+0000","last_unstale":"2024-04-25T15:46:28.900872+0000","last_undegraded":"2024-04-25T15:46:28.900872+0000","last_fullsized":"2024-04-25T15:46:28.900872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:22.364793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900722+0000","last_change":"2024-04-25T15:46:26.830505+0000","last_active":"2024-04-25T15:46:28.900722+0000","last_peered":"2024-04-25T15:46:28.900722+0000","last_clean":"2024-04-25T15:46:28.900722+0000","last_became_active":"2024-04-25T15:46:26.830206+0000","last_became_peered":"2024-04-25T15:46:26.830206+0000","last_unstale":"2024-04-25T15:46:28.900722+0000","last_undegraded":"2024-04-25T15:46:28.900722+0000","last_fullsized":"2024-04-25T15:46:28.900722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:08.178975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899824+0000","last_change":"2024-04-25T15:46:27.840108+0000","last_active":"2024-04-25T15:46:28.899824+0000","last_peered":"2024-04-25T15:46:28.899824+0000","last_clean":"2024-04-25T15:46:28.899824+0000","last_became_active":"2024-04-25T15:46:27.837152+0000","last_became_peered":"2024-04-25T15:46:27.837152+0000","last_unstale":"2024-04-25T15:46:28.899824+0000","last_undegraded":"2024-04-25T15:46:28.899824+0000","last_fullsized":"2024-04-25T15:46:28.899824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:09.809077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.853790+0000","last_change":"2024-04-25T15:46:26.828972+0000","last_active":"2024-04-25T15:46:27.853790+0000","last_peered":"2024-04-25T15:46:27.853790+0000","last_clean":"2024-04-25T15:46:27.853790+0000","last_became_active":"2024-04-25T15:46:26.828328+0000","last_became_peered":"2024-04-25T15:46:26.828328+0000","last_unstale":"2024-04-25T15:46:27.853790+0000","last_undegraded":"2024-04-25T15:46:27.853790+0000","last_fullsized":"2024-04-25T15:46:27.853790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:21.767125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833327+0000","last_change":"2024-04-25T15:46:27.829010+0000","last_active":"2024-04-25T15:46:27.833327+0000","last_peered":"2024-04-25T15:46:27.833327+0000","last_clean":"2024-04-25T15:46:27.833327+0000","last_became_active":"2024-04-25T15:46:27.828498+0000","last_became_peered":"2024-04-25T15:46:27.828498+0000","last_unstale":"2024-04-25T15:46:27.833327+0000","last_undegraded":"2024-04-25T15:46:27.833327+0000","last_fullsized":"2024-04-25T15:46:27.833327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:27.484651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900384+0000","last_change":"2024-04-25T15:46:26.822053+0000","last_active":"2024-04-25T15:46:28.900384+0000","last_peered":"2024-04-25T15:46:28.900384+0000","last_clean":"2024-04-25T15:46:28.900384+0000","last_became_active":"2024-04-25T15:46:26.821735+0000","last_became_peered":"2024-04-25T15:46:26.821735+0000","last_unstale":"2024-04-25T15:46:28.900384+0000","last_undegraded":"2024-04-25T15:46:28.900384+0000","last_fullsized":"2024-04-25T15:46:28.900384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:22.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829689+0000","last_change":"2024-04-25T15:46:27.845013+0000","last_active":"2024-04-25T15:46:28.829689+0000","last_peered":"2024-04-25T15:46:28.829689+0000","last_clean":"2024-04-25T15:46:28.829689+0000","last_became_active":"2024-04-25T15:46:27.844623+0000","last_became_peered":"2024-04-25T15:46:27.844623+0000","last_unstale":"2024-04-25T15:46:28.829689+0000","last_undegraded":"2024-04-25T15:46:28.829689+0000","last_fullsized":"2024-04-25T15:46:28.829689+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:13.367730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899801+0000","last_change":"2024-04-25T15:46:26.830152+0000","last_active":"2024-04-25T15:46:28.899801+0000","last_peered":"2024-04-25T15:46:28.899801+0000","last_clean":"2024-04-25T15:46:28.899801+0000","last_became_active":"2024-04-25T15:46:26.829859+0000","last_became_peered":"2024-04-25T15:46:26.829859+0000","last_unstale":"2024-04-25T15:46:28.899801+0000","last_undegraded":"2024-04-25T15:46:28.899801+0000","last_fullsized":"2024-04-25T15:46:28.899801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:34.016829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829770+0000","last_change":"2024-04-25T15:46:27.835324+0000","last_active":"2024-04-25T15:46:28.829770+0000","last_peered":"2024-04-25T15:46:28.829770+0000","last_clean":"2024-04-25T15:46:28.829770+0000","last_became_active":"2024-04-25T15:46:27.834319+0000","last_became_peered":"2024-04-25T15:46:27.834319+0000","last_unstale":"2024-04-25T15:46:28.829770+0000","last_undegraded":"2024-04-25T15:46:28.829770+0000","last_fullsized":"2024-04-25T15:46:28.829770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:41.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899919+0000","last_change":"2024-04-25T15:46:26.826462+0000","last_active":"2024-04-25T15:46:28.899919+0000","last_peered":"2024-04-25T15:46:28.899919+0000","last_clean":"2024-04-25T15:46:28.899919+0000","last_became_active":"2024-04-25T15:46:26.826083+0000","last_became_peered":"2024-04-25T15:46:26.826083+0000","last_unstale":"2024-04-25T15:46:28.899919+0000","last_undegraded":"2024-04-25T15:46:28.899919+0000","last_fullsized":"2024-04-25T15:46:28.899919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:27.599744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900638+0000","last_change":"2024-04-25T15:46:27.838925+0000","last_active":"2024-04-25T15:46:28.900638+0000","last_peered":"2024-04-25T15:46:28.900638+0000","last_clean":"2024-04-25T15:46:28.900638+0000","last_became_active":"2024-04-25T15:46:27.838569+0000","last_became_peered":"2024-04-25T15:46:27.838569+0000","last_unstale":"2024-04-25T15:46:28.900638+0000","last_undegraded":"2024-04-25T15:46:28.900638+0000","last_fullsized":"2024-04-25T15:46:28.900638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:46.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899387+0000","last_change":"2024-04-25T15:46:26.822867+0000","last_active":"2024-04-25T15:46:28.899387+0000","last_peered":"2024-04-25T15:46:28.899387+0000","last_clean":"2024-04-25T15:46:28.899387+0000","last_became_active":"2024-04-25T15:46:26.822520+0000","last_became_peered":"2024-04-25T15:46:26.822520+0000","last_unstale":"2024-04-25T15:46:28.899387+0000","last_undegraded":"2024-04-25T15:46:28.899387+0000","last_fullsized":"2024-04-25T15:46:28.899387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:05.838766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899326+0000","last_change":"2024-04-25T15:46:27.831553+0000","last_active":"2024-04-25T15:46:28.899326+0000","last_peered":"2024-04-25T15:46:28.899326+0000","last_clean":"2024-04-25T15:46:28.899326+0000","last_became_active":"2024-04-25T15:46:27.831249+0000","last_became_peered":"2024-04-25T15:46:27.831249+0000","last_unstale":"2024-04-25T15:46:28.899326+0000","last_undegraded":"2024-04-25T15:46:28.899326+0000","last_fullsized":"2024-04-25T15:46:28.899326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:34.681753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.848422+0000","last_change":"2024-04-25T15:46:26.824724+0000","last_active":"2024-04-25T15:46:27.848422+0000","last_peered":"2024-04-25T15:46:27.848422+0000","last_clean":"2024-04-25T15:46:27.848422+0000","last_became_active":"2024-04-25T15:46:26.824401+0000","last_became_peered":"2024-04-25T15:46:26.824401+0000","last_unstale":"2024-04-25T15:46:27.848422+0000","last_undegraded":"2024-04-25T15:46:27.848422+0000","last_fullsized":"2024-04-25T15:46:27.848422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:08.178975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.833406+0000","last_change":"2024-04-25T15:46:27.829172+0000","last_active":"2024-04-25T15:46:27.833406+0000","last_peered":"2024-04-25T15:46:27.833406+0000","last_clean":"2024-04-25T15:46:27.833406+0000","last_became_active":"2024-04-25T15:46:27.828842+0000","last_became_peered":"2024-04-25T15:46:27.828842+0000","last_unstale":"2024-04-25T15:46:27.833406+0000","last_undegraded":"2024-04-25T15:46:27.833406+0000","last_fullsized":"2024-04-25T15:46:27.833406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.961224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.856912+0000","last_change":"2024-04-25T15:46:26.829212+0000","last_active":"2024-04-25T15:46:27.856912+0000","last_peered":"2024-04-25T15:46:27.856912+0000","last_clean":"2024-04-25T15:46:27.856912+0000","last_became_active":"2024-04-25T15:46:26.828801+0000","last_became_peered":"2024-04-25T15:46:26.828801+0000","last_unstale":"2024-04-25T15:46:27.856912+0000","last_undegraded":"2024-04-25T15:46:27.856912+0000","last_fullsized":"2024-04-25T15:46:27.856912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:34.016829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899677+0000","last_change":"2024-04-25T15:46:27.854784+0000","last_active":"2024-04-25T15:46:28.899677+0000","last_peered":"2024-04-25T15:46:28.899677+0000","last_clean":"2024-04-25T15:46:28.899677+0000","last_became_active":"2024-04-25T15:46:27.854404+0000","last_became_peered":"2024-04-25T15:46:27.854404+0000","last_unstale":"2024-04-25T15:46:28.899677+0000","last_undegraded":"2024-04-25T15:46:28.899677+0000","last_fullsized":"2024-04-25T15:46:28.899677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:45.896880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.855599+0000","last_change":"2024-04-25T15:46:26.827253+0000","last_active":"2024-04-25T15:46:27.855599+0000","last_peered":"2024-04-25T15:46:27.855599+0000","last_clean":"2024-04-25T15:46:27.855599+0000","last_became_active":"2024-04-25T15:46:26.826924+0000","last_became_peered":"2024-04-25T15:46:26.826924+0000","last_unstale":"2024-04-25T15:46:27.855599+0000","last_undegraded":"2024-04-25T15:46:27.855599+0000","last_fullsized":"2024-04-25T15:46:27.855599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:35.023937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.837480+0000","last_change":"2024-04-25T15:46:27.836396+0000","last_active":"2024-04-25T15:46:27.837480+0000","last_peered":"2024-04-25T15:46:27.837480+0000","last_clean":"2024-04-25T15:46:27.837480+0000","last_became_active":"2024-04-25T15:46:27.836036+0000","last_became_peered":"2024-04-25T15:46:27.836036+0000","last_unstale":"2024-04-25T15:46:27.837480+0000","last_undegraded":"2024-04-25T15:46:27.837480+0000","last_fullsized":"2024-04-25T15:46:27.837480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:22.466482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829781+0000","last_change":"2024-04-25T15:46:26.828732+0000","last_active":"2024-04-25T15:46:28.829781+0000","last_peered":"2024-04-25T15:46:28.829781+0000","last_clean":"2024-04-25T15:46:28.829781+0000","last_became_active":"2024-04-25T15:46:26.828413+0000","last_became_peered":"2024-04-25T15:46:26.828413+0000","last_unstale":"2024-04-25T15:46:28.829781+0000","last_undegraded":"2024-04-25T15:46:28.829781+0000","last_fullsized":"2024-04-25T15:46:28.829781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:48.390650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.842462+0000","last_change":"2024-04-25T15:46:27.841214+0000","last_active":"2024-04-25T15:46:27.842462+0000","last_peered":"2024-04-25T15:46:27.842462+0000","last_clean":"2024-04-25T15:46:27.842462+0000","last_became_active":"2024-04-25T15:46:27.840896+0000","last_became_peered":"2024-04-25T15:46:27.840896+0000","last_unstale":"2024-04-25T15:46:27.842462+0000","last_undegraded":"2024-04-25T15:46:27.842462+0000","last_fullsized":"2024-04-25T15:46:27.842462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:23.147474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.822429+0000","last_change":"2024-04-25T15:46:26.822146+0000","last_active":"2024-04-25T15:46:27.822429+0000","last_peered":"2024-04-25T15:46:27.822429+0000","last_clean":"2024-04-25T15:46:27.822429+0000","last_became_active":"2024-04-25T15:46:26.821857+0000","last_became_peered":"2024-04-25T15:46:26.821857+0000","last_unstale":"2024-04-25T15:46:27.822429+0000","last_undegraded":"2024-04-25T15:46:27.822429+0000","last_fullsized":"2024-04-25T15:46:27.822429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:20.403553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899655+0000","last_change":"2024-04-25T15:46:27.834987+0000","last_active":"2024-04-25T15:46:28.899655+0000","last_peered":"2024-04-25T15:46:28.899655+0000","last_clean":"2024-04-25T15:46:28.899655+0000","last_became_active":"2024-04-25T15:46:27.834668+0000","last_became_peered":"2024-04-25T15:46:27.834668+0000","last_unstale":"2024-04-25T15:46:28.899655+0000","last_undegraded":"2024-04-25T15:46:28.899655+0000","last_fullsized":"2024-04-25T15:46:28.899655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:27.746605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829594+0000","last_change":"2024-04-25T15:46:26.826316+0000","last_active":"2024-04-25T15:46:28.829594+0000","last_peered":"2024-04-25T15:46:28.829594+0000","last_clean":"2024-04-25T15:46:28.829594+0000","last_became_active":"2024-04-25T15:46:26.826022+0000","last_became_peered":"2024-04-25T15:46:26.826022+0000","last_unstale":"2024-04-25T15:46:28.829594+0000","last_undegraded":"2024-04-25T15:46:28.829594+0000","last_fullsized":"2024-04-25T15:46:28.829594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:06.992636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899342+0000","last_change":"2024-04-25T15:46:27.833035+0000","last_active":"2024-04-25T15:46:28.899342+0000","last_peered":"2024-04-25T15:46:28.899342+0000","last_clean":"2024-04-25T15:46:28.899342+0000","last_became_active":"2024-04-25T15:46:27.832711+0000","last_became_peered":"2024-04-25T15:46:27.832711+0000","last_unstale":"2024-04-25T15:46:28.899342+0000","last_undegraded":"2024-04-25T15:46:28.899342+0000","last_fullsized":"2024-04-25T15:46:28.899342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:09.809077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.848060+0000","last_change":"2024-04-25T15:46:26.830287+0000","last_active":"2024-04-25T15:46:27.848060+0000","last_peered":"2024-04-25T15:46:27.848060+0000","last_clean":"2024-04-25T15:46:27.848060+0000","last_became_active":"2024-04-25T15:46:26.829839+0000","last_became_peered":"2024-04-25T15:46:26.829839+0000","last_unstale":"2024-04-25T15:46:27.848060+0000","last_undegraded":"2024-04-25T15:46:27.848060+0000","last_fullsized":"2024-04-25T15:46:27.848060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:02.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900910+0000","last_change":"2024-04-25T15:46:27.837995+0000","last_active":"2024-04-25T15:46:28.900910+0000","last_peered":"2024-04-25T15:46:28.900910+0000","last_clean":"2024-04-25T15:46:28.900910+0000","last_became_active":"2024-04-25T15:46:27.837683+0000","last_became_peered":"2024-04-25T15:46:27.837683+0000","last_unstale":"2024-04-25T15:46:28.900910+0000","last_undegraded":"2024-04-25T15:46:28.900910+0000","last_fullsized":"2024-04-25T15:46:28.900910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:23.640881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.824411+0000","last_change":"2024-04-25T15:46:26.822375+0000","last_active":"2024-04-25T15:46:27.824411+0000","last_peered":"2024-04-25T15:46:27.824411+0000","last_clean":"2024-04-25T15:46:27.824411+0000","last_became_active":"2024-04-25T15:46:26.822014+0000","last_became_peered":"2024-04-25T15:46:26.822014+0000","last_unstale":"2024-04-25T15:46:27.824411+0000","last_undegraded":"2024-04-25T15:46:27.824411+0000","last_fullsized":"2024-04-25T15:46:27.824411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:27.599744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900788+0000","last_change":"2024-04-25T15:46:27.847808+0000","last_active":"2024-04-25T15:46:28.900788+0000","last_peered":"2024-04-25T15:46:28.900788+0000","last_clean":"2024-04-25T15:46:28.900788+0000","last_became_active":"2024-04-25T15:46:27.847521+0000","last_became_peered":"2024-04-25T15:46:27.847521+0000","last_unstale":"2024-04-25T15:46:28.900788+0000","last_undegraded":"2024-04-25T15:46:28.900788+0000","last_fullsized":"2024-04-25T15:46:28.900788+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:56.349994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.824586+0000","last_change":"2024-04-25T15:46:26.823361+0000","last_active":"2024-04-25T15:46:27.824586+0000","last_peered":"2024-04-25T15:46:27.824586+0000","last_clean":"2024-04-25T15:46:27.824586+0000","last_became_active":"2024-04-25T15:46:26.822847+0000","last_became_peered":"2024-04-25T15:46:26.822847+0000","last_unstale":"2024-04-25T15:46:27.824586+0000","last_undegraded":"2024-04-25T15:46:27.824586+0000","last_fullsized":"2024-04-25T15:46:27.824586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:17.003611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.834071+0000","last_change":"2024-04-25T15:46:27.832577+0000","last_active":"2024-04-25T15:46:27.834071+0000","last_peered":"2024-04-25T15:46:27.834071+0000","last_clean":"2024-04-25T15:46:27.834071+0000","last_became_active":"2024-04-25T15:46:27.832243+0000","last_became_peered":"2024-04-25T15:46:27.832243+0000","last_unstale":"2024-04-25T15:46:27.834071+0000","last_undegraded":"2024-04-25T15:46:27.834071+0000","last_fullsized":"2024-04-25T15:46:27.834071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:04.407637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899461+0000","last_change":"2024-04-25T15:46:26.826454+0000","last_active":"2024-04-25T15:46:28.899461+0000","last_peered":"2024-04-25T15:46:28.899461+0000","last_clean":"2024-04-25T15:46:28.899461+0000","last_became_active":"2024-04-25T15:46:26.826134+0000","last_became_peered":"2024-04-25T15:46:26.826134+0000","last_unstale":"2024-04-25T15:46:28.899461+0000","last_undegraded":"2024-04-25T15:46:28.899461+0000","last_fullsized":"2024-04-25T15:46:28.899461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:26.480008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.829611+0000","last_change":"2024-04-25T15:46:27.845114+0000","last_active":"2024-04-25T15:46:28.829611+0000","last_peered":"2024-04-25T15:46:28.829611+0000","last_clean":"2024-04-25T15:46:28.829611+0000","last_became_active":"2024-04-25T15:46:27.844367+0000","last_became_peered":"2024-04-25T15:46:27.844367+0000","last_unstale":"2024-04-25T15:46:28.829611+0000","last_undegraded":"2024-04-25T15:46:28.829611+0000","last_fullsized":"2024-04-25T15:46:28.829611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:02.830711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899919+0000","last_change":"2024-04-25T15:46:26.821779+0000","last_active":"2024-04-25T15:46:28.899919+0000","last_peered":"2024-04-25T15:46:28.899919+0000","last_clean":"2024-04-25T15:46:28.899919+0000","last_became_active":"2024-04-25T15:46:26.821481+0000","last_became_peered":"2024-04-25T15:46:26.821481+0000","last_unstale":"2024-04-25T15:46:28.899919+0000","last_undegraded":"2024-04-25T15:46:28.899919+0000","last_fullsized":"2024-04-25T15:46:28.899919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:57.609560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900473+0000","last_change":"2024-04-25T15:46:27.839398+0000","last_active":"2024-04-25T15:46:28.900473+0000","last_peered":"2024-04-25T15:46:28.900473+0000","last_clean":"2024-04-25T15:46:28.900473+0000","last_became_active":"2024-04-25T15:46:27.839077+0000","last_became_peered":"2024-04-25T15:46:27.839077+0000","last_unstale":"2024-04-25T15:46:28.900473+0000","last_undegraded":"2024-04-25T15:46:28.900473+0000","last_fullsized":"2024-04-25T15:46:28.900473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:49.819027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.822735+0000","last_change":"2024-04-25T15:46:26.825743+0000","last_active":"2024-04-25T15:46:27.822735+0000","last_peered":"2024-04-25T15:46:27.822735+0000","last_clean":"2024-04-25T15:46:27.822735+0000","last_became_active":"2024-04-25T15:46:26.825433+0000","last_became_peered":"2024-04-25T15:46:26.825433+0000","last_unstale":"2024-04-25T15:46:27.822735+0000","last_undegraded":"2024-04-25T15:46:27.822735+0000","last_fullsized":"2024-04-25T15:46:27.822735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:01.602265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899140+0000","last_change":"2024-04-25T15:46:27.842670+0000","last_active":"2024-04-25T15:46:28.899140+0000","last_peered":"2024-04-25T15:46:28.899140+0000","last_clean":"2024-04-25T15:46:28.899140+0000","last_became_active":"2024-04-25T15:46:27.841986+0000","last_became_peered":"2024-04-25T15:46:27.841986+0000","last_unstale":"2024-04-25T15:46:28.899140+0000","last_undegraded":"2024-04-25T15:46:28.899140+0000","last_fullsized":"2024-04-25T15:46:28.899140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.760467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899308+0000","last_change":"2024-04-25T15:46:26.825593+0000","last_active":"2024-04-25T15:46:28.899308+0000","last_peered":"2024-04-25T15:46:28.899308+0000","last_clean":"2024-04-25T15:46:28.899308+0000","last_became_active":"2024-04-25T15:46:26.825269+0000","last_became_peered":"2024-04-25T15:46:26.825269+0000","last_unstale":"2024-04-25T15:46:28.899308+0000","last_undegraded":"2024-04-25T15:46:28.899308+0000","last_fullsized":"2024-04-25T15:46:28.899308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:14.152049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.899815+0000","last_change":"2024-04-25T15:46:27.847125+0000","last_active":"2024-04-25T15:46:28.899815+0000","last_peered":"2024-04-25T15:46:28.899815+0000","last_clean":"2024-04-25T15:46:28.899815+0000","last_became_active":"2024-04-25T15:46:27.846814+0000","last_became_peered":"2024-04-25T15:46:27.846814+0000","last_unstale":"2024-04-25T15:46:28.899815+0000","last_undegraded":"2024-04-25T15:46:28.899815+0000","last_fullsized":"2024-04-25T15:46:28.899815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:32.187087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.819076+0000","last_change":"2024-04-25T15:46:26.827764+0000","last_active":"2024-04-25T15:46:27.819076+0000","last_peered":"2024-04-25T15:46:27.819076+0000","last_clean":"2024-04-25T15:46:27.819076+0000","last_became_active":"2024-04-25T15:46:26.827438+0000","last_became_peered":"2024-04-25T15:46:26.827438+0000","last_unstale":"2024-04-25T15:46:27.819076+0000","last_undegraded":"2024-04-25T15:46:27.819076+0000","last_fullsized":"2024-04-25T15:46:27.819076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:22.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.837281+0000","last_change":"2024-04-25T15:46:27.836351+0000","last_active":"2024-04-25T15:46:27.837281+0000","last_peered":"2024-04-25T15:46:27.837281+0000","last_clean":"2024-04-25T15:46:27.837281+0000","last_became_active":"2024-04-25T15:46:27.835941+0000","last_became_peered":"2024-04-25T15:46:27.835941+0000","last_unstale":"2024-04-25T15:46:27.837281+0000","last_undegraded":"2024-04-25T15:46:27.837281+0000","last_fullsized":"2024-04-25T15:46:27.837281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:26.803659+0000","last_clean_scrub_stamp":"2024-04-25T15:46:26.803659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:49.819027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T15:46:28.900345+0000","last_change":"2024-04-25T15:46:26.826632+0000","last_active":"2024-04-25T15:46:28.900345+0000","last_peered":"2024-04-25T15:46:28.900345+0000","last_clean":"2024-04-25T15:46:28.900345+0000","last_became_active":"2024-04-25T15:46:26.826230+0000","last_became_peered":"2024-04-25T15:46:26.826230+0000","last_unstale":"2024-04-25T15:46:28.900345+0000","last_undegraded":"2024-04-25T15:46:28.900345+0000","last_fullsized":"2024-04-25T15:46:28.900345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:25.799015+0000","last_clean_scrub_stamp":"2024-04-25T15:46:25.799015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:17.003611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":239,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T15:46:27.819150+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:27.819150+0000","last_peered":"2024-04-25T15:46:27.819150+0000","last_clean":"2024-04-25T15:46:27.819150+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:27.819150+0000","last_undegraded":"2024-04-25T15:46:27.819150+0000","last_fullsized":"2024-04-25T15:46:27.819150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":475984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":473768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1056768,"data_stored":480460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":473838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28644,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343196,"statfs":{"total":96636764160,"available":96607432704,"internally_reserved":0,"allocated":1662976,"data_stored":1066454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1626112,"data_stored":1056969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1032192,"data_stored":466601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":473928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:32.190 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:46:32.190 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T15:46:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.341+0000 7f991a070640 1 Processor -- start 2024-04-25T15:46:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.341+0000 7f991a070640 1 -- start start 2024-04-25T15:46:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f991a070640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f99140b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f991a070640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f99140b7b90 0x7f99140d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f991a070640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99140b7fa0 con 0x7f99140d41b0 2024-04-25T15:46:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f991a070640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9914163fb0 con 0x7f99140b7b90 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f991a070640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9914164270 con 0x7f99140b48d0 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f99137fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99140d41b0 0x7f99141602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52364/0 (socket says 172.21.15.80:52364) 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.342+0000 7f99137fe640 1 -- 172.21.15.80:0/4099213108 learned_addr learned my addr 172.21.15.80:0/4099213108 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f99140b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715521734 0 0) 0x7f9904001110 con 0x7f99140d41b0 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9913fff640 1 --2- 172.21.15.80:0/4099213108 >> v2:172.21.15.195:3300/0 conn(0x7f99140b7b90 0x7f99140d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9900003520 con 0x7f99140d41b0 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3632149101 0 0) 0x7f9900003520 con 0x7f99140d41b0 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 msgr2=0x7f99140b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f99140b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 >> v2:172.21.15.195:3300/0 conn(0x7f99140b7b90 msgr2=0x7f99140d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 --2- 172.21.15.80:0/4099213108 >> v2:172.21.15.195:3300/0 conn(0x7f99140b7b90 0x7f99140d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9914164550 con 0x7f99140d41b0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f9904001840 con 0x7f99140d41b0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 >> v1:172.21.15.80:6789/0 conn(0x7f99140d41b0 legacy=0x7f99141602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000039b0 0x7f9900003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9900004800 0x7f9900004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f9900005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9914163fb0 con 0x7f9900004800 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9914164270 con 0x7f99000039b0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f990000b9c0 con 0x7f99140b48d0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9900004800 0x7f9900004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9913fff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f9900005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f99137fe640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000039b0 0x7f9900003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 -- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 msgr2=0x7f9900005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f9900005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 -- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000039b0 msgr2=0x7f9900003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000039b0 0x7f9900003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f990bfff640 1 -- 172.21.15.80:0/4099213108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9900003520 con 0x7f9900004800 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f99137fe640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000039b0 0x7f9900003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.343+0000 7f9913fff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b48d0 0x7f9900005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.344+0000 7f990bfff640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9900004800 0x7f9900004c10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009ac0 tx=0x7f9900005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c660686caf1bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.344+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc036070 con 0x7f9900004800 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.344+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc031400 con 0x7f9900004800 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.344+0000 7f9912ffd640 1 -- 172.21.15.80:0/4099213108 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc009690 con 0x7f9900004800 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f991a070640 1 -- 172.21.15.80:0/4099213108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9900004800 msgr2=0x7f9900004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f991a070640 1 --2- 172.21.15.80:0/4099213108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9900004800 0x7f9900004c10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009ac0 tx=0x7f9900005830 comp rx=0 tx=0).stop 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f9913fff640 1 -- 172.21.15.80:0/4099213108 reap_dead start 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f991a070640 1 -- 172.21.15.80:0/4099213108 shutdown_connections 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f991a070640 1 -- 172.21.15.80:0/4099213108 >> 172.21.15.80:0/4099213108 conn(0x7f991406e9f0 msgr2=0x7f99140d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f991a070640 1 -- 172.21.15.80:0/4099213108 shutdown_connections 2024-04-25T15:46:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.345+0000 7f991a070640 1 -- 172.21.15.80:0/4099213108 wait complete. 2024-04-25T15:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.347+0000 7f991a070640 1 Processor -- start 2024-04-25T15:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.347+0000 7f991a070640 1 -- start start 2024-04-25T15:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f991a070640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9900004800 0x7f9914144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f991a070640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 0x7f99140b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f991a070640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b7390 0x7f9914152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f991a070640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99140b4fd0 con 0x7f9914161e00 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f991a070640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9914164b10 con 0x7f9900004800 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f991a070640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99140b5150 con 0x7f99140b7390 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 0x7f99140b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 0x7f99140b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52176/0 (socket says 172.21.15.80:52176) 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 -- 172.21.15.80:0/1991160335 learned_addr learned my addr 172.21.15.80:0/1991160335 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 -- 172.21.15.80:0/1991160335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b7390 msgr2=0x7f9914152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b7390 0x7f9914152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 -- 172.21.15.80:0/1991160335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9900004800 msgr2=0x7f9914144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9900004800 0x7f9914144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.348+0000 7f990bfff640 1 -- 172.21.15.80:0/1991160335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99140b77a0 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.349+0000 7f990bfff640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 0x7f99140b6e50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009ac0 tx=0x7f98fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.349+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc040020 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.349+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc003b40 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.349+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99141629e0 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.349+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc036040 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.349+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9914162fa0 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.350+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991406a100 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.351+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f98fc043020 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.351+0000 7f9910ff9640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f98f40744e0 0x7f98f40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.351+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f98fc0b5420 con 0x7f9914161e00 2024-04-25T15:46:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.351+0000 7f99137fe640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f98f40744e0 0x7f98f40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.352+0000 7f99137fe640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f98f40744e0 0x7f98f40769f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f99040012f0 tx=0x7f9904000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.356+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f98fc04a070 con 0x7f9914161e00 2024-04-25T15:46:32.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.600+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f99140d3070 con 0x7f9914161e00 2024-04-25T15:46:32.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.602+0000 7f9910ff9640 1 -- 172.21.15.80:0/1991160335 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f99140b77a0 con 0x7f9914161e00 2024-04-25T15:46:32.602 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:46:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:46:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-25T15:46:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-25T15:46:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T15:46:32.603 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f98f40744e0 msgr2=0x7f98f40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f98f40744e0 0x7f98f40769f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f99040012f0 tx=0x7f9904000ed0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 msgr2=0x7f99140b6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 0x7f99140b6e50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009ac0 tx=0x7f98fc004730 comp rx=0 tx=0).stop 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 shutdown_connections 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f98f40744e0 0x7f98f40769f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99140b7390 0x7f9914152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9914161e00 0x7f99140b6e50 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 --2- 172.21.15.80:0/1991160335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9900004800 0x7f9914144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 >> 172.21.15.80:0/1991160335 conn(0x7f991406e9f0 msgr2=0x7f991415ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:32.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 shutdown_connections 2024-04-25T15:46:32.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.604+0000 7f991a070640 1 -- 172.21.15.80:0/1991160335 wait complete. 2024-04-25T15:46:32.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:32.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.724+0000 7f88cfef9640 1 Processor -- start 2024-04-25T15:46:32.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.724+0000 7f88cfef9640 1 -- start start 2024-04-25T15:46:32.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cfef9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88c806d5d0 0x7f88c806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cfef9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88c80b4700 0x7f88c80b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cfef9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c806df20 con 0x7f88c8153f70 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cfef9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f88c80b1180 con 0x7f88c806d5d0 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cfef9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f88c815d4f0 con 0x7f88c80b4700 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cdc95640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f88c8153f70 0x7f88c80b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52368/0 (socket says 172.21.15.80:52368) 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cdc95640 1 -- 172.21.15.80:0/484920913 learned_addr learned my addr 172.21.15.80:0/484920913 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.725+0000 7f88cd494640 1 --2- 172.21.15.80:0/484920913 >> v2:172.21.15.80:3300/0 conn(0x7f88c806d5d0 0x7f88c806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88ce496640 1 --2- 172.21.15.80:0/484920913 >> v2:172.21.15.195:3300/0 conn(0x7f88c80b4700 0x7f88c80b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88cd494640 1 -- 172.21.15.80:0/484920913 >> v2:172.21.15.195:3300/0 conn(0x7f88c80b4700 msgr2=0x7f88c80b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88cd494640 1 --2- 172.21.15.80:0/484920913 >> v2:172.21.15.195:3300/0 conn(0x7f88c80b4700 0x7f88c80b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88cd494640 1 -- 172.21.15.80:0/484920913 >> v1:172.21.15.80:6789/0 conn(0x7f88c8153f70 legacy=0x7f88c80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88cd494640 1 -- 172.21.15.80:0/484920913 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c815e270 con 0x7f88c806d5d0 2024-04-25T15:46:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88ccc93640 1 -- 172.21.15.80:0/484920913 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108976276 0 0) 0x7f88c4001490 con 0x7f88c8153f70 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88cd494640 1 --2- 172.21.15.80:0/484920913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c806d9e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f88c8073220 tx=0x7f88b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf998462f121bf57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88ccc93640 1 -- 172.21.15.80:0/484920913 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8037070 con 0x7f88c806d5d0 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88ccc93640 1 -- 172.21.15.80:0/484920913 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8032440 con 0x7f88c806d5d0 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.726+0000 7f88ccc93640 1 -- 172.21.15.80:0/484920913 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8032810 con 0x7f88c806d5d0 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 -- 172.21.15.80:0/484920913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 msgr2=0x7f88c806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 --2- 172.21.15.80:0/484920913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c806d9e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f88c8073220 tx=0x7f88b802a1a0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 -- 172.21.15.80:0/484920913 shutdown_connections 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 --2- 172.21.15.80:0/484920913 >> v2:172.21.15.195:3300/0 conn(0x7f88c80b4700 0x7f88c80b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 --2- 172.21.15.80:0/484920913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c806d9e0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 -- 172.21.15.80:0/484920913 >> 172.21.15.80:0/484920913 conn(0x7f88c80d1e20 msgr2=0x7f88c8073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 -- 172.21.15.80:0/484920913 shutdown_connections 2024-04-25T15:46:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.727+0000 7f88cfef9640 1 -- 172.21.15.80:0/484920913 wait complete. 2024-04-25T15:46:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.729+0000 7f88cfef9640 1 Processor -- start 2024-04-25T15:46:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.729+0000 7f88cfef9640 1 -- start start 2024-04-25T15:46:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cfef9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c81410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cfef9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88c80b4700 0x7f88c815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cfef9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88c8153f70 0x7f88c809e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cfef9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80b0dd0 con 0x7f88c806d5d0 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cfef9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f88c815da70 con 0x7f88c80b4700 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cfef9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f88c8141a20 con 0x7f88c8153f70 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cdc95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c81410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cdc95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c81410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52196/0 (socket says 172.21.15.80:52196) 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.730+0000 7f88cdc95640 1 -- 172.21.15.80:0/4045011990 learned_addr learned my addr 172.21.15.80:0/4045011990 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cd494640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88c80b4700 0x7f88c815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88ce496640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88c8153f70 0x7f88c809e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cdc95640 1 -- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88c8153f70 msgr2=0x7f88c809e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cdc95640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88c8153f70 0x7f88c809e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cdc95640 1 -- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88c80b4700 msgr2=0x7f88c815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cdc95640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88c80b4700 0x7f88c815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cdc95640 1 -- 172.21.15.80:0/4045011990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c809be20 con 0x7f88c806d5d0 2024-04-25T15:46:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cdc95640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c81410e0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f88c400c7c0 tx=0x7f88c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4018070 con 0x7f88c806d5d0 2024-04-25T15:46:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c400a640 con 0x7f88c806d5d0 2024-04-25T15:46:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c400aa30 con 0x7f88c806d5d0 2024-04-25T15:46:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c809c100 con 0x7f88c806d5d0 2024-04-25T15:46:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.731+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c809c6c0 con 0x7f88c806d5d0 2024-04-25T15:46:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.732+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c806a100 con 0x7f88c806d5d0 2024-04-25T15:46:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.733+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f88c401b070 con 0x7f88c806d5d0 2024-04-25T15:46:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.733+0000 7f88be7fc640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88ac0744e0 0x7f88ac0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.733+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f88c40949a0 con 0x7f88c806d5d0 2024-04-25T15:46:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.733+0000 7f88cd494640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88ac0744e0 0x7f88ac0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.734+0000 7f88cd494640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88ac0744e0 0x7f88ac0769f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f88b8034000 tx=0x7f88b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.738+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f88c806df20 con 0x7f88c806d5d0 2024-04-25T15:46:32.776 INFO:tasks.ceph.mds.a.smithi080.stderr:2024-04-25T15:46:32.776+0000 7f8fa964e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:46:32.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.951+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88c8070570 con 0x7f88c806d5d0 2024-04-25T15:46:32.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.951+0000 7f88be7fc640 1 -- 172.21.15.80:0/4045011990 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7f88c405efa0 con 0x7f88c806d5d0 2024-04-25T15:46:32.951 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:32.951 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:32.952 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:32.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88ac0744e0 msgr2=0x7f88ac0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88ac0744e0 0x7f88ac0769f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f88b8034000 tx=0x7f88b802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 msgr2=0x7f88c81410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c81410e0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f88c400c7c0 tx=0x7f88c400cc80 comp rx=0 tx=0).stop 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 shutdown_connections 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f88ac0744e0 0x7f88ac0769f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88c8153f70 0x7f88c809e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88c80b4700 0x7f88c815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 --2- 172.21.15.80:0/4045011990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88c806d5d0 0x7f88c81410e0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 >> 172.21.15.80:0/4045011990 conn(0x7f88c80d1e20 msgr2=0x7f88c80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 shutdown_connections 2024-04-25T15:46:32.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:32.953+0000 7f88cfef9640 1 -- 172.21.15.80:0/4045011990 wait complete. 2024-04-25T15:46:33.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:27.174449+0000', 'modified': '2024-04-25T15:46:30.186896+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7149': {'gid': 7149, 'name': 'a', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.80:6837/1832881946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6835', 'nonce': 1832881946}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 1832881946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7149, 'qdb_cluster': [7149]} 2024-04-25T15:46:33.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:46:33.368 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T15:46:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.479+0000 7f141f6d1640 1 Processor -- start 2024-04-25T15:46:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.479+0000 7f141f6d1640 1 -- start start 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141f6d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 0x7f141816b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141f6d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1418163ef0 con 0x7f141806f370 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141f6d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14181641d0 con 0x7f1418073ae0 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141f6d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f14181644b0 con 0x7f14180d1e00 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141d46d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f141806f370 0x7f14180733d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:52382/0 (socket says 172.21.15.80:52382) 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141d46d640 1 -- 172.21.15.80:0/846192539 learned_addr learned my addr 172.21.15.80:0/846192539 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.480+0000 7f141dc6e640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 0x7f141816b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880969389 0 0) 0x7f1418163ef0 con 0x7f141806f370 2024-04-25T15:46:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1404003520 con 0x7f141806f370 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010677585 0 0) 0x7f14181641d0 con 0x7f1418073ae0 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1418163ef0 con 0x7f1418073ae0 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3657801819 0 0) 0x7f1404003520 con 0x7f141806f370 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 msgr2=0x7f141816b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 0x7f141816b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 >> v1:172.21.15.195:6789/0 conn(0x7f1418073ae0 legacy=0x7f14180d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1418164790 con 0x7f141806f370 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f14140019f0 con 0x7f141806f370 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 >> v1:172.21.15.80:6789/0 conn(0x7f141806f370 legacy=0x7f14180733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1404003b70 0x7f1404003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 0x7f1404004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1404004d90 0x7f1404005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f14181644b0 con 0x7f1404004d90 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f140400bc60 con 0x7f1404003b70 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f140400be60 con 0x7f14180d1e00 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141dc6e640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1404004d90 0x7f1404005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141d46d640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1404003b70 0x7f1404003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141cc6c640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 0x7f1404004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141dc6e640 1 -- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 msgr2=0x7f1404004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141dc6e640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14180d1e00 0x7f1404004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141dc6e640 1 -- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1404003b70 msgr2=0x7f1404003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141dc6e640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1404003b70 0x7f1404003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141dc6e640 1 -- 172.21.15.80:0/846192539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1404003520 con 0x7f1404004d90 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.481+0000 7f141d46d640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1404003b70 0x7f1404003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.482+0000 7f141dc6e640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1404004d90 0x7f1404005220 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f141806e0a0 tx=0x7f1404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a89fc63e80acfd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.482+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410036070 con 0x7f1404004d90 2024-04-25T15:46:33.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.482+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1410031400 con 0x7f1404004d90 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.482+0000 7f140ffff640 1 -- 172.21.15.80:0/846192539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410009690 con 0x7f1404004d90 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141f6d1640 1 -- 172.21.15.80:0/846192539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1404004d90 msgr2=0x7f1404005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141f6d1640 1 --2- 172.21.15.80:0/846192539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1404004d90 0x7f1404005220 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f141806e0a0 tx=0x7f1404005830 comp rx=0 tx=0).stop 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141dc6e640 1 -- 172.21.15.80:0/846192539 reap_dead start 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141f6d1640 1 -- 172.21.15.80:0/846192539 shutdown_connections 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141f6d1640 1 -- 172.21.15.80:0/846192539 >> 172.21.15.80:0/846192539 conn(0x7f14180d3ea0 msgr2=0x7f14180d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141f6d1640 1 -- 172.21.15.80:0/846192539 shutdown_connections 2024-04-25T15:46:33.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.483+0000 7f141f6d1640 1 -- 172.21.15.80:0/846192539 wait complete. 2024-04-25T15:46:33.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.485+0000 7f141f6d1640 1 Processor -- start 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.485+0000 7f141f6d1640 1 -- start start 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141f6d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1404004d90 0x7f14180cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141f6d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 0x7f14180b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141f6d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141814e710 0x7f14180b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141f6d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f14181692c0 con 0x7f1418158420 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141f6d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1418169140 con 0x7f141814e710 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141f6d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1418169440 con 0x7f1404004d90 2024-04-25T15:46:33.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 0x7f14180b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 0x7f14180b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52216/0 (socket says 172.21.15.80:52216) 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 -- 172.21.15.80:0/3203301962 learned_addr learned my addr 172.21.15.80:0/3203301962 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141d46d640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1404004d90 0x7f14180cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141dc6e640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141814e710 0x7f14180b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 -- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1404004d90 msgr2=0x7f14180cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1404004d90 0x7f14180cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 -- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141814e710 msgr2=0x7f14180b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141814e710 0x7f14180b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.486+0000 7f141cc6c640 1 -- 172.21.15.80:0/3203301962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14180b3410 con 0x7f1418158420 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.487+0000 7f141cc6c640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 0x7f14180b88a0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f140800e510 tx=0x7f140800e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.487+0000 7f140dffb640 1 -- 172.21.15.80:0/3203301962 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14080052e0 con 0x7f1418158420 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.487+0000 7f140dffb640 1 -- 172.21.15.80:0/3203301962 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1408018070 con 0x7f1418158420 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.487+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1418161470 con 0x7f1418158420 2024-04-25T15:46:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.487+0000 7f140dffb640 1 -- 172.21.15.80:0/3203301962 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408003880 con 0x7f1418158420 2024-04-25T15:46:33.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.487+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1418161190 con 0x7f1418158420 2024-04-25T15:46:33.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.488+0000 7f140dffb640 1 -- 172.21.15.80:0/3203301962 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1408003a20 con 0x7f1418158420 2024-04-25T15:46:33.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.489+0000 7f140dffb640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f13fc0744b0 0x7f13fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.489+0000 7f140dffb640 1 -- 172.21.15.80:0/3203301962 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f14080951a0 con 0x7f1418158420 2024-04-25T15:46:33.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.489+0000 7f141d46d640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f13fc0744b0 0x7f13fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.489+0000 7f141d46d640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f13fc0744b0 0x7f13fc0769c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1414001580 tx=0x7f1414009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.490+0000 7f142657c740 1 Processor -- start 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.490+0000 7f142657c740 1 -- start start 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f142657c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd12b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 0x563edd127fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd101260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f142657c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563edd065740 con 0x563edcd5f270 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563edd0013a0 con 0x563edcd3e590 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x563edd061700 con 0x563edcd363b0 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f141d46d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd12b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f141d46d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd12b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52224/0 (socket says 172.21.15.80:52224) 2024-04-25T15:46:33.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.491+0000 7f141d46d640 1 -- 172.21.15.80:0/1152758779 learned_addr learned my addr 172.21.15.80:0/1152758779 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f141d46d640 1 -- 172.21.15.80:0/1152758779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 msgr2=0x563edd127fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f141d46d640 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 0x563edd127fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f141d46d640 1 -- 172.21.15.80:0/1152758779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 msgr2=0x563edd101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f141d46d640 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f141d46d640 1 -- 172.21.15.80:0/1152758779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd01d750 con 0x563edcd5f270 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f141d46d640 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd12b600 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1414005f40 tx=0x7f1414013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3e0b32fdaab66a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f1402ffd640 1 -- 172.21.15.80:0/1152758779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414026070 con 0x563edcd5f270 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f1402ffd640 1 -- 172.21.15.80:0/1152758779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141401c050 con 0x563edcd5f270 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.492+0000 7f1402ffd640 1 -- 172.21.15.80:0/1152758779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414021870 con 0x563edcd5f270 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 -- 172.21.15.80:0/1152758779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 msgr2=0x563edd12b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd12b600 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1414005f40 tx=0x7f1414013000 comp rx=0 tx=0).stop 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 -- 172.21.15.80:0/1152758779 shutdown_connections 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 0x563edd127fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 --2- 172.21.15.80:0/1152758779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd12b600 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 -- 172.21.15.80:0/1152758779 >> 172.21.15.80:0/1152758779 conn(0x563edcd533c0 msgr2=0x563edd1009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 -- 172.21.15.80:0/1152758779 shutdown_connections 2024-04-25T15:46:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.493+0000 7f142657c740 1 -- 172.21.15.80:0/1152758779 wait complete. 2024-04-25T15:46:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.494+0000 7f142657c740 1 -- start start 2024-04-25T15:46:33.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.494+0000 7f142657c740 1 Processor -- start 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 0x563edd144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd14b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd5f270 0x563edd14b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563edcfecfe0 con 0x563edcd363b0 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563edd1271b0 con 0x563edcd3e590 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x563edd14c150 con 0x563edcd5f270 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f142657c740 10 client.0 _ll_register_callbacks cb 0x563edd003150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f141d46d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 0x563edd144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f141d46d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 0x563edd144ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52230/0 (socket says 172.21.15.80:52230) 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.495+0000 7f141d46d640 1 -- 172.21.15.80:0/2760307355 learned_addr learned my addr 172.21.15.80:0/2760307355 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141cc6c640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141dc6e640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd5f270 0x563edd14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141d46d640 1 -- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd5f270 msgr2=0x563edd14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141d46d640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd5f270 0x563edd14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141d46d640 1 -- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 msgr2=0x563edd14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141d46d640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141d46d640 1 -- 172.21.15.80:0/2760307355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edcd772d0 con 0x563edcd363b0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f141d46d640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 0x563edd144ff0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1414009010 tx=0x7f14181640c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d6cc45b2a04931 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f13f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f13f7fff640 1 -- 172.21.15.80:0/2760307355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414031020 con 0x563edcd363b0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f13f7fff640 1 -- 172.21.15.80:0/2760307355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f141402d680 con 0x563edcd363b0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f141401c050 con 0x563edcd363b0 2024-04-25T15:46:33.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f13f7fff640 1 -- 172.21.15.80:0/2760307355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f141403b050 con 0x563edcd363b0 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f142657c740 10 client.7293 fetch_fsmap learned FSMap version 45 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x563edce416b0 con 0x563edcd363b0 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f13f7fff640 1 -- 172.21.15.80:0/2760307355 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141401c050 con 0x563edcd363b0 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.496+0000 7f13f7fff640 1 -- 172.21.15.80:0/2760307355 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7f141403e020 con 0x563edcd363b0 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f142657c740 10 client.7293 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f142657c740 10 client.7293 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f142657c740 20 client.7293 populate_metadata read hostname 'smithi080' 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f142657c740 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edcd1de40 0x563edd1635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f142657c740 4 client.7293 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 --> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563edd073350 con 0x563edcd1de40 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f141cc6c640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edcd1de40 0x563edd1635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f13f7fff640 10 client.7293 ms_handle_connect on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.497+0000 7f141cc6c640 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edcd1de40 0x563edd1635d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947e393603c58f78 server_cookie=c723b5c55659b6b3 in_seq=0 out_seq=0 2024-04-25T15:46:33.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f13f7fff640 1 -- 172.21.15.80:0/2760307355 <== mds.0 v2:172.21.15.80:6835/1832881946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563edd073350 con 0x563edcd1de40 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f13f7fff640 10 client.7293 handle_command_reply: tid=0 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 client.7293 shutdown 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 msgr2=0x563edd144ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 0x563edd144ff0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1414009010 tx=0x7f14181640c0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 shutdown_connections 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edcd1de40 0x563edd1635d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd5f270 0x563edd14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd3e590 0x563edd14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 --2- 172.21.15.80:0/2760307355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd363b0 0x563edd144ff0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f13f7fff640 0 client.7293 ms_handle_reset on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 >> 172.21.15.80:0/2760307355 conn(0x563edcd533c0 msgr2=0x563edd1009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 shutdown_connections 2024-04-25T15:46:33.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 1 -- 172.21.15.80:0/2760307355 wait complete. 2024-04-25T15:46:33.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.498+0000 7f142657c740 20 client.7293 trim_cache size 0 max 16384 2024-04-25T15:46:33.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.517+0000 7f142657c740 1 Processor -- start 2024-04-25T15:46:33.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.517+0000 7f142657c740 1 -- start start 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd363b0 0x563edd14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd3e590 0x563edd0fa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f142657c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd0fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f142657c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1418202550 con 0x563edcd5f270 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1418201950 con 0x563edcd363b0 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1418201f00 con 0x563edcd3e590 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd0fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd0fa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52232/0 (socket says 172.21.15.80:52232) 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 -- 172.21.15.80:0/4290704823 learned_addr learned my addr 172.21.15.80:0/4290704823 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141cc6c640 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd3e590 0x563edd0fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141d46d640 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd363b0 0x563edd14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 -- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd3e590 msgr2=0x563edd0fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd3e590 0x563edd0fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 -- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd363b0 msgr2=0x563edd14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd363b0 0x563edd14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141dc6e640 1 -- 172.21.15.80:0/4290704823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd0fc1b0 con 0x563edcd5f270 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.518+0000 7f141d46d640 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd363b0 0x563edd14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.519+0000 7f141dc6e640 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd0fa840 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1410009b50 tx=0x7f141002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee9493c8feb2d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.519+0000 7f14027fc640 1 -- 172.21.15.80:0/4290704823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410036040 con 0x563edcd5f270 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.519+0000 7f14027fc640 1 -- 172.21.15.80:0/4290704823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141003c620 con 0x563edcd5f270 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.519+0000 7f14027fc640 1 -- 172.21.15.80:0/4290704823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141003c9d0 con 0x563edcd5f270 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.519+0000 7f142657c740 1 -- 172.21.15.80:0/4290704823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 msgr2=0x563edd0fa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.519+0000 7f142657c740 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd0fa840 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1410009b50 tx=0x7f141002c000 comp rx=0 tx=0).stop 2024-04-25T15:46:33.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 -- 172.21.15.80:0/4290704823 shutdown_connections 2024-04-25T15:46:33.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd5f270 0x563edd0fa840 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd3e590 0x563edd0fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 --2- 172.21.15.80:0/4290704823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd363b0 0x563edd14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 -- 172.21.15.80:0/4290704823 >> 172.21.15.80:0/4290704823 conn(0x563edcd533c0 msgr2=0x563edd12b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 -- 172.21.15.80:0/4290704823 shutdown_connections 2024-04-25T15:46:33.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 -- 172.21.15.80:0/4290704823 wait complete. 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 -- start start 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.520+0000 7f142657c740 1 Processor -- start 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 0x563edd1c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 0x563edd12b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd5f270 0x563edd12bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563edd144990 con 0x563edcd3e590 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563edd14bee0 con 0x563edcd5f270 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x563edd12e870 con 0x563edcd363b0 2024-04-25T15:46:33.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f142657c740 10 client.0 _ll_register_callbacks cb 0x7f1414024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 0x563edd12b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 0x563edd12b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52246/0 (socket says 172.21.15.80:52246) 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 -- 172.21.15.80:0/390531586 learned_addr learned my addr 172.21.15.80:0/390531586 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 -- 172.21.15.80:0/390531586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 msgr2=0x563edd1c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 0x563edd1c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 -- 172.21.15.80:0/390531586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd5f270 msgr2=0x563edd12bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd5f270 0x563edd12bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 -- 172.21.15.80:0/390531586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edd14a220 con 0x563edcd3e590 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f141cc6c640 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 0x563edd12b600 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f140805b120 tx=0x7f140805b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fdf56dde03a2a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.522+0000 7f13f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f13f7fff640 1 -- 172.21.15.80:0/390531586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408063450 con 0x563edcd3e590 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f13f7fff640 1 -- 172.21.15.80:0/390531586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f14080630e0 con 0x563edcd3e590 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f141003c620 con 0x563edcd3e590 2024-04-25T15:46:33.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f13f7fff640 1 -- 172.21.15.80:0/390531586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f140807f050 con 0x563edcd3e590 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 10 client.7299 fetch_fsmap learned FSMap version 45 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x563edd15fb40 con 0x563edcd3e590 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f13f7fff640 1 -- 172.21.15.80:0/390531586 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141003c620 con 0x563edcd3e590 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f13f7fff640 1 -- 172.21.15.80:0/390531586 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7f140805b330 con 0x563edcd3e590 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 10 client.7299 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 10 client.7299 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 20 client.7299 populate_metadata read hostname 'smithi080' 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edd125030 0x563edd125440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 4 client.7299 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 --> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] -- command(tid 0: {"prefix": "status"}) -- 0x563edd06d1c0 con 0x563edd125030 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f141d46d640 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edd125030 0x563edd125440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.523+0000 7f13f7fff640 10 client.7299 ms_handle_connect on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f141d46d640 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edd125030 0x563edd125440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51b907724e4d1906 server_cookie=15475a89a9f4dfb9 in_seq=0 out_seq=0 2024-04-25T15:46:33.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f13f7fff640 1 -- 172.21.15.80:0/390531586 <== mds.0 v2:172.21.15.80:6835/1832881946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563edd06d1c0 con 0x563edd125030 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f13f7fff640 10 client.7299 handle_command_reply: tid=0 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 client.7299 shutdown 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 msgr2=0x563edd12b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 0x563edd12b600 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f140805b120 tx=0x7f140805b7a0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 shutdown_connections 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563edcd5f270 0x563edd12bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563edcd3e590 0x563edd12b600 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x563edd125030 0x563edd125440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 --2- 172.21.15.80:0/390531586 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x563edcd363b0 0x563edd1c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f13f7fff640 0 client.7299 ms_handle_reset on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 >> 172.21.15.80:0/390531586 conn(0x563edcd533c0 msgr2=0x563edd101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 shutdown_connections 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 1 -- 172.21.15.80:0/390531586 wait complete. 2024-04-25T15:46:33.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.524+0000 7f142657c740 20 client.7299 trim_cache size 0 max 16384 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7149, 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 5.7005408309999996, 2024-04-25T15:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 45, 2024-04-25T15:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 86, 2024-04-25T15:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 86, 2024-04-25T15:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 16.737214864999999 2024-04-25T15:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f13fc0744b0 msgr2=0x7f13fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f13fc0744b0 0x7f13fc0769c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1414001580 tx=0x7f1414009040 comp rx=0 tx=0).stop 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 msgr2=0x7f14180b88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 0x7f14180b88a0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f140800e510 tx=0x7f140800e9d0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 shutdown_connections 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f13fc0744b0 0x7f13fc0769c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141814e710 0x7f14180b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1418158420 0x7f14180b88a0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 --2- 172.21.15.80:0/3203301962 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1404004d90 0x7f14180cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 >> 172.21.15.80:0/3203301962 conn(0x7f14180d3ea0 msgr2=0x7f1418071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 shutdown_connections 2024-04-25T15:46:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.525+0000 7f141f6d1640 1 -- 172.21.15.80:0/3203301962 wait complete. 2024-04-25T15:46:33.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:46:33.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.643+0000 7f6895684640 1 Processor -- start 2024-04-25T15:46:33.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.643+0000 7f6895684640 1 -- start start 2024-04-25T15:46:33.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.644+0000 7f6895684640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900b48d0 0x7f68900b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.644+0000 7f6895684640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68900b7b90 0x7f68900d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.644+0000 7f6895684640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68900b7fa0 con 0x7f68900d41b0 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.644+0000 7f6895684640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6890163fb0 con 0x7f68900b7b90 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.644+0000 7f6895684640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6890164270 con 0x7f68900b48d0 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68900b7b90 0x7f68900d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68900b7b90 0x7f68900d49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52260/0 (socket says 172.21.15.80:52260) 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 -- 172.21.15.80:0/3016152329 learned_addr learned my addr 172.21.15.80:0/3016152329 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688e7fc640 1 --2- 172.21.15.80:0/3016152329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900b48d0 0x7f68900b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 -- 172.21.15.80:0/3016152329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900b48d0 msgr2=0x7f68900b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 --2- 172.21.15.80:0/3016152329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900b48d0 0x7f68900b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 -- 172.21.15.80:0/3016152329 >> v1:172.21.15.195:6789/0 conn(0x7f68900d41b0 legacy=0x7f68901602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688f7fe640 1 -- 172.21.15.80:0/3016152329 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6890164550 con 0x7f68900b7b90 2024-04-25T15:46:33.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.645+0000 7f688dffb640 1 -- 172.21.15.80:0/3016152329 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58231640 0 0) 0x7f6880001490 con 0x7f68900d41b0 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.646+0000 7f688f7fe640 1 --2- 172.21.15.80:0/3016152329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900d49c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6888009870 tx=0x7f688802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222818876424d25b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.646+0000 7f688dffb640 1 -- 172.21.15.80:0/3016152329 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888037070 con 0x7f68900b7b90 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.646+0000 7f688dffb640 1 -- 172.21.15.80:0/3016152329 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888032440 con 0x7f68900b7b90 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.646+0000 7f688dffb640 1 -- 172.21.15.80:0/3016152329 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888032810 con 0x7f68900b7b90 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 -- 172.21.15.80:0/3016152329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 msgr2=0x7f68900d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 --2- 172.21.15.80:0/3016152329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900d49c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6888009870 tx=0x7f688802a270 comp rx=0 tx=0).stop 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 -- 172.21.15.80:0/3016152329 shutdown_connections 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 --2- 172.21.15.80:0/3016152329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900d49c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 --2- 172.21.15.80:0/3016152329 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900b48d0 0x7f68900b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 -- 172.21.15.80:0/3016152329 >> 172.21.15.80:0/3016152329 conn(0x7f689006e9f0 msgr2=0x7f68900d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 -- 172.21.15.80:0/3016152329 shutdown_connections 2024-04-25T15:46:33.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.647+0000 7f6895684640 1 -- 172.21.15.80:0/3016152329 wait complete. 2024-04-25T15:46:33.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.649+0000 7f6895684640 1 Processor -- start 2024-04-25T15:46:33.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.649+0000 7f6895684640 1 -- start start 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f6895684640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68900b48d0 0x7f6890162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f6895684640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f6895684640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900d41b0 0x7f6890154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f6895684640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f68900b4fd0 con 0x7f68900b7b90 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f6895684640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6890164b10 con 0x7f68900b48d0 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f6895684640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f68900b5150 con 0x7f68900d41b0 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52266/0 (socket says 172.21.15.80:52266) 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 -- 172.21.15.80:0/2215529508 learned_addr learned my addr 172.21.15.80:0/2215529508 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688effd640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68900b48d0 0x7f6890162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688f7fe640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900d41b0 0x7f6890154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 -- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900d41b0 msgr2=0x7f6890154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900d41b0 0x7f6890154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 -- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68900b48d0 msgr2=0x7f6890162cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68900b48d0 0x7f6890162cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.650+0000 7f688e7fc640 1 -- 172.21.15.80:0/2215529508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68901627b0 con 0x7f68900b7b90 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.651+0000 7f688e7fc640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900c8360 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f688400e8a0 tx=0x7f688400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.651+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884017070 con 0x7f68900b7b90 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.651+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688400c940 con 0x7f68900b7b90 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.651+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68901535b0 con 0x7f68900b7b90 2024-04-25T15:46:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.651+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688400cd30 con 0x7f68900b7b90 2024-04-25T15:46:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.651+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68901f7070 con 0x7f68900b7b90 2024-04-25T15:46:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.652+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689006a100 con 0x7f68900b7b90 2024-04-25T15:46:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.653+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f688401a070 con 0x7f68900b7b90 2024-04-25T15:46:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.653+0000 7f68777fe640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f687c0744b0 0x7f687c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.653+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f68840955c0 con 0x7f68900b7b90 2024-04-25T15:46:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.653+0000 7f688effd640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f687c0744b0 0x7f687c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.653+0000 7f688effd640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f687c0744b0 0x7f687c0769c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f68800012e0 tx=0x7f6880009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.658+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f688405f570 con 0x7f68900b7b90 2024-04-25T15:46:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.873+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6890162540 con 0x7f68900b7b90 2024-04-25T15:46:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.874+0000 7f68777fe640 1 -- 172.21.15.80:0/2215529508 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) ==== 53+0+73 (secure 0 0 0) 0x7f6884063870 con 0x7f68900b7b90 2024-04-25T15:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:46:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.875+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f687c0744b0 msgr2=0x7f687c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.875+0000 7f6895684640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f687c0744b0 0x7f687c0769c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f68800012e0 tx=0x7f6880009040 comp rx=0 tx=0).stop 2024-04-25T15:46:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.875+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 msgr2=0x7f68900c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900c8360 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f688400e8a0 tx=0x7f688400eca0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 shutdown_connections 2024-04-25T15:46:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f687c0744b0 0x7f687c0769c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68900d41b0 0x7f6890154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68900b7b90 0x7f68900c8360 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 --2- 172.21.15.80:0/2215529508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68900b48d0 0x7f6890162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 >> 172.21.15.80:0/2215529508 conn(0x7f689006e9f0 msgr2=0x7f689015b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 shutdown_connections 2024-04-25T15:46:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:33.876+0000 7f6895684640 1 -- 172.21.15.80:0/2215529508 wait complete. 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:46:33.887 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:46:33.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:33.888 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42563sec preferred_lft 42563sec 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:33.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:33.906 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:46:33.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:33.968 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:46:33.981 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:34.011 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:46:34.023 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:46:34.023 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:46:34.023 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:46:34.024 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:46:34.024 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:46:34.024 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:46:34.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:46:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:46:34.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:34.173 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:46:34.188 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:46:34.188 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:46:34.188 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:46:34.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:34.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:46:34.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:46:34.252 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:34.307 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:46:34.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:46:34.308 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:34.362 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:46:34.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:34.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:34.455 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:34.455 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:46:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:46:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:46:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:46:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:46:34.466 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:46:34.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:34.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:34.489 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:46:34.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:46:34.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:46:34.589 INFO:teuthology.orchestra.run.smithi080.stdout:client6481 2024-04-25T15:46:34.589 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:34.589 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:34.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:46:34.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.752+0000 7f9d1d24a640 1 Processor -- start 2024-04-25T15:46:34.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.752+0000 7f9d1d24a640 1 -- start start 2024-04-25T15:46:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1d24a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d18071950 0x7f9d18072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1d24a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9d18161c80 0x7f9d180b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1d24a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d180b74c0 0x7f9d180d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1d24a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9d18072aa0 con 0x7f9d180b74c0 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1d24a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f9d181624d0 con 0x7f9d18161c80 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1d24a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d181627b0 con 0x7f9d18071950 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d180b74c0 0x7f9d180d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d180b74c0 0x7f9d180d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42954/0 (socket says 172.21.15.80:42954) 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 -- 172.21.15.80:0/1735952504 learned_addr learned my addr 172.21.15.80:0/1735952504 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1659c640 1 --2- 172.21.15.80:0/1735952504 >> v2:172.21.15.195:3300/0 conn(0x7f9d18161c80 0x7f9d180b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d16d9d640 1 --2- 172.21.15.80:0/1735952504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d18071950 0x7f9d18072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 -- 172.21.15.80:0/1735952504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d18071950 msgr2=0x7f9d18072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 --2- 172.21.15.80:0/1735952504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d18071950 0x7f9d18072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 -- 172.21.15.80:0/1735952504 >> v2:172.21.15.195:3300/0 conn(0x7f9d18161c80 msgr2=0x7f9d180b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.753+0000 7f9d1759e640 1 --2- 172.21.15.80:0/1735952504 >> v2:172.21.15.195:3300/0 conn(0x7f9d18161c80 0x7f9d180b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.754+0000 7f9d1759e640 1 -- 172.21.15.80:0/1735952504 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d18162a90 con 0x7f9d180b74c0 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.754+0000 7f9d1759e640 1 --2- 172.21.15.80:0/1735952504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d180b74c0 0x7f9d180d2a90 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9d181626e0 tx=0x7f9d1002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5725312038e534e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.754+0000 7f9d15d9b640 1 -- 172.21.15.80:0/1735952504 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10037070 con 0x7f9d180b74c0 2024-04-25T15:46:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.754+0000 7f9d15d9b640 1 -- 172.21.15.80:0/1735952504 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d10032440 con 0x7f9d180b74c0 2024-04-25T15:46:34.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.754+0000 7f9d15d9b640 1 -- 172.21.15.80:0/1735952504 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10032810 con 0x7f9d180b74c0 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 -- 172.21.15.80:0/1735952504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d180b74c0 msgr2=0x7f9d180d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/1735952504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d180b74c0 0x7f9d180d2a90 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9d181626e0 tx=0x7f9d1002a130 comp rx=0 tx=0).stop 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 -- 172.21.15.80:0/1735952504 shutdown_connections 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/1735952504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d180b74c0 0x7f9d180d2a90 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/1735952504 >> v2:172.21.15.195:3300/0 conn(0x7f9d18161c80 0x7f9d180b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/1735952504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d18071950 0x7f9d18072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 -- 172.21.15.80:0/1735952504 >> 172.21.15.80:0/1735952504 conn(0x7f9d180d3ea0 msgr2=0x7f9d180d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 -- 172.21.15.80:0/1735952504 shutdown_connections 2024-04-25T15:46:34.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.755+0000 7f9d1d24a640 1 -- 172.21.15.80:0/1735952504 wait complete. 2024-04-25T15:46:34.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.757+0000 7f9d1d24a640 1 Processor -- start 2024-04-25T15:46:34.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.757+0000 7f9d1d24a640 1 -- start start 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.758+0000 7f9d1d24a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 0x7f9d18148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.758+0000 7f9d1d24a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d180b74c0 0x7f9d18148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.758+0000 7f9d1d24a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d18161c80 0x7f9d181492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.758+0000 7f9d1d24a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18162210 con 0x7f9d18071950 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.758+0000 7f9d1d24a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18162090 con 0x7f9d18161c80 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.758+0000 7f9d1d24a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9d180d2fd0 con 0x7f9d180b74c0 2024-04-25T15:46:34.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 0x7f9d18148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 0x7f9d18148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42962/0 (socket says 172.21.15.80:42962) 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 -- 172.21.15.80:0/807617738 learned_addr learned my addr 172.21.15.80:0/807617738 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d1759e640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d18161c80 0x7f9d181492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d1659c640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d180b74c0 0x7f9d18148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 -- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d180b74c0 msgr2=0x7f9d18148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d180b74c0 0x7f9d18148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 -- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d18161c80 msgr2=0x7f9d181492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d18161c80 0x7f9d181492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 -- 172.21.15.80:0/807617738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d180cd0e0 con 0x7f9d18071950 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d16d9d640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 0x7f9d18148850 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f9d08007e60 tx=0x7f9d0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0801a070 con 0x7f9d18071950 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d08003990 con 0x7f9d18071950 2024-04-25T15:46:34.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d180cd3c0 con 0x7f9d18071950 2024-04-25T15:46:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08003d60 con 0x7f9d18071950 2024-04-25T15:46:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.759+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d18158c70 con 0x7f9d18071950 2024-04-25T15:46:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.760+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1806a100 con 0x7f9d18071950 2024-04-25T15:46:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.761+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9d0801d070 con 0x7f9d18071950 2024-04-25T15:46:34.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.761+0000 7f9cff7fe640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d040744e0 0x7f9d040769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.761+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f9d08095470 con 0x7f9d18071950 2024-04-25T15:46:34.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.761+0000 7f9d1659c640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d040744e0 0x7f9d040769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.762+0000 7f9d1659c640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d040744e0 0x7f9d040769f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9d181597a0 tx=0x7f9d0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.766+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d0805f420 con 0x7f9d18071950 2024-04-25T15:46:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.981+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d180d1e40 con 0x7f9d18071950 2024-04-25T15:46:34.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.981+0000 7f9cff7fe640 1 -- 172.21.15.80:0/807617738 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) ==== 53+0+73 (secure 0 0 0) 0x7f9d08063720 con 0x7f9d18071950 2024-04-25T15:46:34.981 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d040744e0 msgr2=0x7f9d040769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d040744e0 0x7f9d040769f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9d181597a0 tx=0x7f9d0c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 msgr2=0x7f9d18148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 0x7f9d18148850 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f9d08007e60 tx=0x7f9d0800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 shutdown_connections 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f9d040744e0 0x7f9d040769f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d18161c80 0x7f9d181492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9d180b74c0 0x7f9d18148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 --2- 172.21.15.80:0/807617738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d18071950 0x7f9d18148850 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 >> 172.21.15.80:0/807617738 conn(0x7f9d180d3ea0 msgr2=0x7f9d180b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 shutdown_connections 2024-04-25T15:46:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:34.983+0000 7f9d1d24a640 1 -- 172.21.15.80:0/807617738 wait complete. 2024-04-25T15:46:34.994 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:46:34.995 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:46:34.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:34.995 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:46:35.015 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:46:35.015 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:46:35.015 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:46:35.015 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.015 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:46:35.016 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42540sec preferred_lft 42540sec 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:46:35.017 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:46:35.018 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:46:35.018 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:46:35.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:35.018 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:46:35.082 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:46:35.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:35.084 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:46:35.141 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:46:35.142 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:46:35.142 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:46:35.142 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:46:35.142 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:46:35.142 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:46:35.143 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:46:35.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:46:35.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:46:35.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:46:35.143 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:46:35.233 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:46:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:46:35.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:46:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:46:35.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:35.270 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:46:35.285 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:46:35.285 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:46:35.286 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:46:35.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:35.286 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:46:35.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:46:35.349 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:35.405 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:46:35.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:46:35.405 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:35.460 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:46:35.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:35.460 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:35.551 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:35.551 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:46:35.559 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:46:35.559 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:46:35.559 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:46:35.559 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:46:35.560 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:46:35.560 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:46:35.560 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:46:35.560 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:46:35.560 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:46:35.560 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:46:35.561 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:46:35.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:35.562 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:35.591 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:46:35.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:46:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:46:35.680 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:46:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:46:35.686 INFO:teuthology.orchestra.run.smithi195.stdout:client6490 2024-04-25T15:46:35.686 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:35.686 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:35.702 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:35.702 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:35.719 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:35.719 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:35.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:35.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.930+0000 7f846fc51640 1 Processor -- start 2024-04-25T15:46:35.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.931+0000 7f846fc51640 1 -- start start 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846fc51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8468153f70 0x7f84680b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846fc51640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f84680b0c00 0x7f846806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846fc51640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846806df20 con 0x7f846806db10 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846fc51640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f84680b1180 con 0x7f84680b0c00 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846fc51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f846815d4f0 con 0x7f8468153f70 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846d9ed640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8468153f70 0x7f84680b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846d1ec640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f84680b0c00 0x7f846806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846e1ee640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f846806db10 0x7f8468160940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:52832/0 (socket says 172.21.15.80:52832) 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.932+0000 7f846e1ee640 1 -- 172.21.15.80:0/1904508276 learned_addr learned my addr 172.21.15.80:0/1904508276 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.933+0000 7f846d9ed640 1 -- 172.21.15.80:0/1904508276 >> v2:172.21.15.195:3300/0 conn(0x7f84680b0c00 msgr2=0x7f846806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.933+0000 7f846d9ed640 1 --2- 172.21.15.80:0/1904508276 >> v2:172.21.15.195:3300/0 conn(0x7f84680b0c00 0x7f846806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.933+0000 7f846d9ed640 1 -- 172.21.15.80:0/1904508276 >> v1:172.21.15.195:6789/0 conn(0x7f846806db10 legacy=0x7f8468160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.933+0000 7f846d9ed640 1 -- 172.21.15.80:0/1904508276 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846815e270 con 0x7f8468153f70 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.933+0000 7f846c9eb640 1 -- 172.21.15.80:0/1904508276 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636972263 0 0) 0x7f8460001490 con 0x7f846806db10 2024-04-25T15:46:35.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.933+0000 7f846d1ec640 1 --2- 172.21.15.80:0/1904508276 >> v2:172.21.15.195:3300/0 conn(0x7f84680b0c00 0x7f846806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:35.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846d9ed640 1 --2- 172.21.15.80:0/1904508276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8468153f70 0x7f84680b06c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84640097a0 tx=0x7f846402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3f21cf228e08ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846c9eb640 1 -- 172.21.15.80:0/1904508276 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464037070 con 0x7f8468153f70 2024-04-25T15:46:35.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846c9eb640 1 -- 172.21.15.80:0/1904508276 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8464032440 con 0x7f8468153f70 2024-04-25T15:46:35.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846c9eb640 1 -- 172.21.15.80:0/1904508276 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464032810 con 0x7f8468153f70 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 -- 172.21.15.80:0/1904508276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8468153f70 msgr2=0x7f84680b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 --2- 172.21.15.80:0/1904508276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8468153f70 0x7f84680b06c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84640097a0 tx=0x7f846402a180 comp rx=0 tx=0).stop 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 -- 172.21.15.80:0/1904508276 shutdown_connections 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 --2- 172.21.15.80:0/1904508276 >> v2:172.21.15.195:3300/0 conn(0x7f84680b0c00 0x7f846806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 --2- 172.21.15.80:0/1904508276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8468153f70 0x7f84680b06c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 -- 172.21.15.80:0/1904508276 >> 172.21.15.80:0/1904508276 conn(0x7f84680d1e20 msgr2=0x7f8468073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.934+0000 7f846fc51640 1 -- 172.21.15.80:0/1904508276 shutdown_connections 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.935+0000 7f846fc51640 1 -- 172.21.15.80:0/1904508276 wait complete. 2024-04-25T15:46:35.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.936+0000 7f846fc51640 1 Processor -- start 2024-04-25T15:46:35.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.936+0000 7f846fc51640 1 -- start start 2024-04-25T15:46:35.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.937+0000 7f846fc51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 0x7f8468146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.937+0000 7f846fc51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84680b0c00 0x7f84681544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.937+0000 7f846fc51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8468153f70 0x7f8468154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.937+0000 7f846fc51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f84680b5710 con 0x7f846806db10 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846fc51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f846815da70 con 0x7f8468153f70 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846fc51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f84680aefe0 con 0x7f84680b0c00 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 0x7f8468146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 0x7f8468146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42972/0 (socket says 172.21.15.80:42972) 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d1ec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84680b0c00 0x7f84681544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 -- 172.21.15.80:0/564214640 learned_addr learned my addr 172.21.15.80:0/564214640 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846e1ee640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8468153f70 0x7f8468154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 -- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84680b0c00 msgr2=0x7f84681544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84680b0c00 0x7f84681544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 -- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8468153f70 msgr2=0x7f8468154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8468153f70 0x7f8468154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 -- 172.21.15.80:0/564214640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8468155600 con 0x7f846806db10 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846d9ed640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 0x7f8468146250 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8464035040 tx=0x7f84640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464037050 con 0x7f846806db10 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8464038040 con 0x7f846806db10 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84681558a0 con 0x7f846806db10 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464004470 con 0x7f846806db10 2024-04-25T15:46:35.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.938+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8468155e60 con 0x7f846806db10 2024-04-25T15:46:35.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.940+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846806a100 con 0x7f846806db10 2024-04-25T15:46:35.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.940+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f846403c6d0 con 0x7f846806db10 2024-04-25T15:46:35.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.940+0000 7f845e7fc640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f844c0744b0 0x7f844c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.940+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f84640b5d80 con 0x7f846806db10 2024-04-25T15:46:35.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.940+0000 7f846d1ec640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f844c0744b0 0x7f844c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.941+0000 7f846d1ec640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f844c0744b0 0x7f844c0769c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f84681f7b50 tx=0x7f8458009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:35.945+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f846407fcb0 con 0x7f846806db10 2024-04-25T15:46:36.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.121+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8468070570 con 0x7f846806db10 2024-04-25T15:46:36.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.122+0000 7f845e7fc640 1 -- 172.21.15.80:0/564214640 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16873 (secure 0 0 0) 0x7f8464088380 con 0x7f846806db10 2024-04-25T15:46:36.122 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:36.123 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":86,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:28.822992+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f844c0744b0 msgr2=0x7f844c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f844c0744b0 0x7f844c0769c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f84681f7b50 tx=0x7f8458009190 comp rx=0 tx=0).stop 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 msgr2=0x7f8468146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 0x7f8468146250 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8464035040 tx=0x7f84640046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 shutdown_connections 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f844c0744b0 0x7f844c0769c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8468153f70 0x7f8468154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84680b0c00 0x7f84681544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 --2- 172.21.15.80:0/564214640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f846806db10 0x7f8468146250 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 >> 172.21.15.80:0/564214640 conn(0x7f84680d1e20 msgr2=0x7f8468073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 shutdown_connections 2024-04-25T15:46:36.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.124+0000 7f846fc51640 1 -- 172.21.15.80:0/564214640 wait complete. 2024-04-25T15:46:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:25.438986+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:26.129465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:36.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.246+0000 7f783c500640 1 Processor -- start 2024-04-25T15:46:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.246+0000 7f783c500640 1 -- start start 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.247+0000 7f783c500640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f78341615a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.247+0000 7f783c500640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7834162450 con 0x7f78340d2fe0 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.247+0000 7f783c500640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7834162730 con 0x7f7834161c90 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.247+0000 7f783c500640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f783406c5c0 con 0x7f783409bf80 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783aa9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f78340d2fe0 0x7f783406cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60872/0 (socket says 172.21.15.80:60872) 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783aa9d640 1 -- 172.21.15.80:0/2948829025 learned_addr learned my addr 172.21.15.80:0/2948829025 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783a29c640 1 --2- 172.21.15.80:0/2948829025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f78341615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687753742 0 0) 0x7f7834162450 con 0x7f78340d2fe0 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7820003520 con 0x7f78340d2fe0 2024-04-25T15:46:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121355167 0 0) 0x7f7834162730 con 0x7f7834161c90 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7834162450 con 0x7f7834161c90 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783a29c640 1 -- 172.21.15.80:0/2948829025 >> v1:172.21.15.195:6789/0 conn(0x7f7834161c90 legacy=0x7f78340d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783a29c640 1 -- 172.21.15.80:0/2948829025 >> v1:172.21.15.80:6789/0 conn(0x7f78340d2fe0 legacy=0x7f783406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.248+0000 7f783a29c640 1 -- 172.21.15.80:0/2948829025 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7834162a10 con 0x7f783409bf80 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.249+0000 7f783a29c640 1 --2- 172.21.15.80:0/2948829025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f78341615a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f782c0097d0 tx=0x7f782c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541db973867f12c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.249+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c037070 con 0x7f783409bf80 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.249+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c032440 con 0x7f783409bf80 2024-04-25T15:46:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.249+0000 7f783929a640 1 -- 172.21.15.80:0/2948829025 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c032810 con 0x7f783409bf80 2024-04-25T15:46:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 -- 172.21.15.80:0/2948829025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 msgr2=0x7f78341615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 --2- 172.21.15.80:0/2948829025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f78341615a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f782c0097d0 tx=0x7f782c02a180 comp rx=0 tx=0).stop 2024-04-25T15:46:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 -- 172.21.15.80:0/2948829025 shutdown_connections 2024-04-25T15:46:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 --2- 172.21.15.80:0/2948829025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f78341615a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 -- 172.21.15.80:0/2948829025 >> 172.21.15.80:0/2948829025 conn(0x7f78340b7640 msgr2=0x7f78340b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 -- 172.21.15.80:0/2948829025 shutdown_connections 2024-04-25T15:46:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.250+0000 7f783c500640 1 -- 172.21.15.80:0/2948829025 wait complete. 2024-04-25T15:46:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.251+0000 7f783c500640 1 Processor -- start 2024-04-25T15:46:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.252+0000 7f783c500640 1 -- start start 2024-04-25T15:46:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783c500640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f7834156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783c500640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7834161c90 0x7f78340cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783c500640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 0x7f78340cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783c500640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f78341620a0 con 0x7f78340cc5b0 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783c500640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f783406d440 con 0x7f7834161c90 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783c500640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f78340c9490 con 0x7f783409bf80 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 0x7f78340cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 0x7f78340cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42976/0 (socket says 172.21.15.80:42976) 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 -- 172.21.15.80:0/523886019 learned_addr learned my addr 172.21.15.80:0/523886019 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783a29c640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f7834156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f7839a9b640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7834161c90 0x7f78340cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 -- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 msgr2=0x7f7834156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f7834156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 -- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7834161c90 msgr2=0x7f78340cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7834161c90 0x7f78340cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 -- 172.21.15.80:0/523886019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78340c86d0 con 0x7f78340cc5b0 2024-04-25T15:46:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783a29c640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f7834156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f7839a9b640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7834161c90 0x7f78340cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.253+0000 7f783aa9d640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 0x7f78340cbe70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f783000ca70 tx=0x7f783000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.254+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830017070 con 0x7f78340cc5b0 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.254+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783000abd0 con 0x7f78340cc5b0 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.254+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830012400 con 0x7f78340cc5b0 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.254+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78340c89b0 con 0x7f78340cc5b0 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.254+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7834158800 con 0x7f78340cc5b0 2024-04-25T15:46:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.255+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7834158a60 con 0x7f78340cc5b0 2024-04-25T15:46:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.255+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f783001a070 con 0x7f78340cc5b0 2024-04-25T15:46:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.256+0000 7f782affd640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f78180744e0 0x7f78180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.256+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f7830094f60 con 0x7f78340cc5b0 2024-04-25T15:46:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.256+0000 7f783a29c640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f78180744e0 0x7f78180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.256+0000 7f783a29c640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f78180744e0 0x7f78180769f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f782c034000 tx=0x7f782c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.260+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f783005efa0 con 0x7f78340cc5b0 2024-04-25T15:46:36.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.434+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f783406a100 con 0x7f78340cc5b0 2024-04-25T15:46:36.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.434+0000 7f782affd640 1 -- 172.21.15.80:0/523886019 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f78300632a0 con 0x7f78340cc5b0 2024-04-25T15:46:36.434 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f78180744e0 msgr2=0x7f78180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f78180744e0 0x7f78180769f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f782c034000 tx=0x7f782c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 msgr2=0x7f78340cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 0x7f78340cbe70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f783000ca70 tx=0x7f783000cf30 comp rx=0 tx=0).stop 2024-04-25T15:46:36.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 shutdown_connections 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f78180744e0 0x7f78180769f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78340cc5b0 0x7f78340cbe70 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7834161c90 0x7f78340cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 --2- 172.21.15.80:0/523886019 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f783409bf80 0x7f7834156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 >> 172.21.15.80:0/523886019 conn(0x7f78340b7640 msgr2=0x7f78340d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 shutdown_connections 2024-04-25T15:46:36.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.436+0000 7f783c500640 1 -- 172.21.15.80:0/523886019 wait complete. 2024-04-25T15:46:36.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:36.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.557+0000 7f26445b7640 1 Processor -- start 2024-04-25T15:46:36.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.557+0000 7f26445b7640 1 -- start start 2024-04-25T15:46:36.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f26445b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f263c0d2d50 0x7f263c16b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f26445b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263c0d57e0 con 0x7f263c0b5490 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f26445b7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263c1643f0 con 0x7f263c0d0b00 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f26445b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f263c1646d0 con 0x7f263c0d2d50 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f2642b54640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f263c0d2d50 0x7f263c16b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f2642353640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f263c0b5490 0x7f263c160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60874/0 (socket says 172.21.15.80:60874) 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.558+0000 7f2642353640 1 -- 172.21.15.80:0/4223731587 learned_addr learned my addr 172.21.15.80:0/4223731587 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2642b54640 1 -- 172.21.15.80:0/4223731587 >> v1:172.21.15.195:6789/0 conn(0x7f263c0d0b00 legacy=0x7f263c0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2642b54640 1 -- 172.21.15.80:0/4223731587 >> v1:172.21.15.80:6789/0 conn(0x7f263c0b5490 legacy=0x7f263c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2642b54640 1 -- 172.21.15.80:0/4223731587 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c1649b0 con 0x7f263c0d2d50 2024-04-25T15:46:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2642b54640 1 --2- 172.21.15.80:0/4223731587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d2d50 0x7f263c16b2b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f26340097a0 tx=0x7f263402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d099e7550de4de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2641351640 1 -- 172.21.15.80:0/4223731587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634037070 con 0x7f263c0d2d50 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2641351640 1 -- 172.21.15.80:0/4223731587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634032440 con 0x7f263c0d2d50 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.559+0000 7f2641351640 1 -- 172.21.15.80:0/4223731587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634032810 con 0x7f263c0d2d50 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 -- 172.21.15.80:0/4223731587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d2d50 msgr2=0x7f263c16b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 --2- 172.21.15.80:0/4223731587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d2d50 0x7f263c16b2b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f26340097a0 tx=0x7f263402a230 comp rx=0 tx=0).stop 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 -- 172.21.15.80:0/4223731587 shutdown_connections 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 --2- 172.21.15.80:0/4223731587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d2d50 0x7f263c16b2b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 -- 172.21.15.80:0/4223731587 >> 172.21.15.80:0/4223731587 conn(0x7f263c06e650 msgr2=0x7f263c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 -- 172.21.15.80:0/4223731587 shutdown_connections 2024-04-25T15:46:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.560+0000 7f26445b7640 1 -- 172.21.15.80:0/4223731587 wait complete. 2024-04-25T15:46:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.562+0000 7f26445b7640 1 Processor -- start 2024-04-25T15:46:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.562+0000 7f26445b7640 1 -- start start 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f26445b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 0x7f263c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f26445b7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f263c0d2d50 0x7f263c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f26445b7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f263c0b77c0 0x7f263c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f26445b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f263c0b94e0 con 0x7f263c0d0b00 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f26445b7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f263c0b9360 con 0x7f263c0b77c0 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f26445b7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f263c163f80 con 0x7f263c0d2d50 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f2642353640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 0x7f263c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f2642353640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 0x7f263c15e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43008/0 (socket says 172.21.15.80:43008) 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.563+0000 7f2642353640 1 -- 172.21.15.80:0/3517691452 learned_addr learned my addr 172.21.15.80:0/3517691452 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2641b52640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f263c0d2d50 0x7f263c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642b54640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f263c0b77c0 0x7f263c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642353640 1 -- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f263c0d2d50 msgr2=0x7f263c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642353640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f263c0d2d50 0x7f263c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642353640 1 -- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f263c0b77c0 msgr2=0x7f263c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642353640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f263c0b77c0 0x7f263c1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642353640 1 -- 172.21.15.80:0/3517691452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c154880 con 0x7f263c0d0b00 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2642353640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 0x7f263c15e270 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f263800cb10 tx=0x7f263800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638017070 con 0x7f263c0d0b00 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263800ac70 con 0x7f263c0d0b00 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638012600 con 0x7f263c0d0b00 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c15ea30 con 0x7f263c0d0b00 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.564+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c0b62b0 con 0x7f263c0d0b00 2024-04-25T15:46:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.565+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c06a100 con 0x7f263c0d0b00 2024-04-25T15:46:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.566+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f263801a070 con 0x7f263c0d0b00 2024-04-25T15:46:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.566+0000 7f2632ffd640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26200744b0 0x7f26200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.566+0000 7f2641b52640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26200744b0 0x7f26200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.566+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f2638094f90 con 0x7f263c0d0b00 2024-04-25T15:46:36.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.567+0000 7f2641b52640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26200744b0 0x7f26200769c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f262c007fd0 tx=0x7f262c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.571+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f263c154880 con 0x7f263c0d0b00 2024-04-25T15:46:36.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.744+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f263c0d41d0 con 0x7f263c0d0b00 2024-04-25T15:46:36.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.744+0000 7f2632ffd640 1 -- 172.21.15.80:0/3517691452 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f263800ae20 con 0x7f263c0d0b00 2024-04-25T15:46:36.744 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:46:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26200744b0 msgr2=0x7f26200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26200744b0 0x7f26200769c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f262c007fd0 tx=0x7f262c009040 comp rx=0 tx=0).stop 2024-04-25T15:46:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 msgr2=0x7f263c15e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 0x7f263c15e270 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f263800cb10 tx=0x7f263800a060 comp rx=0 tx=0).stop 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 shutdown_connections 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26200744b0 0x7f26200769c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f263c0b77c0 0x7f263c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f263c0d2d50 0x7f263c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 --2- 172.21.15.80:0/3517691452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f263c0d0b00 0x7f263c15e270 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 >> 172.21.15.80:0/3517691452 conn(0x7f263c06e650 msgr2=0x7f263c0b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 shutdown_connections 2024-04-25T15:46:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.746+0000 7f26445b7640 1 -- 172.21.15.80:0/3517691452 wait complete. 2024-04-25T15:46:36.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:36.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.868+0000 7f5af6492640 1 Processor -- start 2024-04-25T15:46:36.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.869+0000 7f5af6492640 1 -- start start 2024-04-25T15:46:36.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af6492640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5af00cf930 0x7f5af0160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af6492640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af0071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af6492640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00ce890 con 0x7f5af00d1600 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af6492640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5af00cf4a0 con 0x7f5af00cf930 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af6492640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00cfd40 con 0x7f5af00718d0 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5af00cf930 0x7f5af0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5af00cf930 0x7f5af0160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43018/0 (socket says 172.21.15.80:43018) 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 -- 172.21.15.80:0/2594015867 learned_addr learned my addr 172.21.15.80:0/2594015867 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af4a2f640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af0071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 -- 172.21.15.80:0/2594015867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 msgr2=0x7f5af0071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af0071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 -- 172.21.15.80:0/2594015867 >> v1:172.21.15.195:6789/0 conn(0x7f5af00d1600 legacy=0x7f5af00d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5aeffff640 1 -- 172.21.15.80:0/2594015867 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00ceb70 con 0x7f5af00cf930 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.870+0000 7f5af4a2f640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af0071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.871+0000 7f5aeffff640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0160120 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7d1b5e0b2db1e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.871+0000 7f5aeeffd640 1 -- 172.21.15.80:0/2594015867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0037070 con 0x7f5af00cf930 2024-04-25T15:46:36.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.871+0000 7f5aeeffd640 1 -- 172.21.15.80:0/2594015867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0032440 con 0x7f5af00cf930 2024-04-25T15:46:36.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.871+0000 7f5aeeffd640 1 -- 172.21.15.80:0/2594015867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0032810 con 0x7f5af00cf930 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 -- 172.21.15.80:0/2594015867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 msgr2=0x7f5af0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0160120 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae002a210 comp rx=0 tx=0).stop 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 -- 172.21.15.80:0/2594015867 shutdown_connections 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af0071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 --2- 172.21.15.80:0/2594015867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0160120 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 -- 172.21.15.80:0/2594015867 >> 172.21.15.80:0/2594015867 conn(0x7f5af00d3a30 msgr2=0x7f5af00d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 -- 172.21.15.80:0/2594015867 shutdown_connections 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.872+0000 7f5af6492640 1 -- 172.21.15.80:0/2594015867 wait complete. 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.874+0000 7f5af6492640 1 Processor -- start 2024-04-25T15:46:36.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.874+0000 7f5af6492640 1 -- start start 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af6492640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af01586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af6492640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af6492640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d1600 0x7f5af0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af6492640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0160660 con 0x7f5af00cf930 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af6492640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00cf130 con 0x7f5af00d1600 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af6492640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5af0072220 con 0x7f5af00718d0 2024-04-25T15:46:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43020/0 (socket says 172.21.15.80:43020) 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5aef7fe640 1 -- 172.21.15.80:0/3070754582 learned_addr learned my addr 172.21.15.80:0/3070754582 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5aeffff640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af01586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.875+0000 7f5af4a2f640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d1600 0x7f5af0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aef7fe640 1 -- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 msgr2=0x7f5af01586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aef7fe640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af01586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aef7fe640 1 -- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d1600 msgr2=0x7f5af0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aef7fe640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d1600 0x7f5af0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aef7fe640 1 -- 172.21.15.80:0/3070754582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af015ad10 con 0x7f5af00cf930 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5af4a2f640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d1600 0x7f5af0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aeffff640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af01586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aef7fe640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0157ce0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b420 tx=0x7f5ae400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5af00cf930 2024-04-25T15:46:36.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae4016070 con 0x7f5af00cf930 2024-04-25T15:46:36.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011c10 con 0x7f5af00cf930 2024-04-25T15:46:36.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af00b22c0 con 0x7f5af00cf930 2024-04-25T15:46:36.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.876+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af015aff0 con 0x7f5af00cf930 2024-04-25T15:46:36.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.877+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af006a100 con 0x7f5af00cf930 2024-04-25T15:46:36.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.878+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5ae401b460 con 0x7f5af00cf930 2024-04-25T15:46:36.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.878+0000 7f5aecff9640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5adc0744b0 0x7f5adc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:36.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.878+0000 7f5aeffff640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5adc0744b0 0x7f5adc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:36.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.878+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f5ae4094eb0 con 0x7f5af00cf930 2024-04-25T15:46:36.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.879+0000 7f5aeffff640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5adc0744b0 0x7f5adc0769c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0034000 tx=0x7f5ae002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:36.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:36.883+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ae4020020 con 0x7f5af00cf930 2024-04-25T15:46:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.056+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5af00b99b0 con 0x7f5af00cf930 2024-04-25T15:46:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.057+0000 7f5aecff9640 1 -- 172.21.15.80:0/3070754582 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f5ae405f4b0 con 0x7f5af00cf930 2024-04-25T15:46:37.059 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5adc0744b0 msgr2=0x7f5adc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5adc0744b0 0x7f5adc0769c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0034000 tx=0x7f5ae002e000 comp rx=0 tx=0).stop 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 msgr2=0x7f5af0157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0157ce0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b420 tx=0x7f5ae400b8e0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 shutdown_connections 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5adc0744b0 0x7f5adc0769c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5af00d1600 0x7f5af0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5af00cf930 0x7f5af0157ce0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 --2- 172.21.15.80:0/3070754582 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5af00718d0 0x7f5af01586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 >> 172.21.15.80:0/3070754582 conn(0x7f5af00d3a30 msgr2=0x7f5af015dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 shutdown_connections 2024-04-25T15:46:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.059+0000 7f5af6492640 1 -- 172.21.15.80:0/3070754582 wait complete. 2024-04-25T15:46:37.070 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:46:37.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.179+0000 7f9757fff640 1 Processor -- start 2024-04-25T15:46:37.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.179+0000 7f9757fff640 1 -- start start 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9757fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97580b4aa0 0x7f97580b9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9757fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97580d2a40 0x7f975815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9757fff640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975806ed40 con 0x7f975806e930 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9757fff640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f97580d07b0 con 0x7f97580b4aa0 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9757fff640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f97580d0a90 con 0x7f97580d2a40 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97580b4aa0 0x7f97580b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97580b4aa0 0x7f97580b9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43026/0 (socket says 172.21.15.80:43026) 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 -- 172.21.15.80:0/1802387815 learned_addr learned my addr 172.21.15.80:0/1802387815 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 -- 172.21.15.80:0/1802387815 >> v2:172.21.15.195:3300/0 conn(0x7f97580d2a40 msgr2=0x7f975815ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f97577fe640 1 --2- 172.21.15.80:0/1802387815 >> v2:172.21.15.195:3300/0 conn(0x7f97580d2a40 0x7f975815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 --2- 172.21.15.80:0/1802387815 >> v2:172.21.15.195:3300/0 conn(0x7f97580d2a40 0x7f975815ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 -- 172.21.15.80:0/1802387815 >> v1:172.21.15.80:6789/0 conn(0x7f975806e930 legacy=0x7f97580d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9755ffb640 1 -- 172.21.15.80:0/1802387815 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271226889 0 0) 0x7f974c001110 con 0x7f975806e930 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f9756ffd640 1 -- 172.21.15.80:0/1802387815 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97580d0d70 con 0x7f97580b4aa0 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.181+0000 7f97577fe640 1 --2- 172.21.15.80:0/1802387815 >> v2:172.21.15.195:3300/0 conn(0x7f97580d2a40 0x7f975815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.182+0000 7f9756ffd640 1 --2- 172.21.15.80:0/1802387815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f97580b9020 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f97580b9590 tx=0x7f974802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7130b904a91c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.182+0000 7f9755ffb640 1 -- 172.21.15.80:0/1802387815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748036070 con 0x7f97580b4aa0 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.182+0000 7f9755ffb640 1 -- 172.21.15.80:0/1802387815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9748031600 con 0x7f97580b4aa0 2024-04-25T15:46:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.182+0000 7f9755ffb640 1 -- 172.21.15.80:0/1802387815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97480319d0 con 0x7f97580b4aa0 2024-04-25T15:46:37.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 -- 172.21.15.80:0/1802387815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 msgr2=0x7f97580b9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 --2- 172.21.15.80:0/1802387815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f97580b9020 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f97580b9590 tx=0x7f974802a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 -- 172.21.15.80:0/1802387815 shutdown_connections 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 --2- 172.21.15.80:0/1802387815 >> v2:172.21.15.195:3300/0 conn(0x7f97580d2a40 0x7f975815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 --2- 172.21.15.80:0/1802387815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f97580b9020 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 -- 172.21.15.80:0/1802387815 >> 172.21.15.80:0/1802387815 conn(0x7f97580b7750 msgr2=0x7f97580b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 -- 172.21.15.80:0/1802387815 shutdown_connections 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.183+0000 7f9757fff640 1 -- 172.21.15.80:0/1802387815 wait complete. 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.185+0000 7f9757fff640 1 Processor -- start 2024-04-25T15:46:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.185+0000 7f9757fff640 1 -- start start 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9757fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f975806e930 0x7f97581500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9757fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f975815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9757fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97580d2a40 0x7f975815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9757fff640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f97580b5280 con 0x7f97580b4aa0 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9757fff640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f97580d1330 con 0x7f97580d2a40 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9757fff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9758163c10 con 0x7f975806e930 2024-04-25T15:46:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f97567fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f975815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f97567fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f975815ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43030/0 (socket says 172.21.15.80:43030) 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f97567fc640 1 -- 172.21.15.80:0/1193775553 learned_addr learned my addr 172.21.15.80:0/1193775553 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f97567fc640 1 -- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f975806e930 msgr2=0x7f97581500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f9756ffd640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f975806e930 0x7f97581500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f97577fe640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97580d2a40 0x7f975815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.186+0000 7f97567fc640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f975806e930 0x7f97581500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f97567fc640 1 -- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97580d2a40 msgr2=0x7f975815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f97567fc640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97580d2a40 0x7f975815d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f97567fc640 1 -- 172.21.15.80:0/1193775553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975815b870 con 0x7f97580b4aa0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f97567fc640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f975815ab40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f974c00c3f0 tx=0x7f974c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c017070 con 0x7f97580b4aa0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c0035f0 con 0x7f97580b4aa0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c0039e0 con 0x7f97580b4aa0 2024-04-25T15:46:37.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975815bb50 con 0x7f97580b4aa0 2024-04-25T15:46:37.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.187+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975815c110 con 0x7f97580b4aa0 2024-04-25T15:46:37.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.188+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9758074820 con 0x7f97580b4aa0 2024-04-25T15:46:37.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.189+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f974c01a070 con 0x7f97580b4aa0 2024-04-25T15:46:37.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.189+0000 7f973f7fe640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f97440744b0 0x7f97440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.189+0000 7f9756ffd640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f97440744b0 0x7f97440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.189+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f974c0947b0 con 0x7f97580b4aa0 2024-04-25T15:46:37.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.190+0000 7f9756ffd640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f97440744b0 0x7f97440769c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9748033000 tx=0x7f9748009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.194+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9758074820 con 0x7f97580b4aa0 2024-04-25T15:46:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.381+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f975815b600 con 0x7f97580b4aa0 2024-04-25T15:46:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.381+0000 7f973f7fe640 1 -- 172.21.15.80:0/1193775553 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7f975806ed40 con 0x7f97580b4aa0 2024-04-25T15:46:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:46:37.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f97440744b0 msgr2=0x7f97440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f97440744b0 0x7f97440769c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9748033000 tx=0x7f9748009000 comp rx=0 tx=0).stop 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 msgr2=0x7f975815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f975815ab40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f974c00c3f0 tx=0x7f974c00c8b0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 shutdown_connections 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f97440744b0 0x7f97440769c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97580d2a40 0x7f975815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97580b4aa0 0x7f975815ab40 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 --2- 172.21.15.80:0/1193775553 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f975806e930 0x7f97581500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 >> 172.21.15.80:0/1193775553 conn(0x7f97580b7750 msgr2=0x7f97580b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 shutdown_connections 2024-04-25T15:46:37.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.383+0000 7f9757fff640 1 -- 172.21.15.80:0/1193775553 wait complete. 2024-04-25T15:46:37.394 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:46:37.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:37.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:46:37.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:46:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:37.421 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:46:37.477 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:37.477 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:37.496 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:37.496 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:37.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.661+0000 7f80900f9640 1 Processor -- start 2024-04-25T15:46:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.662+0000 7f80900f9640 1 -- start start 2024-04-25T15:46:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f80900f9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 0x7f80880b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f80900f9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80880b1180 con 0x7f808806dce0 2024-04-25T15:46:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f80900f9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808815d4f0 con 0x7f80880b0c00 2024-04-25T15:46:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f80900f9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f808815e270 con 0x7f8088153f70 2024-04-25T15:46:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f808e696640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f808806dce0 0x7f80880b4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60890/0 (socket says 172.21.15.80:60890) 2024-04-25T15:46:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f808e696640 1 -- 172.21.15.80:0/1158528899 learned_addr learned my addr 172.21.15.80:0/1158528899 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:37.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598752118 0 0) 0x7f80880b1180 con 0x7f808806dce0 2024-04-25T15:46:37.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f808de95640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 0x7f80880b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.663+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8074003520 con 0x7f808806dce0 2024-04-25T15:46:37.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3892293410 0 0) 0x7f8074003520 con 0x7f808806dce0 2024-04-25T15:46:37.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 msgr2=0x7f80880b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 0x7f80880b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 >> v1:172.21.15.195:6789/0 conn(0x7f80880b0c00 legacy=0x7f808806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808815d790 con 0x7f808806dce0 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f80800019f0 con 0x7f808806dce0 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 >> v1:172.21.15.80:6789/0 conn(0x7f808806dce0 legacy=0x7f80880b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f8074003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8074004800 0x7f8074004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 0x7f8074005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f808815e270 con 0x7f80740039e0 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f807400baf0 con 0x7f8074004800 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f807400bcf0 con 0x7f8088153f70 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808de95640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f8074003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808d694640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8074004800 0x7f8074004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808e696640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 0x7f8074005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808de95640 1 -- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 msgr2=0x7f8074005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808de95640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8088153f70 0x7f8074005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808de95640 1 -- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8074004800 msgr2=0x7f8074004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808de95640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8074004800 0x7f8074004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.664+0000 7f808de95640 1 -- 172.21.15.80:0/1158528899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8074003520 con 0x7f80740039e0 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.665+0000 7f808de95640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f8074003e50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8084009a90 tx=0x7f8074005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603d2b021eb21f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.665+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084036070 con 0x7f80740039e0 2024-04-25T15:46:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.665+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8084031400 con 0x7f80740039e0 2024-04-25T15:46:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.665+0000 7f808ce93640 1 -- 172.21.15.80:0/1158528899 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084009690 con 0x7f80740039e0 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f80900f9640 1 -- 172.21.15.80:0/1158528899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 msgr2=0x7f8074003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f80900f9640 1 --2- 172.21.15.80:0/1158528899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f8074003e50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8084009a90 tx=0x7f8074005830 comp rx=0 tx=0).stop 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f808e696640 1 -- 172.21.15.80:0/1158528899 reap_dead start 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f80900f9640 1 -- 172.21.15.80:0/1158528899 shutdown_connections 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f80900f9640 1 -- 172.21.15.80:0/1158528899 >> 172.21.15.80:0/1158528899 conn(0x7f80880d1e20 msgr2=0x7f8088073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f80900f9640 1 -- 172.21.15.80:0/1158528899 shutdown_connections 2024-04-25T15:46:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.666+0000 7f80900f9640 1 -- 172.21.15.80:0/1158528899 wait complete. 2024-04-25T15:46:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.667+0000 7f80900f9640 1 Processor -- start 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.667+0000 7f80900f9640 1 -- start start 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f80900f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f808813e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f80900f9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f808809e1e0 0x7f808809b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f80900f9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f808815e4a0 0x7f808815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f80900f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80880af160 con 0x7f80740039e0 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f80900f9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f80880aefe0 con 0x7f808815e4a0 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f80900f9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f80880b06c0 con 0x7f808809e1e0 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f808813e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f808813e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43056/0 (socket says 172.21.15.80:43056) 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 -- 172.21.15.80:0/3103326233 learned_addr learned my addr 172.21.15.80:0/3103326233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808e696640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f808815e4a0 0x7f808815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808d694640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f808809e1e0 0x7f808809b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 -- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f808809e1e0 msgr2=0x7f808809b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f808809e1e0 0x7f808809b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 -- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f808815e4a0 msgr2=0x7f808815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f808815e4a0 0x7f808815e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 -- 172.21.15.80:0/3103326233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808815edf0 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f808de95640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f808813e340 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8084034040 tx=0x7f8084004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084040020 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8084003bc0 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.669+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084036040 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.670+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808809e780 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.670+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808809ed40 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.670+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f808806a100 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.671+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8084043020 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.671+0000 7f807e7fc640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f806c0744b0 0x7f806c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.672+0000 7f808d694640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f806c0744b0 0x7f806c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.672+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f80840b5830 con 0x7f80740039e0 2024-04-25T15:46:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.672+0000 7f808d694640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f806c0744b0 0x7f806c0769c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8078007fd0 tx=0x7f8078009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.676+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f808404a030 con 0x7f80740039e0 2024-04-25T15:46:37.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.850+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f808814d6c0 con 0x7f80740039e0 2024-04-25T15:46:37.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.851+0000 7f807e7fc640 1 -- 172.21.15.80:0/3103326233 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16873 (secure 0 0 0) 0x7f808815edf0 con 0x7f80740039e0 2024-04-25T15:46:37.852 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:37.852 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":86,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:28.822992+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f806c0744b0 msgr2=0x7f806c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f806c0744b0 0x7f806c0769c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8078007fd0 tx=0x7f8078009040 comp rx=0 tx=0).stop 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 msgr2=0x7f808813e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f808813e340 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8084034040 tx=0x7f8084004730 comp rx=0 tx=0).stop 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 shutdown_connections 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f806c0744b0 0x7f806c0769c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f808815e4a0 0x7f808815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f808809e1e0 0x7f808809b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 --2- 172.21.15.80:0/3103326233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80740039e0 0x7f808813e340 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 >> 172.21.15.80:0/3103326233 conn(0x7f80880d1e20 msgr2=0x7f8088073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 shutdown_connections 2024-04-25T15:46:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.853+0000 7f80900f9640 1 -- 172.21.15.80:0/3103326233 wait complete. 2024-04-25T15:46:37.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:25.438986+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:26.129465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:37.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.976+0000 7fcaaa2f2640 1 Processor -- start 2024-04-25T15:46:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.976+0000 7fcaaa2f2640 1 -- start start 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaaa2f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa40727c0 0x7fcaa40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaaa2f2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcaa40718d0 0x7fcaa40d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaaa2f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa40b3290 con 0x7fcaa40d3160 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaaa2f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa4072400 con 0x7fcaa40727c0 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaaa2f2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa40d2790 con 0x7fcaa40718d0 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa40727c0 0x7fcaa40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa40727c0 0x7fcaa40b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43062/0 (socket says 172.21.15.80:43062) 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 -- 172.21.15.80:0/1462508353 learned_addr learned my addr 172.21.15.80:0/1462508353 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa888f640 1 --1- 172.21.15.80:0/1462508353 >> v1:172.21.15.80:6789/0 conn(0x7fcaa40d3160 0x7fcaa40ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60906/0 (socket says 172.21.15.80:60906) 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 -- 172.21.15.80:0/1462508353 >> v2:172.21.15.195:3300/0 conn(0x7fcaa40718d0 msgr2=0x7fcaa40d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 --2- 172.21.15.80:0/1462508353 >> v2:172.21.15.195:3300/0 conn(0x7fcaa40718d0 0x7fcaa40d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 -- 172.21.15.80:0/1462508353 >> v1:172.21.15.80:6789/0 conn(0x7fcaa40d3160 legacy=0x7fcaa40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.978+0000 7fcaa3fff640 1 -- 172.21.15.80:0/1462508353 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa4072120 con 0x7fcaa40727c0 2024-04-25T15:46:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.979+0000 7fcaa3fff640 1 --2- 172.21.15.80:0/1462508353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40727c0 0x7fcaa40b2d50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4161b40 tx=0x7fca9402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31fd67391f4e368 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.979+0000 7fcaa2ffd640 1 -- 172.21.15.80:0/1462508353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94037070 con 0x7fcaa40727c0 2024-04-25T15:46:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.979+0000 7fcaa2ffd640 1 -- 172.21.15.80:0/1462508353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9402ad90 con 0x7fcaa40727c0 2024-04-25T15:46:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.979+0000 7fcaa2ffd640 1 -- 172.21.15.80:0/1462508353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94032660 con 0x7fcaa40727c0 2024-04-25T15:46:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/1462508353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40727c0 msgr2=0x7fcaa40b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/1462508353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40727c0 0x7fcaa40b2d50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4161b40 tx=0x7fca9402a100 comp rx=0 tx=0).stop 2024-04-25T15:46:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/1462508353 shutdown_connections 2024-04-25T15:46:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/1462508353 >> v2:172.21.15.195:3300/0 conn(0x7fcaa40718d0 0x7fcaa40d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/1462508353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40727c0 0x7fcaa40b2d50 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/1462508353 >> 172.21.15.80:0/1462508353 conn(0x7fcaa40d3a30 msgr2=0x7fcaa40d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/1462508353 shutdown_connections 2024-04-25T15:46:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.980+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/1462508353 wait complete. 2024-04-25T15:46:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.981+0000 7fcaaa2f2640 1 Processor -- start 2024-04-25T15:46:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.982+0000 7fcaaa2f2640 1 -- start start 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaaa2f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 0x7fcaa40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaaa2f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcaa40727c0 0x7fcaa40c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaaa2f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa40d3160 0x7fcaa414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaaa2f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4071ce0 con 0x7fcaa40718d0 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaaa2f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40d2420 con 0x7fcaa40d3160 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaaa2f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa4071e60 con 0x7fcaa40727c0 2024-04-25T15:46:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 0x7fcaa40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 0x7fcaa40c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43074/0 (socket says 172.21.15.80:43074) 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 -- 172.21.15.80:0/4230185985 learned_addr learned my addr 172.21.15.80:0/4230185985 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 -- 172.21.15.80:0/4230185985 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcaa40727c0 msgr2=0x7fcaa40c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcaa40727c0 0x7fcaa40c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 -- 172.21.15.80:0/4230185985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa40d3160 msgr2=0x7fcaa414e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa40d3160 0x7fcaa414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 -- 172.21.15.80:0/4230185985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa40c9280 con 0x7fcaa40718d0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.983+0000 7fcaa3fff640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 0x7fcaa40c7e00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fca94000c00 tx=0x7fca940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.984+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94037040 con 0x7fcaa40718d0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.984+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca94004030 con 0x7fcaa40718d0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.984+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa40c8670 con 0x7fcaa40718d0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.984+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94004200 con 0x7fcaa40718d0 2024-04-25T15:46:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.984+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa40c8c30 con 0x7fcaa40718d0 2024-04-25T15:46:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.985+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa40c9e70 con 0x7fcaa40718d0 2024-04-25T15:46:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.985+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fca9403a070 con 0x7fcaa40718d0 2024-04-25T15:46:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.986+0000 7fcaa0ff9640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca900744b0 0x7fca900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.986+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fca940b5890 con 0x7fcaa40718d0 2024-04-25T15:46:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.986+0000 7fcaa37fe640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca900744b0 0x7fca900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.986+0000 7fcaa37fe640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca900744b0 0x7fca900769c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4160c20 tx=0x7fca98006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:37.990+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcaa40c9e70 con 0x7fcaa40718d0 2024-04-25T15:46:38.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.163+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcaa406a100 con 0x7fcaa40718d0 2024-04-25T15:46:38.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.163+0000 7fcaa0ff9640 1 -- 172.21.15.80:0/4230185985 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7fca94041020 con 0x7fcaa40718d0 2024-04-25T15:46:38.163 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca900744b0 msgr2=0x7fca900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca900744b0 0x7fca900769c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4160c20 tx=0x7fca98006bf0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 msgr2=0x7fcaa40c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 0x7fcaa40c7e00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fca94000c00 tx=0x7fca940046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 shutdown_connections 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca900744b0 0x7fca900769c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa40d3160 0x7fcaa414e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcaa40727c0 0x7fcaa40c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 --2- 172.21.15.80:0/4230185985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40718d0 0x7fcaa40c7e00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 >> 172.21.15.80:0/4230185985 conn(0x7fcaa40d3a30 msgr2=0x7fcaa40c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 shutdown_connections 2024-04-25T15:46:38.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.165+0000 7fcaaa2f2640 1 -- 172.21.15.80:0/4230185985 wait complete. 2024-04-25T15:46:38.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:38.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.287+0000 7f6e70a92640 1 Processor -- start 2024-04-25T15:46:38.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.287+0000 7f6e70a92640 1 -- start start 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.288+0000 7f6e70a92640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15cc80 0x7f6e6c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.288+0000 7f6e70a92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e6c06df20 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.288+0000 7f6e70a92640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e6c0b4850 con 0x7f6e6c06db10 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e70a92640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6e6c0d1620 con 0x7f6e6c15cc80 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6a59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15cc80 0x7f6e6c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6ad9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e6c0b0e70 0x7f6e6c0b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60908/0 (socket says 172.21.15.80:60908) 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6a59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15cc80 0x7f6e6c06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43080/0 (socket says 172.21.15.80:43080) 2024-04-25T15:46:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6ad9d640 1 -- 172.21.15.80:0/2789932995 learned_addr learned my addr 172.21.15.80:0/2789932995 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6a59c640 1 -- 172.21.15.80:0/2789932995 >> v1:172.21.15.195:6789/0 conn(0x7f6e6c06db10 legacy=0x7f6e6c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6a59c640 1 -- 172.21.15.80:0/2789932995 >> v1:172.21.15.80:6789/0 conn(0x7f6e6c0b0e70 legacy=0x7f6e6c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e69d9b640 1 -- 172.21.15.80:0/2789932995 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90338485 0 0) 0x7f6e64001490 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.289+0000 7f6e6a59c640 1 -- 172.21.15.80:0/2789932995 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c0b4b30 con 0x7f6e6c15cc80 2024-04-25T15:46:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e6a59c640 1 --2- 172.21.15.80:0/2789932995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15cc80 0x7f6e6c06d5d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0097a0 tx=0x7f6e5c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8578ea6175a33a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e69d9b640 1 -- 172.21.15.80:0/2789932995 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c037070 con 0x7f6e6c15cc80 2024-04-25T15:46:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e69d9b640 1 -- 172.21.15.80:0/2789932995 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c032440 con 0x7f6e6c15cc80 2024-04-25T15:46:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e69d9b640 1 -- 172.21.15.80:0/2789932995 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c032810 con 0x7f6e6c15cc80 2024-04-25T15:46:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e70a92640 1 -- 172.21.15.80:0/2789932995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15cc80 msgr2=0x7f6e6c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e70a92640 1 --2- 172.21.15.80:0/2789932995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15cc80 0x7f6e6c06d5d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0097a0 tx=0x7f6e5c02a230 comp rx=0 tx=0).stop 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e70a92640 1 -- 172.21.15.80:0/2789932995 shutdown_connections 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e70a92640 1 --2- 172.21.15.80:0/2789932995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15cc80 0x7f6e6c06d5d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.290+0000 7f6e70a92640 1 -- 172.21.15.80:0/2789932995 >> 172.21.15.80:0/2789932995 conn(0x7f6e6c0734b0 msgr2=0x7f6e6c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.291+0000 7f6e70a92640 1 -- 172.21.15.80:0/2789932995 shutdown_connections 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.291+0000 7f6e70a92640 1 -- 172.21.15.80:0/2789932995 wait complete. 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.292+0000 7f6e70a92640 1 Processor -- start 2024-04-25T15:46:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.292+0000 7f6e70a92640 1 -- start start 2024-04-25T15:46:38.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e70a92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e6c06db10 0x7f6e6c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e70a92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 0x7f6e6c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e70a92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e6c15cc80 0x7f6e6c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e70a92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c0b50f0 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e70a92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c0b5460 con 0x7f6e6c06db10 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e70a92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6c15d090 con 0x7f6e6c15cc80 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 0x7f6e6c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 0x7f6e6c158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43086/0 (socket says 172.21.15.80:43086) 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 -- 172.21.15.80:0/644871668 learned_addr learned my addr 172.21.15.80:0/644871668 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e6a59c640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e6c06db10 0x7f6e6c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e6ad9d640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e6c15cc80 0x7f6e6c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 -- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e6c15cc80 msgr2=0x7f6e6c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e6c15cc80 0x7f6e6c150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 -- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e6c06db10 msgr2=0x7f6e6c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e6c06db10 0x7f6e6c1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 -- 172.21.15.80:0/644871668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c159500 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e63fff640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 0x7f6e6c158a40 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c400 tx=0x7f6e5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54017070 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.294+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e540052d0 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.295+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c15e1b0 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.295+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54003830 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.295+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c15e770 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.296+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c0507e0 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.296+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6e5401a070 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.297+0000 7f6e62ffd640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e4c0744b0 0x7f6e4c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.297+0000 7f6e6a59c640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e4c0744b0 0x7f6e4c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.297+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f6e54094540 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.297+0000 7f6e6a59c640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e4c0744b0 0x7f6e4c0769c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c034000 tx=0x7f6e5c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.301+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e6c0507e0 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.475+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e6c06a100 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.475+0000 7f6e62ffd640 1 -- 172.21.15.80:0/644871668 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f6e5405e580 con 0x7f6e6c0b0e70 2024-04-25T15:46:38.475 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e4c0744b0 msgr2=0x7f6e4c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e4c0744b0 0x7f6e4c0769c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c034000 tx=0x7f6e5c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 msgr2=0x7f6e6c158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 0x7f6e6c158a40 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c400 tx=0x7f6e5400c8c0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 shutdown_connections 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e4c0744b0 0x7f6e4c0769c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e6c15cc80 0x7f6e6c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c0b0e70 0x7f6e6c158a40 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 --2- 172.21.15.80:0/644871668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e6c06db10 0x7f6e6c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 >> 172.21.15.80:0/644871668 conn(0x7f6e6c0734b0 msgr2=0x7f6e6c15a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 shutdown_connections 2024-04-25T15:46:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.477+0000 7f6e70a92640 1 -- 172.21.15.80:0/644871668 wait complete. 2024-04-25T15:46:38.490 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:38.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.599+0000 7f2eb7a27640 1 Processor -- start 2024-04-25T15:46:38.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.599+0000 7f2eb7a27640 1 -- start start 2024-04-25T15:46:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb7a27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb00d26a0 0x7f2eb00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb7a27640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2eb006c5c0 0x7f2eb00b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb7a27640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb00b2b00 con 0x7f2eb01618b0 2024-04-25T15:46:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb7a27640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb006cb80 con 0x7f2eb006c5c0 2024-04-25T15:46:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb7a27640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb006ce60 con 0x7f2eb00d26a0 2024-04-25T15:46:38.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb5fc4640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2eb006c5c0 0x7f2eb00b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb57c3640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2eb01618b0 0x7f2eb00d1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:52874/0 (socket says 172.21.15.80:52874) 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb4fc2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb00d26a0 0x7f2eb00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb57c3640 1 -- 172.21.15.80:0/543686798 learned_addr learned my addr 172.21.15.80:0/543686798 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb00d26a0 msgr2=0x7f2eb00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb5fc4640 1 --2- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb00d26a0 0x7f2eb00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/543686798 >> v1:172.21.15.195:6789/0 conn(0x7f2eb01618b0 legacy=0x7f2eb00d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.601+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/543686798 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb00b2d80 con 0x7f2eb006c5c0 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.602+0000 7f2eb5fc4640 1 --2- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb00b3580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80097a0 tx=0x7f2ea802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12e2d85e0a4afa32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.602+0000 7f2ea7fff640 1 -- 172.21.15.80:0/543686798 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8037070 con 0x7f2eb006c5c0 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.602+0000 7f2ea7fff640 1 -- 172.21.15.80:0/543686798 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea8032440 con 0x7f2eb006c5c0 2024-04-25T15:46:38.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.602+0000 7f2ea7fff640 1 -- 172.21.15.80:0/543686798 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8032810 con 0x7f2eb006c5c0 2024-04-25T15:46:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 -- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 msgr2=0x7f2eb00b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb00b3580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80097a0 tx=0x7f2ea802a180 comp rx=0 tx=0).stop 2024-04-25T15:46:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 -- 172.21.15.80:0/543686798 shutdown_connections 2024-04-25T15:46:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb00b3580 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/543686798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb00d26a0 0x7f2eb00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 -- 172.21.15.80:0/543686798 >> 172.21.15.80:0/543686798 conn(0x7f2eb009b410 msgr2=0x7f2eb00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 -- 172.21.15.80:0/543686798 shutdown_connections 2024-04-25T15:46:38.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.603+0000 7f2eb7a27640 1 -- 172.21.15.80:0/543686798 wait complete. 2024-04-25T15:46:38.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.605+0000 7f2eb7a27640 1 Processor -- start 2024-04-25T15:46:38.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.605+0000 7f2eb7a27640 1 -- start start 2024-04-25T15:46:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb7a27640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb7a27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb015d510 0x7f2eb00cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb7a27640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 0x7f2eb015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb7a27640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb00cc670 con 0x7f2eb01f3be0 2024-04-25T15:46:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb7a27640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb0076270 con 0x7f2eb006c5c0 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb7a27640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb00cc7f0 con 0x7f2eb015d510 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb5fc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 0x7f2eb015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb5fc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 0x7f2eb015f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43090/0 (socket says 172.21.15.80:43090) 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.606+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/806440355 learned_addr learned my addr 172.21.15.80:0/806440355 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb57c3640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb4fc2640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb015d510 0x7f2eb00cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb015d510 msgr2=0x7f2eb00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb5fc4640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb015d510 0x7f2eb00cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 msgr2=0x7f2eb0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb5fc4640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb5fc4640 1 -- 172.21.15.80:0/806440355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb00ca2c0 con 0x7f2eb01f3be0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb57c3640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb5fc4640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 0x7f2eb015f2c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8035040 tx=0x7f2ea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8037040 con 0x7f2eb01f3be0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea8042070 con 0x7f2eb01f3be0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb00ca5a0 con 0x7f2eb01f3be0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80308a0 con 0x7f2eb01f3be0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.607+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb00cab60 con 0x7f2eb01f3be0 2024-04-25T15:46:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.608+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb015dc60 con 0x7f2eb01f3be0 2024-04-25T15:46:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.609+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2ea8030a40 con 0x7f2eb01f3be0 2024-04-25T15:46:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.609+0000 7f2ea5ffb640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e940744b0 0x7f2e940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.609+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f2ea80b5ca0 con 0x7f2eb01f3be0 2024-04-25T15:46:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.609+0000 7f2eb57c3640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e940744b0 0x7f2e940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.610+0000 7f2eb57c3640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e940744b0 0x7f2e940769c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0012e0 tx=0x7f2eac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.614+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ea8080330 con 0x7f2eb01f3be0 2024-04-25T15:46:38.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.787+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2eb006e030 con 0x7f2eb01f3be0 2024-04-25T15:46:38.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.788+0000 7f2ea5ffb640 1 -- 172.21.15.80:0/806440355 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f2eb006e030 con 0x7f2eb01f3be0 2024-04-25T15:46:38.788 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:46:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e940744b0 msgr2=0x7f2e940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e940744b0 0x7f2e940769c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0012e0 tx=0x7f2eac009040 comp rx=0 tx=0).stop 2024-04-25T15:46:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 msgr2=0x7f2eb015f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 0x7f2eb015f2c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8035040 tx=0x7f2ea80046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 shutdown_connections 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2e940744b0 0x7f2e940769c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2eb01f3be0 0x7f2eb015f2c0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2eb015d510 0x7f2eb00cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 --2- 172.21.15.80:0/806440355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2eb006c5c0 0x7f2eb0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 >> 172.21.15.80:0/806440355 conn(0x7f2eb009b410 msgr2=0x7f2eb00b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 shutdown_connections 2024-04-25T15:46:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.790+0000 7f2eb7a27640 1 -- 172.21.15.80:0/806440355 wait complete. 2024-04-25T15:46:38.801 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:46:38.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.911+0000 7f5423738640 1 Processor -- start 2024-04-25T15:46:38.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.911+0000 7f5423738640 1 -- start start 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.912+0000 7f5423738640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 0x7f541c09ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.912+0000 7f5423738640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541c0b9350 con 0x7f541c0b2a40 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.912+0000 7f5423738640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541c0cf890 con 0x7f541c0cff30 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.912+0000 7f5423738640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f541c0cfb70 con 0x7f541c0b7230 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5420cd3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f541c0b2a40 0x7f541c0d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60922/0 (socket says 172.21.15.80:60922) 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5420cd3640 1 -- 172.21.15.80:0/552035008 learned_addr learned my addr 172.21.15.80:0/552035008 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5421cd5640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 0x7f541c09ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532279798 0 0) 0x7f541c0b9350 con 0x7f541c0b2a40 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5408003520 con 0x7f541c0b2a40 2024-04-25T15:46:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2305106785 0 0) 0x7f5408003520 con 0x7f541c0b2a40 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 msgr2=0x7f541c09ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 0x7f541c09ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 >> v1:172.21.15.195:6789/0 conn(0x7f541c0cff30 legacy=0x7f541c0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c0d2830 con 0x7f541c0b2a40 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f540c001690 con 0x7f541c0b2a40 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 >> v1:172.21.15.80:6789/0 conn(0x7f541c0b2a40 legacy=0x7f541c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 0x7f54080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5408003f40 0x7f5408004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5408004d40 0x7f5408005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0cfb70 con 0x7f5408004d40 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f540800bb80 con 0x7f5408003f40 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f540800bd80 con 0x7f541c0b7230 2024-04-25T15:46:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5421cd5640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5408004d40 0x7f5408005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f54214d4640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 0x7f54080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.913+0000 7f5420cd3640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5408003f40 0x7f5408004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.914+0000 7f5421cd5640 1 -- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 msgr2=0x7f54080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.914+0000 7f5421cd5640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f541c0b7230 0x7f54080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.914+0000 7f5421cd5640 1 -- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5408003f40 msgr2=0x7f5408004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.914+0000 7f5421cd5640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5408003f40 0x7f5408004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.914+0000 7f5421cd5640 1 -- 172.21.15.80:0/552035008 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408003520 con 0x7f5408004d40 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.914+0000 7f5421cd5640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5408004d40 0x7f5408005150 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f5414009f90 tx=0x7f5408005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618180c4f455728f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414009c10 con 0x7f5408004d40 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5414036070 con 0x7f5408004d40 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5413fff640 1 -- 172.21.15.80:0/552035008 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414031850 con 0x7f5408004d40 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5423738640 1 -- 172.21.15.80:0/552035008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5408004d40 msgr2=0x7f5408005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5423738640 1 --2- 172.21.15.80:0/552035008 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5408004d40 0x7f5408005150 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f5414009f90 tx=0x7f5408005830 comp rx=0 tx=0).stop 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5421cd5640 1 -- 172.21.15.80:0/552035008 reap_dead start 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5423738640 1 -- 172.21.15.80:0/552035008 shutdown_connections 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5423738640 1 -- 172.21.15.80:0/552035008 >> 172.21.15.80:0/552035008 conn(0x7f541c0d0450 msgr2=0x7f541c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5423738640 1 -- 172.21.15.80:0/552035008 shutdown_connections 2024-04-25T15:46:38.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.915+0000 7f5423738640 1 -- 172.21.15.80:0/552035008 wait complete. 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.917+0000 7f5423738640 1 Processor -- start 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.917+0000 7f5423738640 1 -- start start 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5423738640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5408004d40 0x7f541c1f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5423738640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f541c161a90 0x7f541c14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5423738640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 0x7f541c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5423738640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0cf540 con 0x7f541c1f3a30 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5423738640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f541c0d1cb0 con 0x7f541c161a90 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5423738640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f541c0d0f70 con 0x7f5408004d40 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5421cd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 0x7f541c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5421cd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 0x7f541c14dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43116/0 (socket says 172.21.15.80:43116) 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.918+0000 7f5421cd5640 1 -- 172.21.15.80:0/88639896 learned_addr learned my addr 172.21.15.80:0/88639896 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f54214d4640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5408004d40 0x7f541c1f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5420cd3640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f541c161a90 0x7f541c14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5421cd5640 1 -- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5408004d40 msgr2=0x7f541c1f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5421cd5640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5408004d40 0x7f541c1f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5421cd5640 1 -- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f541c161a90 msgr2=0x7f541c14d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5421cd5640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f541c161a90 0x7f541c14d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5421cd5640 1 -- 172.21.15.80:0/88639896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c1504c0 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5421cd5640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 0x7f541c14dbf0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5414009f90 tx=0x7f5414009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414009c10 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5414003990 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541c160fb0 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414003d80 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.919+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541c161570 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.921+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541c160da0 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.921+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5414005d10 con 0x7f541c1f3a30 2024-04-25T15:46:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.921+0000 7f5411ffb640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f54000744b0 0x7f54000769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.921+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f54140b6d10 con 0x7f541c1f3a30 2024-04-25T15:46:38.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.921+0000 7f54214d4640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f54000744b0 0x7f54000769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.922+0000 7f54214d4640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f54000744b0 0x7f54000769c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f541c0d2bc0 tx=0x7f5418009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:38.926+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f541404a060 con 0x7f541c1f3a30 2024-04-25T15:46:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.117+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f541c06a100 con 0x7f541c1f3a30 2024-04-25T15:46:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.117+0000 7f5411ffb640 1 -- 172.21.15.80:0/88639896 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7f541402e050 con 0x7f541c1f3a30 2024-04-25T15:46:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:46:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f54000744b0 msgr2=0x7f54000769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f54000744b0 0x7f54000769c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f541c0d2bc0 tx=0x7f5418009040 comp rx=0 tx=0).stop 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 msgr2=0x7f541c14dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 0x7f541c14dbf0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5414009f90 tx=0x7f5414009750 comp rx=0 tx=0).stop 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 shutdown_connections 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f54000744b0 0x7f54000769c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f541c1f3a30 0x7f541c14dbf0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f541c161a90 0x7f541c14d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 --2- 172.21.15.80:0/88639896 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5408004d40 0x7f541c1f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 >> 172.21.15.80:0/88639896 conn(0x7f541c0d0450 msgr2=0x7f541c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 shutdown_connections 2024-04-25T15:46:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.119+0000 7f5423738640 1 -- 172.21.15.80:0/88639896 wait complete. 2024-04-25T15:46:39.131 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:46:39.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:39.131 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:46:39.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:46:39.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:46:39.163 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:46:39.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:39.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.328+0000 7fa07b372640 1 Processor -- start 2024-04-25T15:46:39.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.329+0000 7fa07b372640 1 -- start start 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07b372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0740d41b0 0x7fa0740b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07b372640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa0741602a0 0x7fa0740b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07b372640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0740b7b90 0x7fa0740d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07b372640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa0740b7fa0 con 0x7fa0740b7b90 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07b372640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa074163fb0 con 0x7fa0741602a0 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07b372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa074164270 con 0x7fa0740d41b0 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07990f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0740b7b90 0x7fa0740d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07990f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0740b7b90 0x7fa0740d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43132/0 (socket says 172.21.15.80:43132) 2024-04-25T15:46:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07990f640 1 -- 172.21.15.80:0/1814112596 learned_addr learned my addr 172.21.15.80:0/1814112596 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07890d640 1 --2- 172.21.15.80:0/1814112596 >> v2:172.21.15.195:3300/0 conn(0x7fa0741602a0 0x7fa0740b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.330+0000 7fa07910e640 1 --2- 172.21.15.80:0/1814112596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0740d41b0 0x7fa0740b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa07990f640 1 -- 172.21.15.80:0/1814112596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0740d41b0 msgr2=0x7fa0740b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa07990f640 1 --2- 172.21.15.80:0/1814112596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0740d41b0 0x7fa0740b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa07990f640 1 -- 172.21.15.80:0/1814112596 >> v2:172.21.15.195:3300/0 conn(0x7fa0741602a0 msgr2=0x7fa0740b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa07990f640 1 --2- 172.21.15.80:0/1814112596 >> v2:172.21.15.195:3300/0 conn(0x7fa0741602a0 0x7fa0740b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa07990f640 1 -- 172.21.15.80:0/1814112596 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074164550 con 0x7fa0740b7b90 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa07990f640 1 --2- 172.21.15.80:0/1814112596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740b7b90 0x7fa0740d0980 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa07408e170 tx=0x7fa06c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b661366e7701100 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa06bfff640 1 -- 172.21.15.80:0/1814112596 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c037070 con 0x7fa0740b7b90 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa06bfff640 1 -- 172.21.15.80:0/1814112596 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa06c032440 con 0x7fa0740b7b90 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.331+0000 7fa06bfff640 1 -- 172.21.15.80:0/1814112596 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c032810 con 0x7fa0740b7b90 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 -- 172.21.15.80:0/1814112596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740b7b90 msgr2=0x7fa0740d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 --2- 172.21.15.80:0/1814112596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740b7b90 0x7fa0740d0980 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa07408e170 tx=0x7fa06c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 -- 172.21.15.80:0/1814112596 shutdown_connections 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 --2- 172.21.15.80:0/1814112596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740b7b90 0x7fa0740d0980 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 --2- 172.21.15.80:0/1814112596 >> v2:172.21.15.195:3300/0 conn(0x7fa0741602a0 0x7fa0740b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 --2- 172.21.15.80:0/1814112596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0740d41b0 0x7fa0740b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 -- 172.21.15.80:0/1814112596 >> 172.21.15.80:0/1814112596 conn(0x7fa07406e9f0 msgr2=0x7fa0740d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 -- 172.21.15.80:0/1814112596 shutdown_connections 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.332+0000 7fa07b372640 1 -- 172.21.15.80:0/1814112596 wait complete. 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.334+0000 7fa07b372640 1 Processor -- start 2024-04-25T15:46:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.334+0000 7fa07b372640 1 -- start start 2024-04-25T15:46:39.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07b372640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0740b7b90 0x7fa07414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07b372640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 0x7fa07414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07b372640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0741602a0 0x7fa0740c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07b372640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa0740b4fd0 con 0x7fa0740d41b0 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07b372640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa074164b10 con 0x7fa0740b7b90 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07b372640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa0740b5150 con 0x7fa0741602a0 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07890d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 0x7fa07414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07890d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 0x7fa07414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43136/0 (socket says 172.21.15.80:43136) 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.335+0000 7fa07890d640 1 -- 172.21.15.80:0/2190806213 learned_addr learned my addr 172.21.15.80:0/2190806213 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07910e640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0740b7b90 0x7fa07414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07990f640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0741602a0 0x7fa0740c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07890d640 1 -- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0741602a0 msgr2=0x7fa0740c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07890d640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0741602a0 0x7fa0740c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07890d640 1 -- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0740b7b90 msgr2=0x7fa07414dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07890d640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0740b7b90 0x7fa07414dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07890d640 1 -- 172.21.15.80:0/2190806213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074159450 con 0x7fa0740d41b0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07990f640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0741602a0 0x7fa0740c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07890d640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 0x7fa07414e100 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa06400d5f0 tx=0x7fa06400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640125f0 con 0x7fa0740d41b0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa064019070 con 0x7fa0740d41b0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640129d0 con 0x7fa0740d41b0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074159730 con 0x7fa0740d41b0 2024-04-25T15:46:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.336+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074159cf0 con 0x7fa0740d41b0 2024-04-25T15:46:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.337+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07406a100 con 0x7fa0740d41b0 2024-04-25T15:46:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.338+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa064012b70 con 0x7fa0740d41b0 2024-04-25T15:46:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.338+0000 7fa069ffb640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0580744e0 0x7fa0580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.338+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa064095750 con 0x7fa0740d41b0 2024-04-25T15:46:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.338+0000 7fa07910e640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0580744e0 0x7fa0580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.339+0000 7fa07910e640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0580744e0 0x7fa0580769f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa0700039e0 tx=0x7fa070009790 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.343+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa06405fcd0 con 0x7fa0740d41b0 2024-04-25T15:46:39.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.552+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0740d3070 con 0x7fa0740d41b0 2024-04-25T15:46:39.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.553+0000 7fa069ffb640 1 -- 172.21.15.80:0/2190806213 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7fa06405f5d0 con 0x7fa0740d41b0 2024-04-25T15:46:39.553 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:39.553 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:39.554 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0580744e0 msgr2=0x7fa0580769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0580744e0 0x7fa0580769f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa0700039e0 tx=0x7fa070009790 comp rx=0 tx=0).stop 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 msgr2=0x7fa07414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 0x7fa07414e100 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa06400d5f0 tx=0x7fa06400dab0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 shutdown_connections 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0580744e0 0x7fa0580769f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0741602a0 0x7fa0740c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0740d41b0 0x7fa07414e100 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 --2- 172.21.15.80:0/2190806213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0740b7b90 0x7fa07414dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 >> 172.21.15.80:0/2190806213 conn(0x7fa07406e9f0 msgr2=0x7fa0740ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 shutdown_connections 2024-04-25T15:46:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.555+0000 7fa07b372640 1 -- 172.21.15.80:0/2190806213 wait complete. 2024-04-25T15:46:39.567 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2024-04-25T15:46:39.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.676+0000 7f65de3e0640 1 Processor -- start 2024-04-25T15:46:39.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.676+0000 7f65de3e0640 1 -- start start 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65de3e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80cf930 0x7f65d8160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65de3e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65d80718d0 0x7f65d8071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65de3e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d80ce890 con 0x7f65d80d1600 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65de3e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f65d80cf4a0 con 0x7f65d80718d0 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65de3e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65d80cfd40 con 0x7f65d80cf930 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65dc97d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65d80718d0 0x7f65d8071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65dc97d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65d80718d0 0x7f65d8071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43148/0 (socket says 172.21.15.80:43148) 2024-04-25T15:46:39.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65dc97d640 1 -- 172.21.15.80:0/1983082284 learned_addr learned my addr 172.21.15.80:0/1983082284 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.677+0000 7f65d77fe640 1 --1- 172.21.15.80:0/1983082284 >> v1:172.21.15.80:6789/0 conn(0x7f65d80d1600 0x7f65d80d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60932/0 (socket says 172.21.15.80:60932) 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65d7fff640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80cf930 0x7f65d8160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65dc97d640 1 -- 172.21.15.80:0/1983082284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80cf930 msgr2=0x7f65d8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65dc97d640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80cf930 0x7f65d8160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65dc97d640 1 -- 172.21.15.80:0/1983082284 >> v1:172.21.15.80:6789/0 conn(0x7f65d80d1600 legacy=0x7f65d80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65dc97d640 1 -- 172.21.15.80:0/1983082284 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d80ceb70 con 0x7f65d80718d0 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65d6ffd640 1 -- 172.21.15.80:0/1983082284 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295094044 0 0) 0x7f65d80ce890 con 0x7f65d80d1600 2024-04-25T15:46:39.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65d7fff640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80cf930 0x7f65d8160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:39.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65dc97d640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80718d0 0x7f65d8071ce0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009e50 tx=0x7f65d002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb4ffba0b2fd184 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.678+0000 7f65d6ffd640 1 -- 172.21.15.80:0/1983082284 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0036070 con 0x7f65d80718d0 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65d6ffd640 1 -- 172.21.15.80:0/1983082284 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d0031600 con 0x7f65d80718d0 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65d6ffd640 1 -- 172.21.15.80:0/1983082284 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d00319d0 con 0x7f65d80718d0 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 -- 172.21.15.80:0/1983082284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80718d0 msgr2=0x7f65d8071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80718d0 0x7f65d8071ce0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009e50 tx=0x7f65d002a730 comp rx=0 tx=0).stop 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 -- 172.21.15.80:0/1983082284 shutdown_connections 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80718d0 0x7f65d8071ce0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1983082284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80cf930 0x7f65d8160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 -- 172.21.15.80:0/1983082284 >> 172.21.15.80:0/1983082284 conn(0x7f65d80d3a30 msgr2=0x7f65d80d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 -- 172.21.15.80:0/1983082284 shutdown_connections 2024-04-25T15:46:39.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.679+0000 7f65de3e0640 1 -- 172.21.15.80:0/1983082284 wait complete. 2024-04-25T15:46:39.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.681+0000 7f65de3e0640 1 Processor -- start 2024-04-25T15:46:39.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.681+0000 7f65de3e0640 1 -- start start 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.682+0000 7f65de3e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80718d0 0x7f65d80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.682+0000 7f65de3e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 0x7f65d80b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.682+0000 7f65de3e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d80d1600 0x7f65d8159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.682+0000 7f65de3e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8160660 con 0x7f65d80cf930 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65de3e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80cf130 con 0x7f65d80d1600 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65de3e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65d8072220 con 0x7f65d80718d0 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 0x7f65d80b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 0x7f65d80b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43164/0 (socket says 172.21.15.80:43164) 2024-04-25T15:46:39.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 -- 172.21.15.80:0/1208191224 learned_addr learned my addr 172.21.15.80:0/1208191224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d7fff640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80718d0 0x7f65d80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65dc97d640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d80d1600 0x7f65d8159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 -- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80718d0 msgr2=0x7f65d80cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80718d0 0x7f65d80cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 -- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d80d1600 msgr2=0x7f65d8159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d80d1600 0x7f65d8159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 -- 172.21.15.80:0/1208191224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d81617d0 con 0x7f65d80cf930 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65dc97d640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d80d1600 0x7f65d8159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d7fff640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80718d0 0x7f65d80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d77fe640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 0x7f65d80b3d90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00c410 tx=0x7f65cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d4ff9640 1 -- 172.21.15.80:0/1208191224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0074e0 con 0x7f65d80cf930 2024-04-25T15:46:39.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d4ff9640 1 -- 172.21.15.80:0/1208191224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc0047e0 con 0x7f65d80cf930 2024-04-25T15:46:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d8161ab0 con 0x7f65d80cf930 2024-04-25T15:46:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65d4ff9640 1 -- 172.21.15.80:0/1208191224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc004bd0 con 0x7f65d80cf930 2024-04-25T15:46:39.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.683+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d8162070 con 0x7f65d80cf930 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.685+0000 7f65d4ff9640 1 -- 172.21.15.80:0/1208191224 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f65cc011070 con 0x7f65d80cf930 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.685+0000 7f65d4ff9640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65c40744b0 0x7f65c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.686+0000 7f65d4ff9640 1 -- 172.21.15.80:0/1208191224 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f65cc094f80 con 0x7f65d80cf930 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.686+0000 7f65d7fff640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65c40744b0 0x7f65c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.686+0000 7f65d7fff640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65c40744b0 0x7f65c40769c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.686+0000 7f65e5368740 1 Processor -- start 2024-04-25T15:46:39.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.686+0000 7f65e5368740 1 -- start start 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.687+0000 7f65e5368740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4da6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.687+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e86b0 0x55d9c4dd6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65e5368740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d9c4d0fd80 con 0x55d9c4a09390 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d9c4cc9a20 con 0x55d9c49e86b0 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55d9c4d0bd40 con 0x55d9c49e04d0 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4da6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4da6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43168/0 (socket says 172.21.15.80:43168) 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 -- 172.21.15.80:0/905182634 learned_addr learned my addr 172.21.15.80:0/905182634 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65dc97d640 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e86b0 0x55d9c4dd6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d77fe640 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 -- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 msgr2=0x55d9c4daa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 -- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e86b0 msgr2=0x55d9c4dd6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e86b0 0x55d9c4dd6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 -- 172.21.15.80:0/905182634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c4cd4c30 con 0x55d9c4a09390 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65d7fff640 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4da6920 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f65c800fa30 tx=0x7f65c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad18861b95d588e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65bdffb640 1 -- 172.21.15.80:0/905182634 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c801b050 con 0x55d9c4a09390 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65bdffb640 1 -- 172.21.15.80:0/905182634 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8025070 con 0x55d9c4a09390 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.688+0000 7f65bdffb640 1 -- 172.21.15.80:0/905182634 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8014e20 con 0x55d9c4a09390 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 -- 172.21.15.80:0/905182634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 msgr2=0x55d9c4da6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4da6920 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f65c800fa30 tx=0x7f65c8012000 comp rx=0 tx=0).stop 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 -- 172.21.15.80:0/905182634 shutdown_connections 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e86b0 0x55d9c4dd6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 --2- 172.21.15.80:0/905182634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4da6920 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 -- 172.21.15.80:0/905182634 >> 172.21.15.80:0/905182634 conn(0x55d9c49fd4e0 msgr2=0x55d9c4dabec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 -- 172.21.15.80:0/905182634 shutdown_connections 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.689+0000 7f65e5368740 1 -- 172.21.15.80:0/905182634 wait complete. 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.690+0000 7f65e5368740 1 -- start start 2024-04-25T15:46:39.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.690+0000 7f65e5368740 1 Processor -- start 2024-04-25T15:46:39.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.691+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4deb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.691+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4df4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.691+0000 7f65e5368740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4dd1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.691+0000 7f65e5368740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d9c4dd42b0 con 0x55d9c4a09390 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.691+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d9c4c96dc0 con 0x55d9c49e04d0 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.691+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55d9c4da6e60 con 0x55d9c49e86b0 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65e5368740 10 client.0 _ll_register_callbacks cb 0x55d9c4cb2600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4dd1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4dd1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43184/0 (socket says 172.21.15.80:43184) 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 -- 172.21.15.80:0/2690508438 learned_addr learned my addr 172.21.15.80:0/2690508438 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65d7fff640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4deb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65d77fe640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4df4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 -- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 msgr2=0x55d9c4df4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4df4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 -- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 msgr2=0x55d9c4deb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4deb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 -- 172.21.15.80:0/2690508438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c4a213f0 con 0x55d9c4a09390 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65d77fe640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4df4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65dc97d640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4dd1b40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009f70 tx=0x7f65d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fdfda532386439 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65b6ffd640 1 -- 172.21.15.80:0/2690508438 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0041030 con 0x55d9c4a09390 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65b6ffd640 1 -- 172.21.15.80:0/2690508438 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f65d0004040 con 0x55d9c4a09390 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c8025070 con 0x55d9c4a09390 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65b6ffd640 1 -- 172.21.15.80:0/2690508438 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f65d0036040 con 0x55d9c4a09390 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65e5368740 10 client.7398 fetch_fsmap learned FSMap version 45 2024-04-25T15:46:39.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.692+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x55d9c4aeb7d0 con 0x55d9c4a09390 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65b6ffd640 1 -- 172.21.15.80:0/2690508438 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8025070 con 0x55d9c4a09390 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65b6ffd640 1 -- 172.21.15.80:0/2690508438 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7f65d003c040 con 0x55d9c4a09390 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65e5368740 10 client.7398 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65e5368740 10 client.7398 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65e5368740 20 client.7398 populate_metadata read hostname 'smithi080' 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65e5368740 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c49c7f60 0x55d9c4decba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65e5368740 4 client.7398 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 --> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9c4d1d990 con 0x55d9c49c7f60 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65d7fff640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c49c7f60 0x55d9c4decba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65b6ffd640 10 client.7398 ms_handle_connect on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.693+0000 7f65d7fff640 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c49c7f60 0x55d9c4decba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5929f4403e49d18 server_cookie=5ebcff52194a6d20 in_seq=0 out_seq=0 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65b6ffd640 1 -- 172.21.15.80:0/2690508438 <== mds.0 v2:172.21.15.80:6835/1832881946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d9c4d1d990 con 0x55d9c49c7f60 2024-04-25T15:46:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65b6ffd640 10 client.7398 handle_command_reply: tid=0 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 client.7398 shutdown 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 msgr2=0x55d9c4dd1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4dd1b40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009f70 tx=0x7f65d0004ab0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 shutdown_connections 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4dd1b40 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c49c7f60 0x55d9c4decba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4df4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 --2- 172.21.15.80:0/2690508438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4deb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 >> 172.21.15.80:0/2690508438 conn(0x55d9c49fd4e0 msgr2=0x55d9c4dd6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65b6ffd640 0 client.7398 ms_handle_reset on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:39.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 shutdown_connections 2024-04-25T15:46:39.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 1 -- 172.21.15.80:0/2690508438 wait complete. 2024-04-25T15:46:39.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.694+0000 7f65e5368740 20 client.7398 trim_cache size 0 max 16384 2024-04-25T15:46:39.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.713+0000 7f65e5368740 1 Processor -- start 2024-04-25T15:46:39.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.713+0000 7f65e5368740 1 -- start start 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65e5368740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4df3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65e5368740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8203210 con 0x55d9c4a09390 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8202210 con 0x55d9c49e04d0 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65d80b3420 con 0x55d9c49e86b0 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65dc97d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4df3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65dc97d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4df3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43188/0 (socket says 172.21.15.80:43188) 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.714+0000 7f65dc97d640 1 -- 172.21.15.80:0/3928533040 learned_addr learned my addr 172.21.15.80:0/3928533040 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65d7fff640 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65d77fe640 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65dc97d640 1 -- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 msgr2=0x55d9c4daa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65dc97d640 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65dc97d640 1 -- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 msgr2=0x55d9c4daa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65dc97d640 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65dc97d640 1 -- 172.21.15.80:0/3928533040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c4da82f0 con 0x55d9c4a09390 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65d77fe640 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65dc97d640 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4df3cd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009ba0 tx=0x7f65d003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22bf3735e4aebc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65bd7fa640 1 -- 172.21.15.80:0/3928533040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0041070 con 0x55d9c4a09390 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65bd7fa640 1 -- 172.21.15.80:0/3928533040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d0037040 con 0x55d9c4a09390 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.715+0000 7f65bd7fa640 1 -- 172.21.15.80:0/3928533040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0046450 con 0x55d9c4a09390 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 -- 172.21.15.80:0/3928533040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 msgr2=0x55d9c4df3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4df3cd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009ba0 tx=0x7f65d003d000 comp rx=0 tx=0).stop 2024-04-25T15:46:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 -- 172.21.15.80:0/3928533040 shutdown_connections 2024-04-25T15:46:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c4a09390 0x55d9c4df3cd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 --2- 172.21.15.80:0/3928533040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 -- 172.21.15.80:0/3928533040 >> 172.21.15.80:0/3928533040 conn(0x55d9c49fd4e0 msgr2=0x55d9c4dffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 -- 172.21.15.80:0/3928533040 shutdown_connections 2024-04-25T15:46:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.716+0000 7f65e5368740 1 -- 172.21.15.80:0/3928533040 wait complete. 2024-04-25T15:46:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.717+0000 7f65e5368740 1 -- start start 2024-04-25T15:46:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.717+0000 7f65e5368740 1 Processor -- start 2024-04-25T15:46:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c4a09390 0x55d9c4dea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8201d10 con 0x55d9c49e86b0 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d9c4e71df0 con 0x55d9c4a09390 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55d9c4da70c0 con 0x55d9c49e04d0 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65e5368740 10 client.0 _ll_register_callbacks cb 0x7f65d0034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43192/0 (socket says 172.21.15.80:43192) 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 -- 172.21.15.80:0/233975921 learned_addr learned my addr 172.21.15.80:0/233975921 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65dc97d640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c4a09390 0x55d9c4dea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d7fff640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 -- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 msgr2=0x55d9c4daa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 -- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c4a09390 msgr2=0x55d9c4dea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c4a09390 0x55d9c4dea4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.718+0000 7f65d77fe640 1 -- 172.21.15.80:0/233975921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c4df5690 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65d77fe640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f65cc05c180 tx=0x7f65cc001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f010c9877bfe600d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65b6ffd640 1 -- 172.21.15.80:0/233975921 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc05ef10 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65b6ffd640 1 -- 172.21.15.80:0/233975921 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f65cc067a60 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d0037040 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65b6ffd640 1 -- 172.21.15.80:0/233975921 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f65cc07e050 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 10 client.7404 fetch_fsmap learned FSMap version 45 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x55d9c4dad6a0 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65b6ffd640 1 -- 172.21.15.80:0/233975921 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d0037040 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65b6ffd640 1 -- 172.21.15.80:0/233975921 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7f65cc05e170 con 0x55d9c49e86b0 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 10 client.7404 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 10 client.7404 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 20 client.7404 populate_metadata read hostname 'smithi080' 2024-04-25T15:46:39.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c4dd60f0 0x55d9c4deaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 4 client.7404 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 --> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] -- command(tid 0: {"prefix": "session ls"}) -- 0x55d9c4d17800 con 0x55d9c4dd60f0 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.719+0000 7f65d7fff640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c4dd60f0 0x55d9c4deaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65b6ffd640 10 client.7404 ms_handle_connect on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65d7fff640 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c4dd60f0 0x55d9c4deaa00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f7e84b0d89e7f3 server_cookie=6be6643e15e6294 in_seq=0 out_seq=0 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65b6ffd640 1 -- 172.21.15.80:0/233975921 <== mds.0 v2:172.21.15.80:6835/1832881946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9c4d17800 con 0x55d9c4dd60f0 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65b6ffd640 10 client.7404 handle_command_reply: tid=0 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 client.7404 shutdown 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 msgr2=0x55d9c4daa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f65cc05c180 tx=0x7f65cc001060 comp rx=0 tx=0).stop 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 shutdown_connections 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9c4a09390 0x55d9c4dea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9c49e86b0 0x55d9c4daa8a0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.80:6835/1832881946,v1:172.21.15.80:6837/1832881946] conn(0x55d9c4dd60f0 0x55d9c4deaa00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 --2- 172.21.15.80:0/233975921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55d9c49e04d0 0x55d9c4daa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65b6ffd640 0 client.7404 ms_handle_reset on v2:172.21.15.80:6835/1832881946 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 >> 172.21.15.80:0/233975921 conn(0x55d9c49fd4e0 msgr2=0x55d9c4dd1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 shutdown_connections 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 1 -- 172.21.15.80:0/233975921 wait complete. 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.720+0000 7f65e5368740 20 client.7404 trim_cache size 0 max 16384 2024-04-25T15:46:39.726 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T15:46:39.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65c40744b0 msgr2=0x7f65c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65c40744b0 0x7f65c40769c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).stop 2024-04-25T15:46:39.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 msgr2=0x7f65d80b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 0x7f65d80b3d90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00c410 tx=0x7f65cc001e70 comp rx=0 tx=0).stop 2024-04-25T15:46:39.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 shutdown_connections 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f65c40744b0 0x7f65c40769c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d80d1600 0x7f65d8159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65d80cf930 0x7f65d80b3d90 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 --2- 172.21.15.80:0/1208191224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65d80718d0 0x7f65d80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 >> 172.21.15.80:0/1208191224 conn(0x7f65d80d3a30 msgr2=0x7f65d80b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 shutdown_connections 2024-04-25T15:46:39.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:39.721+0000 7f65de3e0640 1 -- 172.21.15.80:0/1208191224 wait complete. 2024-04-25T15:46:39.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-04-25T15:46:39.857 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T15:46:39.857 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-04-25T15:46:39.858 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:46:39.858 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:39.899 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:39.940 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:46:39.941 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:39.941 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:39.941 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:39.956 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:39.956 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:39.956 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:39.956 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:39.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:39.997 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:39.997 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:39.997 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:40.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:40.013 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:46:40.013 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:40.013 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:40.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:40.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.162+0000 7f5a3eab1640 1 Processor -- start 2024-04-25T15:46:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.162+0000 7f5a3eab1640 1 -- start start 2024-04-25T15:46:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3eab1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a380714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3eab1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5a380719e0 0x7f5a380b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3eab1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38071df0 con 0x7f5a380cfc40 2024-04-25T15:46:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3eab1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5a38160610 con 0x7f5a380719e0 2024-04-25T15:46:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3eab1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5a380b6eb0 con 0x7f5a38160200 2024-04-25T15:46:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3d04e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5a380719e0 0x7f5a380b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a380714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3d04e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5a380719e0 0x7f5a380b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:42994/0 (socket says 172.21.15.80:42994) 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a380714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:60322/0 (socket says 172.21.15.80:60322) 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3d04e640 1 -- 172.21.15.80:0/2045710434 learned_addr learned my addr 172.21.15.80:0/2045710434 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.164+0000 7f5a3c84d640 1 --1- 172.21.15.80:0/2045710434 >> v1:172.21.15.195:6789/0 conn(0x7f5a380cfc40 0x7f5a38164690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:52894/0 (socket says 172.21.15.80:52894) 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.165+0000 7f5a3d04e640 1 -- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 msgr2=0x7f5a380714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.165+0000 7f5a3d04e640 1 --2- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a380714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.165+0000 7f5a3d04e640 1 -- 172.21.15.80:0/2045710434 >> v1:172.21.15.195:6789/0 conn(0x7f5a380cfc40 legacy=0x7f5a38164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.165+0000 7f5a3d04e640 1 -- 172.21.15.80:0/2045710434 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a380b7150 con 0x7f5a380719e0 2024-04-25T15:46:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.165+0000 7f5a37fff640 1 --2- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a380714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.166+0000 7f5a3d04e640 1 --2- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a380b59e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009e50 tx=0x7f5a3002a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a68f9b2da1f237c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.166+0000 7f5a377fe640 1 -- 172.21.15.80:0/2045710434 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30036070 con 0x7f5a380719e0 2024-04-25T15:46:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.166+0000 7f5a377fe640 1 -- 172.21.15.80:0/2045710434 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a30031600 con 0x7f5a380719e0 2024-04-25T15:46:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.166+0000 7f5a377fe640 1 -- 172.21.15.80:0/2045710434 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a300319d0 con 0x7f5a380719e0 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.166+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 msgr2=0x7f5a380b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.166+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a380b59e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009e50 tx=0x7f5a3002a590 comp rx=0 tx=0).stop 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.167+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2045710434 shutdown_connections 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.167+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a380b59e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.167+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2045710434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a380714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.167+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2045710434 >> 172.21.15.80:0/2045710434 conn(0x7f5a380d2080 msgr2=0x7f5a380d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.167+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2045710434 shutdown_connections 2024-04-25T15:46:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.167+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2045710434 wait complete. 2024-04-25T15:46:40.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.168+0000 7f5a3eab1640 1 Processor -- start 2024-04-25T15:46:40.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.168+0000 7f5a3eab1640 1 -- start start 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3eab1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a3814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3eab1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 0x7f5a38156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3eab1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a38157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3eab1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380b7430 con 0x7f5a380cfc40 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3eab1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380b54c0 con 0x7f5a380719e0 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3eab1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5a38072040 con 0x7f5a38160200 2024-04-25T15:46:40.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 0x7f5a38156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 0x7f5a38156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43198/0 (socket says 172.21.15.80:43198) 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 -- 172.21.15.80:0/2290676416 learned_addr learned my addr 172.21.15.80:0/2290676416 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3c84d640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a3814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a3d04e640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a38157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 -- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 msgr2=0x7f5a38157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a38157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 -- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 msgr2=0x7f5a3814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a3814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 -- 172.21.15.80:0/2290676416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a381560b0 con 0x7f5a380cfc40 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.170+0000 7f5a37fff640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 0x7f5a38156ad0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00e990 tx=0x7f5a2c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.171+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c017070 con 0x7f5a380cfc40 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.171+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00c9e0 con 0x7f5a380cfc40 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.171+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a380cdb00 con 0x7f5a380cfc40 2024-04-25T15:46:40.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.171+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00cdb0 con 0x7f5a380cfc40 2024-04-25T15:46:40.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.171+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a380ce0c0 con 0x7f5a380cfc40 2024-04-25T15:46:40.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.172+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a380cb780 con 0x7f5a380cfc40 2024-04-25T15:46:40.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.172+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5a2c01a070 con 0x7f5a380cfc40 2024-04-25T15:46:40.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.173+0000 7f5a357fa640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5a240744e0 0x7f5a240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.173+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f5a2c095170 con 0x7f5a380cfc40 2024-04-25T15:46:40.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.173+0000 7f5a3c84d640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5a240744e0 0x7f5a240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.173+0000 7f5a3c84d640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5a240744e0 0x7f5a240769f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5a28000f60 tx=0x7f5a28007e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.177+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a381560b0 con 0x7f5a380cfc40 2024-04-25T15:46:40.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.386+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a380cd890 con 0x7f5a380cfc40 2024-04-25T15:46:40.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.387+0000 7f5a357fa640 1 -- 172.21.15.80:0/2290676416 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7f5a2c05f120 con 0x7f5a380cfc40 2024-04-25T15:46:40.387 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:40.387 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:40.387 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5a240744e0 msgr2=0x7f5a240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5a240744e0 0x7f5a240769f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5a28000f60 tx=0x7f5a28007e20 comp rx=0 tx=0).stop 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 msgr2=0x7f5a38156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 0x7f5a38156ad0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00e990 tx=0x7f5a2c00ee50 comp rx=0 tx=0).stop 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 shutdown_connections 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5a240744e0 0x7f5a240769f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a38160200 0x7f5a38157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a380cfc40 0x7f5a38156ad0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 --2- 172.21.15.80:0/2290676416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a380719e0 0x7f5a3814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 >> 172.21.15.80:0/2290676416 conn(0x7f5a380d2080 msgr2=0x7f5a380d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 shutdown_connections 2024-04-25T15:46:40.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.389+0000 7f5a3eab1640 1 -- 172.21.15.80:0/2290676416 wait complete. 2024-04-25T15:46:40.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:40.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.508+0000 7f01100e0640 1 Processor -- start 2024-04-25T15:46:40.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.508+0000 7f01100e0640 1 -- start start 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f01100e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01080afe30 0x7f010815b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f01100e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01080ae960 con 0x7f010806dce0 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f01100e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01080aec40 con 0x7f01080d1090 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f01100e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0108070470 con 0x7f01080afe30 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010d67b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f010806dce0 0x7f01080af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60948/0 (socket says 172.21.15.80:60948) 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010d67b640 1 -- 172.21.15.80:0/2847402053 learned_addr learned my addr 172.21.15.80:0/2847402053 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010e67d640 1 --2- 172.21.15.80:0/2847402053 >> v2:172.21.15.80:3300/0 conn(0x7f01080afe30 0x7f010815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010e67d640 1 -- 172.21.15.80:0/2847402053 >> v1:172.21.15.195:6789/0 conn(0x7f01080d1090 legacy=0x7f010806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010e67d640 1 -- 172.21.15.80:0/2847402053 >> v1:172.21.15.80:6789/0 conn(0x7f010806dce0 legacy=0x7f01080af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010ce7a640 1 -- 172.21.15.80:0/2847402053 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967856188 0 0) 0x7f01080ae960 con 0x7f010806dce0 2024-04-25T15:46:40.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.510+0000 7f010e67d640 1 -- 172.21.15.80:0/2847402053 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01080aef20 con 0x7f01080afe30 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.511+0000 7f010e67d640 1 --2- 172.21.15.80:0/2847402053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815b020 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f0100009dc0 tx=0x7f010002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48421787352632bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.511+0000 7f010ce7a640 1 -- 172.21.15.80:0/2847402053 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100007740 con 0x7f01080afe30 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.511+0000 7f010ce7a640 1 -- 172.21.15.80:0/2847402053 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01000078e0 con 0x7f01080afe30 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.511+0000 7f010ce7a640 1 -- 172.21.15.80:0/2847402053 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100007cb0 con 0x7f01080afe30 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 -- 172.21.15.80:0/2847402053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 msgr2=0x7f010815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 --2- 172.21.15.80:0/2847402053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815b020 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f0100009dc0 tx=0x7f010002a640 comp rx=0 tx=0).stop 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 -- 172.21.15.80:0/2847402053 shutdown_connections 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 --2- 172.21.15.80:0/2847402053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815b020 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 -- 172.21.15.80:0/2847402053 >> 172.21.15.80:0/2847402053 conn(0x7f01080d1e20 msgr2=0x7f0108073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 -- 172.21.15.80:0/2847402053 shutdown_connections 2024-04-25T15:46:40.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.512+0000 7f01100e0640 1 -- 172.21.15.80:0/2847402053 wait complete. 2024-04-25T15:46:40.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.513+0000 7f01100e0640 1 Processor -- start 2024-04-25T15:46:40.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.513+0000 7f01100e0640 1 -- start start 2024-04-25T15:46:40.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01080d1090 0x7f01081e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01081e89a0 0x7f01081377e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01080d1620 con 0x7f01080afe30 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f01080d14a0 con 0x7f01080d1090 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f010815f1d0 con 0x7f01081e89a0 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43220/0 (socket says 172.21.15.80:43220) 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 -- 172.21.15.80:0/782125432 learned_addr learned my addr 172.21.15.80:0/782125432 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010d67b640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01080d1090 0x7f01081e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010e67d640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01081e89a0 0x7f01081377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 -- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01081e89a0 msgr2=0x7f01081377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01081e89a0 0x7f01081377e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 -- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01080d1090 msgr2=0x7f01081e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01080d1090 0x7f01081e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 -- 172.21.15.80:0/782125432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01081e9750 con 0x7f01080afe30 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010d67b640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01080d1090 0x7f01081e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f010de7c640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815d690 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f010400b3c0 tx=0x7f010400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104011830 con 0x7f01080afe30 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0104016070 con 0x7f01080afe30 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0108137020 con 0x7f01080afe30 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.515+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104011c10 con 0x7f01080afe30 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.516+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01081e9470 con 0x7f01080afe30 2024-04-25T15:46:40.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.517+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010806a100 con 0x7f01080afe30 2024-04-25T15:46:40.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.517+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f010401b460 con 0x7f01080afe30 2024-04-25T15:46:40.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.518+0000 7f00fe7fc640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00ec0744b0 0x7f00ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.518+0000 7f010d67b640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00ec0744b0 0x7f00ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.518+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f0104094e10 con 0x7f01080afe30 2024-04-25T15:46:40.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.518+0000 7f010d67b640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00ec0744b0 0x7f00ec0769c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f01081f7570 tx=0x7f00f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.522+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0104020020 con 0x7f01080afe30 2024-04-25T15:46:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.696+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01080ae7f0 con 0x7f01080afe30 2024-04-25T15:46:40.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.697+0000 7f00fe7fc640 1 -- 172.21.15.80:0/782125432 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16873 (secure 0 0 0) 0x7f010405f4b0 con 0x7f01080afe30 2024-04-25T15:46:40.697 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:40.697 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":86,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:28.822992+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:40.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00ec0744b0 msgr2=0x7f00ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00ec0744b0 0x7f00ec0769c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f01081f7570 tx=0x7f00f8009040 comp rx=0 tx=0).stop 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 msgr2=0x7f010815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815d690 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f010400b3c0 tx=0x7f010400b880 comp rx=0 tx=0).stop 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 shutdown_connections 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f00ec0744b0 0x7f00ec0769c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01081e89a0 0x7f01081377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01080d1090 0x7f01081e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 --2- 172.21.15.80:0/782125432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01080afe30 0x7f010815d690 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 >> 172.21.15.80:0/782125432 conn(0x7f01080d1e20 msgr2=0x7f0108160920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 shutdown_connections 2024-04-25T15:46:40.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.699+0000 7f01100e0640 1 -- 172.21.15.80:0/782125432 wait complete. 2024-04-25T15:46:40.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:25.438986+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:26.129465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:40.711 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:40.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.822+0000 7fea08242640 1 Processor -- start 2024-04-25T15:46:40.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.822+0000 7fea08242640 1 -- start start 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.823+0000 7fea08242640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fea0015cc80 0x7fea0006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.823+0000 7fea08242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 0x7fea000b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.823+0000 7fea08242640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0006df20 con 0x7fea000b0ca0 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.823+0000 7fea08242640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fea000d1620 con 0x7fea0015cc80 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.823+0000 7fea08242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fea000b5460 con 0x7fea0006db10 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea067df640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fea000b0ca0 0x7fea001608d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60962/0 (socket says 172.21.15.80:60962) 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea067df640 1 -- 172.21.15.80:0/1012698061 learned_addr learned my addr 172.21.15.80:0/1012698061 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea05fde640 1 --2- 172.21.15.80:0/1012698061 >> v2:172.21.15.195:3300/0 conn(0x7fea0015cc80 0x7fea0006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea057dd640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 0x7fea000b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933697506 0 0) 0x7fe9f8001490 con 0x7fea000b0ca0 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9ec003520 con 0x7fea000b0ca0 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 332679035 0 0) 0x7fe9ec003520 con 0x7fea000b0ca0 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 msgr2=0x7fea000b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 0x7fea000b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 >> v2:172.21.15.195:3300/0 conn(0x7fea0015cc80 msgr2=0x7fea0006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 --2- 172.21.15.80:0/1012698061 >> v2:172.21.15.195:3300/0 conn(0x7fea0015cc80 0x7fea0006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea000b4850 con 0x7fea000b0ca0 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe9f8001bc0 con 0x7fea000b0ca0 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea05fde640 1 --2- 172.21.15.80:0/1012698061 >> v2:172.21.15.195:3300/0 conn(0x7fea0015cc80 0x7fea0006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 >> v1:172.21.15.80:6789/0 conn(0x7fea000b0ca0 legacy=0x7fea001608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 0x7fe9ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9ec003f30 0x7fe9ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9ec004d40 0x7fe9ec005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea000d1620 con 0x7fe9ec004d40 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fea000b5460 con 0x7fe9ec003f30 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec00ba10 con 0x7fea0006db10 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea067df640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9ec004d40 0x7fe9ec005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea05fde640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 0x7fe9ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.824+0000 7fea057dd640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9ec003f30 0x7fe9ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.825+0000 7fea067df640 1 -- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 msgr2=0x7fe9ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.825+0000 7fea067df640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea0006db10 0x7fe9ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.825+0000 7fea067df640 1 -- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9ec003f30 msgr2=0x7fe9ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.825+0000 7fea067df640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9ec003f30 0x7fe9ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.825+0000 7fea067df640 1 -- 172.21.15.80:0/1012698061 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec003520 con 0x7fe9ec004d40 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.825+0000 7fea067df640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9ec004d40 0x7fe9ec005150 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fea00074430 tx=0x7fe9ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6748b5ef901fd7eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800a690 con 0x7fe9ec004d40 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f80072f0 con 0x7fe9ec004d40 2024-04-25T15:46:40.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea04fdc640 1 -- 172.21.15.80:0/1012698061 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8007720 con 0x7fe9ec004d40 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea08242640 1 -- 172.21.15.80:0/1012698061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9ec004d40 msgr2=0x7fe9ec005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea08242640 1 --2- 172.21.15.80:0/1012698061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9ec004d40 0x7fe9ec005150 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fea00074430 tx=0x7fe9ec005830 comp rx=0 tx=0).stop 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea067df640 1 -- 172.21.15.80:0/1012698061 reap_dead start 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea08242640 1 -- 172.21.15.80:0/1012698061 shutdown_connections 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea08242640 1 -- 172.21.15.80:0/1012698061 >> 172.21.15.80:0/1012698061 conn(0x7fea000734b0 msgr2=0x7fea000738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea08242640 1 -- 172.21.15.80:0/1012698061 shutdown_connections 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.826+0000 7fea08242640 1 -- 172.21.15.80:0/1012698061 wait complete. 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.828+0000 7fea08242640 1 Processor -- start 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.828+0000 7fea08242640 1 -- start start 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.829+0000 7fea08242640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea001f67f0 0x7fea001f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.829+0000 7fea08242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 0x7fea001f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.829+0000 7fea08242640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea0015e0c0 0x7fea001f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.829+0000 7fea08242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea000b50f0 con 0x7fea0015dcb0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.829+0000 7fea08242640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fea000b4e10 con 0x7fea0015e0c0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.829+0000 7fea08242640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fea0015d090 con 0x7fea001f67f0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 0x7fea001f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 0x7fea001f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43242/0 (socket says 172.21.15.80:43242) 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 -- 172.21.15.80:0/2388296445 learned_addr learned my addr 172.21.15.80:0/2388296445 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea067df640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea0015e0c0 0x7fea001f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea05fde640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea001f67f0 0x7fea001f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 -- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea001f67f0 msgr2=0x7fea001f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea001f67f0 0x7fea001f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 -- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea0015e0c0 msgr2=0x7fea001f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea0015e0c0 0x7fea001f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 -- 172.21.15.80:0/2388296445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0015f6c0 con 0x7fea0015dcb0 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea067df640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea0015e0c0 0x7fea001f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea057dd640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 0x7fea001f5c30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00118e0 tx=0x7fe9f0011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000faf0 con 0x7fea0015dcb0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f000fc90 con 0x7fea0015dcb0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0014440 con 0x7fea0015dcb0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0015e620 con 0x7fea0015dcb0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.830+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0015ebe0 con 0x7fea0015dcb0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.831+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0006a100 con 0x7fea0015dcb0 2024-04-25T15:46:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.832+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe9f0012040 con 0x7fea0015dcb0 2024-04-25T15:46:40.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.832+0000 7fe9f67fc640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9e40744b0 0x7fe9e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.832+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fe9f00959d0 con 0x7fea0015dcb0 2024-04-25T15:46:40.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.832+0000 7fea05fde640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9e40744b0 0x7fe9e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.833+0000 7fea05fde640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9e40744b0 0x7fe9e40769c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fea001542d0 tx=0x7fe9fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:40.837+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9f0019030 con 0x7fea0015dcb0 2024-04-25T15:46:41.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.015+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea000aeae0 con 0x7fea0015dcb0 2024-04-25T15:46:41.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.016+0000 7fe9f67fc640 1 -- 172.21.15.80:0/2388296445 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7fe9f00600f0 con 0x7fea0015dcb0 2024-04-25T15:46:41.017 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9e40744b0 msgr2=0x7fe9e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9e40744b0 0x7fe9e40769c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fea001542d0 tx=0x7fe9fc008040 comp rx=0 tx=0).stop 2024-04-25T15:46:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 msgr2=0x7fea001f5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 0x7fea001f5c30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00118e0 tx=0x7fe9f0011da0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 shutdown_connections 2024-04-25T15:46:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9e40744b0 0x7fe9e40769c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea0015e0c0 0x7fea001f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea0015dcb0 0x7fea001f5c30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 --2- 172.21.15.80:0/2388296445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea001f67f0 0x7fea001f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 >> 172.21.15.80:0/2388296445 conn(0x7fea000734b0 msgr2=0x7fea0015c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 shutdown_connections 2024-04-25T15:46:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.018+0000 7fea08242640 1 -- 172.21.15.80:0/2388296445 wait complete. 2024-04-25T15:46:41.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.142+0000 7fd7b8442640 1 Processor -- start 2024-04-25T15:46:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.142+0000 7fd7b8442640 1 -- start start 2024-04-25T15:46:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b8442640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd7b015cc80 0x7fd7b006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b8442640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7b006db10 0x7fd7b00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b8442640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b00b0ca0 0x7fd7b01608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b8442640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00d1620 con 0x7fd7b006db10 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b8442640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00b5460 con 0x7fd7b015cc80 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b8442640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b006df20 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b59dd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7b006db10 0x7fd7b00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b59dd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7b006db10 0x7fd7b00b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43258/0 (socket says 172.21.15.80:43258) 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b59dd640 1 -- 172.21.15.80:0/2085578979 learned_addr learned my addr 172.21.15.80:0/2085578979 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b61de640 1 --2- 172.21.15.80:0/2085578979 >> v2:172.21.15.195:3300/0 conn(0x7fd7b015cc80 0x7fd7b006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b69df640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b00b0ca0 0x7fd7b01608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.143+0000 7fd7b59dd640 1 -- 172.21.15.80:0/2085578979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b00b0ca0 msgr2=0x7fd7b01608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b59dd640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b00b0ca0 0x7fd7b01608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b59dd640 1 -- 172.21.15.80:0/2085578979 >> v2:172.21.15.195:3300/0 conn(0x7fd7b015cc80 msgr2=0x7fd7b006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b59dd640 1 --2- 172.21.15.80:0/2085578979 >> v2:172.21.15.195:3300/0 conn(0x7fd7b015cc80 0x7fd7b006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b59dd640 1 -- 172.21.15.80:0/2085578979 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b00b4850 con 0x7fd7b006db10 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b61de640 1 --2- 172.21.15.80:0/2085578979 >> v2:172.21.15.195:3300/0 conn(0x7fd7b015cc80 0x7fd7b006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b69df640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b00b0ca0 0x7fd7b01608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b59dd640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b006db10 0x7fd7b00b0760 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0072c80 tx=0x7fd7a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34c7613f48a297b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b51dc640 1 -- 172.21.15.80:0/2085578979 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0037070 con 0x7fd7b006db10 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b51dc640 1 -- 172.21.15.80:0/2085578979 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a0032440 con 0x7fd7b006db10 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.144+0000 7fd7b51dc640 1 -- 172.21.15.80:0/2085578979 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0032810 con 0x7fd7b006db10 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 -- 172.21.15.80:0/2085578979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b006db10 msgr2=0x7fd7b00b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b006db10 0x7fd7b00b0760 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0072c80 tx=0x7fd7a002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 -- 172.21.15.80:0/2085578979 shutdown_connections 2024-04-25T15:46:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b00b0ca0 0x7fd7b01608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 --2- 172.21.15.80:0/2085578979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b006db10 0x7fd7b00b0760 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 --2- 172.21.15.80:0/2085578979 >> v2:172.21.15.195:3300/0 conn(0x7fd7b015cc80 0x7fd7b006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 -- 172.21.15.80:0/2085578979 >> 172.21.15.80:0/2085578979 conn(0x7fd7b00734b0 msgr2=0x7fd7b00738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 -- 172.21.15.80:0/2085578979 shutdown_connections 2024-04-25T15:46:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.145+0000 7fd7b8442640 1 -- 172.21.15.80:0/2085578979 wait complete. 2024-04-25T15:46:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.147+0000 7fd7b8442640 1 Processor -- start 2024-04-25T15:46:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.147+0000 7fd7b8442640 1 -- start start 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b8442640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7b006db10 0x7fd7b0150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b8442640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 0x7fd7b0158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b8442640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b015cc80 0x7fd7b0159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b8442640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b50f0 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b8442640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b4e10 con 0x7fd7b006db10 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b8442640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b015d090 con 0x7fd7b015cc80 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b59dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 0x7fd7b0158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b59dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 0x7fd7b0158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43268/0 (socket says 172.21.15.80:43268) 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b59dd640 1 -- 172.21.15.80:0/3939408900 learned_addr learned my addr 172.21.15.80:0/3939408900 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.148+0000 7fd7b61de640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7b006db10 0x7fd7b0150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b69df640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b015cc80 0x7fd7b0159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b59dd640 1 -- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b015cc80 msgr2=0x7fd7b0159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b59dd640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b015cc80 0x7fd7b0159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b59dd640 1 -- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7b006db10 msgr2=0x7fd7b0150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b59dd640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7b006db10 0x7fd7b0150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b59dd640 1 -- 172.21.15.80:0/3939408900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b015d5f0 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b59dd640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 0x7fd7b0158b00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fd7a002a220 tx=0x7fd7a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0037040 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a0042070 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0030bb0 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b015ef80 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.149+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b015f540 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.150+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b006a100 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.151+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd7a0047460 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.151+0000 7fd7a6ffd640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd7940744e0 0x7fd7940769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.151+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fd7a00b5f80 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.151+0000 7fd7b61de640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd7940744e0 0x7fd7940769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.151+0000 7fd7b61de640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd7940744e0 0x7fd7940769f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00ccc0 tx=0x7fd7ac00c490 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.156+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7a0080580 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.329+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd7b00d1020 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.329+0000 7fd7a6ffd640 1 -- 172.21.15.80:0/3939408900 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7fd7a007fe80 con 0x7fd7b00b0ca0 2024-04-25T15:46:41.331 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd7940744e0 msgr2=0x7fd7940769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd7940744e0 0x7fd7940769f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00ccc0 tx=0x7fd7ac00c490 comp rx=0 tx=0).stop 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 msgr2=0x7fd7b0158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 0x7fd7b0158b00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fd7a002a220 tx=0x7fd7a00046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 shutdown_connections 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd7940744e0 0x7fd7940769f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7b015cc80 0x7fd7b0159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7b00b0ca0 0x7fd7b0158b00 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 --2- 172.21.15.80:0/3939408900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7b006db10 0x7fd7b0150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 >> 172.21.15.80:0/3939408900 conn(0x7fd7b00734b0 msgr2=0x7fd7b00ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 shutdown_connections 2024-04-25T15:46:41.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.331+0000 7fd7b8442640 1 -- 172.21.15.80:0/3939408900 wait complete. 2024-04-25T15:46:41.344 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:41.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.452+0000 7f21d4851640 1 Processor -- start 2024-04-25T15:46:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.452+0000 7f21d4851640 1 -- start start 2024-04-25T15:46:41.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21d4851640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d006d870 0x7f21d00d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21d4851640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f21d00b37b0 0x7f21d00d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21d4851640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d00cfc90 con 0x7f21d006cc10 2024-04-25T15:46:41.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21d4851640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f21d006c9a0 con 0x7f21d00b37b0 2024-04-25T15:46:41.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21d4851640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f21d00d2c10 con 0x7f21d006d870 2024-04-25T15:46:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21ced9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f21d00b37b0 0x7f21d00d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21cdd9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d006d870 0x7f21d00d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21ced9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f21d00b37b0 0x7f21d00d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:43068/0 (socket says 172.21.15.80:43068) 2024-04-25T15:46:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21ced9d640 1 -- 172.21.15.80:0/328477964 learned_addr learned my addr 172.21.15.80:0/328477964 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.454+0000 7f21ce59c640 1 --1- 172.21.15.80:0/328477964 >> v1:172.21.15.195:6789/0 conn(0x7f21d006cc10 0x7f21d006d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:52908/0 (socket says 172.21.15.80:52908) 2024-04-25T15:46:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.455+0000 7f21ced9d640 1 -- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d006d870 msgr2=0x7f21d00d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.455+0000 7f21ced9d640 1 --2- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d006d870 0x7f21d00d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.455+0000 7f21ced9d640 1 -- 172.21.15.80:0/328477964 >> v1:172.21.15.195:6789/0 conn(0x7f21d006cc10 legacy=0x7f21d006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.455+0000 7f21ced9d640 1 -- 172.21.15.80:0/328477964 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d00cff30 con 0x7f21d00b37b0 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.455+0000 7f21cd59a640 1 -- 172.21.15.80:0/328477964 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360734110 0 0) 0x7f21d00cfc90 con 0x7f21d006cc10 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.455+0000 7f21ced9d640 1 --2- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d00d0990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009870 tx=0x7f21c802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7d610104e5521 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21cd59a640 1 -- 172.21.15.80:0/328477964 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8037070 con 0x7f21d00b37b0 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21cd59a640 1 -- 172.21.15.80:0/328477964 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c8032440 con 0x7f21d00b37b0 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21cd59a640 1 -- 172.21.15.80:0/328477964 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8032810 con 0x7f21d00b37b0 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 -- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 msgr2=0x7f21d00d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 --2- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d00d0990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009870 tx=0x7f21c802a270 comp rx=0 tx=0).stop 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 -- 172.21.15.80:0/328477964 shutdown_connections 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 --2- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d00d0990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 --2- 172.21.15.80:0/328477964 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d006d870 0x7f21d00d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 -- 172.21.15.80:0/328477964 >> 172.21.15.80:0/328477964 conn(0x7f21d009b410 msgr2=0x7f21d00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 -- 172.21.15.80:0/328477964 shutdown_connections 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.456+0000 7f21d4851640 1 -- 172.21.15.80:0/328477964 wait complete. 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.458+0000 7f21d4851640 1 Processor -- start 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.458+0000 7f21d4851640 1 -- start start 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21d4851640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 0x7f21d00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21d4851640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21d4851640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d01526c0 0x7f21d0152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21d4851640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0076230 con 0x7f21d006cc10 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21d4851640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f21d006c670 con 0x7f21d00b37b0 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21d4851640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f21d0163860 con 0x7f21d01526c0 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 0x7f21d00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 0x7f21d00cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43280/0 (socket says 172.21.15.80:43280) 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 -- 172.21.15.80:0/94837003 learned_addr learned my addr 172.21.15.80:0/94837003 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ced9d640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d01526c0 0x7f21d0152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 -- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d01526c0 msgr2=0x7f21d0152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d01526c0 0x7f21d0152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 -- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 msgr2=0x7f21d014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 -- 172.21.15.80:0/94837003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d0153610 con 0x7f21d006cc10 2024-04-25T15:46:41.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21ce59c640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 0x7f21d00cc650 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c7c0 tx=0x7f21c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.460+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0018070 con 0x7f21d006cc10 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.461+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c000a640 con 0x7f21d006cc10 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.461+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d00cf100 con 0x7f21d006cc10 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.461+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c000aa30 con 0x7f21d006cc10 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.461+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d00cf6c0 con 0x7f21d006cc10 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.462+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d006a100 con 0x7f21d006cc10 2024-04-25T15:46:41.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.462+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f21c001b070 con 0x7f21d006cc10 2024-04-25T15:46:41.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.463+0000 7f21beffd640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21b00744b0 0x7f21b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.463+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f21c0094a10 con 0x7f21d006cc10 2024-04-25T15:46:41.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.463+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21b00744b0 0x7f21b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.463+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21b00744b0 0x7f21b00769c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f21d00b2fa0 tx=0x7f21c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.469+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21c005f010 con 0x7f21d006cc10 2024-04-25T15:46:41.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.641+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f21d00d2370 con 0x7f21d006cc10 2024-04-25T15:46:41.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.642+0000 7f21beffd640 1 -- 172.21.15.80:0/94837003 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f21c0067090 con 0x7f21d006cc10 2024-04-25T15:46:41.643 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.643+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21b00744b0 msgr2=0x7f21b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.643+0000 7f21d4851640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21b00744b0 0x7f21b00769c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f21d00b2fa0 tx=0x7f21c4008040 comp rx=0 tx=0).stop 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.643+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 msgr2=0x7f21d00cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.643+0000 7f21d4851640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 0x7f21d00cc650 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c7c0 tx=0x7f21c000cc80 comp rx=0 tx=0).stop 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 shutdown_connections 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21b00744b0 0x7f21b00769c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f21d01526c0 0x7f21d0152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00b37b0 0x7f21d014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 --2- 172.21.15.80:0/94837003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d006cc10 0x7f21d00cc650 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 >> 172.21.15.80:0/94837003 conn(0x7f21d009b410 msgr2=0x7f21d00b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 shutdown_connections 2024-04-25T15:46:41.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.644+0000 7f21d4851640 1 -- 172.21.15.80:0/94837003 wait complete. 2024-04-25T15:46:41.656 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:41.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.762+0000 7fa0ba649640 1 Processor -- start 2024-04-25T15:46:41.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.762+0000 7fa0ba649640 1 -- start start 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.763+0000 7fa0ba649640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0b40cfd50 0x7fa0b406f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.763+0000 7fa0ba649640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa0b40d2940 0x7fa0b4073740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.763+0000 7fa0ba649640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b4164bc0 con 0x7fa0b4073330 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.763+0000 7fa0ba649640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b4073c80 con 0x7fa0b40cfd50 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.763+0000 7fa0ba649640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b4073ea0 con 0x7fa0b40d2940 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.763+0000 7fa0b3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0b40cfd50 0x7fa0b406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0b40cfd50 0x7fa0b406f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43290/0 (socket says 172.21.15.80:43290) 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 -- 172.21.15.80:0/591166910 learned_addr learned my addr 172.21.15.80:0/591166910 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b8be6640 1 --2- 172.21.15.80:0/591166910 >> v2:172.21.15.195:3300/0 conn(0x7fa0b40d2940 0x7fa0b4073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 -- 172.21.15.80:0/591166910 >> v2:172.21.15.195:3300/0 conn(0x7fa0b40d2940 msgr2=0x7fa0b4073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 --2- 172.21.15.80:0/591166910 >> v2:172.21.15.195:3300/0 conn(0x7fa0b40d2940 0x7fa0b4073740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 -- 172.21.15.80:0/591166910 >> v1:172.21.15.195:6789/0 conn(0x7fa0b4073330 legacy=0x7fa0b40d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 -- 172.21.15.80:0/591166910 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b406e380 con 0x7fa0b40cfd50 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b8be6640 1 --2- 172.21.15.80:0/591166910 >> v2:172.21.15.195:3300/0 conn(0x7fa0b40d2940 0x7fa0b4073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.764+0000 7fa0b3fff640 1 --2- 172.21.15.80:0/591166910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b40cfd50 0x7fa0b406f140 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa0b408cb50 tx=0x7fa0a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904398c7cabae156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0b2ffd640 1 -- 172.21.15.80:0/591166910 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4037070 con 0x7fa0b40cfd50 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0b2ffd640 1 -- 172.21.15.80:0/591166910 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a4032440 con 0x7fa0b40cfd50 2024-04-25T15:46:41.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0b2ffd640 1 -- 172.21.15.80:0/591166910 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4032810 con 0x7fa0b40cfd50 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0ba649640 1 -- 172.21.15.80:0/591166910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b40cfd50 msgr2=0x7fa0b406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0ba649640 1 --2- 172.21.15.80:0/591166910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b40cfd50 0x7fa0b406f140 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa0b408cb50 tx=0x7fa0a402a230 comp rx=0 tx=0).stop 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0ba649640 1 -- 172.21.15.80:0/591166910 shutdown_connections 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0ba649640 1 --2- 172.21.15.80:0/591166910 >> v2:172.21.15.195:3300/0 conn(0x7fa0b40d2940 0x7fa0b4073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0ba649640 1 --2- 172.21.15.80:0/591166910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b40cfd50 0x7fa0b406f140 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.765+0000 7fa0ba649640 1 -- 172.21.15.80:0/591166910 >> 172.21.15.80:0/591166910 conn(0x7fa0b40d3ea0 msgr2=0x7fa0b40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.766+0000 7fa0ba649640 1 -- 172.21.15.80:0/591166910 shutdown_connections 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.766+0000 7fa0ba649640 1 -- 172.21.15.80:0/591166910 wait complete. 2024-04-25T15:46:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.767+0000 7fa0ba649640 1 Processor -- start 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.767+0000 7fa0ba649640 1 -- start start 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 0x7fa0b4161be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b40cfd50 0x7fa0b415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b415ebb0 0x7fa0b41fa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b406f680 con 0x7fa0b4073330 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b406e940 con 0x7fa0b40cfd50 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b40d0160 con 0x7fa0b415ebb0 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 0x7fa0b4161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 0x7fa0b4161be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43306/0 (socket says 172.21.15.80:43306) 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 -- 172.21.15.80:0/456028806 learned_addr learned my addr 172.21.15.80:0/456028806 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b8be6640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b415ebb0 0x7fa0b41fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b37fe640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b40cfd50 0x7fa0b415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 -- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b415ebb0 msgr2=0x7fa0b41fa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b415ebb0 0x7fa0b41fa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 -- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b40cfd50 msgr2=0x7fa0b415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b40cfd50 0x7fa0b415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 -- 172.21.15.80:0/456028806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b4160b40 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b3fff640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 0x7fa0b4161be0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa0a402a270 tx=0x7fa0a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4037040 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a4042070 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4030bb0 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.769+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b4160e20 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.770+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b41613e0 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.770+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b406a100 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.771+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa0a4047460 con 0x7fa0b4073330 2024-04-25T15:46:41.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.771+0000 7fa0b0ff9640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0a00744e0 0x7fa0a00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.772+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa0a40b5f50 con 0x7fa0b4073330 2024-04-25T15:46:41.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.772+0000 7fa0b37fe640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0a00744e0 0x7fa0a00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.772+0000 7fa0b37fe640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0a00744e0 0x7fa0a00769f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40b9520 tx=0x7fa0a8009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.776+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa0a407ff00 con 0x7fa0b4073330 2024-04-25T15:46:41.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.992+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0b406de90 con 0x7fa0b4073330 2024-04-25T15:46:41.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.993+0000 7fa0b0ff9640 1 -- 172.21.15.80:0/456028806 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7fa0a4084200 con 0x7fa0b4073330 2024-04-25T15:46:41.994 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:41.994 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:41.994 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0a00744e0 msgr2=0x7fa0a00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0a00744e0 0x7fa0a00769f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40b9520 tx=0x7fa0a8009060 comp rx=0 tx=0).stop 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 msgr2=0x7fa0b4161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 0x7fa0b4161be0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa0a402a270 tx=0x7fa0a40046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 shutdown_connections 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa0a00744e0 0x7fa0a00769f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b415ebb0 0x7fa0b41fa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b40cfd50 0x7fa0b415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 --2- 172.21.15.80:0/456028806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4073330 0x7fa0b4161be0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.994+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 >> 172.21.15.80:0/456028806 conn(0x7fa0b40d3ea0 msgr2=0x7fa0b40b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.995+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 shutdown_connections 2024-04-25T15:46:41.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:41.995+0000 7fa0ba649640 1 -- 172.21.15.80:0/456028806 wait complete. 2024-04-25T15:46:42.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:42.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.112+0000 7f03864b1640 1 Processor -- start 2024-04-25T15:46:42.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.112+0000 7f03864b1640 1 -- start start 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f03864b1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03800cfc40 0x7f0380160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f03864b1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0380164690 0x7f03800714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f03864b1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0380071df0 con 0x7f03800719e0 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f03864b1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f03800b6eb0 con 0x7f03800cfc40 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f03864b1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f03800b7150 con 0x7f0380164690 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03800cfc40 0x7f0380160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03800cfc40 0x7f0380160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43316/0 (socket says 172.21.15.80:43316) 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 -- 172.21.15.80:0/808890176 learned_addr learned my addr 172.21.15.80:0/808890176 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037f7fe640 1 --2- 172.21.15.80:0/808890176 >> v2:172.21.15.195:3300/0 conn(0x7f0380164690 0x7f03800714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 -- 172.21.15.80:0/808890176 >> v2:172.21.15.195:3300/0 conn(0x7f0380164690 msgr2=0x7f03800714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 --2- 172.21.15.80:0/808890176 >> v2:172.21.15.195:3300/0 conn(0x7f0380164690 0x7f03800714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 -- 172.21.15.80:0/808890176 >> v1:172.21.15.195:6789/0 conn(0x7f03800719e0 legacy=0x7f038006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.114+0000 7f037ffff640 1 -- 172.21.15.80:0/808890176 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03800b51e0 con 0x7f03800cfc40 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.115+0000 7f037ffff640 1 --2- 172.21.15.80:0/808890176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800cfc40 0x7f0380160200 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0380072540 tx=0x7f037002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fb1918a4702419 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.115+0000 7f037effd640 1 -- 172.21.15.80:0/808890176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370037070 con 0x7f03800cfc40 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.115+0000 7f037effd640 1 -- 172.21.15.80:0/808890176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0370032440 con 0x7f03800cfc40 2024-04-25T15:46:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.115+0000 7f037effd640 1 -- 172.21.15.80:0/808890176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370032810 con 0x7f03800cfc40 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 -- 172.21.15.80:0/808890176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800cfc40 msgr2=0x7f0380160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 --2- 172.21.15.80:0/808890176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800cfc40 0x7f0380160200 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0380072540 tx=0x7f037002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 -- 172.21.15.80:0/808890176 shutdown_connections 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 --2- 172.21.15.80:0/808890176 >> v2:172.21.15.195:3300/0 conn(0x7f0380164690 0x7f03800714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 --2- 172.21.15.80:0/808890176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800cfc40 0x7f0380160200 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 -- 172.21.15.80:0/808890176 >> 172.21.15.80:0/808890176 conn(0x7f03800d2080 msgr2=0x7f03800d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 -- 172.21.15.80:0/808890176 shutdown_connections 2024-04-25T15:46:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.116+0000 7f03864b1640 1 -- 172.21.15.80:0/808890176 wait complete. 2024-04-25T15:46:42.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.117+0000 7f03864b1640 1 Processor -- start 2024-04-25T15:46:42.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.118+0000 7f03864b1640 1 -- start start 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f03864b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 0x7f03800cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f03864b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03800cfc40 0x7f038014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f03864b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0380164690 0x7f0380160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f03864b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0380072040 con 0x7f03800719e0 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f03864b1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03800b7430 con 0x7f03800cfc40 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f03864b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03800b6b70 con 0x7f0380164690 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 0x7f03800cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 0x7f03800cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43320/0 (socket says 172.21.15.80:43320) 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 -- 172.21.15.80:0/2945980080 learned_addr learned my addr 172.21.15.80:0/2945980080 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037f7fe640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03800cfc40 0x7f038014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f0384a4e640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0380164690 0x7f0380160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 -- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0380164690 msgr2=0x7f0380160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0380164690 0x7f0380160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 -- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03800cfc40 msgr2=0x7f038014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03800cfc40 0x7f038014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 -- 172.21.15.80:0/2945980080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03800ccf30 con 0x7f03800719e0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.119+0000 7f037ffff640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 0x7f03800cc6e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f037002a220 tx=0x7f03700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.120+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370041020 con 0x7f03800719e0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.120+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03700306c0 con 0x7f03800719e0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.120+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03800cd210 con 0x7f03800719e0 2024-04-25T15:46:42.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.120+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370037040 con 0x7f03800719e0 2024-04-25T15:46:42.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.120+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03800cd7d0 con 0x7f03800719e0 2024-04-25T15:46:42.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.121+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038006a100 con 0x7f03800719e0 2024-04-25T15:46:42.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.121+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0370044020 con 0x7f03800719e0 2024-04-25T15:46:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.122+0000 7f037cff9640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f036c0744b0 0x7f036c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.122+0000 7f037f7fe640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f036c0744b0 0x7f036c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.122+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6217+0+0 (secure 0 0 0) 0x7f03700b5ba0 con 0x7f03800719e0 2024-04-25T15:46:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.122+0000 7f037f7fe640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f036c0744b0 0x7f036c0769c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0380162940 tx=0x7f0374008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.127+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f037004b030 con 0x7f03800719e0 2024-04-25T15:46:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.303+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03800d1000 con 0x7f03800719e0 2024-04-25T15:46:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.304+0000 7f037cff9640 1 -- 172.21.15.80:0/2945980080 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17067 (secure 0 0 0) 0x7f0370080130 con 0x7f03800719e0 2024-04-25T15:46:42.305 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:42.305 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":87,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:41.874002+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.17","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f036c0744b0 msgr2=0x7f036c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f036c0744b0 0x7f036c0769c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0380162940 tx=0x7f0374008040 comp rx=0 tx=0).stop 2024-04-25T15:46:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 msgr2=0x7f03800cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 0x7f03800cc6e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f037002a220 tx=0x7f03700046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 shutdown_connections 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f036c0744b0 0x7f036c0769c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0380164690 0x7f0380160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03800cfc40 0x7f038014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 --2- 172.21.15.80:0/2945980080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03800719e0 0x7f03800cc6e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 >> 172.21.15.80:0/2945980080 conn(0x7f03800d2080 msgr2=0x7f03800d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 shutdown_connections 2024-04-25T15:46:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.306+0000 7f03864b1640 1 -- 172.21.15.80:0/2945980080 wait complete. 2024-04-25T15:46:42.318 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:46:42.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:42.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.425+0000 7f1bda9b7640 1 Processor -- start 2024-04-25T15:46:42.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.425+0000 7f1bda9b7640 1 -- start start 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bda9b7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd40d41b0 0x7f1bd40b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bda9b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bd40b7d60 0x7f1bd40d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bda9b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd4163fb0 con 0x7f1bd41602a0 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bda9b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd4164270 con 0x7f1bd40b7d60 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bda9b7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd4164550 con 0x7f1bd40d41b0 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bd8f54640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bd40b7d60 0x7f1bd40d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bd37fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1bd41602a0 0x7f1bd40b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60966/0 (socket says 172.21.15.80:60966) 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bd37fe640 1 -- 172.21.15.80:0/3631773215 learned_addr learned my addr 172.21.15.80:0/3631773215 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:42.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.426+0000 7f1bd3fff640 1 --2- 172.21.15.80:0/3631773215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd40d41b0 0x7f1bd40b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd8f54640 1 -- 172.21.15.80:0/3631773215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd40d41b0 msgr2=0x7f1bd40b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd8f54640 1 --2- 172.21.15.80:0/3631773215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd40d41b0 0x7f1bd40b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd8f54640 1 -- 172.21.15.80:0/3631773215 >> v1:172.21.15.80:6789/0 conn(0x7f1bd41602a0 legacy=0x7f1bd40b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd2ffd640 1 -- 172.21.15.80:0/3631773215 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050667322 0 0) 0x7f1bd4163fb0 con 0x7f1bd41602a0 2024-04-25T15:46:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd8f54640 1 -- 172.21.15.80:0/3631773215 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd4164830 con 0x7f1bd40b7d60 2024-04-25T15:46:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd8f54640 1 --2- 172.21.15.80:0/3631773215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40b7d60 0x7f1bd40d49c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009d90 tx=0x7f1bcc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999dafd818c650f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd2ffd640 1 -- 172.21.15.80:0/3631773215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc007740 con 0x7f1bd40b7d60 2024-04-25T15:46:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd2ffd640 1 -- 172.21.15.80:0/3631773215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0078e0 con 0x7f1bd40b7d60 2024-04-25T15:46:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.427+0000 7f1bd2ffd640 1 -- 172.21.15.80:0/3631773215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc007cb0 con 0x7f1bd40b7d60 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 -- 172.21.15.80:0/3631773215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40b7d60 msgr2=0x7f1bd40d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/3631773215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40b7d60 0x7f1bd40d49c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009d90 tx=0x7f1bcc02a660 comp rx=0 tx=0).stop 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 -- 172.21.15.80:0/3631773215 shutdown_connections 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/3631773215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40b7d60 0x7f1bd40d49c0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/3631773215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd40d41b0 0x7f1bd40b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 -- 172.21.15.80:0/3631773215 >> 172.21.15.80:0/3631773215 conn(0x7f1bd406e9f0 msgr2=0x7f1bd40d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 -- 172.21.15.80:0/3631773215 shutdown_connections 2024-04-25T15:46:42.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.428+0000 7f1bda9b7640 1 -- 172.21.15.80:0/3631773215 wait complete. 2024-04-25T15:46:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.430+0000 7f1bda9b7640 1 Processor -- start 2024-04-25T15:46:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.430+0000 7f1bda9b7640 1 -- start start 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bda9b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 0x7f1bd41613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bda9b7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd41602a0 0x7f1bd414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bda9b7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40d0030 0x7f1bd40cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bda9b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40b5150 con 0x7f1bd40d41b0 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bda9b7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40b4fd0 con 0x7f1bd40d0030 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bda9b7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd40b9220 con 0x7f1bd41602a0 2024-04-25T15:46:42.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 0x7f1bd41613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 0x7f1bd41613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43340/0 (socket says 172.21.15.80:43340) 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.431+0000 7f1bd3fff640 1 -- 172.21.15.80:0/4182671376 learned_addr learned my addr 172.21.15.80:0/4182671376 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd37fe640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd41602a0 0x7f1bd414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd8f54640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40d0030 0x7f1bd40cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd3fff640 1 -- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd41602a0 msgr2=0x7f1bd414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd3fff640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd41602a0 0x7f1bd414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd3fff640 1 -- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40d0030 msgr2=0x7f1bd40cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd3fff640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40d0030 0x7f1bd40cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd3fff640 1 -- 172.21.15.80:0/4182671376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd40d0810 con 0x7f1bd40d41b0 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd8f54640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40d0030 0x7f1bd40cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd3fff640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 0x7f1bd41613d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400d5f0 tx=0x7f1bc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40125f0 con 0x7f1bd40d41b0 2024-04-25T15:46:42.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc4019070 con 0x7f1bd40d41b0 2024-04-25T15:46:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd40d0af0 con 0x7f1bd40d41b0 2024-04-25T15:46:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40129d0 con 0x7f1bd40d41b0 2024-04-25T15:46:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.432+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd40d10b0 con 0x7f1bd40d41b0 2024-04-25T15:46:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.433+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd406a100 con 0x7f1bd40d41b0 2024-04-25T15:46:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.434+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1bc4012b70 con 0x7f1bd40d41b0 2024-04-25T15:46:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.434+0000 7f1bd0ff9640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bc00744b0 0x7f1bc00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.434+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6217+0+0 (secure 0 0 0) 0x7f1bc4095820 con 0x7f1bd40d41b0 2024-04-25T15:46:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.434+0000 7f1bd37fe640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bc00744b0 0x7f1bc00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.435+0000 7f1bd37fe640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bc00744b0 0x7f1bc00769c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1bd408e990 tx=0x7f1bc8007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.439+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1bc405fe40 con 0x7f1bd40d41b0 2024-04-25T15:46:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.650+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bd40d3070 con 0x7f1bd40d41b0 2024-04-25T15:46:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.650+0000 7f1bd0ff9640 1 -- 172.21.15.80:0/4182671376 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7f1bc405f740 con 0x7f1bd40d41b0 2024-04-25T15:46:42.651 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:42.652 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:42.652 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bc00744b0 msgr2=0x7f1bc00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bc00744b0 0x7f1bc00769c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1bd408e990 tx=0x7f1bc8007c00 comp rx=0 tx=0).stop 2024-04-25T15:46:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 msgr2=0x7f1bd41613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 0x7f1bd41613d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400d5f0 tx=0x7f1bc400dab0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 shutdown_connections 2024-04-25T15:46:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bc00744b0 0x7f1bc00769c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd40d0030 0x7f1bd40cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd41602a0 0x7f1bd414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 --2- 172.21.15.80:0/4182671376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd40d41b0 0x7f1bd41613d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.652+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 >> 172.21.15.80:0/4182671376 conn(0x7f1bd406e9f0 msgr2=0x7f1bd415e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.653+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 shutdown_connections 2024-04-25T15:46:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.653+0000 7f1bda9b7640 1 -- 172.21.15.80:0/4182671376 wait complete. 2024-04-25T15:46:42.665 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.773+0000 7f175c251640 1 Processor -- start 2024-04-25T15:46:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.773+0000 7f175c251640 1 -- start start 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.774+0000 7f175c251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17540d41b0 0x7f17540b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.774+0000 7f175c251640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f17541602a0 0x7f17540b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.774+0000 7f175c251640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17540b7b90 0x7f17540d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.774+0000 7f175c251640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f17540b7fa0 con 0x7f17540b7b90 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.774+0000 7f175c251640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1754163fb0 con 0x7f17541602a0 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.774+0000 7f175c251640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1754164270 con 0x7f17540d41b0 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17540b7b90 0x7f17540d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17540b7b90 0x7f17540d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43350/0 (socket says 172.21.15.80:43350) 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 -- 172.21.15.80:0/3252924839 learned_addr learned my addr 172.21.15.80:0/3252924839 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f1759fed640 1 --2- 172.21.15.80:0/3252924839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17540d41b0 0x7f17540b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f17597ec640 1 --2- 172.21.15.80:0/3252924839 >> v2:172.21.15.195:3300/0 conn(0x7f17541602a0 0x7f17540b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 -- 172.21.15.80:0/3252924839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17540d41b0 msgr2=0x7f17540b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 --2- 172.21.15.80:0/3252924839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17540d41b0 0x7f17540b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 -- 172.21.15.80:0/3252924839 >> v2:172.21.15.195:3300/0 conn(0x7f17541602a0 msgr2=0x7f17540b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 --2- 172.21.15.80:0/3252924839 >> v2:172.21.15.195:3300/0 conn(0x7f17541602a0 0x7f17540b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f175a7ee640 1 -- 172.21.15.80:0/3252924839 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1754164550 con 0x7f17540b7b90 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.775+0000 7f17597ec640 1 --2- 172.21.15.80:0/3252924839 >> v2:172.21.15.195:3300/0 conn(0x7f17541602a0 0x7f17540b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.776+0000 7f175a7ee640 1 --2- 172.21.15.80:0/3252924839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540b7b90 0x7f17540d0980 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f175408e170 tx=0x7f174c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb310d5eb60847aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.776+0000 7f1758feb640 1 -- 172.21.15.80:0/3252924839 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c036070 con 0x7f17540b7b90 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.776+0000 7f1758feb640 1 -- 172.21.15.80:0/3252924839 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c031600 con 0x7f17540b7b90 2024-04-25T15:46:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.776+0000 7f1758feb640 1 -- 172.21.15.80:0/3252924839 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c0319d0 con 0x7f17540b7b90 2024-04-25T15:46:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 -- 172.21.15.80:0/3252924839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540b7b90 msgr2=0x7f17540d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 --2- 172.21.15.80:0/3252924839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540b7b90 0x7f17540d0980 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f175408e170 tx=0x7f174c02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 -- 172.21.15.80:0/3252924839 shutdown_connections 2024-04-25T15:46:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 --2- 172.21.15.80:0/3252924839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540b7b90 0x7f17540d0980 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 --2- 172.21.15.80:0/3252924839 >> v2:172.21.15.195:3300/0 conn(0x7f17541602a0 0x7f17540b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 --2- 172.21.15.80:0/3252924839 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17540d41b0 0x7f17540b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 -- 172.21.15.80:0/3252924839 >> 172.21.15.80:0/3252924839 conn(0x7f175406e9f0 msgr2=0x7f17540d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 -- 172.21.15.80:0/3252924839 shutdown_connections 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.777+0000 7f175c251640 1 -- 172.21.15.80:0/3252924839 wait complete. 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.778+0000 7f175c251640 1 Processor -- start 2024-04-25T15:46:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.778+0000 7f175c251640 1 -- start start 2024-04-25T15:46:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17540b7b90 0x7f1754158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 0x7f175414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17541602a0 0x7f175415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f17540b4fd0 con 0x7f17540d41b0 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1754164b10 con 0x7f17540b7b90 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f17540b5150 con 0x7f17541602a0 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 0x7f175414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 0x7f175414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43352/0 (socket says 172.21.15.80:43352) 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 -- 172.21.15.80:0/2693126345 learned_addr learned my addr 172.21.15.80:0/2693126345 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f1759fed640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17540b7b90 0x7f1754158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175a7ee640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17541602a0 0x7f175415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 -- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17541602a0 msgr2=0x7f175415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17541602a0 0x7f175415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 -- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17540b7b90 msgr2=0x7f1754158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17540b7b90 0x7f1754158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 -- 172.21.15.80:0/2693126345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17541f61c0 con 0x7f17540d41b0 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f1759fed640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17540b7b90 0x7f1754158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f17597ec640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 0x7f175414cd70 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f174400c820 tx=0x7f174400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744015070 con 0x7f17540d41b0 2024-04-25T15:46:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1744007a30 con 0x7f17540d41b0 2024-04-25T15:46:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1754158b00 con 0x7f17540d41b0 2024-04-25T15:46:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744007de0 con 0x7f17540d41b0 2024-04-25T15:46:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.780+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1754161b60 con 0x7f17540d41b0 2024-04-25T15:46:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.782+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175406a100 con 0x7f17540d41b0 2024-04-25T15:46:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.782+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1744018070 con 0x7f17540d41b0 2024-04-25T15:46:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.783+0000 7f174a7fc640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17380744b0 0x7f17380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.783+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6217+0+0 (secure 0 0 0) 0x7f17440953c0 con 0x7f17540d41b0 2024-04-25T15:46:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.783+0000 7f1759fed640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17380744b0 0x7f17380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.783+0000 7f1759fed640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17380744b0 0x7f17380769c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f175000b800 tx=0x7f1750008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:42.787+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f174405f950 con 0x7f17540d41b0 2024-04-25T15:46:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.006+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17540d3070 con 0x7f17540d41b0 2024-04-25T15:46:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.007+0000 7f174a7fc640 1 -- 172.21.15.80:0/2693126345 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5189 (secure 0 0 0) 0x7f174405f250 con 0x7f17540d41b0 2024-04-25T15:46:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:43.009 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:27.174449+0000","modified":"2024-04-25T15:46:30.186896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"a","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6837/1832881946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1832881946},{"type":"v1","addr":"172.21.15.80:6837","nonce":1832881946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-04-25T15:46:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2024-04-25T15:46:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17380744b0 msgr2=0x7f17380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17380744b0 0x7f17380769c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f175000b800 tx=0x7f1750008040 comp rx=0 tx=0).stop 2024-04-25T15:46:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 msgr2=0x7f175414cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 0x7f175414cd70 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f174400c820 tx=0x7f174400cce0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 shutdown_connections 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f17380744b0 0x7f17380769c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17541602a0 0x7f175415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17540d41b0 0x7f175414cd70 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 --2- 172.21.15.80:0/2693126345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17540b7b90 0x7f1754158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 >> 172.21.15.80:0/2693126345 conn(0x7f175406e9f0 msgr2=0x7f17540c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 shutdown_connections 2024-04-25T15:46:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.009+0000 7f175c251640 1 -- 172.21.15.80:0/2693126345 wait complete. 2024-04-25T15:46:43.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.128+0000 7f4aa2892640 1 Processor -- start 2024-04-25T15:46:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.128+0000 7f4aa2892640 1 -- start start 2024-04-25T15:46:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4aa2892640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a9c0b4b60 0x7f4a9c0b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4aa2892640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4a9c06d6d0 0x7f4a9c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4aa2892640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9c0b2f30 con 0x7f4a9c0b3680 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4aa2892640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9c06eb60 con 0x7f4a9c0b4b60 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4aa2892640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9c0b2c90 con 0x7f4a9c06d6d0 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4a9bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a9c0b4b60 0x7f4a9c0b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4a9bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a9c0b4b60 0x7f4a9c0b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43364/0 (socket says 172.21.15.80:43364) 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4a9bfff640 1 -- 172.21.15.80:0/4261300787 learned_addr learned my addr 172.21.15.80:0/4261300787 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.129+0000 7f4a9b7fe640 1 --2- 172.21.15.80:0/4261300787 >> v2:172.21.15.195:3300/0 conn(0x7f4a9c06d6d0 0x7f4a9c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9bfff640 1 -- 172.21.15.80:0/4261300787 >> v2:172.21.15.195:3300/0 conn(0x7f4a9c06d6d0 msgr2=0x7f4a9c0b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9bfff640 1 --2- 172.21.15.80:0/4261300787 >> v2:172.21.15.195:3300/0 conn(0x7f4a9c06d6d0 0x7f4a9c0b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9bfff640 1 -- 172.21.15.80:0/4261300787 >> v1:172.21.15.195:6789/0 conn(0x7f4a9c0b3680 legacy=0x7f4a9c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9bfff640 1 -- 172.21.15.80:0/4261300787 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c0d10a0 con 0x7f4a9c0b4b60 2024-04-25T15:46:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9b7fe640 1 --2- 172.21.15.80:0/4261300787 >> v2:172.21.15.195:3300/0 conn(0x7f4a9c06d6d0 0x7f4a9c0b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9bfff640 1 --2- 172.21.15.80:0/4261300787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c0b91c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0b8b70 tx=0x7f4a8c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aab9b6806259b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9affd640 1 -- 172.21.15.80:0/4261300787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c004030 con 0x7f4a9c0b4b60 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9affd640 1 -- 172.21.15.80:0/4261300787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8c0041d0 con 0x7f4a9c0b4b60 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.130+0000 7f4a9affd640 1 -- 172.21.15.80:0/4261300787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c003610 con 0x7f4a9c0b4b60 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 -- 172.21.15.80:0/4261300787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b4b60 msgr2=0x7f4a9c0b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 --2- 172.21.15.80:0/4261300787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c0b91c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0b8b70 tx=0x7f4a8c02a180 comp rx=0 tx=0).stop 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 -- 172.21.15.80:0/4261300787 shutdown_connections 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 --2- 172.21.15.80:0/4261300787 >> v2:172.21.15.195:3300/0 conn(0x7f4a9c06d6d0 0x7f4a9c0b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 --2- 172.21.15.80:0/4261300787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c0b91c0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 -- 172.21.15.80:0/4261300787 >> 172.21.15.80:0/4261300787 conn(0x7f4a9c0d0450 msgr2=0x7f4a9c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 -- 172.21.15.80:0/4261300787 shutdown_connections 2024-04-25T15:46:43.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.131+0000 7f4aa2892640 1 -- 172.21.15.80:0/4261300787 wait complete. 2024-04-25T15:46:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.133+0000 7f4aa2892640 1 Processor -- start 2024-04-25T15:46:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.133+0000 7f4aa2892640 1 -- start start 2024-04-25T15:46:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.134+0000 7f4aa2892640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a9c06d6d0 0x7f4a9c09eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.134+0000 7f4aa2892640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 0x7f4a9c09d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.134+0000 7f4aa2892640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c09dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.134+0000 7f4aa2892640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c09d0e0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.134+0000 7f4aa2892640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0d1400 con 0x7f4a9c0b4b60 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.134+0000 7f4aa2892640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c09d260 con 0x7f4a9c06d6d0 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 0x7f4a9c09d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 0x7f4a9c09d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43370/0 (socket says 172.21.15.80:43370) 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 -- 172.21.15.80:0/88902610 learned_addr learned my addr 172.21.15.80:0/88902610 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4aa0e2f640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c09dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9bfff640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a9c06d6d0 0x7f4a9c09eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 -- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a9c06d6d0 msgr2=0x7f4a9c09eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a9c06d6d0 0x7f4a9c09eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 -- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a9c0b4b60 msgr2=0x7f4a9c09dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c09dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 -- 172.21.15.80:0/88902610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c1d90b0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9bfff640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a9c06d6d0 0x7f4a9c09eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a9b7fe640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 0x7f4a9c09d790 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c7f0 tx=0x7f4a9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90015070 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90007820 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c1d9d40 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90007bf0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.135+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c1da300 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.136+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c075c90 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.137+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4a90018070 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.137+0000 7f4a98ff9640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a880744b0 0x7f4a880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.137+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6217+0+0 (secure 0 0 0) 0x7f4a900953d0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.137+0000 7f4a9bfff640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a880744b0 0x7f4a880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.138+0000 7f4a9bfff640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a880744b0 0x7f4a880769c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c033000 tx=0x7f4a8c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.142+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a9005f3a0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.320+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a9c0d0be0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.321+0000 7f4a98ff9640 1 -- 172.21.15.80:0/88902610 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+17067 (secure 0 0 0) 0x7f4a900636a0 con 0x7f4a9c0b3680 2024-04-25T15:46:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:43.323 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":88,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:42.878667+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:25.438986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:26.129465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.17","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a880744b0 msgr2=0x7f4a880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a880744b0 0x7f4a880769c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c033000 tx=0x7f4a8c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 msgr2=0x7f4a9c09d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 0x7f4a9c09d790 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c7f0 tx=0x7f4a9000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 shutdown_connections 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a880744b0 0x7f4a880769c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a9c0b4b60 0x7f4a9c09dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a9c0b3680 0x7f4a9c09d790 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 --2- 172.21.15.80:0/88902610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a9c06d6d0 0x7f4a9c09eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 >> 172.21.15.80:0/88902610 conn(0x7f4a9c0d0450 msgr2=0x7f4a9c0d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 shutdown_connections 2024-04-25T15:46:43.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.323+0000 7f4aa2892640 1 -- 172.21.15.80:0/88902610 wait complete. 2024-04-25T15:46:43.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:46:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.443+0000 7f39c10a7640 1 Processor -- start 2024-04-25T15:46:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.443+0000 7f39c10a7640 1 -- start start 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39c10a7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39bc160200 0x7f39bc0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39c10a7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc071df0 con 0x7f39bc0719e0 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39c10a7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc0b6eb0 con 0x7f39bc0cfc40 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39c10a7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f39bc160610 con 0x7f39bc160200 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39ba59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39bc160200 0x7f39bc0714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39ba59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39bc160200 0x7f39bc0714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43382/0 (socket says 172.21.15.80:43382) 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39ba59c640 1 -- 172.21.15.80:0/3839804562 learned_addr learned my addr 172.21.15.80:0/3839804562 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39bb59e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f39bc0719e0 0x7f39bc0b59e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60978/0 (socket says 172.21.15.80:60978) 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39ba59c640 1 -- 172.21.15.80:0/3839804562 >> v1:172.21.15.195:6789/0 conn(0x7f39bc0cfc40 legacy=0x7f39bc164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39ba59c640 1 -- 172.21.15.80:0/3839804562 >> v1:172.21.15.80:6789/0 conn(0x7f39bc0719e0 legacy=0x7f39bc0b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.445+0000 7f39ba59c640 1 -- 172.21.15.80:0/3839804562 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc0b7150 con 0x7f39bc160200 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.446+0000 7f39ba59c640 1 --2- 172.21.15.80:0/3839804562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc160200 0x7f39bc0714a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009870 tx=0x7f39b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1c69ccf45adbc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.446+0000 7f39b9d9b640 1 -- 172.21.15.80:0/3839804562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0037070 con 0x7f39bc160200 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.446+0000 7f39b9d9b640 1 -- 172.21.15.80:0/3839804562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b0032440 con 0x7f39bc160200 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.446+0000 7f39b9d9b640 1 -- 172.21.15.80:0/3839804562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0032810 con 0x7f39bc160200 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 -- 172.21.15.80:0/3839804562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc160200 msgr2=0x7f39bc0714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 --2- 172.21.15.80:0/3839804562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc160200 0x7f39bc0714a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009870 tx=0x7f39b002a270 comp rx=0 tx=0).stop 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 -- 172.21.15.80:0/3839804562 shutdown_connections 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 --2- 172.21.15.80:0/3839804562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc160200 0x7f39bc0714a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 -- 172.21.15.80:0/3839804562 >> 172.21.15.80:0/3839804562 conn(0x7f39bc0d2080 msgr2=0x7f39bc0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 -- 172.21.15.80:0/3839804562 shutdown_connections 2024-04-25T15:46:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.447+0000 7f39c10a7640 1 -- 172.21.15.80:0/3839804562 wait complete. 2024-04-25T15:46:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.449+0000 7f39c10a7640 1 Processor -- start 2024-04-25T15:46:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.449+0000 7f39c10a7640 1 -- start start 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39c10a7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0719e0 0x7f39bc1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39c10a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 0x7f39bc1ea370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39c10a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc160200 0x7f39bc1ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39c10a7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0b7430 con 0x7f39bc0cfc40 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39c10a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0b54c0 con 0x7f39bc160200 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39c10a7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc072040 con 0x7f39bc0719e0 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 0x7f39bc1ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 0x7f39bc1ea370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43390/0 (socket says 172.21.15.80:43390) 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 -- 172.21.15.80:0/2461624615 learned_addr learned my addr 172.21.15.80:0/2461624615 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39bb59e640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc160200 0x7f39bc1ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39bad9d640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0719e0 0x7f39bc1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 -- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0719e0 msgr2=0x7f39bc1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0719e0 0x7f39bc1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 -- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc160200 msgr2=0x7f39bc1ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc160200 0x7f39bc1ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39ba59c640 1 -- 172.21.15.80:0/2461624615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc157850 con 0x7f39bc0cfc40 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.450+0000 7f39bb59e640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc160200 0x7f39bc1ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.451+0000 7f39ba59c640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 0x7f39bc1ea370 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009870 tx=0x7f39b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.451+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0041020 con 0x7f39bc0cfc40 2024-04-25T15:46:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.451+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b0030970 con 0x7f39bc0cfc40 2024-04-25T15:46:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.451+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc157b30 con 0x7f39bc0cfc40 2024-04-25T15:46:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.451+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0037040 con 0x7f39bc0cfc40 2024-04-25T15:46:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.451+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc1580f0 con 0x7f39bc0cfc40 2024-04-25T15:46:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.452+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39bc15ca10 con 0x7f39bc0cfc40 2024-04-25T15:46:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.452+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f39b0044020 con 0x7f39bc0cfc40 2024-04-25T15:46:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.453+0000 7f39a37fe640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39a80744b0 0x7f39a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.453+0000 7f39bad9d640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39a80744b0 0x7f39a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.453+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6217+0+0 (secure 0 0 0) 0x7f39b00b5e00 con 0x7f39bc0cfc40 2024-04-25T15:46:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.453+0000 7f39bad9d640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39a80744b0 0x7f39a80769c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f39ac001ca0 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.458+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39bc15ca10 con 0x7f39bc0cfc40 2024-04-25T15:46:43.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.668+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f39bc06a100 con 0x7f39bc0cfc40 2024-04-25T15:46:43.687 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:46:43.668+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.670+0000 7f39a37fe640 1 -- 172.21.15.80:0/2461624615 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) ==== 161+0+0 (secure 0 0 0) 0x7f39b004b030 con 0x7f39bc0cfc40 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39a80744b0 msgr2=0x7f39a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39a80744b0 0x7f39a80769c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f39ac001ca0 tx=0x7f39ac009040 comp rx=0 tx=0).stop 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 msgr2=0x7f39bc1ea370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 0x7f39bc1ea370 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009870 tx=0x7f39b00046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 shutdown_connections 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f39a80744b0 0x7f39a80769c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39bc160200 0x7f39bc1ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39bc0cfc40 0x7f39bc1ea370 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 --2- 172.21.15.80:0/2461624615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f39bc0719e0 0x7f39bc1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 >> 172.21.15.80:0/2461624615 conn(0x7f39bc0d2080 msgr2=0x7f39bc15c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 shutdown_connections 2024-04-25T15:46:43.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.674+0000 7f39c10a7640 1 -- 172.21.15.80:0/2461624615 wait complete. 2024-04-25T15:46:43.690 INFO:tasks.ceph.mds.a.smithi080.stderr: -2172> 2024-04-25T15:46:32.776+0000 7f8fa964e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:46:43.691 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:46:43.726 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:46:43.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.802+0000 7f62e9d06640 1 Processor -- start 2024-04-25T15:46:43.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.802+0000 7f62e9d06640 1 -- start start 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.803+0000 7f62e9d06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62e416b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.803+0000 7f62e9d06640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e40d57e0 con 0x7f62e40d0b00 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.803+0000 7f62e9d06640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e41643f0 con 0x7f62e40b5490 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.803+0000 7f62e9d06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62e41646d0 con 0x7f62e40d2d50 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.803+0000 7f62e2ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f62e40d0b00 0x7f62e40d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60994/0 (socket says 172.21.15.80:60994) 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.803+0000 7f62e2ffd640 1 -- 172.21.15.80:0/2311263683 learned_addr learned my addr 172.21.15.80:0/2311263683 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518540623 0 0) 0x7f62e40d57e0 con 0x7f62e40d0b00 2024-04-25T15:46:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62cc003520 con 0x7f62e40d0b00 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e3fff640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62e416b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4200525496 0 0) 0x7f62cc003520 con 0x7f62e40d0b00 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 msgr2=0x7f62e416b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62e416b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 >> v1:172.21.15.195:6789/0 conn(0x7f62e40b5490 legacy=0x7f62e4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41649b0 con 0x7f62e40d0b00 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f62d4001670 con 0x7f62e40d0b00 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e3fff640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62e416b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 >> v1:172.21.15.80:6789/0 conn(0x7f62e40d0b00 legacy=0x7f62e40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc0039e0 0x7f62cc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62cc004800 0x7f62cc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62cc005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41646d0 con 0x7f62cc004800 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc00bb80 con 0x7f62cc0039e0 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62cc00bd80 con 0x7f62e40d2d50 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e2ffd640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62cc004800 0x7f62cc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e37fe640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc0039e0 0x7f62cc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e3fff640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62cc005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e2ffd640 1 -- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 msgr2=0x7f62cc005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e2ffd640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62e40d2d50 0x7f62cc005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e2ffd640 1 -- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc0039e0 msgr2=0x7f62cc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e2ffd640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc0039e0 0x7f62cc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e2ffd640 1 -- 172.21.15.80:0/2311263683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc003520 con 0x7f62cc004800 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.804+0000 7f62e37fe640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc0039e0 0x7f62cc003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.805+0000 7f62e2ffd640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62cc004800 0x7f62cc004c10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c240 tx=0x7f62cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ce6a73a2269934 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.805+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4007cf0 con 0x7f62cc004800 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.805+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d40058d0 con 0x7f62cc004800 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.805+0000 7f62e27fc640 1 -- 172.21.15.80:0/2311263683 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4005ce0 con 0x7f62cc004800 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e9d06640 1 -- 172.21.15.80:0/2311263683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62cc004800 msgr2=0x7f62cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2311263683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62cc004800 0x7f62cc004c10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c240 tx=0x7f62cc005830 comp rx=0 tx=0).stop 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e3fff640 1 -- 172.21.15.80:0/2311263683 reap_dead start 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e9d06640 1 -- 172.21.15.80:0/2311263683 shutdown_connections 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e9d06640 1 -- 172.21.15.80:0/2311263683 >> 172.21.15.80:0/2311263683 conn(0x7f62e406e650 msgr2=0x7f62e406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e9d06640 1 -- 172.21.15.80:0/2311263683 shutdown_connections 2024-04-25T15:46:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.806+0000 7f62e9d06640 1 -- 172.21.15.80:0/2311263683 wait complete. 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.808+0000 7f62e9d06640 1 Processor -- start 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.808+0000 7f62e9d06640 1 -- start start 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e9d06640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc004800 0x7f62e40ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e9d06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e415a4f0 0x7f62e4150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e9d06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 0x7f62e40cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e9d06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40b94e0 con 0x7f62e40cb5e0 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e9d06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40b9360 con 0x7f62e415a4f0 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e9d06640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62e4163f80 con 0x7f62cc004800 2024-04-25T15:46:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 0x7f62e40cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 0x7f62e40cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43434/0 (socket says 172.21.15.80:43434) 2024-04-25T15:46:43.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e3fff640 1 -- 172.21.15.80:0/2775450027 learned_addr learned my addr 172.21.15.80:0/2775450027 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e37fe640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc004800 0x7f62e40ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.809+0000 7f62e2ffd640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e415a4f0 0x7f62e4150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e3fff640 1 -- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc004800 msgr2=0x7f62e40ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e3fff640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc004800 0x7f62e40ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e3fff640 1 -- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e415a4f0 msgr2=0x7f62e4150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e3fff640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e415a4f0 0x7f62e4150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e3fff640 1 -- 172.21.15.80:0/2775450027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e40cbf30 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e37fe640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc004800 0x7f62e40ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e2ffd640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e415a4f0 0x7f62e4150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e3fff640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 0x7f62e40cb9f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f62e40d22f0 tx=0x7f62dc010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc010d20 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc003990 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e40cabe0 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc003b80 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.810+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e40cb1a0 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.811+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e40ca950 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.812+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f62dc01e030 con 0x7f62e40cb5e0 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.812+0000 7f62cbfff640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62d00744e0 0x7f62d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.812+0000 7f62e37fe640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62d00744e0 0x7f62d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.812+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6303+0+0 (secure 0 0 0) 0x7f62dc095b30 con 0x7f62e40cb5e0 2024-04-25T15:46:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.813+0000 7f62e37fe640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62d00744e0 0x7f62d00769f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f62d8007fd0 tx=0x7f62d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:43.817+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62dc025020 con 0x7f62e40cb5e0 2024-04-25T15:46:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.038+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f62e406ef90 con 0x7f62e40cb5e0 2024-04-25T15:46:44.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.671+0000 7f62cbfff640 1 -- 172.21.15.80:0/2775450027 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f62e406ef90 con 0x7f62e40cb5e0 2024-04-25T15:46:44.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62d00744e0 msgr2=0x7f62d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62d00744e0 0x7f62d00769f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f62d8007fd0 tx=0x7f62d8009040 comp rx=0 tx=0).stop 2024-04-25T15:46:44.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 msgr2=0x7f62e40cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 0x7f62e40cb9f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f62e40d22f0 tx=0x7f62dc010530 comp rx=0 tx=0).stop 2024-04-25T15:46:44.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 shutdown_connections 2024-04-25T15:46:44.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f62d00744e0 0x7f62d00769f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62e40cb5e0 0x7f62e40cb9f0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e415a4f0 0x7f62e4150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 --2- 172.21.15.80:0/2775450027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc004800 0x7f62e40ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 >> 172.21.15.80:0/2775450027 conn(0x7f62e406e650 msgr2=0x7f62e40cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:44.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 shutdown_connections 2024-04-25T15:46:44.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.674+0000 7f62e9d06640 1 -- 172.21.15.80:0/2775450027 wait complete. 2024-04-25T15:46:44.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:46:44.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.841+0000 7fb24a134640 1 Processor -- start 2024-04-25T15:46:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.841+0000 7fb24a134640 1 -- start start 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb24a134640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 0x7fb2440b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb24a134640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb2440b2a40 0x7fb24409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb24a134640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2440b9350 con 0x7fb2440d2120 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb24a134640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb2440cfb70 con 0x7fb2440b2a40 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb24a134640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440cf890 con 0x7fb2440cff30 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb243fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb2440d2120 0x7fb2440d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59592/0 (socket says 172.21.15.80:59592) 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb243fff640 1 -- 172.21.15.80:0/3427778569 learned_addr learned my addr 172.21.15.80:0/3427778569 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb242ffd640 1 --2- 172.21.15.80:0/3427778569 >> v2:172.21.15.195:3300/0 conn(0x7fb2440b2a40 0x7fb24409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2437fe640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 0x7fb2440b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616772636 0 0) 0x7fb2440b9350 con 0x7fb2440d2120 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c003520 con 0x7fb2440d2120 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3007071574 0 0) 0x7fb22c003520 con 0x7fb2440d2120 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 msgr2=0x7fb2440b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 0x7fb2440b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 >> v2:172.21.15.195:3300/0 conn(0x7fb2440b2a40 msgr2=0x7fb24409ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 --2- 172.21.15.80:0/3427778569 >> v2:172.21.15.195:3300/0 conn(0x7fb2440b2a40 0x7fb24409ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2440b9020 con 0x7fb2440d2120 2024-04-25T15:46:44.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb23c0019f0 con 0x7fb2440d2120 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 >> v1:172.21.15.80:6789/0 conn(0x7fb2440d2120 legacy=0x7fb2440d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 0x7fb22c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c003f30 0x7fb22c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb22c004d40 0x7fb22c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440cfb70 con 0x7fb22c004d40 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440cf890 con 0x7fb22c003f30 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.843+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c00bac0 con 0x7fb2440cff30 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb243fff640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb22c004d40 0x7fb22c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb242ffd640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c003f30 0x7fb22c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb243fff640 1 -- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 msgr2=0x7fb22c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb243fff640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2440cff30 0x7fb22c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb243fff640 1 -- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c003f30 msgr2=0x7fb22c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb243fff640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c003f30 0x7fb22c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.844+0000 7fb243fff640 1 -- 172.21.15.80:0/3427778569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c003520 con 0x7fb22c004d40 2024-04-25T15:46:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb243fff640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb22c004d40 0x7fb22c005150 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0013d0 tx=0x7fb22c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4563353052e63da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00a4e0 con 0x7fb22c004d40 2024-04-25T15:46:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c02f070 con 0x7fb22c004d40 2024-04-25T15:46:44.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb2427fc640 1 -- 172.21.15.80:0/3427778569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c02bce0 con 0x7fb22c004d40 2024-04-25T15:46:44.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb24a134640 1 -- 172.21.15.80:0/3427778569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb22c004d40 msgr2=0x7fb22c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb24a134640 1 --2- 172.21.15.80:0/3427778569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb22c004d40 0x7fb22c005150 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0013d0 tx=0x7fb22c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:44.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb243fff640 1 -- 172.21.15.80:0/3427778569 reap_dead start 2024-04-25T15:46:44.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb24a134640 1 -- 172.21.15.80:0/3427778569 shutdown_connections 2024-04-25T15:46:44.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb24a134640 1 -- 172.21.15.80:0/3427778569 >> 172.21.15.80:0/3427778569 conn(0x7fb2440d0450 msgr2=0x7fb2440d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb24a134640 1 -- 172.21.15.80:0/3427778569 shutdown_connections 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.845+0000 7fb24a134640 1 -- 172.21.15.80:0/3427778569 wait complete. 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.847+0000 7fb24a134640 1 Processor -- start 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.847+0000 7fb24a134640 1 -- start start 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24415cfe0 0x7fb24409fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24415d3f0 0x7fb24409d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 0x7fb24409dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440d10f0 con 0x7fb2440a0150 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440d0f70 con 0x7fb24415d3f0 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440b7230 con 0x7fb24415cfe0 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 0x7fb24409dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 0x7fb24409dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34220/0 (socket says 172.21.15.80:34220) 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 -- 172.21.15.80:0/43064889 learned_addr learned my addr 172.21.15.80:0/43064889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb2437fe640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24415cfe0 0x7fb24409fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb242ffd640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24415d3f0 0x7fb24409d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 -- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24415cfe0 msgr2=0x7fb24409fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24415cfe0 0x7fb24409fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 -- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24415d3f0 msgr2=0x7fb24409d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24415d3f0 0x7fb24409d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 -- 172.21.15.80:0/43064889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2441f4310 con 0x7fb2440a0150 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb243fff640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 0x7fb24409dcd0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00a0b0 tx=0x7fb23c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c002040 con 0x7fb2440a0150 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c00a4c0 con 0x7fb2440a0150 2024-04-25T15:46:44.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24409e680 con 0x7fb2440a0150 2024-04-25T15:46:44.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.849+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0346b0 con 0x7fb2440a0150 2024-04-25T15:46:44.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.850+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24409ec40 con 0x7fb2440a0150 2024-04-25T15:46:44.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.851+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2440d28f0 con 0x7fb2440a0150 2024-04-25T15:46:44.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.851+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb23c046060 con 0x7fb2440a0150 2024-04-25T15:46:44.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.852+0000 7fb22bfff640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2300744e0 0x7fb2300769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.852+0000 7fb2437fe640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2300744e0 0x7fb2300769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.852+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6303+0+0 (secure 0 0 0) 0x7fb23c0b50e0 con 0x7fb2440a0150 2024-04-25T15:46:44.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.852+0000 7fb2437fe640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2300744e0 0x7fb2300769f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2440d0a80 tx=0x7fb2340092a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:44.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:44.857+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2440d28f0 con 0x7fb2440a0150 2024-04-25T15:46:45.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.033+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb24406a100 con 0x7fb2440a0150 2024-04-25T15:46:45.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.900+0000 7fb22bfff640 1 -- 172.21.15.80:0/43064889 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7fb23c07f0f0 con 0x7fb2440a0150 2024-04-25T15:46:45.902 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:46:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2300744e0 msgr2=0x7fb2300769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2300744e0 0x7fb2300769f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2440d0a80 tx=0x7fb2340092a0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 msgr2=0x7fb24409dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 0x7fb24409dcd0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00a0b0 tx=0x7fb23c001360 comp rx=0 tx=0).stop 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 shutdown_connections 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb2300744e0 0x7fb2300769f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2440a0150 0x7fb24409dcd0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24415d3f0 0x7fb24409d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 --2- 172.21.15.80:0/43064889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24415cfe0 0x7fb24409fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.904+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 >> 172.21.15.80:0/43064889 conn(0x7fb2440d0450 msgr2=0x7fb244072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.905+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 shutdown_connections 2024-04-25T15:46:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:45.905+0000 7fb24a134640 1 -- 172.21.15.80:0/43064889 wait complete. 2024-04-25T15:46:45.919 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.035+0000 7f3bd9e51640 1 Processor -- start 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.035+0000 7f3bd9e51640 1 -- start start 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.036+0000 7f3bd9e51640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bd4074240 0x7f3bd415c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.036+0000 7f3bd9e51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd9e51640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd40703e0 con 0x7f3bd40b0d80 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd9e51640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd40affc0 con 0x7f3bd4074240 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd9e51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd40b02a0 con 0x7f3bd40b65a0 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bd4074240 0x7f3bd415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bd4074240 0x7f3bd415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34226/0 (socket says 172.21.15.80:34226) 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 -- 172.21.15.80:0/761360795 learned_addr learned my addr 172.21.15.80:0/761360795 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 -- 172.21.15.80:0/761360795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 msgr2=0x7f3bd40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd3fff640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 -- 172.21.15.80:0/761360795 >> v1:172.21.15.195:6789/0 conn(0x7f3bd40b0d80 legacy=0x7f3bd4073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd2ffd640 1 -- 172.21.15.80:0/761360795 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd40b0580 con 0x7f3bd4074240 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.037+0000 7f3bd3fff640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.038+0000 7f3bd2ffd640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd4074240 0x7f3bd415c670 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800bb00 tx=0x7f3bc802c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c670a9b5073fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.038+0000 7f3bd27fc640 1 -- 172.21.15.80:0/761360795 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc803a070 con 0x7f3bd4074240 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.038+0000 7f3bd27fc640 1 -- 172.21.15.80:0/761360795 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc8032480 con 0x7f3bd4074240 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.038+0000 7f3bd27fc640 1 -- 172.21.15.80:0/761360795 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8032850 con 0x7f3bd4074240 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 -- 172.21.15.80:0/761360795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd4074240 msgr2=0x7f3bd415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd4074240 0x7f3bd415c670 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800bb00 tx=0x7f3bc802c690 comp rx=0 tx=0).stop 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 -- 172.21.15.80:0/761360795 shutdown_connections 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/761360795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd4074240 0x7f3bd415c670 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 -- 172.21.15.80:0/761360795 >> 172.21.15.80:0/761360795 conn(0x7f3bd40d1e20 msgr2=0x7f3bd4073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 -- 172.21.15.80:0/761360795 shutdown_connections 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.039+0000 7f3bd9e51640 1 -- 172.21.15.80:0/761360795 wait complete. 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.040+0000 7f3bd9e51640 1 Processor -- start 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.041+0000 7f3bd9e51640 1 -- start start 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd9e51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd40b0d80 0x7f3bd415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd9e51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd4154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd9e51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 0x7f3bd41530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd9e51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd406fe10 con 0x7f3bd415c670 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd9e51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd40ae7c0 con 0x7f3bd40b0d80 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd9e51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd406ff90 con 0x7f3bd40b65a0 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 0x7f3bd41530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 0x7f3bd41530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34230/0 (socket says 172.21.15.80:34230) 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 -- 172.21.15.80:0/3223336662 learned_addr learned my addr 172.21.15.80:0/3223336662 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd37fe640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd40b0d80 0x7f3bd415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd2ffd640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd4154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 -- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 msgr2=0x7f3bd4154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd4154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 -- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd40b0d80 msgr2=0x7f3bd415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd40b0d80 0x7f3bd415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 -- 172.21.15.80:0/3223336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd4153610 con 0x7f3bd415c670 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.042+0000 7f3bd3fff640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 0x7f3bd41530d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cd50 tx=0x7f3bcc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.043+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00f680 con 0x7f3bd415c670 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.043+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00f840 con 0x7f3bd415c670 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.043+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00fc30 con 0x7f3bd415c670 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.043+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd415cd50 con 0x7f3bd415c670 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.043+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd415d310 con 0x7f3bd415c670 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.044+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd406a100 con 0x7f3bd415c670 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.044+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3bcc0213f0 con 0x7f3bd415c670 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.045+0000 7f3bbbfff640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bc00744b0 0x7f3bc00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.045+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5865+0+0 (secure 0 0 0) 0x7f3bcc095ea0 con 0x7f3bd415c670 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.045+0000 7f3bd37fe640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bc00744b0 0x7f3bc00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.045+0000 7f3bd37fe640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bc00744b0 0x7f3bc00769c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006fd0 tx=0x7f3bc4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.050+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3bd4153610 con 0x7f3bd415c670 2024-04-25T15:46:46.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.226+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3bd415ca80 con 0x7f3bd415c670 2024-04-25T15:46:46.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.903+0000 7f3bbbfff640 1 -- 172.21.15.80:0/3223336662 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f3bcc014030 con 0x7f3bd415c670 2024-04-25T15:46:46.904 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:46:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bc00744b0 msgr2=0x7f3bc00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bc00744b0 0x7f3bc00769c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006fd0 tx=0x7f3bc4009060 comp rx=0 tx=0).stop 2024-04-25T15:46:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 msgr2=0x7f3bd41530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 0x7f3bd41530d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cd50 tx=0x7f3bcc00a650 comp rx=0 tx=0).stop 2024-04-25T15:46:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 shutdown_connections 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3bc00744b0 0x7f3bc00769c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd415c670 0x7f3bd41530d0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3bd40b65a0 0x7f3bd4154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 --2- 172.21.15.80:0/3223336662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd40b0d80 0x7f3bd415ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.908+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 >> 172.21.15.80:0/3223336662 conn(0x7f3bd40d1e20 msgr2=0x7f3bd40b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.909+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 shutdown_connections 2024-04-25T15:46:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:46.909+0000 7f3bd9e51640 1 -- 172.21.15.80:0/3223336662 wait complete. 2024-04-25T15:46:46.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T15:46:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.037+0000 7f2cb0a51640 1 Processor -- start 2024-04-25T15:46:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.037+0000 7f2cb0a51640 1 -- start start 2024-04-25T15:46:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2cb0a51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac15e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2cb0a51640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2cac0cee90 0x7f2cac0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2cb0a51640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cac0d0cd0 con 0x7f2cac0d08c0 2024-04-25T15:46:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2cb0a51640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2cac161b00 con 0x7f2cac0cee90 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2cb0a51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac161dc0 con 0x7f2cac0b2b80 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2ca3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2cac0cee90 0x7f2cac0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2caad9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2cac0d08c0 0x7f2cac071970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59606/0 (socket says 172.21.15.80:59606) 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.038+0000 7f2caad9d640 1 -- 172.21.15.80:0/2028273818 learned_addr learned my addr 172.21.15.80:0/2028273818 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2caa59c640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca3fff640 1 -- 172.21.15.80:0/2028273818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 msgr2=0x7f2cac15e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca3fff640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac15e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca3fff640 1 -- 172.21.15.80:0/2028273818 >> v1:172.21.15.80:6789/0 conn(0x7f2cac0d08c0 legacy=0x7f2cac071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca9d9b640 1 -- 172.21.15.80:0/2028273818 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567672713 0 0) 0x7f2cac0d0cd0 con 0x7f2cac0d08c0 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca3fff640 1 -- 172.21.15.80:0/2028273818 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac1620a0 con 0x7f2cac0cee90 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2caa59c640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca3fff640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0cee90 0x7f2cac0d0380 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2c940097a0 tx=0x7f2c9402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f051311903a1aad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca9d9b640 1 -- 172.21.15.80:0/2028273818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94037070 con 0x7f2cac0cee90 2024-04-25T15:46:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca9d9b640 1 -- 172.21.15.80:0/2028273818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c9402ae50 con 0x7f2cac0cee90 2024-04-25T15:46:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.039+0000 7f2ca9d9b640 1 -- 172.21.15.80:0/2028273818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94032660 con 0x7f2cac0cee90 2024-04-25T15:46:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 -- 172.21.15.80:0/2028273818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0cee90 msgr2=0x7f2cac0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0cee90 0x7f2cac0d0380 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2c940097a0 tx=0x7f2c9402a100 comp rx=0 tx=0).stop 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 -- 172.21.15.80:0/2028273818 shutdown_connections 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0cee90 0x7f2cac0d0380 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/2028273818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 -- 172.21.15.80:0/2028273818 >> 172.21.15.80:0/2028273818 conn(0x7f2cac0b54a0 msgr2=0x7f2cac0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 -- 172.21.15.80:0/2028273818 shutdown_connections 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.040+0000 7f2cb0a51640 1 -- 172.21.15.80:0/2028273818 wait complete. 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.042+0000 7f2cb0a51640 1 Processor -- start 2024-04-25T15:46:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.042+0000 7f2cb0a51640 1 -- start start 2024-04-25T15:46:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.043+0000 7f2cb0a51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cac0cee90 0x7f2cac0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 0x7f2cac0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac162940 con 0x7f2cac0d08c0 2024-04-25T15:46:47.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac162660 con 0x7f2cac0cee90 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac0cf2a0 con 0x7f2cac0b2b80 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 0x7f2cac0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 0x7f2cac0c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34248/0 (socket says 172.21.15.80:34248) 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 -- 172.21.15.80:0/3184340774 learned_addr learned my addr 172.21.15.80:0/3184340774 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caa59c640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2ca3fff640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cac0cee90 0x7f2cac0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 -- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 msgr2=0x7f2cac158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 -- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cac0cee90 msgr2=0x7f2cac0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cac0cee90 0x7f2cac0c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 -- 172.21.15.80:0/3184340774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac15f9a0 con 0x7f2cac0d08c0 2024-04-25T15:46:47.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2caad9d640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 0x7f2cac0c9ea0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c7b0 tx=0x7f2ca400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4018070 con 0x7f2cac0d08c0 2024-04-25T15:46:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca400a640 con 0x7f2cac0d08c0 2024-04-25T15:46:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac15fc80 con 0x7f2cac0d08c0 2024-04-25T15:46:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400ce60 con 0x7f2cac0d08c0 2024-04-25T15:46:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.044+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac160240 con 0x7f2cac0d08c0 2024-04-25T15:46:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.046+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac06a100 con 0x7f2cac0d08c0 2024-04-25T15:46:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.046+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2ca401b070 con 0x7f2cac0d08c0 2024-04-25T15:46:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.047+0000 7f2ca2ffd640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c8c0744e0 0x7f2c8c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.047+0000 7f2caa59c640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c8c0744e0 0x7f2c8c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.047+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7f2ca4094510 con 0x7f2cac0d08c0 2024-04-25T15:46:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.047+0000 7f2caa59c640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c8c0744e0 0x7f2c8c0769f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00aac0 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.051+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ca405e7c0 con 0x7f2cac0d08c0 2024-04-25T15:46:47.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.226+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2cac0d1c50 con 0x7f2cac0d08c0 2024-04-25T15:46:47.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.230+0000 7f2ca2ffd640 1 -- 172.21.15.80:0/3184340774 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f2ca4062ac0 con 0x7f2cac0d08c0 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c8c0744e0 msgr2=0x7f2c8c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c8c0744e0 0x7f2c8c0769f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00aac0 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 msgr2=0x7f2cac0c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 0x7f2cac0c9ea0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c7b0 tx=0x7f2ca400cc70 comp rx=0 tx=0).stop 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 shutdown_connections 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c8c0744e0 0x7f2c8c0769f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac0d08c0 0x7f2cac0c9ea0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cac0cee90 0x7f2cac0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 --2- 172.21.15.80:0/3184340774 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2cac0b2b80 0x7f2cac158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 >> 172.21.15.80:0/3184340774 conn(0x7f2cac0b54a0 msgr2=0x7f2cac06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 shutdown_connections 2024-04-25T15:46:47.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.232+0000 7f2cb0a51640 1 -- 172.21.15.80:0/3184340774 wait complete. 2024-04-25T15:46:47.244 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-04-25T15:46:47.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.349+0000 7ff1d8f72640 1 Processor -- start 2024-04-25T15:46:47.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.349+0000 7ff1d8f72640 1 -- start start 2024-04-25T15:46:47.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d8f72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1d406db10 0x7ff1d415e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d8f72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d8f72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d4071df0 con 0x7ff1d406c5c0 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d8f72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d415faf0 con 0x7ff1d406db10 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d8f72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d41589c0 con 0x7ff1d40714a0 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1d406db10 0x7ff1d415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1d406db10 0x7ff1d415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34258/0 (socket says 172.21.15.80:34258) 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 -- 172.21.15.80:0/1048621725 learned_addr learned my addr 172.21.15.80:0/1048621725 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d1d9b640 1 --2- 172.21.15.80:0/1048621725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 -- 172.21.15.80:0/1048621725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 msgr2=0x7ff1d40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 --2- 172.21.15.80:0/1048621725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 -- 172.21.15.80:0/1048621725 >> v1:172.21.15.195:6789/0 conn(0x7ff1d406c5c0 legacy=0x7ff1d406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.351+0000 7ff1d259c640 1 -- 172.21.15.80:0/1048621725 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d415ee90 con 0x7ff1d406db10 2024-04-25T15:46:47.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.352+0000 7ff1d259c640 1 --2- 172.21.15.80:0/1048621725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406db10 0x7ff1d415e520 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009e50 tx=0x7ff1c402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e879841d61bf09a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.352+0000 7ff1d159a640 1 -- 172.21.15.80:0/1048621725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4036070 con 0x7ff1d406db10 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.352+0000 7ff1d159a640 1 -- 172.21.15.80:0/1048621725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c4031600 con 0x7ff1d406db10 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.352+0000 7ff1d159a640 1 -- 172.21.15.80:0/1048621725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40319d0 con 0x7ff1d406db10 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1048621725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406db10 msgr2=0x7ff1d415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1048621725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406db10 0x7ff1d415e520 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009e50 tx=0x7ff1c402a710 comp rx=0 tx=0).stop 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1048621725 shutdown_connections 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1048621725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1048621725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406db10 0x7ff1d415e520 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1048621725 >> 172.21.15.80:0/1048621725 conn(0x7ff1d40d2080 msgr2=0x7ff1d40d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1048621725 shutdown_connections 2024-04-25T15:46:47.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.353+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1048621725 wait complete. 2024-04-25T15:46:47.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.355+0000 7ff1d8f72640 1 Processor -- start 2024-04-25T15:46:47.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.355+0000 7ff1d8f72640 1 -- start start 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d8f72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 0x7ff1d415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d8f72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d406db10 0x7ff1d415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d8f72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d41417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d8f72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d415f450 con 0x7ff1d406c5c0 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d8f72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d415f780 con 0x7ff1d406db10 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d8f72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d415ea60 con 0x7ff1d40714a0 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 0x7ff1d415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 0x7ff1d415ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34266/0 (socket says 172.21.15.80:34266) 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 -- 172.21.15.80:0/1816136804 learned_addr learned my addr 172.21.15.80:0/1816136804 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:47.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d1d9b640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d406db10 0x7ff1d415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d2d9d640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d41417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 -- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 msgr2=0x7ff1d41417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d41417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 -- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d406db10 msgr2=0x7ff1d415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d406db10 0x7ff1d415b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d259c640 1 -- 172.21.15.80:0/1816136804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d4140720 con 0x7ff1d406c5c0 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d1d9b640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d406db10 0x7ff1d415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.356+0000 7ff1d2d9d640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d41417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.357+0000 7ff1d259c640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 0x7ff1d415ad10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009e50 tx=0x7ff1c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.357+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4036050 con 0x7ff1d406c5c0 2024-04-25T15:46:47.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.357+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c4042070 con 0x7ff1d406c5c0 2024-04-25T15:46:47.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.357+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d4140a00 con 0x7ff1d406c5c0 2024-04-25T15:46:47.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.357+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4009510 con 0x7ff1d406c5c0 2024-04-25T15:46:47.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.357+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d4140fc0 con 0x7ff1d406c5c0 2024-04-25T15:46:47.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.358+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d406a100 con 0x7ff1d406c5c0 2024-04-25T15:46:47.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.359+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff1c4007c50 con 0x7ff1d406c5c0 2024-04-25T15:46:47.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.359+0000 7ff1c2ffd640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff1b40744b0 0x7ff1b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.359+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7ff1c40b6a80 con 0x7ff1d406c5c0 2024-04-25T15:46:47.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.359+0000 7ff1d1d9b640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff1b40744b0 0x7ff1b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.360+0000 7ff1d1d9b640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff1b40744b0 0x7ff1b40769c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8006fd0 tx=0x7ff1c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.363+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff1c4081610 con 0x7ff1d406c5c0 2024-04-25T15:46:47.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.603+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) -- 0x7ff1d40b1a00 con 0x7ff1d406c5c0 2024-04-25T15:46:47.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.908+0000 7ff1c2ffd640 1 -- 172.21.15.80:0/1816136804 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v240) ==== 145+0+0 (secure 0 0 0) 0x7ff1c4080f10 con 0x7ff1d406c5c0 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff1b40744b0 msgr2=0x7ff1b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff1b40744b0 0x7ff1b40769c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8006fd0 tx=0x7ff1c8008040 comp rx=0 tx=0).stop 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 msgr2=0x7ff1d415ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 0x7ff1d415ad10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009e50 tx=0x7ff1c4004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 shutdown_connections 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff1b40744b0 0x7ff1b40769c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff1d40714a0 0x7ff1d41417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1d406db10 0x7ff1d415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 --2- 172.21.15.80:0/1816136804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d406c5c0 0x7ff1d415ad10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 >> 172.21.15.80:0/1816136804 conn(0x7ff1d40d2080 msgr2=0x7ff1d415d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 shutdown_connections 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:47.910+0000 7ff1d8f72640 1 -- 172.21.15.80:0/1816136804 wait complete. 2024-04-25T15:46:47.922 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-04-25T15:46:47.922 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2024-04-25T15:46:47.923 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-25T15:46:47.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:48.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.029+0000 7f37f199d640 1 Processor -- start 2024-04-25T15:46:48.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.029+0000 7f37f199d640 1 -- start start 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37f199d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 0x7f37ec0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37f199d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37ec0b7fa0 con 0x7f37ec0d41b0 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37f199d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37ec163fb0 con 0x7f37ec0b7b90 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37f199d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec164270 con 0x7f37ec0b48d0 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37eaffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f37ec0d41b0 0x7f37ec1602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59608/0 (socket says 172.21.15.80:59608) 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37eaffd640 1 -- 172.21.15.80:0/2298218147 learned_addr learned my addr 172.21.15.80:0/2298218147 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529228151 0 0) 0x7f37dc001110 con 0x7f37ec0d41b0 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37d4003520 con 0x7f37ec0d41b0 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37ea7fc640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 0x7f37ec0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3752561766 0 0) 0x7f37d4003520 con 0x7f37ec0d41b0 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 msgr2=0x7f37ec0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 0x7f37ec0b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 >> v1:172.21.15.195:6789/0 conn(0x7f37ec0b7b90 legacy=0x7f37ec0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec164550 con 0x7f37ec0d41b0 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f37dc001840 con 0x7f37ec0d41b0 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 >> v1:172.21.15.80:6789/0 conn(0x7f37ec0d41b0 legacy=0x7f37ec1602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.031+0000 7f37e9ffb640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d40039e0 0x7f37d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37e9ffb640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 0x7f37d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37e9ffb640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37d4004d40 0x7f37d4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec164270 con 0x7f37d4004d40 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f37d400baf0 con 0x7f37d40039e0 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f37d400bcf0 con 0x7f37ec0b48d0 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37d4004d40 0x7f37d4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eaffd640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d40039e0 0x7f37d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37ea7fc640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 0x7f37d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eb7fe640 1 -- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 msgr2=0x7f37d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec0b48d0 0x7f37d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eb7fe640 1 -- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d40039e0 msgr2=0x7f37d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d40039e0 0x7f37d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.032+0000 7f37eb7fe640 1 -- 172.21.15.80:0/2298218147 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d4003520 con 0x7f37d4004d40 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37d4004d40 0x7f37d4005150 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f37e4001e50 tx=0x7f37d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db7e34630762c9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4001a70 con 0x7f37d4004d40 2024-04-25T15:46:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4003970 con 0x7f37d4004d40 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37e9ffb640 1 -- 172.21.15.80:0/2298218147 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4003d60 con 0x7f37d4004d40 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37f199d640 1 -- 172.21.15.80:0/2298218147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37d4004d40 msgr2=0x7f37d4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37f199d640 1 --2- 172.21.15.80:0/2298218147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37d4004d40 0x7f37d4005150 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f37e4001e50 tx=0x7f37d4005830 comp rx=0 tx=0).stop 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37eb7fe640 1 -- 172.21.15.80:0/2298218147 reap_dead start 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37f199d640 1 -- 172.21.15.80:0/2298218147 shutdown_connections 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.033+0000 7f37f199d640 1 -- 172.21.15.80:0/2298218147 >> 172.21.15.80:0/2298218147 conn(0x7f37ec06e9f0 msgr2=0x7f37ec0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.034+0000 7f37f199d640 1 -- 172.21.15.80:0/2298218147 shutdown_connections 2024-04-25T15:46:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.034+0000 7f37f199d640 1 -- 172.21.15.80:0/2298218147 wait complete. 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.035+0000 7f37f199d640 1 Processor -- start 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.035+0000 7f37f199d640 1 -- start start 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37ec0c8460 0x7f37ec1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec1575e0 0x7f37ec162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 0x7f37ec163150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0b4fd0 con 0x7f37ec1579f0 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec164b10 con 0x7f37ec0c8460 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec0b5150 con 0x7f37ec1575e0 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 0x7f37ec163150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 0x7f37ec163150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34286/0 (socket says 172.21.15.80:34286) 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 -- 172.21.15.80:0/1761005847 learned_addr learned my addr 172.21.15.80:0/1761005847 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eaffd640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37ec0c8460 0x7f37ec1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37ea7fc640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec1575e0 0x7f37ec162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 -- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec1575e0 msgr2=0x7f37ec162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec1575e0 0x7f37ec162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 -- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37ec0c8460 msgr2=0x7f37ec1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37ec0c8460 0x7f37ec1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 -- 172.21.15.80:0/1761005847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec156540 con 0x7f37ec1579f0 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37ea7fc640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec1575e0 0x7f37ec162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37eb7fe640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 0x7f37ec163150 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f37e402a920 tx=0x7f37e40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4040070 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4003e50 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec156820 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.037+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4037040 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.038+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec156de0 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.038+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ec06a100 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.039+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f37e4043070 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.039+0000 7f37d3fff640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37d80744b0 0x7f37d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.040+0000 7f37eaffd640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37d80744b0 0x7f37d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.040+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7f37e40b40e0 con 0x7f37ec1579f0 2024-04-25T15:46:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.040+0000 7f37eaffd640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37d80744b0 0x7f37d80769c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0d6b40 tx=0x7f37dc000f80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.044+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37e407e390 con 0x7f37ec1579f0 2024-04-25T15:46:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.217+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37ec0d1740 con 0x7f37ec1579f0 2024-04-25T15:46:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.218+0000 7f37d3fff640 1 -- 172.21.15.80:0/1761005847 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+13282 (secure 0 0 0) 0x7f37e4082690 con 0x7f37ec1579f0 2024-04-25T15:46:48.219 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:48.219 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:46.901765+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/1832881946":"2024-04-26T15:46:43.669618+0000","172.21.15.80:6835/1832881946":"2024-04-26T15:46:43.669618+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:48.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37d80744b0 msgr2=0x7f37d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37d80744b0 0x7f37d80769c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0d6b40 tx=0x7f37dc000f80 comp rx=0 tx=0).stop 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 msgr2=0x7f37ec163150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 0x7f37ec163150 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f37e402a920 tx=0x7f37e40014a0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 shutdown_connections 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f37d80744b0 0x7f37d80769c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37ec1579f0 0x7f37ec163150 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37ec1575e0 0x7f37ec162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 --2- 172.21.15.80:0/1761005847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37ec0c8460 0x7f37ec1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 >> 172.21.15.80:0/1761005847 conn(0x7f37ec06e9f0 msgr2=0x7f37ec0b9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 shutdown_connections 2024-04-25T15:46:48.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.220+0000 7f37f199d640 1 -- 172.21.15.80:0/1761005847 wait complete. 2024-04-25T15:46:48.232 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:48.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.343+0000 7f93a25c5640 1 Processor -- start 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.343+0000 7f93a25c5640 1 -- start start 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a25c5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c161870 0x7f939c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a25c5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f939c0d23c0 0x7f939c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a25c5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f939c0d27d0 0x7f939c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a25c5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f939c163f60 con 0x7f939c0d23c0 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a25c5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f939c164240 con 0x7f939c0d27d0 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a25c5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f939c164520 con 0x7f939c161870 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f939b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f939c0d23c0 0x7f939c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f939b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f939c0d23c0 0x7f939c0d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34292/0 (socket says 172.21.15.80:34292) 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f939b7fe640 1 -- 172.21.15.80:0/725520930 learned_addr learned my addr 172.21.15.80:0/725520930 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f93a0b62640 1 --2- 172.21.15.80:0/725520930 >> v2:172.21.15.195:3300/0 conn(0x7f939c0d27d0 0x7f939c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.344+0000 7f939bfff640 1 --2- 172.21.15.80:0/725520930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c161870 0x7f939c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939b7fe640 1 -- 172.21.15.80:0/725520930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c161870 msgr2=0x7f939c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939b7fe640 1 --2- 172.21.15.80:0/725520930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c161870 0x7f939c160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939b7fe640 1 -- 172.21.15.80:0/725520930 >> v2:172.21.15.195:3300/0 conn(0x7f939c0d27d0 msgr2=0x7f939c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939b7fe640 1 --2- 172.21.15.80:0/725520930 >> v2:172.21.15.195:3300/0 conn(0x7f939c0d27d0 0x7f939c0d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939b7fe640 1 -- 172.21.15.80:0/725520930 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c164800 con 0x7f939c0d23c0 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939b7fe640 1 --2- 172.21.15.80:0/725520930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0d1560 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f939c08cf80 tx=0x7f939002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b45fc3c9275ebc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939affd640 1 -- 172.21.15.80:0/725520930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390037070 con 0x7f939c0d23c0 2024-04-25T15:46:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939affd640 1 -- 172.21.15.80:0/725520930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9390032440 con 0x7f939c0d23c0 2024-04-25T15:46:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.345+0000 7f939affd640 1 -- 172.21.15.80:0/725520930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390032810 con 0x7f939c0d23c0 2024-04-25T15:46:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 -- 172.21.15.80:0/725520930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 msgr2=0x7f939c0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 --2- 172.21.15.80:0/725520930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0d1560 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f939c08cf80 tx=0x7f939002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 -- 172.21.15.80:0/725520930 shutdown_connections 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 --2- 172.21.15.80:0/725520930 >> v2:172.21.15.195:3300/0 conn(0x7f939c0d27d0 0x7f939c0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 --2- 172.21.15.80:0/725520930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0d1560 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 --2- 172.21.15.80:0/725520930 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c161870 0x7f939c160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 -- 172.21.15.80:0/725520930 >> 172.21.15.80:0/725520930 conn(0x7f939c0b54a0 msgr2=0x7f939c0b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 -- 172.21.15.80:0/725520930 shutdown_connections 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.346+0000 7f93a25c5640 1 -- 172.21.15.80:0/725520930 wait complete. 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.348+0000 7f93a25c5640 1 Processor -- start 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.348+0000 7f93a25c5640 1 -- start start 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c0d27d0 0x7f939c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f939c161870 0x7f939c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f939c071af0 con 0x7f939c0d23c0 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f939c071970 con 0x7f939c161870 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f939c071c70 con 0x7f939c0d27d0 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34296/0 (socket says 172.21.15.80:34296) 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 -- 172.21.15.80:0/2778550792 learned_addr learned my addr 172.21.15.80:0/2778550792 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a0b62640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f939c161870 0x7f939c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939b7fe640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c0d27d0 0x7f939c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 -- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c0d27d0 msgr2=0x7f939c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c0d27d0 0x7f939c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 -- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f939c161870 msgr2=0x7f939c0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f939c161870 0x7f939c0c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 -- 172.21.15.80:0/2778550792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c0c9f00 con 0x7f939c0d23c0 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f939bfff640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0c7480 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e840 tx=0x7f938c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c017070 con 0x7f939c0d23c0 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c00c940 con 0x7f939c0d23c0 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c0c79c0 con 0x7f939c0d23c0 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00cd10 con 0x7f939c0d23c0 2024-04-25T15:46:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.350+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c0b6930 con 0x7f939c0d23c0 2024-04-25T15:46:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.351+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c06a100 con 0x7f939c0d23c0 2024-04-25T15:46:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.352+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f938c01a070 con 0x7f939c0d23c0 2024-04-25T15:46:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.353+0000 7f9398ff9640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93880744b0 0x7f93880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.353+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7f938c094ee0 con 0x7f939c0d23c0 2024-04-25T15:46:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.353+0000 7f939b7fe640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93880744b0 0x7f93880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.353+0000 7f939b7fe640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93880744b0 0x7f93880769c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9390034000 tx=0x7f939002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.357+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f938c05f190 con 0x7f939c0d23c0 2024-04-25T15:46:48.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.530+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f939c06dde0 con 0x7f939c0d23c0 2024-04-25T15:46:48.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.530+0000 7f9398ff9640 1 -- 172.21.15.80:0/2778550792 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f938c063490 con 0x7f939c0d23c0 2024-04-25T15:46:48.536 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:48.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93880744b0 msgr2=0x7f93880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93880744b0 0x7f93880769c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9390034000 tx=0x7f939002e000 comp rx=0 tx=0).stop 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 msgr2=0x7f939c0c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0c7480 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e840 tx=0x7f938c00ed00 comp rx=0 tx=0).stop 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 shutdown_connections 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93880744b0 0x7f93880769c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f939c161870 0x7f939c0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f939c0d27d0 0x7f939c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 --2- 172.21.15.80:0/2778550792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f939c0d23c0 0x7f939c0c7480 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 >> 172.21.15.80:0/2778550792 conn(0x7f939c0b54a0 msgr2=0x7f939c160280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 shutdown_connections 2024-04-25T15:46:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.532+0000 7f93a25c5640 1 -- 172.21.15.80:0/2778550792 wait complete. 2024-04-25T15:46:48.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-04-25T15:46:48.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.649+0000 7fcc39138640 1 Processor -- start 2024-04-25T15:46:48.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.650+0000 7fcc39138640 1 -- start start 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc39138640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc3409c100 0x7fcc3406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc39138640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340ce4b0 con 0x7fcc340d30e0 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc39138640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340ce750 con 0x7fcc3415e3c0 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc39138640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcc340cea30 con 0x7fcc3409c100 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc3359e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcc340d30e0 0x7fcc3406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59616/0 (socket says 172.21.15.80:59616) 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc3359e640 1 -- 172.21.15.80:0/2107108421 learned_addr learned my addr 172.21.15.80:0/2107108421 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc32d9d640 1 --2- 172.21.15.80:0/2107108421 >> v2:172.21.15.195:3300/0 conn(0x7fcc3409c100 0x7fcc3406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160431824 0 0) 0x7fcc340ce4b0 con 0x7fcc340d30e0 2024-04-25T15:46:48.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.651+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc1c003520 con 0x7fcc340d30e0 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 654454995 0 0) 0x7fcc1c003520 con 0x7fcc340d30e0 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 >> v2:172.21.15.195:3300/0 conn(0x7fcc3409c100 msgr2=0x7fcc3406e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 --2- 172.21.15.80:0/2107108421 >> v2:172.21.15.195:3300/0 conn(0x7fcc3409c100 0x7fcc3406e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 >> v1:172.21.15.195:6789/0 conn(0x7fcc3415e3c0 legacy=0x7fcc340d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340ced10 con 0x7fcc340d30e0 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fcc2c001670 con 0x7fcc340d30e0 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 >> v1:172.21.15.80:6789/0 conn(0x7fcc340d30e0 legacy=0x7fcc3406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c0039b0 0x7fcc1c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c004800 0x7fcc1c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340cea30 con 0x7fcc1c005250 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c00c1e0 con 0x7fcc1c0039b0 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1c00c3e0 con 0x7fcc1c004800 2024-04-25T15:46:48.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3359e640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc32d9d640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c0039b0 0x7fcc1c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3259c640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c004800 0x7fcc1c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3359e640 1 -- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c004800 msgr2=0x7fcc1c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3359e640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c004800 0x7fcc1c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3359e640 1 -- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c0039b0 msgr2=0x7fcc1c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3359e640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c0039b0 0x7fcc1c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.652+0000 7fcc3359e640 1 -- 172.21.15.80:0/2107108421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c003520 con 0x7fcc1c005250 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.653+0000 7fcc3359e640 1 -- 172.21.15.80:0/2107108421 reap_dead start 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.653+0000 7fcc3359e640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc1c00b9c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c210 tx=0x7fcc1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a873c869f36827 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.653+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c007d10 con 0x7fcc1c005250 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.653+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0058d0 con 0x7fcc1c005250 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.653+0000 7fcc31d9b640 1 -- 172.21.15.80:0/2107108421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c005cc0 con 0x7fcc1c005250 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 -- 172.21.15.80:0/2107108421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 msgr2=0x7fcc1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc1c00b9c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c210 tx=0x7fcc1c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:48.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 -- 172.21.15.80:0/2107108421 shutdown_connections 2024-04-25T15:46:48.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 --2- 172.21.15.80:0/2107108421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc1c00b9c0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 -- 172.21.15.80:0/2107108421 >> 172.21.15.80:0/2107108421 conn(0x7fcc340b7750 msgr2=0x7fcc340b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 -- 172.21.15.80:0/2107108421 shutdown_connections 2024-04-25T15:46:48.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.654+0000 7fcc39138640 1 -- 172.21.15.80:0/2107108421 wait complete. 2024-04-25T15:46:48.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.656+0000 7fcc39138640 1 Processor -- start 2024-04-25T15:46:48.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.656+0000 7fcc39138640 1 -- start start 2024-04-25T15:46:48.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc39138640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc341f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc39138640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc341f6440 0x7fcc34160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc39138640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc340d1d50 0x7fcc34160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc39138640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3406e910 con 0x7fcc1c005250 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc39138640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3406e790 con 0x7fcc341f6440 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc39138640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3406ea90 con 0x7fcc340d1d50 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc341f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc341f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34306/0 (socket says 172.21.15.80:34306) 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc32d9d640 1 -- 172.21.15.80:0/2228903720 learned_addr learned my addr 172.21.15.80:0/2228903720 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc3259c640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc341f6440 0x7fcc34160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.657+0000 7fcc3359e640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc340d1d50 0x7fcc34160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc32d9d640 1 -- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc340d1d50 msgr2=0x7fcc34160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc32d9d640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc340d1d50 0x7fcc34160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc32d9d640 1 -- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc341f6440 msgr2=0x7fcc34160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc32d9d640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc341f6440 0x7fcc34160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc32d9d640 1 -- 172.21.15.80:0/2228903720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc341606a0 con 0x7fcc1c005250 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc3259c640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc341f6440 0x7fcc34160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc32d9d640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc341f5f00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009f90 tx=0x7fcc2400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400fea0 con 0x7fcc1c005250 2024-04-25T15:46:48.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc24015630 con 0x7fcc1c005250 2024-04-25T15:46:48.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc340d1270 con 0x7fcc1c005250 2024-04-25T15:46:48.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24015a20 con 0x7fcc1c005250 2024-04-25T15:46:48.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.658+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc340ca3c0 con 0x7fcc1c005250 2024-04-25T15:46:48.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.659+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3406a100 con 0x7fcc1c005250 2024-04-25T15:46:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.660+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcc24015bc0 con 0x7fcc1c005250 2024-04-25T15:46:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.660+0000 7fcc1b7fe640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744b0 0x7fcc200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.660+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7fcc24096260 con 0x7fcc1c005250 2024-04-25T15:46:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.660+0000 7fcc3259c640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744b0 0x7fcc200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.661+0000 7fcc3259c640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744b0 0x7fcc200769c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcc3415f6f0 tx=0x7fcc28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.665+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc24019030 con 0x7fcc1c005250 2024-04-25T15:46:48.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.907+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) -- 0x7fcc34068790 con 0x7fcc1c005250 2024-04-25T15:46:48.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.909+0000 7fcc1b7fe640 1 -- 172.21.15.80:0/2228903720 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v241) ==== 148+0+0 (secure 0 0 0) 0x7fcc24010040 con 0x7fcc1c005250 2024-04-25T15:46:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744b0 msgr2=0x7fcc200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744b0 0x7fcc200769c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcc3415f6f0 tx=0x7fcc28009040 comp rx=0 tx=0).stop 2024-04-25T15:46:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 msgr2=0x7fcc341f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc341f5f00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009f90 tx=0x7fcc2400f580 comp rx=0 tx=0).stop 2024-04-25T15:46:48.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 shutdown_connections 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcc200744b0 0x7fcc200769c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc340d1d50 0x7fcc34160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc341f6440 0x7fcc34160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 --2- 172.21.15.80:0/2228903720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc1c005250 0x7fcc341f5f00 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 >> 172.21.15.80:0/2228903720 conn(0x7fcc340b7750 msgr2=0x7fcc3406cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 shutdown_connections 2024-04-25T15:46:48.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:48.911+0000 7fcc39138640 1 -- 172.21.15.80:0/2228903720 wait complete. 2024-04-25T15:46:48.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T15:46:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.032+0000 7f60c9155640 1 Processor -- start 2024-04-25T15:46:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.032+0000 7f60c9155640 1 -- start start 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.033+0000 7f60c9155640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c406d870 0x7f60c40d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.033+0000 7f60c9155640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60c40b37b0 0x7f60c40d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.033+0000 7f60c9155640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c40cfc90 con 0x7f60c406cc10 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.033+0000 7f60c9155640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f60c406c9a0 con 0x7f60c40b37b0 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.033+0000 7f60c9155640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f60c40d2c10 con 0x7f60c406d870 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60c40b37b0 0x7f60c40d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60c40b37b0 0x7f60c40d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34314/0 (socket says 172.21.15.80:34314) 2024-04-25T15:46:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 -- 172.21.15.80:0/4046163755 learned_addr learned my addr 172.21.15.80:0/4046163755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c259c640 1 --2- 172.21.15.80:0/4046163755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c406d870 0x7f60c40d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 -- 172.21.15.80:0/4046163755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c406d870 msgr2=0x7f60c40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 --2- 172.21.15.80:0/4046163755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c406d870 0x7f60c40d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 -- 172.21.15.80:0/4046163755 >> v1:172.21.15.195:6789/0 conn(0x7f60c406cc10 legacy=0x7f60c406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.034+0000 7f60c359e640 1 -- 172.21.15.80:0/4046163755 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c40cff30 con 0x7f60c40b37b0 2024-04-25T15:46:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c359e640 1 --2- 172.21.15.80:0/4046163755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c40b37b0 0x7f60c40d0990 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009870 tx=0x7f60bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f5f96697bad97d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c1d9b640 1 -- 172.21.15.80:0/4046163755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc037070 con 0x7f60c40b37b0 2024-04-25T15:46:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c1d9b640 1 -- 172.21.15.80:0/4046163755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc032440 con 0x7f60c40b37b0 2024-04-25T15:46:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c1d9b640 1 -- 172.21.15.80:0/4046163755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc032810 con 0x7f60c40b37b0 2024-04-25T15:46:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 -- 172.21.15.80:0/4046163755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c40b37b0 msgr2=0x7f60c40d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 --2- 172.21.15.80:0/4046163755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c40b37b0 0x7f60c40d0990 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009870 tx=0x7f60bc02a270 comp rx=0 tx=0).stop 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 -- 172.21.15.80:0/4046163755 shutdown_connections 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 --2- 172.21.15.80:0/4046163755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c40b37b0 0x7f60c40d0990 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 --2- 172.21.15.80:0/4046163755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c406d870 0x7f60c40d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 -- 172.21.15.80:0/4046163755 >> 172.21.15.80:0/4046163755 conn(0x7f60c409b410 msgr2=0x7f60c40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.035+0000 7f60c9155640 1 -- 172.21.15.80:0/4046163755 shutdown_connections 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.036+0000 7f60c9155640 1 -- 172.21.15.80:0/4046163755 wait complete. 2024-04-25T15:46:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.038+0000 7f60c9155640 1 Processor -- start 2024-04-25T15:46:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.038+0000 7f60c9155640 1 -- start start 2024-04-25T15:46:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c9155640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 0x7f60c40c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c9155640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60c40b37b0 0x7f60c4149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c9155640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c414d3d0 0x7f60c414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c9155640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4076230 con 0x7f60c406cc10 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c9155640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f60c406c670 con 0x7f60c40b37b0 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c9155640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f60c4163860 con 0x7f60c414d3d0 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 0x7f60c40c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 0x7f60c40c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34330/0 (socket says 172.21.15.80:34330) 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 -- 172.21.15.80:0/1419390765 learned_addr learned my addr 172.21.15.80:0/1419390765 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c259c640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60c40b37b0 0x7f60c4149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c359e640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c414d3d0 0x7f60c414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 -- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c414d3d0 msgr2=0x7f60c414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c414d3d0 0x7f60c414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 -- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60c40b37b0 msgr2=0x7f60c4149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60c40b37b0 0x7f60c4149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c2d9d640 1 -- 172.21.15.80:0/1419390765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c40c6200 con 0x7f60c406cc10 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.039+0000 7f60c359e640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c414d3d0 0x7f60c414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.040+0000 7f60c2d9d640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 0x7f60c40c5b50 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f60b400c730 tx=0x7f60b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.040+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4016020 con 0x7f60c406cc10 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.040+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b4006d50 con 0x7f60c406cc10 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.040+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c40d0e90 con 0x7f60c406cc10 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.040+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4003bb0 con 0x7f60c406cc10 2024-04-25T15:46:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.040+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c40d1450 con 0x7f60c406cc10 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.041+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c406a100 con 0x7f60c406cc10 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.042+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f60b400a850 con 0x7f60c406cc10 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.042+0000 7f60ab7fe640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60b00744b0 0x7f60b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.042+0000 7f60c259c640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60b00744b0 0x7f60b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.042+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7f60b4094bb0 con 0x7f60c406cc10 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.042+0000 7f60c259c640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60b00744b0 0x7f60b00769c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006fd0 tx=0x7f60b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.047+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60b4020020 con 0x7f60c406cc10 2024-04-25T15:46:49.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.223+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f60c40b4530 con 0x7f60c406cc10 2024-04-25T15:46:49.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.227+0000 7f60ab7fe640 1 -- 172.21.15.80:0/1419390765 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f60b405f5d0 con 0x7f60c406cc10 2024-04-25T15:46:49.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60b00744b0 msgr2=0x7f60b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60b00744b0 0x7f60b00769c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006fd0 tx=0x7f60b8008040 comp rx=0 tx=0).stop 2024-04-25T15:46:49.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 msgr2=0x7f60c40c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 0x7f60c40c5b50 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f60b400c730 tx=0x7f60b400cbf0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 shutdown_connections 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f60b00744b0 0x7f60b00769c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60c414d3d0 0x7f60c414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60c40b37b0 0x7f60c4149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 --2- 172.21.15.80:0/1419390765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60c406cc10 0x7f60c40c5b50 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 >> 172.21.15.80:0/1419390765 conn(0x7f60c409b410 msgr2=0x7f60c4070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 shutdown_connections 2024-04-25T15:46:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.229+0000 7f60c9155640 1 -- 172.21.15.80:0/1419390765 wait complete. 2024-04-25T15:46:49.241 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:46:49.241 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:49.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:46:49.322 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:46:49.322 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:49.322 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:49.337 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:49.337 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:49.337 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:49.380 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:49.380 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:46:49.380 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:49.395 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:46:49.395 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:46:49.395 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:46:49.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:46:49.438 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T15:46:49.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:49.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.544+0000 7f4ef9af9640 1 Processor -- start 2024-04-25T15:46:49.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.544+0000 7f4ef9af9640 1 -- start start 2024-04-25T15:46:49.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef9af9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ef4072560 0x7f4ef40b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef9af9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ef40b74c0 0x7f4ef40d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef9af9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef41624d0 con 0x7f4ef4071950 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef9af9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef41627b0 con 0x7f4ef40b74c0 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef9af9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef4162a90 con 0x7f4ef4072560 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ef40b74c0 0x7f4ef40d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ef40b74c0 0x7f4ef40d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34332/0 (socket says 172.21.15.80:34332) 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.545+0000 7f4ef3fff640 1 -- 172.21.15.80:0/936671889 learned_addr learned my addr 172.21.15.80:0/936671889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef3fff640 1 -- 172.21.15.80:0/936671889 >> v2:172.21.15.195:3300/0 conn(0x7f4ef4072560 msgr2=0x7f4ef40b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef3fff640 1 --2- 172.21.15.80:0/936671889 >> v2:172.21.15.195:3300/0 conn(0x7f4ef4072560 0x7f4ef40b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef3fff640 1 -- 172.21.15.80:0/936671889 >> v1:172.21.15.195:6789/0 conn(0x7f4ef4071950 legacy=0x7f4ef4161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef3fff640 1 -- 172.21.15.80:0/936671889 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef40d2290 con 0x7f4ef40b74c0 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef3fff640 1 --2- 172.21.15.80:0/936671889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40d2a90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4162d70 tx=0x7f4eec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6ce47a0464da20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef27fc640 1 -- 172.21.15.80:0/936671889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec036070 con 0x7f4ef40b74c0 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef27fc640 1 -- 172.21.15.80:0/936671889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eec031600 con 0x7f4ef40b74c0 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.546+0000 7f4ef27fc640 1 -- 172.21.15.80:0/936671889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0319d0 con 0x7f4ef40b74c0 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 -- 172.21.15.80:0/936671889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef40b74c0 msgr2=0x7f4ef40d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/936671889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40d2a90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4162d70 tx=0x7f4eec02a660 comp rx=0 tx=0).stop 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 -- 172.21.15.80:0/936671889 shutdown_connections 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/936671889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40d2a90 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/936671889 >> v2:172.21.15.195:3300/0 conn(0x7f4ef4072560 0x7f4ef40b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 -- 172.21.15.80:0/936671889 >> 172.21.15.80:0/936671889 conn(0x7f4ef40d3ea0 msgr2=0x7f4ef40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 -- 172.21.15.80:0/936671889 shutdown_connections 2024-04-25T15:46:49.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.547+0000 7f4ef9af9640 1 -- 172.21.15.80:0/936671889 wait complete. 2024-04-25T15:46:49.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.549+0000 7f4ef9af9640 1 Processor -- start 2024-04-25T15:46:49.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.549+0000 7f4ef9af9640 1 -- start start 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef9af9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef4071950 0x7f4ef41f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef9af9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 0x7f4ef40ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef9af9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef9af9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40d3150 con 0x7f4ef4072560 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef9af9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40d2fd0 con 0x7f4ef40b74c0 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef9af9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef40d32d0 con 0x7f4ef4071950 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 0x7f4ef40ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 0x7f4ef40ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34348/0 (socket says 172.21.15.80:34348) 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.550+0000 7f4ef2ffd640 1 -- 172.21.15.80:0/1408762611 learned_addr learned my addr 172.21.15.80:0/1408762611 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef3fff640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef37fe640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef4071950 0x7f4ef41f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef2ffd640 1 -- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef4071950 msgr2=0x7f4ef41f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef2ffd640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef4071950 0x7f4ef41f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef2ffd640 1 -- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef40b74c0 msgr2=0x7f4ef40ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef2ffd640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef2ffd640 1 -- 172.21.15.80:0/1408762611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef41f6040 con 0x7f4ef4072560 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef3fff640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef2ffd640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 0x7f4ef40ccd80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b420 tx=0x7f4ee800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8005970 con 0x7f4ef4072560 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8005b10 con 0x7f4ef4072560 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef40cbce0 con 0x7f4ef4072560 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8006020 con 0x7f4ef4072560 2024-04-25T15:46:49.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.551+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef40cc2a0 con 0x7f4ef4072560 2024-04-25T15:46:49.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.552+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef406a100 con 0x7f4ef4072560 2024-04-25T15:46:49.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.553+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ee8018020 con 0x7f4ef4072560 2024-04-25T15:46:49.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.553+0000 7f4edbfff640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ee00744e0 0x7f4ee00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.553+0000 7f4ef37fe640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ee00744e0 0x7f4ee00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.553+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7f4ee8094600 con 0x7f4ef4072560 2024-04-25T15:46:49.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.554+0000 7f4ef37fe640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ee00744e0 0x7f4ee00769f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4006fd0 tx=0x7f4ee4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.558+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ee805f020 con 0x7f4ef4072560 2024-04-25T15:46:49.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.768+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ef40d1e40 con 0x7f4ef4072560 2024-04-25T15:46:49.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.769+0000 7f4edbfff640 1 -- 172.21.15.80:0/1408762611 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+3875 (secure 0 0 0) 0x7f4ee805e920 con 0x7f4ef4072560 2024-04-25T15:46:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:49.771 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3120016578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3120016578},{"type":"v1","addr":"172.21.15.195:6833","nonce":3120016578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6388,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3102676203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3102676203},{"type":"v1","addr":"172.21.15.195:6835","nonce":3102676203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/4227729291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4227729291},{"type":"v1","addr":"172.21.15.80:6836","nonce":4227729291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2526302110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2526302110},{"type":"v1","addr":"172.21.15.80:6837","nonce":2526302110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[]} 2024-04-25T15:46:49.771 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 47 2024-04-25T15:46:49.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ee00744e0 msgr2=0x7f4ee00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ee00744e0 0x7f4ee00769f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4006fd0 tx=0x7f4ee4008040 comp rx=0 tx=0).stop 2024-04-25T15:46:49.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 msgr2=0x7f4ef40ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 0x7f4ef40ccd80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b420 tx=0x7f4ee800b8e0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 shutdown_connections 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4ee00744e0 0x7f4ee00769f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef40b74c0 0x7f4ef40ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef4072560 0x7f4ef40ccd80 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 --2- 172.21.15.80:0/1408762611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef4071950 0x7f4ef41f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 >> 172.21.15.80:0/1408762611 conn(0x7f4ef40d3ea0 msgr2=0x7f4ef4073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 shutdown_connections 2024-04-25T15:46:49.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.771+0000 7f4ef9af9640 1 -- 172.21.15.80:0/1408762611 wait complete. 2024-04-25T15:46:49.784 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:46:49.784 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T15:46:49.784 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:46:49.784 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:49.784 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:46:49.784 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T15:46:49.785 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:46:49.785 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:49.785 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:46:49.785 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T15:46:49.785 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:46:49.785 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:49.785 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:46:49.786 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T15:46:49.786 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:46:49.786 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:46:49.795 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:46:49.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:46:49.797 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:46:49.797 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:46:49.798 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:46:49.798 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:46:49.799 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:46:49.799 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:46:49.839 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:46:49.839 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.840 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:46:49.841 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.841 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:46:49.841 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.842 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:46:49.842 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T15:46:49.924 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:46:49.925 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:46:49.934 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:46:49.934 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:46:49.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.956+0000 7f2feed96640 1 Processor -- start 2024-04-25T15:46:49.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.957+0000 7f2feed96640 1 -- start start 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2feed96640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2fe8169130 0x7f2fe816b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2feed96640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8160700 con 0x7f2fe80733b0 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2feed96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe806ed80 con 0x7f2fe81602f0 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2feed96640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe806f060 con 0x7f2fe8169130 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2fdffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2fe80733b0 0x7f2fe80737c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59644/0 (socket says 172.21.15.80:59644) 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2fdffff640 1 -- 172.21.15.80:0/359978834 learned_addr learned my addr 172.21.15.80:0/359978834 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2fed333640 1 --2- 172.21.15.80:0/359978834 >> v2:172.21.15.195:3300/0 conn(0x7f2fe8169130 0x7f2fe816b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2fdf7fe640 1 -- 172.21.15.80:0/359978834 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307732934 0 0) 0x7f2fe8160700 con 0x7f2fe80733b0 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.958+0000 7f2fdf7fe640 1 -- 172.21.15.80:0/359978834 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd0003520 con 0x7f2fe80733b0 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fed333640 1 -- 172.21.15.80:0/359978834 >> v1:172.21.15.195:6789/0 conn(0x7f2fe81602f0 legacy=0x7f2fe806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fdf7fe640 1 -- 172.21.15.80:0/359978834 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3270743109 0 0) 0x7f2fd0003520 con 0x7f2fe80733b0 2024-04-25T15:46:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fed333640 1 -- 172.21.15.80:0/359978834 >> v1:172.21.15.80:6789/0 conn(0x7f2fe80733b0 legacy=0x7f2fe80737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fed333640 1 -- 172.21.15.80:0/359978834 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe806f340 con 0x7f2fe8169130 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fed333640 1 --2- 172.21.15.80:0/359978834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe8169130 0x7f2fe816b550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009d90 tx=0x7f2fe002a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12365967137622d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fdf7fe640 1 -- 172.21.15.80:0/359978834 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80017f0 con 0x7f2fe8169130 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fdf7fe640 1 -- 172.21.15.80:0/359978834 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0032440 con 0x7f2fe8169130 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.959+0000 7f2fdf7fe640 1 -- 172.21.15.80:0/359978834 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0032810 con 0x7f2fe8169130 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 -- 172.21.15.80:0/359978834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe8169130 msgr2=0x7f2fe816b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 --2- 172.21.15.80:0/359978834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe8169130 0x7f2fe816b550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009d90 tx=0x7f2fe002a480 comp rx=0 tx=0).stop 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 -- 172.21.15.80:0/359978834 shutdown_connections 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 --2- 172.21.15.80:0/359978834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe8169130 0x7f2fe816b550 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 -- 172.21.15.80:0/359978834 >> 172.21.15.80:0/359978834 conn(0x7f2fe80d3ea0 msgr2=0x7f2fe80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 -- 172.21.15.80:0/359978834 shutdown_connections 2024-04-25T15:46:49.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.960+0000 7f2feed96640 1 -- 172.21.15.80:0/359978834 wait complete. 2024-04-25T15:46:49.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.962+0000 7f2feed96640 1 Processor -- start 2024-04-25T15:46:49.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.962+0000 7f2feed96640 1 -- start start 2024-04-25T15:46:49.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.963+0000 7f2feed96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fe80733b0 0x7f2fe815ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.963+0000 7f2feed96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe81602f0 0x7f2fe80c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.963+0000 7f2feed96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 0x7f2fe80c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.963+0000 7f2feed96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe806ea10 con 0x7f2fe8169130 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.963+0000 7f2feed96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe80ce9a0 con 0x7f2fe81602f0 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.963+0000 7f2feed96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe80b3140 con 0x7f2fe80733b0 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 0x7f2fe80c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 0x7f2fe80c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34388/0 (socket says 172.21.15.80:34388) 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 -- 172.21.15.80:0/626870149 learned_addr learned my addr 172.21.15.80:0/626870149 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fdffff640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe81602f0 0x7f2fe80c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fecb32640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fe80733b0 0x7f2fe815ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 -- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fe80733b0 msgr2=0x7f2fe815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fe80733b0 0x7f2fe815ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 -- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe81602f0 msgr2=0x7f2fe80c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe81602f0 0x7f2fe80c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 -- 172.21.15.80:0/626870149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe81f6d70 con 0x7f2fe8169130 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fed333640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 0x7f2fe80c9930 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0034040 tx=0x7f2fe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0009450 con 0x7f2fe8169130 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0003990 con 0x7f2fe8169130 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0003d80 con 0x7f2fe8169130 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe80cb5c0 con 0x7f2fe8169130 2024-04-25T15:46:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.964+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe80cbb80 con 0x7f2fe8169130 2024-04-25T15:46:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.966+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe806a100 con 0x7f2fe8169130 2024-04-25T15:46:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.966+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2fe0030900 con 0x7f2fe8169130 2024-04-25T15:46:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.966+0000 7f2fdd7fa640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2fd40744e0 0x7f2fd40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.966+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5335+0+0 (secure 0 0 0) 0x7f2fe00b5f90 con 0x7f2fe8169130 2024-04-25T15:46:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.966+0000 7f2fecb32640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2fd40744e0 0x7f2fd40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.967+0000 7f2fecb32640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2fd40744e0 0x7f2fd40769f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4000f60 tx=0x7f2fe4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:49.971+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2fe0042020 con 0x7f2fe8169130 2024-04-25T15:46:50.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.157+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2fe80b9a30 con 0x7f2fe8169130 2024-04-25T15:46:50.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.927+0000 7f2fdd7fa640 1 -- 172.21.15.80:0/626870149 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v93) ==== 97+0+0 (secure 0 0 0) 0x7f2fe0080240 con 0x7f2fe8169130 2024-04-25T15:46:50.929 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-25T15:46:50.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.930+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2fd40744e0 msgr2=0x7f2fd40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.930+0000 7f2feed96640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2fd40744e0 0x7f2fd40769f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4000f60 tx=0x7f2fe4009040 comp rx=0 tx=0).stop 2024-04-25T15:46:50.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.930+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 msgr2=0x7f2fe80c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.930+0000 7f2feed96640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 0x7f2fe80c9930 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0034040 tx=0x7f2fe0004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:50.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 shutdown_connections 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2fd40744e0 0x7f2fd40769f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8169130 0x7f2fe80c9930 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fe81602f0 0x7f2fe80c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 --2- 172.21.15.80:0/626870149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fe80733b0 0x7f2fe815ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 >> 172.21.15.80:0/626870149 conn(0x7f2fe80d3ea0 msgr2=0x7f2fe81507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 shutdown_connections 2024-04-25T15:46:50.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:50.931+0000 7f2feed96640 1 -- 172.21.15.80:0/626870149 wait complete. 2024-04-25T15:46:50.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T15:46:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.056+0000 7fccf6b00640 1 Processor -- start 2024-04-25T15:46:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.056+0000 7fccf6b00640 1 -- start start 2024-04-25T15:46:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf6b00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 0x7fccf00d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf6b00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fccf00d2480 0x7fccf00d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf6b00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf00b2f30 con 0x7fccf00b4b60 2024-04-25T15:46:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf6b00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fccf006eb60 con 0x7fccf00d2480 2024-04-25T15:46:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf6b00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fccf00b2c90 con 0x7fccf00b91c0 2024-04-25T15:46:51.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf509d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fccf00d2480 0x7fccf00d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fcceffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 0x7fccf00d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fcceffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 0x7fccf00d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:59708/0 (socket says 172.21.15.80:59708) 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fcceffff640 1 -- 172.21.15.80:0/1432998834 learned_addr learned my addr 172.21.15.80:0/1432998834 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.058+0000 7fccf489c640 1 --1- 172.21.15.80:0/1432998834 >> v1:172.21.15.195:6789/0 conn(0x7fccf00b4b60 0x7fccf006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:60608/0 (socket says 172.21.15.80:60608) 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fcceffff640 1 -- 172.21.15.80:0/1432998834 >> v2:172.21.15.195:3300/0 conn(0x7fccf00d2480 msgr2=0x7fccf00d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fcceffff640 1 --2- 172.21.15.80:0/1432998834 >> v2:172.21.15.195:3300/0 conn(0x7fccf00d2480 0x7fccf00d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fcceffff640 1 -- 172.21.15.80:0/1432998834 >> v1:172.21.15.195:6789/0 conn(0x7fccf00b4b60 legacy=0x7fccf006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fcceffff640 1 -- 172.21.15.80:0/1432998834 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf00d10a0 con 0x7fccf00b91c0 2024-04-25T15:46:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fccf509d640 1 --2- 172.21.15.80:0/1432998834 >> v2:172.21.15.195:3300/0 conn(0x7fccf00d2480 0x7fccf00d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:51.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fcceffff640 1 --2- 172.21.15.80:0/1432998834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 0x7fccf00d1f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009870 tx=0x7fcce402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b74f7e9cab01af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.059+0000 7fccef7fe640 1 -- 172.21.15.80:0/1432998834 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4037070 con 0x7fccf00b91c0 2024-04-25T15:46:51.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccef7fe640 1 -- 172.21.15.80:0/1432998834 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce4032440 con 0x7fccf00b91c0 2024-04-25T15:46:51.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccef7fe640 1 -- 172.21.15.80:0/1432998834 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4032810 con 0x7fccf00b91c0 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 -- 172.21.15.80:0/1432998834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 msgr2=0x7fccf00d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1432998834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 0x7fccf00d1f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009870 tx=0x7fcce402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 -- 172.21.15.80:0/1432998834 shutdown_connections 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1432998834 >> v2:172.21.15.195:3300/0 conn(0x7fccf00d2480 0x7fccf00d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1432998834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00b91c0 0x7fccf00d1f40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 -- 172.21.15.80:0/1432998834 >> 172.21.15.80:0/1432998834 conn(0x7fccf00d0450 msgr2=0x7fccf00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 -- 172.21.15.80:0/1432998834 shutdown_connections 2024-04-25T15:46:51.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.060+0000 7fccf6b00640 1 -- 172.21.15.80:0/1432998834 wait complete. 2024-04-25T15:46:51.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.062+0000 7fccf6b00640 1 Processor -- start 2024-04-25T15:46:51.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.062+0000 7fccf6b00640 1 -- start start 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.063+0000 7fccf6b00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 0x7fccf01d5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.063+0000 7fccf6b00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf00b91c0 0x7fccf01d7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.063+0000 7fccf6b00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00d2480 0x7fccf01d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.063+0000 7fccf6b00640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fccf009d0e0 con 0x7fccf00b4b60 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.063+0000 7fccf6b00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fccf009cbe0 con 0x7fccf00b91c0 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.063+0000 7fccf6b00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fccf009d260 con 0x7fccf00d2480 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 0x7fccf01d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 0x7fccf01d5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34398/0 (socket says 172.21.15.80:34398) 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 -- 172.21.15.80:0/1173166772 learned_addr learned my addr 172.21.15.80:0/1173166772 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fcceffff640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf00b91c0 0x7fccf01d7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 -- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00d2480 msgr2=0x7fccf01d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf509d640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00d2480 0x7fccf01d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00d2480 0x7fccf01d7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 -- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf00b91c0 msgr2=0x7fccf01d7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf00b91c0 0x7fccf01d7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 -- 172.21.15.80:0/1173166772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf01d68f0 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fcceffff640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf00b91c0 0x7fccf01d7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf509d640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00d2480 0x7fccf01d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf489c640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 0x7fccf01d5ce0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c3f0 tx=0x7fcce000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0017070 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0005c70 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf01d6bd0 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00072f0 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.064+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf01d7190 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.065+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf0075c90 con 0x7fccf00b4b60 2024-04-25T15:46:51.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.066+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcce001a070 con 0x7fccf00b4b60 2024-04-25T15:46:51.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.066+0000 7fcced7fa640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fccdc0744e0 0x7fccdc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.066+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7fcce00943d0 con 0x7fccf00b4b60 2024-04-25T15:46:51.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.066+0000 7fcceffff640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fccdc0744e0 0x7fccdc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.067+0000 7fcceffff640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fccdc0744e0 0x7fccdc0769f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcce4034000 tx=0x7fcce402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.071+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcce0005e20 con 0x7fccf00b4b60 2024-04-25T15:46:51.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.311+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fccf006a100 con 0x7fccf00b4b60 2024-04-25T15:46:51.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.312+0000 7fcced7fa640 1 -- 172.21.15.80:0/1173166772 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fcce005ed20 con 0x7fccf00b4b60 2024-04-25T15:46:51.313 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:51.313 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:46:51.313 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmm+5KChAANTJpaz5f7kP4+/m5bRlMnw==", 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-25T15:46:51.314 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmum2sFhAAoe59I+LuSRLDINOlN3Fx5Q==", 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm2uOsERAAft4C499t0Mgr7sIrXod9oA==", 2024-04-25T15:46:51.315 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmDt4YHhAAiHrrpk0Av2yHyDXXLb5hCw==", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:51.316 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDQeSpmWMz4NBAA/SdfYaz0mir2b1XPChXx+g==", 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDTeSpm4vTJMxAAJVRE6t7Qfu8yA3Jx9T1xyw==", 2024-04-25T15:46:51.317 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDWeSpm9JrlMhAAoab+vrTpgt5vmAOT+4ZYkw==", 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDZeSpmfxgQMhAAKJxXLqN0hTDCe5EbbgEU0Q==", 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDdeSpmV8KsOhAArjRj+B/zaHnQXp3KyaRWzw==", 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.319 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDgeSpmCp1GORAAi+tt54IzkjRze8OOyRVDWA==", 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.320 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDjeSpmMnUrNxAAOeFGMIv8820+H0f380PxCA==", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDmeSpm6SpjNRAArbB989LbXoyh9HFtZ8aZGg==", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-25T15:46:51.321 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw==", 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmbs65KRAA0+fQbgSaXgfiQjNQz/58Jw==", 2024-04-25T15:46:51.322 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmlO8XJhAAIdXJNYsdNddWxnBkDWV70g==", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:46:51.323 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmyKlCLRAACjv7c2xvw+HypO6QF2gwbw==", 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.324 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDMeSpmVFP1JxAAQ3NwNePUywfB5CkeGWRjfA==", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpmX8eqBhAA43G6+tQFBus+84lDo0zfzA==", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:46:51.325 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQDNeSpm0rT6ABAAGBCBBvph3GTaO8Ewkgn+Og==", 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:46:51.326 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fccdc0744e0 msgr2=0x7fccdc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fccdc0744e0 0x7fccdc0769f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcce4034000 tx=0x7fcce402e000 comp rx=0 tx=0).stop 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 msgr2=0x7fccf01d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 0x7fccf01d5ce0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c3f0 tx=0x7fcce000c8b0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 shutdown_connections 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fccdc0744e0 0x7fccdc0769f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fccf00d2480 0x7fccf01d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf00b91c0 0x7fccf01d7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 --2- 172.21.15.80:0/1173166772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccf00b4b60 0x7fccf01d5ce0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 >> 172.21.15.80:0/1173166772 conn(0x7fccf00d0450 msgr2=0x7fccf006d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 shutdown_connections 2024-04-25T15:46:51.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.314+0000 7fccf6b00640 1 -- 172.21.15.80:0/1173166772 wait complete. 2024-04-25T15:46:51.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:51.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.434+0000 7fb36e0f2640 1 Processor -- start 2024-04-25T15:46:51.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.434+0000 7fb36e0f2640 1 -- start start 2024-04-25T15:46:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb36e0f2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb3680ceec0 0x7fb3680c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb36e0f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb3680d2670 0x7fb3680b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb36e0f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680d2a80 con 0x7fb3680d2260 2024-04-25T15:46:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb36e0f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb3680b2fe0 con 0x7fb3680d2670 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb36e0f2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb3680b32c0 con 0x7fb3680ceec0 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb367fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb3680d2670 0x7fb3680b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb366ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb3680d2260 0x7fb36806c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59648/0 (socket says 172.21.15.80:59648) 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb366ffd640 1 -- 172.21.15.80:0/4191475474 learned_addr learned my addr 172.21.15.80:0/4191475474 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb3677fe640 1 --2- 172.21.15.80:0/4191475474 >> v2:172.21.15.195:3300/0 conn(0x7fb3680ceec0 0x7fb3680c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb367fff640 1 -- 172.21.15.80:0/4191475474 >> v2:172.21.15.195:3300/0 conn(0x7fb3680ceec0 msgr2=0x7fb3680c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb367fff640 1 --2- 172.21.15.80:0/4191475474 >> v2:172.21.15.195:3300/0 conn(0x7fb3680ceec0 0x7fb3680c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb367fff640 1 -- 172.21.15.80:0/4191475474 >> v1:172.21.15.80:6789/0 conn(0x7fb3680d2260 legacy=0x7fb36806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb3667fc640 1 -- 172.21.15.80:0/4191475474 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841782013 0 0) 0x7fb3680d2a80 con 0x7fb3680d2260 2024-04-25T15:46:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb367fff640 1 -- 172.21.15.80:0/4191475474 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680b35a0 con 0x7fb3680d2670 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.436+0000 7fb3677fe640 1 --2- 172.21.15.80:0/4191475474 >> v2:172.21.15.195:3300/0 conn(0x7fb3680ceec0 0x7fb3680c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.437+0000 7fb367fff640 1 --2- 172.21.15.80:0/4191475474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680d2670 0x7fb3680b0bb0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb368073440 tx=0x7fb36002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4909e81731a60f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.437+0000 7fb3667fc640 1 -- 172.21.15.80:0/4191475474 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360007740 con 0x7fb3680d2670 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.437+0000 7fb3667fc640 1 -- 172.21.15.80:0/4191475474 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3600078e0 con 0x7fb3680d2670 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.437+0000 7fb3667fc640 1 -- 172.21.15.80:0/4191475474 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360007cb0 con 0x7fb3680d2670 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4191475474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680d2670 msgr2=0x7fb3680b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4191475474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680d2670 0x7fb3680b0bb0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb368073440 tx=0x7fb36002a560 comp rx=0 tx=0).stop 2024-04-25T15:46:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4191475474 shutdown_connections 2024-04-25T15:46:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4191475474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680d2670 0x7fb3680b0bb0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4191475474 >> v2:172.21.15.195:3300/0 conn(0x7fb3680ceec0 0x7fb3680c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4191475474 >> 172.21.15.80:0/4191475474 conn(0x7fb36809b410 msgr2=0x7fb3680b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4191475474 shutdown_connections 2024-04-25T15:46:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.438+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4191475474 wait complete. 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.440+0000 7fb36e0f2640 1 Processor -- start 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.440+0000 7fb36e0f2640 1 -- start start 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb36e0f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 0x7fb36815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb36e0f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3680d2260 0x7fb3680b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb36e0f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3680d2670 0x7fb368149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb36e0f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680c8780 con 0x7fb3680ceec0 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb36e0f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680d1d40 con 0x7fb3680d2260 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb36e0f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680cf2d0 con 0x7fb3680d2670 2024-04-25T15:46:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 0x7fb36815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 0x7fb36815a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34424/0 (socket says 172.21.15.80:34424) 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb3677fe640 1 -- 172.21.15.80:0/4256158677 learned_addr learned my addr 172.21.15.80:0/4256158677 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb367fff640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3680d2670 0x7fb368149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.441+0000 7fb366ffd640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3680d2260 0x7fb3680b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb3677fe640 1 -- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3680d2670 msgr2=0x7fb368149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb3677fe640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3680d2670 0x7fb368149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb3677fe640 1 -- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3680d2260 msgr2=0x7fb3680b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb3677fe640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3680d2260 0x7fb3680b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb3677fe640 1 -- 172.21.15.80:0/4256158677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680b1b50 con 0x7fb3680ceec0 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb367fff640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3680d2670 0x7fb368149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb366ffd640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3680d2260 0x7fb3680b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb3677fe640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 0x7fb36815a250 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb35800c820 tx=0x7fb35800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358015070 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358007a30 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3681591b0 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358007e20 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.442+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb368159770 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.443+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36806a100 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.444+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb358018070 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.444+0000 7fb34ffff640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb3540744b0 0x7fb3540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.444+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7fb358094ee0 con 0x7fb3680ceec0 2024-04-25T15:46:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.444+0000 7fb366ffd640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb3540744b0 0x7fb3540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.444+0000 7fb366ffd640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb3540744b0 0x7fb3540769c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb36806dc20 tx=0x7fb35c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.449+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb35805f8c0 con 0x7fb3680ceec0 2024-04-25T15:46:51.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.623+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb368068db0 con 0x7fb3680ceec0 2024-04-25T15:46:51.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.624+0000 7fb34ffff640 1 -- 172.21.15.80:0/4256158677 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+13153 (secure 0 0 0) 0x7fb35805f1c0 con 0x7fb3680ceec0 2024-04-25T15:46:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:51.625 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":95,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:50.937015+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:51.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb3540744b0 msgr2=0x7fb3540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb3540744b0 0x7fb3540769c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb36806dc20 tx=0x7fb35c009040 comp rx=0 tx=0).stop 2024-04-25T15:46:51.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 msgr2=0x7fb36815a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 0x7fb36815a250 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb35800c820 tx=0x7fb35800cce0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 shutdown_connections 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb3540744b0 0x7fb3540769c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3680d2670 0x7fb368149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3680d2260 0x7fb3680b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 --2- 172.21.15.80:0/4256158677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3680ceec0 0x7fb36815a250 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 >> 172.21.15.80:0/4256158677 conn(0x7fb36809b410 msgr2=0x7fb3680b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 shutdown_connections 2024-04-25T15:46:51.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.626+0000 7fb36e0f2640 1 -- 172.21.15.80:0/4256158677 wait complete. 2024-04-25T15:46:51.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:51.639 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.748+0000 7f2692f26640 1 Processor -- start 2024-04-25T15:46:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.748+0000 7f2692f26640 1 -- start start 2024-04-25T15:46:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f2692f26640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f268c0d1ec0 0x7f268c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f2692f26640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 0x7f268c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f2692f26640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268c0cf290 con 0x7f268c161a80 2024-04-25T15:46:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f2692f26640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f268c0ce1f0 con 0x7f268c0d1ec0 2024-04-25T15:46:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f2692f26640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f268c0d2e60 con 0x7f268c0ce940 2024-04-25T15:46:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f268bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f268c0d1ec0 0x7f268c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 0x7f268c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 0x7f268c0ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:59742/0 (socket says 172.21.15.80:59742) 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f268bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f268c0d1ec0 0x7f268c15de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:34782/0 (socket says 172.21.15.80:34782) 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 -- 172.21.15.80:0/3618657101 learned_addr learned my addr 172.21.15.80:0/3618657101 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 -- 172.21.15.80:0/3618657101 >> v2:172.21.15.195:3300/0 conn(0x7f268c0d1ec0 msgr2=0x7f268c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 --2- 172.21.15.80:0/3618657101 >> v2:172.21.15.195:3300/0 conn(0x7f268c0d1ec0 0x7f268c15de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 -- 172.21.15.80:0/3618657101 >> v1:172.21.15.195:6789/0 conn(0x7f268c161a80 legacy=0x7f268c0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.750+0000 7f26914c3640 1 -- 172.21.15.80:0/3618657101 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0d25c0 con 0x7f268c0ce940 2024-04-25T15:46:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.751+0000 7f26914c3640 1 --2- 172.21.15.80:0/3618657101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 0x7f268c0ced50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2684009e50 tx=0x7f268402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c63fb3fdeb5445 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.751+0000 7f268b7fe640 1 -- 172.21.15.80:0/3618657101 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684036070 con 0x7f268c0ce940 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.751+0000 7f268b7fe640 1 -- 172.21.15.80:0/3618657101 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2684031600 con 0x7f268c0ce940 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.751+0000 7f268b7fe640 1 -- 172.21.15.80:0/3618657101 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26840319d0 con 0x7f268c0ce940 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 -- 172.21.15.80:0/3618657101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 msgr2=0x7f268c0ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 --2- 172.21.15.80:0/3618657101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 0x7f268c0ced50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2684009e50 tx=0x7f268402a680 comp rx=0 tx=0).stop 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 -- 172.21.15.80:0/3618657101 shutdown_connections 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 --2- 172.21.15.80:0/3618657101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0ce940 0x7f268c0ced50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 --2- 172.21.15.80:0/3618657101 >> v2:172.21.15.195:3300/0 conn(0x7f268c0d1ec0 0x7f268c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 -- 172.21.15.80:0/3618657101 >> 172.21.15.80:0/3618657101 conn(0x7f268c0b5510 msgr2=0x7f268c0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 -- 172.21.15.80:0/3618657101 shutdown_connections 2024-04-25T15:46:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.752+0000 7f2692f26640 1 -- 172.21.15.80:0/3618657101 wait complete. 2024-04-25T15:46:51.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.754+0000 7f2692f26640 1 Processor -- start 2024-04-25T15:46:51.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.754+0000 7f2692f26640 1 -- start start 2024-04-25T15:46:51.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2692f26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 0x7f268c1603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2692f26640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0d1ec0 0x7f268c160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2692f26640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268c161a80 0x7f268c1f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2692f26640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f268c15e3d0 con 0x7f268c0ce940 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2692f26640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0d33e0 con 0x7f268c161a80 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2692f26640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f268c0d2b80 con 0x7f268c0d1ec0 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2690cc2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 0x7f268c1603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2690cc2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 0x7f268c1603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34428/0 (socket says 172.21.15.80:34428) 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f2690cc2640 1 -- 172.21.15.80:0/2487637925 learned_addr learned my addr 172.21.15.80:0/2487637925 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f268bfff640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0d1ec0 0x7f268c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.755+0000 7f26914c3640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268c161a80 0x7f268c1f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2690cc2640 1 -- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0d1ec0 msgr2=0x7f268c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2690cc2640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0d1ec0 0x7f268c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2690cc2640 1 -- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268c161a80 msgr2=0x7f268c1f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2690cc2640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268c161a80 0x7f268c1f7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2690cc2640 1 -- 172.21.15.80:0/2487637925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c1e7400 con 0x7f268c0ce940 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2690cc2640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 0x7f268c1603f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c470 tx=0x7f267c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0052d0 con 0x7f268c0ce940 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c005490 con 0x7f268c0ce940 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c007260 con 0x7f268c0ce940 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c1e76e0 con 0x7f268c0ce940 2024-04-25T15:46:51.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.756+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c0c8520 con 0x7f268c0ce940 2024-04-25T15:46:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.757+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268c06a100 con 0x7f268c0ce940 2024-04-25T15:46:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.758+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f267c007400 con 0x7f268c0ce940 2024-04-25T15:46:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.758+0000 7f26897fa640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26780744e0 0x7f26780769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.758+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7f267c0944c0 con 0x7f268c0ce940 2024-04-25T15:46:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.758+0000 7f268bfff640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26780744e0 0x7f26780769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.759+0000 7f268bfff640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26780744e0 0x7f26780769f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f268c1e6f50 tx=0x7f2680009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.763+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f268c0cf290 con 0x7f268c0ce940 2024-04-25T15:46:51.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.942+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f268c0b3030 con 0x7f268c0ce940 2024-04-25T15:46:51.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.942+0000 7f26897fa640 1 -- 172.21.15.80:0/2487637925 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f267c05e740 con 0x7f268c0ce940 2024-04-25T15:46:51.944 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:46:51.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26780744e0 msgr2=0x7f26780769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26780744e0 0x7f26780769f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f268c1e6f50 tx=0x7f2680009190 comp rx=0 tx=0).stop 2024-04-25T15:46:51.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 msgr2=0x7f268c1603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 0x7f268c1603f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c470 tx=0x7f267c00c930 comp rx=0 tx=0).stop 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 shutdown_connections 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26780744e0 0x7f26780769f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268c161a80 0x7f268c1f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f268c0d1ec0 0x7f268c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 --2- 172.21.15.80:0/2487637925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f268c0ce940 0x7f268c1603f0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 >> 172.21.15.80:0/2487637925 conn(0x7f268c0b5510 msgr2=0x7f268c0d3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 shutdown_connections 2024-04-25T15:46:51.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:51.944+0000 7f2692f26640 1 -- 172.21.15.80:0/2487637925 wait complete. 2024-04-25T15:46:51.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:46:52.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.064+0000 7faea651f640 1 Processor -- start 2024-04-25T15:46:52.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.064+0000 7faea651f640 1 -- start start 2024-04-25T15:46:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7faea651f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea015dfe0 0x7faea00d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7faea651f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faea00d19c0 0x7faea00b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7faea651f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea00b7600 con 0x7faea0154110 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7faea651f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7faea015e3f0 con 0x7faea00d19c0 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7faea651f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faea00d0ff0 con 0x7faea015dfe0 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7faea4abc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faea00d19c0 0x7faea00b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7fae9ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faea0154110 0x7faea006c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59658/0 (socket says 172.21.15.80:59658) 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.065+0000 7fae9ffff640 1 -- 172.21.15.80:0/568930713 learned_addr learned my addr 172.21.15.80:0/568930713 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7faea4abc640 1 -- 172.21.15.80:0/568930713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea015dfe0 msgr2=0x7faea00d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7fae9f7fe640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea015dfe0 0x7faea00d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7faea4abc640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea015dfe0 0x7faea00d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7faea4abc640 1 -- 172.21.15.80:0/568930713 >> v1:172.21.15.80:6789/0 conn(0x7faea0154110 legacy=0x7faea006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7fae9effd640 1 -- 172.21.15.80:0/568930713 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393964421 0 0) 0x7faea00b7600 con 0x7faea0154110 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7faea4abc640 1 -- 172.21.15.80:0/568930713 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea006ccd0 con 0x7faea00d19c0 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.066+0000 7fae9f7fe640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea015dfe0 0x7faea00d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea4abc640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea00b5bd0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fae98009d90 tx=0x7fae9802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9903602bf532b937 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7fae9effd640 1 -- 172.21.15.80:0/568930713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98007740 con 0x7faea00d19c0 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7fae9effd640 1 -- 172.21.15.80:0/568930713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae980078e0 con 0x7faea00d19c0 2024-04-25T15:46:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7fae9effd640 1 -- 172.21.15.80:0/568930713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98007cb0 con 0x7faea00d19c0 2024-04-25T15:46:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 -- 172.21.15.80:0/568930713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 msgr2=0x7faea00b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea00b5bd0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fae98009d90 tx=0x7fae9802a660 comp rx=0 tx=0).stop 2024-04-25T15:46:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 -- 172.21.15.80:0/568930713 shutdown_connections 2024-04-25T15:46:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea00b5bd0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 --2- 172.21.15.80:0/568930713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea015dfe0 0x7faea00d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 -- 172.21.15.80:0/568930713 >> 172.21.15.80:0/568930713 conn(0x7faea00d2080 msgr2=0x7faea00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 -- 172.21.15.80:0/568930713 shutdown_connections 2024-04-25T15:46:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.067+0000 7faea651f640 1 -- 172.21.15.80:0/568930713 wait complete. 2024-04-25T15:46:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.069+0000 7faea651f640 1 Processor -- start 2024-04-25T15:46:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.069+0000 7faea651f640 1 -- start start 2024-04-25T15:46:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea0154110 0x7faea01547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faea015dfe0 0x7faea0160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faea00b7320 con 0x7faea00d19c0 2024-04-25T15:46:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faea00d0cc0 con 0x7faea015dfe0 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faea00d1dd0 con 0x7faea0154110 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea014b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34450/0 (socket says 172.21.15.80:34450) 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 -- 172.21.15.80:0/2034546748 learned_addr learned my addr 172.21.15.80:0/2034546748 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9f7fe640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea0154110 0x7faea01547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea4abc640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faea015dfe0 0x7faea0160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 -- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea0154110 msgr2=0x7faea01547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea0154110 0x7faea01547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 -- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faea015dfe0 msgr2=0x7faea0160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faea015dfe0 0x7faea0160950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 -- 172.21.15.80:0/2034546748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea0154d30 con 0x7faea00d19c0 2024-04-25T15:46:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea4abc640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faea015dfe0 0x7faea0160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9ffff640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea014b3d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fae9000c430 tx=0x7fae9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90017070 con 0x7faea00d19c0 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae90005ce0 con 0x7faea00d19c0 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90007310 con 0x7faea00d19c0 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea0156670 con 0x7faea00d19c0 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.071+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea0156c30 con 0x7faea00d19c0 2024-04-25T15:46:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.072+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea006a100 con 0x7faea00d19c0 2024-04-25T15:46:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.073+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fae9001a070 con 0x7faea00d19c0 2024-04-25T15:46:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.074+0000 7fae9cff9640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae8c0744b0 0x7fae8c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.074+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7fae90094290 con 0x7faea00d19c0 2024-04-25T15:46:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.074+0000 7fae9f7fe640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae8c0744b0 0x7fae8c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.074+0000 7fae9f7fe640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae8c0744b0 0x7fae8c0769c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faea01600d0 tx=0x7fae94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.078+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae9005e6b0 con 0x7faea00d19c0 2024-04-25T15:46:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.253+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7faea00d1420 con 0x7faea00d19c0 2024-04-25T15:46:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.254+0000 7fae9cff9640 1 -- 172.21.15.80:0/2034546748 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) ==== 84+0+65 (secure 0 0 0) 0x7fae900629b0 con 0x7faea00d19c0 2024-04-25T15:46:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:52.255 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T15:46:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:46:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T15:46:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T15:46:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:46:52.256 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T15:46:52.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae8c0744b0 msgr2=0x7fae8c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae8c0744b0 0x7fae8c0769c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faea01600d0 tx=0x7fae94008040 comp rx=0 tx=0).stop 2024-04-25T15:46:52.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 msgr2=0x7faea014b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea014b3d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fae9000c430 tx=0x7fae9000c8f0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 shutdown_connections 2024-04-25T15:46:52.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fae8c0744b0 0x7fae8c0769c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faea015dfe0 0x7faea0160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faea0154110 0x7faea01547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 --2- 172.21.15.80:0/2034546748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea00d19c0 0x7faea014b3d0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 >> 172.21.15.80:0/2034546748 conn(0x7faea00d2080 msgr2=0x7faea00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 shutdown_connections 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.256+0000 7faea651f640 1 -- 172.21.15.80:0/2034546748 wait complete. 2024-04-25T15:46:52.268 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:46:52.269 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:46:52.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.379+0000 7f3a2964c640 1 Processor -- start 2024-04-25T15:46:52.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.379+0000 7f3a2964c640 1 -- start start 2024-04-25T15:46:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a2964c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a240d41b0 0x7f3a240b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a2964c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3a241602a0 0x7f3a240b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a2964c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a240b7b90 0x7f3a240d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a2964c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3a240b7fa0 con 0x7f3a240b7b90 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a2964c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3a24163fb0 con 0x7f3a241602a0 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a2964c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a24164270 con 0x7f3a240d41b0 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a237fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a240b7b90 0x7f3a240d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.380+0000 7f3a237fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a240b7b90 0x7f3a240d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34464/0 (socket says 172.21.15.80:34464) 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 -- 172.21.15.80:0/648939802 learned_addr learned my addr 172.21.15.80:0/648939802 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a227fc640 1 --2- 172.21.15.80:0/648939802 >> v2:172.21.15.195:3300/0 conn(0x7f3a241602a0 0x7f3a240b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a22ffd640 1 --2- 172.21.15.80:0/648939802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a240d41b0 0x7f3a240b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 -- 172.21.15.80:0/648939802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a240d41b0 msgr2=0x7f3a240b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 --2- 172.21.15.80:0/648939802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a240d41b0 0x7f3a240b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 -- 172.21.15.80:0/648939802 >> v2:172.21.15.195:3300/0 conn(0x7f3a241602a0 msgr2=0x7f3a240b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 --2- 172.21.15.80:0/648939802 >> v2:172.21.15.195:3300/0 conn(0x7f3a241602a0 0x7f3a240b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 -- 172.21.15.80:0/648939802 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a24164550 con 0x7f3a240b7b90 2024-04-25T15:46:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a227fc640 1 --2- 172.21.15.80:0/648939802 >> v2:172.21.15.195:3300/0 conn(0x7f3a241602a0 0x7f3a240b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.381+0000 7f3a237fe640 1 --2- 172.21.15.80:0/648939802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240b7b90 0x7f3a240d0980 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3a2408e170 tx=0x7f3a1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0364e7c99f39af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a21ffb640 1 -- 172.21.15.80:0/648939802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c037070 con 0x7f3a240b7b90 2024-04-25T15:46:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a21ffb640 1 -- 172.21.15.80:0/648939802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c032440 con 0x7f3a240b7b90 2024-04-25T15:46:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a21ffb640 1 -- 172.21.15.80:0/648939802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c032810 con 0x7f3a240b7b90 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 -- 172.21.15.80:0/648939802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240b7b90 msgr2=0x7f3a240d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 --2- 172.21.15.80:0/648939802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240b7b90 0x7f3a240d0980 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3a2408e170 tx=0x7f3a1c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 -- 172.21.15.80:0/648939802 shutdown_connections 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 --2- 172.21.15.80:0/648939802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240b7b90 0x7f3a240d0980 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 --2- 172.21.15.80:0/648939802 >> v2:172.21.15.195:3300/0 conn(0x7f3a241602a0 0x7f3a240b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 --2- 172.21.15.80:0/648939802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a240d41b0 0x7f3a240b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 -- 172.21.15.80:0/648939802 >> 172.21.15.80:0/648939802 conn(0x7f3a2406e9f0 msgr2=0x7f3a240d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 -- 172.21.15.80:0/648939802 shutdown_connections 2024-04-25T15:46:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.382+0000 7f3a2964c640 1 -- 172.21.15.80:0/648939802 wait complete. 2024-04-25T15:46:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.384+0000 7f3a2964c640 1 Processor -- start 2024-04-25T15:46:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.384+0000 7f3a2964c640 1 -- start start 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a240b7b90 0x7f3a24163100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 0x7f3a240ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a241602a0 0x7f3a240cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240b4fd0 con 0x7f3a240d41b0 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24164b10 con 0x7f3a240b7b90 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a240b5150 con 0x7f3a241602a0 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 0x7f3a240ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 0x7f3a240ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34470/0 (socket says 172.21.15.80:34470) 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 -- 172.21.15.80:0/3954185769 learned_addr learned my addr 172.21.15.80:0/3954185769 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a22ffd640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a240b7b90 0x7f3a24163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a237fe640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a241602a0 0x7f3a240cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 -- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a241602a0 msgr2=0x7f3a240cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a241602a0 0x7f3a240cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 -- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a240b7b90 msgr2=0x7f3a24163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a240b7b90 0x7f3a24163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 -- 172.21.15.80:0/3954185769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a240cde20 con 0x7f3a240d41b0 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a22ffd640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a240b7b90 0x7f3a24163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a227fc640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 0x7f3a240ced20 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800d800 tx=0x7f3a1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18004030 con 0x7f3a240d41b0 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a180041d0 con 0x7f3a240d41b0 2024-04-25T15:46:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a180096a0 con 0x7f3a240d41b0 2024-04-25T15:46:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a240ce100 con 0x7f3a240d41b0 2024-04-25T15:46:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.386+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a24160900 con 0x7f3a240d41b0 2024-04-25T15:46:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.387+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2406a100 con 0x7f3a240d41b0 2024-04-25T15:46:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.388+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3a18009840 con 0x7f3a240d41b0 2024-04-25T15:46:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.389+0000 7f3a0b7fe640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a100744b0 0x7f3a100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.389+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5249+0+0 (secure 0 0 0) 0x7f3a18095370 con 0x7f3a240d41b0 2024-04-25T15:46:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.389+0000 7f3a22ffd640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a100744b0 0x7f3a100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.389+0000 7f3a22ffd640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a100744b0 0x7f3a100769c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009ed0 tx=0x7f3a1400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.393+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a1805fcc0 con 0x7f3a240d41b0 2024-04-25T15:46:52.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.567+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3a241636c0 con 0x7f3a240d41b0 2024-04-25T15:46:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.940+0000 7f3a0b7fe640 1 -- 172.21.15.80:0/3954185769 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) ==== 138+0+0 (secure 0 0 0) 0x7f3a1805f5c0 con 0x7f3a240d41b0 2024-04-25T15:46:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T15:46:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a100744b0 msgr2=0x7f3a100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a100744b0 0x7f3a100769c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009ed0 tx=0x7f3a1400b040 comp rx=0 tx=0).stop 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 msgr2=0x7f3a240ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 0x7f3a240ced20 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800d800 tx=0x7f3a1800dcc0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 shutdown_connections 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3a100744b0 0x7f3a100769c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a241602a0 0x7f3a240cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a240d41b0 0x7f3a240ced20 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 --2- 172.21.15.80:0/3954185769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a240b7b90 0x7f3a24163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 >> 172.21.15.80:0/3954185769 conn(0x7f3a2406e9f0 msgr2=0x7f3a240c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 shutdown_connections 2024-04-25T15:46:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:52.942+0000 7f3a2964c640 1 -- 172.21.15.80:0/3954185769 wait complete. 2024-04-25T15:46:52.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:46:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.073+0000 7f0b6c98f640 1 Processor -- start 2024-04-25T15:46:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.073+0000 7f0b6c98f640 1 -- start start 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b6c98f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b680ce860 0x7f0b680b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b6c98f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b68073a40 0x7f0b681601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b6c98f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b681642e0 con 0x7f0b68163e00 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b6c98f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0b681606e0 con 0x7f0b680ce860 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b6c98f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b681645c0 con 0x7f0b68073a40 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b65d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b68163e00 0x7f0b68073330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59666/0 (socket says 172.21.15.80:59666) 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b65d9b640 1 -- 172.21.15.80:0/3590447034 learned_addr learned my addr 172.21.15.80:0/3590447034 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.074+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855504313 0 0) 0x7f0b681642e0 con 0x7f0b68163e00 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b50003520 con 0x7f0b68163e00 2024-04-25T15:46:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 --2- 172.21.15.80:0/3590447034 >> v2:172.21.15.195:3300/0 conn(0x7f0b680ce860 0x7f0b680b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b66d9d640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b68073a40 0x7f0b681601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3871298384 0 0) 0x7f0b50003520 con 0x7f0b68163e00 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b68073a40 msgr2=0x7f0b681601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b68073a40 0x7f0b681601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 >> v2:172.21.15.195:3300/0 conn(0x7f0b680ce860 msgr2=0x7f0b680b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 --2- 172.21.15.80:0/3590447034 >> v2:172.21.15.195:3300/0 conn(0x7f0b680ce860 0x7f0b680b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b681648a0 con 0x7f0b68163e00 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f0b5c0017f0 con 0x7f0b68163e00 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 >> v1:172.21.15.80:6789/0 conn(0x7f0b68163e00 legacy=0x7f0b68073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b50003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b50004800 0x7f0b50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b50005150 0x7f0b5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681606e0 con 0x7f0b500039b0 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681645c0 con 0x7f0b50005150 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5000bf00 con 0x7f0b50004800 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b50003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b65d9b640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b50004800 0x7f0b50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b66d9d640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b50005150 0x7f0b5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 -- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b50004800 msgr2=0x7f0b50004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b50004800 0x7f0b50004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 -- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b50005150 msgr2=0x7f0b5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b50005150 0x7f0b5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b6659c640 1 -- 172.21.15.80:0/3590447034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b50003520 con 0x7f0b500039b0 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.075+0000 7f0b66d9d640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b50005150 0x7f0b5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.076+0000 7f0b6659c640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b50003e20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009fc0 tx=0x7f0b50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4dada65a51c8db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.076+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58009c10 con 0x7f0b500039b0 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.076+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58036070 con 0x7f0b500039b0 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.076+0000 7f0b6559a640 1 -- 172.21.15.80:0/3590447034 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5802d070 con 0x7f0b500039b0 2024-04-25T15:46:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b6c98f640 1 -- 172.21.15.80:0/3590447034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 msgr2=0x7f0b50003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/3590447034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b50003e20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009fc0 tx=0x7f0b50005830 comp rx=0 tx=0).stop 2024-04-25T15:46:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b66d9d640 1 -- 172.21.15.80:0/3590447034 reap_dead start 2024-04-25T15:46:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b6c98f640 1 -- 172.21.15.80:0/3590447034 shutdown_connections 2024-04-25T15:46:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b6c98f640 1 -- 172.21.15.80:0/3590447034 >> 172.21.15.80:0/3590447034 conn(0x7f0b680d3ea0 msgr2=0x7f0b680d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b6c98f640 1 -- 172.21.15.80:0/3590447034 shutdown_connections 2024-04-25T15:46:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.077+0000 7f0b6c98f640 1 -- 172.21.15.80:0/3590447034 wait complete. 2024-04-25T15:46:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.079+0000 7f0b6c98f640 1 Processor -- start 2024-04-25T15:46:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.079+0000 7f0b6c98f640 1 -- start start 2024-04-25T15:46:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6c98f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b680cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6c98f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b681f9f00 0x7f0b6814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6c98f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b680b34c0 0x7f0b680b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6c98f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b68073a40 con 0x7f0b500039b0 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6c98f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0b680d1aa0 con 0x7f0b680b34c0 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6c98f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b68073bc0 con 0x7f0b681f9f00 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b680cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b680cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34486/0 (socket says 172.21.15.80:34486) 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b6659c640 1 -- 172.21.15.80:0/2754199016 learned_addr learned my addr 172.21.15.80:0/2754199016 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b65d9b640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b681f9f00 0x7f0b6814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.080+0000 7f0b66d9d640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b680b34c0 0x7f0b680b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6659c640 1 -- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b681f9f00 msgr2=0x7f0b6814cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6659c640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b681f9f00 0x7f0b6814cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6659c640 1 -- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b680b34c0 msgr2=0x7f0b680b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6659c640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b680b34c0 0x7f0b680b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6659c640 1 -- 172.21.15.80:0/2754199016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6814d400 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b65d9b640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b681f9f00 0x7f0b6814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b66d9d640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b680b34c0 0x7f0b680b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6659c640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b680cd590 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0b5802af10 tx=0x7f0b58009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58009c10 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58003bb0 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b680b7760 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58004020 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.081+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b680b7d00 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.082+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6806a100 con 0x7f0b500039b0 2024-04-25T15:46:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.083+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0b58005d10 con 0x7f0b500039b0 2024-04-25T15:46:53.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.084+0000 7f0b56ffd640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b480744e0 0x7f0b480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.084+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5619+0+0 (secure 0 0 0) 0x7f0b580b6d20 con 0x7f0b500039b0 2024-04-25T15:46:53.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.084+0000 7f0b65d9b640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b480744e0 0x7f0b480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.084+0000 7f0b65d9b640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b480744e0 0x7f0b480769f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0b680c7100 tx=0x7f0b5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:53.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.088+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b580815e0 con 0x7f0b500039b0 2024-04-25T15:46:53.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.262+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0b6806de90 con 0x7f0b500039b0 2024-04-25T15:46:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.946+0000 7f0b56ffd640 1 -- 172.21.15.80:0/2754199016 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) ==== 170+0+0 (secure 0 0 0) 0x7f0b58080ee0 con 0x7f0b500039b0 2024-04-25T15:46:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T15:46:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b480744e0 msgr2=0x7f0b480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b480744e0 0x7f0b480769f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0b680c7100 tx=0x7f0b5c009040 comp rx=0 tx=0).stop 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 msgr2=0x7f0b680cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b680cd590 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0b5802af10 tx=0x7f0b58009750 comp rx=0 tx=0).stop 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 shutdown_connections 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0b480744e0 0x7f0b480769f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b680b34c0 0x7f0b680b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b681f9f00 0x7f0b6814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 --2- 172.21.15.80:0/2754199016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b500039b0 0x7f0b680cd590 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 >> 172.21.15.80:0/2754199016 conn(0x7f0b680d3ea0 msgr2=0x7f0b6815dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 shutdown_connections 2024-04-25T15:46:53.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:53.949+0000 7f0b6c98f640 1 -- 172.21.15.80:0/2754199016 wait complete. 2024-04-25T15:46:53.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:46:54.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.084+0000 7fe0b9c92640 1 Processor -- start 2024-04-25T15:46:54.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.084+0000 7fe0b9c92640 1 -- start start 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b9c92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b40b5490 0x7fe0b4160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b9c92640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe0b40d0b00 0x7fe0b40d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b9c92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b40d57e0 con 0x7fe0b40d2b80 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b9c92640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b41643f0 con 0x7fe0b40d0b00 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b9c92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b41646d0 con 0x7fe0b40b5490 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0b40d2b80 0x7fe0b40b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59672/0 (socket says 172.21.15.80:59672) 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b3fff640 1 -- 172.21.15.80:0/3276847170 learned_addr learned my addr 172.21.15.80:0/3276847170 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b37fe640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b40b5490 0x7fe0b4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0aaffd640 1 --2- 172.21.15.80:0/3276847170 >> v2:172.21.15.195:3300/0 conn(0x7fe0b40d0b00 0x7fe0b40d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871302938 0 0) 0x7fe0b40d57e0 con 0x7fe0b40d2b80 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.085+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a0003520 con 0x7fe0b40d2b80 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 660851768 0 0) 0x7fe0a0003520 con 0x7fe0b40d2b80 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b40b5490 msgr2=0x7fe0b4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b40b5490 0x7fe0b4160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 >> v2:172.21.15.195:3300/0 conn(0x7fe0b40d0b00 msgr2=0x7fe0b40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 --2- 172.21.15.80:0/3276847170 >> v2:172.21.15.195:3300/0 conn(0x7fe0b40d0b00 0x7fe0b40d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b41649b0 con 0x7fe0b40d2b80 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe0ac0019f0 con 0x7fe0b40d2b80 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0aaffd640 1 --2- 172.21.15.80:0/3276847170 >> v2:172.21.15.195:3300/0 conn(0x7fe0b40d0b00 0x7fe0b40d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 >> v1:172.21.15.80:6789/0 conn(0x7fe0b40d2b80 legacy=0x7fe0b40b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0a00039b0 0x7fe0a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a0004340 0x7fe0a0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0a0004ed0 0x7fe0a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b41643f0 con 0x7fe0a0004ed0 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b41646d0 con 0x7fe0a0004340 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a000bf00 con 0x7fe0a00039b0 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b3fff640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0a0004ed0 0x7fe0a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b37fe640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0a00039b0 0x7fe0a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0aaffd640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a0004340 0x7fe0a0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b3fff640 1 -- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0a00039b0 msgr2=0x7fe0a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b3fff640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0a00039b0 0x7fe0a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b3fff640 1 -- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a0004340 msgr2=0x7fe0a0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b3fff640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a0004340 0x7fe0a0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.086+0000 7fe0b3fff640 1 -- 172.21.15.80:0/3276847170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a0003520 con 0x7fe0a0004ed0 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.087+0000 7fe0b3fff640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0a0004ed0 0x7fe0a000b9c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40d0450 tx=0x7fe0a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a0684581ba6cd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.087+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00a4c0 con 0x7fe0a0004ed0 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.087+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ac02f070 con 0x7fe0a0004ed0 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.087+0000 7fe0b2ffd640 1 -- 172.21.15.80:0/3276847170 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac02bc90 con 0x7fe0a0004ed0 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b9c92640 1 -- 172.21.15.80:0/3276847170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0a0004ed0 msgr2=0x7fe0a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/3276847170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0a0004ed0 0x7fe0a000b9c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40d0450 tx=0x7fe0a0005830 comp rx=0 tx=0).stop 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b3fff640 1 -- 172.21.15.80:0/3276847170 reap_dead start 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b9c92640 1 -- 172.21.15.80:0/3276847170 shutdown_connections 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b9c92640 1 -- 172.21.15.80:0/3276847170 >> 172.21.15.80:0/3276847170 conn(0x7fe0b406e650 msgr2=0x7fe0b406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:54.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b9c92640 1 -- 172.21.15.80:0/3276847170 shutdown_connections 2024-04-25T15:46:54.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.088+0000 7fe0b9c92640 1 -- 172.21.15.80:0/3276847170 wait complete. 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.090+0000 7fe0b9c92640 1 Processor -- start 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.090+0000 7fe0b9c92640 1 -- start start 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b9c92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 0x7fe0b41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b9c92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0b4154380 0x7fe0b4162110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b9c92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b4154790 0x7fe0b4162650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b9c92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40b9360 con 0x7fe0b4157320 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b9c92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40d2f90 con 0x7fe0b4154380 2024-04-25T15:46:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b9c92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b40b94e0 con 0x7fe0b4154790 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 0x7fe0b41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 0x7fe0b41533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34490/0 (socket says 172.21.15.80:34490) 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 -- 172.21.15.80:0/1414137395 learned_addr learned my addr 172.21.15.80:0/1414137395 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 -- 172.21.15.80:0/1414137395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b4154790 msgr2=0x7fe0b4162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b4154790 0x7fe0b4162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 -- 172.21.15.80:0/1414137395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0b4154380 msgr2=0x7fe0b4162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0b4154380 0x7fe0b4162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.091+0000 7fe0b37fe640 1 -- 172.21.15.80:0/1414137395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b41603a0 con 0x7fe0b4157320 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.092+0000 7fe0b37fe640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 0x7fe0b41533a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4011930 tx=0x7fe0a4011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.092+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400f9b0 con 0x7fe0b4157320 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.092+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a400fb50 con 0x7fe0b4157320 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.092+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4014440 con 0x7fe0b4157320 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.092+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b4160680 con 0x7fe0b4157320 2024-04-25T15:46:54.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.092+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b4158e10 con 0x7fe0b4157320 2024-04-25T15:46:54.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.093+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b406a100 con 0x7fe0b4157320 2024-04-25T15:46:54.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.093+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe0a4012040 con 0x7fe0b4157320 2024-04-25T15:46:54.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.094+0000 7fe0b0ff9640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0940744b0 0x7fe0940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.094+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6001+0+0 (secure 0 0 0) 0x7fe0a4095990 con 0x7fe0b4157320 2024-04-25T15:46:54.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.094+0000 7fe0aaffd640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0940744b0 0x7fe0940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.094+0000 7fe0aaffd640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0940744b0 0x7fe0940769c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe0b406eff0 tx=0x7fe09c009780 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.099+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0a4019030 con 0x7fe0b4157320 2024-04-25T15:46:54.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.311+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe0b40d41d0 con 0x7fe0b4157320 2024-04-25T15:46:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.948+0000 7fe0b0ff9640 1 -- 172.21.15.80:0/1414137395 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v50) ==== 174+0+0 (secure 0 0 0) 0x7fe0a40950c0 con 0x7fe0b4157320 2024-04-25T15:46:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 15 and data pool 16 2024-04-25T15:46:54.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.953+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0940744b0 msgr2=0x7fe0940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0940744b0 0x7fe0940769c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe0b406eff0 tx=0x7fe09c009780 comp rx=0 tx=0).stop 2024-04-25T15:46:54.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 msgr2=0x7fe0b41533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 0x7fe0b41533a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4011930 tx=0x7fe0a4011df0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 shutdown_connections 2024-04-25T15:46:54.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0940744b0 0x7fe0940769c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0b4154790 0x7fe0b4162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0b4154380 0x7fe0b4162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 --2- 172.21.15.80:0/1414137395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0b4157320 0x7fe0b41533a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 >> 172.21.15.80:0/1414137395 conn(0x7fe0b406e650 msgr2=0x7fe0b40d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.954+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 shutdown_connections 2024-04-25T15:46:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:54.955+0000 7fe0b9c92640 1 -- 172.21.15.80:0/1414137395 wait complete. 2024-04-25T15:46:54.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.092+0000 7f716ec92640 1 Processor -- start 2024-04-25T15:46:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.092+0000 7f716ec92640 1 -- start start 2024-04-25T15:46:55.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f716ec92640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7168160f90 0x7f7168168b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f716ec92640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71681589c0 con 0x7f71680714a0 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f716ec92640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716815ee90 con 0x7f716806db10 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f716ec92640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f716815faf0 con 0x7f7168160f90 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f7167fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f71680714a0 0x7f71680718b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43726/0 (socket says 172.21.15.80:43726) 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f7167fff640 1 -- 172.21.15.80:0/1568142009 learned_addr learned my addr 172.21.15.80:0/1568142009 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720339923 0 0) 0x7f71681589c0 con 0x7f71680714a0 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7150003520 con 0x7f71680714a0 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f716d22f640 1 --2- 172.21.15.80:0/1568142009 >> v2:172.21.15.195:3300/0 conn(0x7f7168160f90 0x7f7168168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4211959633 0 0) 0x7f7150003520 con 0x7f71680714a0 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 >> v2:172.21.15.195:3300/0 conn(0x7f7168160f90 msgr2=0x7f7168168b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 --2- 172.21.15.80:0/1568142009 >> v2:172.21.15.195:3300/0 conn(0x7f7168160f90 0x7f7168168b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 >> v1:172.21.15.195:6789/0 conn(0x7f716806db10 legacy=0x7f716815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716815f170 con 0x7f71680714a0 2024-04-25T15:46:55.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f715c001690 con 0x7f71680714a0 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 >> v1:172.21.15.80:6789/0 conn(0x7f71680714a0 legacy=0x7f71680718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71500039b0 0x7f7150003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7150004800 0x7f7150004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7150005270 0x7f715000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f716815faf0 con 0x7f71500039b0 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f715000c200 con 0x7f7150005270 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f715000c400 con 0x7f7150004800 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f716ca2e640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71500039b0 0x7f7150003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.094+0000 7f7167fff640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7150004800 0x7f7150004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716d22f640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7150005270 0x7f715000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716ca2e640 1 -- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7150004800 msgr2=0x7f7150004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716ca2e640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7150004800 0x7f7150004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716ca2e640 1 -- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7150005270 msgr2=0x7f715000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716ca2e640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7150005270 0x7f715000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716ca2e640 1 -- 172.21.15.80:0/1568142009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7150003520 con 0x7f71500039b0 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716d22f640 1 -- 172.21.15.80:0/1568142009 reap_dead start 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f716ca2e640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71500039b0 0x7f7150003e40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7158001720 tx=0x7f7150005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8c51c7786c7ff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.095+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158001370 con 0x7f71500039b0 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71580052d0 con 0x7f71500039b0 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f71677fe640 1 -- 172.21.15.80:0/1568142009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715802ab90 con 0x7f71500039b0 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 -- 172.21.15.80:0/1568142009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71500039b0 msgr2=0x7f7150003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71500039b0 0x7f7150003e40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7158001720 tx=0x7f7150005830 comp rx=0 tx=0).stop 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 -- 172.21.15.80:0/1568142009 shutdown_connections 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 --2- 172.21.15.80:0/1568142009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71500039b0 0x7f7150003e40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 -- 172.21.15.80:0/1568142009 >> 172.21.15.80:0/1568142009 conn(0x7f71680d2080 msgr2=0x7f71680d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 -- 172.21.15.80:0/1568142009 shutdown_connections 2024-04-25T15:46:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.096+0000 7f716ec92640 1 -- 172.21.15.80:0/1568142009 wait complete. 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.098+0000 7f716ec92640 1 Processor -- start 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.098+0000 7f716ec92640 1 -- start start 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716ec92640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71500039b0 0x7f71681568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716ec92640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71680b0860 0x7f716814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716ec92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 0x7f7168152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716ec92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f71680718b0 con 0x7f7168152510 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716ec92640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f716815f450 con 0x7f71500039b0 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716ec92640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7168071a30 con 0x7f71680b0860 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.099+0000 7f716d22f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 0x7f7168152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 0x7f7168152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33832/0 (socket says 172.21.15.80:33832) 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 -- 172.21.15.80:0/2485849332 learned_addr learned my addr 172.21.15.80:0/2485849332 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f7167fff640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71680b0860 0x7f716814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716ca2e640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71500039b0 0x7f71681568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 -- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71680b0860 msgr2=0x7f716814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71680b0860 0x7f716814fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 -- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71500039b0 msgr2=0x7f71681568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71500039b0 0x7f71681568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 -- 172.21.15.80:0/2485849332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7168152e60 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716d22f640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 0x7f7168152920 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f716806fbd0 tx=0x7f716000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716000fd80 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716001d070 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7168151100 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160015670 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.100+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681516c0 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.101+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716815bdd0 con 0x7f7168152510 2024-04-25T15:46:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.102+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7160015810 con 0x7f7168152510 2024-04-25T15:46:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.102+0000 7f71657fa640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71540744b0 0x7f71540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.102+0000 7f716ca2e640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71540744b0 0x7f71540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.102+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f7160095b90 con 0x7f7168152510 2024-04-25T15:46:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.103+0000 7f716ca2e640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71540744b0 0x7f71540769c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7158032000 tx=0x7f715802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.107+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f716815bdd0 con 0x7f7168152510 2024-04-25T15:46:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.283+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71680b16d0 con 0x7f7168152510 2024-04-25T15:46:55.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.285+0000 7f71657fa640 1 -- 172.21.15.80:0/2485849332 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16874 (secure 0 0 0) 0x7f71680b16d0 con 0x7f7168152510 2024-04-25T15:46:55.286 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:55.286 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":98,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:54.313655+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71540744b0 msgr2=0x7f71540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71540744b0 0x7f71540769c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7158032000 tx=0x7f715802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 msgr2=0x7f7168152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 0x7f7168152920 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f716806fbd0 tx=0x7f716000f580 comp rx=0 tx=0).stop 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 shutdown_connections 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f71540744b0 0x7f71540769c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7168152510 0x7f7168152920 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71680b0860 0x7f716814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 --2- 172.21.15.80:0/2485849332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71500039b0 0x7f71681568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 >> 172.21.15.80:0/2485849332 conn(0x7f71680d2080 msgr2=0x7f71680b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 shutdown_connections 2024-04-25T15:46:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.287+0000 7f716ec92640 1 -- 172.21.15.80:0/2485849332 wait complete. 2024-04-25T15:46:55.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.406+0000 7fa581d14640 1 Processor -- start 2024-04-25T15:46:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.406+0000 7fa581d14640 1 -- start start 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa581d14640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa57c071950 0x7fa57c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa581d14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c161c80 0x7fa57c0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa581d14640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa57c0b74c0 0x7fa57c0d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa581d14640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa57c072aa0 con 0x7fa57c071950 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa581d14640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa57c1624d0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa581d14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa57c1627b0 con 0x7fa57c161c80 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa57b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa57c071950 0x7fa57c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa57b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa57c071950 0x7fa57c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33844/0 (socket says 172.21.15.80:33844) 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa57b7fe640 1 -- 172.21.15.80:0/4286865699 learned_addr learned my addr 172.21.15.80:0/4286865699 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa57bfff640 1 --2- 172.21.15.80:0/4286865699 >> v2:172.21.15.195:3300/0 conn(0x7fa57c0b74c0 0x7fa57c0d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.407+0000 7fa57affd640 1 --2- 172.21.15.80:0/4286865699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c161c80 0x7fa57c0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57b7fe640 1 -- 172.21.15.80:0/4286865699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c161c80 msgr2=0x7fa57c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/4286865699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c161c80 0x7fa57c0b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57b7fe640 1 -- 172.21.15.80:0/4286865699 >> v2:172.21.15.195:3300/0 conn(0x7fa57c0b74c0 msgr2=0x7fa57c0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/4286865699 >> v2:172.21.15.195:3300/0 conn(0x7fa57c0b74c0 0x7fa57c0d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57b7fe640 1 -- 172.21.15.80:0/4286865699 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57c162a90 con 0x7fa57c071950 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/4286865699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c071950 0x7fa57c072560 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa57c1626e0 tx=0x7fa56c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680e41c3dfc801a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57a7fc640 1 -- 172.21.15.80:0/4286865699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c037070 con 0x7fa57c071950 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57a7fc640 1 -- 172.21.15.80:0/4286865699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56c032440 con 0x7fa57c071950 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.408+0000 7fa57a7fc640 1 -- 172.21.15.80:0/4286865699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c032810 con 0x7fa57c071950 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 -- 172.21.15.80:0/4286865699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c071950 msgr2=0x7fa57c072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 --2- 172.21.15.80:0/4286865699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c071950 0x7fa57c072560 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa57c1626e0 tx=0x7fa56c02a130 comp rx=0 tx=0).stop 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 -- 172.21.15.80:0/4286865699 shutdown_connections 2024-04-25T15:46:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 --2- 172.21.15.80:0/4286865699 >> v2:172.21.15.195:3300/0 conn(0x7fa57c0b74c0 0x7fa57c0d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 --2- 172.21.15.80:0/4286865699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c161c80 0x7fa57c0b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 --2- 172.21.15.80:0/4286865699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c071950 0x7fa57c072560 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 -- 172.21.15.80:0/4286865699 >> 172.21.15.80:0/4286865699 conn(0x7fa57c0d3ea0 msgr2=0x7fa57c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 -- 172.21.15.80:0/4286865699 shutdown_connections 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.409+0000 7fa581d14640 1 -- 172.21.15.80:0/4286865699 wait complete. 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.411+0000 7fa581d14640 1 Processor -- start 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.411+0000 7fa581d14640 1 -- start start 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.412+0000 7fa581d14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c071950 0x7fa57c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.412+0000 7fa581d14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 0x7fa57c161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.412+0000 7fa581d14640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa57c161c80 0x7fa57c0aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.412+0000 7fa581d14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c162210 con 0x7fa57c0b74c0 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.412+0000 7fa581d14640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c162090 con 0x7fa57c161c80 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.412+0000 7fa581d14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa57c0d2fd0 con 0x7fa57c071950 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 0x7fa57c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 0x7fa57c161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33860/0 (socket says 172.21.15.80:33860) 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 -- 172.21.15.80:0/3601995888 learned_addr learned my addr 172.21.15.80:0/3601995888 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c071950 0x7fa57c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57bfff640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa57c161c80 0x7fa57c0aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 -- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c071950 msgr2=0x7fa57c0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c071950 0x7fa57c0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 -- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa57c161c80 msgr2=0x7fa57c0aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa57c161c80 0x7fa57c0aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 -- 172.21.15.80:0/3601995888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57c0aaef0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c071950 0x7fa57c0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa57affd640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 0x7fa57c161120 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa57000d800 tx=0x7fa57000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570018020 con 0x7fa57c0b74c0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5700096c0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570009ab0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57c0ab1d0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.413+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57c0ab790 con 0x7fa57c0b74c0 2024-04-25T15:46:55.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.414+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57c06a100 con 0x7fa57c0b74c0 2024-04-25T15:46:55.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.415+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa57001b020 con 0x7fa57c0b74c0 2024-04-25T15:46:55.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.415+0000 7fa563fff640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5680744b0 0x7fa5680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.416+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5680744b0 0x7fa5680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.416+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fa570095ab0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.416+0000 7fa57b7fe640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5680744b0 0x7fa5680769c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa56c034000 tx=0x7fa56c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.420+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa570022020 con 0x7fa57c0b74c0 2024-04-25T15:46:55.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.596+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa57c0d1e40 con 0x7fa57c0b74c0 2024-04-25T15:46:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.597+0000 7fa563fff640 1 -- 172.21.15.80:0/3601995888 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16874 (secure 0 0 0) 0x7fa5700600b0 con 0x7fa57c0b74c0 2024-04-25T15:46:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:55.599 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":98,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:54.313655+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5680744b0 msgr2=0x7fa5680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5680744b0 0x7fa5680769c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa56c034000 tx=0x7fa56c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 msgr2=0x7fa57c161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 0x7fa57c161120 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa57000d800 tx=0x7fa57000dcc0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 shutdown_connections 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa5680744b0 0x7fa5680769c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa57c161c80 0x7fa57c0aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57c0b74c0 0x7fa57c161120 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 --2- 172.21.15.80:0/3601995888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa57c071950 0x7fa57c0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 >> 172.21.15.80:0/3601995888 conn(0x7fa57c0d3ea0 msgr2=0x7fa57c073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 shutdown_connections 2024-04-25T15:46:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.599+0000 7fa581d14640 1 -- 172.21.15.80:0/3601995888 wait complete. 2024-04-25T15:46:55.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:46:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.721+0000 7f80aa772640 1 Processor -- start 2024-04-25T15:46:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.721+0000 7f80aa772640 1 -- start start 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80aa772640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f80a40d26a0 0x7f80a40cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80aa772640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a406c5c0 0x7f80a40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80aa772640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a40b2b00 con 0x7f80a41618b0 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80aa772640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f80a406cb80 con 0x7f80a406c5c0 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80aa772640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f80a406ce60 con 0x7f80a40d26a0 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a406c5c0 0x7f80a40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a406c5c0 0x7f80a40b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33876/0 (socket says 172.21.15.80:33876) 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 -- 172.21.15.80:0/2860301532 learned_addr learned my addr 172.21.15.80:0/2860301532 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a37fe640 1 --2- 172.21.15.80:0/2860301532 >> v2:172.21.15.195:3300/0 conn(0x7f80a40d26a0 0x7f80a40cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 -- 172.21.15.80:0/2860301532 >> v2:172.21.15.195:3300/0 conn(0x7f80a40d26a0 msgr2=0x7f80a40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 --2- 172.21.15.80:0/2860301532 >> v2:172.21.15.195:3300/0 conn(0x7f80a40d26a0 0x7f80a40cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 -- 172.21.15.80:0/2860301532 >> v1:172.21.15.195:6789/0 conn(0x7f80a41618b0 legacy=0x7f80a40d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.723+0000 7f80a8d0f640 1 -- 172.21.15.80:0/2860301532 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a40b2d80 con 0x7f80a406c5c0 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.724+0000 7f80a8d0f640 1 --2- 172.21.15.80:0/2860301532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a406c5c0 0x7f80a40b3580 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f80a40d1e70 tx=0x7f809c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f44e1a149604581 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.724+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2860301532 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c036070 con 0x7f80a406c5c0 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.724+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2860301532 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c031600 con 0x7f80a406c5c0 2024-04-25T15:46:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.724+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2860301532 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c0319d0 con 0x7f80a406c5c0 2024-04-25T15:46:55.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 -- 172.21.15.80:0/2860301532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a406c5c0 msgr2=0x7f80a40b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 --2- 172.21.15.80:0/2860301532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a406c5c0 0x7f80a40b3580 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f80a40d1e70 tx=0x7f809c02a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 -- 172.21.15.80:0/2860301532 shutdown_connections 2024-04-25T15:46:55.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 --2- 172.21.15.80:0/2860301532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a406c5c0 0x7f80a40b3580 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 --2- 172.21.15.80:0/2860301532 >> v2:172.21.15.195:3300/0 conn(0x7f80a40d26a0 0x7f80a40cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 -- 172.21.15.80:0/2860301532 >> 172.21.15.80:0/2860301532 conn(0x7f80a409b410 msgr2=0x7f80a40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 -- 172.21.15.80:0/2860301532 shutdown_connections 2024-04-25T15:46:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.725+0000 7f80aa772640 1 -- 172.21.15.80:0/2860301532 wait complete. 2024-04-25T15:46:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.726+0000 7f80aa772640 1 Processor -- start 2024-04-25T15:46:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.727+0000 7f80aa772640 1 -- start start 2024-04-25T15:46:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80aa772640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80a406c5c0 0x7f80a40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80aa772640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 0x7f80a40c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80aa772640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80a415c4d0 0x7f80a40ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80aa772640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40cc670 con 0x7f80a40c64e0 2024-04-25T15:46:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80aa772640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4076270 con 0x7f80a406c5c0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80aa772640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f80a40cc7f0 con 0x7f80a415c4d0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 0x7f80a40c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 0x7f80a40c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33882/0 (socket says 172.21.15.80:33882) 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 -- 172.21.15.80:0/2470887178 learned_addr learned my addr 172.21.15.80:0/2470887178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a8d0f640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80a415c4d0 0x7f80a40ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a3fff640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80a406c5c0 0x7f80a40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 -- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80a415c4d0 msgr2=0x7f80a40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80a415c4d0 0x7f80a40ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 -- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80a406c5c0 msgr2=0x7f80a40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80a406c5c0 0x7f80a40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.728+0000 7f80a37fe640 1 -- 172.21.15.80:0/2470887178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a40ca270 con 0x7f80a40c64e0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.729+0000 7f80a37fe640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 0x7f80a40c5b50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f809800c820 tx=0x7f809800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.729+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098015070 con 0x7f80a40c64e0 2024-04-25T15:46:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.729+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8098004020 con 0x7f80a40c64e0 2024-04-25T15:46:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.729+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80980043f0 con 0x7f80a40c64e0 2024-04-25T15:46:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.729+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a40c6a10 con 0x7f80a40c64e0 2024-04-25T15:46:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.729+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a40c9530 con 0x7f80a40c64e0 2024-04-25T15:46:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.730+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a406a100 con 0x7f80a40c64e0 2024-04-25T15:46:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.730+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8098007830 con 0x7f80a40c64e0 2024-04-25T15:46:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.731+0000 7f80a0ff9640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f80900744e0 0x7f80900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.731+0000 7f80a3fff640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f80900744e0 0x7f80900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.731+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f8098095120 con 0x7f80a40c64e0 2024-04-25T15:46:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.731+0000 7f80a3fff640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f80900744e0 0x7f80900769f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8094006fd0 tx=0x7f8094008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.735+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f809805f720 con 0x7f80a40c64e0 2024-04-25T15:46:55.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.949+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f80a406ece0 con 0x7f80a40c64e0 2024-04-25T15:46:55.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.965+0000 7f80a0ff9640 1 -- 172.21.15.80:0/2470887178 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) ==== 118+0+0 (secure 0 0 0) 0x7f809805f020 con 0x7f80a40c64e0 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f80900744e0 msgr2=0x7f80900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f80900744e0 0x7f80900769f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8094006fd0 tx=0x7f8094008040 comp rx=0 tx=0).stop 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 msgr2=0x7f80a40c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 0x7f80a40c5b50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f809800c820 tx=0x7f809800cce0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 shutdown_connections 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f80900744e0 0x7f80900769f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80a415c4d0 0x7f80a40ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a40c64e0 0x7f80a40c5b50 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 --2- 172.21.15.80:0/2470887178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80a406c5c0 0x7f80a40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 >> 172.21.15.80:0/2470887178 conn(0x7f80a409b410 msgr2=0x7f80a40b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 shutdown_connections 2024-04-25T15:46:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:55.968+0000 7f80aa772640 1 -- 172.21.15.80:0/2470887178 wait complete. 2024-04-25T15:46:55.980 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:46:55.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:46:56.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.089+0000 7fb03d4d1640 1 Processor -- start 2024-04-25T15:46:56.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.089+0000 7fb03d4d1640 1 -- start start 2024-04-25T15:46:56.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb03d4d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb0380d2d50 0x7fb03816b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb03d4d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0380d57e0 con 0x7fb0380d0b00 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb03d4d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0381643f0 con 0x7fb0380b5490 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb03d4d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb0381646d0 con 0x7fb0380d2d50 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb0367fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb0380d0b00 0x7fb0380d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43736/0 (socket says 172.21.15.80:43736) 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb0367fc640 1 -- 172.21.15.80:0/2455968377 learned_addr learned my addr 172.21.15.80:0/2455968377 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093600259 0 0) 0x7fb0380d57e0 con 0x7fb0380d0b00 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb020003520 con 0x7fb0380d0b00 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb0377fe640 1 --2- 172.21.15.80:0/2455968377 >> v2:172.21.15.195:3300/0 conn(0x7fb0380d2d50 0x7fb03816b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3430520532 0 0) 0x7fb020003520 con 0x7fb0380d0b00 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 >> v2:172.21.15.195:3300/0 conn(0x7fb0380d2d50 msgr2=0x7fb03816b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 --2- 172.21.15.80:0/2455968377 >> v2:172.21.15.195:3300/0 conn(0x7fb0380d2d50 0x7fb03816b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 >> v1:172.21.15.195:6789/0 conn(0x7fb0380b5490 legacy=0x7fb038160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0381649b0 con 0x7fb0380d0b00 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fb02c001670 con 0x7fb0380d0b00 2024-04-25T15:46:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 >> v1:172.21.15.80:6789/0 conn(0x7fb0380d0b00 legacy=0x7fb0380d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0200039b0 0x7fb020003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020004800 0x7fb020004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0200051c0 0x7fb02000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381646d0 con 0x7fb0200051c0 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb02000c160 con 0x7fb020004800 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.091+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb02000c360 con 0x7fb0200039b0 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0200051c0 0x7fb02000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb036ffd640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0200039b0 0x7fb020003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0367fc640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020004800 0x7fb020004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 -- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0200039b0 msgr2=0x7fb020003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0200039b0 0x7fb020003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 -- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020004800 msgr2=0x7fb020004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb020004800 0x7fb020004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 -- 172.21.15.80:0/2455968377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb020003520 con 0x7fb0200051c0 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.092+0000 7fb0377fe640 1 -- 172.21.15.80:0/2455968377 reap_dead start 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb0377fe640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0200051c0 0x7fb02000b9c0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb030009a90 tx=0x7fb020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698c63fbd9c04db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030009690 con 0x7fb0200051c0 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb030004020 con 0x7fb0200051c0 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb035ffb640 1 -- 172.21.15.80:0/2455968377 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300043d0 con 0x7fb0200051c0 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb03d4d1640 1 -- 172.21.15.80:0/2455968377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0200051c0 msgr2=0x7fb02000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0200051c0 0x7fb02000b9c0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb030009a90 tx=0x7fb020005830 comp rx=0 tx=0).stop 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb03d4d1640 1 -- 172.21.15.80:0/2455968377 shutdown_connections 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/2455968377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0200051c0 0x7fb02000b9c0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb03d4d1640 1 -- 172.21.15.80:0/2455968377 >> 172.21.15.80:0/2455968377 conn(0x7fb03806e650 msgr2=0x7fb03806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.093+0000 7fb03d4d1640 1 -- 172.21.15.80:0/2455968377 shutdown_connections 2024-04-25T15:46:56.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.094+0000 7fb03d4d1640 1 -- 172.21.15.80:0/2455968377 wait complete. 2024-04-25T15:46:56.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.095+0000 7fb03d4d1640 1 Processor -- start 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.095+0000 7fb03d4d1640 1 -- start start 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb03d4d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0200051c0 0x7fb0381572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb03d4d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 0x7fb03815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb03d4d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb038162300 0x7fb03815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb03d4d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb0380b94e0 con 0x7fb038161ef0 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb03d4d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb0380b9360 con 0x7fb0200051c0 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb03d4d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb038163f80 con 0x7fb038162300 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 0x7fb03815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 0x7fb03815c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33904/0 (socket says 172.21.15.80:33904) 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 -- 172.21.15.80:0/1105225187 learned_addr learned my addr 172.21.15.80:0/1105225187 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0377fe640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb038162300 0x7fb03815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb036ffd640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0200051c0 0x7fb0381572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 -- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb038162300 msgr2=0x7fb03815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb038162300 0x7fb03815ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 -- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0200051c0 msgr2=0x7fb0381572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0200051c0 0x7fb0381572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 -- 172.21.15.80:0/1105225187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0381f6fa0 con 0x7fb038161ef0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb0367fc640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 0x7fb03815c540 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb02c004ef0 tx=0x7fb02c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00f7b0 con 0x7fb038161ef0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.097+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02c018070 con 0x7fb038161ef0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.098+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb038160510 con 0x7fb038161ef0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.098+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00fbd0 con 0x7fb038161ef0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.098+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb038160ad0 con 0x7fb038161ef0 2024-04-25T15:46:56.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.098+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03806a100 con 0x7fb038161ef0 2024-04-25T15:46:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.099+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb02c01d460 con 0x7fb038161ef0 2024-04-25T15:46:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.100+0000 7fb01f7fe640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0240744b0 0x7fb0240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.100+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fb02c095c40 con 0x7fb038161ef0 2024-04-25T15:46:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.100+0000 7fb036ffd640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0240744b0 0x7fb0240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.100+0000 7fb036ffd640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0240744b0 0x7fb0240769c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb028000f80 tx=0x7fb028009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.104+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb02c05fd60 con 0x7fb038161ef0 2024-04-25T15:46:56.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.314+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb0380d41d0 con 0x7fb038161ef0 2024-04-25T15:46:56.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.972+0000 7fb01f7fe640 1 -- 172.21.15.80:0/1105225187 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7fb02c064060 con 0x7fb038161ef0 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0240744b0 msgr2=0x7fb0240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0240744b0 0x7fb0240769c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb028000f80 tx=0x7fb028009040 comp rx=0 tx=0).stop 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 msgr2=0x7fb03815c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 0x7fb03815c540 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb02c004ef0 tx=0x7fb02c007430 comp rx=0 tx=0).stop 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 shutdown_connections 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb0240744b0 0x7fb0240769c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb038162300 0x7fb03815ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb038161ef0 0x7fb03815c540 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 --2- 172.21.15.80:0/1105225187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0200051c0 0x7fb0381572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.974+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 >> 172.21.15.80:0/1105225187 conn(0x7fb03806e650 msgr2=0x7fb03806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.975+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 shutdown_connections 2024-04-25T15:46:56.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:56.975+0000 7fb03d4d1640 1 -- 172.21.15.80:0/1105225187 wait complete. 2024-04-25T15:46:56.987 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:46:56.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:57.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.096+0000 7fb19d140640 1 Processor -- start 2024-04-25T15:46:57.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.096+0000 7fb19d140640 1 -- start start 2024-04-25T15:46:57.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19d140640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 0x7fb198160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19d140640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb198164690 0x7fb1980714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19d140640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb198071df0 con 0x7fb1980719e0 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19d140640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb1980b6eb0 con 0x7fb1980cfc40 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19d140640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb1980b7150 con 0x7fb198164690 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb196d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 0x7fb198160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb196d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 0x7fb198160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:57034/0 (socket says 172.21.15.80:57034) 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19759e640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb1980719e0 0x7fb19806c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:56688/0 (socket says 172.21.15.80:56688) 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb196d9d640 1 -- 172.21.15.80:0/1122976350 learned_addr learned my addr 172.21.15.80:0/1122976350 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19659c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb198164690 0x7fb1980714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19659c640 1 -- 172.21.15.80:0/1122976350 >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 msgr2=0x7fb198160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19659c640 1 --2- 172.21.15.80:0/1122976350 >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 0x7fb198160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19659c640 1 -- 172.21.15.80:0/1122976350 >> v1:172.21.15.195:6789/0 conn(0x7fb1980719e0 legacy=0x7fb19806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb19659c640 1 -- 172.21.15.80:0/1122976350 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1980b51e0 con 0x7fb198164690 2024-04-25T15:46:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.098+0000 7fb196d9d640 1 --2- 172.21.15.80:0/1122976350 >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 0x7fb198160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.099+0000 7fb19659c640 1 --2- 172.21.15.80:0/1122976350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb198164690 0x7fb1980714a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0097a0 tx=0x7fb18c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d384e8efa7a14d2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.099+0000 7fb195d9b640 1 -- 172.21.15.80:0/1122976350 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c037070 con 0x7fb198164690 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.099+0000 7fb195d9b640 1 -- 172.21.15.80:0/1122976350 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c02ae50 con 0x7fb198164690 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.099+0000 7fb195d9b640 1 -- 172.21.15.80:0/1122976350 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c032660 con 0x7fb198164690 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 -- 172.21.15.80:0/1122976350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb198164690 msgr2=0x7fb1980714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 --2- 172.21.15.80:0/1122976350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb198164690 0x7fb1980714a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0097a0 tx=0x7fb18c02a100 comp rx=0 tx=0).stop 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 -- 172.21.15.80:0/1122976350 shutdown_connections 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 --2- 172.21.15.80:0/1122976350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb198164690 0x7fb1980714a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 --2- 172.21.15.80:0/1122976350 >> v2:172.21.15.195:3300/0 conn(0x7fb1980cfc40 0x7fb198160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 -- 172.21.15.80:0/1122976350 >> 172.21.15.80:0/1122976350 conn(0x7fb1980d2080 msgr2=0x7fb1980d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 -- 172.21.15.80:0/1122976350 shutdown_connections 2024-04-25T15:46:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.100+0000 7fb19d140640 1 -- 172.21.15.80:0/1122976350 wait complete. 2024-04-25T15:46:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.102+0000 7fb19d140640 1 Processor -- start 2024-04-25T15:46:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.102+0000 7fb19d140640 1 -- start start 2024-04-25T15:46:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19d140640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 0x7fb1981f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19d140640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1980cfc40 0x7fb1981f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19d140640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb198164690 0x7fb1981fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19d140640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb198072040 con 0x7fb1980719e0 2024-04-25T15:46:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19d140640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1980b7430 con 0x7fb198164690 2024-04-25T15:46:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19d140640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb1980b6b70 con 0x7fb1980cfc40 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 0x7fb1981f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 0x7fb1981f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33906/0 (socket says 172.21.15.80:33906) 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 -- 172.21.15.80:0/3161305990 learned_addr learned my addr 172.21.15.80:0/3161305990 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19659c640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1980cfc40 0x7fb1981f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19759e640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb198164690 0x7fb1981fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 -- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1980cfc40 msgr2=0x7fb1981f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1980cfc40 0x7fb1981f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 -- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb198164690 msgr2=0x7fb1981fa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb198164690 0x7fb1981fa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 -- 172.21.15.80:0/3161305990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb198160e30 con 0x7fb1980719e0 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb19759e640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb198164690 0x7fb1981fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb196d9d640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 0x7fb1981f6c00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb188009e80 tx=0x7fb18800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.104+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18800ce60 con 0x7fb1980719e0 2024-04-25T15:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.105+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb188019070 con 0x7fb1980719e0 2024-04-25T15:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.105+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1981f4610 con 0x7fb1980719e0 2024-04-25T15:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.105+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188014680 con 0x7fb1980719e0 2024-04-25T15:46:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.105+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981f7880 con 0x7fb1980719e0 2024-04-25T15:46:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.105+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1980cef80 con 0x7fb1980719e0 2024-04-25T15:46:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.106+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb188005d10 con 0x7fb1980719e0 2024-04-25T15:46:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.107+0000 7fb17f7fe640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1840744b0 0x7fb1840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.107+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fb188095770 con 0x7fb1980719e0 2024-04-25T15:46:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.107+0000 7fb19659c640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1840744b0 0x7fb1840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.107+0000 7fb19659c640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1840744b0 0x7fb1840769c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.111+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1980cef80 con 0x7fb1980719e0 2024-04-25T15:46:57.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.321+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb19806a100 con 0x7fb1980719e0 2024-04-25T15:46:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.322+0000 7fb17f7fe640 1 -- 172.21.15.80:0/3161305990 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5186 (secure 0 0 0) 0x7fb188010040 con 0x7fb1980719e0 2024-04-25T15:46:57.323 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:57.323 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3406883775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3406883775},{"type":"v1","addr":"172.21.15.80:6837","nonce":3406883775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/657778508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":657778508},{"type":"v1","addr":"172.21.15.195:6835","nonce":657778508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/2812835007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2812835007},{"type":"v1","addr":"172.21.15.195:6834","nonce":2812835007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:46:56.316544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7548":{"gid":7548,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6836/3726019359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3726019359},{"type":"v1","addr":"172.21.15.80:6836","nonce":3726019359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7548,"qdb_cluster":[7548]},"id":7}]} 2024-04-25T15:46:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 52 2024-04-25T15:46:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1840744b0 msgr2=0x7fb1840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1840744b0 0x7fb1840769c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 msgr2=0x7fb1981f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 0x7fb1981f6c00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb188009e80 tx=0x7fb18800c490 comp rx=0 tx=0).stop 2024-04-25T15:46:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 shutdown_connections 2024-04-25T15:46:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb1840744b0 0x7fb1840769c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb198164690 0x7fb1981fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1980cfc40 0x7fb1981f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 --2- 172.21.15.80:0/3161305990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1980719e0 0x7fb1981f6c00 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 >> 172.21.15.80:0/3161305990 conn(0x7fb1980d2080 msgr2=0x7fb1980d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 shutdown_connections 2024-04-25T15:46:57.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.324+0000 7fb19d140640 1 -- 172.21.15.80:0/3161305990 wait complete. 2024-04-25T15:46:57.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:57.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.442+0000 7fd3e30d1640 1 Processor -- start 2024-04-25T15:46:57.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.442+0000 7fd3e30d1640 1 -- start start 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3e30d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0cf960 0x7fd3dc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3e30d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3dc1607c0 con 0x7fd3dc0b1ef0 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3e30d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3dc0ceba0 con 0x7fd3dc0ce220 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3e30d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc0cf4d0 con 0x7fd3dc0cf960 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3e166e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd3dc0b1ef0 0x7fd3dc0d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43738/0 (socket says 172.21.15.80:43738) 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3e166e640 1 -- 172.21.15.80:0/1897727968 learned_addr learned my addr 172.21.15.80:0/1897727968 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3dbfff640 1 --2- 172.21.15.80:0/1897727968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0cf960 0x7fd3dc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390009631 0 0) 0x7fd3dc1607c0 con 0x7fd3dc0b1ef0 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c4003520 con 0x7fd3dc0b1ef0 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18670754 0 0) 0x7fd3dc0ceba0 con 0x7fd3dc0ce220 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3dc1607c0 con 0x7fd3dc0ce220 2024-04-25T15:46:57.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1897727968 >> v1:172.21.15.195:6789/0 conn(0x7fd3dc0ce220 legacy=0x7fd3dc09bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1897727968 >> v1:172.21.15.80:6789/0 conn(0x7fd3dc0b1ef0 legacy=0x7fd3dc0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.444+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1897727968 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc0cee80 con 0x7fd3dc0cf960 2024-04-25T15:46:57.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.445+0000 7fd3dbfff640 1 --2- 172.21.15.80:0/1897727968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0cf960 0x7fd3dc0cfd70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00097d0 tx=0x7fd3d002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82468d43c2b0b12f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.445+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0037070 con 0x7fd3dc0cf960 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.445+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0032440 con 0x7fd3dc0cf960 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.445+0000 7fd3db7fe640 1 -- 172.21.15.80:0/1897727968 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00327f0 con 0x7fd3dc0cf960 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1897727968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0cf960 msgr2=0x7fd3dc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1897727968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0cf960 0x7fd3dc0cfd70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00097d0 tx=0x7fd3d002a290 comp rx=0 tx=0).stop 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1897727968 shutdown_connections 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1897727968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0cf960 0x7fd3dc0cfd70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1897727968 >> 172.21.15.80:0/1897727968 conn(0x7fd3dc0b7620 msgr2=0x7fd3dc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1897727968 shutdown_connections 2024-04-25T15:46:57.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.446+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1897727968 wait complete. 2024-04-25T15:46:57.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.448+0000 7fd3e30d1640 1 Processor -- start 2024-04-25T15:46:57.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.448+0000 7fd3e30d1640 1 -- start start 2024-04-25T15:46:57.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e30d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0b1ef0 0x7fd3dc1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e30d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 0x7fd3dc1f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e30d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3dc0cf960 0x7fd3dc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e30d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc0d3530 con 0x7fd3dc0ce220 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e30d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc0ce630 con 0x7fd3dc0cf960 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e30d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc0c8370 con 0x7fd3dc0b1ef0 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3dbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 0x7fd3dc1f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3dbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 0x7fd3dc1f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33918/0 (socket says 172.21.15.80:33918) 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1448619565 learned_addr learned my addr 172.21.15.80:0/1448619565 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e166e640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3dc0cf960 0x7fd3dc0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.449+0000 7fd3e0e6d640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0b1ef0 0x7fd3dc1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0b1ef0 msgr2=0x7fd3dc1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3dbfff640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0b1ef0 0x7fd3dc1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3dc0cf960 msgr2=0x7fd3dc0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3dbfff640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3dc0cf960 0x7fd3dc0b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3dbfff640 1 -- 172.21.15.80:0/1448619565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc1fa4e0 con 0x7fd3dc0ce220 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3e0e6d640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0b1ef0 0x7fd3dc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3e166e640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3dc0cf960 0x7fd3dc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3dbfff640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 0x7fd3dc1f9840 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd3d002a2d0 tx=0x7fd3d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0041020 con 0x7fd3dc0ce220 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d003d6e0 con 0x7fd3dc0ce220 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc0c6550 con 0x7fd3dc0ce220 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0037040 con 0x7fd3dc0ce220 2024-04-25T15:46:57.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.450+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc0c6b10 con 0x7fd3dc0ce220 2024-04-25T15:46:57.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.451+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc06a100 con 0x7fd3dc0ce220 2024-04-25T15:46:57.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.452+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd3d0044020 con 0x7fd3dc0ce220 2024-04-25T15:46:57.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.452+0000 7fd3d97fa640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3c80744b0 0x7fd3c80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.452+0000 7fd3e0e6d640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3c80744b0 0x7fd3c80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.452+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fd3d00b5bd0 con 0x7fd3dc0ce220 2024-04-25T15:46:57.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.453+0000 7fd3e0e6d640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3c80744b0 0x7fd3c80769c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc001670 tx=0x7fd3cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.457+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3d004b030 con 0x7fd3dc0ce220 2024-04-25T15:46:57.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.631+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3dc160050 con 0x7fd3dc0ce220 2024-04-25T15:46:57.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.632+0000 7fd3d97fa640 1 -- 172.21.15.80:0/1448619565 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16861 (secure 0 0 0) 0x7fd3d0080270 con 0x7fd3dc0ce220 2024-04-25T15:46:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:57.634 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":99,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:55.949436+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:57.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3c80744b0 msgr2=0x7fd3c80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3c80744b0 0x7fd3c80769c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc001670 tx=0x7fd3cc009040 comp rx=0 tx=0).stop 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 msgr2=0x7fd3dc1f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 0x7fd3dc1f9840 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd3d002a2d0 tx=0x7fd3d00046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 shutdown_connections 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3c80744b0 0x7fd3c80769c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3dc0cf960 0x7fd3dc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3dc0ce220 0x7fd3dc1f9840 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 --2- 172.21.15.80:0/1448619565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3dc0b1ef0 0x7fd3dc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 >> 172.21.15.80:0/1448619565 conn(0x7fd3dc0b7620 msgr2=0x7fd3dc0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 shutdown_connections 2024-04-25T15:46:57.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.634+0000 7fd3e30d1640 1 -- 172.21.15.80:0/1448619565 wait complete. 2024-04-25T15:46:57.647 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:46:57.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.754+0000 7f10780f2640 1 Processor -- start 2024-04-25T15:46:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.754+0000 7f10780f2640 1 -- start start 2024-04-25T15:46:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f10780f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700cff30 0x7f10700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f10780f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10700b2a40 0x7f107009ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f10780f2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10700b9350 con 0x7f10700d2120 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f10780f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f10700cfb70 con 0x7f10700b2a40 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f10780f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10700cf890 con 0x7f10700cff30 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f107568d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10700b2a40 0x7f107009ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f107568d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10700b2a40 0x7f107009ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33932/0 (socket says 172.21.15.80:33932) 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.755+0000 7f107568d640 1 -- 172.21.15.80:0/1875952086 learned_addr learned my addr 172.21.15.80:0/1875952086 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f1075e8e640 1 --2- 172.21.15.80:0/1875952086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700cff30 0x7f10700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f107568d640 1 -- 172.21.15.80:0/1875952086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700cff30 msgr2=0x7f10700b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f107568d640 1 --2- 172.21.15.80:0/1875952086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700cff30 0x7f10700b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f107568d640 1 -- 172.21.15.80:0/1875952086 >> v1:172.21.15.195:6789/0 conn(0x7f10700d2120 legacy=0x7f10700d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f107568d640 1 -- 172.21.15.80:0/1875952086 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10700b9020 con 0x7f10700b2a40 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f107568d640 1 --2- 172.21.15.80:0/1875952086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700b2a40 0x7f107009ce90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1060009870 tx=0x7f106002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5c61380c777869 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.756+0000 7f1074e8c640 1 -- 172.21.15.80:0/1875952086 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060037070 con 0x7f10700b2a40 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f1074e8c640 1 -- 172.21.15.80:0/1875952086 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060032440 con 0x7f10700b2a40 2024-04-25T15:46:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f1074e8c640 1 -- 172.21.15.80:0/1875952086 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060032810 con 0x7f10700b2a40 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 -- 172.21.15.80:0/1875952086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700b2a40 msgr2=0x7f107009ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 --2- 172.21.15.80:0/1875952086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700b2a40 0x7f107009ce90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1060009870 tx=0x7f106002a180 comp rx=0 tx=0).stop 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 -- 172.21.15.80:0/1875952086 shutdown_connections 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 --2- 172.21.15.80:0/1875952086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700b2a40 0x7f107009ce90 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 --2- 172.21.15.80:0/1875952086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700cff30 0x7f10700b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 -- 172.21.15.80:0/1875952086 >> 172.21.15.80:0/1875952086 conn(0x7f10700d0450 msgr2=0x7f10700d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 -- 172.21.15.80:0/1875952086 shutdown_connections 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.757+0000 7f10780f2640 1 -- 172.21.15.80:0/1875952086 wait complete. 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.759+0000 7f10780f2640 1 Processor -- start 2024-04-25T15:46:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.759+0000 7f10780f2640 1 -- start start 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f10780f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700b2a40 0x7f107014de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f10780f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 0x7f107014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f10780f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10700d2120 0x7f10700cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f10780f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f10700d10f0 con 0x7f10700cff30 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f10780f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10700d0f70 con 0x7f10700d2120 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f10780f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10700d2530 con 0x7f10700b2a40 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f107568d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 0x7f107014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f107568d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 0x7f107014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33938/0 (socket says 172.21.15.80:33938) 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.760+0000 7f107568d640 1 -- 172.21.15.80:0/3421633715 learned_addr learned my addr 172.21.15.80:0/3421633715 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f107568d640 1 -- 172.21.15.80:0/3421633715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700b2a40 msgr2=0x7f107014de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f107568d640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700b2a40 0x7f107014de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f107568d640 1 -- 172.21.15.80:0/3421633715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10700d2120 msgr2=0x7f10700cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f107568d640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10700d2120 0x7f10700cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f107568d640 1 -- 172.21.15.80:0/3421633715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107014fc60 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f107568d640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 0x7f107014f720 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c00 tx=0x7f10600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060037040 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060042070 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107014e680 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060030bb0 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.761+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107014ec40 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.762+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107006a100 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.763+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1060047460 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.763+0000 7f10667fc640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10540744e0 0x7f10540769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.763+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f10600b5f80 con 0x7f10700cff30 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.763+0000 7f1075e8e640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10540744e0 0x7f10540769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.764+0000 7f1075e8e640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10540744e0 0x7f10540769f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f106c00a7f0 tx=0x7f106c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.768+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f106007ffc0 con 0x7f10700cff30 2024-04-25T15:46:57.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.941+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f107014e410 con 0x7f10540744e0 2024-04-25T15:46:57.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.947+0000 7f10667fc640 1 -- 172.21.15.80:0/3421633715 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244661 (secure 0 0 0) 0x7f107014e410 con 0x7f10540744e0 2024-04-25T15:46:57.950 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:57.952 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10540744e0 msgr2=0x7f10540769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10540744e0 0x7f10540769f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f106c00a7f0 tx=0x7f106c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 msgr2=0x7f107014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 0x7f107014f720 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c00 tx=0x7f10600046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 shutdown_connections 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f10540744e0 0x7f10540769f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10700d2120 0x7f10700cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10700cff30 0x7f107014f720 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 --2- 172.21.15.80:0/3421633715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10700b2a40 0x7f107014de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 >> 172.21.15.80:0/3421633715 conn(0x7f10700d0450 msgr2=0x7f10700cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 shutdown_connections 2024-04-25T15:46:57.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:57.950+0000 7f10780f2640 1 -- 172.21.15.80:0/3421633715 wait complete. 2024-04-25T15:46:57.962 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-25T15:46:57.045888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251556,"kb_used_data":10416,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723164,"statfs":{"total":773094113280,"available":772836519936,"internally_reserved":0,"allocated":10665984,"data_stored":5494600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.104095"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959228+0000","last_change":"2024-04-25T15:46:53.959228+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959228+0000","last_undegraded":"2024-04-25T15:46:53.959228+0000","last_fullsized":"2024-04-25T15:46:53.959228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960438+0000","last_change":"2024-04-25T15:46:53.960438+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960438+0000","last_undegraded":"2024-04-25T15:46:53.960438+0000","last_fullsized":"2024-04-25T15:46:53.960438+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959085+0000","last_change":"2024-04-25T15:46:53.959085+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959085+0000","last_undegraded":"2024-04-25T15:46:53.959085+0000","last_fullsized":"2024-04-25T15:46:53.959085+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954568+0000","last_change":"2024-04-25T15:46:53.954568+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954568+0000","last_undegraded":"2024-04-25T15:46:53.954568+0000","last_fullsized":"2024-04-25T15:46:53.954568+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957395+0000","last_change":"2024-04-25T15:46:53.957395+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957395+0000","last_undegraded":"2024-04-25T15:46:53.957395+0000","last_fullsized":"2024-04-25T15:46:53.957395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956986+0000","last_change":"2024-04-25T15:46:53.956986+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956986+0000","last_undegraded":"2024-04-25T15:46:53.956986+0000","last_fullsized":"2024-04-25T15:46:53.956986+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958704+0000","last_change":"2024-04-25T15:46:53.958704+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958704+0000","last_undegraded":"2024-04-25T15:46:53.958704+0000","last_fullsized":"2024-04-25T15:46:53.958704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956330+0000","last_change":"2024-04-25T15:46:53.956330+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956330+0000","last_undegraded":"2024-04-25T15:46:53.956330+0000","last_fullsized":"2024-04-25T15:46:53.956330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957062+0000","last_change":"2024-04-25T15:46:53.957062+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957062+0000","last_undegraded":"2024-04-25T15:46:53.957062+0000","last_fullsized":"2024-04-25T15:46:53.957062+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955717+0000","last_change":"2024-04-25T15:46:53.955717+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955717+0000","last_undegraded":"2024-04-25T15:46:53.955717+0000","last_fullsized":"2024-04-25T15:46:53.955717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953566+0000","last_change":"2024-04-25T15:46:53.953566+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953566+0000","last_undegraded":"2024-04-25T15:46:53.953566+0000","last_fullsized":"2024-04-25T15:46:53.953566+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958188+0000","last_change":"2024-04-25T15:46:53.958188+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958188+0000","last_undegraded":"2024-04-25T15:46:53.958188+0000","last_fullsized":"2024-04-25T15:46:53.958188+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959965+0000","last_change":"2024-04-25T15:46:53.959965+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959965+0000","last_undegraded":"2024-04-25T15:46:53.959965+0000","last_fullsized":"2024-04-25T15:46:53.959965+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957821+0000","last_change":"2024-04-25T15:46:53.957821+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957821+0000","last_undegraded":"2024-04-25T15:46:53.957821+0000","last_fullsized":"2024-04-25T15:46:53.957821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956585+0000","last_change":"2024-04-25T15:46:53.956585+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956585+0000","last_undegraded":"2024-04-25T15:46:53.956585+0000","last_fullsized":"2024-04-25T15:46:53.956585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957948+0000","last_change":"2024-04-25T15:46:53.957948+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957948+0000","last_undegraded":"2024-04-25T15:46:53.957948+0000","last_fullsized":"2024-04-25T15:46:53.957948+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955880+0000","last_change":"2024-04-25T15:46:53.955880+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955880+0000","last_undegraded":"2024-04-25T15:46:53.955880+0000","last_fullsized":"2024-04-25T15:46:53.955880+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957696+0000","last_change":"2024-04-25T15:46:53.957696+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957696+0000","last_undegraded":"2024-04-25T15:46:53.957696+0000","last_fullsized":"2024-04-25T15:46:53.957696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956806+0000","last_change":"2024-04-25T15:46:53.956806+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956806+0000","last_undegraded":"2024-04-25T15:46:53.956806+0000","last_fullsized":"2024-04-25T15:46:53.956806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954309+0000","last_change":"2024-04-25T15:46:53.954309+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954309+0000","last_undegraded":"2024-04-25T15:46:53.954309+0000","last_fullsized":"2024-04-25T15:46:53.954309+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958209+0000","last_change":"2024-04-25T15:46:53.958209+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958209+0000","last_undegraded":"2024-04-25T15:46:53.958209+0000","last_fullsized":"2024-04-25T15:46:53.958209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955442+0000","last_change":"2024-04-25T15:46:53.955442+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955442+0000","last_undegraded":"2024-04-25T15:46:53.955442+0000","last_fullsized":"2024-04-25T15:46:53.955442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953362+0000","last_change":"2024-04-25T15:46:53.953362+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953362+0000","last_undegraded":"2024-04-25T15:46:53.953362+0000","last_fullsized":"2024-04-25T15:46:53.953362+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969850+0000","last_change":"2024-04-25T15:46:53.968876+0000","last_active":"2024-04-25T15:46:53.969850+0000","last_peered":"2024-04-25T15:46:53.969850+0000","last_clean":"2024-04-25T15:46:53.969850+0000","last_became_active":"2024-04-25T15:46:53.968481+0000","last_became_peered":"2024-04-25T15:46:53.968481+0000","last_unstale":"2024-04-25T15:46:53.969850+0000","last_undegraded":"2024-04-25T15:46:53.969850+0000","last_fullsized":"2024-04-25T15:46:53.969850+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:53.882480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954970+0000","last_change":"2024-04-25T15:46:53.954970+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954970+0000","last_undegraded":"2024-04-25T15:46:53.954970+0000","last_fullsized":"2024-04-25T15:46:53.954970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975078+0000","last_change":"2024-04-25T15:46:53.971080+0000","last_active":"2024-04-25T15:46:53.975078+0000","last_peered":"2024-04-25T15:46:53.975078+0000","last_clean":"2024-04-25T15:46:53.975078+0000","last_became_active":"2024-04-25T15:46:53.969706+0000","last_became_peered":"2024-04-25T15:46:53.969706+0000","last_unstale":"2024-04-25T15:46:53.975078+0000","last_undegraded":"2024-04-25T15:46:53.975078+0000","last_fullsized":"2024-04-25T15:46:53.975078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:25.630507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944139+0000","last_change":"2024-04-25T15:46:52.944139+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944139+0000","last_undegraded":"2024-04-25T15:46:52.944139+0000","last_fullsized":"2024-04-25T15:46:52.944139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977481+0000","last_change":"2024-04-25T15:46:53.971918+0000","last_active":"2024-04-25T15:46:53.977481+0000","last_peered":"2024-04-25T15:46:53.977481+0000","last_clean":"2024-04-25T15:46:53.977481+0000","last_became_active":"2024-04-25T15:46:53.971592+0000","last_became_peered":"2024-04-25T15:46:53.971592+0000","last_unstale":"2024-04-25T15:46:53.977481+0000","last_undegraded":"2024-04-25T15:46:53.977481+0000","last_fullsized":"2024-04-25T15:46:53.977481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:24.750079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953843+0000","last_change":"2024-04-25T15:46:53.953843+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953843+0000","last_undegraded":"2024-04-25T15:46:53.953843+0000","last_fullsized":"2024-04-25T15:46:53.953843+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944121+0000","last_change":"2024-04-25T15:46:52.944121+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944121+0000","last_undegraded":"2024-04-25T15:46:52.944121+0000","last_fullsized":"2024-04-25T15:46:52.944121+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956833+0000","last_change":"2024-04-25T15:46:53.956833+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956833+0000","last_undegraded":"2024-04-25T15:46:53.956833+0000","last_fullsized":"2024-04-25T15:46:53.956833+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.947302+0000","last_change":"2024-04-25T15:46:52.947302+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.947302+0000","last_undegraded":"2024-04-25T15:46:52.947302+0000","last_fullsized":"2024-04-25T15:46:52.947302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959436+0000","last_change":"2024-04-25T15:46:53.959436+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959436+0000","last_undegraded":"2024-04-25T15:46:53.959436+0000","last_fullsized":"2024-04-25T15:46:53.959436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944669+0000","last_change":"2024-04-25T15:46:52.944669+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944669+0000","last_undegraded":"2024-04-25T15:46:52.944669+0000","last_fullsized":"2024-04-25T15:46:52.944669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955246+0000","last_change":"2024-04-25T15:46:53.955246+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955246+0000","last_undegraded":"2024-04-25T15:46:53.955246+0000","last_fullsized":"2024-04-25T15:46:53.955246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.964207+0000","last_change":"2024-04-25T15:46:53.961775+0000","last_active":"2024-04-25T15:46:53.964207+0000","last_peered":"2024-04-25T15:46:53.964207+0000","last_clean":"2024-04-25T15:46:53.964207+0000","last_became_active":"2024-04-25T15:46:53.961476+0000","last_became_peered":"2024-04-25T15:46:53.961476+0000","last_unstale":"2024-04-25T15:46:53.964207+0000","last_undegraded":"2024-04-25T15:46:53.964207+0000","last_fullsized":"2024-04-25T15:46:53.964207+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:16.471621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953959+0000","last_change":"2024-04-25T15:46:53.953959+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953959+0000","last_undegraded":"2024-04-25T15:46:53.953959+0000","last_fullsized":"2024-04-25T15:46:53.953959+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.945014+0000","last_change":"2024-04-25T15:46:52.945014+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.945014+0000","last_undegraded":"2024-04-25T15:46:52.945014+0000","last_fullsized":"2024-04-25T15:46:52.945014+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955655+0000","last_change":"2024-04-25T15:46:53.955655+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955655+0000","last_undegraded":"2024-04-25T15:46:53.955655+0000","last_fullsized":"2024-04-25T15:46:53.955655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.962836+0000","last_change":"2024-04-25T15:46:53.958121+0000","last_active":"2024-04-25T15:46:53.962836+0000","last_peered":"2024-04-25T15:46:53.962836+0000","last_clean":"2024-04-25T15:46:53.962836+0000","last_became_active":"2024-04-25T15:46:53.957362+0000","last_became_peered":"2024-04-25T15:46:53.957362+0000","last_unstale":"2024-04-25T15:46:53.962836+0000","last_undegraded":"2024-04-25T15:46:53.962836+0000","last_fullsized":"2024-04-25T15:46:53.962836+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:38.120803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956025+0000","last_change":"2024-04-25T15:46:53.956025+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956025+0000","last_undegraded":"2024-04-25T15:46:53.956025+0000","last_fullsized":"2024-04-25T15:46:53.956025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944750+0000","last_change":"2024-04-25T15:46:52.944750+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944750+0000","last_undegraded":"2024-04-25T15:46:52.944750+0000","last_fullsized":"2024-04-25T15:46:52.944750+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956486+0000","last_change":"2024-04-25T15:46:53.956486+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956486+0000","last_undegraded":"2024-04-25T15:46:53.956486+0000","last_fullsized":"2024-04-25T15:46:53.956486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.968857+0000","last_change":"2024-04-25T15:46:53.966347+0000","last_active":"2024-04-25T15:46:53.968857+0000","last_peered":"2024-04-25T15:46:53.968857+0000","last_clean":"2024-04-25T15:46:53.968857+0000","last_became_active":"2024-04-25T15:46:53.965444+0000","last_became_peered":"2024-04-25T15:46:53.965444+0000","last_unstale":"2024-04-25T15:46:53.968857+0000","last_undegraded":"2024-04-25T15:46:53.968857+0000","last_fullsized":"2024-04-25T15:46:53.968857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:02.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977474+0000","last_change":"2024-04-25T15:46:53.971700+0000","last_active":"2024-04-25T15:46:53.977474+0000","last_peered":"2024-04-25T15:46:53.977474+0000","last_clean":"2024-04-25T15:46:53.977474+0000","last_became_active":"2024-04-25T15:46:53.971408+0000","last_became_peered":"2024-04-25T15:46:53.971408+0000","last_unstale":"2024-04-25T15:46:53.977474+0000","last_undegraded":"2024-04-25T15:46:53.977474+0000","last_fullsized":"2024-04-25T15:46:53.977474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.966461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956302+0000","last_change":"2024-04-25T15:46:53.956302+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956302+0000","last_undegraded":"2024-04-25T15:46:53.956302+0000","last_fullsized":"2024-04-25T15:46:53.956302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969879+0000","last_change":"2024-04-25T15:46:53.966111+0000","last_active":"2024-04-25T15:46:53.969879+0000","last_peered":"2024-04-25T15:46:53.969879+0000","last_clean":"2024-04-25T15:46:53.969879+0000","last_became_active":"2024-04-25T15:46:53.965745+0000","last_became_peered":"2024-04-25T15:46:53.965745+0000","last_unstale":"2024-04-25T15:46:53.969879+0000","last_undegraded":"2024-04-25T15:46:53.969879+0000","last_fullsized":"2024-04-25T15:46:53.969879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.409398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960019+0000","last_change":"2024-04-25T15:46:53.960019+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960019+0000","last_undegraded":"2024-04-25T15:46:53.960019+0000","last_fullsized":"2024-04-25T15:46:53.960019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970072+0000","last_change":"2024-04-25T15:46:53.967519+0000","last_active":"2024-04-25T15:46:53.970072+0000","last_peered":"2024-04-25T15:46:53.970072+0000","last_clean":"2024-04-25T15:46:53.970072+0000","last_became_active":"2024-04-25T15:46:53.967161+0000","last_became_peered":"2024-04-25T15:46:53.967161+0000","last_unstale":"2024-04-25T15:46:53.970072+0000","last_undegraded":"2024-04-25T15:46:53.970072+0000","last_fullsized":"2024-04-25T15:46:53.970072+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.247123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954392+0000","last_change":"2024-04-25T15:46:53.954392+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954392+0000","last_undegraded":"2024-04-25T15:46:53.954392+0000","last_fullsized":"2024-04-25T15:46:53.954392+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944115+0000","last_change":"2024-04-25T15:46:52.944115+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944115+0000","last_undegraded":"2024-04-25T15:46:52.944115+0000","last_fullsized":"2024-04-25T15:46:52.944115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954978+0000","last_change":"2024-04-25T15:46:53.954978+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954978+0000","last_undegraded":"2024-04-25T15:46:53.954978+0000","last_fullsized":"2024-04-25T15:46:53.954978+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.973078+0000","last_change":"2024-04-25T15:46:53.972080+0000","last_active":"2024-04-25T15:46:53.973078+0000","last_peered":"2024-04-25T15:46:53.973078+0000","last_clean":"2024-04-25T15:46:53.973078+0000","last_became_active":"2024-04-25T15:46:53.971693+0000","last_became_peered":"2024-04-25T15:46:53.971693+0000","last_unstale":"2024-04-25T15:46:53.973078+0000","last_undegraded":"2024-04-25T15:46:53.973078+0000","last_fullsized":"2024-04-25T15:46:53.973078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:55.761865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955542+0000","last_change":"2024-04-25T15:46:53.955542+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955542+0000","last_undegraded":"2024-04-25T15:46:53.955542+0000","last_fullsized":"2024-04-25T15:46:53.955542+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944115+0000","last_change":"2024-04-25T15:46:52.944115+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944115+0000","last_undegraded":"2024-04-25T15:46:52.944115+0000","last_fullsized":"2024-04-25T15:46:52.944115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956944+0000","last_change":"2024-04-25T15:46:53.956944+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956944+0000","last_undegraded":"2024-04-25T15:46:53.956944+0000","last_fullsized":"2024-04-25T15:46:53.956944+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.947390+0000","last_change":"2024-04-25T15:46:52.947390+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.947390+0000","last_undegraded":"2024-04-25T15:46:52.947390+0000","last_fullsized":"2024-04-25T15:46:52.947390+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954838+0000","last_change":"2024-04-25T15:46:53.954838+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954838+0000","last_undegraded":"2024-04-25T15:46:53.954838+0000","last_fullsized":"2024-04-25T15:46:53.954838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970187+0000","last_change":"2024-04-25T15:46:53.962212+0000","last_active":"2024-04-25T15:46:53.970187+0000","last_peered":"2024-04-25T15:46:53.970187+0000","last_clean":"2024-04-25T15:46:53.970187+0000","last_became_active":"2024-04-25T15:46:53.961142+0000","last_became_peered":"2024-04-25T15:46:53.961142+0000","last_unstale":"2024-04-25T15:46:53.970187+0000","last_undegraded":"2024-04-25T15:46:53.970187+0000","last_fullsized":"2024-04-25T15:46:53.970187+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:18.080583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957298+0000","last_change":"2024-04-25T15:46:53.957298+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957298+0000","last_undegraded":"2024-04-25T15:46:53.957298+0000","last_fullsized":"2024-04-25T15:46:53.957298+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975037+0000","last_change":"2024-04-25T15:46:53.970934+0000","last_active":"2024-04-25T15:46:53.975037+0000","last_peered":"2024-04-25T15:46:53.975037+0000","last_clean":"2024-04-25T15:46:53.975037+0000","last_became_active":"2024-04-25T15:46:53.970663+0000","last_became_peered":"2024-04-25T15:46:53.970663+0000","last_unstale":"2024-04-25T15:46:53.975037+0000","last_undegraded":"2024-04-25T15:46:53.975037+0000","last_fullsized":"2024-04-25T15:46:53.975037+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:06.603322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955713+0000","last_change":"2024-04-25T15:46:53.955713+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955713+0000","last_undegraded":"2024-04-25T15:46:53.955713+0000","last_fullsized":"2024-04-25T15:46:53.955713+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969036+0000","last_change":"2024-04-25T15:46:53.967992+0000","last_active":"2024-04-25T15:46:53.969036+0000","last_peered":"2024-04-25T15:46:53.969036+0000","last_clean":"2024-04-25T15:46:53.969036+0000","last_became_active":"2024-04-25T15:46:53.967078+0000","last_became_peered":"2024-04-25T15:46:53.967078+0000","last_unstale":"2024-04-25T15:46:53.969036+0000","last_undegraded":"2024-04-25T15:46:53.969036+0000","last_fullsized":"2024-04-25T15:46:53.969036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:47.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958741+0000","last_change":"2024-04-25T15:46:53.958741+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958741+0000","last_undegraded":"2024-04-25T15:46:53.958741+0000","last_fullsized":"2024-04-25T15:46:53.958741+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972206+0000","last_change":"2024-04-25T15:46:53.970573+0000","last_active":"2024-04-25T15:46:53.972206+0000","last_peered":"2024-04-25T15:46:53.972206+0000","last_clean":"2024-04-25T15:46:53.972206+0000","last_became_active":"2024-04-25T15:46:53.970245+0000","last_became_peered":"2024-04-25T15:46:53.970245+0000","last_unstale":"2024-04-25T15:46:53.972206+0000","last_undegraded":"2024-04-25T15:46:53.972206+0000","last_fullsized":"2024-04-25T15:46:53.972206+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:28:56.649496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955359+0000","last_change":"2024-04-25T15:46:53.955359+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955359+0000","last_undegraded":"2024-04-25T15:46:53.955359+0000","last_fullsized":"2024-04-25T15:46:53.955359+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.974853+0000","last_change":"2024-04-25T15:46:53.970973+0000","last_active":"2024-04-25T15:46:53.974853+0000","last_peered":"2024-04-25T15:46:53.974853+0000","last_clean":"2024-04-25T15:46:53.974853+0000","last_became_active":"2024-04-25T15:46:53.970675+0000","last_became_peered":"2024-04-25T15:46:53.970675+0000","last_unstale":"2024-04-25T15:46:53.974853+0000","last_undegraded":"2024-04-25T15:46:53.974853+0000","last_fullsized":"2024-04-25T15:46:53.974853+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:48.602358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970007+0000","last_change":"2024-04-25T15:46:53.964407+0000","last_active":"2024-04-25T15:46:53.970007+0000","last_peered":"2024-04-25T15:46:53.970007+0000","last_clean":"2024-04-25T15:46:53.970007+0000","last_became_active":"2024-04-25T15:46:53.963305+0000","last_became_peered":"2024-04-25T15:46:53.963305+0000","last_unstale":"2024-04-25T15:46:53.970007+0000","last_undegraded":"2024-04-25T15:46:53.970007+0000","last_fullsized":"2024-04-25T15:46:53.970007+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:09.432578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953887+0000","last_change":"2024-04-25T15:46:53.953887+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953887+0000","last_undegraded":"2024-04-25T15:46:53.953887+0000","last_fullsized":"2024-04-25T15:46:53.953887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972076+0000","last_change":"2024-04-25T15:46:53.970133+0000","last_active":"2024-04-25T15:46:53.972076+0000","last_peered":"2024-04-25T15:46:53.972076+0000","last_clean":"2024-04-25T15:46:53.972076+0000","last_became_active":"2024-04-25T15:46:53.969839+0000","last_became_peered":"2024-04-25T15:46:53.969839+0000","last_unstale":"2024-04-25T15:46:53.972076+0000","last_undegraded":"2024-04-25T15:46:53.972076+0000","last_fullsized":"2024-04-25T15:46:53.972076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:28.742784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969834+0000","last_change":"2024-04-25T15:46:53.968093+0000","last_active":"2024-04-25T15:46:53.969834+0000","last_peered":"2024-04-25T15:46:53.969834+0000","last_clean":"2024-04-25T15:46:53.969834+0000","last_became_active":"2024-04-25T15:46:53.967755+0000","last_became_peered":"2024-04-25T15:46:53.967755+0000","last_unstale":"2024-04-25T15:46:53.969834+0000","last_undegraded":"2024-04-25T15:46:53.969834+0000","last_fullsized":"2024-04-25T15:46:53.969834+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:30.543513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954365+0000","last_change":"2024-04-25T15:46:53.954365+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954365+0000","last_undegraded":"2024-04-25T15:46:53.954365+0000","last_fullsized":"2024-04-25T15:46:53.954365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944135+0000","last_change":"2024-04-25T15:46:52.944135+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944135+0000","last_undegraded":"2024-04-25T15:46:52.944135+0000","last_fullsized":"2024-04-25T15:46:52.944135+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953812+0000","last_change":"2024-04-25T15:46:53.953812+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953812+0000","last_undegraded":"2024-04-25T15:46:53.953812+0000","last_fullsized":"2024-04-25T15:46:53.953812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970064+0000","last_change":"2024-04-25T15:46:53.968248+0000","last_active":"2024-04-25T15:46:53.970064+0000","last_peered":"2024-04-25T15:46:53.970064+0000","last_clean":"2024-04-25T15:46:53.970064+0000","last_became_active":"2024-04-25T15:46:53.967888+0000","last_became_peered":"2024-04-25T15:46:53.967888+0000","last_unstale":"2024-04-25T15:46:53.970064+0000","last_undegraded":"2024-04-25T15:46:53.970064+0000","last_fullsized":"2024-04-25T15:46:53.970064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:49.381207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.971887+0000","last_change":"2024-04-25T15:46:53.970313+0000","last_active":"2024-04-25T15:46:53.971887+0000","last_peered":"2024-04-25T15:46:53.971887+0000","last_clean":"2024-04-25T15:46:53.971887+0000","last_became_active":"2024-04-25T15:46:53.969993+0000","last_became_peered":"2024-04-25T15:46:53.969993+0000","last_unstale":"2024-04-25T15:46:53.971887+0000","last_undegraded":"2024-04-25T15:46:53.971887+0000","last_fullsized":"2024-04-25T15:46:53.971887+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:44.087600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970107+0000","last_change":"2024-04-25T15:46:53.968009+0000","last_active":"2024-04-25T15:46:53.970107+0000","last_peered":"2024-04-25T15:46:53.970107+0000","last_clean":"2024-04-25T15:46:53.970107+0000","last_became_active":"2024-04-25T15:46:53.967723+0000","last_became_peered":"2024-04-25T15:46:53.967723+0000","last_unstale":"2024-04-25T15:46:53.970107+0000","last_undegraded":"2024-04-25T15:46:53.970107+0000","last_fullsized":"2024-04-25T15:46:53.970107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:50.693234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975101+0000","last_change":"2024-04-25T15:46:53.971368+0000","last_active":"2024-04-25T15:46:53.975101+0000","last_peered":"2024-04-25T15:46:53.975101+0000","last_clean":"2024-04-25T15:46:53.975101+0000","last_became_active":"2024-04-25T15:46:53.970376+0000","last_became_peered":"2024-04-25T15:46:53.970376+0000","last_unstale":"2024-04-25T15:46:53.975101+0000","last_undegraded":"2024-04-25T15:46:53.975101+0000","last_fullsized":"2024-04-25T15:46:53.975101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.546642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":262,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T15:46:52.945545+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:52.945545+0000","last_peered":"2024-04-25T15:46:52.945545+0000","last_clean":"2024-04-25T15:46:52.945545+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:52.945545+0000","last_undegraded":"2024-04-25T15:46:52.945545+0000","last_fullsized":"2024-04-25T15:46:52.945545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":5},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":547395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1781760,"data_stored":1131096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":1124887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1175552,"data_stored":534519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1175552,"data_stored":534519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:57.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:58.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.109+0000 7efc36a25640 1 Processor -- start 2024-04-25T15:46:58.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.109+0000 7efc36a25640 1 -- start start 2024-04-25T15:46:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc36a25640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efc3006da90 0x7efc300b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc36a25640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc300d1010 con 0x7efc300b91b0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc36a25640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3009cdf0 con 0x7efc300d34a0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc36a25640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7efc3009d0d0 con 0x7efc3006da90 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc300b91b0 0x7efc300b3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43740/0 (socket says 172.21.15.80:43740) 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2f7fe640 1 -- 172.21.15.80:0/1885365447 learned_addr learned my addr 172.21.15.80:0/1885365447 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379004550 0 0) 0x7efc300d1010 con 0x7efc300b91b0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc18003520 con 0x7efc300b91b0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1885365447 >> v2:172.21.15.195:3300/0 conn(0x7efc3006da90 0x7efc300b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2361283768 0 0) 0x7efc18003520 con 0x7efc300b91b0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 >> v2:172.21.15.195:3300/0 conn(0x7efc3006da90 msgr2=0x7efc300b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 --2- 172.21.15.80:0/1885365447 >> v2:172.21.15.195:3300/0 conn(0x7efc3006da90 0x7efc300b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 >> v1:172.21.15.195:6789/0 conn(0x7efc300d34a0 legacy=0x7efc3006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3006ec70 con 0x7efc300b91b0 2024-04-25T15:46:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7efc24001670 con 0x7efc300b91b0 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 >> v1:172.21.15.80:6789/0 conn(0x7efc300b91b0 legacy=0x7efc300b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180039b0 0x7efc18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc18004800 0x7efc18004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180051c0 0x7efc1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc3009d0d0 con 0x7efc180051c0 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efc1800c160 con 0x7efc18004800 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.111+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efc1800c360 con 0x7efc180039b0 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180051c0 0x7efc1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc2ffff640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180039b0 0x7efc18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc2f7fe640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc18004800 0x7efc18004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 -- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180039b0 msgr2=0x7efc18003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180039b0 0x7efc18003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 -- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc18004800 msgr2=0x7efc18004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc18004800 0x7efc18004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 -- 172.21.15.80:0/1885365447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc18003520 con 0x7efc180051c0 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.112+0000 7efc34fc2640 1 -- 172.21.15.80:0/1885365447 reap_dead start 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180051c0 0x7efc1800b9c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7efc28009f90 tx=0x7efc18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d4756e4f84fdc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28037070 con 0x7efc180051c0 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28032620 con 0x7efc180051c0 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc2effd640 1 -- 172.21.15.80:0/1885365447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28009c10 con 0x7efc180051c0 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 -- 172.21.15.80:0/1885365447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180051c0 msgr2=0x7efc1800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180051c0 0x7efc1800b9c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7efc28009f90 tx=0x7efc18005830 comp rx=0 tx=0).stop 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 -- 172.21.15.80:0/1885365447 shutdown_connections 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 --2- 172.21.15.80:0/1885365447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc180051c0 0x7efc1800b9c0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 -- 172.21.15.80:0/1885365447 >> 172.21.15.80:0/1885365447 conn(0x7efc300d0450 msgr2=0x7efc300d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 -- 172.21.15.80:0/1885365447 shutdown_connections 2024-04-25T15:46:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.113+0000 7efc36a25640 1 -- 172.21.15.80:0/1885365447 wait complete. 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.115+0000 7efc36a25640 1 Processor -- start 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.115+0000 7efc36a25640 1 -- start start 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180051c0 0x7efc30155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 0x7efc301f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc30072710 0x7efc30072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc3006e560 con 0x7efc301539d0 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efc3006d7b0 con 0x7efc30072710 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efc3006e6e0 con 0x7efc180051c0 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 0x7efc301f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 0x7efc301f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33958/0 (socket says 172.21.15.80:33958) 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 -- 172.21.15.80:0/1506970899 learned_addr learned my addr 172.21.15.80:0/1506970899 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2ffff640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180051c0 0x7efc30155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc30072710 0x7efc30072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 -- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180051c0 msgr2=0x7efc30155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180051c0 0x7efc30155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 -- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc30072710 msgr2=0x7efc30072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc30072710 0x7efc30072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 -- 172.21.15.80:0/1506970899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc30073060 con 0x7efc301539d0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2ffff640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180051c0 0x7efc30155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc34fc2640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc30072710 0x7efc30072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2f7fe640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 0x7efc301f6c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7efc240072c0 tx=0x7efc24007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2401a070 con 0x7efc301539d0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2400f860 con 0x7efc301539d0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc30156290 con 0x7efc301539d0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2400fc10 con 0x7efc301539d0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.117+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc30156850 con 0x7efc301539d0 2024-04-25T15:46:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.118+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc301536f0 con 0x7efc301539d0 2024-04-25T15:46:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.119+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efc2401d070 con 0x7efc301539d0 2024-04-25T15:46:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.119+0000 7efc2cff9640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc1c0744b0 0x7efc1c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.119+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7efc24094ec0 con 0x7efc301539d0 2024-04-25T15:46:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.119+0000 7efc2ffff640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc1c0744b0 0x7efc1c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.120+0000 7efc2ffff640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc1c0744b0 0x7efc1c0769c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efc20000c00 tx=0x7efc20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.124+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc301536f0 con 0x7efc301539d0 2024-04-25T15:46:58.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.294+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc30156020 con 0x7efc1c0744b0 2024-04-25T15:46:58.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.300+0000 7efc2cff9640 1 -- 172.21.15.80:0/1506970899 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244661 (secure 0 0 0) 0x7efc30156020 con 0x7efc1c0744b0 2024-04-25T15:46:58.303 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:58.304 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:46:58.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.302+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc1c0744b0 msgr2=0x7efc1c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.302+0000 7efc36a25640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc1c0744b0 0x7efc1c0769c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efc20000c00 tx=0x7efc20009040 comp rx=0 tx=0).stop 2024-04-25T15:46:58.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.302+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 msgr2=0x7efc301f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.302+0000 7efc36a25640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 0x7efc301f6c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7efc240072c0 tx=0x7efc24007780 comp rx=0 tx=0).stop 2024-04-25T15:46:58.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 shutdown_connections 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7efc1c0744b0 0x7efc1c0769c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc30072710 0x7efc30072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc301539d0 0x7efc301f6c80 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 --2- 172.21.15.80:0/1506970899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc180051c0 0x7efc30155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 >> 172.21.15.80:0/1506970899 conn(0x7efc300d0450 msgr2=0x7efc300cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 shutdown_connections 2024-04-25T15:46:58.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.303+0000 7efc36a25640 1 -- 172.21.15.80:0/1506970899 wait complete. 2024-04-25T15:46:58.315 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-25T15:46:57.045888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251556,"kb_used_data":10416,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723164,"statfs":{"total":773094113280,"available":772836519936,"internally_reserved":0,"allocated":10665984,"data_stored":5494600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.104095"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959228+0000","last_change":"2024-04-25T15:46:53.959228+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959228+0000","last_undegraded":"2024-04-25T15:46:53.959228+0000","last_fullsized":"2024-04-25T15:46:53.959228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960438+0000","last_change":"2024-04-25T15:46:53.960438+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960438+0000","last_undegraded":"2024-04-25T15:46:53.960438+0000","last_fullsized":"2024-04-25T15:46:53.960438+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959085+0000","last_change":"2024-04-25T15:46:53.959085+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959085+0000","last_undegraded":"2024-04-25T15:46:53.959085+0000","last_fullsized":"2024-04-25T15:46:53.959085+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954568+0000","last_change":"2024-04-25T15:46:53.954568+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954568+0000","last_undegraded":"2024-04-25T15:46:53.954568+0000","last_fullsized":"2024-04-25T15:46:53.954568+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957395+0000","last_change":"2024-04-25T15:46:53.957395+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957395+0000","last_undegraded":"2024-04-25T15:46:53.957395+0000","last_fullsized":"2024-04-25T15:46:53.957395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956986+0000","last_change":"2024-04-25T15:46:53.956986+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956986+0000","last_undegraded":"2024-04-25T15:46:53.956986+0000","last_fullsized":"2024-04-25T15:46:53.956986+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958704+0000","last_change":"2024-04-25T15:46:53.958704+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958704+0000","last_undegraded":"2024-04-25T15:46:53.958704+0000","last_fullsized":"2024-04-25T15:46:53.958704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956330+0000","last_change":"2024-04-25T15:46:53.956330+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956330+0000","last_undegraded":"2024-04-25T15:46:53.956330+0000","last_fullsized":"2024-04-25T15:46:53.956330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957062+0000","last_change":"2024-04-25T15:46:53.957062+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957062+0000","last_undegraded":"2024-04-25T15:46:53.957062+0000","last_fullsized":"2024-04-25T15:46:53.957062+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955717+0000","last_change":"2024-04-25T15:46:53.955717+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955717+0000","last_undegraded":"2024-04-25T15:46:53.955717+0000","last_fullsized":"2024-04-25T15:46:53.955717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953566+0000","last_change":"2024-04-25T15:46:53.953566+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953566+0000","last_undegraded":"2024-04-25T15:46:53.953566+0000","last_fullsized":"2024-04-25T15:46:53.953566+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958188+0000","last_change":"2024-04-25T15:46:53.958188+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958188+0000","last_undegraded":"2024-04-25T15:46:53.958188+0000","last_fullsized":"2024-04-25T15:46:53.958188+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959965+0000","last_change":"2024-04-25T15:46:53.959965+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959965+0000","last_undegraded":"2024-04-25T15:46:53.959965+0000","last_fullsized":"2024-04-25T15:46:53.959965+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957821+0000","last_change":"2024-04-25T15:46:53.957821+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957821+0000","last_undegraded":"2024-04-25T15:46:53.957821+0000","last_fullsized":"2024-04-25T15:46:53.957821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956585+0000","last_change":"2024-04-25T15:46:53.956585+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956585+0000","last_undegraded":"2024-04-25T15:46:53.956585+0000","last_fullsized":"2024-04-25T15:46:53.956585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957948+0000","last_change":"2024-04-25T15:46:53.957948+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957948+0000","last_undegraded":"2024-04-25T15:46:53.957948+0000","last_fullsized":"2024-04-25T15:46:53.957948+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955880+0000","last_change":"2024-04-25T15:46:53.955880+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955880+0000","last_undegraded":"2024-04-25T15:46:53.955880+0000","last_fullsized":"2024-04-25T15:46:53.955880+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957696+0000","last_change":"2024-04-25T15:46:53.957696+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957696+0000","last_undegraded":"2024-04-25T15:46:53.957696+0000","last_fullsized":"2024-04-25T15:46:53.957696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956806+0000","last_change":"2024-04-25T15:46:53.956806+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956806+0000","last_undegraded":"2024-04-25T15:46:53.956806+0000","last_fullsized":"2024-04-25T15:46:53.956806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954309+0000","last_change":"2024-04-25T15:46:53.954309+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954309+0000","last_undegraded":"2024-04-25T15:46:53.954309+0000","last_fullsized":"2024-04-25T15:46:53.954309+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958209+0000","last_change":"2024-04-25T15:46:53.958209+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958209+0000","last_undegraded":"2024-04-25T15:46:53.958209+0000","last_fullsized":"2024-04-25T15:46:53.958209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955442+0000","last_change":"2024-04-25T15:46:53.955442+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955442+0000","last_undegraded":"2024-04-25T15:46:53.955442+0000","last_fullsized":"2024-04-25T15:46:53.955442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953362+0000","last_change":"2024-04-25T15:46:53.953362+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953362+0000","last_undegraded":"2024-04-25T15:46:53.953362+0000","last_fullsized":"2024-04-25T15:46:53.953362+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969850+0000","last_change":"2024-04-25T15:46:53.968876+0000","last_active":"2024-04-25T15:46:53.969850+0000","last_peered":"2024-04-25T15:46:53.969850+0000","last_clean":"2024-04-25T15:46:53.969850+0000","last_became_active":"2024-04-25T15:46:53.968481+0000","last_became_peered":"2024-04-25T15:46:53.968481+0000","last_unstale":"2024-04-25T15:46:53.969850+0000","last_undegraded":"2024-04-25T15:46:53.969850+0000","last_fullsized":"2024-04-25T15:46:53.969850+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:53.882480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954970+0000","last_change":"2024-04-25T15:46:53.954970+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954970+0000","last_undegraded":"2024-04-25T15:46:53.954970+0000","last_fullsized":"2024-04-25T15:46:53.954970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975078+0000","last_change":"2024-04-25T15:46:53.971080+0000","last_active":"2024-04-25T15:46:53.975078+0000","last_peered":"2024-04-25T15:46:53.975078+0000","last_clean":"2024-04-25T15:46:53.975078+0000","last_became_active":"2024-04-25T15:46:53.969706+0000","last_became_peered":"2024-04-25T15:46:53.969706+0000","last_unstale":"2024-04-25T15:46:53.975078+0000","last_undegraded":"2024-04-25T15:46:53.975078+0000","last_fullsized":"2024-04-25T15:46:53.975078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:25.630507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944139+0000","last_change":"2024-04-25T15:46:52.944139+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944139+0000","last_undegraded":"2024-04-25T15:46:52.944139+0000","last_fullsized":"2024-04-25T15:46:52.944139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977481+0000","last_change":"2024-04-25T15:46:53.971918+0000","last_active":"2024-04-25T15:46:53.977481+0000","last_peered":"2024-04-25T15:46:53.977481+0000","last_clean":"2024-04-25T15:46:53.977481+0000","last_became_active":"2024-04-25T15:46:53.971592+0000","last_became_peered":"2024-04-25T15:46:53.971592+0000","last_unstale":"2024-04-25T15:46:53.977481+0000","last_undegraded":"2024-04-25T15:46:53.977481+0000","last_fullsized":"2024-04-25T15:46:53.977481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:24.750079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953843+0000","last_change":"2024-04-25T15:46:53.953843+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953843+0000","last_undegraded":"2024-04-25T15:46:53.953843+0000","last_fullsized":"2024-04-25T15:46:53.953843+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944121+0000","last_change":"2024-04-25T15:46:52.944121+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944121+0000","last_undegraded":"2024-04-25T15:46:52.944121+0000","last_fullsized":"2024-04-25T15:46:52.944121+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956833+0000","last_change":"2024-04-25T15:46:53.956833+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956833+0000","last_undegraded":"2024-04-25T15:46:53.956833+0000","last_fullsized":"2024-04-25T15:46:53.956833+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.947302+0000","last_change":"2024-04-25T15:46:52.947302+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.947302+0000","last_undegraded":"2024-04-25T15:46:52.947302+0000","last_fullsized":"2024-04-25T15:46:52.947302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959436+0000","last_change":"2024-04-25T15:46:53.959436+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959436+0000","last_undegraded":"2024-04-25T15:46:53.959436+0000","last_fullsized":"2024-04-25T15:46:53.959436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944669+0000","last_change":"2024-04-25T15:46:52.944669+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944669+0000","last_undegraded":"2024-04-25T15:46:52.944669+0000","last_fullsized":"2024-04-25T15:46:52.944669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955246+0000","last_change":"2024-04-25T15:46:53.955246+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955246+0000","last_undegraded":"2024-04-25T15:46:53.955246+0000","last_fullsized":"2024-04-25T15:46:53.955246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.964207+0000","last_change":"2024-04-25T15:46:53.961775+0000","last_active":"2024-04-25T15:46:53.964207+0000","last_peered":"2024-04-25T15:46:53.964207+0000","last_clean":"2024-04-25T15:46:53.964207+0000","last_became_active":"2024-04-25T15:46:53.961476+0000","last_became_peered":"2024-04-25T15:46:53.961476+0000","last_unstale":"2024-04-25T15:46:53.964207+0000","last_undegraded":"2024-04-25T15:46:53.964207+0000","last_fullsized":"2024-04-25T15:46:53.964207+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:16.471621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953959+0000","last_change":"2024-04-25T15:46:53.953959+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953959+0000","last_undegraded":"2024-04-25T15:46:53.953959+0000","last_fullsized":"2024-04-25T15:46:53.953959+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.945014+0000","last_change":"2024-04-25T15:46:52.945014+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.945014+0000","last_undegraded":"2024-04-25T15:46:52.945014+0000","last_fullsized":"2024-04-25T15:46:52.945014+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955655+0000","last_change":"2024-04-25T15:46:53.955655+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955655+0000","last_undegraded":"2024-04-25T15:46:53.955655+0000","last_fullsized":"2024-04-25T15:46:53.955655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.962836+0000","last_change":"2024-04-25T15:46:53.958121+0000","last_active":"2024-04-25T15:46:53.962836+0000","last_peered":"2024-04-25T15:46:53.962836+0000","last_clean":"2024-04-25T15:46:53.962836+0000","last_became_active":"2024-04-25T15:46:53.957362+0000","last_became_peered":"2024-04-25T15:46:53.957362+0000","last_unstale":"2024-04-25T15:46:53.962836+0000","last_undegraded":"2024-04-25T15:46:53.962836+0000","last_fullsized":"2024-04-25T15:46:53.962836+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:38.120803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956025+0000","last_change":"2024-04-25T15:46:53.956025+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956025+0000","last_undegraded":"2024-04-25T15:46:53.956025+0000","last_fullsized":"2024-04-25T15:46:53.956025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944750+0000","last_change":"2024-04-25T15:46:52.944750+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944750+0000","last_undegraded":"2024-04-25T15:46:52.944750+0000","last_fullsized":"2024-04-25T15:46:52.944750+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956486+0000","last_change":"2024-04-25T15:46:53.956486+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956486+0000","last_undegraded":"2024-04-25T15:46:53.956486+0000","last_fullsized":"2024-04-25T15:46:53.956486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.968857+0000","last_change":"2024-04-25T15:46:53.966347+0000","last_active":"2024-04-25T15:46:53.968857+0000","last_peered":"2024-04-25T15:46:53.968857+0000","last_clean":"2024-04-25T15:46:53.968857+0000","last_became_active":"2024-04-25T15:46:53.965444+0000","last_became_peered":"2024-04-25T15:46:53.965444+0000","last_unstale":"2024-04-25T15:46:53.968857+0000","last_undegraded":"2024-04-25T15:46:53.968857+0000","last_fullsized":"2024-04-25T15:46:53.968857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:02.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977474+0000","last_change":"2024-04-25T15:46:53.971700+0000","last_active":"2024-04-25T15:46:53.977474+0000","last_peered":"2024-04-25T15:46:53.977474+0000","last_clean":"2024-04-25T15:46:53.977474+0000","last_became_active":"2024-04-25T15:46:53.971408+0000","last_became_peered":"2024-04-25T15:46:53.971408+0000","last_unstale":"2024-04-25T15:46:53.977474+0000","last_undegraded":"2024-04-25T15:46:53.977474+0000","last_fullsized":"2024-04-25T15:46:53.977474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.966461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956302+0000","last_change":"2024-04-25T15:46:53.956302+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956302+0000","last_undegraded":"2024-04-25T15:46:53.956302+0000","last_fullsized":"2024-04-25T15:46:53.956302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969879+0000","last_change":"2024-04-25T15:46:53.966111+0000","last_active":"2024-04-25T15:46:53.969879+0000","last_peered":"2024-04-25T15:46:53.969879+0000","last_clean":"2024-04-25T15:46:53.969879+0000","last_became_active":"2024-04-25T15:46:53.965745+0000","last_became_peered":"2024-04-25T15:46:53.965745+0000","last_unstale":"2024-04-25T15:46:53.969879+0000","last_undegraded":"2024-04-25T15:46:53.969879+0000","last_fullsized":"2024-04-25T15:46:53.969879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.409398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960019+0000","last_change":"2024-04-25T15:46:53.960019+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960019+0000","last_undegraded":"2024-04-25T15:46:53.960019+0000","last_fullsized":"2024-04-25T15:46:53.960019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970072+0000","last_change":"2024-04-25T15:46:53.967519+0000","last_active":"2024-04-25T15:46:53.970072+0000","last_peered":"2024-04-25T15:46:53.970072+0000","last_clean":"2024-04-25T15:46:53.970072+0000","last_became_active":"2024-04-25T15:46:53.967161+0000","last_became_peered":"2024-04-25T15:46:53.967161+0000","last_unstale":"2024-04-25T15:46:53.970072+0000","last_undegraded":"2024-04-25T15:46:53.970072+0000","last_fullsized":"2024-04-25T15:46:53.970072+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.247123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954392+0000","last_change":"2024-04-25T15:46:53.954392+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954392+0000","last_undegraded":"2024-04-25T15:46:53.954392+0000","last_fullsized":"2024-04-25T15:46:53.954392+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944115+0000","last_change":"2024-04-25T15:46:52.944115+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944115+0000","last_undegraded":"2024-04-25T15:46:52.944115+0000","last_fullsized":"2024-04-25T15:46:52.944115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954978+0000","last_change":"2024-04-25T15:46:53.954978+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954978+0000","last_undegraded":"2024-04-25T15:46:53.954978+0000","last_fullsized":"2024-04-25T15:46:53.954978+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.973078+0000","last_change":"2024-04-25T15:46:53.972080+0000","last_active":"2024-04-25T15:46:53.973078+0000","last_peered":"2024-04-25T15:46:53.973078+0000","last_clean":"2024-04-25T15:46:53.973078+0000","last_became_active":"2024-04-25T15:46:53.971693+0000","last_became_peered":"2024-04-25T15:46:53.971693+0000","last_unstale":"2024-04-25T15:46:53.973078+0000","last_undegraded":"2024-04-25T15:46:53.973078+0000","last_fullsized":"2024-04-25T15:46:53.973078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:55.761865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955542+0000","last_change":"2024-04-25T15:46:53.955542+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955542+0000","last_undegraded":"2024-04-25T15:46:53.955542+0000","last_fullsized":"2024-04-25T15:46:53.955542+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944115+0000","last_change":"2024-04-25T15:46:52.944115+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944115+0000","last_undegraded":"2024-04-25T15:46:52.944115+0000","last_fullsized":"2024-04-25T15:46:52.944115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956944+0000","last_change":"2024-04-25T15:46:53.956944+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956944+0000","last_undegraded":"2024-04-25T15:46:53.956944+0000","last_fullsized":"2024-04-25T15:46:53.956944+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.947390+0000","last_change":"2024-04-25T15:46:52.947390+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.947390+0000","last_undegraded":"2024-04-25T15:46:52.947390+0000","last_fullsized":"2024-04-25T15:46:52.947390+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954838+0000","last_change":"2024-04-25T15:46:53.954838+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954838+0000","last_undegraded":"2024-04-25T15:46:53.954838+0000","last_fullsized":"2024-04-25T15:46:53.954838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970187+0000","last_change":"2024-04-25T15:46:53.962212+0000","last_active":"2024-04-25T15:46:53.970187+0000","last_peered":"2024-04-25T15:46:53.970187+0000","last_clean":"2024-04-25T15:46:53.970187+0000","last_became_active":"2024-04-25T15:46:53.961142+0000","last_became_peered":"2024-04-25T15:46:53.961142+0000","last_unstale":"2024-04-25T15:46:53.970187+0000","last_undegraded":"2024-04-25T15:46:53.970187+0000","last_fullsized":"2024-04-25T15:46:53.970187+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:18.080583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957298+0000","last_change":"2024-04-25T15:46:53.957298+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957298+0000","last_undegraded":"2024-04-25T15:46:53.957298+0000","last_fullsized":"2024-04-25T15:46:53.957298+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975037+0000","last_change":"2024-04-25T15:46:53.970934+0000","last_active":"2024-04-25T15:46:53.975037+0000","last_peered":"2024-04-25T15:46:53.975037+0000","last_clean":"2024-04-25T15:46:53.975037+0000","last_became_active":"2024-04-25T15:46:53.970663+0000","last_became_peered":"2024-04-25T15:46:53.970663+0000","last_unstale":"2024-04-25T15:46:53.975037+0000","last_undegraded":"2024-04-25T15:46:53.975037+0000","last_fullsized":"2024-04-25T15:46:53.975037+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:06.603322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955713+0000","last_change":"2024-04-25T15:46:53.955713+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955713+0000","last_undegraded":"2024-04-25T15:46:53.955713+0000","last_fullsized":"2024-04-25T15:46:53.955713+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969036+0000","last_change":"2024-04-25T15:46:53.967992+0000","last_active":"2024-04-25T15:46:53.969036+0000","last_peered":"2024-04-25T15:46:53.969036+0000","last_clean":"2024-04-25T15:46:53.969036+0000","last_became_active":"2024-04-25T15:46:53.967078+0000","last_became_peered":"2024-04-25T15:46:53.967078+0000","last_unstale":"2024-04-25T15:46:53.969036+0000","last_undegraded":"2024-04-25T15:46:53.969036+0000","last_fullsized":"2024-04-25T15:46:53.969036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:47.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958741+0000","last_change":"2024-04-25T15:46:53.958741+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958741+0000","last_undegraded":"2024-04-25T15:46:53.958741+0000","last_fullsized":"2024-04-25T15:46:53.958741+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972206+0000","last_change":"2024-04-25T15:46:53.970573+0000","last_active":"2024-04-25T15:46:53.972206+0000","last_peered":"2024-04-25T15:46:53.972206+0000","last_clean":"2024-04-25T15:46:53.972206+0000","last_became_active":"2024-04-25T15:46:53.970245+0000","last_became_peered":"2024-04-25T15:46:53.970245+0000","last_unstale":"2024-04-25T15:46:53.972206+0000","last_undegraded":"2024-04-25T15:46:53.972206+0000","last_fullsized":"2024-04-25T15:46:53.972206+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:28:56.649496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955359+0000","last_change":"2024-04-25T15:46:53.955359+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955359+0000","last_undegraded":"2024-04-25T15:46:53.955359+0000","last_fullsized":"2024-04-25T15:46:53.955359+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.974853+0000","last_change":"2024-04-25T15:46:53.970973+0000","last_active":"2024-04-25T15:46:53.974853+0000","last_peered":"2024-04-25T15:46:53.974853+0000","last_clean":"2024-04-25T15:46:53.974853+0000","last_became_active":"2024-04-25T15:46:53.970675+0000","last_became_peered":"2024-04-25T15:46:53.970675+0000","last_unstale":"2024-04-25T15:46:53.974853+0000","last_undegraded":"2024-04-25T15:46:53.974853+0000","last_fullsized":"2024-04-25T15:46:53.974853+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:48.602358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970007+0000","last_change":"2024-04-25T15:46:53.964407+0000","last_active":"2024-04-25T15:46:53.970007+0000","last_peered":"2024-04-25T15:46:53.970007+0000","last_clean":"2024-04-25T15:46:53.970007+0000","last_became_active":"2024-04-25T15:46:53.963305+0000","last_became_peered":"2024-04-25T15:46:53.963305+0000","last_unstale":"2024-04-25T15:46:53.970007+0000","last_undegraded":"2024-04-25T15:46:53.970007+0000","last_fullsized":"2024-04-25T15:46:53.970007+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:09.432578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953887+0000","last_change":"2024-04-25T15:46:53.953887+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953887+0000","last_undegraded":"2024-04-25T15:46:53.953887+0000","last_fullsized":"2024-04-25T15:46:53.953887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972076+0000","last_change":"2024-04-25T15:46:53.970133+0000","last_active":"2024-04-25T15:46:53.972076+0000","last_peered":"2024-04-25T15:46:53.972076+0000","last_clean":"2024-04-25T15:46:53.972076+0000","last_became_active":"2024-04-25T15:46:53.969839+0000","last_became_peered":"2024-04-25T15:46:53.969839+0000","last_unstale":"2024-04-25T15:46:53.972076+0000","last_undegraded":"2024-04-25T15:46:53.972076+0000","last_fullsized":"2024-04-25T15:46:53.972076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:28.742784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969834+0000","last_change":"2024-04-25T15:46:53.968093+0000","last_active":"2024-04-25T15:46:53.969834+0000","last_peered":"2024-04-25T15:46:53.969834+0000","last_clean":"2024-04-25T15:46:53.969834+0000","last_became_active":"2024-04-25T15:46:53.967755+0000","last_became_peered":"2024-04-25T15:46:53.967755+0000","last_unstale":"2024-04-25T15:46:53.969834+0000","last_undegraded":"2024-04-25T15:46:53.969834+0000","last_fullsized":"2024-04-25T15:46:53.969834+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:30.543513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954365+0000","last_change":"2024-04-25T15:46:53.954365+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954365+0000","last_undegraded":"2024-04-25T15:46:53.954365+0000","last_fullsized":"2024-04-25T15:46:53.954365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944135+0000","last_change":"2024-04-25T15:46:52.944135+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944135+0000","last_undegraded":"2024-04-25T15:46:52.944135+0000","last_fullsized":"2024-04-25T15:46:52.944135+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953812+0000","last_change":"2024-04-25T15:46:53.953812+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953812+0000","last_undegraded":"2024-04-25T15:46:53.953812+0000","last_fullsized":"2024-04-25T15:46:53.953812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970064+0000","last_change":"2024-04-25T15:46:53.968248+0000","last_active":"2024-04-25T15:46:53.970064+0000","last_peered":"2024-04-25T15:46:53.970064+0000","last_clean":"2024-04-25T15:46:53.970064+0000","last_became_active":"2024-04-25T15:46:53.967888+0000","last_became_peered":"2024-04-25T15:46:53.967888+0000","last_unstale":"2024-04-25T15:46:53.970064+0000","last_undegraded":"2024-04-25T15:46:53.970064+0000","last_fullsized":"2024-04-25T15:46:53.970064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:49.381207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.971887+0000","last_change":"2024-04-25T15:46:53.970313+0000","last_active":"2024-04-25T15:46:53.971887+0000","last_peered":"2024-04-25T15:46:53.971887+0000","last_clean":"2024-04-25T15:46:53.971887+0000","last_became_active":"2024-04-25T15:46:53.969993+0000","last_became_peered":"2024-04-25T15:46:53.969993+0000","last_unstale":"2024-04-25T15:46:53.971887+0000","last_undegraded":"2024-04-25T15:46:53.971887+0000","last_fullsized":"2024-04-25T15:46:53.971887+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:44.087600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970107+0000","last_change":"2024-04-25T15:46:53.968009+0000","last_active":"2024-04-25T15:46:53.970107+0000","last_peered":"2024-04-25T15:46:53.970107+0000","last_clean":"2024-04-25T15:46:53.970107+0000","last_became_active":"2024-04-25T15:46:53.967723+0000","last_became_peered":"2024-04-25T15:46:53.967723+0000","last_unstale":"2024-04-25T15:46:53.970107+0000","last_undegraded":"2024-04-25T15:46:53.970107+0000","last_fullsized":"2024-04-25T15:46:53.970107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:50.693234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975101+0000","last_change":"2024-04-25T15:46:53.971368+0000","last_active":"2024-04-25T15:46:53.975101+0000","last_peered":"2024-04-25T15:46:53.975101+0000","last_clean":"2024-04-25T15:46:53.975101+0000","last_became_active":"2024-04-25T15:46:53.970376+0000","last_became_peered":"2024-04-25T15:46:53.970376+0000","last_unstale":"2024-04-25T15:46:53.975101+0000","last_undegraded":"2024-04-25T15:46:53.975101+0000","last_fullsized":"2024-04-25T15:46:53.975101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.546642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":262,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T15:46:52.945545+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:52.945545+0000","last_peered":"2024-04-25T15:46:52.945545+0000","last_clean":"2024-04-25T15:46:52.945545+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:52.945545+0000","last_undegraded":"2024-04-25T15:46:52.945545+0000","last_fullsized":"2024-04-25T15:46:52.945545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":5},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":547395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1781760,"data_stored":1131096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":1124887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1175552,"data_stored":534519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1175552,"data_stored":534519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:58.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:58.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.462+0000 7f563184c640 1 Processor -- start 2024-04-25T15:46:58.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.462+0000 7f563184c640 1 -- start start 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f563184c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c0d41b0 0x7f562c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f563184c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f562c1602a0 0x7f562c0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f563184c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c0b7fa0 con 0x7f562c0b7b90 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f563184c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f562c0d59d0 con 0x7f562c1602a0 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f563184c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f562c163fb0 con 0x7f562c0d41b0 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f562a7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f562c1602a0 0x7f562c0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f562b7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f562c0b7b90 0x7f562c0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43752/0 (socket says 172.21.15.80:43752) 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f562a7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f562c1602a0 0x7f562c0b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33964/0 (socket says 172.21.15.80:33964) 2024-04-25T15:46:58.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.463+0000 7f562b7fe640 1 -- 172.21.15.80:0/1974569143 learned_addr learned my addr 172.21.15.80:0/1974569143 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f562affd640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c0d41b0 0x7f562c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f562a7fc640 1 -- 172.21.15.80:0/1974569143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c0d41b0 msgr2=0x7f562c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f562a7fc640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c0d41b0 0x7f562c0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f562a7fc640 1 -- 172.21.15.80:0/1974569143 >> v1:172.21.15.80:6789/0 conn(0x7f562c0b7b90 legacy=0x7f562c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f562a7fc640 1 -- 172.21.15.80:0/1974569143 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c164270 con 0x7f562c1602a0 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f5629ffb640 1 -- 172.21.15.80:0/1974569143 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052256649 0 0) 0x7f5624001490 con 0x7f562c0b7b90 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.464+0000 7f562affd640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c0d41b0 0x7f562c0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f562a7fc640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c1602a0 0x7f562c0b7650 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f56200097a0 tx=0x7f562002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1516d20fc6173fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f5629ffb640 1 -- 172.21.15.80:0/1974569143 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620037070 con 0x7f562c1602a0 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f5629ffb640 1 -- 172.21.15.80:0/1974569143 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620032440 con 0x7f562c1602a0 2024-04-25T15:46:58.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f5629ffb640 1 -- 172.21.15.80:0/1974569143 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620032810 con 0x7f562c1602a0 2024-04-25T15:46:58.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f563184c640 1 -- 172.21.15.80:0/1974569143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c1602a0 msgr2=0x7f562c0b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f563184c640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c1602a0 0x7f562c0b7650 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f56200097a0 tx=0x7f562002a180 comp rx=0 tx=0).stop 2024-04-25T15:46:58.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f563184c640 1 -- 172.21.15.80:0/1974569143 shutdown_connections 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f563184c640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c1602a0 0x7f562c0b7650 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f563184c640 1 --2- 172.21.15.80:0/1974569143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c0d41b0 0x7f562c0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.465+0000 7f563184c640 1 -- 172.21.15.80:0/1974569143 >> 172.21.15.80:0/1974569143 conn(0x7f562c06e9f0 msgr2=0x7f562c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.466+0000 7f563184c640 1 -- 172.21.15.80:0/1974569143 shutdown_connections 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.466+0000 7f563184c640 1 -- 172.21.15.80:0/1974569143 wait complete. 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.467+0000 7f563184c640 1 Processor -- start 2024-04-25T15:46:58.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.467+0000 7f563184c640 1 -- start start 2024-04-25T15:46:58.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 0x7f562c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f562c0d41b0 0x7f562c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c1602a0 0x7f562c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f562c164b10 con 0x7f562c0b7b90 2024-04-25T15:46:58.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f562c164830 con 0x7f562c0d41b0 2024-04-25T15:46:58.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f562c0b4fd0 con 0x7f562c1602a0 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 0x7f562c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 0x7f562c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33972/0 (socket says 172.21.15.80:33972) 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 -- 172.21.15.80:0/1963682957 learned_addr learned my addr 172.21.15.80:0/1963682957 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562a7fc640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f562c0d41b0 0x7f562c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562b7fe640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c1602a0 0x7f562c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 -- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c1602a0 msgr2=0x7f562c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c1602a0 0x7f562c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 -- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f562c0d41b0 msgr2=0x7f562c14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f562c0d41b0 0x7f562c14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 -- 172.21.15.80:0/1963682957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c151410 con 0x7f562c0b7b90 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f562affd640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 0x7f562c0ccc60 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f561c00c820 tx=0x7f561c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c015070 con 0x7f562c0b7b90 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c0079d0 con 0x7f562c0b7b90 2024-04-25T15:46:58.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c0cb490 con 0x7f562c0b7b90 2024-04-25T15:46:58.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c007d80 con 0x7f562c0b7b90 2024-04-25T15:46:58.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.469+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c0cba50 con 0x7f562c0b7b90 2024-04-25T15:46:58.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.470+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c06a100 con 0x7f562c0b7b90 2024-04-25T15:46:58.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.471+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f561c018070 con 0x7f562c0b7b90 2024-04-25T15:46:58.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.472+0000 7f5613fff640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f56180744b0 0x7f56180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.472+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f561c095240 con 0x7f562c0b7b90 2024-04-25T15:46:58.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.472+0000 7f562a7fc640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f56180744b0 0x7f56180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.472+0000 7f562a7fc640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f56180744b0 0x7f56180769c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5620034000 tx=0x7f562002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.476+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f561c05f8d0 con 0x7f562c0b7b90 2024-04-25T15:46:58.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.649+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f562c0d3070 con 0x7f56180744b0 2024-04-25T15:46:58.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.655+0000 7f5613fff640 1 -- 172.21.15.80:0/1963682957 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244661 (secure 0 0 0) 0x7f562c0d3070 con 0x7f56180744b0 2024-04-25T15:46:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:58.659 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:46:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f56180744b0 msgr2=0x7f56180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f56180744b0 0x7f56180769c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5620034000 tx=0x7f562002e000 comp rx=0 tx=0).stop 2024-04-25T15:46:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 msgr2=0x7f562c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 0x7f562c0ccc60 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f561c00c820 tx=0x7f561c00cce0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 shutdown_connections 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f56180744b0 0x7f56180769c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f562c1602a0 0x7f562c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f562c0d41b0 0x7f562c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 --2- 172.21.15.80:0/1963682957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f562c0b7b90 0x7f562c0ccc60 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 >> 172.21.15.80:0/1963682957 conn(0x7f562c06e9f0 msgr2=0x7f562c0b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 shutdown_connections 2024-04-25T15:46:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.658+0000 7f563184c640 1 -- 172.21.15.80:0/1963682957 wait complete. 2024-04-25T15:46:58.670 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-25T15:46:57.045888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251556,"kb_used_data":10416,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723164,"statfs":{"total":773094113280,"available":772836519936,"internally_reserved":0,"allocated":10665984,"data_stored":5494600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.104095"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959228+0000","last_change":"2024-04-25T15:46:53.959228+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959228+0000","last_undegraded":"2024-04-25T15:46:53.959228+0000","last_fullsized":"2024-04-25T15:46:53.959228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960438+0000","last_change":"2024-04-25T15:46:53.960438+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960438+0000","last_undegraded":"2024-04-25T15:46:53.960438+0000","last_fullsized":"2024-04-25T15:46:53.960438+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959085+0000","last_change":"2024-04-25T15:46:53.959085+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959085+0000","last_undegraded":"2024-04-25T15:46:53.959085+0000","last_fullsized":"2024-04-25T15:46:53.959085+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954568+0000","last_change":"2024-04-25T15:46:53.954568+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954568+0000","last_undegraded":"2024-04-25T15:46:53.954568+0000","last_fullsized":"2024-04-25T15:46:53.954568+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957395+0000","last_change":"2024-04-25T15:46:53.957395+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957395+0000","last_undegraded":"2024-04-25T15:46:53.957395+0000","last_fullsized":"2024-04-25T15:46:53.957395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956986+0000","last_change":"2024-04-25T15:46:53.956986+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956986+0000","last_undegraded":"2024-04-25T15:46:53.956986+0000","last_fullsized":"2024-04-25T15:46:53.956986+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958704+0000","last_change":"2024-04-25T15:46:53.958704+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958704+0000","last_undegraded":"2024-04-25T15:46:53.958704+0000","last_fullsized":"2024-04-25T15:46:53.958704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956330+0000","last_change":"2024-04-25T15:46:53.956330+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956330+0000","last_undegraded":"2024-04-25T15:46:53.956330+0000","last_fullsized":"2024-04-25T15:46:53.956330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957062+0000","last_change":"2024-04-25T15:46:53.957062+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957062+0000","last_undegraded":"2024-04-25T15:46:53.957062+0000","last_fullsized":"2024-04-25T15:46:53.957062+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955717+0000","last_change":"2024-04-25T15:46:53.955717+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955717+0000","last_undegraded":"2024-04-25T15:46:53.955717+0000","last_fullsized":"2024-04-25T15:46:53.955717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953566+0000","last_change":"2024-04-25T15:46:53.953566+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953566+0000","last_undegraded":"2024-04-25T15:46:53.953566+0000","last_fullsized":"2024-04-25T15:46:53.953566+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958188+0000","last_change":"2024-04-25T15:46:53.958188+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958188+0000","last_undegraded":"2024-04-25T15:46:53.958188+0000","last_fullsized":"2024-04-25T15:46:53.958188+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959965+0000","last_change":"2024-04-25T15:46:53.959965+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959965+0000","last_undegraded":"2024-04-25T15:46:53.959965+0000","last_fullsized":"2024-04-25T15:46:53.959965+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957821+0000","last_change":"2024-04-25T15:46:53.957821+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957821+0000","last_undegraded":"2024-04-25T15:46:53.957821+0000","last_fullsized":"2024-04-25T15:46:53.957821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956585+0000","last_change":"2024-04-25T15:46:53.956585+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956585+0000","last_undegraded":"2024-04-25T15:46:53.956585+0000","last_fullsized":"2024-04-25T15:46:53.956585+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957948+0000","last_change":"2024-04-25T15:46:53.957948+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957948+0000","last_undegraded":"2024-04-25T15:46:53.957948+0000","last_fullsized":"2024-04-25T15:46:53.957948+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955880+0000","last_change":"2024-04-25T15:46:53.955880+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955880+0000","last_undegraded":"2024-04-25T15:46:53.955880+0000","last_fullsized":"2024-04-25T15:46:53.955880+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957696+0000","last_change":"2024-04-25T15:46:53.957696+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957696+0000","last_undegraded":"2024-04-25T15:46:53.957696+0000","last_fullsized":"2024-04-25T15:46:53.957696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956806+0000","last_change":"2024-04-25T15:46:53.956806+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956806+0000","last_undegraded":"2024-04-25T15:46:53.956806+0000","last_fullsized":"2024-04-25T15:46:53.956806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954309+0000","last_change":"2024-04-25T15:46:53.954309+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954309+0000","last_undegraded":"2024-04-25T15:46:53.954309+0000","last_fullsized":"2024-04-25T15:46:53.954309+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958209+0000","last_change":"2024-04-25T15:46:53.958209+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958209+0000","last_undegraded":"2024-04-25T15:46:53.958209+0000","last_fullsized":"2024-04-25T15:46:53.958209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955442+0000","last_change":"2024-04-25T15:46:53.955442+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955442+0000","last_undegraded":"2024-04-25T15:46:53.955442+0000","last_fullsized":"2024-04-25T15:46:53.955442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953362+0000","last_change":"2024-04-25T15:46:53.953362+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953362+0000","last_undegraded":"2024-04-25T15:46:53.953362+0000","last_fullsized":"2024-04-25T15:46:53.953362+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969850+0000","last_change":"2024-04-25T15:46:53.968876+0000","last_active":"2024-04-25T15:46:53.969850+0000","last_peered":"2024-04-25T15:46:53.969850+0000","last_clean":"2024-04-25T15:46:53.969850+0000","last_became_active":"2024-04-25T15:46:53.968481+0000","last_became_peered":"2024-04-25T15:46:53.968481+0000","last_unstale":"2024-04-25T15:46:53.969850+0000","last_undegraded":"2024-04-25T15:46:53.969850+0000","last_fullsized":"2024-04-25T15:46:53.969850+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:53.882480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954970+0000","last_change":"2024-04-25T15:46:53.954970+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954970+0000","last_undegraded":"2024-04-25T15:46:53.954970+0000","last_fullsized":"2024-04-25T15:46:53.954970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975078+0000","last_change":"2024-04-25T15:46:53.971080+0000","last_active":"2024-04-25T15:46:53.975078+0000","last_peered":"2024-04-25T15:46:53.975078+0000","last_clean":"2024-04-25T15:46:53.975078+0000","last_became_active":"2024-04-25T15:46:53.969706+0000","last_became_peered":"2024-04-25T15:46:53.969706+0000","last_unstale":"2024-04-25T15:46:53.975078+0000","last_undegraded":"2024-04-25T15:46:53.975078+0000","last_fullsized":"2024-04-25T15:46:53.975078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:25.630507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944139+0000","last_change":"2024-04-25T15:46:52.944139+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944139+0000","last_undegraded":"2024-04-25T15:46:52.944139+0000","last_fullsized":"2024-04-25T15:46:52.944139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977481+0000","last_change":"2024-04-25T15:46:53.971918+0000","last_active":"2024-04-25T15:46:53.977481+0000","last_peered":"2024-04-25T15:46:53.977481+0000","last_clean":"2024-04-25T15:46:53.977481+0000","last_became_active":"2024-04-25T15:46:53.971592+0000","last_became_peered":"2024-04-25T15:46:53.971592+0000","last_unstale":"2024-04-25T15:46:53.977481+0000","last_undegraded":"2024-04-25T15:46:53.977481+0000","last_fullsized":"2024-04-25T15:46:53.977481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:24.750079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953843+0000","last_change":"2024-04-25T15:46:53.953843+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953843+0000","last_undegraded":"2024-04-25T15:46:53.953843+0000","last_fullsized":"2024-04-25T15:46:53.953843+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944121+0000","last_change":"2024-04-25T15:46:52.944121+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944121+0000","last_undegraded":"2024-04-25T15:46:52.944121+0000","last_fullsized":"2024-04-25T15:46:52.944121+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956833+0000","last_change":"2024-04-25T15:46:53.956833+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956833+0000","last_undegraded":"2024-04-25T15:46:53.956833+0000","last_fullsized":"2024-04-25T15:46:53.956833+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.947302+0000","last_change":"2024-04-25T15:46:52.947302+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.947302+0000","last_undegraded":"2024-04-25T15:46:52.947302+0000","last_fullsized":"2024-04-25T15:46:52.947302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959436+0000","last_change":"2024-04-25T15:46:53.959436+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959436+0000","last_undegraded":"2024-04-25T15:46:53.959436+0000","last_fullsized":"2024-04-25T15:46:53.959436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944669+0000","last_change":"2024-04-25T15:46:52.944669+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944669+0000","last_undegraded":"2024-04-25T15:46:52.944669+0000","last_fullsized":"2024-04-25T15:46:52.944669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955246+0000","last_change":"2024-04-25T15:46:53.955246+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955246+0000","last_undegraded":"2024-04-25T15:46:53.955246+0000","last_fullsized":"2024-04-25T15:46:53.955246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.964207+0000","last_change":"2024-04-25T15:46:53.961775+0000","last_active":"2024-04-25T15:46:53.964207+0000","last_peered":"2024-04-25T15:46:53.964207+0000","last_clean":"2024-04-25T15:46:53.964207+0000","last_became_active":"2024-04-25T15:46:53.961476+0000","last_became_peered":"2024-04-25T15:46:53.961476+0000","last_unstale":"2024-04-25T15:46:53.964207+0000","last_undegraded":"2024-04-25T15:46:53.964207+0000","last_fullsized":"2024-04-25T15:46:53.964207+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:16.471621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953959+0000","last_change":"2024-04-25T15:46:53.953959+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953959+0000","last_undegraded":"2024-04-25T15:46:53.953959+0000","last_fullsized":"2024-04-25T15:46:53.953959+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.945014+0000","last_change":"2024-04-25T15:46:52.945014+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.945014+0000","last_undegraded":"2024-04-25T15:46:52.945014+0000","last_fullsized":"2024-04-25T15:46:52.945014+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955655+0000","last_change":"2024-04-25T15:46:53.955655+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955655+0000","last_undegraded":"2024-04-25T15:46:53.955655+0000","last_fullsized":"2024-04-25T15:46:53.955655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.962836+0000","last_change":"2024-04-25T15:46:53.958121+0000","last_active":"2024-04-25T15:46:53.962836+0000","last_peered":"2024-04-25T15:46:53.962836+0000","last_clean":"2024-04-25T15:46:53.962836+0000","last_became_active":"2024-04-25T15:46:53.957362+0000","last_became_peered":"2024-04-25T15:46:53.957362+0000","last_unstale":"2024-04-25T15:46:53.962836+0000","last_undegraded":"2024-04-25T15:46:53.962836+0000","last_fullsized":"2024-04-25T15:46:53.962836+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:38.120803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956025+0000","last_change":"2024-04-25T15:46:53.956025+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956025+0000","last_undegraded":"2024-04-25T15:46:53.956025+0000","last_fullsized":"2024-04-25T15:46:53.956025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944750+0000","last_change":"2024-04-25T15:46:52.944750+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944750+0000","last_undegraded":"2024-04-25T15:46:52.944750+0000","last_fullsized":"2024-04-25T15:46:52.944750+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956486+0000","last_change":"2024-04-25T15:46:53.956486+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956486+0000","last_undegraded":"2024-04-25T15:46:53.956486+0000","last_fullsized":"2024-04-25T15:46:53.956486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.968857+0000","last_change":"2024-04-25T15:46:53.966347+0000","last_active":"2024-04-25T15:46:53.968857+0000","last_peered":"2024-04-25T15:46:53.968857+0000","last_clean":"2024-04-25T15:46:53.968857+0000","last_became_active":"2024-04-25T15:46:53.965444+0000","last_became_peered":"2024-04-25T15:46:53.965444+0000","last_unstale":"2024-04-25T15:46:53.968857+0000","last_undegraded":"2024-04-25T15:46:53.968857+0000","last_fullsized":"2024-04-25T15:46:53.968857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:02.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977474+0000","last_change":"2024-04-25T15:46:53.971700+0000","last_active":"2024-04-25T15:46:53.977474+0000","last_peered":"2024-04-25T15:46:53.977474+0000","last_clean":"2024-04-25T15:46:53.977474+0000","last_became_active":"2024-04-25T15:46:53.971408+0000","last_became_peered":"2024-04-25T15:46:53.971408+0000","last_unstale":"2024-04-25T15:46:53.977474+0000","last_undegraded":"2024-04-25T15:46:53.977474+0000","last_fullsized":"2024-04-25T15:46:53.977474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.966461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956302+0000","last_change":"2024-04-25T15:46:53.956302+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956302+0000","last_undegraded":"2024-04-25T15:46:53.956302+0000","last_fullsized":"2024-04-25T15:46:53.956302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969879+0000","last_change":"2024-04-25T15:46:53.966111+0000","last_active":"2024-04-25T15:46:53.969879+0000","last_peered":"2024-04-25T15:46:53.969879+0000","last_clean":"2024-04-25T15:46:53.969879+0000","last_became_active":"2024-04-25T15:46:53.965745+0000","last_became_peered":"2024-04-25T15:46:53.965745+0000","last_unstale":"2024-04-25T15:46:53.969879+0000","last_undegraded":"2024-04-25T15:46:53.969879+0000","last_fullsized":"2024-04-25T15:46:53.969879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.409398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960019+0000","last_change":"2024-04-25T15:46:53.960019+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960019+0000","last_undegraded":"2024-04-25T15:46:53.960019+0000","last_fullsized":"2024-04-25T15:46:53.960019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970072+0000","last_change":"2024-04-25T15:46:53.967519+0000","last_active":"2024-04-25T15:46:53.970072+0000","last_peered":"2024-04-25T15:46:53.970072+0000","last_clean":"2024-04-25T15:46:53.970072+0000","last_became_active":"2024-04-25T15:46:53.967161+0000","last_became_peered":"2024-04-25T15:46:53.967161+0000","last_unstale":"2024-04-25T15:46:53.970072+0000","last_undegraded":"2024-04-25T15:46:53.970072+0000","last_fullsized":"2024-04-25T15:46:53.970072+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.247123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954392+0000","last_change":"2024-04-25T15:46:53.954392+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954392+0000","last_undegraded":"2024-04-25T15:46:53.954392+0000","last_fullsized":"2024-04-25T15:46:53.954392+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944115+0000","last_change":"2024-04-25T15:46:52.944115+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944115+0000","last_undegraded":"2024-04-25T15:46:52.944115+0000","last_fullsized":"2024-04-25T15:46:52.944115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954978+0000","last_change":"2024-04-25T15:46:53.954978+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954978+0000","last_undegraded":"2024-04-25T15:46:53.954978+0000","last_fullsized":"2024-04-25T15:46:53.954978+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.973078+0000","last_change":"2024-04-25T15:46:53.972080+0000","last_active":"2024-04-25T15:46:53.973078+0000","last_peered":"2024-04-25T15:46:53.973078+0000","last_clean":"2024-04-25T15:46:53.973078+0000","last_became_active":"2024-04-25T15:46:53.971693+0000","last_became_peered":"2024-04-25T15:46:53.971693+0000","last_unstale":"2024-04-25T15:46:53.973078+0000","last_undegraded":"2024-04-25T15:46:53.973078+0000","last_fullsized":"2024-04-25T15:46:53.973078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:55.761865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955542+0000","last_change":"2024-04-25T15:46:53.955542+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955542+0000","last_undegraded":"2024-04-25T15:46:53.955542+0000","last_fullsized":"2024-04-25T15:46:53.955542+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944115+0000","last_change":"2024-04-25T15:46:52.944115+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944115+0000","last_undegraded":"2024-04-25T15:46:52.944115+0000","last_fullsized":"2024-04-25T15:46:52.944115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956944+0000","last_change":"2024-04-25T15:46:53.956944+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956944+0000","last_undegraded":"2024-04-25T15:46:53.956944+0000","last_fullsized":"2024-04-25T15:46:53.956944+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.947390+0000","last_change":"2024-04-25T15:46:52.947390+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.947390+0000","last_undegraded":"2024-04-25T15:46:52.947390+0000","last_fullsized":"2024-04-25T15:46:52.947390+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954838+0000","last_change":"2024-04-25T15:46:53.954838+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954838+0000","last_undegraded":"2024-04-25T15:46:53.954838+0000","last_fullsized":"2024-04-25T15:46:53.954838+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970187+0000","last_change":"2024-04-25T15:46:53.962212+0000","last_active":"2024-04-25T15:46:53.970187+0000","last_peered":"2024-04-25T15:46:53.970187+0000","last_clean":"2024-04-25T15:46:53.970187+0000","last_became_active":"2024-04-25T15:46:53.961142+0000","last_became_peered":"2024-04-25T15:46:53.961142+0000","last_unstale":"2024-04-25T15:46:53.970187+0000","last_undegraded":"2024-04-25T15:46:53.970187+0000","last_fullsized":"2024-04-25T15:46:53.970187+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:00:18.080583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957298+0000","last_change":"2024-04-25T15:46:53.957298+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957298+0000","last_undegraded":"2024-04-25T15:46:53.957298+0000","last_fullsized":"2024-04-25T15:46:53.957298+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975037+0000","last_change":"2024-04-25T15:46:53.970934+0000","last_active":"2024-04-25T15:46:53.975037+0000","last_peered":"2024-04-25T15:46:53.975037+0000","last_clean":"2024-04-25T15:46:53.975037+0000","last_became_active":"2024-04-25T15:46:53.970663+0000","last_became_peered":"2024-04-25T15:46:53.970663+0000","last_unstale":"2024-04-25T15:46:53.975037+0000","last_undegraded":"2024-04-25T15:46:53.975037+0000","last_fullsized":"2024-04-25T15:46:53.975037+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:06.603322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955713+0000","last_change":"2024-04-25T15:46:53.955713+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955713+0000","last_undegraded":"2024-04-25T15:46:53.955713+0000","last_fullsized":"2024-04-25T15:46:53.955713+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969036+0000","last_change":"2024-04-25T15:46:53.967992+0000","last_active":"2024-04-25T15:46:53.969036+0000","last_peered":"2024-04-25T15:46:53.969036+0000","last_clean":"2024-04-25T15:46:53.969036+0000","last_became_active":"2024-04-25T15:46:53.967078+0000","last_became_peered":"2024-04-25T15:46:53.967078+0000","last_unstale":"2024-04-25T15:46:53.969036+0000","last_undegraded":"2024-04-25T15:46:53.969036+0000","last_fullsized":"2024-04-25T15:46:53.969036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:47.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958741+0000","last_change":"2024-04-25T15:46:53.958741+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958741+0000","last_undegraded":"2024-04-25T15:46:53.958741+0000","last_fullsized":"2024-04-25T15:46:53.958741+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972206+0000","last_change":"2024-04-25T15:46:53.970573+0000","last_active":"2024-04-25T15:46:53.972206+0000","last_peered":"2024-04-25T15:46:53.972206+0000","last_clean":"2024-04-25T15:46:53.972206+0000","last_became_active":"2024-04-25T15:46:53.970245+0000","last_became_peered":"2024-04-25T15:46:53.970245+0000","last_unstale":"2024-04-25T15:46:53.972206+0000","last_undegraded":"2024-04-25T15:46:53.972206+0000","last_fullsized":"2024-04-25T15:46:53.972206+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:28:56.649496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955359+0000","last_change":"2024-04-25T15:46:53.955359+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955359+0000","last_undegraded":"2024-04-25T15:46:53.955359+0000","last_fullsized":"2024-04-25T15:46:53.955359+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.974853+0000","last_change":"2024-04-25T15:46:53.970973+0000","last_active":"2024-04-25T15:46:53.974853+0000","last_peered":"2024-04-25T15:46:53.974853+0000","last_clean":"2024-04-25T15:46:53.974853+0000","last_became_active":"2024-04-25T15:46:53.970675+0000","last_became_peered":"2024-04-25T15:46:53.970675+0000","last_unstale":"2024-04-25T15:46:53.974853+0000","last_undegraded":"2024-04-25T15:46:53.974853+0000","last_fullsized":"2024-04-25T15:46:53.974853+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:48.602358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970007+0000","last_change":"2024-04-25T15:46:53.964407+0000","last_active":"2024-04-25T15:46:53.970007+0000","last_peered":"2024-04-25T15:46:53.970007+0000","last_clean":"2024-04-25T15:46:53.970007+0000","last_became_active":"2024-04-25T15:46:53.963305+0000","last_became_peered":"2024-04-25T15:46:53.963305+0000","last_unstale":"2024-04-25T15:46:53.970007+0000","last_undegraded":"2024-04-25T15:46:53.970007+0000","last_fullsized":"2024-04-25T15:46:53.970007+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:09.432578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953887+0000","last_change":"2024-04-25T15:46:53.953887+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953887+0000","last_undegraded":"2024-04-25T15:46:53.953887+0000","last_fullsized":"2024-04-25T15:46:53.953887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972076+0000","last_change":"2024-04-25T15:46:53.970133+0000","last_active":"2024-04-25T15:46:53.972076+0000","last_peered":"2024-04-25T15:46:53.972076+0000","last_clean":"2024-04-25T15:46:53.972076+0000","last_became_active":"2024-04-25T15:46:53.969839+0000","last_became_peered":"2024-04-25T15:46:53.969839+0000","last_unstale":"2024-04-25T15:46:53.972076+0000","last_undegraded":"2024-04-25T15:46:53.972076+0000","last_fullsized":"2024-04-25T15:46:53.972076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:28.742784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969834+0000","last_change":"2024-04-25T15:46:53.968093+0000","last_active":"2024-04-25T15:46:53.969834+0000","last_peered":"2024-04-25T15:46:53.969834+0000","last_clean":"2024-04-25T15:46:53.969834+0000","last_became_active":"2024-04-25T15:46:53.967755+0000","last_became_peered":"2024-04-25T15:46:53.967755+0000","last_unstale":"2024-04-25T15:46:53.969834+0000","last_undegraded":"2024-04-25T15:46:53.969834+0000","last_fullsized":"2024-04-25T15:46:53.969834+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:30.543513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.954365+0000","last_change":"2024-04-25T15:46:53.954365+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.954365+0000","last_undegraded":"2024-04-25T15:46:53.954365+0000","last_fullsized":"2024-04-25T15:46:53.954365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-04-25T15:46:52.944135+0000","last_change":"2024-04-25T15:46:52.944135+0000","last_active":"2024-04-25T15:46:52.939535+0000","last_peered":"2024-04-25T15:46:52.939535+0000","last_clean":"2024-04-25T15:46:52.939535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:52.944135+0000","last_undegraded":"2024-04-25T15:46:52.944135+0000","last_fullsized":"2024-04-25T15:46:52.944135+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.953812+0000","last_change":"2024-04-25T15:46:53.953812+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.953812+0000","last_undegraded":"2024-04-25T15:46:53.953812+0000","last_fullsized":"2024-04-25T15:46:53.953812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970064+0000","last_change":"2024-04-25T15:46:53.968248+0000","last_active":"2024-04-25T15:46:53.970064+0000","last_peered":"2024-04-25T15:46:53.970064+0000","last_clean":"2024-04-25T15:46:53.970064+0000","last_became_active":"2024-04-25T15:46:53.967888+0000","last_became_peered":"2024-04-25T15:46:53.967888+0000","last_unstale":"2024-04-25T15:46:53.970064+0000","last_undegraded":"2024-04-25T15:46:53.970064+0000","last_fullsized":"2024-04-25T15:46:53.970064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:49.381207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.971887+0000","last_change":"2024-04-25T15:46:53.970313+0000","last_active":"2024-04-25T15:46:53.971887+0000","last_peered":"2024-04-25T15:46:53.971887+0000","last_clean":"2024-04-25T15:46:53.971887+0000","last_became_active":"2024-04-25T15:46:53.969993+0000","last_became_peered":"2024-04-25T15:46:53.969993+0000","last_unstale":"2024-04-25T15:46:53.971887+0000","last_undegraded":"2024-04-25T15:46:53.971887+0000","last_fullsized":"2024-04-25T15:46:53.971887+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:44.087600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.970107+0000","last_change":"2024-04-25T15:46:53.968009+0000","last_active":"2024-04-25T15:46:53.970107+0000","last_peered":"2024-04-25T15:46:53.970107+0000","last_clean":"2024-04-25T15:46:53.970107+0000","last_became_active":"2024-04-25T15:46:53.967723+0000","last_became_peered":"2024-04-25T15:46:53.967723+0000","last_unstale":"2024-04-25T15:46:53.970107+0000","last_undegraded":"2024-04-25T15:46:53.970107+0000","last_fullsized":"2024-04-25T15:46:53.970107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:50.693234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T15:46:53.941751+0000","last_change":"2024-04-25T15:46:53.941751+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.941751+0000","last_undegraded":"2024-04-25T15:46:53.941751+0000","last_fullsized":"2024-04-25T15:46:53.941751+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.975101+0000","last_change":"2024-04-25T15:46:53.971368+0000","last_active":"2024-04-25T15:46:53.975101+0000","last_peered":"2024-04-25T15:46:53.975101+0000","last_clean":"2024-04-25T15:46:53.975101+0000","last_became_active":"2024-04-25T15:46:53.970376+0000","last_became_peered":"2024-04-25T15:46:53.970376+0000","last_unstale":"2024-04-25T15:46:53.975101+0000","last_undegraded":"2024-04-25T15:46:53.975101+0000","last_fullsized":"2024-04-25T15:46:53.975101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.546642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":262,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T15:46:52.945545+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:52.945545+0000","last_peered":"2024-04-25T15:46:52.945545+0000","last_clean":"2024-04-25T15:46:52.945545+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:52.945545+0000","last_undegraded":"2024-04-25T15:46:52.945545+0000","last_fullsized":"2024-04-25T15:46:52.945545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":5},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":547395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1781760,"data_stored":1131096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":1124887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1175552,"data_stored":534519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1175552,"data_stored":534519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:58.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-04-25T15:46:58.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.959228+0000', 'last_change': '2024-04-25T15:46:53.959228+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.959228+0000', 'last_undegraded': '2024-04-25T15:46:53.959228+0000', 'last_fullsized': '2024-04-25T15:46:53.959228+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2024-04-25T15:46:58.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.960438+0000', 'last_change': '2024-04-25T15:46:53.960438+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.960438+0000', 'last_undegraded': '2024-04-25T15:46:53.960438+0000', 'last_fullsized': '2024-04-25T15:46:53.960438+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.959085+0000', 'last_change': '2024-04-25T15:46:53.959085+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.959085+0000', 'last_undegraded': '2024-04-25T15:46:53.959085+0000', 'last_fullsized': '2024-04-25T15:46:53.959085+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954568+0000', 'last_change': '2024-04-25T15:46:53.954568+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954568+0000', 'last_undegraded': '2024-04-25T15:46:53.954568+0000', 'last_fullsized': '2024-04-25T15:46:53.954568+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.957395+0000', 'last_change': '2024-04-25T15:46:53.957395+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.957395+0000', 'last_undegraded': '2024-04-25T15:46:53.957395+0000', 'last_fullsized': '2024-04-25T15:46:53.957395+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956986+0000', 'last_change': '2024-04-25T15:46:53.956986+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956986+0000', 'last_undegraded': '2024-04-25T15:46:53.956986+0000', 'last_fullsized': '2024-04-25T15:46:53.956986+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2024-04-25T15:46:58.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.958704+0000', 'last_change': '2024-04-25T15:46:53.958704+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.958704+0000', 'last_undegraded': '2024-04-25T15:46:53.958704+0000', 'last_fullsized': '2024-04-25T15:46:53.958704+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956330+0000', 'last_change': '2024-04-25T15:46:53.956330+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956330+0000', 'last_undegraded': '2024-04-25T15:46:53.956330+0000', 'last_fullsized': '2024-04-25T15:46:53.956330+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.957062+0000', 'last_change': '2024-04-25T15:46:53.957062+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.957062+0000', 'last_undegraded': '2024-04-25T15:46:53.957062+0000', 'last_fullsized': '2024-04-25T15:46:53.957062+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955717+0000', 'last_change': '2024-04-25T15:46:53.955717+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955717+0000', 'last_undegraded': '2024-04-25T15:46:53.955717+0000', 'last_fullsized': '2024-04-25T15:46:53.955717+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2024-04-25T15:46:58.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.953566+0000', 'last_change': '2024-04-25T15:46:53.953566+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.953566+0000', 'last_undegraded': '2024-04-25T15:46:53.953566+0000', 'last_fullsized': '2024-04-25T15:46:53.953566+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.958188+0000', 'last_change': '2024-04-25T15:46:53.958188+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.958188+0000', 'last_undegraded': '2024-04-25T15:46:53.958188+0000', 'last_fullsized': '2024-04-25T15:46:53.958188+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.959965+0000', 'last_change': '2024-04-25T15:46:53.959965+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.959965+0000', 'last_undegraded': '2024-04-25T15:46:53.959965+0000', 'last_fullsized': '2024-04-25T15:46:53.959965+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.957821+0000', 'last_change': '2024-04-25T15:46:53.957821+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.957821+0000', 'last_undegraded': '2024-04-25T15:46:53.957821+0000', 'last_fullsized': '2024-04-25T15:46:53.957821+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956585+0000', 'last_change': '2024-04-25T15:46:53.956585+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956585+0000', 'last_undegraded': '2024-04-25T15:46:53.956585+0000', 'last_fullsized': '2024-04-25T15:46:53.956585+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.957948+0000', 'last_change': '2024-04-25T15:46:53.957948+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.957948+0000', 'last_undegraded': '2024-04-25T15:46:53.957948+0000', 'last_fullsized': '2024-04-25T15:46:53.957948+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955880+0000', 'last_change': '2024-04-25T15:46:53.955880+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955880+0000', 'last_undegraded': '2024-04-25T15:46:53.955880+0000', 'last_fullsized': '2024-04-25T15:46:53.955880+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-04-25T15:46:58.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.957696+0000', 'last_change': '2024-04-25T15:46:53.957696+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.957696+0000', 'last_undegraded': '2024-04-25T15:46:53.957696+0000', 'last_fullsized': '2024-04-25T15:46:53.957696+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956806+0000', 'last_change': '2024-04-25T15:46:53.956806+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956806+0000', 'last_undegraded': '2024-04-25T15:46:53.956806+0000', 'last_fullsized': '2024-04-25T15:46:53.956806+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954309+0000', 'last_change': '2024-04-25T15:46:53.954309+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954309+0000', 'last_undegraded': '2024-04-25T15:46:53.954309+0000', 'last_fullsized': '2024-04-25T15:46:53.954309+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2024-04-25T15:46:58.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2024-04-25T15:46:58.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.958209+0000', 'last_change': '2024-04-25T15:46:53.958209+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.958209+0000', 'last_undegraded': '2024-04-25T15:46:53.958209+0000', 'last_fullsized': '2024-04-25T15:46:53.958209+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2024-04-25T15:46:58.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955442+0000', 'last_change': '2024-04-25T15:46:53.955442+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955442+0000', 'last_undegraded': '2024-04-25T15:46:53.955442+0000', 'last_fullsized': '2024-04-25T15:46:53.955442+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.953362+0000', 'last_change': '2024-04-25T15:46:53.953362+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.953362+0000', 'last_undegraded': '2024-04-25T15:46:53.953362+0000', 'last_fullsized': '2024-04-25T15:46:53.953362+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954970+0000', 'last_change': '2024-04-25T15:46:53.954970+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954970+0000', 'last_undegraded': '2024-04-25T15:46:53.954970+0000', 'last_fullsized': '2024-04-25T15:46:53.954970+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944139+0000', 'last_change': '2024-04-25T15:46:52.944139+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944139+0000', 'last_undegraded': '2024-04-25T15:46:52.944139+0000', 'last_fullsized': '2024-04-25T15:46:52.944139+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:46:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.953843+0000', 'last_change': '2024-04-25T15:46:53.953843+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.953843+0000', 'last_undegraded': '2024-04-25T15:46:53.953843+0000', 'last_fullsized': '2024-04-25T15:46:53.953843+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944121+0000', 'last_change': '2024-04-25T15:46:52.944121+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944121+0000', 'last_undegraded': '2024-04-25T15:46:52.944121+0000', 'last_fullsized': '2024-04-25T15:46:52.944121+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956833+0000', 'last_change': '2024-04-25T15:46:53.956833+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956833+0000', 'last_undegraded': '2024-04-25T15:46:53.956833+0000', 'last_fullsized': '2024-04-25T15:46:53.956833+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.947302+0000', 'last_change': '2024-04-25T15:46:52.947302+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.947302+0000', 'last_undegraded': '2024-04-25T15:46:52.947302+0000', 'last_fullsized': '2024-04-25T15:46:52.947302+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2024-04-25T15:46:58.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.959436+0000', 'last_change': '2024-04-25T15:46:53.959436+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.959436+0000', 'last_undegraded': '2024-04-25T15:46:53.959436+0000', 'last_fullsized': '2024-04-25T15:46:53.959436+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944669+0000', 'last_change': '2024-04-25T15:46:52.944669+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944669+0000', 'last_undegraded': '2024-04-25T15:46:52.944669+0000', 'last_fullsized': '2024-04-25T15:46:52.944669+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955246+0000', 'last_change': '2024-04-25T15:46:53.955246+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955246+0000', 'last_undegraded': '2024-04-25T15:46:53.955246+0000', 'last_fullsized': '2024-04-25T15:46:53.955246+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.953959+0000', 'last_change': '2024-04-25T15:46:53.953959+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.953959+0000', 'last_undegraded': '2024-04-25T15:46:53.953959+0000', 'last_fullsized': '2024-04-25T15:46:53.953959+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.945014+0000', 'last_change': '2024-04-25T15:46:52.945014+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.945014+0000', 'last_undegraded': '2024-04-25T15:46:52.945014+0000', 'last_fullsized': '2024-04-25T15:46:52.945014+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:46:58.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955655+0000', 'last_change': '2024-04-25T15:46:53.955655+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955655+0000', 'last_undegraded': '2024-04-25T15:46:53.955655+0000', 'last_fullsized': '2024-04-25T15:46:53.955655+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956025+0000', 'last_change': '2024-04-25T15:46:53.956025+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956025+0000', 'last_undegraded': '2024-04-25T15:46:53.956025+0000', 'last_fullsized': '2024-04-25T15:46:53.956025+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944750+0000', 'last_change': '2024-04-25T15:46:52.944750+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944750+0000', 'last_undegraded': '2024-04-25T15:46:52.944750+0000', 'last_fullsized': '2024-04-25T15:46:52.944750+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956486+0000', 'last_change': '2024-04-25T15:46:53.956486+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956486+0000', 'last_undegraded': '2024-04-25T15:46:53.956486+0000', 'last_fullsized': '2024-04-25T15:46:53.956486+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956302+0000', 'last_change': '2024-04-25T15:46:53.956302+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956302+0000', 'last_undegraded': '2024-04-25T15:46:53.956302+0000', 'last_fullsized': '2024-04-25T15:46:53.956302+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.960019+0000', 'last_change': '2024-04-25T15:46:53.960019+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.960019+0000', 'last_undegraded': '2024-04-25T15:46:53.960019+0000', 'last_fullsized': '2024-04-25T15:46:53.960019+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954392+0000', 'last_change': '2024-04-25T15:46:53.954392+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954392+0000', 'last_undegraded': '2024-04-25T15:46:53.954392+0000', 'last_fullsized': '2024-04-25T15:46:53.954392+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944115+0000', 'last_change': '2024-04-25T15:46:52.944115+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944115+0000', 'last_undegraded': '2024-04-25T15:46:52.944115+0000', 'last_fullsized': '2024-04-25T15:46:52.944115+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:46:58.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954978+0000', 'last_change': '2024-04-25T15:46:53.954978+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954978+0000', 'last_undegraded': '2024-04-25T15:46:53.954978+0000', 'last_fullsized': '2024-04-25T15:46:53.954978+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955542+0000', 'last_change': '2024-04-25T15:46:53.955542+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955542+0000', 'last_undegraded': '2024-04-25T15:46:53.955542+0000', 'last_fullsized': '2024-04-25T15:46:53.955542+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944115+0000', 'last_change': '2024-04-25T15:46:52.944115+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944115+0000', 'last_undegraded': '2024-04-25T15:46:52.944115+0000', 'last_fullsized': '2024-04-25T15:46:52.944115+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.956944+0000', 'last_change': '2024-04-25T15:46:53.956944+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.956944+0000', 'last_undegraded': '2024-04-25T15:46:53.956944+0000', 'last_fullsized': '2024-04-25T15:46:53.956944+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.947390+0000', 'last_change': '2024-04-25T15:46:52.947390+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.947390+0000', 'last_undegraded': '2024-04-25T15:46:52.947390+0000', 'last_fullsized': '2024-04-25T15:46:52.947390+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T15:46:58.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954838+0000', 'last_change': '2024-04-25T15:46:53.954838+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954838+0000', 'last_undegraded': '2024-04-25T15:46:53.954838+0000', 'last_fullsized': '2024-04-25T15:46:53.954838+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.957298+0000', 'last_change': '2024-04-25T15:46:53.957298+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.957298+0000', 'last_undegraded': '2024-04-25T15:46:53.957298+0000', 'last_fullsized': '2024-04-25T15:46:53.957298+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955713+0000', 'last_change': '2024-04-25T15:46:53.955713+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955713+0000', 'last_undegraded': '2024-04-25T15:46:53.955713+0000', 'last_fullsized': '2024-04-25T15:46:53.955713+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.958741+0000', 'last_change': '2024-04-25T15:46:53.958741+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.958741+0000', 'last_undegraded': '2024-04-25T15:46:53.958741+0000', 'last_fullsized': '2024-04-25T15:46:53.958741+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.955359+0000', 'last_change': '2024-04-25T15:46:53.955359+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.955359+0000', 'last_undegraded': '2024-04-25T15:46:53.955359+0000', 'last_fullsized': '2024-04-25T15:46:53.955359+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2024-04-25T15:46:58.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.953887+0000', 'last_change': '2024-04-25T15:46:53.953887+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.953887+0000', 'last_undegraded': '2024-04-25T15:46:53.953887+0000', 'last_fullsized': '2024-04-25T15:46:53.953887+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.954365+0000', 'last_change': '2024-04-25T15:46:53.954365+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.954365+0000', 'last_undegraded': '2024-04-25T15:46:53.954365+0000', 'last_fullsized': '2024-04-25T15:46:53.954365+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:52.944135+0000', 'last_change': '2024-04-25T15:46:52.944135+0000', 'last_active': '2024-04-25T15:46:52.939535+0000', 'last_peered': '2024-04-25T15:46:52.939535+0000', 'last_clean': '2024-04-25T15:46:52.939535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:52.944135+0000', 'last_undegraded': '2024-04-25T15:46:52.944135+0000', 'last_fullsized': '2024-04-25T15:46:52.944135+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:52.939535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-25T15:46:53.953812+0000', 'last_change': '2024-04-25T15:46:53.953812+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.953812+0000', 'last_undegraded': '2024-04-25T15:46:53.953812+0000', 'last_fullsized': '2024-04-25T15:46:53.953812+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T15:46:58.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2024-04-25T15:46:58.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2024-04-25T15:46:58.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2024-04-25T15:46:58.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T15:46:53.941751+0000', 'last_change': '2024-04-25T15:46:53.941751+0000', 'last_active': '2024-04-25T15:46:53.941751+0000', 'last_peered': '2024-04-25T15:46:53.941751+0000', 'last_clean': '2024-04-25T15:46:53.941751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T15:46:53.941751+0000', 'last_undegraded': '2024-04-25T15:46:53.941751+0000', 'last_fullsized': '2024-04-25T15:46:53.941751+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'last_clean_scrub_stamp': '2024-04-25T15:46:53.941751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T15:46:58.689 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T15:46:58.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.816+0000 7f4ffe59d640 1 Processor -- start 2024-04-25T15:46:58.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.816+0000 7f4ffe59d640 1 -- start start 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffe59d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 0x7f4ff815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffe59d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff8164b20 con 0x7f4ff8163bc0 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffe59d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff8164840 con 0x7f4ff80b7480 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffe59d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff8160da0 con 0x7f4ff8161230 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffdd9c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4ff8163bc0 0x7f4ff8163fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43766/0 (socket says 172.21.15.80:43766) 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/257046454 learned_addr learned my addr 172.21.15.80:0/257046454 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932085142 0 0) 0x7f4ff8164b20 con 0x7f4ff8163bc0 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4ffd59b640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 0x7f4ff815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe4003520 con 0x7f4ff8163bc0 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2632396525 0 0) 0x7f4fe4003520 con 0x7f4ff8163bc0 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 msgr2=0x7f4ff815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 0x7f4ff815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 >> v1:172.21.15.195:6789/0 conn(0x7f4ff80b7480 legacy=0x7f4ff80b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff8160750 con 0x7f4ff8163bc0 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f4ff0001670 con 0x7f4ff8163bc0 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 >> v1:172.21.15.80:6789/0 conn(0x7f4ff8163bc0 legacy=0x7f4ff8163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.818+0000 7f4feffff640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 0x7f4fe40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4feffff640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fe4003f60 0x7f4fe4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4feffff640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe4004d40 0x7f4fe4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8160da0 con 0x7f4fe4004d40 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe400bb50 con 0x7f4fe4003f60 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe400bd50 con 0x7f4ff8161230 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe4004d40 0x7f4fe4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffd59b640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 0x7f4fe40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffcd9a640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fe4003f60 0x7f4fe4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 msgr2=0x7f4fe40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff8161230 0x7f4fe40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fe4003f60 msgr2=0x7f4fe4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fe4003f60 0x7f4fe4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.819+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/257046454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe4003520 con 0x7f4fe4004d40 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe4004d40 0x7f4fe4005150 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c240 tx=0x7f4fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb10b612400f03d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0007cf0 con 0x7f4fe4004d40 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff00058d0 con 0x7f4fe4004d40 2024-04-25T15:46:58.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4feffff640 1 -- 172.21.15.80:0/257046454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0005ce0 con 0x7f4fe4004d40 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4ffe59d640 1 -- 172.21.15.80:0/257046454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe4004d40 msgr2=0x7f4fe4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/257046454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe4004d40 0x7f4fe4005150 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c240 tx=0x7f4fe4005830 comp rx=0 tx=0).stop 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/257046454 reap_dead start 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4ffe59d640 1 -- 172.21.15.80:0/257046454 shutdown_connections 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.820+0000 7f4ffe59d640 1 -- 172.21.15.80:0/257046454 >> 172.21.15.80:0/257046454 conn(0x7f4ff80d2480 msgr2=0x7f4ff80d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.821+0000 7f4ffe59d640 1 -- 172.21.15.80:0/257046454 shutdown_connections 2024-04-25T15:46:58.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.821+0000 7f4ffe59d640 1 -- 172.21.15.80:0/257046454 wait complete. 2024-04-25T15:46:58.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.822+0000 7f4ffe59d640 1 Processor -- start 2024-04-25T15:46:58.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.822+0000 7f4ffe59d640 1 -- start start 2024-04-25T15:46:58.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff80b6770 0x7f4ff80b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ff80ba4f0 0x7f4ff8149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 0x7f4ff80ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff815dd70 con 0x7f4ff814a460 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff815dbf0 con 0x7f4ff80ba4f0 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff815def0 con 0x7f4ff80b6770 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 0x7f4ff80ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 0x7f4ff80ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33990/0 (socket says 172.21.15.80:33990) 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/247575403 learned_addr learned my addr 172.21.15.80:0/247575403 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffcd9a640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ff80ba4f0 0x7f4ff8149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffd59b640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff80b6770 0x7f4ff80b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff80b6770 msgr2=0x7f4ff80b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff80b6770 0x7f4ff80b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ff80ba4f0 msgr2=0x7f4ff8149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ff80ba4f0 0x7f4ff8149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 -- 172.21.15.80:0/247575403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff80ba900 con 0x7f4ff814a460 2024-04-25T15:46:58.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffdd9c640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 0x7f4ff80ac3e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f4ff002adf0 tx=0x7f4ff8160d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0038040 con 0x7f4ff814a460 2024-04-25T15:46:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0041070 con 0x7f4ff814a460 2024-04-25T15:46:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff814ac80 con 0x7f4ff814a460 2024-04-25T15:46:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.824+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0007cf0 con 0x7f4ff814a460 2024-04-25T15:46:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.825+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff814b240 con 0x7f4ff814a460 2024-04-25T15:46:58.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.825+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff8164500 con 0x7f4ff814a460 2024-04-25T15:46:58.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.826+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ff0004a20 con 0x7f4ff814a460 2024-04-25T15:46:58.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.826+0000 7f4fedffb640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fdc0744b0 0x7f4fdc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.827+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f4ff00b4df0 con 0x7f4ff814a460 2024-04-25T15:46:58.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.827+0000 7f4ffd59b640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fdc0744b0 0x7f4fdc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.827+0000 7f4ffd59b640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fdc0744b0 0x7f4fdc0769c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80ad600 tx=0x7f4ff400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:58.831+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ff8164500 con 0x7f4ff814a460 2024-04-25T15:46:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.080+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4ff8069c50 con 0x7f4ff814a460 2024-04-25T15:46:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.081+0000 7f4fedffb640 1 -- 172.21.15.80:0/247575403 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1529 (secure 0 0 0) 0x7f4ff009ee20 con 0x7f4ff814a460 2024-04-25T15:46:59.082 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:59.082 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":262,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714059768,"num_in_osds":8,"osd_in_since":1714059759,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":56},{"state_name":"active+clean","count":23},{"state_name":"unknown","count":18}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":257593344,"bytes_avail":772836519936,"bytes_total":773094113280,"unknown_pgs_ratio":0.18556700646877289,"inactive_pgs_ratio":0.57731956243515015},"fsmap":{"epoch":52,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7548}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-25T15:46:09.036418+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fdc0744b0 msgr2=0x7f4fdc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fdc0744b0 0x7f4fdc0769c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80ad600 tx=0x7f4ff400b040 comp rx=0 tx=0).stop 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 msgr2=0x7f4ff80ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 0x7f4ff80ac3e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f4ff002adf0 tx=0x7f4ff8160d10 comp rx=0 tx=0).stop 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 shutdown_connections 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4fdc0744b0 0x7f4fdc0769c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff814a460 0x7f4ff80ac3e0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ff80ba4f0 0x7f4ff8149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 --2- 172.21.15.80:0/247575403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ff80b6770 0x7f4ff80b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 >> 172.21.15.80:0/247575403 conn(0x7f4ff80d2480 msgr2=0x7f4ff8163320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 shutdown_connections 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.083+0000 7f4ffe59d640 1 -- 172.21.15.80:0/247575403 wait complete. 2024-04-25T15:46:59.095 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T15:46:59.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.202+0000 7fb8a2ed8640 1 Processor -- start 2024-04-25T15:46:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.202+0000 7fb8a2ed8640 1 -- start start 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a2ed8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb89c0d41b0 0x7fb89c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a2ed8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c0b7d60 0x7fb89c0d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a2ed8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89c163fb0 con 0x7fb89c1602a0 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a2ed8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb89c164270 con 0x7fb89c0d41b0 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a2ed8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb89c164550 con 0x7fb89c0b7d60 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb89c0d41b0 0x7fb89c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb89c0d41b0 0x7fb89c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33996/0 (socket says 172.21.15.80:33996) 2024-04-25T15:46:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 -- 172.21.15.80:0/306557585 learned_addr learned my addr 172.21.15.80:0/306557585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 -- 172.21.15.80:0/306557585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c0b7d60 msgr2=0x7fb89c0d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 --2- 172.21.15.80:0/306557585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c0b7d60 0x7fb89c0d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 -- 172.21.15.80:0/306557585 >> v1:172.21.15.195:6789/0 conn(0x7fb89c1602a0 legacy=0x7fb89c0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.203+0000 7fb8a0c74640 1 -- 172.21.15.80:0/306557585 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c164830 con 0x7fb89c0d41b0 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.204+0000 7fb8a0c74640 1 --2- 172.21.15.80:0/306557585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0b48d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009870 tx=0x7fb88c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8d8dc75a796851 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.204+0000 7fb89b7fe640 1 -- 172.21.15.80:0/306557585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c037070 con 0x7fb89c0d41b0 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.204+0000 7fb89b7fe640 1 -- 172.21.15.80:0/306557585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88c032440 con 0x7fb89c0d41b0 2024-04-25T15:46:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.204+0000 7fb89b7fe640 1 -- 172.21.15.80:0/306557585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c032810 con 0x7fb89c0d41b0 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/306557585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c0d41b0 msgr2=0x7fb89c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/306557585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0b48d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009870 tx=0x7fb88c02a210 comp rx=0 tx=0).stop 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/306557585 shutdown_connections 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/306557585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c0b7d60 0x7fb89c0d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/306557585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0b48d0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/306557585 >> 172.21.15.80:0/306557585 conn(0x7fb89c06e9f0 msgr2=0x7fb89c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/306557585 shutdown_connections 2024-04-25T15:46:59.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.205+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/306557585 wait complete. 2024-04-25T15:46:59.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.207+0000 7fb8a2ed8640 1 Processor -- start 2024-04-25T15:46:59.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.207+0000 7fb8a2ed8640 1 -- start start 2024-04-25T15:46:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a2ed8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a2ed8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c1602a0 0x7fb89c162f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a2ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 0x7fb89c1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a2ed8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c0b5150 con 0x7fb89c15bbf0 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a2ed8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c0b4fd0 con 0x7fb89c0d41b0 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a2ed8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb89c0b9220 con 0x7fb89c1602a0 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a1475640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 0x7fb89c1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a1475640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 0x7fb89c1f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34012/0 (socket says 172.21.15.80:34012) 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.208+0000 7fb8a1475640 1 -- 172.21.15.80:0/2591544128 learned_addr learned my addr 172.21.15.80:0/2591544128 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a0c74640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb89bfff640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c1602a0 0x7fb89c162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a1475640 1 -- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c1602a0 msgr2=0x7fb89c162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a1475640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c1602a0 0x7fb89c162f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a1475640 1 -- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb89c0d41b0 msgr2=0x7fb89c0ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a1475640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a1475640 1 -- 172.21.15.80:0/2591544128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c161ee0 con 0x7fb89c15bbf0 2024-04-25T15:46:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a1475640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 0x7fb89c1f64e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb89400b970 tx=0x7fb89400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894019070 con 0x7fb89c15bbf0 2024-04-25T15:46:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89400cb60 con 0x7fb89c15bbf0 2024-04-25T15:46:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89c1621c0 con 0x7fb89c15bbf0 2024-04-25T15:46:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894014440 con 0x7fb89c15bbf0 2024-04-25T15:46:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.209+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89c162780 con 0x7fb89c15bbf0 2024-04-25T15:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.210+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89c06a100 con 0x7fb89c15bbf0 2024-04-25T15:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.211+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb89401c070 con 0x7fb89c15bbf0 2024-04-25T15:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.211+0000 7fb8997fa640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8880744b0 0x7fb8880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.211+0000 7fb8a0c74640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8880744b0 0x7fb8880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.211+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fb894095080 con 0x7fb89c15bbf0 2024-04-25T15:46:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.212+0000 7fb8a0c74640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8880744b0 0x7fb8880769c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb88c034000 tx=0x7fb88c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.216+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb89405f030 con 0x7fb89c15bbf0 2024-04-25T15:46:59.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.388+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb89c0b54f0 con 0x7fb8880744b0 2024-04-25T15:46:59.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.394+0000 7fb8997fa640 1 -- 172.21.15.80:0/2591544128 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250659 (secure 0 0 0) 0x7fb89c0b54f0 con 0x7fb8880744b0 2024-04-25T15:46:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:46:59.402 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:46:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8880744b0 msgr2=0x7fb8880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8880744b0 0x7fb8880769c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb88c034000 tx=0x7fb88c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 msgr2=0x7fb89c1f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 0x7fb89c1f64e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb89400b970 tx=0x7fb89400be30 comp rx=0 tx=0).stop 2024-04-25T15:46:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 shutdown_connections 2024-04-25T15:46:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb8880744b0 0x7fb8880769c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb89c15bbf0 0x7fb89c1f64e0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb89c1602a0 0x7fb89c162f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 --2- 172.21.15.80:0/2591544128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb89c0d41b0 0x7fb89c0ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 >> 172.21.15.80:0/2591544128 conn(0x7fb89c06e9f0 msgr2=0x7fb89c0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:59.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 shutdown_connections 2024-04-25T15:46:59.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:46:59.397+0000 7fb8a2ed8640 1 -- 172.21.15.80:0/2591544128 wait complete. 2024-04-25T15:46:59.410 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-25T15:46:59.046207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":130,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255996,"kb_used_data":10708,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718724,"statfs":{"total":773094113280,"available":772831973376,"internally_reserved":0,"allocated":10964992,"data_stored":5638953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001150"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957978+0000","last_change":"2024-04-25T15:46:54.980574+0000","last_active":"2024-04-25T15:46:56.957978+0000","last_peered":"2024-04-25T15:46:56.957978+0000","last_clean":"2024-04-25T15:46:56.957978+0000","last_became_active":"2024-04-25T15:46:54.980265+0000","last_became_peered":"2024-04-25T15:46:54.980265+0000","last_unstale":"2024-04-25T15:46:56.957978+0000","last_undegraded":"2024-04-25T15:46:56.957978+0000","last_fullsized":"2024-04-25T15:46:56.957978+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:44.847993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.960438+0000","last_change":"2024-04-25T15:46:53.960438+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.960438+0000","last_undegraded":"2024-04-25T15:46:53.960438+0000","last_fullsized":"2024-04-25T15:46:53.960438+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957871+0000","last_change":"2024-04-25T15:46:54.979283+0000","last_active":"2024-04-25T15:46:56.957871+0000","last_peered":"2024-04-25T15:46:56.957871+0000","last_clean":"2024-04-25T15:46:56.957871+0000","last_became_active":"2024-04-25T15:46:54.974843+0000","last_became_peered":"2024-04-25T15:46:54.974843+0000","last_unstale":"2024-04-25T15:46:56.957871+0000","last_undegraded":"2024-04-25T15:46:56.957871+0000","last_fullsized":"2024-04-25T15:46:56.957871+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:43.491133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051093+0000","last_change":"2024-04-25T15:46:54.970774+0000","last_active":"2024-04-25T15:46:57.051093+0000","last_peered":"2024-04-25T15:46:57.051093+0000","last_clean":"2024-04-25T15:46:57.051093+0000","last_became_active":"2024-04-25T15:46:54.970452+0000","last_became_peered":"2024-04-25T15:46:54.970452+0000","last_unstale":"2024-04-25T15:46:57.051093+0000","last_undegraded":"2024-04-25T15:46:57.051093+0000","last_fullsized":"2024-04-25T15:46:57.051093+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:50.778973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957395+0000","last_change":"2024-04-25T15:46:53.957395+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957395+0000","last_undegraded":"2024-04-25T15:46:53.957395+0000","last_fullsized":"2024-04-25T15:46:53.957395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956986+0000","last_change":"2024-04-25T15:46:53.956986+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956986+0000","last_undegraded":"2024-04-25T15:46:53.956986+0000","last_fullsized":"2024-04-25T15:46:53.956986+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958704+0000","last_change":"2024-04-25T15:46:53.958704+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958704+0000","last_undegraded":"2024-04-25T15:46:53.958704+0000","last_fullsized":"2024-04-25T15:46:53.958704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052368+0000","last_change":"2024-04-25T15:46:54.987005+0000","last_active":"2024-04-25T15:46:57.052368+0000","last_peered":"2024-04-25T15:46:57.052368+0000","last_clean":"2024-04-25T15:46:57.052368+0000","last_became_active":"2024-04-25T15:46:54.986705+0000","last_became_peered":"2024-04-25T15:46:54.986705+0000","last_unstale":"2024-04-25T15:46:57.052368+0000","last_undegraded":"2024-04-25T15:46:57.052368+0000","last_fullsized":"2024-04-25T15:46:57.052368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:05.427951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957062+0000","last_change":"2024-04-25T15:46:53.957062+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957062+0000","last_undegraded":"2024-04-25T15:46:53.957062+0000","last_fullsized":"2024-04-25T15:46:53.957062+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955717+0000","last_change":"2024-04-25T15:46:53.955717+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955717+0000","last_undegraded":"2024-04-25T15:46:53.955717+0000","last_fullsized":"2024-04-25T15:46:53.955717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956559+0000","last_change":"2024-04-25T15:46:54.973659+0000","last_active":"2024-04-25T15:46:55.956559+0000","last_peered":"2024-04-25T15:46:55.956559+0000","last_clean":"2024-04-25T15:46:55.956559+0000","last_became_active":"2024-04-25T15:46:54.973341+0000","last_became_peered":"2024-04-25T15:46:54.973341+0000","last_unstale":"2024-04-25T15:46:55.956559+0000","last_undegraded":"2024-04-25T15:46:55.956559+0000","last_fullsized":"2024-04-25T15:46:55.956559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:50.778973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955080+0000","last_change":"2024-04-25T15:46:54.978870+0000","last_active":"2024-04-25T15:46:55.955080+0000","last_peered":"2024-04-25T15:46:55.955080+0000","last_clean":"2024-04-25T15:46:55.955080+0000","last_became_active":"2024-04-25T15:46:54.977851+0000","last_became_peered":"2024-04-25T15:46:54.977851+0000","last_unstale":"2024-04-25T15:46:55.955080+0000","last_undegraded":"2024-04-25T15:46:55.955080+0000","last_fullsized":"2024-04-25T15:46:55.955080+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:53.929716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051584+0000","last_change":"2024-04-25T15:46:54.973740+0000","last_active":"2024-04-25T15:46:57.051584+0000","last_peered":"2024-04-25T15:46:57.051584+0000","last_clean":"2024-04-25T15:46:57.051584+0000","last_became_active":"2024-04-25T15:46:54.973433+0000","last_became_peered":"2024-04-25T15:46:54.973433+0000","last_unstale":"2024-04-25T15:46:57.051584+0000","last_undegraded":"2024-04-25T15:46:57.051584+0000","last_fullsized":"2024-04-25T15:46:57.051584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:51.266720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954164+0000","last_change":"2024-04-25T15:46:54.957479+0000","last_active":"2024-04-25T15:46:55.954164+0000","last_peered":"2024-04-25T15:46:55.954164+0000","last_clean":"2024-04-25T15:46:55.954164+0000","last_became_active":"2024-04-25T15:46:54.957096+0000","last_became_peered":"2024-04-25T15:46:54.957096+0000","last_unstale":"2024-04-25T15:46:55.954164+0000","last_undegraded":"2024-04-25T15:46:55.954164+0000","last_fullsized":"2024-04-25T15:46:55.954164+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:44.785532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953896+0000","last_change":"2024-04-25T15:46:54.964232+0000","last_active":"2024-04-25T15:46:55.953896+0000","last_peered":"2024-04-25T15:46:55.953896+0000","last_clean":"2024-04-25T15:46:55.953896+0000","last_became_active":"2024-04-25T15:46:54.963905+0000","last_became_peered":"2024-04-25T15:46:54.963905+0000","last_unstale":"2024-04-25T15:46:55.953896+0000","last_undegraded":"2024-04-25T15:46:55.953896+0000","last_fullsized":"2024-04-25T15:46:55.953896+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:47.419426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953897+0000","last_change":"2024-04-25T15:46:54.978006+0000","last_active":"2024-04-25T15:46:55.953897+0000","last_peered":"2024-04-25T15:46:55.953897+0000","last_clean":"2024-04-25T15:46:55.953897+0000","last_became_active":"2024-04-25T15:46:54.977665+0000","last_became_peered":"2024-04-25T15:46:54.977665+0000","last_unstale":"2024-04-25T15:46:55.953897+0000","last_undegraded":"2024-04-25T15:46:55.953897+0000","last_fullsized":"2024-04-25T15:46:55.953897+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:24.360593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958156+0000","last_change":"2024-04-25T15:46:54.974607+0000","last_active":"2024-04-25T15:46:56.958156+0000","last_peered":"2024-04-25T15:46:56.958156+0000","last_clean":"2024-04-25T15:46:56.958156+0000","last_became_active":"2024-04-25T15:46:54.974123+0000","last_became_peered":"2024-04-25T15:46:54.974123+0000","last_unstale":"2024-04-25T15:46:56.958156+0000","last_undegraded":"2024-04-25T15:46:56.958156+0000","last_fullsized":"2024-04-25T15:46:56.958156+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:32.434773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959965+0000","last_change":"2024-04-25T15:46:53.959965+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959965+0000","last_undegraded":"2024-04-25T15:46:53.959965+0000","last_fullsized":"2024-04-25T15:46:53.959965+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957910+0000","last_change":"2024-04-25T15:46:54.975132+0000","last_active":"2024-04-25T15:46:56.957910+0000","last_peered":"2024-04-25T15:46:56.957910+0000","last_clean":"2024-04-25T15:46:56.957910+0000","last_became_active":"2024-04-25T15:46:54.974708+0000","last_became_peered":"2024-04-25T15:46:54.974708+0000","last_unstale":"2024-04-25T15:46:56.957910+0000","last_undegraded":"2024-04-25T15:46:56.957910+0000","last_fullsized":"2024-04-25T15:46:56.957910+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:34.588584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955259+0000","last_change":"2024-04-25T15:46:54.967954+0000","last_active":"2024-04-25T15:46:55.955259+0000","last_peered":"2024-04-25T15:46:55.955259+0000","last_clean":"2024-04-25T15:46:55.955259+0000","last_became_active":"2024-04-25T15:46:54.967431+0000","last_became_peered":"2024-04-25T15:46:54.967431+0000","last_unstale":"2024-04-25T15:46:55.955259+0000","last_undegraded":"2024-04-25T15:46:55.955259+0000","last_fullsized":"2024-04-25T15:46:55.955259+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:45.884108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052146+0000","last_change":"2024-04-25T15:46:54.983907+0000","last_active":"2024-04-25T15:46:57.052146+0000","last_peered":"2024-04-25T15:46:57.052146+0000","last_clean":"2024-04-25T15:46:57.052146+0000","last_became_active":"2024-04-25T15:46:54.983222+0000","last_became_peered":"2024-04-25T15:46:54.983222+0000","last_unstale":"2024-04-25T15:46:57.052146+0000","last_undegraded":"2024-04-25T15:46:57.052146+0000","last_fullsized":"2024-04-25T15:46:57.052146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:54.120384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957948+0000","last_change":"2024-04-25T15:46:53.957948+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957948+0000","last_undegraded":"2024-04-25T15:46:53.957948+0000","last_fullsized":"2024-04-25T15:46:53.957948+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957772+0000","last_change":"2024-04-25T15:46:54.976750+0000","last_active":"2024-04-25T15:46:56.957772+0000","last_peered":"2024-04-25T15:46:56.957772+0000","last_clean":"2024-04-25T15:46:56.957772+0000","last_became_active":"2024-04-25T15:46:54.976423+0000","last_became_peered":"2024-04-25T15:46:54.976423+0000","last_unstale":"2024-04-25T15:46:56.957772+0000","last_undegraded":"2024-04-25T15:46:56.957772+0000","last_fullsized":"2024-04-25T15:46:56.957772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:37.751382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.957696+0000","last_change":"2024-04-25T15:46:53.957696+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.957696+0000","last_undegraded":"2024-04-25T15:46:53.957696+0000","last_fullsized":"2024-04-25T15:46:53.957696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954967+0000","last_change":"2024-04-25T15:46:54.973842+0000","last_active":"2024-04-25T15:46:55.954967+0000","last_peered":"2024-04-25T15:46:55.954967+0000","last_clean":"2024-04-25T15:46:55.954967+0000","last_became_active":"2024-04-25T15:46:54.973526+0000","last_became_peered":"2024-04-25T15:46:54.973526+0000","last_unstale":"2024-04-25T15:46:55.954967+0000","last_undegraded":"2024-04-25T15:46:55.954967+0000","last_fullsized":"2024-04-25T15:46:55.954967+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:10.080858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954503+0000","last_change":"2024-04-25T15:46:54.974254+0000","last_active":"2024-04-25T15:46:55.954503+0000","last_peered":"2024-04-25T15:46:55.954503+0000","last_clean":"2024-04-25T15:46:55.954503+0000","last_became_active":"2024-04-25T15:46:54.973923+0000","last_became_peered":"2024-04-25T15:46:54.973923+0000","last_unstale":"2024-04-25T15:46:55.954503+0000","last_undegraded":"2024-04-25T15:46:55.954503+0000","last_fullsized":"2024-04-25T15:46:55.954503+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:13.034972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956590+0000","last_change":"2024-04-25T15:46:54.971410+0000","last_active":"2024-04-25T15:46:55.956590+0000","last_peered":"2024-04-25T15:46:55.956590+0000","last_clean":"2024-04-25T15:46:55.956590+0000","last_became_active":"2024-04-25T15:46:54.970947+0000","last_became_peered":"2024-04-25T15:46:54.970947+0000","last_unstale":"2024-04-25T15:46:55.956590+0000","last_undegraded":"2024-04-25T15:46:55.956590+0000","last_fullsized":"2024-04-25T15:46:55.956590+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:55.298631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956806+0000","last_change":"2024-04-25T15:46:53.956806+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956806+0000","last_undegraded":"2024-04-25T15:46:53.956806+0000","last_fullsized":"2024-04-25T15:46:53.956806+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052315+0000","last_change":"2024-04-25T15:46:54.975914+0000","last_active":"2024-04-25T15:46:57.052315+0000","last_peered":"2024-04-25T15:46:57.052315+0000","last_clean":"2024-04-25T15:46:57.052315+0000","last_became_active":"2024-04-25T15:46:54.975536+0000","last_became_peered":"2024-04-25T15:46:54.975536+0000","last_unstale":"2024-04-25T15:46:57.052315+0000","last_undegraded":"2024-04-25T15:46:57.052315+0000","last_fullsized":"2024-04-25T15:46:57.052315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.749186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954911+0000","last_change":"2024-04-25T15:46:54.966197+0000","last_active":"2024-04-25T15:46:55.954911+0000","last_peered":"2024-04-25T15:46:55.954911+0000","last_clean":"2024-04-25T15:46:55.954911+0000","last_became_active":"2024-04-25T15:46:54.965894+0000","last_became_peered":"2024-04-25T15:46:54.965894+0000","last_unstale":"2024-04-25T15:46:55.954911+0000","last_undegraded":"2024-04-25T15:46:55.954911+0000","last_fullsized":"2024-04-25T15:46:55.954911+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:59.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.958209+0000","last_change":"2024-04-25T15:46:53.958209+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.958209+0000","last_undegraded":"2024-04-25T15:46:53.958209+0000","last_fullsized":"2024-04-25T15:46:53.958209+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052633+0000","last_change":"2024-04-25T15:46:54.976723+0000","last_active":"2024-04-25T15:46:57.052633+0000","last_peered":"2024-04-25T15:46:57.052633+0000","last_clean":"2024-04-25T15:46:57.052633+0000","last_became_active":"2024-04-25T15:46:54.976444+0000","last_became_peered":"2024-04-25T15:46:54.976444+0000","last_unstale":"2024-04-25T15:46:57.052633+0000","last_undegraded":"2024-04-25T15:46:57.052633+0000","last_fullsized":"2024-04-25T15:46:57.052633+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:48.546288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957891+0000","last_change":"2024-04-25T15:46:54.981397+0000","last_active":"2024-04-25T15:46:56.957891+0000","last_peered":"2024-04-25T15:46:56.957891+0000","last_clean":"2024-04-25T15:46:56.957891+0000","last_became_active":"2024-04-25T15:46:54.981084+0000","last_became_peered":"2024-04-25T15:46:54.981084+0000","last_unstale":"2024-04-25T15:46:56.957891+0000","last_undegraded":"2024-04-25T15:46:56.957891+0000","last_fullsized":"2024-04-25T15:46:56.957891+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:33.105533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"98'4","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051413+0000","last_change":"2024-04-25T15:46:53.968876+0000","last_active":"2024-04-25T15:46:57.051413+0000","last_peered":"2024-04-25T15:46:57.051413+0000","last_clean":"2024-04-25T15:46:57.051413+0000","last_became_active":"2024-04-25T15:46:53.968481+0000","last_became_peered":"2024-04-25T15:46:53.968481+0000","last_unstale":"2024-04-25T15:46:57.051413+0000","last_undegraded":"2024-04-25T15:46:57.051413+0000","last_fullsized":"2024-04-25T15:46:57.051413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:12.032756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052058+0000","last_change":"2024-04-25T15:46:54.987359+0000","last_active":"2024-04-25T15:46:57.052058+0000","last_peered":"2024-04-25T15:46:57.052058+0000","last_clean":"2024-04-25T15:46:57.052058+0000","last_became_active":"2024-04-25T15:46:54.986659+0000","last_became_peered":"2024-04-25T15:46:54.986659+0000","last_unstale":"2024-04-25T15:46:57.052058+0000","last_undegraded":"2024-04-25T15:46:57.052058+0000","last_fullsized":"2024-04-25T15:46:57.052058+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:54.272616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052550+0000","last_change":"2024-04-25T15:46:53.971080+0000","last_active":"2024-04-25T15:46:57.052550+0000","last_peered":"2024-04-25T15:46:57.052550+0000","last_clean":"2024-04-25T15:46:57.052550+0000","last_became_active":"2024-04-25T15:46:53.969706+0000","last_became_peered":"2024-04-25T15:46:53.969706+0000","last_unstale":"2024-04-25T15:46:57.052550+0000","last_undegraded":"2024-04-25T15:46:57.052550+0000","last_fullsized":"2024-04-25T15:46:57.052550+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:01.157348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955012+0000","last_change":"2024-04-25T15:46:54.972683+0000","last_active":"2024-04-25T15:46:55.955012+0000","last_peered":"2024-04-25T15:46:55.955012+0000","last_clean":"2024-04-25T15:46:55.955012+0000","last_became_active":"2024-04-25T15:46:54.972382+0000","last_became_peered":"2024-04-25T15:46:54.972382+0000","last_unstale":"2024-04-25T15:46:55.955012+0000","last_undegraded":"2024-04-25T15:46:55.955012+0000","last_fullsized":"2024-04-25T15:46:55.955012+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:22.259894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953977+0000","last_change":"2024-04-25T15:46:53.963095+0000","last_active":"2024-04-25T15:46:55.953977+0000","last_peered":"2024-04-25T15:46:55.953977+0000","last_clean":"2024-04-25T15:46:55.953977+0000","last_became_active":"2024-04-25T15:46:53.962643+0000","last_became_peered":"2024-04-25T15:46:53.962643+0000","last_unstale":"2024-04-25T15:46:55.953977+0000","last_undegraded":"2024-04-25T15:46:55.953977+0000","last_fullsized":"2024-04-25T15:46:55.953977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:42.217667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956443+0000","last_change":"2024-04-25T15:46:54.976829+0000","last_active":"2024-04-25T15:46:55.956443+0000","last_peered":"2024-04-25T15:46:55.956443+0000","last_clean":"2024-04-25T15:46:55.956443+0000","last_became_active":"2024-04-25T15:46:54.973021+0000","last_became_peered":"2024-04-25T15:46:54.973021+0000","last_unstale":"2024-04-25T15:46:55.956443+0000","last_undegraded":"2024-04-25T15:46:55.956443+0000","last_fullsized":"2024-04-25T15:46:55.956443+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:23.488086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977481+0000","last_change":"2024-04-25T15:46:53.971918+0000","last_active":"2024-04-25T15:46:53.977481+0000","last_peered":"2024-04-25T15:46:53.977481+0000","last_clean":"2024-04-25T15:46:53.977481+0000","last_became_active":"2024-04-25T15:46:53.971592+0000","last_became_peered":"2024-04-25T15:46:53.971592+0000","last_unstale":"2024-04-25T15:46:53.977481+0000","last_undegraded":"2024-04-25T15:46:53.977481+0000","last_fullsized":"2024-04-25T15:46:53.977481+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:24.750079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051143+0000","last_change":"2024-04-25T15:46:54.968707+0000","last_active":"2024-04-25T15:46:57.051143+0000","last_peered":"2024-04-25T15:46:57.051143+0000","last_clean":"2024-04-25T15:46:57.051143+0000","last_became_active":"2024-04-25T15:46:54.967824+0000","last_became_peered":"2024-04-25T15:46:54.967824+0000","last_unstale":"2024-04-25T15:46:57.051143+0000","last_undegraded":"2024-04-25T15:46:57.051143+0000","last_fullsized":"2024-04-25T15:46:57.051143+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:55.298631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954276+0000","last_change":"2024-04-25T15:46:53.962220+0000","last_active":"2024-04-25T15:46:55.954276+0000","last_peered":"2024-04-25T15:46:55.954276+0000","last_clean":"2024-04-25T15:46:55.954276+0000","last_became_active":"2024-04-25T15:46:53.961874+0000","last_became_peered":"2024-04-25T15:46:53.961874+0000","last_unstale":"2024-04-25T15:46:55.954276+0000","last_undegraded":"2024-04-25T15:46:55.954276+0000","last_fullsized":"2024-04-25T15:46:55.954276+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:08.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958112+0000","last_change":"2024-04-25T15:46:54.975002+0000","last_active":"2024-04-25T15:46:56.958112+0000","last_peered":"2024-04-25T15:46:56.958112+0000","last_clean":"2024-04-25T15:46:56.958112+0000","last_became_active":"2024-04-25T15:46:54.974325+0000","last_became_peered":"2024-04-25T15:46:54.974325+0000","last_unstale":"2024-04-25T15:46:56.958112+0000","last_undegraded":"2024-04-25T15:46:56.958112+0000","last_fullsized":"2024-04-25T15:46:56.958112+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:13.805726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956247+0000","last_change":"2024-04-25T15:46:53.969406+0000","last_active":"2024-04-25T15:46:55.956247+0000","last_peered":"2024-04-25T15:46:55.956247+0000","last_clean":"2024-04-25T15:46:55.956247+0000","last_became_active":"2024-04-25T15:46:53.969043+0000","last_became_peered":"2024-04-25T15:46:53.969043+0000","last_unstale":"2024-04-25T15:46:55.956247+0000","last_undegraded":"2024-04-25T15:46:55.956247+0000","last_fullsized":"2024-04-25T15:46:55.956247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:16.471621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.959436+0000","last_change":"2024-04-25T15:46:53.959436+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.959436+0000","last_undegraded":"2024-04-25T15:46:53.959436+0000","last_fullsized":"2024-04-25T15:46:53.959436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954253+0000","last_change":"2024-04-25T15:46:53.963444+0000","last_active":"2024-04-25T15:46:55.954253+0000","last_peered":"2024-04-25T15:46:55.954253+0000","last_clean":"2024-04-25T15:46:55.954253+0000","last_became_active":"2024-04-25T15:46:53.963083+0000","last_became_peered":"2024-04-25T15:46:53.963083+0000","last_unstale":"2024-04-25T15:46:55.954253+0000","last_undegraded":"2024-04-25T15:46:55.954253+0000","last_fullsized":"2024-04-25T15:46:55.954253+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:07.701961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051325+0000","last_change":"2024-04-25T15:46:54.972914+0000","last_active":"2024-04-25T15:46:57.051325+0000","last_peered":"2024-04-25T15:46:57.051325+0000","last_clean":"2024-04-25T15:46:57.051325+0000","last_became_active":"2024-04-25T15:46:54.972274+0000","last_became_peered":"2024-04-25T15:46:54.972274+0000","last_unstale":"2024-04-25T15:46:57.051325+0000","last_undegraded":"2024-04-25T15:46:57.051325+0000","last_fullsized":"2024-04-25T15:46:57.051325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:33.158913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.050999+0000","last_change":"2024-04-25T15:46:53.961775+0000","last_active":"2024-04-25T15:46:57.050999+0000","last_peered":"2024-04-25T15:46:57.050999+0000","last_clean":"2024-04-25T15:46:57.050999+0000","last_became_active":"2024-04-25T15:46:53.961476+0000","last_became_peered":"2024-04-25T15:46:53.961476+0000","last_unstale":"2024-04-25T15:46:57.050999+0000","last_undegraded":"2024-04-25T15:46:57.050999+0000","last_fullsized":"2024-04-25T15:46:57.050999+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:09.078642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957685+0000","last_change":"2024-04-25T15:46:54.977161+0000","last_active":"2024-04-25T15:46:56.957685+0000","last_peered":"2024-04-25T15:46:56.957685+0000","last_clean":"2024-04-25T15:46:56.957685+0000","last_became_active":"2024-04-25T15:46:54.976181+0000","last_became_peered":"2024-04-25T15:46:54.976181+0000","last_unstale":"2024-04-25T15:46:56.957685+0000","last_undegraded":"2024-04-25T15:46:56.957685+0000","last_fullsized":"2024-04-25T15:46:56.957685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:34.941086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955036+0000","last_change":"2024-04-25T15:46:53.969932+0000","last_active":"2024-04-25T15:46:55.955036+0000","last_peered":"2024-04-25T15:46:55.955036+0000","last_clean":"2024-04-25T15:46:55.955036+0000","last_became_active":"2024-04-25T15:46:53.968144+0000","last_became_peered":"2024-04-25T15:46:53.968144+0000","last_unstale":"2024-04-25T15:46:55.955036+0000","last_undegraded":"2024-04-25T15:46:55.955036+0000","last_fullsized":"2024-04-25T15:46:55.955036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:15.954902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955655+0000","last_change":"2024-04-25T15:46:53.955655+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955655+0000","last_undegraded":"2024-04-25T15:46:53.955655+0000","last_fullsized":"2024-04-25T15:46:53.955655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957900+0000","last_change":"2024-04-25T15:46:53.958121+0000","last_active":"2024-04-25T15:46:56.957900+0000","last_peered":"2024-04-25T15:46:56.957900+0000","last_clean":"2024-04-25T15:46:56.957900+0000","last_became_active":"2024-04-25T15:46:53.957362+0000","last_became_peered":"2024-04-25T15:46:53.957362+0000","last_unstale":"2024-04-25T15:46:56.957900+0000","last_undegraded":"2024-04-25T15:46:56.957900+0000","last_fullsized":"2024-04-25T15:46:56.957900+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:25.183333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052405+0000","last_change":"2024-04-25T15:46:54.984284+0000","last_active":"2024-04-25T15:46:57.052405+0000","last_peered":"2024-04-25T15:46:57.052405+0000","last_clean":"2024-04-25T15:46:57.052405+0000","last_became_active":"2024-04-25T15:46:54.983419+0000","last_became_peered":"2024-04-25T15:46:54.983419+0000","last_unstale":"2024-04-25T15:46:57.052405+0000","last_undegraded":"2024-04-25T15:46:57.052405+0000","last_fullsized":"2024-04-25T15:46:57.052405+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:49.502885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"98'3","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955100+0000","last_change":"2024-04-25T15:46:53.965265+0000","last_active":"2024-04-25T15:46:55.955100+0000","last_peered":"2024-04-25T15:46:55.955100+0000","last_clean":"2024-04-25T15:46:55.955100+0000","last_became_active":"2024-04-25T15:46:53.964903+0000","last_became_peered":"2024-04-25T15:46:53.964903+0000","last_unstale":"2024-04-25T15:46:55.955100+0000","last_undegraded":"2024-04-25T15:46:55.955100+0000","last_fullsized":"2024-04-25T15:46:55.955100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:54.296414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956486+0000","last_change":"2024-04-25T15:46:53.956486+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956486+0000","last_undegraded":"2024-04-25T15:46:53.956486+0000","last_fullsized":"2024-04-25T15:46:53.956486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.968857+0000","last_change":"2024-04-25T15:46:53.966347+0000","last_active":"2024-04-25T15:46:53.968857+0000","last_peered":"2024-04-25T15:46:53.968857+0000","last_clean":"2024-04-25T15:46:53.968857+0000","last_became_active":"2024-04-25T15:46:53.965444+0000","last_became_peered":"2024-04-25T15:46:53.965444+0000","last_unstale":"2024-04-25T15:46:53.968857+0000","last_undegraded":"2024-04-25T15:46:53.968857+0000","last_fullsized":"2024-04-25T15:46:53.968857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:02.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956497+0000","last_change":"2024-04-25T15:46:54.978887+0000","last_active":"2024-04-25T15:46:55.956497+0000","last_peered":"2024-04-25T15:46:55.956497+0000","last_clean":"2024-04-25T15:46:55.956497+0000","last_became_active":"2024-04-25T15:46:54.974606+0000","last_became_peered":"2024-04-25T15:46:54.974606+0000","last_unstale":"2024-04-25T15:46:55.956497+0000","last_undegraded":"2024-04-25T15:46:55.956497+0000","last_fullsized":"2024-04-25T15:46:55.956497+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:09.070782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.977474+0000","last_change":"2024-04-25T15:46:53.971700+0000","last_active":"2024-04-25T15:46:53.977474+0000","last_peered":"2024-04-25T15:46:53.977474+0000","last_clean":"2024-04-25T15:46:53.977474+0000","last_became_active":"2024-04-25T15:46:53.971408+0000","last_became_peered":"2024-04-25T15:46:53.971408+0000","last_unstale":"2024-04-25T15:46:53.977474+0000","last_undegraded":"2024-04-25T15:46:53.977474+0000","last_fullsized":"2024-04-25T15:46:53.977474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.966461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956302+0000","last_change":"2024-04-25T15:46:53.956302+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956302+0000","last_undegraded":"2024-04-25T15:46:53.956302+0000","last_fullsized":"2024-04-25T15:46:53.956302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051420+0000","last_change":"2024-04-25T15:46:53.966111+0000","last_active":"2024-04-25T15:46:57.051420+0000","last_peered":"2024-04-25T15:46:57.051420+0000","last_clean":"2024-04-25T15:46:57.051420+0000","last_became_active":"2024-04-25T15:46:53.965745+0000","last_became_peered":"2024-04-25T15:46:53.965745+0000","last_unstale":"2024-04-25T15:46:57.051420+0000","last_undegraded":"2024-04-25T15:46:57.051420+0000","last_fullsized":"2024-04-25T15:46:57.051420+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:58.322963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052544+0000","last_change":"2024-04-25T15:46:54.975951+0000","last_active":"2024-04-25T15:46:57.052544+0000","last_peered":"2024-04-25T15:46:57.052544+0000","last_clean":"2024-04-25T15:46:57.052544+0000","last_became_active":"2024-04-25T15:46:54.975625+0000","last_became_peered":"2024-04-25T15:46:54.975625+0000","last_unstale":"2024-04-25T15:46:57.052544+0000","last_undegraded":"2024-04-25T15:46:57.052544+0000","last_fullsized":"2024-04-25T15:46:57.052544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:09.137893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052163+0000","last_change":"2024-04-25T15:46:53.967519+0000","last_active":"2024-04-25T15:46:57.052163+0000","last_peered":"2024-04-25T15:46:57.052163+0000","last_clean":"2024-04-25T15:46:57.052163+0000","last_became_active":"2024-04-25T15:46:53.967161+0000","last_became_peered":"2024-04-25T15:46:53.967161+0000","last_unstale":"2024-04-25T15:46:57.052163+0000","last_undegraded":"2024-04-25T15:46:57.052163+0000","last_fullsized":"2024-04-25T15:46:57.052163+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:53.620527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958152+0000","last_change":"2024-04-25T15:46:54.974454+0000","last_active":"2024-04-25T15:46:56.958152+0000","last_peered":"2024-04-25T15:46:56.958152+0000","last_clean":"2024-04-25T15:46:56.958152+0000","last_became_active":"2024-04-25T15:46:54.973671+0000","last_became_peered":"2024-04-25T15:46:54.973671+0000","last_unstale":"2024-04-25T15:46:56.958152+0000","last_undegraded":"2024-04-25T15:46:56.958152+0000","last_fullsized":"2024-04-25T15:46:56.958152+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:42.172962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"98'8","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953897+0000","last_change":"2024-04-25T15:46:53.970231+0000","last_active":"2024-04-25T15:46:55.953897+0000","last_peered":"2024-04-25T15:46:55.953897+0000","last_clean":"2024-04-25T15:46:55.953897+0000","last_became_active":"2024-04-25T15:46:53.969940+0000","last_became_peered":"2024-04-25T15:46:53.969940+0000","last_unstale":"2024-04-25T15:46:55.953897+0000","last_undegraded":"2024-04-25T15:46:55.953897+0000","last_fullsized":"2024-04-25T15:46:55.953897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:55.926922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052651+0000","last_change":"2024-04-25T15:46:54.983942+0000","last_active":"2024-04-25T15:46:57.052651+0000","last_peered":"2024-04-25T15:46:57.052651+0000","last_clean":"2024-04-25T15:46:57.052651+0000","last_became_active":"2024-04-25T15:46:54.983625+0000","last_became_peered":"2024-04-25T15:46:54.983625+0000","last_unstale":"2024-04-25T15:46:57.052651+0000","last_undegraded":"2024-04-25T15:46:57.052651+0000","last_fullsized":"2024-04-25T15:46:57.052651+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:29.745001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.973078+0000","last_change":"2024-04-25T15:46:53.972080+0000","last_active":"2024-04-25T15:46:53.973078+0000","last_peered":"2024-04-25T15:46:53.973078+0000","last_clean":"2024-04-25T15:46:53.973078+0000","last_became_active":"2024-04-25T15:46:53.971693+0000","last_became_peered":"2024-04-25T15:46:53.971693+0000","last_unstale":"2024-04-25T15:46:53.973078+0000","last_undegraded":"2024-04-25T15:46:53.973078+0000","last_fullsized":"2024-04-25T15:46:53.973078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:55.761865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.955542+0000","last_change":"2024-04-25T15:46:53.955542+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.955542+0000","last_undegraded":"2024-04-25T15:46:53.955542+0000","last_fullsized":"2024-04-25T15:46:53.955542+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955219+0000","last_change":"2024-04-25T15:46:53.964498+0000","last_active":"2024-04-25T15:46:55.955219+0000","last_peered":"2024-04-25T15:46:55.955219+0000","last_clean":"2024-04-25T15:46:55.955219+0000","last_became_active":"2024-04-25T15:46:53.964129+0000","last_became_peered":"2024-04-25T15:46:53.964129+0000","last_unstale":"2024-04-25T15:46:55.955219+0000","last_undegraded":"2024-04-25T15:46:55.955219+0000","last_fullsized":"2024-04-25T15:46:55.955219+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:49.776757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-25T15:46:53.956944+0000","last_change":"2024-04-25T15:46:53.956944+0000","last_active":"2024-04-25T15:46:53.941751+0000","last_peered":"2024-04-25T15:46:53.941751+0000","last_clean":"2024-04-25T15:46:53.941751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T15:46:53.956944+0000","last_undegraded":"2024-04-25T15:46:53.956944+0000","last_fullsized":"2024-04-25T15:46:53.956944+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956368+0000","last_change":"2024-04-25T15:46:53.968256+0000","last_active":"2024-04-25T15:46:55.956368+0000","last_peered":"2024-04-25T15:46:55.956368+0000","last_clean":"2024-04-25T15:46:55.956368+0000","last_became_active":"2024-04-25T15:46:53.967940+0000","last_became_peered":"2024-04-25T15:46:53.967940+0000","last_unstale":"2024-04-25T15:46:55.956368+0000","last_undegraded":"2024-04-25T15:46:55.956368+0000","last_fullsized":"2024-04-25T15:46:55.956368+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.409398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957766+0000","last_change":"2024-04-25T15:46:54.979011+0000","last_active":"2024-04-25T15:46:56.957766+0000","last_peered":"2024-04-25T15:46:56.957766+0000","last_clean":"2024-04-25T15:46:56.957766+0000","last_became_active":"2024-04-25T15:46:54.978705+0000","last_became_peered":"2024-04-25T15:46:54.978705+0000","last_unstale":"2024-04-25T15:46:56.957766+0000","last_undegraded":"2024-04-25T15:46:56.957766+0000","last_fullsized":"2024-04-25T15:46:56.957766+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:17.976522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052414+0000","last_change":"2024-04-25T15:46:53.962212+0000","last_active":"2024-04-25T15:46:57.052414+0000","last_peered":"2024-04-25T15:46:57.052414+0000","last_clean":"2024-04-25T15:46:57.052414+0000","last_became_active":"2024-04-25T15:46:53.961142+0000","last_became_peered":"2024-04-25T15:46:53.961142+0000","last_unstale":"2024-04-25T15:46:57.052414+0000","last_undegraded":"2024-04-25T15:46:57.052414+0000","last_fullsized":"2024-04-25T15:46:57.052414+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:54.740263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958031+0000","last_change":"2024-04-25T15:46:54.986140+0000","last_active":"2024-04-25T15:46:56.958031+0000","last_peered":"2024-04-25T15:46:56.958031+0000","last_clean":"2024-04-25T15:46:56.958031+0000","last_became_active":"2024-04-25T15:46:54.984925+0000","last_became_peered":"2024-04-25T15:46:54.984925+0000","last_unstale":"2024-04-25T15:46:56.958031+0000","last_undegraded":"2024-04-25T15:46:56.958031+0000","last_fullsized":"2024-04-25T15:46:56.958031+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:44.578380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052248+0000","last_change":"2024-04-25T15:46:53.970934+0000","last_active":"2024-04-25T15:46:57.052248+0000","last_peered":"2024-04-25T15:46:57.052248+0000","last_clean":"2024-04-25T15:46:57.052248+0000","last_became_active":"2024-04-25T15:46:53.970663+0000","last_became_peered":"2024-04-25T15:46:53.970663+0000","last_unstale":"2024-04-25T15:46:57.052248+0000","last_undegraded":"2024-04-25T15:46:57.052248+0000","last_fullsized":"2024-04-25T15:46:57.052248+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:57.454313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051985+0000","last_change":"2024-04-25T15:46:54.973613+0000","last_active":"2024-04-25T15:46:57.051985+0000","last_peered":"2024-04-25T15:46:57.051985+0000","last_clean":"2024-04-25T15:46:57.051985+0000","last_became_active":"2024-04-25T15:46:54.973286+0000","last_became_peered":"2024-04-25T15:46:54.973286+0000","last_unstale":"2024-04-25T15:46:57.051985+0000","last_undegraded":"2024-04-25T15:46:57.051985+0000","last_fullsized":"2024-04-25T15:46:57.051985+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:41.798144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969036+0000","last_change":"2024-04-25T15:46:53.967992+0000","last_active":"2024-04-25T15:46:53.969036+0000","last_peered":"2024-04-25T15:46:53.969036+0000","last_clean":"2024-04-25T15:46:53.969036+0000","last_became_active":"2024-04-25T15:46:53.967078+0000","last_became_peered":"2024-04-25T15:46:53.967078+0000","last_unstale":"2024-04-25T15:46:53.969036+0000","last_undegraded":"2024-04-25T15:46:53.969036+0000","last_fullsized":"2024-04-25T15:46:53.969036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:47.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052618+0000","last_change":"2024-04-25T15:46:54.985610+0000","last_active":"2024-04-25T15:46:57.052618+0000","last_peered":"2024-04-25T15:46:57.052618+0000","last_clean":"2024-04-25T15:46:57.052618+0000","last_became_active":"2024-04-25T15:46:54.985132+0000","last_became_peered":"2024-04-25T15:46:54.985132+0000","last_unstale":"2024-04-25T15:46:57.052618+0000","last_undegraded":"2024-04-25T15:46:57.052618+0000","last_fullsized":"2024-04-25T15:46:57.052618+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:03.166672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052746+0000","last_change":"2024-04-25T15:46:53.970573+0000","last_active":"2024-04-25T15:46:57.052746+0000","last_peered":"2024-04-25T15:46:57.052746+0000","last_clean":"2024-04-25T15:46:57.052746+0000","last_became_active":"2024-04-25T15:46:53.970245+0000","last_became_peered":"2024-04-25T15:46:53.970245+0000","last_unstale":"2024-04-25T15:46:57.052746+0000","last_undegraded":"2024-04-25T15:46:57.052746+0000","last_fullsized":"2024-04-25T15:46:57.052746+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:41.292568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957687+0000","last_change":"2024-04-25T15:46:54.983548+0000","last_active":"2024-04-25T15:46:56.957687+0000","last_peered":"2024-04-25T15:46:56.957687+0000","last_clean":"2024-04-25T15:46:56.957687+0000","last_became_active":"2024-04-25T15:46:54.983257+0000","last_became_peered":"2024-04-25T15:46:54.983257+0000","last_unstale":"2024-04-25T15:46:56.957687+0000","last_undegraded":"2024-04-25T15:46:56.957687+0000","last_fullsized":"2024-04-25T15:46:56.957687+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:13.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.974853+0000","last_change":"2024-04-25T15:46:53.970973+0000","last_active":"2024-04-25T15:46:53.974853+0000","last_peered":"2024-04-25T15:46:53.974853+0000","last_clean":"2024-04-25T15:46:53.974853+0000","last_became_active":"2024-04-25T15:46:53.970675+0000","last_became_peered":"2024-04-25T15:46:53.970675+0000","last_unstale":"2024-04-25T15:46:53.974853+0000","last_undegraded":"2024-04-25T15:46:53.974853+0000","last_fullsized":"2024-04-25T15:46:53.974853+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:48.602358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954182+0000","last_change":"2024-04-25T15:46:54.965465+0000","last_active":"2024-04-25T15:46:55.954182+0000","last_peered":"2024-04-25T15:46:55.954182+0000","last_clean":"2024-04-25T15:46:55.954182+0000","last_became_active":"2024-04-25T15:46:54.965161+0000","last_became_peered":"2024-04-25T15:46:54.965161+0000","last_unstale":"2024-04-25T15:46:55.954182+0000","last_undegraded":"2024-04-25T15:46:55.954182+0000","last_fullsized":"2024-04-25T15:46:55.954182+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:54.884697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"99'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958226+0000","last_change":"2024-04-25T15:46:53.964407+0000","last_active":"2024-04-25T15:46:56.958226+0000","last_peered":"2024-04-25T15:46:56.958226+0000","last_clean":"2024-04-25T15:46:56.958226+0000","last_became_active":"2024-04-25T15:46:53.963305+0000","last_became_peered":"2024-04-25T15:46:53.963305+0000","last_unstale":"2024-04-25T15:46:56.958226+0000","last_undegraded":"2024-04-25T15:46:56.958226+0000","last_fullsized":"2024-04-25T15:46:56.958226+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:20.840036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051321+0000","last_change":"2024-04-25T15:46:54.972801+0000","last_active":"2024-04-25T15:46:57.051321+0000","last_peered":"2024-04-25T15:46:57.051321+0000","last_clean":"2024-04-25T15:46:57.051321+0000","last_became_active":"2024-04-25T15:46:54.972492+0000","last_became_peered":"2024-04-25T15:46:54.972492+0000","last_unstale":"2024-04-25T15:46:57.051321+0000","last_undegraded":"2024-04-25T15:46:57.051321+0000","last_fullsized":"2024-04-25T15:46:57.051321+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:05.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.972076+0000","last_change":"2024-04-25T15:46:53.970133+0000","last_active":"2024-04-25T15:46:53.972076+0000","last_peered":"2024-04-25T15:46:53.972076+0000","last_clean":"2024-04-25T15:46:53.972076+0000","last_became_active":"2024-04-25T15:46:53.969839+0000","last_became_peered":"2024-04-25T15:46:53.969839+0000","last_unstale":"2024-04-25T15:46:53.972076+0000","last_undegraded":"2024-04-25T15:46:53.972076+0000","last_fullsized":"2024-04-25T15:46:53.972076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:28.742784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956382+0000","last_change":"2024-04-25T15:46:54.970275+0000","last_active":"2024-04-25T15:46:55.956382+0000","last_peered":"2024-04-25T15:46:55.956382+0000","last_clean":"2024-04-25T15:46:55.956382+0000","last_became_active":"2024-04-25T15:46:54.969945+0000","last_became_peered":"2024-04-25T15:46:54.969945+0000","last_unstale":"2024-04-25T15:46:55.956382+0000","last_undegraded":"2024-04-25T15:46:55.956382+0000","last_fullsized":"2024-04-25T15:46:55.956382+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:56.752047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.969834+0000","last_change":"2024-04-25T15:46:53.968093+0000","last_active":"2024-04-25T15:46:53.969834+0000","last_peered":"2024-04-25T15:46:53.969834+0000","last_clean":"2024-04-25T15:46:53.969834+0000","last_became_active":"2024-04-25T15:46:53.967755+0000","last_became_peered":"2024-04-25T15:46:53.967755+0000","last_unstale":"2024-04-25T15:46:53.969834+0000","last_undegraded":"2024-04-25T15:46:53.969834+0000","last_fullsized":"2024-04-25T15:46:53.969834+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:30.543513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052334+0000","last_change":"2024-04-25T15:46:54.985029+0000","last_active":"2024-04-25T15:46:57.052334+0000","last_peered":"2024-04-25T15:46:57.052334+0000","last_clean":"2024-04-25T15:46:57.052334+0000","last_became_active":"2024-04-25T15:46:54.983866+0000","last_became_peered":"2024-04-25T15:46:54.983866+0000","last_unstale":"2024-04-25T15:46:57.052334+0000","last_undegraded":"2024-04-25T15:46:57.052334+0000","last_fullsized":"2024-04-25T15:46:57.052334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:19.413664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954617+0000","last_change":"2024-04-25T15:46:53.967678+0000","last_active":"2024-04-25T15:46:55.954617+0000","last_peered":"2024-04-25T15:46:55.954617+0000","last_clean":"2024-04-25T15:46:55.954617+0000","last_became_active":"2024-04-25T15:46:53.964635+0000","last_became_peered":"2024-04-25T15:46:53.964635+0000","last_unstale":"2024-04-25T15:46:55.954617+0000","last_undegraded":"2024-04-25T15:46:55.954617+0000","last_fullsized":"2024-04-25T15:46:55.954617+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:34.339553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052523+0000","last_change":"2024-04-25T15:46:54.984298+0000","last_active":"2024-04-25T15:46:57.052523+0000","last_peered":"2024-04-25T15:46:57.052523+0000","last_clean":"2024-04-25T15:46:57.052523+0000","last_became_active":"2024-04-25T15:46:54.983965+0000","last_became_peered":"2024-04-25T15:46:54.983965+0000","last_unstale":"2024-04-25T15:46:57.052523+0000","last_undegraded":"2024-04-25T15:46:57.052523+0000","last_fullsized":"2024-04-25T15:46:57.052523+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:15.855336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052412+0000","last_change":"2024-04-25T15:46:53.968248+0000","last_active":"2024-04-25T15:46:57.052412+0000","last_peered":"2024-04-25T15:46:57.052412+0000","last_clean":"2024-04-25T15:46:57.052412+0000","last_became_active":"2024-04-25T15:46:53.967888+0000","last_became_peered":"2024-04-25T15:46:53.967888+0000","last_unstale":"2024-04-25T15:46:57.052412+0000","last_undegraded":"2024-04-25T15:46:57.052412+0000","last_fullsized":"2024-04-25T15:46:57.052412+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:44.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954917+0000","last_change":"2024-04-25T15:46:54.965208+0000","last_active":"2024-04-25T15:46:55.954917+0000","last_peered":"2024-04-25T15:46:55.954917+0000","last_clean":"2024-04-25T15:46:55.954917+0000","last_became_active":"2024-04-25T15:46:54.964892+0000","last_became_peered":"2024-04-25T15:46:54.964892+0000","last_unstale":"2024-04-25T15:46:55.954917+0000","last_undegraded":"2024-04-25T15:46:55.954917+0000","last_fullsized":"2024-04-25T15:46:55.954917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:39.123019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T15:46:53.971887+0000","last_change":"2024-04-25T15:46:53.970313+0000","last_active":"2024-04-25T15:46:53.971887+0000","last_peered":"2024-04-25T15:46:53.971887+0000","last_clean":"2024-04-25T15:46:53.971887+0000","last_became_active":"2024-04-25T15:46:53.969993+0000","last_became_peered":"2024-04-25T15:46:53.969993+0000","last_unstale":"2024-04-25T15:46:53.971887+0000","last_undegraded":"2024-04-25T15:46:53.971887+0000","last_fullsized":"2024-04-25T15:46:53.971887+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:44.087600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956713+0000","last_change":"2024-04-25T15:46:54.970442+0000","last_active":"2024-04-25T15:46:55.956713+0000","last_peered":"2024-04-25T15:46:55.956713+0000","last_clean":"2024-04-25T15:46:55.956713+0000","last_became_active":"2024-04-25T15:46:54.970148+0000","last_became_peered":"2024-04-25T15:46:54.970148+0000","last_unstale":"2024-04-25T15:46:55.956713+0000","last_undegraded":"2024-04-25T15:46:55.956713+0000","last_fullsized":"2024-04-25T15:46:55.956713+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:05.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052755+0000","last_change":"2024-04-25T15:46:53.968009+0000","last_active":"2024-04-25T15:46:57.052755+0000","last_peered":"2024-04-25T15:46:57.052755+0000","last_clean":"2024-04-25T15:46:57.052755+0000","last_became_active":"2024-04-25T15:46:53.967723+0000","last_became_peered":"2024-04-25T15:46:53.967723+0000","last_unstale":"2024-04-25T15:46:57.052755+0000","last_undegraded":"2024-04-25T15:46:57.052755+0000","last_fullsized":"2024-04-25T15:46:57.052755+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:17.097099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956324+0000","last_change":"2024-04-25T15:46:54.968610+0000","last_active":"2024-04-25T15:46:55.956324+0000","last_peered":"2024-04-25T15:46:55.956324+0000","last_clean":"2024-04-25T15:46:55.956324+0000","last_became_active":"2024-04-25T15:46:54.968326+0000","last_became_peered":"2024-04-25T15:46:54.968326+0000","last_unstale":"2024-04-25T15:46:55.956324+0000","last_undegraded":"2024-04-25T15:46:55.956324+0000","last_fullsized":"2024-04-25T15:46:55.956324+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:13.407938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052638+0000","last_change":"2024-04-25T15:46:53.971368+0000","last_active":"2024-04-25T15:46:57.052638+0000","last_peered":"2024-04-25T15:46:57.052638+0000","last_clean":"2024-04-25T15:46:57.052638+0000","last_became_active":"2024-04-25T15:46:53.970376+0000","last_became_peered":"2024-04-25T15:46:53.970376+0000","last_unstale":"2024-04-25T15:46:57.052638+0000","last_undegraded":"2024-04-25T15:46:57.052638+0000","last_fullsized":"2024-04-25T15:46:57.052638+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:47.146101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":268,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953984+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:55.953984+0000","last_peered":"2024-04-25T15:46:55.953984+0000","last_clean":"2024-04-25T15:46:55.953984+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:55.953984+0000","last_undegraded":"2024-04-25T15:46:55.953984+0000","last_fullsized":"2024-04-25T15:46:55.953984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1187840,"data_stored":540728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1228800,"data_stored":561836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1228800,"data_stored":561288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":547395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1153324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1826816,"data_stored":1151782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":561254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1232896,"data_stored":561346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:47:00.932 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-25T15:47:00.931+0000 7f28a728d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:47:02.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:47:02.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.590+0000 7f0166842640 1 Processor -- start 2024-04-25T15:47:02.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.590+0000 7f0166842640 1 -- start start 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.591+0000 7f0166842640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01600b4b60 0x7f01600b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.591+0000 7f0166842640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01600b3850 0x7f016016a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.591+0000 7f0166842640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01600b2f30 con 0x7f016006d6d0 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.591+0000 7f0166842640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f016006eb60 con 0x7f01600b4b60 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.591+0000 7f0166842640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f01600b2c90 con 0x7f01600b3850 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01600b4b60 0x7f01600b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01600b4b60 0x7f01600b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34014/0 (socket says 172.21.15.80:34014) 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 -- 172.21.15.80:0/3136814589 learned_addr learned my addr 172.21.15.80:0/3136814589 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:02.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f0164ddf640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01600b3850 0x7f016016a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 -- 172.21.15.80:0/3136814589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01600b3850 msgr2=0x7f016016a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01600b3850 0x7f016016a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 -- 172.21.15.80:0/3136814589 >> v1:172.21.15.195:6789/0 conn(0x7f016006d6d0 legacy=0x7f01600b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f015ffff640 1 -- 172.21.15.80:0/3136814589 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01600d10a0 con 0x7f01600b4b60 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.592+0000 7f0164ddf640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01600b3850 0x7f016016a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.593+0000 7f015ffff640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01600b91c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0150009850 tx=0x7f015002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15c775255cd1c97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.593+0000 7f015effd640 1 -- 172.21.15.80:0/3136814589 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150004030 con 0x7f01600b4b60 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.593+0000 7f015effd640 1 -- 172.21.15.80:0/3136814589 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01500041d0 con 0x7f01600b4b60 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.593+0000 7f015effd640 1 -- 172.21.15.80:0/3136814589 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150003610 con 0x7f01600b4b60 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 -- 172.21.15.80:0/3136814589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 msgr2=0x7f01600b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01600b91c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0150009850 tx=0x7f015002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 -- 172.21.15.80:0/3136814589 shutdown_connections 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01600b3850 0x7f016016a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 --2- 172.21.15.80:0/3136814589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01600b91c0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 -- 172.21.15.80:0/3136814589 >> 172.21.15.80:0/3136814589 conn(0x7f01600d0450 msgr2=0x7f01600d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 -- 172.21.15.80:0/3136814589 shutdown_connections 2024-04-25T15:47:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.594+0000 7f0166842640 1 -- 172.21.15.80:0/3136814589 wait complete. 2024-04-25T15:47:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.595+0000 7f0166842640 1 Processor -- start 2024-04-25T15:47:02.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.596+0000 7f0166842640 1 -- start start 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0166842640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f016006d6d0 0x7f01601dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0166842640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01600b3850 0x7f01601d7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0166842640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01601da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0166842640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01600d2f50 con 0x7f01600b4b60 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0166842640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f016009cbe0 con 0x7f01600b3850 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0166842640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f016009d0e0 con 0x7f016006d6d0 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01601da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01601da420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34028/0 (socket says 172.21.15.80:34028) 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 -- 172.21.15.80:0/1415439959 learned_addr learned my addr 172.21.15.80:0/1415439959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f015ffff640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f016006d6d0 0x7f01601dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f015f7fe640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01600b3850 0x7f01601d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 -- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f016006d6d0 msgr2=0x7f01601dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f016006d6d0 0x7f01601dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 -- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01600b3850 msgr2=0x7f01601d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01600b3850 0x7f01601d7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f0164ddf640 1 -- 172.21.15.80:0/1415439959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01601ebc70 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.597+0000 7f015f7fe640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01600b3850 0x7f01601d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.598+0000 7f0164ddf640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01601da420 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f015800cd80 tx=0x7f015800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.598+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015800f680 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.598+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015800f840 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.598+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01601d5040 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.598+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015800fc30 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.598+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01601d5600 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.599+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01601eb9e0 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.600+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f01580213f0 con 0x7f01600b4b60 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.600+0000 7f015cff9640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f014c0744b0 0x7f014c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.600+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f01580960b0 con 0x7f01600b4b60 2024-04-25T15:47:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.600+0000 7f015ffff640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f014c0744b0 0x7f014c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.601+0000 7f015ffff640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f014c0744b0 0x7f014c0769c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0150033000 tx=0x7f015002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.605+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0158014030 con 0x7f01600b4b60 2024-04-25T15:47:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.779+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0160075c90 con 0x7f014c0744b0 2024-04-25T15:47:02.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.785+0000 7f015cff9640 1 -- 172.21.15.80:0/1415439959 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252074 (secure 0 0 0) 0x7f0160075c90 con 0x7f014c0744b0 2024-04-25T15:47:02.790 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:02.792 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:47:02.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f014c0744b0 msgr2=0x7f014c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f014c0744b0 0x7f014c0769c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0150033000 tx=0x7f015002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 msgr2=0x7f01601da420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01601da420 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f015800cd80 tx=0x7f015800a650 comp rx=0 tx=0).stop 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 shutdown_connections 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f014c0744b0 0x7f014c0769c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01600b4b60 0x7f01601da420 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01600b3850 0x7f01601d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 --2- 172.21.15.80:0/1415439959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f016006d6d0 0x7f01601dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 >> 172.21.15.80:0/1415439959 conn(0x7f01600d0450 msgr2=0x7f01600b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 shutdown_connections 2024-04-25T15:47:02.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.788+0000 7f0166842640 1 -- 172.21.15.80:0/1415439959 wait complete. 2024-04-25T15:47:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-04-25T15:47:01.046714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256076,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718644,"statfs":{"total":773094113280,"available":772831891456,"internally_reserved":0,"allocated":11051008,"data_stored":5675588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.098133"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957978+0000","last_change":"2024-04-25T15:46:54.980574+0000","last_active":"2024-04-25T15:46:56.957978+0000","last_peered":"2024-04-25T15:46:56.957978+0000","last_clean":"2024-04-25T15:46:56.957978+0000","last_became_active":"2024-04-25T15:46:54.980265+0000","last_became_peered":"2024-04-25T15:46:54.980265+0000","last_unstale":"2024-04-25T15:46:56.957978+0000","last_undegraded":"2024-04-25T15:46:56.957978+0000","last_fullsized":"2024-04-25T15:46:56.957978+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:44.847993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051879+0000","last_change":"2024-04-25T15:46:54.972087+0000","last_active":"2024-04-25T15:46:57.051879+0000","last_peered":"2024-04-25T15:46:57.051879+0000","last_clean":"2024-04-25T15:46:57.051879+0000","last_became_active":"2024-04-25T15:46:54.971714+0000","last_became_peered":"2024-04-25T15:46:54.971714+0000","last_unstale":"2024-04-25T15:46:57.051879+0000","last_undegraded":"2024-04-25T15:46:57.051879+0000","last_fullsized":"2024-04-25T15:46:57.051879+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:54.884697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957871+0000","last_change":"2024-04-25T15:46:54.979283+0000","last_active":"2024-04-25T15:46:56.957871+0000","last_peered":"2024-04-25T15:46:56.957871+0000","last_clean":"2024-04-25T15:46:56.957871+0000","last_became_active":"2024-04-25T15:46:54.974843+0000","last_became_peered":"2024-04-25T15:46:54.974843+0000","last_unstale":"2024-04-25T15:46:56.957871+0000","last_undegraded":"2024-04-25T15:46:56.957871+0000","last_fullsized":"2024-04-25T15:46:56.957871+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:43.491133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051093+0000","last_change":"2024-04-25T15:46:54.970774+0000","last_active":"2024-04-25T15:46:57.051093+0000","last_peered":"2024-04-25T15:46:57.051093+0000","last_clean":"2024-04-25T15:46:57.051093+0000","last_became_active":"2024-04-25T15:46:54.970452+0000","last_became_peered":"2024-04-25T15:46:54.970452+0000","last_unstale":"2024-04-25T15:46:57.051093+0000","last_undegraded":"2024-04-25T15:46:57.051093+0000","last_fullsized":"2024-04-25T15:46:57.051093+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:50.778973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051650+0000","last_change":"2024-04-25T15:46:54.971271+0000","last_active":"2024-04-25T15:46:57.051650+0000","last_peered":"2024-04-25T15:46:57.051650+0000","last_clean":"2024-04-25T15:46:57.051650+0000","last_became_active":"2024-04-25T15:46:54.970983+0000","last_became_peered":"2024-04-25T15:46:54.970983+0000","last_unstale":"2024-04-25T15:46:57.051650+0000","last_undegraded":"2024-04-25T15:46:57.051650+0000","last_fullsized":"2024-04-25T15:46:57.051650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:11.939701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051394+0000","last_change":"2024-04-25T15:46:54.983229+0000","last_active":"2024-04-25T15:46:57.051394+0000","last_peered":"2024-04-25T15:46:57.051394+0000","last_clean":"2024-04-25T15:46:57.051394+0000","last_became_active":"2024-04-25T15:46:54.982904+0000","last_became_peered":"2024-04-25T15:46:54.982904+0000","last_unstale":"2024-04-25T15:46:57.051394+0000","last_undegraded":"2024-04-25T15:46:57.051394+0000","last_fullsized":"2024-04-25T15:46:57.051394+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:19.666402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051244+0000","last_change":"2024-04-25T15:46:54.979737+0000","last_active":"2024-04-25T15:46:57.051244+0000","last_peered":"2024-04-25T15:46:57.051244+0000","last_clean":"2024-04-25T15:46:57.051244+0000","last_became_active":"2024-04-25T15:46:54.979414+0000","last_became_peered":"2024-04-25T15:46:54.979414+0000","last_unstale":"2024-04-25T15:46:57.051244+0000","last_undegraded":"2024-04-25T15:46:57.051244+0000","last_fullsized":"2024-04-25T15:46:57.051244+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:43.219884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052368+0000","last_change":"2024-04-25T15:46:54.987005+0000","last_active":"2024-04-25T15:46:57.052368+0000","last_peered":"2024-04-25T15:46:57.052368+0000","last_clean":"2024-04-25T15:46:57.052368+0000","last_became_active":"2024-04-25T15:46:54.986705+0000","last_became_peered":"2024-04-25T15:46:54.986705+0000","last_unstale":"2024-04-25T15:46:57.052368+0000","last_undegraded":"2024-04-25T15:46:57.052368+0000","last_fullsized":"2024-04-25T15:46:57.052368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:05.427951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051768+0000","last_change":"2024-04-25T15:46:54.977949+0000","last_active":"2024-04-25T15:46:57.051768+0000","last_peered":"2024-04-25T15:46:57.051768+0000","last_clean":"2024-04-25T15:46:57.051768+0000","last_became_active":"2024-04-25T15:46:54.977596+0000","last_became_peered":"2024-04-25T15:46:54.977596+0000","last_unstale":"2024-04-25T15:46:57.051768+0000","last_undegraded":"2024-04-25T15:46:57.051768+0000","last_fullsized":"2024-04-25T15:46:57.051768+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:37.411614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052174+0000","last_change":"2024-04-25T15:46:54.974108+0000","last_active":"2024-04-25T15:46:57.052174+0000","last_peered":"2024-04-25T15:46:57.052174+0000","last_clean":"2024-04-25T15:46:57.052174+0000","last_became_active":"2024-04-25T15:46:54.973822+0000","last_became_peered":"2024-04-25T15:46:54.973822+0000","last_unstale":"2024-04-25T15:46:57.052174+0000","last_undegraded":"2024-04-25T15:46:57.052174+0000","last_fullsized":"2024-04-25T15:46:57.052174+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:54.884697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956559+0000","last_change":"2024-04-25T15:46:54.973659+0000","last_active":"2024-04-25T15:46:55.956559+0000","last_peered":"2024-04-25T15:46:55.956559+0000","last_clean":"2024-04-25T15:46:55.956559+0000","last_became_active":"2024-04-25T15:46:54.973341+0000","last_became_peered":"2024-04-25T15:46:54.973341+0000","last_unstale":"2024-04-25T15:46:55.956559+0000","last_undegraded":"2024-04-25T15:46:55.956559+0000","last_fullsized":"2024-04-25T15:46:55.956559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:50.778973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955080+0000","last_change":"2024-04-25T15:46:54.978870+0000","last_active":"2024-04-25T15:46:55.955080+0000","last_peered":"2024-04-25T15:46:55.955080+0000","last_clean":"2024-04-25T15:46:55.955080+0000","last_became_active":"2024-04-25T15:46:54.977851+0000","last_became_peered":"2024-04-25T15:46:54.977851+0000","last_unstale":"2024-04-25T15:46:55.955080+0000","last_undegraded":"2024-04-25T15:46:55.955080+0000","last_fullsized":"2024-04-25T15:46:55.955080+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:19:53.929716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051584+0000","last_change":"2024-04-25T15:46:54.973740+0000","last_active":"2024-04-25T15:46:57.051584+0000","last_peered":"2024-04-25T15:46:57.051584+0000","last_clean":"2024-04-25T15:46:57.051584+0000","last_became_active":"2024-04-25T15:46:54.973433+0000","last_became_peered":"2024-04-25T15:46:54.973433+0000","last_unstale":"2024-04-25T15:46:57.051584+0000","last_undegraded":"2024-04-25T15:46:57.051584+0000","last_fullsized":"2024-04-25T15:46:57.051584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:51.266720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954164+0000","last_change":"2024-04-25T15:46:54.957479+0000","last_active":"2024-04-25T15:46:55.954164+0000","last_peered":"2024-04-25T15:46:55.954164+0000","last_clean":"2024-04-25T15:46:55.954164+0000","last_became_active":"2024-04-25T15:46:54.957096+0000","last_became_peered":"2024-04-25T15:46:54.957096+0000","last_unstale":"2024-04-25T15:46:55.954164+0000","last_undegraded":"2024-04-25T15:46:55.954164+0000","last_fullsized":"2024-04-25T15:46:55.954164+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:44.785532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953896+0000","last_change":"2024-04-25T15:46:54.964232+0000","last_active":"2024-04-25T15:46:55.953896+0000","last_peered":"2024-04-25T15:46:55.953896+0000","last_clean":"2024-04-25T15:46:55.953896+0000","last_became_active":"2024-04-25T15:46:54.963905+0000","last_became_peered":"2024-04-25T15:46:54.963905+0000","last_unstale":"2024-04-25T15:46:55.953896+0000","last_undegraded":"2024-04-25T15:46:55.953896+0000","last_fullsized":"2024-04-25T15:46:55.953896+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:47.419426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953897+0000","last_change":"2024-04-25T15:46:54.978006+0000","last_active":"2024-04-25T15:46:55.953897+0000","last_peered":"2024-04-25T15:46:55.953897+0000","last_clean":"2024-04-25T15:46:55.953897+0000","last_became_active":"2024-04-25T15:46:54.977665+0000","last_became_peered":"2024-04-25T15:46:54.977665+0000","last_unstale":"2024-04-25T15:46:55.953897+0000","last_undegraded":"2024-04-25T15:46:55.953897+0000","last_fullsized":"2024-04-25T15:46:55.953897+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:24.360593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958156+0000","last_change":"2024-04-25T15:46:54.974607+0000","last_active":"2024-04-25T15:46:56.958156+0000","last_peered":"2024-04-25T15:46:56.958156+0000","last_clean":"2024-04-25T15:46:56.958156+0000","last_became_active":"2024-04-25T15:46:54.974123+0000","last_became_peered":"2024-04-25T15:46:54.974123+0000","last_unstale":"2024-04-25T15:46:56.958156+0000","last_undegraded":"2024-04-25T15:46:56.958156+0000","last_fullsized":"2024-04-25T15:46:56.958156+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:32.434773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051946+0000","last_change":"2024-04-25T15:46:54.979694+0000","last_active":"2024-04-25T15:46:57.051946+0000","last_peered":"2024-04-25T15:46:57.051946+0000","last_clean":"2024-04-25T15:46:57.051946+0000","last_became_active":"2024-04-25T15:46:54.979358+0000","last_became_peered":"2024-04-25T15:46:54.979358+0000","last_unstale":"2024-04-25T15:46:57.051946+0000","last_undegraded":"2024-04-25T15:46:57.051946+0000","last_fullsized":"2024-04-25T15:46:57.051946+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:13.034972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957910+0000","last_change":"2024-04-25T15:46:54.975132+0000","last_active":"2024-04-25T15:46:56.957910+0000","last_peered":"2024-04-25T15:46:56.957910+0000","last_clean":"2024-04-25T15:46:56.957910+0000","last_became_active":"2024-04-25T15:46:54.974708+0000","last_became_peered":"2024-04-25T15:46:54.974708+0000","last_unstale":"2024-04-25T15:46:56.957910+0000","last_undegraded":"2024-04-25T15:46:56.957910+0000","last_fullsized":"2024-04-25T15:46:56.957910+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:34.588584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955259+0000","last_change":"2024-04-25T15:46:54.967954+0000","last_active":"2024-04-25T15:46:55.955259+0000","last_peered":"2024-04-25T15:46:55.955259+0000","last_clean":"2024-04-25T15:46:55.955259+0000","last_became_active":"2024-04-25T15:46:54.967431+0000","last_became_peered":"2024-04-25T15:46:54.967431+0000","last_unstale":"2024-04-25T15:46:55.955259+0000","last_undegraded":"2024-04-25T15:46:55.955259+0000","last_fullsized":"2024-04-25T15:46:55.955259+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:45.884108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052146+0000","last_change":"2024-04-25T15:46:54.983907+0000","last_active":"2024-04-25T15:46:57.052146+0000","last_peered":"2024-04-25T15:46:57.052146+0000","last_clean":"2024-04-25T15:46:57.052146+0000","last_became_active":"2024-04-25T15:46:54.983222+0000","last_became_peered":"2024-04-25T15:46:54.983222+0000","last_unstale":"2024-04-25T15:46:57.052146+0000","last_undegraded":"2024-04-25T15:46:57.052146+0000","last_fullsized":"2024-04-25T15:46:57.052146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:54.120384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051661+0000","last_change":"2024-04-25T15:46:54.973333+0000","last_active":"2024-04-25T15:46:57.051661+0000","last_peered":"2024-04-25T15:46:57.051661+0000","last_clean":"2024-04-25T15:46:57.051661+0000","last_became_active":"2024-04-25T15:46:54.972473+0000","last_became_peered":"2024-04-25T15:46:54.972473+0000","last_unstale":"2024-04-25T15:46:57.051661+0000","last_undegraded":"2024-04-25T15:46:57.051661+0000","last_fullsized":"2024-04-25T15:46:57.051661+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:43.398496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957772+0000","last_change":"2024-04-25T15:46:54.976750+0000","last_active":"2024-04-25T15:46:56.957772+0000","last_peered":"2024-04-25T15:46:56.957772+0000","last_clean":"2024-04-25T15:46:56.957772+0000","last_became_active":"2024-04-25T15:46:54.976423+0000","last_became_peered":"2024-04-25T15:46:54.976423+0000","last_unstale":"2024-04-25T15:46:56.957772+0000","last_undegraded":"2024-04-25T15:46:56.957772+0000","last_fullsized":"2024-04-25T15:46:56.957772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:37.751382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051486+0000","last_change":"2024-04-25T15:46:54.983022+0000","last_active":"2024-04-25T15:46:57.051486+0000","last_peered":"2024-04-25T15:46:57.051486+0000","last_clean":"2024-04-25T15:46:57.051486+0000","last_became_active":"2024-04-25T15:46:54.982732+0000","last_became_peered":"2024-04-25T15:46:54.982732+0000","last_unstale":"2024-04-25T15:46:57.051486+0000","last_undegraded":"2024-04-25T15:46:57.051486+0000","last_fullsized":"2024-04-25T15:46:57.051486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:19.666402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954967+0000","last_change":"2024-04-25T15:46:54.973842+0000","last_active":"2024-04-25T15:46:55.954967+0000","last_peered":"2024-04-25T15:46:55.954967+0000","last_clean":"2024-04-25T15:46:55.954967+0000","last_became_active":"2024-04-25T15:46:54.973526+0000","last_became_peered":"2024-04-25T15:46:54.973526+0000","last_unstale":"2024-04-25T15:46:55.954967+0000","last_undegraded":"2024-04-25T15:46:55.954967+0000","last_fullsized":"2024-04-25T15:46:55.954967+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:10.080858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954503+0000","last_change":"2024-04-25T15:46:54.974254+0000","last_active":"2024-04-25T15:46:55.954503+0000","last_peered":"2024-04-25T15:46:55.954503+0000","last_clean":"2024-04-25T15:46:55.954503+0000","last_became_active":"2024-04-25T15:46:54.973923+0000","last_became_peered":"2024-04-25T15:46:54.973923+0000","last_unstale":"2024-04-25T15:46:55.954503+0000","last_undegraded":"2024-04-25T15:46:55.954503+0000","last_fullsized":"2024-04-25T15:46:55.954503+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:13.034972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956590+0000","last_change":"2024-04-25T15:46:54.971410+0000","last_active":"2024-04-25T15:46:55.956590+0000","last_peered":"2024-04-25T15:46:55.956590+0000","last_clean":"2024-04-25T15:46:55.956590+0000","last_became_active":"2024-04-25T15:46:54.970947+0000","last_became_peered":"2024-04-25T15:46:54.970947+0000","last_unstale":"2024-04-25T15:46:55.956590+0000","last_undegraded":"2024-04-25T15:46:55.956590+0000","last_fullsized":"2024-04-25T15:46:55.956590+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:55.298631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051593+0000","last_change":"2024-04-25T15:46:54.975471+0000","last_active":"2024-04-25T15:46:57.051593+0000","last_peered":"2024-04-25T15:46:57.051593+0000","last_clean":"2024-04-25T15:46:57.051593+0000","last_became_active":"2024-04-25T15:46:54.974819+0000","last_became_peered":"2024-04-25T15:46:54.974819+0000","last_unstale":"2024-04-25T15:46:57.051593+0000","last_undegraded":"2024-04-25T15:46:57.051593+0000","last_fullsized":"2024-04-25T15:46:57.051593+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:43.398496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052315+0000","last_change":"2024-04-25T15:46:54.975914+0000","last_active":"2024-04-25T15:46:57.052315+0000","last_peered":"2024-04-25T15:46:57.052315+0000","last_clean":"2024-04-25T15:46:57.052315+0000","last_became_active":"2024-04-25T15:46:54.975536+0000","last_became_peered":"2024-04-25T15:46:54.975536+0000","last_unstale":"2024-04-25T15:46:57.052315+0000","last_undegraded":"2024-04-25T15:46:57.052315+0000","last_fullsized":"2024-04-25T15:46:57.052315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.749186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954911+0000","last_change":"2024-04-25T15:46:54.966197+0000","last_active":"2024-04-25T15:46:55.954911+0000","last_peered":"2024-04-25T15:46:55.954911+0000","last_clean":"2024-04-25T15:46:55.954911+0000","last_became_active":"2024-04-25T15:46:54.965894+0000","last_became_peered":"2024-04-25T15:46:54.965894+0000","last_unstale":"2024-04-25T15:46:55.954911+0000","last_undegraded":"2024-04-25T15:46:55.954911+0000","last_fullsized":"2024-04-25T15:46:55.954911+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:59.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051246+0000","last_change":"2024-04-25T15:46:54.983366+0000","last_active":"2024-04-25T15:46:57.051246+0000","last_peered":"2024-04-25T15:46:57.051246+0000","last_clean":"2024-04-25T15:46:57.051246+0000","last_became_active":"2024-04-25T15:46:54.983066+0000","last_became_peered":"2024-04-25T15:46:54.983066+0000","last_unstale":"2024-04-25T15:46:57.051246+0000","last_undegraded":"2024-04-25T15:46:57.051246+0000","last_fullsized":"2024-04-25T15:46:57.051246+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:11.608856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052633+0000","last_change":"2024-04-25T15:46:54.976723+0000","last_active":"2024-04-25T15:46:57.052633+0000","last_peered":"2024-04-25T15:46:57.052633+0000","last_clean":"2024-04-25T15:46:57.052633+0000","last_became_active":"2024-04-25T15:46:54.976444+0000","last_became_peered":"2024-04-25T15:46:54.976444+0000","last_unstale":"2024-04-25T15:46:57.052633+0000","last_undegraded":"2024-04-25T15:46:57.052633+0000","last_fullsized":"2024-04-25T15:46:57.052633+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:48.546288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957891+0000","last_change":"2024-04-25T15:46:54.981397+0000","last_active":"2024-04-25T15:46:56.957891+0000","last_peered":"2024-04-25T15:46:56.957891+0000","last_clean":"2024-04-25T15:46:56.957891+0000","last_became_active":"2024-04-25T15:46:54.981084+0000","last_became_peered":"2024-04-25T15:46:54.981084+0000","last_unstale":"2024-04-25T15:46:56.957891+0000","last_undegraded":"2024-04-25T15:46:56.957891+0000","last_fullsized":"2024-04-25T15:46:56.957891+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:33.105533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"98'4","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051413+0000","last_change":"2024-04-25T15:46:53.968876+0000","last_active":"2024-04-25T15:46:57.051413+0000","last_peered":"2024-04-25T15:46:57.051413+0000","last_clean":"2024-04-25T15:46:57.051413+0000","last_became_active":"2024-04-25T15:46:53.968481+0000","last_became_peered":"2024-04-25T15:46:53.968481+0000","last_unstale":"2024-04-25T15:46:57.051413+0000","last_undegraded":"2024-04-25T15:46:57.051413+0000","last_fullsized":"2024-04-25T15:46:57.051413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:12.032756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052058+0000","last_change":"2024-04-25T15:46:54.987359+0000","last_active":"2024-04-25T15:46:57.052058+0000","last_peered":"2024-04-25T15:46:57.052058+0000","last_clean":"2024-04-25T15:46:57.052058+0000","last_became_active":"2024-04-25T15:46:54.986659+0000","last_became_peered":"2024-04-25T15:46:54.986659+0000","last_unstale":"2024-04-25T15:46:57.052058+0000","last_undegraded":"2024-04-25T15:46:57.052058+0000","last_fullsized":"2024-04-25T15:46:57.052058+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:54.272616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052550+0000","last_change":"2024-04-25T15:46:53.971080+0000","last_active":"2024-04-25T15:46:57.052550+0000","last_peered":"2024-04-25T15:46:57.052550+0000","last_clean":"2024-04-25T15:46:57.052550+0000","last_became_active":"2024-04-25T15:46:53.969706+0000","last_became_peered":"2024-04-25T15:46:53.969706+0000","last_unstale":"2024-04-25T15:46:57.052550+0000","last_undegraded":"2024-04-25T15:46:57.052550+0000","last_fullsized":"2024-04-25T15:46:57.052550+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:01.157348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955012+0000","last_change":"2024-04-25T15:46:54.972683+0000","last_active":"2024-04-25T15:46:55.955012+0000","last_peered":"2024-04-25T15:46:55.955012+0000","last_clean":"2024-04-25T15:46:55.955012+0000","last_became_active":"2024-04-25T15:46:54.972382+0000","last_became_peered":"2024-04-25T15:46:54.972382+0000","last_unstale":"2024-04-25T15:46:55.955012+0000","last_undegraded":"2024-04-25T15:46:55.955012+0000","last_fullsized":"2024-04-25T15:46:55.955012+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:22.259894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953977+0000","last_change":"2024-04-25T15:46:53.963095+0000","last_active":"2024-04-25T15:46:55.953977+0000","last_peered":"2024-04-25T15:46:55.953977+0000","last_clean":"2024-04-25T15:46:55.953977+0000","last_became_active":"2024-04-25T15:46:53.962643+0000","last_became_peered":"2024-04-25T15:46:53.962643+0000","last_unstale":"2024-04-25T15:46:55.953977+0000","last_undegraded":"2024-04-25T15:46:55.953977+0000","last_fullsized":"2024-04-25T15:46:55.953977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:42.217667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956443+0000","last_change":"2024-04-25T15:46:54.976829+0000","last_active":"2024-04-25T15:46:55.956443+0000","last_peered":"2024-04-25T15:46:55.956443+0000","last_clean":"2024-04-25T15:46:55.956443+0000","last_became_active":"2024-04-25T15:46:54.973021+0000","last_became_peered":"2024-04-25T15:46:54.973021+0000","last_unstale":"2024-04-25T15:46:55.956443+0000","last_undegraded":"2024-04-25T15:46:55.956443+0000","last_fullsized":"2024-04-25T15:46:55.956443+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:23.488086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051915+0000","last_change":"2024-04-25T15:46:53.971918+0000","last_active":"2024-04-25T15:46:57.051915+0000","last_peered":"2024-04-25T15:46:57.051915+0000","last_clean":"2024-04-25T15:46:57.051915+0000","last_became_active":"2024-04-25T15:46:53.971592+0000","last_became_peered":"2024-04-25T15:46:53.971592+0000","last_unstale":"2024-04-25T15:46:57.051915+0000","last_undegraded":"2024-04-25T15:46:57.051915+0000","last_fullsized":"2024-04-25T15:46:57.051915+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:49.283350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051143+0000","last_change":"2024-04-25T15:46:54.968707+0000","last_active":"2024-04-25T15:46:57.051143+0000","last_peered":"2024-04-25T15:46:57.051143+0000","last_clean":"2024-04-25T15:46:57.051143+0000","last_became_active":"2024-04-25T15:46:54.967824+0000","last_became_peered":"2024-04-25T15:46:54.967824+0000","last_unstale":"2024-04-25T15:46:57.051143+0000","last_undegraded":"2024-04-25T15:46:57.051143+0000","last_fullsized":"2024-04-25T15:46:57.051143+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:55.298631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954276+0000","last_change":"2024-04-25T15:46:53.962220+0000","last_active":"2024-04-25T15:46:55.954276+0000","last_peered":"2024-04-25T15:46:55.954276+0000","last_clean":"2024-04-25T15:46:55.954276+0000","last_became_active":"2024-04-25T15:46:53.961874+0000","last_became_peered":"2024-04-25T15:46:53.961874+0000","last_unstale":"2024-04-25T15:46:55.954276+0000","last_undegraded":"2024-04-25T15:46:55.954276+0000","last_fullsized":"2024-04-25T15:46:55.954276+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:08.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958112+0000","last_change":"2024-04-25T15:46:54.975002+0000","last_active":"2024-04-25T15:46:56.958112+0000","last_peered":"2024-04-25T15:46:56.958112+0000","last_clean":"2024-04-25T15:46:56.958112+0000","last_became_active":"2024-04-25T15:46:54.974325+0000","last_became_peered":"2024-04-25T15:46:54.974325+0000","last_unstale":"2024-04-25T15:46:56.958112+0000","last_undegraded":"2024-04-25T15:46:56.958112+0000","last_fullsized":"2024-04-25T15:46:56.958112+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:13.805726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956247+0000","last_change":"2024-04-25T15:46:53.969406+0000","last_active":"2024-04-25T15:46:55.956247+0000","last_peered":"2024-04-25T15:46:55.956247+0000","last_clean":"2024-04-25T15:46:55.956247+0000","last_became_active":"2024-04-25T15:46:53.969043+0000","last_became_peered":"2024-04-25T15:46:53.969043+0000","last_unstale":"2024-04-25T15:46:55.956247+0000","last_undegraded":"2024-04-25T15:46:55.956247+0000","last_fullsized":"2024-04-25T15:46:55.956247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:16.471621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051992+0000","last_change":"2024-04-25T15:46:54.980401+0000","last_active":"2024-04-25T15:46:57.051992+0000","last_peered":"2024-04-25T15:46:57.051992+0000","last_clean":"2024-04-25T15:46:57.051992+0000","last_became_active":"2024-04-25T15:46:54.980060+0000","last_became_peered":"2024-04-25T15:46:54.980060+0000","last_unstale":"2024-04-25T15:46:57.051992+0000","last_undegraded":"2024-04-25T15:46:57.051992+0000","last_fullsized":"2024-04-25T15:46:57.051992+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:59.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954253+0000","last_change":"2024-04-25T15:46:53.963444+0000","last_active":"2024-04-25T15:46:55.954253+0000","last_peered":"2024-04-25T15:46:55.954253+0000","last_clean":"2024-04-25T15:46:55.954253+0000","last_became_active":"2024-04-25T15:46:53.963083+0000","last_became_peered":"2024-04-25T15:46:53.963083+0000","last_unstale":"2024-04-25T15:46:55.954253+0000","last_undegraded":"2024-04-25T15:46:55.954253+0000","last_fullsized":"2024-04-25T15:46:55.954253+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:07.701961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051325+0000","last_change":"2024-04-25T15:46:54.972914+0000","last_active":"2024-04-25T15:46:57.051325+0000","last_peered":"2024-04-25T15:46:57.051325+0000","last_clean":"2024-04-25T15:46:57.051325+0000","last_became_active":"2024-04-25T15:46:54.972274+0000","last_became_peered":"2024-04-25T15:46:54.972274+0000","last_unstale":"2024-04-25T15:46:57.051325+0000","last_undegraded":"2024-04-25T15:46:57.051325+0000","last_fullsized":"2024-04-25T15:46:57.051325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:33.158913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.050999+0000","last_change":"2024-04-25T15:46:53.961775+0000","last_active":"2024-04-25T15:46:57.050999+0000","last_peered":"2024-04-25T15:46:57.050999+0000","last_clean":"2024-04-25T15:46:57.050999+0000","last_became_active":"2024-04-25T15:46:53.961476+0000","last_became_peered":"2024-04-25T15:46:53.961476+0000","last_unstale":"2024-04-25T15:46:57.050999+0000","last_undegraded":"2024-04-25T15:46:57.050999+0000","last_fullsized":"2024-04-25T15:46:57.050999+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:09.078642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957685+0000","last_change":"2024-04-25T15:46:54.977161+0000","last_active":"2024-04-25T15:46:56.957685+0000","last_peered":"2024-04-25T15:46:56.957685+0000","last_clean":"2024-04-25T15:46:56.957685+0000","last_became_active":"2024-04-25T15:46:54.976181+0000","last_became_peered":"2024-04-25T15:46:54.976181+0000","last_unstale":"2024-04-25T15:46:56.957685+0000","last_undegraded":"2024-04-25T15:46:56.957685+0000","last_fullsized":"2024-04-25T15:46:56.957685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:34.941086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955036+0000","last_change":"2024-04-25T15:46:53.969932+0000","last_active":"2024-04-25T15:46:55.955036+0000","last_peered":"2024-04-25T15:46:55.955036+0000","last_clean":"2024-04-25T15:46:55.955036+0000","last_became_active":"2024-04-25T15:46:53.968144+0000","last_became_peered":"2024-04-25T15:46:53.968144+0000","last_unstale":"2024-04-25T15:46:55.955036+0000","last_undegraded":"2024-04-25T15:46:55.955036+0000","last_fullsized":"2024-04-25T15:46:55.955036+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:15.954902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051423+0000","last_change":"2024-04-25T15:46:54.979689+0000","last_active":"2024-04-25T15:46:57.051423+0000","last_peered":"2024-04-25T15:46:57.051423+0000","last_clean":"2024-04-25T15:46:57.051423+0000","last_became_active":"2024-04-25T15:46:54.979419+0000","last_became_peered":"2024-04-25T15:46:54.979419+0000","last_unstale":"2024-04-25T15:46:57.051423+0000","last_undegraded":"2024-04-25T15:46:57.051423+0000","last_fullsized":"2024-04-25T15:46:57.051423+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:43.219884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957900+0000","last_change":"2024-04-25T15:46:53.958121+0000","last_active":"2024-04-25T15:46:56.957900+0000","last_peered":"2024-04-25T15:46:56.957900+0000","last_clean":"2024-04-25T15:46:56.957900+0000","last_became_active":"2024-04-25T15:46:53.957362+0000","last_became_peered":"2024-04-25T15:46:53.957362+0000","last_unstale":"2024-04-25T15:46:56.957900+0000","last_undegraded":"2024-04-25T15:46:56.957900+0000","last_fullsized":"2024-04-25T15:46:56.957900+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:25.183333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052405+0000","last_change":"2024-04-25T15:46:54.984284+0000","last_active":"2024-04-25T15:46:57.052405+0000","last_peered":"2024-04-25T15:46:57.052405+0000","last_clean":"2024-04-25T15:46:57.052405+0000","last_became_active":"2024-04-25T15:46:54.983419+0000","last_became_peered":"2024-04-25T15:46:54.983419+0000","last_unstale":"2024-04-25T15:46:57.052405+0000","last_undegraded":"2024-04-25T15:46:57.052405+0000","last_fullsized":"2024-04-25T15:46:57.052405+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:49.502885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"98'3","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955100+0000","last_change":"2024-04-25T15:46:53.965265+0000","last_active":"2024-04-25T15:46:55.955100+0000","last_peered":"2024-04-25T15:46:55.955100+0000","last_clean":"2024-04-25T15:46:55.955100+0000","last_became_active":"2024-04-25T15:46:53.964903+0000","last_became_peered":"2024-04-25T15:46:53.964903+0000","last_unstale":"2024-04-25T15:46:55.955100+0000","last_undegraded":"2024-04-25T15:46:55.955100+0000","last_fullsized":"2024-04-25T15:46:55.955100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:54.296414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051801+0000","last_change":"2024-04-25T15:46:54.979016+0000","last_active":"2024-04-25T15:46:57.051801+0000","last_peered":"2024-04-25T15:46:57.051801+0000","last_clean":"2024-04-25T15:46:57.051801+0000","last_became_active":"2024-04-25T15:46:54.978737+0000","last_became_peered":"2024-04-25T15:46:54.978737+0000","last_unstale":"2024-04-25T15:46:57.051801+0000","last_undegraded":"2024-04-25T15:46:57.051801+0000","last_fullsized":"2024-04-25T15:46:57.051801+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:37.411614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"98'6","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051536+0000","last_change":"2024-04-25T15:46:53.966347+0000","last_active":"2024-04-25T15:46:57.051536+0000","last_peered":"2024-04-25T15:46:57.051536+0000","last_clean":"2024-04-25T15:46:57.051536+0000","last_became_active":"2024-04-25T15:46:53.965444+0000","last_became_peered":"2024-04-25T15:46:53.965444+0000","last_unstale":"2024-04-25T15:46:57.051536+0000","last_undegraded":"2024-04-25T15:46:57.051536+0000","last_fullsized":"2024-04-25T15:46:57.051536+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:24.750079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956497+0000","last_change":"2024-04-25T15:46:54.978887+0000","last_active":"2024-04-25T15:46:55.956497+0000","last_peered":"2024-04-25T15:46:55.956497+0000","last_clean":"2024-04-25T15:46:55.956497+0000","last_became_active":"2024-04-25T15:46:54.974606+0000","last_became_peered":"2024-04-25T15:46:54.974606+0000","last_unstale":"2024-04-25T15:46:55.956497+0000","last_undegraded":"2024-04-25T15:46:55.956497+0000","last_fullsized":"2024-04-25T15:46:55.956497+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:09.070782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051800+0000","last_change":"2024-04-25T15:46:53.971700+0000","last_active":"2024-04-25T15:46:57.051800+0000","last_peered":"2024-04-25T15:46:57.051800+0000","last_clean":"2024-04-25T15:46:57.051800+0000","last_became_active":"2024-04-25T15:46:53.971408+0000","last_became_peered":"2024-04-25T15:46:53.971408+0000","last_unstale":"2024-04-25T15:46:57.051800+0000","last_undegraded":"2024-04-25T15:46:57.051800+0000","last_fullsized":"2024-04-25T15:46:57.051800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:29.323101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051745+0000","last_change":"2024-04-25T15:46:54.977707+0000","last_active":"2024-04-25T15:46:57.051745+0000","last_peered":"2024-04-25T15:46:57.051745+0000","last_clean":"2024-04-25T15:46:57.051745+0000","last_became_active":"2024-04-25T15:46:54.977401+0000","last_became_peered":"2024-04-25T15:46:54.977401+0000","last_unstale":"2024-04-25T15:46:57.051745+0000","last_undegraded":"2024-04-25T15:46:57.051745+0000","last_fullsized":"2024-04-25T15:46:57.051745+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:17.473838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051420+0000","last_change":"2024-04-25T15:46:53.966111+0000","last_active":"2024-04-25T15:46:57.051420+0000","last_peered":"2024-04-25T15:46:57.051420+0000","last_clean":"2024-04-25T15:46:57.051420+0000","last_became_active":"2024-04-25T15:46:53.965745+0000","last_became_peered":"2024-04-25T15:46:53.965745+0000","last_unstale":"2024-04-25T15:46:57.051420+0000","last_undegraded":"2024-04-25T15:46:57.051420+0000","last_fullsized":"2024-04-25T15:46:57.051420+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:58.322963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052544+0000","last_change":"2024-04-25T15:46:54.975951+0000","last_active":"2024-04-25T15:46:57.052544+0000","last_peered":"2024-04-25T15:46:57.052544+0000","last_clean":"2024-04-25T15:46:57.052544+0000","last_became_active":"2024-04-25T15:46:54.975625+0000","last_became_peered":"2024-04-25T15:46:54.975625+0000","last_unstale":"2024-04-25T15:46:57.052544+0000","last_undegraded":"2024-04-25T15:46:57.052544+0000","last_fullsized":"2024-04-25T15:46:57.052544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:09.137893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052163+0000","last_change":"2024-04-25T15:46:53.967519+0000","last_active":"2024-04-25T15:46:57.052163+0000","last_peered":"2024-04-25T15:46:57.052163+0000","last_clean":"2024-04-25T15:46:57.052163+0000","last_became_active":"2024-04-25T15:46:53.967161+0000","last_became_peered":"2024-04-25T15:46:53.967161+0000","last_unstale":"2024-04-25T15:46:57.052163+0000","last_undegraded":"2024-04-25T15:46:57.052163+0000","last_fullsized":"2024-04-25T15:46:57.052163+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:53.620527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958152+0000","last_change":"2024-04-25T15:46:54.974454+0000","last_active":"2024-04-25T15:46:56.958152+0000","last_peered":"2024-04-25T15:46:56.958152+0000","last_clean":"2024-04-25T15:46:56.958152+0000","last_became_active":"2024-04-25T15:46:54.973671+0000","last_became_peered":"2024-04-25T15:46:54.973671+0000","last_unstale":"2024-04-25T15:46:56.958152+0000","last_undegraded":"2024-04-25T15:46:56.958152+0000","last_fullsized":"2024-04-25T15:46:56.958152+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:42.172962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"98'8","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953897+0000","last_change":"2024-04-25T15:46:53.970231+0000","last_active":"2024-04-25T15:46:55.953897+0000","last_peered":"2024-04-25T15:46:55.953897+0000","last_clean":"2024-04-25T15:46:55.953897+0000","last_became_active":"2024-04-25T15:46:53.969940+0000","last_became_peered":"2024-04-25T15:46:53.969940+0000","last_unstale":"2024-04-25T15:46:55.953897+0000","last_undegraded":"2024-04-25T15:46:55.953897+0000","last_fullsized":"2024-04-25T15:46:55.953897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:55.926922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052651+0000","last_change":"2024-04-25T15:46:54.983942+0000","last_active":"2024-04-25T15:46:57.052651+0000","last_peered":"2024-04-25T15:46:57.052651+0000","last_clean":"2024-04-25T15:46:57.052651+0000","last_became_active":"2024-04-25T15:46:54.983625+0000","last_became_peered":"2024-04-25T15:46:54.983625+0000","last_unstale":"2024-04-25T15:46:57.052651+0000","last_undegraded":"2024-04-25T15:46:57.052651+0000","last_fullsized":"2024-04-25T15:46:57.052651+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:29.745001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051766+0000","last_change":"2024-04-25T15:46:53.972080+0000","last_active":"2024-04-25T15:46:57.051766+0000","last_peered":"2024-04-25T15:46:57.051766+0000","last_clean":"2024-04-25T15:46:57.051766+0000","last_became_active":"2024-04-25T15:46:53.971693+0000","last_became_peered":"2024-04-25T15:46:53.971693+0000","last_unstale":"2024-04-25T15:46:57.051766+0000","last_undegraded":"2024-04-25T15:46:57.051766+0000","last_fullsized":"2024-04-25T15:46:57.051766+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:48.602358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051500+0000","last_change":"2024-04-25T15:46:54.984073+0000","last_active":"2024-04-25T15:46:57.051500+0000","last_peered":"2024-04-25T15:46:57.051500+0000","last_clean":"2024-04-25T15:46:57.051500+0000","last_became_active":"2024-04-25T15:46:54.983618+0000","last_became_peered":"2024-04-25T15:46:54.983618+0000","last_unstale":"2024-04-25T15:46:57.051500+0000","last_undegraded":"2024-04-25T15:46:57.051500+0000","last_fullsized":"2024-04-25T15:46:57.051500+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:11.939701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.955219+0000","last_change":"2024-04-25T15:46:53.964498+0000","last_active":"2024-04-25T15:46:55.955219+0000","last_peered":"2024-04-25T15:46:55.955219+0000","last_clean":"2024-04-25T15:46:55.955219+0000","last_became_active":"2024-04-25T15:46:53.964129+0000","last_became_peered":"2024-04-25T15:46:53.964129+0000","last_unstale":"2024-04-25T15:46:55.955219+0000","last_undegraded":"2024-04-25T15:46:55.955219+0000","last_fullsized":"2024-04-25T15:46:55.955219+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:49.776757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051690+0000","last_change":"2024-04-25T15:46:54.961296+0000","last_active":"2024-04-25T15:46:57.051690+0000","last_peered":"2024-04-25T15:46:57.051690+0000","last_clean":"2024-04-25T15:46:57.051690+0000","last_became_active":"2024-04-25T15:46:54.960882+0000","last_became_peered":"2024-04-25T15:46:54.960882+0000","last_unstale":"2024-04-25T15:46:57.051690+0000","last_undegraded":"2024-04-25T15:46:57.051690+0000","last_fullsized":"2024-04-25T15:46:57.051690+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:17.473838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956368+0000","last_change":"2024-04-25T15:46:53.968256+0000","last_active":"2024-04-25T15:46:55.956368+0000","last_peered":"2024-04-25T15:46:55.956368+0000","last_clean":"2024-04-25T15:46:55.956368+0000","last_became_active":"2024-04-25T15:46:53.967940+0000","last_became_peered":"2024-04-25T15:46:53.967940+0000","last_unstale":"2024-04-25T15:46:55.956368+0000","last_undegraded":"2024-04-25T15:46:55.956368+0000","last_fullsized":"2024-04-25T15:46:55.956368+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.409398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957766+0000","last_change":"2024-04-25T15:46:54.979011+0000","last_active":"2024-04-25T15:46:56.957766+0000","last_peered":"2024-04-25T15:46:56.957766+0000","last_clean":"2024-04-25T15:46:56.957766+0000","last_became_active":"2024-04-25T15:46:54.978705+0000","last_became_peered":"2024-04-25T15:46:54.978705+0000","last_unstale":"2024-04-25T15:46:56.957766+0000","last_undegraded":"2024-04-25T15:46:56.957766+0000","last_fullsized":"2024-04-25T15:46:56.957766+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:17.976522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052414+0000","last_change":"2024-04-25T15:46:53.962212+0000","last_active":"2024-04-25T15:46:57.052414+0000","last_peered":"2024-04-25T15:46:57.052414+0000","last_clean":"2024-04-25T15:46:57.052414+0000","last_became_active":"2024-04-25T15:46:53.961142+0000","last_became_peered":"2024-04-25T15:46:53.961142+0000","last_unstale":"2024-04-25T15:46:57.052414+0000","last_undegraded":"2024-04-25T15:46:57.052414+0000","last_fullsized":"2024-04-25T15:46:57.052414+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:34:54.740263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958031+0000","last_change":"2024-04-25T15:46:54.986140+0000","last_active":"2024-04-25T15:46:56.958031+0000","last_peered":"2024-04-25T15:46:56.958031+0000","last_clean":"2024-04-25T15:46:56.958031+0000","last_became_active":"2024-04-25T15:46:54.984925+0000","last_became_peered":"2024-04-25T15:46:54.984925+0000","last_unstale":"2024-04-25T15:46:56.958031+0000","last_undegraded":"2024-04-25T15:46:56.958031+0000","last_fullsized":"2024-04-25T15:46:56.958031+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:44.578380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052248+0000","last_change":"2024-04-25T15:46:53.970934+0000","last_active":"2024-04-25T15:46:57.052248+0000","last_peered":"2024-04-25T15:46:57.052248+0000","last_clean":"2024-04-25T15:46:57.052248+0000","last_became_active":"2024-04-25T15:46:53.970663+0000","last_became_peered":"2024-04-25T15:46:53.970663+0000","last_unstale":"2024-04-25T15:46:57.052248+0000","last_undegraded":"2024-04-25T15:46:57.052248+0000","last_fullsized":"2024-04-25T15:46:57.052248+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:57.454313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051985+0000","last_change":"2024-04-25T15:46:54.973613+0000","last_active":"2024-04-25T15:46:57.051985+0000","last_peered":"2024-04-25T15:46:57.051985+0000","last_clean":"2024-04-25T15:46:57.051985+0000","last_became_active":"2024-04-25T15:46:54.973286+0000","last_became_peered":"2024-04-25T15:46:54.973286+0000","last_unstale":"2024-04-25T15:46:57.051985+0000","last_undegraded":"2024-04-25T15:46:57.051985+0000","last_fullsized":"2024-04-25T15:46:57.051985+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:41.798144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051445+0000","last_change":"2024-04-25T15:46:53.967992+0000","last_active":"2024-04-25T15:46:57.051445+0000","last_peered":"2024-04-25T15:46:57.051445+0000","last_clean":"2024-04-25T15:46:57.051445+0000","last_became_active":"2024-04-25T15:46:53.967078+0000","last_became_peered":"2024-04-25T15:46:53.967078+0000","last_unstale":"2024-04-25T15:46:57.051445+0000","last_undegraded":"2024-04-25T15:46:57.051445+0000","last_fullsized":"2024-04-25T15:46:57.051445+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:49.283350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052618+0000","last_change":"2024-04-25T15:46:54.985610+0000","last_active":"2024-04-25T15:46:57.052618+0000","last_peered":"2024-04-25T15:46:57.052618+0000","last_clean":"2024-04-25T15:46:57.052618+0000","last_became_active":"2024-04-25T15:46:54.985132+0000","last_became_peered":"2024-04-25T15:46:54.985132+0000","last_unstale":"2024-04-25T15:46:57.052618+0000","last_undegraded":"2024-04-25T15:46:57.052618+0000","last_fullsized":"2024-04-25T15:46:57.052618+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:03.166672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052746+0000","last_change":"2024-04-25T15:46:53.970573+0000","last_active":"2024-04-25T15:46:57.052746+0000","last_peered":"2024-04-25T15:46:57.052746+0000","last_clean":"2024-04-25T15:46:57.052746+0000","last_became_active":"2024-04-25T15:46:53.970245+0000","last_became_peered":"2024-04-25T15:46:53.970245+0000","last_unstale":"2024-04-25T15:46:57.052746+0000","last_undegraded":"2024-04-25T15:46:57.052746+0000","last_fullsized":"2024-04-25T15:46:57.052746+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:41.292568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.957687+0000","last_change":"2024-04-25T15:46:54.983548+0000","last_active":"2024-04-25T15:46:56.957687+0000","last_peered":"2024-04-25T15:46:56.957687+0000","last_clean":"2024-04-25T15:46:56.957687+0000","last_became_active":"2024-04-25T15:46:54.983257+0000","last_became_peered":"2024-04-25T15:46:54.983257+0000","last_unstale":"2024-04-25T15:46:56.957687+0000","last_undegraded":"2024-04-25T15:46:56.957687+0000","last_fullsized":"2024-04-25T15:46:56.957687+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:13.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052265+0000","last_change":"2024-04-25T15:46:53.970973+0000","last_active":"2024-04-25T15:46:57.052265+0000","last_peered":"2024-04-25T15:46:57.052265+0000","last_clean":"2024-04-25T15:46:57.052265+0000","last_became_active":"2024-04-25T15:46:53.970675+0000","last_became_peered":"2024-04-25T15:46:53.970675+0000","last_unstale":"2024-04-25T15:46:57.052265+0000","last_undegraded":"2024-04-25T15:46:57.052265+0000","last_fullsized":"2024-04-25T15:46:57.052265+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:48.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954182+0000","last_change":"2024-04-25T15:46:54.965465+0000","last_active":"2024-04-25T15:46:55.954182+0000","last_peered":"2024-04-25T15:46:55.954182+0000","last_clean":"2024-04-25T15:46:55.954182+0000","last_became_active":"2024-04-25T15:46:54.965161+0000","last_became_peered":"2024-04-25T15:46:54.965161+0000","last_unstale":"2024-04-25T15:46:55.954182+0000","last_undegraded":"2024-04-25T15:46:55.954182+0000","last_fullsized":"2024-04-25T15:46:55.954182+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:54.884697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"99'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:56.958226+0000","last_change":"2024-04-25T15:46:53.964407+0000","last_active":"2024-04-25T15:46:56.958226+0000","last_peered":"2024-04-25T15:46:56.958226+0000","last_clean":"2024-04-25T15:46:56.958226+0000","last_became_active":"2024-04-25T15:46:53.963305+0000","last_became_peered":"2024-04-25T15:46:53.963305+0000","last_unstale":"2024-04-25T15:46:56.958226+0000","last_undegraded":"2024-04-25T15:46:56.958226+0000","last_fullsized":"2024-04-25T15:46:56.958226+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:20.840036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051321+0000","last_change":"2024-04-25T15:46:54.972801+0000","last_active":"2024-04-25T15:46:57.051321+0000","last_peered":"2024-04-25T15:46:57.051321+0000","last_clean":"2024-04-25T15:46:57.051321+0000","last_became_active":"2024-04-25T15:46:54.972492+0000","last_became_peered":"2024-04-25T15:46:54.972492+0000","last_unstale":"2024-04-25T15:46:57.051321+0000","last_undegraded":"2024-04-25T15:46:57.051321+0000","last_fullsized":"2024-04-25T15:46:57.051321+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:05.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051741+0000","last_change":"2024-04-25T15:46:53.970133+0000","last_active":"2024-04-25T15:46:57.051741+0000","last_peered":"2024-04-25T15:46:57.051741+0000","last_clean":"2024-04-25T15:46:57.051741+0000","last_became_active":"2024-04-25T15:46:53.969839+0000","last_became_peered":"2024-04-25T15:46:53.969839+0000","last_unstale":"2024-04-25T15:46:57.051741+0000","last_undegraded":"2024-04-25T15:46:57.051741+0000","last_fullsized":"2024-04-25T15:46:57.051741+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:30.543513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956382+0000","last_change":"2024-04-25T15:46:54.970275+0000","last_active":"2024-04-25T15:46:55.956382+0000","last_peered":"2024-04-25T15:46:55.956382+0000","last_clean":"2024-04-25T15:46:55.956382+0000","last_became_active":"2024-04-25T15:46:54.969945+0000","last_became_peered":"2024-04-25T15:46:54.969945+0000","last_unstale":"2024-04-25T15:46:55.956382+0000","last_undegraded":"2024-04-25T15:46:55.956382+0000","last_fullsized":"2024-04-25T15:46:55.956382+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:56.752047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052014+0000","last_change":"2024-04-25T15:46:53.968093+0000","last_active":"2024-04-25T15:46:57.052014+0000","last_peered":"2024-04-25T15:46:57.052014+0000","last_clean":"2024-04-25T15:46:57.052014+0000","last_became_active":"2024-04-25T15:46:53.967755+0000","last_became_peered":"2024-04-25T15:46:53.967755+0000","last_unstale":"2024-04-25T15:46:57.052014+0000","last_undegraded":"2024-04-25T15:46:57.052014+0000","last_fullsized":"2024-04-25T15:46:57.052014+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:35.319494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052334+0000","last_change":"2024-04-25T15:46:54.985029+0000","last_active":"2024-04-25T15:46:57.052334+0000","last_peered":"2024-04-25T15:46:57.052334+0000","last_clean":"2024-04-25T15:46:57.052334+0000","last_became_active":"2024-04-25T15:46:54.983866+0000","last_became_peered":"2024-04-25T15:46:54.983866+0000","last_unstale":"2024-04-25T15:46:57.052334+0000","last_undegraded":"2024-04-25T15:46:57.052334+0000","last_fullsized":"2024-04-25T15:46:57.052334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:19.413664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954617+0000","last_change":"2024-04-25T15:46:53.967678+0000","last_active":"2024-04-25T15:46:55.954617+0000","last_peered":"2024-04-25T15:46:55.954617+0000","last_clean":"2024-04-25T15:46:55.954617+0000","last_became_active":"2024-04-25T15:46:53.964635+0000","last_became_peered":"2024-04-25T15:46:53.964635+0000","last_unstale":"2024-04-25T15:46:55.954617+0000","last_undegraded":"2024-04-25T15:46:55.954617+0000","last_fullsized":"2024-04-25T15:46:55.954617+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:34.339553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052523+0000","last_change":"2024-04-25T15:46:54.984298+0000","last_active":"2024-04-25T15:46:57.052523+0000","last_peered":"2024-04-25T15:46:57.052523+0000","last_clean":"2024-04-25T15:46:57.052523+0000","last_became_active":"2024-04-25T15:46:54.983965+0000","last_became_peered":"2024-04-25T15:46:54.983965+0000","last_unstale":"2024-04-25T15:46:57.052523+0000","last_undegraded":"2024-04-25T15:46:57.052523+0000","last_fullsized":"2024-04-25T15:46:57.052523+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:32:15.855336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052412+0000","last_change":"2024-04-25T15:46:53.968248+0000","last_active":"2024-04-25T15:46:57.052412+0000","last_peered":"2024-04-25T15:46:57.052412+0000","last_clean":"2024-04-25T15:46:57.052412+0000","last_became_active":"2024-04-25T15:46:53.967888+0000","last_became_peered":"2024-04-25T15:46:53.967888+0000","last_unstale":"2024-04-25T15:46:57.052412+0000","last_undegraded":"2024-04-25T15:46:57.052412+0000","last_fullsized":"2024-04-25T15:46:57.052412+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:44.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.954917+0000","last_change":"2024-04-25T15:46:54.965208+0000","last_active":"2024-04-25T15:46:55.954917+0000","last_peered":"2024-04-25T15:46:55.954917+0000","last_clean":"2024-04-25T15:46:55.954917+0000","last_became_active":"2024-04-25T15:46:54.964892+0000","last_became_peered":"2024-04-25T15:46:54.964892+0000","last_unstale":"2024-04-25T15:46:55.954917+0000","last_undegraded":"2024-04-25T15:46:55.954917+0000","last_fullsized":"2024-04-25T15:46:55.954917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:39.123019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.051448+0000","last_change":"2024-04-25T15:46:53.970313+0000","last_active":"2024-04-25T15:46:57.051448+0000","last_peered":"2024-04-25T15:46:57.051448+0000","last_clean":"2024-04-25T15:46:57.051448+0000","last_became_active":"2024-04-25T15:46:53.969993+0000","last_became_peered":"2024-04-25T15:46:53.969993+0000","last_unstale":"2024-04-25T15:46:57.051448+0000","last_undegraded":"2024-04-25T15:46:57.051448+0000","last_fullsized":"2024-04-25T15:46:57.051448+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:46.966461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956713+0000","last_change":"2024-04-25T15:46:54.970442+0000","last_active":"2024-04-25T15:46:55.956713+0000","last_peered":"2024-04-25T15:46:55.956713+0000","last_clean":"2024-04-25T15:46:55.956713+0000","last_became_active":"2024-04-25T15:46:54.970148+0000","last_became_peered":"2024-04-25T15:46:54.970148+0000","last_unstale":"2024-04-25T15:46:55.956713+0000","last_undegraded":"2024-04-25T15:46:55.956713+0000","last_fullsized":"2024-04-25T15:46:55.956713+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:05.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052755+0000","last_change":"2024-04-25T15:46:53.968009+0000","last_active":"2024-04-25T15:46:57.052755+0000","last_peered":"2024-04-25T15:46:57.052755+0000","last_clean":"2024-04-25T15:46:57.052755+0000","last_became_active":"2024-04-25T15:46:53.967723+0000","last_became_peered":"2024-04-25T15:46:53.967723+0000","last_unstale":"2024-04-25T15:46:57.052755+0000","last_undegraded":"2024-04-25T15:46:57.052755+0000","last_fullsized":"2024-04-25T15:46:57.052755+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:17.097099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.956324+0000","last_change":"2024-04-25T15:46:54.968610+0000","last_active":"2024-04-25T15:46:55.956324+0000","last_peered":"2024-04-25T15:46:55.956324+0000","last_clean":"2024-04-25T15:46:55.956324+0000","last_became_active":"2024-04-25T15:46:54.968326+0000","last_became_peered":"2024-04-25T15:46:54.968326+0000","last_unstale":"2024-04-25T15:46:55.956324+0000","last_undegraded":"2024-04-25T15:46:55.956324+0000","last_fullsized":"2024-04-25T15:46:55.956324+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:53.941751+0000","last_clean_scrub_stamp":"2024-04-25T15:46:53.941751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:13.407938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:57.052638+0000","last_change":"2024-04-25T15:46:53.971368+0000","last_active":"2024-04-25T15:46:57.052638+0000","last_peered":"2024-04-25T15:46:57.052638+0000","last_clean":"2024-04-25T15:46:57.052638+0000","last_became_active":"2024-04-25T15:46:53.970376+0000","last_became_peered":"2024-04-25T15:46:53.970376+0000","last_unstale":"2024-04-25T15:46:57.052638+0000","last_undegraded":"2024-04-25T15:46:57.052638+0000","last_fullsized":"2024-04-25T15:46:57.052638+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:52.939535+0000","last_clean_scrub_stamp":"2024-04-25T15:46:52.939535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:47.146101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":268,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T15:46:55.953984+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:46:55.953984+0000","last_peered":"2024-04-25T15:46:55.953984+0000","last_clean":"2024-04-25T15:46:55.953984+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:46:55.953984+0000","last_undegraded":"2024-04-25T15:46:55.953984+0000","last_fullsized":"2024-04-25T15:46:55.953984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1245184,"data_stored":563470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1228800,"data_stored":561836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1228800,"data_stored":561288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542199,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1228800,"data_stored":561288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1153324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1826816,"data_stored":1151782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":561254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1232896,"data_stored":561346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:47:02.804 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:47:02.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T15:47:02.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.954+0000 7f193f75f640 1 Processor -- start 2024-04-25T15:47:02.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.954+0000 7f193f75f640 1 -- start start 2024-04-25T15:47:02.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193f75f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 0x7f19380718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193f75f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 0x7f1938160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193f75f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1938071df0 con 0x7f193806db10 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193f75f640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f193815faf0 con 0x7f19380714a0 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193f75f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f193815ec30 con 0x7f193815ff80 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193ccfa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 0x7f19380718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193dcfc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 0x7f1938160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193ccfa640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 0x7f19380718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:57142/0 (socket says 172.21.15.80:57142) 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193dcfc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 0x7f1938160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:44076/0 (socket says 172.21.15.80:44076) 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193ccfa640 1 -- 172.21.15.80:0/550534766 learned_addr learned my addr 172.21.15.80:0/550534766 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193dcfc640 1 -- 172.21.15.80:0/550534766 >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 msgr2=0x7f19380718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193dcfc640 1 --2- 172.21.15.80:0/550534766 >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 0x7f19380718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193dcfc640 1 -- 172.21.15.80:0/550534766 >> v1:172.21.15.195:6789/0 conn(0x7f193806db10 legacy=0x7f193815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f193dcfc640 1 -- 172.21.15.80:0/550534766 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19381589c0 con 0x7f193815ff80 2024-04-25T15:47:02.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.956+0000 7f192ffff640 1 -- 172.21.15.80:0/550534766 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872630744 0 0) 0x7f1934001110 con 0x7f193806db10 2024-04-25T15:47:02.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.957+0000 7f193ccfa640 1 --2- 172.21.15.80:0/550534766 >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 0x7f19380718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.957+0000 7f193dcfc640 1 --2- 172.21.15.80:0/550534766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 0x7f1938160390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1930009d90 tx=0x7f193002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fbc20a79118e1c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.957+0000 7f192ffff640 1 -- 172.21.15.80:0/550534766 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930007740 con 0x7f193815ff80 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.957+0000 7f192ffff640 1 -- 172.21.15.80:0/550534766 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300078e0 con 0x7f193815ff80 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.957+0000 7f192ffff640 1 -- 172.21.15.80:0/550534766 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930007cb0 con 0x7f193815ff80 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 -- 172.21.15.80:0/550534766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 msgr2=0x7f1938160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 --2- 172.21.15.80:0/550534766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 0x7f1938160390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1930009d90 tx=0x7f193002a660 comp rx=0 tx=0).stop 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 -- 172.21.15.80:0/550534766 shutdown_connections 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 --2- 172.21.15.80:0/550534766 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f193815ff80 0x7f1938160390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 --2- 172.21.15.80:0/550534766 >> v2:172.21.15.195:3300/0 conn(0x7f19380714a0 0x7f19380718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 -- 172.21.15.80:0/550534766 >> 172.21.15.80:0/550534766 conn(0x7f19380d2080 msgr2=0x7f19380d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 -- 172.21.15.80:0/550534766 shutdown_connections 2024-04-25T15:47:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.958+0000 7f193f75f640 1 -- 172.21.15.80:0/550534766 wait complete. 2024-04-25T15:47:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.960+0000 7f193f75f640 1 Processor -- start 2024-04-25T15:47:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.960+0000 7f193f75f640 1 -- start start 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193f75f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f193806db10 0x7f193815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193f75f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19380714a0 0x7f19381f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193f75f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 0x7f19381f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193f75f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f193815f780 con 0x7f193815ff80 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193f75f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f193815f170 con 0x7f193806db10 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193f75f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f193815f450 con 0x7f19380714a0 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193dcfc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 0x7f19381f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193dcfc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 0x7f19381f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34044/0 (socket says 172.21.15.80:34044) 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.961+0000 7f193dcfc640 1 -- 172.21.15.80:0/1471268313 learned_addr learned my addr 172.21.15.80:0/1471268313 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193d4fb640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f193806db10 0x7f193815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193ccfa640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19380714a0 0x7f19381f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193dcfc640 1 -- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19380714a0 msgr2=0x7f19381f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193dcfc640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19380714a0 0x7f19381f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193dcfc640 1 -- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f193806db10 msgr2=0x7f193815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193dcfc640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f193806db10 0x7f193815b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193dcfc640 1 -- 172.21.15.80:0/1471268313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193815c430 con 0x7f193815ff80 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193dcfc640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 0x7f19381f4900 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f1930009eb0 tx=0x7f1930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193003f070 con 0x7f193815ff80 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1930031c40 con 0x7f193815ff80 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930009450 con 0x7f193815ff80 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193815c710 con 0x7f193815ff80 2024-04-25T15:47:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.962+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193815ccd0 con 0x7f193815ff80 2024-04-25T15:47:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.963+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19380d1a50 con 0x7f193815ff80 2024-04-25T15:47:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.964+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1930003990 con 0x7f193815ff80 2024-04-25T15:47:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.964+0000 7f192dffb640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f191c0744e0 0x7f191c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.964+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f19300b63c0 con 0x7f193815ff80 2024-04-25T15:47:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.965+0000 7f193d4fb640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f191c0744e0 0x7f191c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.965+0000 7f193d4fb640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f191c0744e0 0x7f191c0769f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1934000f60 tx=0x7f1934009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:02.969+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19380d1a50 con 0x7f193815ff80 2024-04-25T15:47:03.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.217+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f193815c1c0 con 0x7f193815ff80 2024-04-25T15:47:03.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.221+0000 7f192dffb640 1 -- 172.21.15.80:0/1471268313 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f1930080370 con 0x7f193815ff80 2024-04-25T15:47:03.223 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T15:47:03.223 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNeSpmypqKIhAAh2dXzqEYLquKVMDirQedfw== 2024-04-25T15:47:03.223 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-25T15:47:03.223 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-25T15:47:03.223 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T15:47:03.223 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-25T15:47:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f191c0744e0 msgr2=0x7f191c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f191c0744e0 0x7f191c0769f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1934000f60 tx=0x7f1934009040 comp rx=0 tx=0).stop 2024-04-25T15:47:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 msgr2=0x7f19381f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 0x7f19381f4900 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f1930009eb0 tx=0x7f1930004a40 comp rx=0 tx=0).stop 2024-04-25T15:47:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 shutdown_connections 2024-04-25T15:47:03.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f191c0744e0 0x7f191c0769f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193815ff80 0x7f19381f4900 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19380714a0 0x7f19381f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 --2- 172.21.15.80:0/1471268313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f193806db10 0x7f193815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 >> 172.21.15.80:0/1471268313 conn(0x7f19380d2080 msgr2=0x7f1938156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 shutdown_connections 2024-04-25T15:47:03.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.224+0000 7f193f75f640 1 -- 172.21.15.80:0/1471268313 wait complete. 2024-04-25T15:47:03.236 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.343+0000 7f28faafa640 1 Processor -- start 2024-04-25T15:47:03.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.343+0000 7f28faafa640 1 -- start start 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28faafa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 0x7f28f4162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28faafa640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f40d37e0 con 0x7f28f40ce810 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28faafa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f40b8240 con 0x7f28f40d22c0 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28faafa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f28f409cd00 con 0x7f28f40d26d0 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28f9097640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f28f40ce810 0x7f28f40cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43780/0 (socket says 172.21.15.80:43780) 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28f9097640 1 -- 172.21.15.80:0/519850231 learned_addr learned my addr 172.21.15.80:0/519850231 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832357465 0 0) 0x7f28f40d37e0 con 0x7f28f40ce810 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28f3fff640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 0x7f28f4162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.344+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28dc003520 con 0x7f28f40ce810 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 659026626 0 0) 0x7f28dc003520 con 0x7f28f40ce810 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 msgr2=0x7f28f4162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:03.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 0x7f28f4162df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 >> v1:172.21.15.195:6789/0 conn(0x7f28f40d22c0 legacy=0x7f28f41626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f40b91c0 con 0x7f28f40ce810 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f28ec0019f0 con 0x7f28f40ce810 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 >> v1:172.21.15.80:6789/0 conn(0x7f28f40ce810 legacy=0x7f28f40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28dc0039e0 0x7f28dc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28dc004800 0x7f28dc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 0x7f28dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc005560 con 0x7f28dc004800 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc00bf00 con 0x7f28dc0039e0 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc00c080 con 0x7f28f40d26d0 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f3fff640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28dc004800 0x7f28dc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f8896640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28dc0039e0 0x7f28dc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f9097640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 0x7f28dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f3fff640 1 -- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 msgr2=0x7f28dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:03.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f3fff640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28f40d26d0 0x7f28dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f3fff640 1 -- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28dc0039e0 msgr2=0x7f28dc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f3fff640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28dc0039e0 0x7f28dc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.345+0000 7f28f3fff640 1 -- 172.21.15.80:0/519850231 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc003520 con 0x7f28dc004800 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.346+0000 7f28f3fff640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28dc004800 0x7f28dc004c10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009ac0 tx=0x7f28dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9440db590b005657 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.346+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8036070 con 0x7f28dc004800 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.346+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e8031400 con 0x7f28dc004800 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.346+0000 7f28f37fe640 1 -- 172.21.15.80:0/519850231 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8009690 con 0x7f28dc004800 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28faafa640 1 -- 172.21.15.80:0/519850231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28dc004800 msgr2=0x7f28dc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28faafa640 1 --2- 172.21.15.80:0/519850231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28dc004800 0x7f28dc004c10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009ac0 tx=0x7f28dc005830 comp rx=0 tx=0).stop 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28f9097640 1 -- 172.21.15.80:0/519850231 reap_dead start 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28faafa640 1 -- 172.21.15.80:0/519850231 shutdown_connections 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28faafa640 1 -- 172.21.15.80:0/519850231 >> 172.21.15.80:0/519850231 conn(0x7f28f40d0450 msgr2=0x7f28f40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:03.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28faafa640 1 -- 172.21.15.80:0/519850231 shutdown_connections 2024-04-25T15:47:03.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.347+0000 7f28faafa640 1 -- 172.21.15.80:0/519850231 wait complete. 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.349+0000 7f28faafa640 1 Processor -- start 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.349+0000 7f28faafa640 1 -- start start 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28faafa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28dc004800 0x7f28f41e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28faafa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 0x7f28f41dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28faafa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28f40c98f0 0x7f28f40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28faafa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28f409d190 con 0x7f28f41e27a0 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28faafa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f28f40cfe50 con 0x7f28f40c98f0 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28faafa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f28f40d47e0 con 0x7f28dc004800 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 0x7f28f41dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 0x7f28f41dd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34076/0 (socket says 172.21.15.80:34076) 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 -- 172.21.15.80:0/3194316543 learned_addr learned my addr 172.21.15.80:0/3194316543 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f9097640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28f40c98f0 0x7f28f40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f8896640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28dc004800 0x7f28f41e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 -- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28dc004800 msgr2=0x7f28f41e2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28dc004800 0x7f28f41e2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 -- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28f40c98f0 msgr2=0x7f28f40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28f40c98f0 0x7f28f40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.350+0000 7f28f3fff640 1 -- 172.21.15.80:0/3194316543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f40ca240 con 0x7f28f41e27a0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.351+0000 7f28f3fff640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 0x7f28f41dd6f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f28e8034040 tx=0x7f28e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.351+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8040020 con 0x7f28f41e27a0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.351+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e8003bc0 con 0x7f28f41e27a0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.351+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f41e3790 con 0x7f28f41e27a0 2024-04-25T15:47:03.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.351+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8036040 con 0x7f28f41e27a0 2024-04-25T15:47:03.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.351+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41e3d50 con 0x7f28f41e27a0 2024-04-25T15:47:03.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.352+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f406a100 con 0x7f28f41e27a0 2024-04-25T15:47:03.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.353+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f28e8043020 con 0x7f28f41e27a0 2024-04-25T15:47:03.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.353+0000 7f28f17fa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28e00744b0 0x7f28e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:03.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.353+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f28e80b5560 con 0x7f28f41e27a0 2024-04-25T15:47:03.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.353+0000 7f28f8896640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28e00744b0 0x7f28e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.354+0000 7f28f8896640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28e00744b0 0x7f28e00769c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f28e4007fd0 tx=0x7f28e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:03.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.358+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28e804a070 con 0x7f28f41e27a0 2024-04-25T15:47:03.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.567+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28f40c7060 con 0x7f28f41e27a0 2024-04-25T15:47:03.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.567+0000 7f28f17fa640 1 -- 172.21.15.80:0/3194316543 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5186 (secure 0 0 0) 0x7f28f40ca240 con 0x7f28f41e27a0 2024-04-25T15:47:03.568 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:03.568 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":52,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3406883775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3406883775},{"type":"v1","addr":"172.21.15.80:6837","nonce":3406883775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/657778508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":657778508},{"type":"v1","addr":"172.21.15.195:6835","nonce":657778508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/2812835007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2812835007},{"type":"v1","addr":"172.21.15.195:6834","nonce":2812835007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:46:56.316544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7548":{"gid":7548,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6836/3726019359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3726019359},{"type":"v1","addr":"172.21.15.80:6836","nonce":3726019359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7548,"qdb_cluster":[7548]},"id":7}]} 2024-04-25T15:47:03.569 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 52 2024-04-25T15:47:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28e00744b0 msgr2=0x7f28e00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28e00744b0 0x7f28e00769c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f28e4007fd0 tx=0x7f28e4009040 comp rx=0 tx=0).stop 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 msgr2=0x7f28f41dd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 0x7f28f41dd6f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f28e8034040 tx=0x7f28e8004730 comp rx=0 tx=0).stop 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 shutdown_connections 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f28e00744b0 0x7f28e00769c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28f40c98f0 0x7f28f40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f41e27a0 0x7f28f41dd6f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 --2- 172.21.15.80:0/3194316543 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28dc004800 0x7f28f41e2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 >> 172.21.15.80:0/3194316543 conn(0x7f28f40d0450 msgr2=0x7f28f41e7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 shutdown_connections 2024-04-25T15:47:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:03.569+0000 7f28faafa640 1 -- 172.21.15.80:0/3194316543 wait complete. 2024-04-25T15:47:03.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:54.313611+0000', 'modified': '2024-04-25T15:46:56.316544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7548}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7548': {'gid': 7548, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6836/3726019359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3726019359}, {'type': 'v1', 'addr': '172.21.15.80:6836', 'nonce': 3726019359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7548, 'qdb_cluster': [7548]} 2024-04-25T15:47:03.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:47:03.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:47:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.094+0000 7faf67c82640 1 Processor -- start 2024-04-25T15:47:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.095+0000 7faf67c82640 1 -- start start 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf67c82640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf600b4b60 0x7faf600b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf67c82640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf600b2f30 con 0x7faf6006d6d0 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf67c82640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf600b2c90 con 0x7faf600b3850 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf67c82640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf6006eb60 con 0x7faf600b4b60 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf6521d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faf6006d6d0 0x7faf600b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43794/0 (socket says 172.21.15.80:43794) 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf6521d640 1 -- 172.21.15.80:0/1388235451 learned_addr learned my addr 172.21.15.80:0/1388235451 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284856430 0 0) 0x7faf600b2f30 con 0x7faf6006d6d0 2024-04-25T15:47:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf4c003520 con 0x7faf6006d6d0 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.096+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf600b4b60 0x7faf600b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1509292001 0 0) 0x7faf4c003520 con 0x7faf6006d6d0 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf600b4b60 msgr2=0x7faf600b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf600b4b60 0x7faf600b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 >> v1:172.21.15.195:6789/0 conn(0x7faf600b3850 legacy=0x7faf6016a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf600d10a0 con 0x7faf6006d6d0 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7faf50001670 con 0x7faf6006d6d0 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 >> v1:172.21.15.80:6789/0 conn(0x7faf6006d6d0 legacy=0x7faf600b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c0039e0 0x7faf4c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf4c004800 0x7faf4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c005350 0x7faf4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faf6006eb60 con 0x7faf4c005350 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c00c200 con 0x7faf4c0039e0 2024-04-25T15:47:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf4c00c400 con 0x7faf4c004800 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf600b4b60 0x7faf600b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6621f640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c005350 0x7faf4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6521d640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf4c004800 0x7faf4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c0039e0 0x7faf4c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6621f640 1 -- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf4c004800 msgr2=0x7faf4c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6621f640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf4c004800 0x7faf4c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6621f640 1 -- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c0039e0 msgr2=0x7faf4c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6621f640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c0039e0 0x7faf4c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.097+0000 7faf6621f640 1 -- 172.21.15.80:0/1388235451 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c003520 con 0x7faf4c005350 2024-04-25T15:47:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.098+0000 7faf6621f640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c005350 0x7faf4c00b9c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7faf58001750 tx=0x7faf4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53904c397eb8d16f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.098+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58001370 con 0x7faf4c005350 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.098+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf580052d0 con 0x7faf4c005350 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.098+0000 7faf64a1c640 1 -- 172.21.15.80:0/1388235451 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5802abe0 con 0x7faf4c005350 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf67c82640 1 -- 172.21.15.80:0/1388235451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c005350 msgr2=0x7faf4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf67c82640 1 --2- 172.21.15.80:0/1388235451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf4c005350 0x7faf4c00b9c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7faf58001750 tx=0x7faf4c005830 comp rx=0 tx=0).stop 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf6621f640 1 -- 172.21.15.80:0/1388235451 reap_dead start 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf67c82640 1 -- 172.21.15.80:0/1388235451 shutdown_connections 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf67c82640 1 -- 172.21.15.80:0/1388235451 >> 172.21.15.80:0/1388235451 conn(0x7faf600d0450 msgr2=0x7faf600d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf67c82640 1 -- 172.21.15.80:0/1388235451 shutdown_connections 2024-04-25T15:47:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.099+0000 7faf67c82640 1 -- 172.21.15.80:0/1388235451 wait complete. 2024-04-25T15:47:04.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.101+0000 7faf67c82640 1 Processor -- start 2024-04-25T15:47:04.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.101+0000 7faf67c82640 1 -- start start 2024-04-25T15:47:04.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf67c82640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c005350 0x7faf600c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf67c82640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf601f6960 0x7faf601db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf67c82640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 0x7faf600b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf67c82640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faf600d2f50 con 0x7faf600b6d00 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf67c82640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faf6009cbe0 con 0x7faf4c005350 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf67c82640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf6009d0e0 con 0x7faf601f6960 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 0x7faf600b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 0x7faf600b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34086/0 (socket says 172.21.15.80:34086) 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 -- 172.21.15.80:0/2958236359 learned_addr learned my addr 172.21.15.80:0/2958236359 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c005350 0x7faf600c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6521d640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf601f6960 0x7faf601db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 -- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf601f6960 msgr2=0x7faf601db9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf601f6960 0x7faf601db9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 -- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c005350 msgr2=0x7faf600c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c005350 0x7faf600c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 -- 172.21.15.80:0/2958236359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf600b7650 con 0x7faf600b6d00 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.102+0000 7faf6621f640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 0x7faf600b7110 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7faf58001870 tx=0x7faf58001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.103+0000 7faf567fc640 1 -- 172.21.15.80:0/2958236359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58037040 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.103+0000 7faf567fc640 1 -- 172.21.15.80:0/2958236359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf58040070 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.103+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601f9280 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.103+0000 7faf567fc640 1 -- 172.21.15.80:0/2958236359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58007a30 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.103+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601f9840 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.104+0000 7faf567fc640 1 -- 172.21.15.80:0/2958236359 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faf580052d0 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.105+0000 7faf567fc640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf440744e0 0x7faf440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.105+0000 7faf567fc640 1 -- 172.21.15.80:0/2958236359 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7faf580b4de0 con 0x7faf600b6d00 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.105+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf440744e0 0x7faf440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.105+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf440744e0 0x7faf440769f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faf60075e60 tx=0x7faf5c009750 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.106+0000 7faf6ec0d740 1 Processor -- start 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.106+0000 7faf6ec0d740 1 -- start start 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf69270 0x562a6c335600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 0x562a6c331fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c30b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562a6c26f740 con 0x562a6bf403b0 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x562a6c20b3a0 con 0x562a6bf48590 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x562a6c26b700 con 0x562a6bf69270 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6521d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 0x562a6c331fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6521d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 0x562a6c331fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34096/0 (socket says 172.21.15.80:34096) 2024-04-25T15:47:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.107+0000 7faf6521d640 1 -- 172.21.15.80:0/2440592253 learned_addr learned my addr 172.21.15.80:0/2440592253 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf69270 0x562a6c335600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6621f640 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c30b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6521d640 1 -- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf69270 msgr2=0x562a6c335600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6521d640 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf69270 0x562a6c335600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6521d640 1 -- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 msgr2=0x562a6c30b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6521d640 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c30b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6521d640 1 -- 172.21.15.80:0/2440592253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6c227750 con 0x562a6bf403b0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6621f640 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c30b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf6521d640 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 0x562a6c331fa0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7faf50007d00 tx=0x7faf50004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f15eefd95a52c17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf437fe640 1 -- 172.21.15.80:0/2440592253 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50007560 con 0x562a6bf403b0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf437fe640 1 -- 172.21.15.80:0/2440592253 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5001a070 con 0x562a6bf403b0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.108+0000 7faf437fe640 1 -- 172.21.15.80:0/2440592253 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50015670 con 0x562a6bf403b0 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2440592253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 msgr2=0x562a6c331fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 0x562a6c331fa0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7faf50007d00 tx=0x7faf50004bb0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2440592253 shutdown_connections 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c30b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf403b0 0x562a6c331fa0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2440592253 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf69270 0x562a6c335600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2440592253 >> 172.21.15.80:0/2440592253 conn(0x562a6bf5d3c0 msgr2=0x562a6c30a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2440592253 shutdown_connections 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.109+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2440592253 wait complete. 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.110+0000 7faf6ec0d740 1 -- start start 2024-04-25T15:47:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.110+0000 7faf6ec0d740 1 Processor -- start 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.111+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf403b0 0x562a6c34f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.111+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf48590 0x562a6c34da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c34df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562a6c1f6fe0 con 0x562a6bf69270 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x562a6c3322e0 con 0x562a6bf403b0 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x562a6c3502a0 con 0x562a6bf48590 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6ec0d740 10 client.0 _ll_register_callbacks cb 0x562a6c20d150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c34df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c34df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34106/0 (socket says 172.21.15.80:34106) 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 -- 172.21.15.80:0/2402419665 learned_addr learned my addr 172.21.15.80:0/2402419665 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf403b0 0x562a6c34f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6521d640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf48590 0x562a6c34da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 -- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf48590 msgr2=0x562a6c34da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf48590 0x562a6c34da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 -- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf403b0 msgr2=0x562a6c34f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf403b0 0x562a6c34f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 -- 172.21.15.80:0/2402419665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6bf812d0 con 0x562a6bf69270 2024-04-25T15:47:04.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf6621f640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c34df50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7faf5807bec0 tx=0x7faf580077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af011611249dd49d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.112+0000 7faf40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:04.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.115+0000 7faf40ff9640 1 -- 172.21.15.80:0/2402419665 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5807ece0 con 0x562a6bf69270 2024-04-25T15:47:04.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.115+0000 7faf40ff9640 1 -- 172.21.15.80:0/2402419665 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7faf5807ce40 con 0x562a6bf69270 2024-04-25T15:47:04.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.115+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5001a070 con 0x562a6bf69270 2024-04-25T15:47:04.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.115+0000 7faf40ff9640 1 -- 172.21.15.80:0/2402419665 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7faf58083090 con 0x562a6bf69270 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.115+0000 7faf6ec0d740 10 client.7707 fetch_fsmap learned FSMap version 52 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.115+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x562a6c04b6b0 con 0x562a6bf69270 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf40ff9640 1 -- 172.21.15.80:0/2402419665 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5001a070 con 0x562a6bf69270 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf40ff9640 1 -- 172.21.15.80:0/2402419665 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7faf5803a070 con 0x562a6bf69270 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf6ec0d740 10 client.7707 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf6ec0d740 10 client.7707 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf6ec0d740 20 client.7707 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6bf27e40 0x562a6c331110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf6ec0d740 4 client.7707 mds_command: new command op to 7548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 --> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a6c27d350 con 0x562a6bf27e40 2024-04-25T15:47:04.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6bf27e40 0x562a6c331110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf40ff9640 10 client.7707 ms_handle_connect on v2:172.21.15.80:6834/3726019359 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.116+0000 7faf65a1e640 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6bf27e40 0x562a6c331110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97108851208b40e9 server_cookie=4a038e34b6cd4b31 in_seq=0 out_seq=0 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf40ff9640 1 -- 172.21.15.80:0/2402419665 <== mds.0 v2:172.21.15.80:6834/3726019359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562a6c27d350 con 0x562a6bf27e40 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf40ff9640 10 client.7707 handle_command_reply: tid=0 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 client.7707 shutdown 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 msgr2=0x562a6c34df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c34df50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7faf5807bec0 tx=0x7faf580077a0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 shutdown_connections 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c34df50 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf48590 0x562a6c34da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6bf27e40 0x562a6c331110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/2402419665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf403b0 0x562a6c34f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf40ff9640 0 client.7707 ms_handle_reset on v2:172.21.15.80:6834/3726019359 2024-04-25T15:47:04.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 >> 172.21.15.80:0/2402419665 conn(0x562a6bf5d3c0 msgr2=0x562a6c309d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 shutdown_connections 2024-04-25T15:47:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.117+0000 7faf6ec0d740 1 -- 172.21.15.80:0/2402419665 wait complete. 2024-04-25T15:47:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.118+0000 7faf6ec0d740 20 client.7707 trim_cache size 0 max 16384 2024-04-25T15:47:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.136+0000 7faf6ec0d740 1 Processor -- start 2024-04-25T15:47:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.136+0000 7faf6ec0d740 1 -- start start 2024-04-25T15:47:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c3511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 0x562a6c373200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf69270 0x562a6c338890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faf60202800 con 0x562a6bf48590 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faf600a0b70 con 0x562a6bf69270 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faf602021b0 con 0x562a6bf403b0 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 0x562a6c373200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 0x562a6c373200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34108/0 (socket says 172.21.15.80:34108) 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 -- 172.21.15.80:0/3620504869 learned_addr learned my addr 172.21.15.80:0/3620504869 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6621f640 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf69270 0x562a6c338890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf65a1e640 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c3511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 -- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 msgr2=0x562a6c3511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c3511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 -- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf69270 msgr2=0x562a6c338890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf69270 0x562a6c338890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 -- 172.21.15.80:0/3620504869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6c2c30a0 con 0x562a6bf48590 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf6521d640 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 0x562a6c373200 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x562a6c347180 tx=0x7faf5000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec45150ba5c0391 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf42ffd640 1 -- 172.21.15.80:0/3620504869 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50015470 con 0x562a6bf48590 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf42ffd640 1 -- 172.21.15.80:0/3620504869 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5001a070 con 0x562a6bf48590 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.138+0000 7faf42ffd640 1 -- 172.21.15.80:0/3620504869 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50015830 con 0x562a6bf48590 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 -- 172.21.15.80:0/3620504869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 msgr2=0x562a6c373200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 0x562a6c373200 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x562a6c347180 tx=0x7faf5000f000 comp rx=0 tx=0).stop 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 -- 172.21.15.80:0/3620504869 shutdown_connections 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf69270 0x562a6c338890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf48590 0x562a6c373200 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/3620504869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c3511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 -- 172.21.15.80:0/3620504869 >> 172.21.15.80:0/3620504869 conn(0x562a6bf5d3c0 msgr2=0x562a6c300cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 -- 172.21.15.80:0/3620504869 shutdown_connections 2024-04-25T15:47:04.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.139+0000 7faf6ec0d740 1 -- 172.21.15.80:0/3620504869 wait complete. 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.140+0000 7faf6ec0d740 1 -- start start 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.140+0000 7faf6ec0d740 1 Processor -- start 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c331a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c3cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c3d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562a6c31f360 con 0x562a6bf69270 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x562a6c332140 con 0x562a6bf48590 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x562a6c362ba0 con 0x562a6bf403b0 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 10 client.0 _ll_register_callbacks cb 0x7faf58000ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c3d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c3d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34124/0 (socket says 172.21.15.80:34124) 2024-04-25T15:47:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 -- 172.21.15.80:0/1680654205 learned_addr learned my addr 172.21.15.80:0/1680654205 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6521d640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c3cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c331a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 -- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 msgr2=0x562a6c331a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c331a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 -- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 msgr2=0x562a6c3cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c3cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 -- 172.21.15.80:0/1680654205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6c372c40 con 0x562a6bf69270 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c331a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6621f640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c3d06c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7faf5802a590 tx=0x7faf580b3050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c76be667dc2e292 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf40ff9640 1 -- 172.21.15.80:0/1680654205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5807e630 con 0x562a6bf69270 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf40ff9640 1 -- 172.21.15.80:0/1680654205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7faf580a0330 con 0x562a6bf69270 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.142+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5001a070 con 0x562a6bf69270 2024-04-25T15:47:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf40ff9640 1 -- 172.21.15.80:0/1680654205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7faf5807e7f0 con 0x562a6bf69270 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 10 client.7713 fetch_fsmap learned FSMap version 52 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x562a6c372c40 con 0x562a6bf69270 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf40ff9640 1 -- 172.21.15.80:0/1680654205 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5001a070 con 0x562a6bf69270 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf40ff9640 1 -- 172.21.15.80:0/1680654205 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7faf5803a070 con 0x562a6bf69270 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 10 client.7713 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 10 client.7713 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 20 client.7713 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6c3049c0 0x562a6c34d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 4 client.7713 mds_command: new command op to 7548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 --> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] -- command(tid 0: {"prefix": "status"}) -- 0x562a6c2771c0 con 0x562a6c3049c0 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6c3049c0 0x562a6c34d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf40ff9640 10 client.7713 ms_handle_connect on v2:172.21.15.80:6834/3726019359 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.143+0000 7faf65a1e640 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6c3049c0 0x562a6c34d1e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f2901803d9ff4bb server_cookie=717289dfe7ab375d in_seq=0 out_seq=0 2024-04-25T15:47:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf40ff9640 1 -- 172.21.15.80:0/1680654205 <== mds.0 v2:172.21.15.80:6834/3726019359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562a6c2771c0 con 0x562a6c3049c0 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf40ff9640 10 client.7713 handle_command_reply: tid=0 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 client.7713 shutdown 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 msgr2=0x562a6c3d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c3d06c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7faf5802a590 tx=0x7faf580b3050 comp rx=0 tx=0).stop 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 shutdown_connections 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562a6bf69270 0x562a6c3d06c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.80:6834/3726019359,v1:172.21.15.80:6836/3726019359] conn(0x562a6c3049c0 0x562a6c34d1e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a6bf48590 0x562a6c3cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 --2- 172.21.15.80:0/1680654205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x562a6bf403b0 0x562a6c331a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf40ff9640 0 client.7713 ms_handle_reset on v2:172.21.15.80:6834/3726019359 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 >> 172.21.15.80:0/1680654205 conn(0x562a6bf5d3c0 msgr2=0x562a6c3539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 shutdown_connections 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 1 -- 172.21.15.80:0/1680654205 wait complete. 2024-04-25T15:47:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.144+0000 7faf6ec0d740 20 client.7713 trim_cache size 0 max 16384 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7548, 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 9.1951810330000008, 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 52, 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 99, 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 99, 2024-04-25T15:47:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 14.219074144 2024-04-25T15:47:04.152 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:04.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf440744e0 msgr2=0x7faf440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf440744e0 0x7faf440769f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faf60075e60 tx=0x7faf5c009750 comp rx=0 tx=0).stop 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 msgr2=0x7faf600b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 0x7faf600b7110 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7faf58001870 tx=0x7faf58001120 comp rx=0 tx=0).stop 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 shutdown_connections 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faf440744e0 0x7faf440769f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf600b6d00 0x7faf600b7110 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faf601f6960 0x7faf601db9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 --2- 172.21.15.80:0/2958236359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf4c005350 0x7faf600c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 >> 172.21.15.80:0/2958236359 conn(0x7faf600d0450 msgr2=0x7faf600b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 shutdown_connections 2024-04-25T15:47:04.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.145+0000 7faf67c82640 1 -- 172.21.15.80:0/2958236359 wait complete. 2024-04-25T15:47:04.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:47:04.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:04.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:04.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.264+0000 7f24683b7640 1 Processor -- start 2024-04-25T15:47:04.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.265+0000 7f24683b7640 1 -- start start 2024-04-25T15:47:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f24683b7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f24600d41b0 0x7f24600b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f24683b7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24601602a0 0x7f24600b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f24683b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24600b7b90 0x7f24600d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f24683b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f24600b7fa0 con 0x7f24600b7b90 2024-04-25T15:47:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f24683b7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2460163fb0 con 0x7f24600d41b0 2024-04-25T15:47:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f24683b7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2460164270 con 0x7f24601602a0 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f2466954640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24600b7b90 0x7f24600d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f2466954640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24600b7b90 0x7f24600d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34128/0 (socket says 172.21.15.80:34128) 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f2466954640 1 -- 172.21.15.80:0/1510071516 learned_addr learned my addr 172.21.15.80:0/1510071516 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f2466153640 1 --2- 172.21.15.80:0/1510071516 >> v2:172.21.15.195:3300/0 conn(0x7f24600d41b0 0x7f24600b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.266+0000 7f2465952640 1 --2- 172.21.15.80:0/1510071516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24601602a0 0x7f24600b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466954640 1 -- 172.21.15.80:0/1510071516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24601602a0 msgr2=0x7f24600b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466954640 1 --2- 172.21.15.80:0/1510071516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24601602a0 0x7f24600b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466954640 1 -- 172.21.15.80:0/1510071516 >> v2:172.21.15.195:3300/0 conn(0x7f24600d41b0 msgr2=0x7f24600b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466954640 1 --2- 172.21.15.80:0/1510071516 >> v2:172.21.15.195:3300/0 conn(0x7f24600d41b0 0x7f24600b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466954640 1 -- 172.21.15.80:0/1510071516 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2460164550 con 0x7f24600b7b90 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466153640 1 --2- 172.21.15.80:0/1510071516 >> v2:172.21.15.195:3300/0 conn(0x7f24600d41b0 0x7f24600b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2466954640 1 --2- 172.21.15.80:0/1510071516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24600d0980 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f246008eaf0 tx=0x7f245802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320993f05d798ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2465151640 1 -- 172.21.15.80:0/1510071516 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458036070 con 0x7f24600b7b90 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2465151640 1 -- 172.21.15.80:0/1510071516 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2458031600 con 0x7f24600b7b90 2024-04-25T15:47:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.267+0000 7f2465151640 1 -- 172.21.15.80:0/1510071516 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24580319d0 con 0x7f24600b7b90 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 -- 172.21.15.80:0/1510071516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 msgr2=0x7f24600d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 --2- 172.21.15.80:0/1510071516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24600d0980 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f246008eaf0 tx=0x7f245802a6a0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 -- 172.21.15.80:0/1510071516 shutdown_connections 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 --2- 172.21.15.80:0/1510071516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24600d0980 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 --2- 172.21.15.80:0/1510071516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24601602a0 0x7f24600b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 --2- 172.21.15.80:0/1510071516 >> v2:172.21.15.195:3300/0 conn(0x7f24600d41b0 0x7f24600b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 -- 172.21.15.80:0/1510071516 >> 172.21.15.80:0/1510071516 conn(0x7f246006e9f0 msgr2=0x7f24600d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 -- 172.21.15.80:0/1510071516 shutdown_connections 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.268+0000 7f24683b7640 1 -- 172.21.15.80:0/1510071516 wait complete. 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.270+0000 7f24683b7640 1 Processor -- start 2024-04-25T15:47:04.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.270+0000 7f24683b7640 1 -- start start 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f24683b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24601606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f24683b7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24600d41b0 0x7f246014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f24683b7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24601602a0 0x7f246014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f24683b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f24600b4fd0 con 0x7f24600b7b90 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f24683b7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2460164b10 con 0x7f24601602a0 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f24683b7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f24600b5150 con 0x7f24600d41b0 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f2466153640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24601606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f2466153640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24601606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34140/0 (socket says 172.21.15.80:34140) 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.271+0000 7f2466153640 1 -- 172.21.15.80:0/108753821 learned_addr learned my addr 172.21.15.80:0/108753821 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2465952640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24600d41b0 0x7f246014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466153640 1 -- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24600d41b0 msgr2=0x7f246014cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466954640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24601602a0 0x7f246014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466153640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24600d41b0 0x7f246014cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466153640 1 -- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24601602a0 msgr2=0x7f246014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466153640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24601602a0 0x7f246014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466153640 1 -- 172.21.15.80:0/108753821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2460161170 con 0x7f24600b7b90 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466954640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24601602a0 0x7f246014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2466153640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24601606b0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f245c00d830 tx=0x7f245c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c018070 con 0x7f24600b7b90 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c00be10 con 0x7f24600b7b90 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2460161450 con 0x7f24600b7b90 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c004250 con 0x7f24600b7b90 2024-04-25T15:47:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.272+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2460161a10 con 0x7f24600b7b90 2024-04-25T15:47:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.273+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246006a100 con 0x7f24600b7b90 2024-04-25T15:47:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.274+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f245c0098b0 con 0x7f24600b7b90 2024-04-25T15:47:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.274+0000 7f2456ffd640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24440744e0 0x7f24440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.274+0000 7f2465952640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24440744e0 0x7f24440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.274+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f245c0955c0 con 0x7f24600b7b90 2024-04-25T15:47:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.275+0000 7f2465952640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24440744e0 0x7f24440769f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.279+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f245c05fc50 con 0x7f24600b7b90 2024-04-25T15:47:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.493+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f24600d3070 con 0x7f24600b7b90 2024-04-25T15:47:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.494+0000 7f2456ffd640 1 -- 172.21.15.80:0/108753821 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f245c05f550 con 0x7f24600b7b90 2024-04-25T15:47:04.495 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.495+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24440744e0 msgr2=0x7f24440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.495+0000 7f24683b7640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24440744e0 0x7f24440769f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450008040 comp rx=0 tx=0).stop 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.495+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 msgr2=0x7f24601606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.495+0000 7f24683b7640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24601606b0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f245c00d830 tx=0x7f245c00dcf0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 shutdown_connections 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24440744e0 0x7f24440769f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24601602a0 0x7f246014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24600d41b0 0x7f246014cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 --2- 172.21.15.80:0/108753821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24600b7b90 0x7f24601606b0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 >> 172.21.15.80:0/108753821 conn(0x7f246006e9f0 msgr2=0x7f246015d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 shutdown_connections 2024-04-25T15:47:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04.496+0000 7f24683b7640 1 -- 172.21.15.80:0/108753821 wait complete. 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:47:04.508 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:04.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:04.509 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:47:04.563 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:47:04.563 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:47:04.563 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:47:04.563 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:47:04.564 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42532sec preferred_lft 42532sec 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:47:04.566 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:47:04.566 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:04.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:04.566 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:47:04.626 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:47:04.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:04.627 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:47:04.684 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:47:04.684 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:47:04.684 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:47:04.684 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:47:04.684 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:47:04.684 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:04.684 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:47:04.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:47:04.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:47:04.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:47:04.685 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:47:04.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:04.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:04.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:04.809 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:47:04.823 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:47:04.823 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:47:04.823 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:04.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:04.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:47:04.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:04.887 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:04.943 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:04.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:04.944 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:04.998 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:47:04.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:04.999 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:05.091 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:05.091 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:05.099 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:05.099 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:05.099 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:47:05.099 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:47:05.099 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:47:05.100 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:47:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:47:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:47:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:47:05.100 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:47:05.101 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:47:05.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:05.102 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:05.126 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:47:05.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:47:05.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:05.226 INFO:teuthology.orchestra.run.smithi080.stdout:client7722 2024-04-25T15:47:05.226 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:05.226 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:05.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:47:05.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.388+0000 7f8b0c2d1640 1 Processor -- start 2024-04-25T15:47:05.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.388+0000 7f8b0c2d1640 1 -- start start 2024-04-25T15:47:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0c2d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0415e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0c2d1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b040714a0 0x7f8b040718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0c2d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b04071df0 con 0x7f8b0406c5c0 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0c2d1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8b0415faf0 con 0x7f8b040714a0 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0c2d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8b041589c0 con 0x7f8b0406db10 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0986c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b040714a0 0x7f8b040718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0a86e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8b0406c5c0 0x7f8b0406c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33602/0 (socket says 172.21.15.80:33602) 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0a86e640 1 -- 172.21.15.80:0/2129508190 learned_addr learned my addr 172.21.15.80:0/2129508190 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.389+0000 7f8b0986c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b040714a0 0x7f8b040718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51010/0 (socket says 172.21.15.80:51010) 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0a06d640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0986c640 1 -- 172.21.15.80:0/2129508190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 msgr2=0x7f8b0415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0986c640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0415e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0986c640 1 -- 172.21.15.80:0/2129508190 >> v1:172.21.15.80:6789/0 conn(0x7f8b0406c5c0 legacy=0x7f8b0406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0986c640 1 -- 172.21.15.80:0/2129508190 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0415ee90 con 0x7f8b040714a0 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0a06d640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0415e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.390+0000 7f8b0986c640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b040718b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8af40097a0 tx=0x7f8af402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acac7fd92f4bbe09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0906b640 1 -- 172.21.15.80:0/2129508190 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4037070 con 0x7f8b040714a0 2024-04-25T15:47:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0906b640 1 -- 172.21.15.80:0/2129508190 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af4032440 con 0x7f8b040714a0 2024-04-25T15:47:05.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0906b640 1 -- 172.21.15.80:0/2129508190 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4032810 con 0x7f8b040714a0 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/2129508190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 msgr2=0x7f8b040718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b040718b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8af40097a0 tx=0x7f8af402a180 comp rx=0 tx=0).stop 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/2129508190 shutdown_connections 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b040718b0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/2129508190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0415e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/2129508190 >> 172.21.15.80:0/2129508190 conn(0x7f8b040d2080 msgr2=0x7f8b040d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/2129508190 shutdown_connections 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.391+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/2129508190 wait complete. 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.393+0000 7f8b0c2d1640 1 Processor -- start 2024-04-25T15:47:05.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.393+0000 7f8b0c2d1640 1 -- start start 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0c2d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0406c5c0 0x7f8b04152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0c2d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0c2d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b0414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0c2d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0415f450 con 0x7f8b040714a0 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0c2d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0415f780 con 0x7f8b0406c5c0 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0c2d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0415ea60 con 0x7f8b0406db10 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0a86e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b0414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0a86e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b0414d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51016/0 (socket says 172.21.15.80:51016) 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.394+0000 7f8b0a86e640 1 -- 172.21.15.80:0/1573407121 learned_addr learned my addr 172.21.15.80:0/1573407121 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0986c640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:05.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a06d640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0406c5c0 0x7f8b04152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a86e640 1 -- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 msgr2=0x7f8b0414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a86e640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a86e640 1 -- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0406c5c0 msgr2=0x7f8b04152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a86e640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0406c5c0 0x7f8b04152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a86e640 1 -- 172.21.15.80:0/1573407121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b041e6d30 con 0x7f8b040714a0 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a06d640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0406c5c0 0x7f8b04152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0a86e640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b0414d570 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00caa0 tx=0x7f8afc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc017070 con 0x7f8b040714a0 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc00ac00 con 0x7f8b040714a0 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b041e7010 con 0x7f8b040714a0 2024-04-25T15:47:05.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc012400 con 0x7f8b040714a0 2024-04-25T15:47:05.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.395+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b041e75d0 con 0x7f8b040714a0 2024-04-25T15:47:05.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.396+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0406a100 con 0x7f8b040714a0 2024-04-25T15:47:05.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.397+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8afc01a070 con 0x7f8b040714a0 2024-04-25T15:47:05.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.397+0000 7f8afaffd640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ae80744e0 0x7f8ae80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:05.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.397+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f8afc094ec0 con 0x7f8b040714a0 2024-04-25T15:47:05.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.397+0000 7f8b0a06d640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ae80744e0 0x7f8ae80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:05.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.398+0000 7f8b0a06d640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ae80744e0 0x7f8ae80769f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8b00006fd0 tx=0x7f8b00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:05.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.402+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b04071df0 con 0x7f8b040714a0 2024-04-25T15:47:05.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.614+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8b040b1a00 con 0x7f8b040714a0 2024-04-25T15:47:05.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.615+0000 7f8afaffd640 1 -- 172.21.15.80:0/1573407121 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f8afc05ef00 con 0x7f8b040714a0 2024-04-25T15:47:05.616 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:47:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ae80744e0 msgr2=0x7f8ae80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ae80744e0 0x7f8ae80769f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8b00006fd0 tx=0x7f8b00008040 comp rx=0 tx=0).stop 2024-04-25T15:47:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 msgr2=0x7f8b0414d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b0414d570 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00caa0 tx=0x7f8afc00cf60 comp rx=0 tx=0).stop 2024-04-25T15:47:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 shutdown_connections 2024-04-25T15:47:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8ae80744e0 0x7f8ae80769f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b040714a0 0x7f8b0414d570 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b0406db10 0x7f8b0414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 --2- 172.21.15.80:0/1573407121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b0406c5c0 0x7f8b04152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 >> 172.21.15.80:0/1573407121 conn(0x7f8b040d2080 msgr2=0x7f8b040d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 shutdown_connections 2024-04-25T15:47:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:05.617+0000 7f8b0c2d1640 1 -- 172.21.15.80:0/1573407121 wait complete. 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:47:05.629 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:47:05.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:05.630 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:47:05.648 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:05.649 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42509sec preferred_lft 42509sec 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:05.650 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:05.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:05.651 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:47:05.715 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:47:05.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:05.717 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:47:05.777 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:47:05.778 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:47:05.778 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:47:05.778 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:47:05.778 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:47:05.778 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:05.778 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:47:05.778 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:47:05.778 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:47:05.778 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:47:05.779 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:47:05.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:05.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:05.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:05.908 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:47:05.923 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:47:05.923 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:47:05.923 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:47:05.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:05.924 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:47:05.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:05.988 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:06.042 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:47:06.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:06.043 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:06.097 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:47:06.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:06.097 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:06.189 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:06.190 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:06.197 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:06.197 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:47:06.198 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:47:06.200 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:47:06.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:06.200 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:06.223 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:47:06.311 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:47:06.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:06.318 INFO:teuthology.orchestra.run.smithi195.stdout:client6817 2024-04-25T15:47:06.319 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:06.319 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:06.334 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:06.335 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:06.352 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:06.352 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:06.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.560+0000 7fe98a9ee640 1 Processor -- start 2024-04-25T15:47:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.560+0000 7fe98a9ee640 1 -- start start 2024-04-25T15:47:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe98a9ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9840cff30 0x7fe9840b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe98a9ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840b2a40 0x7fe98409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe98a9ee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9840b9350 con 0x7fe9840d2120 2024-04-25T15:47:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe98a9ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe9840cfb70 con 0x7fe9840cff30 2024-04-25T15:47:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe98a9ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe9840cf890 con 0x7fe9840b2a40 2024-04-25T15:47:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9840cff30 0x7fe9840b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9840cff30 0x7fe9840b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51032/0 (socket says 172.21.15.80:51032) 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 -- 172.21.15.80:0/2333468274 learned_addr learned my addr 172.21.15.80:0/2333468274 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 -- 172.21.15.80:0/2333468274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840b2a40 msgr2=0x7fe98409ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe9837fe640 1 --2- 172.21.15.80:0/2333468274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840b2a40 0x7fe98409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 --2- 172.21.15.80:0/2333468274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840b2a40 0x7fe98409ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 -- 172.21.15.80:0/2333468274 >> v1:172.21.15.195:6789/0 conn(0x7fe9840d2120 legacy=0x7fe9840d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.562+0000 7fe983fff640 1 -- 172.21.15.80:0/2333468274 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9840b9020 con 0x7fe9840cff30 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.563+0000 7fe983fff640 1 --2- 172.21.15.80:0/2333468274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9840b7230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe974009850 tx=0x7fe97402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871335975ffc18be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.563+0000 7fe982ffd640 1 -- 172.21.15.80:0/2333468274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97402ae60 con 0x7fe9840cff30 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.563+0000 7fe982ffd640 1 -- 172.21.15.80:0/2333468274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974004030 con 0x7fe9840cff30 2024-04-25T15:47:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.563+0000 7fe982ffd640 1 -- 172.21.15.80:0/2333468274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974004460 con 0x7fe9840cff30 2024-04-25T15:47:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 -- 172.21.15.80:0/2333468274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 msgr2=0x7fe9840b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/2333468274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9840b7230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe974009850 tx=0x7fe97402a150 comp rx=0 tx=0).stop 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 -- 172.21.15.80:0/2333468274 shutdown_connections 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/2333468274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840b2a40 0x7fe98409ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/2333468274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9840b7230 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 -- 172.21.15.80:0/2333468274 >> 172.21.15.80:0/2333468274 conn(0x7fe9840d0450 msgr2=0x7fe9840d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 -- 172.21.15.80:0/2333468274 shutdown_connections 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.564+0000 7fe98a9ee640 1 -- 172.21.15.80:0/2333468274 wait complete. 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.565+0000 7fe98a9ee640 1 Processor -- start 2024-04-25T15:47:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.566+0000 7fe98a9ee640 1 -- start start 2024-04-25T15:47:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe98a9ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9840b2a40 0x7fe98414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe98a9ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9841500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe98a9ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840d2120 0x7fe9841505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe98a9ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840d10f0 con 0x7fe9840cff30 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe98a9ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840d0f70 con 0x7fe9840b2a40 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe98a9ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe9840d2530 con 0x7fe9840d2120 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9841500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9841500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51042/0 (socket says 172.21.15.80:51042) 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 -- 172.21.15.80:0/3593981920 learned_addr learned my addr 172.21.15.80:0/3593981920 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe988f8b640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840d2120 0x7fe9841505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe983fff640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9840b2a40 0x7fe98414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 -- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840d2120 msgr2=0x7fe9841505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840d2120 0x7fe9841505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 -- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9840b2a40 msgr2=0x7fe98414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9840b2a40 0x7fe98414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.567+0000 7fe9837fe640 1 -- 172.21.15.80:0/3593981920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe984150e70 con 0x7fe9840cff30 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.568+0000 7fe9837fe640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9841500b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c5d0 tx=0x7fe97800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.568+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978015070 con 0x7fe9840cff30 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.568+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978004220 con 0x7fe9840cff30 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.568+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98414e250 con 0x7fe9840cff30 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.568+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978003610 con 0x7fe9840cff30 2024-04-25T15:47:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.568+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98414fdb0 con 0x7fe9840cff30 2024-04-25T15:47:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.569+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98406a100 con 0x7fe9840cff30 2024-04-25T15:47:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.570+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe9780037b0 con 0x7fe9840cff30 2024-04-25T15:47:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.570+0000 7fe980ff9640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9700744b0 0x7fe9700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.570+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fe978095100 con 0x7fe9840cff30 2024-04-25T15:47:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.570+0000 7fe983fff640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9700744b0 0x7fe9700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.570+0000 7fe983fff640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9700744b0 0x7fe9700769c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe974033000 tx=0x7fe97402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.575+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe97805f7a0 con 0x7fe9840cff30 2024-04-25T15:47:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.751+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9840cdda0 con 0x7fe9840cff30 2024-04-25T15:47:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.752+0000 7fe980ff9640 1 -- 172.21.15.80:0/3593981920 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16861 (secure 0 0 0) 0x7fe97805f0a0 con 0x7fe9840cff30 2024-04-25T15:47:06.753 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:06.753 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":99,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:55.949436+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9700744b0 msgr2=0x7fe9700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9700744b0 0x7fe9700769c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe974033000 tx=0x7fe97402e000 comp rx=0 tx=0).stop 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 msgr2=0x7fe9841500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9841500b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c5d0 tx=0x7fe97800ca90 comp rx=0 tx=0).stop 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 shutdown_connections 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe9700744b0 0x7fe9700769c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9840d2120 0x7fe9841505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9840cff30 0x7fe9841500b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 --2- 172.21.15.80:0/3593981920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9840b2a40 0x7fe98414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 >> 172.21.15.80:0/3593981920 conn(0x7fe9840d0450 msgr2=0x7fe984072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 shutdown_connections 2024-04-25T15:47:06.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.754+0000 7fe98a9ee640 1 -- 172.21.15.80:0/3593981920 wait complete. 2024-04-25T15:47:06.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:52.572368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:53.267030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:47:06.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:47:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.876+0000 7f1c5b99d640 1 Processor -- start 2024-04-25T15:47:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.876+0000 7f1c5b99d640 1 -- start start 2024-04-25T15:47:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c5b99d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1c5406e790 0x7f1c5406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c5b99d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c540b25e0 0x7f1c540b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c5b99d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c540ce590 con 0x7f1c5406c5c0 2024-04-25T15:47:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c5b99d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1c540ce360 con 0x7f1c540b25e0 2024-04-25T15:47:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c5b99d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1c5409c320 con 0x7f1c5406e790 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59f3a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c540b25e0 0x7f1c540b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59739640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1c5406c5c0 0x7f1c540d2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33604/0 (socket says 172.21.15.80:33604) 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59739640 1 -- 172.21.15.80:0/276339603 learned_addr learned my addr 172.21.15.80:0/276339603 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c58f38640 1 --2- 172.21.15.80:0/276339603 >> v2:172.21.15.195:3300/0 conn(0x7f1c5406e790 0x7f1c5406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59f3a640 1 -- 172.21.15.80:0/276339603 >> v2:172.21.15.195:3300/0 conn(0x7f1c5406e790 msgr2=0x7f1c5406eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59f3a640 1 --2- 172.21.15.80:0/276339603 >> v2:172.21.15.195:3300/0 conn(0x7f1c5406e790 0x7f1c5406eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59f3a640 1 -- 172.21.15.80:0/276339603 >> v1:172.21.15.80:6789/0 conn(0x7f1c5406c5c0 legacy=0x7f1c540d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.878+0000 7f1c59f3a640 1 -- 172.21.15.80:0/276339603 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c540ce830 con 0x7f1c540b25e0 2024-04-25T15:47:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.879+0000 7f1c59f3a640 1 --2- 172.21.15.80:0/276339603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c540b25e0 0x7f1c540b29f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1c540d02a0 tx=0x7f1c4c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed9f06b11090079 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.879+0000 7f1c4bfff640 1 -- 172.21.15.80:0/276339603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c007740 con 0x7f1c540b25e0 2024-04-25T15:47:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.879+0000 7f1c4bfff640 1 -- 172.21.15.80:0/276339603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c0078e0 con 0x7f1c540b25e0 2024-04-25T15:47:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.879+0000 7f1c4bfff640 1 -- 172.21.15.80:0/276339603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c007cb0 con 0x7f1c540b25e0 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 -- 172.21.15.80:0/276339603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c540b25e0 msgr2=0x7f1c540b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/276339603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c540b25e0 0x7f1c540b29f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1c540d02a0 tx=0x7f1c4c02a5f0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 -- 172.21.15.80:0/276339603 shutdown_connections 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/276339603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c540b25e0 0x7f1c540b29f0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/276339603 >> v2:172.21.15.195:3300/0 conn(0x7f1c5406e790 0x7f1c5406eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 -- 172.21.15.80:0/276339603 >> 172.21.15.80:0/276339603 conn(0x7f1c540b7620 msgr2=0x7f1c540b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 -- 172.21.15.80:0/276339603 shutdown_connections 2024-04-25T15:47:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.880+0000 7f1c5b99d640 1 -- 172.21.15.80:0/276339603 wait complete. 2024-04-25T15:47:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.881+0000 7f1c5b99d640 1 Processor -- start 2024-04-25T15:47:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.882+0000 7f1c5b99d640 1 -- start start 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c5b99d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c5406c5c0 0x7f1c540c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c5b99d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 0x7f1c540d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c5b99d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540b25e0 0x7f1c5415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c5b99d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1c540d3110 con 0x7f1c5406e790 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c5b99d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1c540cedf0 con 0x7f1c540b25e0 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c5b99d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5406c9d0 con 0x7f1c5406c5c0 2024-04-25T15:47:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 0x7f1c540d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 0x7f1c540d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51068/0 (socket says 172.21.15.80:51068) 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 -- 172.21.15.80:0/2537441046 learned_addr learned my addr 172.21.15.80:0/2537441046 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c59f3a640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540b25e0 0x7f1c5415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c59739640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c5406c5c0 0x7f1c540c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 -- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c5406c5c0 msgr2=0x7f1c540c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c5406c5c0 0x7f1c540c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 -- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540b25e0 msgr2=0x7f1c5415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540b25e0 0x7f1c5415d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 -- 172.21.15.80:0/2537441046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c540c6480 con 0x7f1c5406e790 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.883+0000 7f1c58f38640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 0x7f1c540d1a10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400d620 tx=0x7f1c4400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.884+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400b620 con 0x7f1c5406e790 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.884+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c44019070 con 0x7f1c5406e790 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.884+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400ba00 con 0x7f1c5406e790 2024-04-25T15:47:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.884+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c540c6720 con 0x7f1c5406e790 2024-04-25T15:47:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.884+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c540c6ce0 con 0x7f1c5406e790 2024-04-25T15:47:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.885+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c540d2220 con 0x7f1c5406e790 2024-04-25T15:47:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.885+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c4400bba0 con 0x7f1c5406e790 2024-04-25T15:47:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.886+0000 7f1c49ffb640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c380744e0 0x7f1c380769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.886+0000 7f1c59739640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c380744e0 0x7f1c380769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.886+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f1c440955c0 con 0x7f1c5406e790 2024-04-25T15:47:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.886+0000 7f1c59739640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c380744e0 0x7f1c380769f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000f60 tx=0x7f1c50007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:06.891+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c4405f600 con 0x7f1c5406e790 2024-04-25T15:47:07.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.065+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c5406a100 con 0x7f1c5406e790 2024-04-25T15:47:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.065+0000 7f1c49ffb640 1 -- 172.21.15.80:0/2537441046 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f1c44063900 con 0x7f1c5406e790 2024-04-25T15:47:07.067 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c380744e0 msgr2=0x7f1c380769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c380744e0 0x7f1c380769f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000f60 tx=0x7f1c50007e80 comp rx=0 tx=0).stop 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 msgr2=0x7f1c540d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 0x7f1c540d1a10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400d620 tx=0x7f1c4400dae0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 shutdown_connections 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1c380744e0 0x7f1c380769f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540b25e0 0x7f1c5415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c5406e790 0x7f1c540d1a10 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 --2- 172.21.15.80:0/2537441046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c5406c5c0 0x7f1c540c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.067+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 >> 172.21.15.80:0/2537441046 conn(0x7f1c540b7620 msgr2=0x7f1c5406cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.068+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 shutdown_connections 2024-04-25T15:47:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.068+0000 7f1c5b99d640 1 -- 172.21.15.80:0/2537441046 wait complete. 2024-04-25T15:47:07.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:47:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.190+0000 7fc7a3b14640 1 Processor -- start 2024-04-25T15:47:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.190+0000 7fc7a3b14640 1 -- start start 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a3b14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc79c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a3b14640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c0d1f50 con 0x7fc79c0718d0 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a3b14640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c0ce890 con 0x7fc79c0cf930 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a3b14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc79c0cf4a0 con 0x7fc79c0d1600 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a20b1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc79c0718d0 0x7fc79c071ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33614/0 (socket says 172.21.15.80:33614) 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a20b1640 1 -- 172.21.15.80:0/3654209375 learned_addr learned my addr 172.21.15.80:0/3654209375 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612983681 0 0) 0x7fc794001110 con 0x7fc79c0718d0 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc788003520 con 0x7fc79c0718d0 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a10af640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc79c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 484173356 0 0) 0x7fc788003520 con 0x7fc79c0718d0 2024-04-25T15:47:07.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 msgr2=0x7fc79c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc79c0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 >> v1:172.21.15.195:6789/0 conn(0x7fc79c0cf930 legacy=0x7fc79c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c0ceb70 con 0x7fc79c0718d0 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc794001840 con 0x7fc79c0718d0 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 >> v1:172.21.15.80:6789/0 conn(0x7fc79c0718d0 legacy=0x7fc79c071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc788003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc788004800 0x7fc788004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc788005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c0cf4a0 con 0x7fc7880039e0 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc78800bb50 con 0x7fc788004800 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc78800bd20 con 0x7fc79c0d1600 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.192+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc788003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a10af640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc788004800 0x7fc788004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a20b1640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc788005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a18b0640 1 -- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 msgr2=0x7fc788005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc788005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a18b0640 1 -- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc788004800 msgr2=0x7fc788004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc788004800 0x7fc788004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a18b0640 1 -- 172.21.15.80:0/3654209375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc788003520 con 0x7fc7880039e0 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a20b1640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c0d1600 0x7fc788005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.193+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc788003e70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc798001e50 tx=0x7fc788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1356643ecc458cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798001a70 con 0x7fc7880039e0 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79802ad60 con 0x7fc7880039e0 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a08ae640 1 -- 172.21.15.80:0/3654209375 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798003bb0 con 0x7fc7880039e0 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a3b14640 1 -- 172.21.15.80:0/3654209375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 msgr2=0x7fc788003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/3654209375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc788003e70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc798001e50 tx=0x7fc788005830 comp rx=0 tx=0).stop 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a20b1640 1 -- 172.21.15.80:0/3654209375 reap_dead start 2024-04-25T15:47:07.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a3b14640 1 -- 172.21.15.80:0/3654209375 shutdown_connections 2024-04-25T15:47:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a3b14640 1 -- 172.21.15.80:0/3654209375 >> 172.21.15.80:0/3654209375 conn(0x7fc79c0d3a30 msgr2=0x7fc79c0d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a3b14640 1 -- 172.21.15.80:0/3654209375 shutdown_connections 2024-04-25T15:47:07.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.194+0000 7fc7a3b14640 1 -- 172.21.15.80:0/3654209375 wait complete. 2024-04-25T15:47:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.196+0000 7fc7a3b14640 1 Processor -- start 2024-04-25T15:47:07.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.196+0000 7fc7a3b14640 1 -- start start 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a3b14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc79c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a3b14640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc79c0b58a0 0x7fc79c1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a3b14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c1ebda0 0x7fc79c1ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a3b14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c0cf130 con 0x7fc7880039e0 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a3b14640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c0cfd40 con 0x7fc79c0b58a0 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a3b14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc79c0d1a10 con 0x7fc79c1ebda0 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a18b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc79c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a18b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc79c0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51086/0 (socket says 172.21.15.80:51086) 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.197+0000 7fc7a18b0640 1 -- 172.21.15.80:0/1965009492 learned_addr learned my addr 172.21.15.80:0/1965009492 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a20b1640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c1ebda0 0x7fc79c1ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a10af640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc79c0b58a0 0x7fc79c1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a18b0640 1 -- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c1ebda0 msgr2=0x7fc79c1ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c1ebda0 0x7fc79c1ec1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a18b0640 1 -- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc79c0b58a0 msgr2=0x7fc79c1502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc79c0b58a0 0x7fc79c1502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a18b0640 1 -- 172.21.15.80:0/1965009492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c1ec6f0 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a18b0640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc79c0b25a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc798005040 tx=0x7fc7980014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79803f030 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79802ab60 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c0b5cb0 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798037040 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.198+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c14db70 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.199+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79c06a100 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.200+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc798042070 con 0x7fc7880039e0 2024-04-25T15:47:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.200+0000 7fc7927fc640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7800744b0 0x7fc7800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.200+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fc7980b5150 con 0x7fc7880039e0 2024-04-25T15:47:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.200+0000 7fc7a10af640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7800744b0 0x7fc7800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.201+0000 7fc7a10af640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7800744b0 0x7fc7800769c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc79c1ec970 tx=0x7fc78c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.205+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc79c1ec6f0 con 0x7fc7880039e0 2024-04-25T15:47:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.379+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc79c0b99b0 con 0x7fc7880039e0 2024-04-25T15:47:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.379+0000 7fc7927fc640 1 -- 172.21.15.80:0/1965009492 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7fc79807f830 con 0x7fc7880039e0 2024-04-25T15:47:07.381 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7800744b0 msgr2=0x7fc7800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7800744b0 0x7fc7800769c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc79c1ec970 tx=0x7fc78c008040 comp rx=0 tx=0).stop 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 msgr2=0x7fc79c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc79c0b25a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc798005040 tx=0x7fc7980014a0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 shutdown_connections 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7800744b0 0x7fc7800769c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc79c1ebda0 0x7fc79c1ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc79c0b58a0 0x7fc79c1502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 --2- 172.21.15.80:0/1965009492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7880039e0 0x7fc79c0b25a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 >> 172.21.15.80:0/1965009492 conn(0x7fc79c0d3a30 msgr2=0x7fc79c15ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:07.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.381+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 shutdown_connections 2024-04-25T15:47:07.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.382+0000 7fc7a3b14640 1 -- 172.21.15.80:0/1965009492 wait complete. 2024-04-25T15:47:07.394 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:47:07.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.502+0000 7fe3981a8640 1 Processor -- start 2024-04-25T15:47:07.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.503+0000 7fe3981a8640 1 -- start start 2024-04-25T15:47:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe3981a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3900b2b80 0x7fe39015e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe3981a8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe390161b00 con 0x7fe3900d0a90 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe3981a8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe390161dc0 con 0x7fe3900cee90 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe3981a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe3901620a0 con 0x7fe3900b2b80 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe395f44640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3900b2b80 0x7fe39015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe395f44640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3900b2b80 0x7fe39015e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51096/0 (socket says 172.21.15.80:51096) 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe396745640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3900d0a90 0x7fe3900d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33626/0 (socket says 172.21.15.80:33626) 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.504+0000 7fe395f44640 1 -- 172.21.15.80:0/2163789466 learned_addr learned my addr 172.21.15.80:0/2163789466 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe395f44640 1 -- 172.21.15.80:0/2163789466 >> v1:172.21.15.195:6789/0 conn(0x7fe3900cee90 legacy=0x7fe3900d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe395f44640 1 -- 172.21.15.80:0/2163789466 >> v1:172.21.15.80:6789/0 conn(0x7fe3900d0a90 legacy=0x7fe3900d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe395f44640 1 -- 172.21.15.80:0/2163789466 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390162380 con 0x7fe3900b2b80 2024-04-25T15:47:07.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe394f42640 1 -- 172.21.15.80:0/2163789466 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714556015 0 0) 0x7fe390161b00 con 0x7fe3900d0a90 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe395f44640 1 --2- 172.21.15.80:0/2163789466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe39015e060 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009e50 tx=0x7fe38c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a0a002b051dfe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe394f42640 1 -- 172.21.15.80:0/2163789466 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c036070 con 0x7fe3900b2b80 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe394f42640 1 -- 172.21.15.80:0/2163789466 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c031600 con 0x7fe3900b2b80 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.505+0000 7fe394f42640 1 -- 172.21.15.80:0/2163789466 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0319d0 con 0x7fe3900b2b80 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 -- 172.21.15.80:0/2163789466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 msgr2=0x7fe39015e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 --2- 172.21.15.80:0/2163789466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe39015e060 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009e50 tx=0x7fe38c02a6d0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 -- 172.21.15.80:0/2163789466 shutdown_connections 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 --2- 172.21.15.80:0/2163789466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe39015e060 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 -- 172.21.15.80:0/2163789466 >> 172.21.15.80:0/2163789466 conn(0x7fe3900b54a0 msgr2=0x7fe3900b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 -- 172.21.15.80:0/2163789466 shutdown_connections 2024-04-25T15:47:07.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.506+0000 7fe3981a8640 1 -- 172.21.15.80:0/2163789466 wait complete. 2024-04-25T15:47:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.508+0000 7fe3981a8640 1 Processor -- start 2024-04-25T15:47:07.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.508+0000 7fe3981a8640 1 -- start start 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe3981a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe390156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe3981a8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900cee90 0x7fe3900cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe3981a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900d0a90 0x7fe3900ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe3981a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900cf2a0 con 0x7fe3900b2b80 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe3981a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe390162940 con 0x7fe3900d0a90 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe3981a8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe3900cf420 con 0x7fe3900cee90 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe395f44640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe390156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe395f44640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe390156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51106/0 (socket says 172.21.15.80:51106) 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.509+0000 7fe395f44640 1 -- 172.21.15.80:0/4178508059 learned_addr learned my addr 172.21.15.80:0/4178508059 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395743640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900cee90 0x7fe3900cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe396745640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900d0a90 0x7fe3900ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395f44640 1 -- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900cee90 msgr2=0x7fe3900cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395f44640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900cee90 0x7fe3900cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395f44640 1 -- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900d0a90 msgr2=0x7fe3900ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395f44640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900d0a90 0x7fe3900ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395f44640 1 -- 172.21.15.80:0/4178508059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3900c85e0 con 0x7fe3900b2b80 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395743640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900cee90 0x7fe3900cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe395f44640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe390156980 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe38c034040 tx=0x7fe38c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c041020 con 0x7fe3900b2b80 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c007800 con 0x7fe3900b2b80 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3900c88c0 con 0x7fe3900b2b80 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c036040 con 0x7fe3900b2b80 2024-04-25T15:47:07.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.510+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3900c8e80 con 0x7fe3900b2b80 2024-04-25T15:47:07.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.511+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39006a100 con 0x7fe3900b2b80 2024-04-25T15:47:07.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.512+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe38c044020 con 0x7fe3900b2b80 2024-04-25T15:47:07.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.512+0000 7fe3867fc640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe3740744e0 0x7fe3740769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.512+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fe38c0b63a0 con 0x7fe3900b2b80 2024-04-25T15:47:07.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.512+0000 7fe395743640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe3740744e0 0x7fe3740769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.513+0000 7fe395743640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe3740744e0 0x7fe3740769f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe380006fd0 tx=0x7fe380008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.517+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe38c04b030 con 0x7fe3900b2b80 2024-04-25T15:47:07.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.691+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3900d1c50 con 0x7fe3900b2b80 2024-04-25T15:47:07.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.691+0000 7fe3867fc640 1 -- 172.21.15.80:0/4178508059 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7fe38c080900 con 0x7fe3900b2b80 2024-04-25T15:47:07.693 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe3740744e0 msgr2=0x7fe3740769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe3740744e0 0x7fe3740769f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe380006fd0 tx=0x7fe380008040 comp rx=0 tx=0).stop 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 msgr2=0x7fe390156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe390156980 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe38c034040 tx=0x7fe38c004a40 comp rx=0 tx=0).stop 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 shutdown_connections 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe3740744e0 0x7fe3740769f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900d0a90 0x7fe3900ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900cee90 0x7fe3900cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 --2- 172.21.15.80:0/4178508059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3900b2b80 0x7fe390156980 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 >> 172.21.15.80:0/4178508059 conn(0x7fe3900b54a0 msgr2=0x7fe3900d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 shutdown_connections 2024-04-25T15:47:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.694+0000 7fe3981a8640 1 -- 172.21.15.80:0/4178508059 wait complete. 2024-04-25T15:47:07.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:47:07.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.812+0000 7f4e859ee640 1 Processor -- start 2024-04-25T15:47:07.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.812+0000 7f4e859ee640 1 -- start start 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.813+0000 7f4e859ee640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e800b48d0 0x7f4e800b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.813+0000 7f4e859ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 0x7f4e800d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.813+0000 7f4e859ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e800b7fa0 con 0x7f4e800d41b0 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e859ee640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4e80163fb0 con 0x7f4e800b48d0 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e859ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e80164270 con 0x7f4e800b7b90 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7effd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e800d41b0 0x7f4e801602a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33628/0 (socket says 172.21.15.80:33628) 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7effd640 1 -- 172.21.15.80:0/1629755489 learned_addr learned my addr 172.21.15.80:0/1629755489 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991900129 0 0) 0x7f4e70001490 con 0x7f4e800d41b0 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e68003520 con 0x7f4e800d41b0 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7f7fe640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 0x7f4e800d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7e7fc640 1 --2- 172.21.15.80:0/1629755489 >> v2:172.21.15.195:3300/0 conn(0x7f4e800b48d0 0x7f4e800b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3030631927 0 0) 0x7f4e68003520 con 0x7f4e800d41b0 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 msgr2=0x7f4e800d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 0x7f4e800d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 >> v2:172.21.15.195:3300/0 conn(0x7f4e800b48d0 msgr2=0x7f4e800b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 --2- 172.21.15.80:0/1629755489 >> v2:172.21.15.195:3300/0 conn(0x7f4e800b48d0 0x7f4e800b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e80164550 con 0x7f4e800d41b0 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f4e70001bc0 con 0x7f4e800d41b0 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 >> v1:172.21.15.80:6789/0 conn(0x7f4e800d41b0 legacy=0x7f4e801602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680039b0 0x7f4e68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e68004800 0x7f4e68004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 0x7f4e68005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80163fb0 con 0x7f4e680039b0 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80164270 con 0x7f4e68004800 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6800b9c0 con 0x7f4e800b7b90 2024-04-25T15:47:07.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7effd640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680039b0 0x7f4e68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.814+0000 7f4e7e7fc640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e68004800 0x7f4e68004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7f7fe640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 0x7f4e68005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7effd640 1 -- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 msgr2=0x7f4e68005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7effd640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e800b7b90 0x7f4e68005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7effd640 1 -- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e68004800 msgr2=0x7f4e68004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7effd640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e68004800 0x7f4e68004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7effd640 1 -- 172.21.15.80:0/1629755489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e68003520 con 0x7f4e680039b0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7effd640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680039b0 0x7f4e68003e20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000aa70 tx=0x7f4e68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879cce0cf0c68d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000a690 con 0x7f4e680039b0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7002f070 con 0x7f4e680039b0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.815+0000 7f4e7dffb640 1 -- 172.21.15.80:0/1629755489 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70034470 con 0x7f4e680039b0 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e859ee640 1 -- 172.21.15.80:0/1629755489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680039b0 msgr2=0x7f4e68003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e859ee640 1 --2- 172.21.15.80:0/1629755489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680039b0 0x7f4e68003e20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000aa70 tx=0x7f4e68005830 comp rx=0 tx=0).stop 2024-04-25T15:47:07.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e7f7fe640 1 -- 172.21.15.80:0/1629755489 reap_dead start 2024-04-25T15:47:07.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e859ee640 1 -- 172.21.15.80:0/1629755489 shutdown_connections 2024-04-25T15:47:07.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e859ee640 1 -- 172.21.15.80:0/1629755489 >> 172.21.15.80:0/1629755489 conn(0x7f4e8006e9f0 msgr2=0x7f4e800d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:07.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e859ee640 1 -- 172.21.15.80:0/1629755489 shutdown_connections 2024-04-25T15:47:07.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.816+0000 7f4e859ee640 1 -- 172.21.15.80:0/1629755489 wait complete. 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.818+0000 7f4e859ee640 1 Processor -- start 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.818+0000 7f4e859ee640 1 -- start start 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e859ee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e680039b0 0x7f4e80151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e859ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e80152270 0x7f4e80153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e859ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 0x7f4e80153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e859ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e800b4fd0 con 0x7f4e80153780 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e859ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80164b10 con 0x7f4e80152270 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e859ee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e800b5150 con 0x7f4e680039b0 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.819+0000 7f4e7f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 0x7f4e80153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 0x7f4e80153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51120/0 (socket says 172.21.15.80:51120) 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 -- 172.21.15.80:0/2304481069 learned_addr learned my addr 172.21.15.80:0/2304481069 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7e7fc640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e80152270 0x7f4e80153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7effd640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e680039b0 0x7f4e80151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 -- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e680039b0 msgr2=0x7f4e80151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e680039b0 0x7f4e80151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 -- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e80152270 msgr2=0x7f4e80153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e80152270 0x7f4e80153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 -- 172.21.15.80:0/2304481069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e801540d0 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e7f7fe640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 0x7f4e80153b90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f4e8008e140 tx=0x7f4e78011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78003610 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7801b070 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e801eaef0 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78003a30 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.820+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e801eb190 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.821+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8006a100 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.822+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4e78003bd0 con 0x7f4e80153780 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.822+0000 7f4e67fff640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e6c0744e0 0x7f4e6c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:07.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.822+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f4e78094fa0 con 0x7f4e80153780 2024-04-25T15:47:07.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.822+0000 7f4e7effd640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e6c0744e0 0x7f4e6c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:07.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.823+0000 7f4e7effd640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e6c0744e0 0x7f4e6c0769f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000aa40 tx=0x7f4e7002d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:07.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:07.827+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e78024020 con 0x7f4e80153780 2024-04-25T15:47:08.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.016+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4e800d3070 con 0x7f4e80153780 2024-04-25T15:47:08.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.016+0000 7f4e67fff640 1 -- 172.21.15.80:0/2304481069 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v99) ==== 80+0+0 (secure 0 0 0) 0x7f4e7805f5a0 con 0x7f4e80153780 2024-04-25T15:47:08.018 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e6c0744e0 msgr2=0x7f4e6c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e6c0744e0 0x7f4e6c0769f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000aa40 tx=0x7f4e7002d000 comp rx=0 tx=0).stop 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 msgr2=0x7f4e80153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 0x7f4e80153b90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f4e8008e140 tx=0x7f4e78011860 comp rx=0 tx=0).stop 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 shutdown_connections 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4e6c0744e0 0x7f4e6c0769f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e80153780 0x7f4e80153b90 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e80152270 0x7f4e80153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 --2- 172.21.15.80:0/2304481069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e680039b0 0x7f4e80151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.018+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 >> 172.21.15.80:0/2304481069 conn(0x7f4e8006e9f0 msgr2=0x7f4e8015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.019+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 shutdown_connections 2024-04-25T15:47:08.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.019+0000 7f4e859ee640 1 -- 172.21.15.80:0/2304481069 wait complete. 2024-04-25T15:47:08.031 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:47:08.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:08.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:08.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:47:08.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:08.058 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:47:08.114 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:08.114 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:08.133 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:08.134 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:08.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:08.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.300+0000 7f8c062d1640 1 Processor -- start 2024-04-25T15:47:08.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.300+0000 7f8c062d1640 1 -- start start 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8c062d1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8c0006ea80 0x7f8c000b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8c062d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c000b25e0 con 0x7f8c0015d170 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8c062d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0006d770 con 0x7f8c000d2e50 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8c062d1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0006ddc0 con 0x7f8c0006ea80 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8c0015d170 0x7f8c000d2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33640/0 (socket says 172.21.15.80:33640) 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfffff640 1 -- 172.21.15.80:0/3593742326 learned_addr learned my addr 172.21.15.80:0/3593742326 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946955814 0 0) 0x7f8c000b25e0 con 0x7f8c0015d170 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be8003520 con 0x7f8c0015d170 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8c0486e640 1 --2- 172.21.15.80:0/3593742326 >> v2:172.21.15.195:3300/0 conn(0x7f8c0006ea80 0x7f8c000b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2930233933 0 0) 0x7f8be8003520 con 0x7f8c0015d170 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 >> v2:172.21.15.195:3300/0 conn(0x7f8c0006ea80 msgr2=0x7f8c000b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 --2- 172.21.15.80:0/3593742326 >> v2:172.21.15.195:3300/0 conn(0x7f8c0006ea80 0x7f8c000b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 >> v1:172.21.15.195:6789/0 conn(0x7f8c000d2e50 legacy=0x7f8c000cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0006da50 con 0x7f8c0015d170 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f8bf0001670 con 0x7f8c0015d170 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.302+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 >> v1:172.21.15.80:6789/0 conn(0x7f8c0015d170 legacy=0x7f8c000d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfeffd640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8be80039b0 0x7f8be8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfeffd640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8be8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfeffd640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8be80051c0 0x7f8be800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0006ddc0 con 0x7f8be8004800 2024-04-25T15:47:08.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8be800c160 con 0x7f8be80039b0 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8be800c360 con 0x7f8be80051c0 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8be8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bfffff640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8be80039b0 0x7f8be8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8c0486e640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8be80051c0 0x7f8be800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bff7fe640 1 -- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8be80051c0 msgr2=0x7f8be800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8be80051c0 0x7f8be800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bff7fe640 1 -- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8be80039b0 msgr2=0x7f8be8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8be80039b0 0x7f8be8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8bff7fe640 1 -- 172.21.15.80:0/3593742326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be8003520 con 0x7f8be8004800 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.303+0000 7f8c0486e640 1 -- 172.21.15.80:0/3593742326 reap_dead start 2024-04-25T15:47:08.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8be8004c10 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001750 tx=0x7f8be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b763118cb4c152d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4001370 con 0x7f8be8004800 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40052d0 con 0x7f8be8004800 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8bfeffd640 1 -- 172.21.15.80:0/3593742326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf402abc0 con 0x7f8be8004800 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8c062d1640 1 -- 172.21.15.80:0/3593742326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 msgr2=0x7f8be8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8c062d1640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8be8004c10 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001750 tx=0x7f8be8005830 comp rx=0 tx=0).stop 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8c062d1640 1 -- 172.21.15.80:0/3593742326 shutdown_connections 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8c062d1640 1 --2- 172.21.15.80:0/3593742326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8be8004c10 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.304+0000 7f8c062d1640 1 -- 172.21.15.80:0/3593742326 >> 172.21.15.80:0/3593742326 conn(0x7f8c000b7620 msgr2=0x7f8c000b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.305+0000 7f8c062d1640 1 -- 172.21.15.80:0/3593742326 shutdown_connections 2024-04-25T15:47:08.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.305+0000 7f8c062d1640 1 -- 172.21.15.80:0/3593742326 wait complete. 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.306+0000 7f8c062d1640 1 Processor -- start 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.306+0000 7f8c062d1640 1 -- start start 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8c00158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c000cb3a0 0x7f8c000cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c000cf130 0x7f8c000cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8c000b3e00 con 0x7f8be8004800 2024-04-25T15:47:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8c000b2270 con 0x7f8c000cb3a0 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8c000b3f80 con 0x7f8c000cf130 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8c00158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8c00158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51136/0 (socket says 172.21.15.80:51136) 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 -- 172.21.15.80:0/1169699188 learned_addr learned my addr 172.21.15.80:0/1169699188 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c0486e640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c000cf130 0x7f8c000cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c000cb3a0 0x7f8c000cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 -- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c000cf130 msgr2=0x7f8c000cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c000cf130 0x7f8c000cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 -- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c000cb3a0 msgr2=0x7f8c000cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c000cb3a0 0x7f8c000cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 -- 172.21.15.80:0/1169699188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c000cfa80 con 0x7f8be8004800 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c0486e640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c000cf130 0x7f8c000cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfffff640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8c00158d10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00072c0 tx=0x7f8bf0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000f8e0 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf0018070 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c00153820 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000fca0 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.308+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c00153de0 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.310+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0006a100 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.310+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8bf001d460 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.310+0000 7f8bfcff9640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8bec0744b0 0x7f8bec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.310+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8bec0744b0 0x7f8bec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.310+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f8bf00953c0 con 0x7f8be8004800 2024-04-25T15:47:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.311+0000 7f8bff7fe640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8bec0744b0 0x7f8bec0769c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4032000 tx=0x7f8bf402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.315+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8bf005f9c0 con 0x7f8be8004800 2024-04-25T15:47:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.493+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c00072060 con 0x7f8be8004800 2024-04-25T15:47:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.495+0000 7f8bfcff9640 1 -- 172.21.15.80:0/1169699188 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16861 (secure 0 0 0) 0x7f8bf005f2c0 con 0x7f8be8004800 2024-04-25T15:47:08.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:08.496 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":99,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:46:55.949436+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8bec0744b0 msgr2=0x7f8bec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8bec0744b0 0x7f8bec0769c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4032000 tx=0x7f8bf402e000 comp rx=0 tx=0).stop 2024-04-25T15:47:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 msgr2=0x7f8c00158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8c00158d10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00072c0 tx=0x7f8bf0007780 comp rx=0 tx=0).stop 2024-04-25T15:47:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 shutdown_connections 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8bec0744b0 0x7f8bec0769c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8c000cf130 0x7f8c000cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c000cb3a0 0x7f8c000cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 --2- 172.21.15.80:0/1169699188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8004800 0x7f8c00158d10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 >> 172.21.15.80:0/1169699188 conn(0x7f8c000b7620 msgr2=0x7f8c000b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 shutdown_connections 2024-04-25T15:47:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.497+0000 7f8c062d1640 1 -- 172.21.15.80:0/1169699188 wait complete. 2024-04-25T15:47:08.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:52.572368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:53.267030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:47:08.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:47:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.619+0000 7f2218c30640 1 Processor -- start 2024-04-25T15:47:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.619+0000 7f2218c30640 1 -- start start 2024-04-25T15:47:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.620+0000 7f2218c30640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 0x7f221415e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.620+0000 7f2218c30640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f22140cee90 0x7f22140d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.620+0000 7f2218c30640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22140d0cd0 con 0x7f22140d08c0 2024-04-25T15:47:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.620+0000 7f2218c30640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f2214161b00 con 0x7f22140cee90 2024-04-25T15:47:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.620+0000 7f2218c30640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2214161dc0 con 0x7f22140b2b80 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 0x7f221415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f220bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f22140cee90 0x7f22140d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 0x7f221415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:54758/0 (socket says 172.21.15.80:54758) 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 -- 172.21.15.80:0/1248375923 learned_addr learned my addr 172.21.15.80:0/1248375923 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 -- 172.21.15.80:0/1248375923 >> v2:172.21.15.195:3300/0 conn(0x7f22140cee90 msgr2=0x7f22140d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 --2- 172.21.15.80:0/1248375923 >> v2:172.21.15.195:3300/0 conn(0x7f22140cee90 0x7f22140d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 -- 172.21.15.80:0/1248375923 >> v1:172.21.15.195:6789/0 conn(0x7f22140d08c0 legacy=0x7f2214071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.621+0000 7f221259c640 1 -- 172.21.15.80:0/1248375923 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141620a0 con 0x7f22140b2b80 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.622+0000 7f221259c640 1 --2- 172.21.15.80:0/1248375923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 0x7f221415e060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1525cf98762cfa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.622+0000 7f2211d9b640 1 -- 172.21.15.80:0/1248375923 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204037070 con 0x7f22140b2b80 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.622+0000 7f2211d9b640 1 -- 172.21.15.80:0/1248375923 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204032440 con 0x7f22140b2b80 2024-04-25T15:47:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.622+0000 7f2211d9b640 1 -- 172.21.15.80:0/1248375923 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204032810 con 0x7f22140b2b80 2024-04-25T15:47:08.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 -- 172.21.15.80:0/1248375923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 msgr2=0x7f221415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 --2- 172.21.15.80:0/1248375923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 0x7f221415e060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 -- 172.21.15.80:0/1248375923 shutdown_connections 2024-04-25T15:47:08.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 --2- 172.21.15.80:0/1248375923 >> v2:172.21.15.195:3300/0 conn(0x7f22140cee90 0x7f22140d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 --2- 172.21.15.80:0/1248375923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140b2b80 0x7f221415e060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 -- 172.21.15.80:0/1248375923 >> 172.21.15.80:0/1248375923 conn(0x7f22140b54a0 msgr2=0x7f22140b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 -- 172.21.15.80:0/1248375923 shutdown_connections 2024-04-25T15:47:08.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.623+0000 7f2218c30640 1 -- 172.21.15.80:0/1248375923 wait complete. 2024-04-25T15:47:08.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.624+0000 7f2218c30640 1 Processor -- start 2024-04-25T15:47:08.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.625+0000 7f2218c30640 1 -- start start 2024-04-25T15:47:08.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2218c30640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22140b2b80 0x7f22141f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2218c30640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140cee90 0x7f22141f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2218c30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 0x7f22141e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2218c30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2214162940 con 0x7f22140d08c0 2024-04-25T15:47:08.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2218c30640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2214162660 con 0x7f22140b2b80 2024-04-25T15:47:08.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2218c30640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f22140cf2a0 con 0x7f22140cee90 2024-04-25T15:47:08.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 0x7f22141e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 0x7f22141e8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51148/0 (socket says 172.21.15.80:51148) 2024-04-25T15:47:08.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 -- 172.21.15.80:0/41245046 learned_addr learned my addr 172.21.15.80:0/41245046 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:08.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f221259c640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22140b2b80 0x7f22141f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f220bfff640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140cee90 0x7f22141f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 -- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140cee90 msgr2=0x7f22141f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140cee90 0x7f22141f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 -- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22140b2b80 msgr2=0x7f22141f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22140b2b80 0x7f22141f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 -- 172.21.15.80:0/41245046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141f8080 con 0x7f22140d08c0 2024-04-25T15:47:08.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f2212d9d640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 0x7f22141e8f40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c730 tx=0x7f220c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.626+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c003b70 con 0x7f22140d08c0 2024-04-25T15:47:08.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.627+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220c003d10 con 0x7f22140d08c0 2024-04-25T15:47:08.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.627+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141f8360 con 0x7f22140d08c0 2024-04-25T15:47:08.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.627+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c005310 con 0x7f22140d08c0 2024-04-25T15:47:08.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.627+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22141f8920 con 0x7f22140d08c0 2024-04-25T15:47:08.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.628+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22141f7df0 con 0x7f22140d08c0 2024-04-25T15:47:08.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.628+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f220c0056c0 con 0x7f22140d08c0 2024-04-25T15:47:08.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.629+0000 7f220affd640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21f40744b0 0x7f21f40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.629+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f220c095450 con 0x7f22140d08c0 2024-04-25T15:47:08.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.629+0000 7f221259c640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21f40744b0 0x7f21f40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.629+0000 7f221259c640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21f40744b0 0x7f21f40769c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2204034000 tx=0x7f220402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.633+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f220c05f9b0 con 0x7f22140d08c0 2024-04-25T15:47:08.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.807+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f221406a100 con 0x7f22140d08c0 2024-04-25T15:47:08.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.807+0000 7f220affd640 1 -- 172.21.15.80:0/41245046 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f220c05f2b0 con 0x7f22140d08c0 2024-04-25T15:47:08.808 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:47:08.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21f40744b0 msgr2=0x7f21f40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21f40744b0 0x7f21f40769c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2204034000 tx=0x7f220402e000 comp rx=0 tx=0).stop 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 msgr2=0x7f22141e8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 0x7f22141e8f40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c730 tx=0x7f220c00cbf0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 shutdown_connections 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f21f40744b0 0x7f21f40769c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22140d08c0 0x7f22141e8f40 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f22140cee90 0x7f22141f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 --2- 172.21.15.80:0/41245046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22140b2b80 0x7f22141f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 >> 172.21.15.80:0/41245046 conn(0x7f22140b54a0 msgr2=0x7f22140d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 shutdown_connections 2024-04-25T15:47:08.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.809+0000 7f2218c30640 1 -- 172.21.15.80:0/41245046 wait complete. 2024-04-25T15:47:08.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:47:08.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.932+0000 7f6e32e84640 1 Processor -- start 2024-04-25T15:47:08.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.932+0000 7f6e32e84640 1 -- start start 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e32e84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e2c0b2f90 0x7f6e2c0ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e32e84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2c164670 con 0x7f6e2c0d3870 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e32e84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2c164950 con 0x7f6e2c163e40 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e32e84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6e2c164c30 con 0x7f6e2c0b2f90 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e30c20640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e2c0b2f90 0x7f6e2c0ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e31421640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e2c0d3870 0x7f6e2c0d3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33650/0 (socket says 172.21.15.80:33650) 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.933+0000 7f6e31421640 1 -- 172.21.15.80:0/2967282540 learned_addr learned my addr 172.21.15.80:0/2967282540 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.934+0000 7f6e30c20640 1 -- 172.21.15.80:0/2967282540 >> v1:172.21.15.195:6789/0 conn(0x7f6e2c163e40 legacy=0x7f6e2c160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.934+0000 7f6e30c20640 1 -- 172.21.15.80:0/2967282540 >> v1:172.21.15.80:6789/0 conn(0x7f6e2c0d3870 legacy=0x7f6e2c0d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.934+0000 7f6e30c20640 1 -- 172.21.15.80:0/2967282540 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c06db50 con 0x7f6e2c0b2f90 2024-04-25T15:47:08.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.934+0000 7f6e2b7fe640 1 -- 172.21.15.80:0/2967282540 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677984893 0 0) 0x7f6e2c164670 con 0x7f6e2c0d3870 2024-04-25T15:47:08.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.934+0000 7f6e30c20640 1 --2- 172.21.15.80:0/2967282540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c0ce730 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6e200097a0 tx=0x7f6e2002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fa3c0e8712788a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e2b7fe640 1 -- 172.21.15.80:0/2967282540 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20037070 con 0x7f6e2c0b2f90 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e2b7fe640 1 -- 172.21.15.80:0/2967282540 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2002ae50 con 0x7f6e2c0b2f90 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e2b7fe640 1 -- 172.21.15.80:0/2967282540 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20032660 con 0x7f6e2c0b2f90 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 -- 172.21.15.80:0/2967282540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c0b2f90 msgr2=0x7f6e2c0ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2967282540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c0ce730 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6e200097a0 tx=0x7f6e2002a140 comp rx=0 tx=0).stop 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 -- 172.21.15.80:0/2967282540 shutdown_connections 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2967282540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c0ce730 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 -- 172.21.15.80:0/2967282540 >> 172.21.15.80:0/2967282540 conn(0x7f6e2c0b5510 msgr2=0x7f6e2c0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 -- 172.21.15.80:0/2967282540 shutdown_connections 2024-04-25T15:47:08.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.935+0000 7f6e32e84640 1 -- 172.21.15.80:0/2967282540 wait complete. 2024-04-25T15:47:08.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.937+0000 7f6e32e84640 1 Processor -- start 2024-04-25T15:47:08.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.937+0000 7f6e32e84640 1 -- start start 2024-04-25T15:47:08.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.938+0000 7f6e32e84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e2c0d3870 0x7f6e2c1f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 0x7f6e2c1f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c06e4d0 con 0x7f6e2c163e40 2024-04-25T15:47:08.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c06e350 con 0x7f6e2c0b2f90 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2c06e650 con 0x7f6e2c0d3870 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 0x7f6e2c1f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 0x7f6e2c1f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51168/0 (socket says 172.21.15.80:51168) 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 -- 172.21.15.80:0/2510807661 learned_addr learned my addr 172.21.15.80:0/2510807661 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e30c20640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e2bfff640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e2c0d3870 0x7f6e2c1f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 -- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e2c0d3870 msgr2=0x7f6e2c1f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e2c0d3870 0x7f6e2c1f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 -- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e2c0b2f90 msgr2=0x7f6e2c1496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c1496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 -- 172.21.15.80:0/2510807661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c0c87b0 con 0x7f6e2c163e40 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e2bfff640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e2c0d3870 0x7f6e2c1f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e31421640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 0x7f6e2c1f6c80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c6d0 tx=0x7f6e2400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24018070 con 0x7f6e2c163e40 2024-04-25T15:47:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e24004d80 con 0x7f6e2c163e40 2024-04-25T15:47:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c0c8a90 con 0x7f6e2c163e40 2024-04-25T15:47:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400a880 con 0x7f6e2c163e40 2024-04-25T15:47:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.939+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c0c9050 con 0x7f6e2c163e40 2024-04-25T15:47:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.940+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c06a100 con 0x7f6e2c163e40 2024-04-25T15:47:08.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.941+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6e2401b070 con 0x7f6e2c163e40 2024-04-25T15:47:08.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.941+0000 7f6e297fa640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e100744b0 0x7f6e100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.942+0000 7f6e30c20640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e100744b0 0x7f6e100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.942+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f6e24094b00 con 0x7f6e2c163e40 2024-04-25T15:47:08.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.942+0000 7f6e30c20640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e100744b0 0x7f6e100769c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6e20034000 tx=0x7f6e2002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:08.946+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e2405f190 con 0x7f6e2c163e40 2024-04-25T15:47:09.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.125+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e2c1f7210 con 0x7f6e2c163e40 2024-04-25T15:47:09.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.126+0000 7f6e297fa640 1 -- 172.21.15.80:0/2510807661 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f6e24067180 con 0x7f6e2c163e40 2024-04-25T15:47:09.127 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:47:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e100744b0 msgr2=0x7f6e100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e100744b0 0x7f6e100769c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6e20034000 tx=0x7f6e2002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 msgr2=0x7f6e2c1f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 0x7f6e2c1f6c80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c6d0 tx=0x7f6e2400cb90 comp rx=0 tx=0).stop 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 shutdown_connections 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f6e100744b0 0x7f6e100769c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e2c163e40 0x7f6e2c1f6c80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e2c0d3870 0x7f6e2c1f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 --2- 172.21.15.80:0/2510807661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e2c0b2f90 0x7f6e2c1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 >> 172.21.15.80:0/2510807661 conn(0x7f6e2c0b5510 msgr2=0x7f6e2c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 shutdown_connections 2024-04-25T15:47:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.128+0000 7f6e32e84640 1 -- 172.21.15.80:0/2510807661 wait complete. 2024-04-25T15:47:09.140 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:47:09.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.248+0000 7f84cfc84640 1 Processor -- start 2024-04-25T15:47:09.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.249+0000 7f84cfc84640 1 -- start start 2024-04-25T15:47:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cfc84640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f84c80b5490 0x7f84c8160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cfc84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c81643f0 con 0x7f84c80d0b00 2024-04-25T15:47:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cfc84640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c81646d0 con 0x7f84c80d2d50 2024-04-25T15:47:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cfc84640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f84c81649b0 con 0x7f84c80b5490 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cd21f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f84c80d0b00 0x7f84c80d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33664/0 (socket says 172.21.15.80:33664) 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cd21f640 1 -- 172.21.15.80:0/703100279 learned_addr learned my addr 172.21.15.80:0/703100279 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cda20640 1 --2- 172.21.15.80:0/703100279 >> v2:172.21.15.195:3300/0 conn(0x7f84c80b5490 0x7f84c8160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157479648 0 0) 0x7f84c81643f0 con 0x7f84c80d0b00 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.250+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84b4003520 con 0x7f84c80d0b00 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1670757627 0 0) 0x7f84b4003520 con 0x7f84c80d0b00 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 >> v2:172.21.15.195:3300/0 conn(0x7f84c80b5490 msgr2=0x7f84c8160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 --2- 172.21.15.80:0/703100279 >> v2:172.21.15.195:3300/0 conn(0x7f84c80b5490 0x7f84c8160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 >> v1:172.21.15.195:6789/0 conn(0x7f84c80d2d50 legacy=0x7f84c80d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c8164c90 con 0x7f84c80d0b00 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f84b8001670 con 0x7f84c80d0b00 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 >> v1:172.21.15.80:6789/0 conn(0x7f84c80d0b00 legacy=0x7f84c80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b40039b0 0x7f84b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84b4004800 0x7f84b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40051c0 0x7f84b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81649b0 con 0x7f84b40039b0 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f84b400c160 con 0x7f84b4004800 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f84b400c360 con 0x7f84b40051c0 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cda20640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b40039b0 0x7f84b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cd21f640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84b4004800 0x7f84b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84ce221640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40051c0 0x7f84b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cda20640 1 -- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40051c0 msgr2=0x7f84b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cda20640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40051c0 0x7f84b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cda20640 1 -- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84b4004800 msgr2=0x7f84b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cda20640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84b4004800 0x7f84b4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cda20640 1 -- 172.21.15.80:0/703100279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b4003520 con 0x7f84b40039b0 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84cd21f640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84b4004800 0x7f84b4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84ce221640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40051c0 0x7f84b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.251+0000 7f84ce221640 1 -- 172.21.15.80:0/703100279 reap_dead start 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.252+0000 7f84cda20640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b40039b0 0x7f84b4003e20 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009f90 tx=0x7f84b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1da950783a85a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.252+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4036070 con 0x7f84b40039b0 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.252+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c4031600 con 0x7f84b40039b0 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.252+0000 7f84cca1e640 1 -- 172.21.15.80:0/703100279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4009c10 con 0x7f84b40039b0 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 -- 172.21.15.80:0/703100279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b40039b0 msgr2=0x7f84b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b40039b0 0x7f84b4003e20 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009f90 tx=0x7f84b4005830 comp rx=0 tx=0).stop 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 -- 172.21.15.80:0/703100279 shutdown_connections 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 --2- 172.21.15.80:0/703100279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b40039b0 0x7f84b4003e20 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 -- 172.21.15.80:0/703100279 >> 172.21.15.80:0/703100279 conn(0x7f84c806e650 msgr2=0x7f84c806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 -- 172.21.15.80:0/703100279 shutdown_connections 2024-04-25T15:47:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.253+0000 7f84cfc84640 1 -- 172.21.15.80:0/703100279 wait complete. 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.255+0000 7f84cfc84640 1 Processor -- start 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.255+0000 7f84cfc84640 1 -- start start 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cfc84640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40039b0 0x7f84c80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cfc84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84c8156610 0x7f84c80ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cfc84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 0x7f84c81f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cfc84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8163f80 con 0x7f84c81f6110 2024-04-25T15:47:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cfc84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8164100 con 0x7f84c8156610 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cfc84640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f84c80b5490 con 0x7f84b40039b0 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 0x7f84c81f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 0x7f84c81f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51194/0 (socket says 172.21.15.80:51194) 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 -- 172.21.15.80:0/2300354737 learned_addr learned my addr 172.21.15.80:0/2300354737 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cda20640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40039b0 0x7f84c80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84cd21f640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84c8156610 0x7f84c80ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 -- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40039b0 msgr2=0x7f84c80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40039b0 0x7f84c80cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 -- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84c8156610 msgr2=0x7f84c80ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84c8156610 0x7f84c80ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 -- 172.21.15.80:0/2300354737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c80cb5d0 con 0x7f84c81f6110 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.256+0000 7f84ce221640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 0x7f84c81f6520 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f84c80d0450 tx=0x7f84c000d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.257+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0018070 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.257+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c00035f0 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.257+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c80cb8b0 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.257+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c00039e0 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.257+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c80cbe70 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.257+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c806a100 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.258+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f84c001b070 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.259+0000 7f84be7fc640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f84ac0744b0 0x7f84ac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.259+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f84c00947a0 con 0x7f84c81f6110 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.259+0000 7f84cda20640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f84ac0744b0 0x7f84ac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.259+0000 7f84cda20640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f84ac0744b0 0x7f84ac0769c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f84c4033000 tx=0x7f84c402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.263+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84c005eef0 con 0x7f84c81f6110 2024-04-25T15:47:09.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.439+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84c8163900 con 0x7f84c81f6110 2024-04-25T15:47:09.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.439+0000 7f84be7fc640 1 -- 172.21.15.80:0/2300354737 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7f84c005e7f0 con 0x7f84c81f6110 2024-04-25T15:47:09.440 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:47:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f84ac0744b0 msgr2=0x7f84ac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f84ac0744b0 0x7f84ac0769c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f84c4033000 tx=0x7f84c402e000 comp rx=0 tx=0).stop 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 msgr2=0x7f84c81f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 0x7f84c81f6520 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f84c80d0450 tx=0x7f84c000d810 comp rx=0 tx=0).stop 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 shutdown_connections 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f84ac0744b0 0x7f84ac0769c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84c81f6110 0x7f84c81f6520 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84c8156610 0x7f84c80ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 --2- 172.21.15.80:0/2300354737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f84b40039b0 0x7f84c80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 >> 172.21.15.80:0/2300354737 conn(0x7f84c806e650 msgr2=0x7f84c80b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 shutdown_connections 2024-04-25T15:47:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.441+0000 7f84cfc84640 1 -- 172.21.15.80:0/2300354737 wait complete. 2024-04-25T15:47:09.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:47:09.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.561+0000 7f9590557640 1 Processor -- start 2024-04-25T15:47:09.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.561+0000 7f9590557640 1 -- start start 2024-04-25T15:47:09.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.562+0000 7f9590557640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f95880b4b60 0x7f95880b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.562+0000 7f9590557640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880b2f30 con 0x7f958806d6d0 2024-04-25T15:47:09.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.562+0000 7f9590557640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880b2c90 con 0x7f95880b3850 2024-04-25T15:47:09.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.562+0000 7f9590557640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f958806eb60 con 0x7f95880b4b60 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.562+0000 7f958daf2640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f958806d6d0 0x7f95880b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33676/0 (socket says 172.21.15.80:33676) 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.562+0000 7f958daf2640 1 -- 172.21.15.80:0/1033785956 learned_addr learned my addr 172.21.15.80:0/1033785956 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1033785956 >> v2:172.21.15.195:3300/0 conn(0x7f95880b4b60 0x7f95880b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967024282 0 0) 0x7f95880b2f30 con 0x7f958806d6d0 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9574003520 con 0x7f958806d6d0 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1495096715 0 0) 0x7f9574003520 con 0x7f958806d6d0 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 >> v2:172.21.15.195:3300/0 conn(0x7f95880b4b60 msgr2=0x7f95880b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 --2- 172.21.15.80:0/1033785956 >> v2:172.21.15.195:3300/0 conn(0x7f95880b4b60 0x7f95880b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 >> v1:172.21.15.195:6789/0 conn(0x7f95880b3850 legacy=0x7f958816a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880d10a0 con 0x7f958806d6d0 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f9578001670 con 0x7f958806d6d0 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 >> v1:172.21.15.80:6789/0 conn(0x7f958806d6d0 legacy=0x7f95880b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95740039b0 0x7f9574003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574004800 0x7f9574004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9574005250 0x7f957400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f958806eb60 con 0x7f9574005250 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f957400c1e0 con 0x7f9574004800 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f957400c3e0 con 0x7f95740039b0 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1033785956 >> v2:172.21.15.195:3300/0 conn(0x7f95880b4b60 0x7f95880b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958eaf4640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9574005250 0x7f957400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958daf2640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574004800 0x7f9574004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95740039b0 0x7f9574003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958eaf4640 1 -- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95740039b0 msgr2=0x7f9574003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958eaf4640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95740039b0 0x7f9574003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958eaf4640 1 -- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574004800 msgr2=0x7f9574004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958eaf4640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574004800 0x7f9574004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958eaf4640 1 -- 172.21.15.80:0/1033785956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9574003520 con 0x7f9574005250 2024-04-25T15:47:09.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.563+0000 7f958daf2640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574004800 0x7f9574004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.564+0000 7f958eaf4640 1 -- 172.21.15.80:0/1033785956 reap_dead start 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.564+0000 7f958eaf4640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9574005250 0x7f957400b9c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9580001e50 tx=0x7f9574005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d874ed406b216a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.564+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580001a70 con 0x7f9574005250 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.564+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580003970 con 0x7f9574005250 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.564+0000 7f958d2f1640 1 -- 172.21.15.80:0/1033785956 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580003d60 con 0x7f9574005250 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 -- 172.21.15.80:0/1033785956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9574005250 msgr2=0x7f957400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9574005250 0x7f957400b9c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9580001e50 tx=0x7f9574005830 comp rx=0 tx=0).stop 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 -- 172.21.15.80:0/1033785956 shutdown_connections 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 --2- 172.21.15.80:0/1033785956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9574005250 0x7f957400b9c0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 -- 172.21.15.80:0/1033785956 >> 172.21.15.80:0/1033785956 conn(0x7f95880d0450 msgr2=0x7f95880d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 -- 172.21.15.80:0/1033785956 shutdown_connections 2024-04-25T15:47:09.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.565+0000 7f9590557640 1 -- 172.21.15.80:0/1033785956 wait complete. 2024-04-25T15:47:09.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.567+0000 7f9590557640 1 Processor -- start 2024-04-25T15:47:09.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.567+0000 7f9590557640 1 -- start start 2024-04-25T15:47:09.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f9590557640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574005250 0x7f95881dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f9590557640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 0x7f95880a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f9590557640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95881f9450 0x7f95881f9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f9590557640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f958809d0e0 con 0x7f958809eea0 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f9590557640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f95880d13a0 con 0x7f9574005250 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f9590557640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f958809d260 con 0x7f95881f9450 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 0x7f95880a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 0x7f95880a04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51210/0 (socket says 172.21.15.80:51210) 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 -- 172.21.15.80:0/1306690386 learned_addr learned my addr 172.21.15.80:0/1306690386 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574005250 0x7f95881dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958eaf4640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95881f9450 0x7f95881f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 -- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95881f9450 msgr2=0x7f95881f9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95881f9450 0x7f95881f9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 -- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574005250 msgr2=0x7f95881dbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574005250 0x7f95881dbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958daf2640 1 -- 172.21.15.80:0/1306690386 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880a0a10 con 0x7f958809eea0 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958eaf4640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95881f9450 0x7f95881f9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:09.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.568+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574005250 0x7f95881dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.569+0000 7f958daf2640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 0x7f95880a04d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f957800e780 tx=0x7f957800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.569+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957800c6c0 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.569+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9578018070 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.569+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95881f9da0 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.569+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957800ca60 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.569+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958809e0e0 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.570+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958806a100 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.570+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f957800cc00 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.571+0000 7f957effd640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f956c0744b0 0x7f956c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.571+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f9578095300 con 0x7f958809eea0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.571+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f956c0744b0 0x7f956c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.571+0000 7f958e2f3640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f956c0744b0 0x7f956c0769c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9584009b80 tx=0x7f9584008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.576+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95881f9da0 con 0x7f958809eea0 2024-04-25T15:47:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.762+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9588068860 con 0x7f958809eea0 2024-04-25T15:47:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.762+0000 7f957effd640 1 -- 172.21.15.80:0/1306690386 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v99) ==== 80+0+0 (secure 0 0 0) 0x7f957805f900 con 0x7f958809eea0 2024-04-25T15:47:09.763 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-25T15:47:09.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f956c0744b0 msgr2=0x7f956c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f956c0744b0 0x7f956c0769c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9584009b80 tx=0x7f9584008040 comp rx=0 tx=0).stop 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 msgr2=0x7f95880a04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 0x7f95880a04d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f957800e780 tx=0x7f957800ec40 comp rx=0 tx=0).stop 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 shutdown_connections 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f956c0744b0 0x7f956c0769c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95881f9450 0x7f95881f9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f958809eea0 0x7f95880a04d0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 --2- 172.21.15.80:0/1306690386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9574005250 0x7f95881dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 >> 172.21.15.80:0/1306690386 conn(0x7f95880d0450 msgr2=0x7f958806dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 shutdown_connections 2024-04-25T15:47:09.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:09.764+0000 7f9590557640 1 -- 172.21.15.80:0/1306690386 wait complete. 2024-04-25T15:47:09.776 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:47:09.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:09.776 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:09.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:47:09.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:09.811 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:47:09.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:47:09.873 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:47:09.913 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-25T15:47:09.913 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-04-25T15:47:09.913 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.914 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:47:09.915 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-04-25T15:47:09.916 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on skipped message = False 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-04-25T15:47:09.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-04-25T15:47:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-04-25T15:47:09.919 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 20 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 20 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 10 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-04-25T15:47:09.920 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T15:47:09.921 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.922 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon down mkfs grace = 300 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-04-25T15:47:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = "" 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-04-25T15:47:09.924 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-04-25T15:47:09.925 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-04-25T15:47:09.926 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-04-25T15:47:09.926 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T15:47:09.926 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T15:47:09.927 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T15:47:09.927 INFO:teuthology.orchestra.run.smithi080.stdout: mds_sessionmap_keys_per_op = 1 2024-04-25T15:47:09.954 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-25T15:47:09.955 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-25T15:47:09.956 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-25T15:47:09.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on skipped message = False 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-25T15:47:09.958 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.959 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 20 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 20 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:09.960 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 10 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T15:47:09.961 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:09.962 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.963 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: mon down mkfs grace = 300 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-04-25T15:47:09.964 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-04-25T15:47:09.965 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-04-25T15:47:09.966 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-04-25T15:47:09.966 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T15:47:09.966 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T15:47:09.966 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T15:47:09.966 INFO:teuthology.orchestra.run.smithi195.stdout: mds_sessionmap_keys_per_op = 1 2024-04-25T15:47:09.967 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:47:09.967 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:47:09.968 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:47:09.968 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:47:09.968 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:47:09.968 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:47:09.969 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:47:09.969 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:47:09.981 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:47:09.981 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-04-25T15:47:09.982 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:47:09.982 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-04-25T15:47:10.019 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:47:10.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-04-25T15:47:10.021 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:47:10.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-04-25T15:47:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7fd34f60d640 1 Processor -- start 2024-04-25T15:47:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7f99f6ae2640 1 Processor -- start 2024-04-25T15:47:10.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7f99f6ae2640 1 -- start start 2024-04-25T15:47:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7f0df9e4c640 1 Processor -- start 2024-04-25T15:47:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7f8e8a6f9640 1 Processor -- start 2024-04-25T15:47:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7f0df9e4c640 1 -- start start 2024-04-25T15:47:10.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7f8e8a6f9640 1 -- start start 2024-04-25T15:47:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.138+0000 7fd34f60d640 1 -- start start 2024-04-25T15:47:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7f99f6ae2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f99f00af2e0 0x7f99f00cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7f99f6ae2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f015e520 0x7f99f015e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7f99f6ae2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f015ef50 con 0x7f99f006d5d0 2024-04-25T15:47:10.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7f99f6ae2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f99f015f230 con 0x7f99f00af2e0 2024-04-25T15:47:10.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7f99f6ae2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99f00aeae0 con 0x7f99f015e520 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7fd34f60d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3481540f0 0x7fd34815de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7fd34f60d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3480b0790 0x7fd3480b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7fd34f60d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd34815e3b0 con 0x7fd34806d5d0 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.139+0000 7fd34f60d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd3480b12c0 con 0x7fd3481540f0 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34f60d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3480b0d00 con 0x7fd3480b0790 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34cba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3480b0790 0x7fd3480b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3481540f0 0x7fd34815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3481540f0 0x7fd34815de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51212/0 (socket says 172.21.15.80:51212) 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34dbaa640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd34806d5d0 0x7fd34806d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54006/0 (socket says 172.21.15.80:54006) 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 -- 172.21.15.80:0/3927195400 learned_addr learned my addr 172.21.15.80:0/3927195400 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34cba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3480b0790 0x7fd3480b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:54804/0 (socket says 172.21.15.80:54804) 2024-04-25T15:47:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99f507f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99f006d5d0 0x7f99f006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33690/0 (socket says 172.21.15.80:33690) 2024-04-25T15:47:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99f507f640 1 -- 172.21.15.80:0/3602830018 learned_addr learned my addr 172.21.15.80:0/3602830018 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99effff640 1 --2- 172.21.15.80:0/3602830018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f015e520 0x7f99f015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 -- 172.21.15.80:0/3927195400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3480b0790 msgr2=0x7fd3480b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 --2- 172.21.15.80:0/3927195400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3480b0790 0x7fd3480b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 -- 172.21.15.80:0/3927195400 >> v1:172.21.15.195:6789/0 conn(0x7fd34806d5d0 legacy=0x7fd34806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7fd34d3a9640 1 -- 172.21.15.80:0/3927195400 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3480b0fe0 con 0x7fd3481540f0 2024-04-25T15:47:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f8e8a6f9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e8406c5c0 0x7f8e8406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99effff640 1 -- 172.21.15.80:0/3602830018 >> v2:172.21.15.195:3300/0 conn(0x7f99f00af2e0 msgr2=0x7f99f00cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99effff640 1 --2- 172.21.15.80:0/3602830018 >> v2:172.21.15.195:3300/0 conn(0x7f99f00af2e0 0x7f99f00cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99effff640 1 -- 172.21.15.80:0/3602830018 >> v1:172.21.15.80:6789/0 conn(0x7f99f006d5d0 legacy=0x7f99f006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f0df9e4c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0df4070a00 0x7f0df4164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f99effff640 1 -- 172.21.15.80:0/3602830018 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f00aedc0 con 0x7f99f015e520 2024-04-25T15:47:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f0df9e4c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df4164fd0 con 0x7f0df40b48d0 2024-04-25T15:47:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f0df9e4c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df41652b0 con 0x7f0df406d5d0 2024-04-25T15:47:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f0df9e4c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0df4165590 con 0x7f0df4070a00 2024-04-25T15:47:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.140+0000 7f8e8a6f9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e84163e70 0x7f8e840b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e83fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e8406c5c0 0x7f8e8406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e84163e70 0x7f8e840b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e83fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e8406c5c0 0x7f8e8406db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:54820/0 (socket says 172.21.15.80:54820) 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e84163e70 0x7f8e840b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51218/0 (socket says 172.21.15.80:51218) 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 -- 172.21.15.80:0/712789978 learned_addr learned my addr 172.21.15.80:0/712789978 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e840b5190 con 0x7f8e840d0a70 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8406ca80 con 0x7f8e84163e70 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8406cd60 con 0x7f8e8406c5c0 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f0df3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0df40b48d0 0x7f0df40b4ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33702/0 (socket says 172.21.15.80:33702) 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f0df3fff640 1 -- 172.21.15.80:0/3421721533 learned_addr learned my addr 172.21.15.80:0/3421721533 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f0df37fe640 1 --2- 172.21.15.80:0/3421721533 >> v2:172.21.15.195:3300/0 conn(0x7f0df4070a00 0x7f0df4164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7fd34d3a9640 1 --2- 172.21.15.80:0/3927195400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3481540f0 0x7fd34815de70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd34400bb10 tx=0x7fd34402eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950eea31b82af53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 -- 172.21.15.80:0/712789978 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e8406c5c0 msgr2=0x7f8e8406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 --2- 172.21.15.80:0/712789978 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e8406c5c0 0x7f8e8406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 -- 172.21.15.80:0/712789978 >> v1:172.21.15.80:6789/0 conn(0x7f8e840d0a70 legacy=0x7f8e840d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f8e837fe640 1 -- 172.21.15.80:0/712789978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8406d040 con 0x7f8e84163e70 2024-04-25T15:47:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f0df37fe640 1 -- 172.21.15.80:0/3421721533 >> v1:172.21.15.195:6789/0 conn(0x7f0df406d5d0 legacy=0x7f0df406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f99effff640 1 --2- 172.21.15.80:0/3602830018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f015e520 0x7f99f015e930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0097a0 tx=0x7f99dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce97e58a72619df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f0df37fe640 1 -- 172.21.15.80:0/3421721533 >> v1:172.21.15.80:6789/0 conn(0x7f0df40b48d0 legacy=0x7f0df40b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.141+0000 7f0df37fe640 1 -- 172.21.15.80:0/3421721533 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df4165870 con 0x7f0df4070a00 2024-04-25T15:47:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f99ef7fe640 1 -- 172.21.15.80:0/3602830018 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc037070 con 0x7f99f015e520 2024-04-25T15:47:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f99ef7fe640 1 -- 172.21.15.80:0/3602830018 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc032440 con 0x7f99f015e520 2024-04-25T15:47:10.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f99ef7fe640 1 -- 172.21.15.80:0/3602830018 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc032810 con 0x7f99f015e520 2024-04-25T15:47:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7fd33ffff640 1 -- 172.21.15.80:0/3927195400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344030880 con 0x7fd3481540f0 2024-04-25T15:47:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7fd33ffff640 1 -- 172.21.15.80:0/3927195400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd344030a20 con 0x7fd3481540f0 2024-04-25T15:47:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7fd33ffff640 1 -- 172.21.15.80:0/3927195400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344030df0 con 0x7fd3481540f0 2024-04-25T15:47:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f8e837fe640 1 --2- 172.21.15.80:0/712789978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e84163e70 0x7f8e840b4c50 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e7802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440dc149b5e3c826 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f8e82ffd640 1 -- 172.21.15.80:0/712789978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78037070 con 0x7f8e84163e70 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f8e82ffd640 1 -- 172.21.15.80:0/712789978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e78032440 con 0x7f8e84163e70 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f8e82ffd640 1 -- 172.21.15.80:0/712789978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78032810 con 0x7f8e84163e70 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3602830018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f015e520 msgr2=0x7f99f015e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.142+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3602830018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f015e520 0x7f99f015e930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0097a0 tx=0x7f99dc02a180 comp rx=0 tx=0).stop 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3602830018 shutdown_connections 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3602830018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f015e520 0x7f99f015e930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3602830018 >> v2:172.21.15.195:3300/0 conn(0x7f99f00af2e0 0x7f99f00cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3602830018 >> 172.21.15.80:0/3602830018 conn(0x7f99f00d1e30 msgr2=0x7f99f0073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f0df37fe640 1 --2- 172.21.15.80:0/3421721533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df4070a00 0x7f0df4164660 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0de40097a0 tx=0x7f0de402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35843b6da2a2f058 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3602830018 shutdown_connections 2024-04-25T15:47:10.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3602830018 wait complete. 2024-04-25T15:47:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f0df27fc640 1 -- 172.21.15.80:0/3421721533 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037070 con 0x7f0df4070a00 2024-04-25T15:47:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f0df27fc640 1 -- 172.21.15.80:0/3421721533 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4032440 con 0x7f0df4070a00 2024-04-25T15:47:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f0df27fc640 1 -- 172.21.15.80:0/3421721533 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037070 con 0x7f0df4070a00 2024-04-25T15:47:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 -- 172.21.15.80:0/3927195400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3481540f0 msgr2=0x7fd34815de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 --2- 172.21.15.80:0/3927195400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3481540f0 0x7fd34815de70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd34400bb10 tx=0x7fd34402eb60 comp rx=0 tx=0).stop 2024-04-25T15:47:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 -- 172.21.15.80:0/3927195400 shutdown_connections 2024-04-25T15:47:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 --2- 172.21.15.80:0/3927195400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3480b0790 0x7fd3480b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 --2- 172.21.15.80:0/3927195400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3481540f0 0x7fd34815de70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 -- 172.21.15.80:0/3927195400 >> 172.21.15.80:0/3927195400 conn(0x7fd3480d1e30 msgr2=0x7fd348073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e84163e70 msgr2=0x7f8e840b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/712789978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e84163e70 0x7f8e840b4c50 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e7802a210 comp rx=0 tx=0).stop 2024-04-25T15:47:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 -- 172.21.15.80:0/3927195400 shutdown_connections 2024-04-25T15:47:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7fd34f60d640 1 -- 172.21.15.80:0/3927195400 wait complete. 2024-04-25T15:47:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.143+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 shutdown_connections 2024-04-25T15:47:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/712789978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e84163e70 0x7f8e840b4c50 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/712789978 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e8406c5c0 0x7f8e8406db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 >> 172.21.15.80:0/712789978 conn(0x7f8e840d6620 msgr2=0x7f8e840d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 shutdown_connections 2024-04-25T15:47:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/712789978 wait complete. 2024-04-25T15:47:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 -- 172.21.15.80:0/3421721533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df4070a00 msgr2=0x7f0df4164660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/3421721533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df4070a00 0x7f0df4164660 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0de40097a0 tx=0x7f0de402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 -- 172.21.15.80:0/3421721533 shutdown_connections 2024-04-25T15:47:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/3421721533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df4070a00 0x7f0df4164660 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 -- 172.21.15.80:0/3421721533 >> 172.21.15.80:0/3421721533 conn(0x7f0df40d1e30 msgr2=0x7f0df4073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 -- 172.21.15.80:0/3421721533 shutdown_connections 2024-04-25T15:47:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.145+0000 7f99f6ae2640 1 Processor -- start 2024-04-25T15:47:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.145+0000 7f99f6ae2640 1 -- start start 2024-04-25T15:47:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.144+0000 7f0df9e4c640 1 -- 172.21.15.80:0/3421721533 wait complete. 2024-04-25T15:47:10.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f8e8a6f9640 1 Processor -- start 2024-04-25T15:47:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7fd34f60d640 1 Processor -- start 2024-04-25T15:47:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f8e8a6f9640 1 -- start start 2024-04-25T15:47:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f6ae2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006d5d0 0x7f99f0142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7fd34f60d640 1 -- start start 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f6ae2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 0x7f99f015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f6ae2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e520 0x7f99f006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f6ae2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99f00ce0c0 con 0x7f99f00af2e0 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f6ae2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99f00cdf40 con 0x7f99f015e520 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f6ae2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99f0071320 con 0x7f99f006d5d0 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 0x7f99f015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 0x7f99f015ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51230/0 (socket says 172.21.15.80:51230) 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99effff640 1 -- 172.21.15.80:0/3167843771 learned_addr learned my addr 172.21.15.80:0/3167843771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f487e640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006d5d0 0x7f99f0142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.146+0000 7f99f507f640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e520 0x7f99f006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99effff640 1 -- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006d5d0 msgr2=0x7f99f0142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99effff640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006d5d0 0x7f99f0142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99effff640 1 -- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e520 msgr2=0x7f99f006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99effff640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e520 0x7f99f006f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99effff640 1 -- 172.21.15.80:0/3167843771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f015b870 con 0x7f99f00af2e0 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99f487e640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006d5d0 0x7f99f0142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99effff640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 0x7f99f015ac90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f99dc02a770 tx=0x7f99dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc041070 con 0x7f99f00af2e0 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc03c870 con 0x7f99f00af2e0 2024-04-25T15:47:10.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc037040 con 0x7f99f00af2e0 2024-04-25T15:47:10.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f01f7a40 con 0x7f99f00af2e0 2024-04-25T15:47:10.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.147+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f01f7d20 con 0x7f99f00af2e0 2024-04-25T15:47:10.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e8a6f9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 0x7f8e840cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e8a6f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e840ca150 0x7f8e840cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e8a6f9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e840c8ea0 0x7f8e84148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 0x7f8e840cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 0x7f8e840cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:46790/0 (socket says 172.21.15.80:46790) 2024-04-25T15:47:10.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f0df9e4c640 1 Processor -- start 2024-04-25T15:47:10.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e8a6f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8e840d1590 con 0x7f8e840ca150 2024-04-25T15:47:10.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 -- 172.21.15.80:0/871032549 learned_addr learned my addr 172.21.15.80:0/871032549 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:10.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8406d600 con 0x7f8e840d0a70 2024-04-25T15:47:10.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e837fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e840ca150 0x7f8e840cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8e840d1710 con 0x7f8e840c8ea0 2024-04-25T15:47:10.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e88c96640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e840c8ea0 0x7f8e84148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7fd34f60d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd34806d5d0 0x7fd348146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7fd34f60d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3480b0790 0x7fd3480b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7fd34f60d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd34815c220 0x7fd34815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 -- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e840c8ea0 msgr2=0x7f8e84148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e840c8ea0 0x7f8e84148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 -- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e840ca150 msgr2=0x7f8e840cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e840ca150 0x7f8e840cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f8e83fff640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e841f61d0 con 0x7f8e840d0a70 2024-04-25T15:47:10.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f01f7860 con 0x7f99f00af2e0 2024-04-25T15:47:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7f0df9e4c640 1 -- start start 2024-04-25T15:47:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.148+0000 7fd34cba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3480b0790 0x7fd3480b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34d3a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd34806d5d0 0x7fd348146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34d3a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd34806d5d0 0x7fd348146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:54834/0 (socket says 172.21.15.80:54834) 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34cba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3480b0790 0x7fd3480b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51242/0 (socket says 172.21.15.80:51242) 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34d3a9640 1 -- 172.21.15.80:0/441893217 learned_addr learned my addr 172.21.15.80:0/441893217 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34dbaa640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd34815c220 0x7fd34815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd3480b6b10 con 0x7fd3480b0790 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd34815d950 con 0x7fd34815c220 2024-04-25T15:47:10.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3480b6c90 con 0x7fd34806d5d0 2024-04-25T15:47:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7f8e83fff640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 0x7f8e840cb960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009cd0 tx=0x7f8e7c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c018020 con 0x7f8e840d0a70 2024-04-25T15:47:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c014480 con 0x7f8e840d0a70 2024-04-25T15:47:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c014850 con 0x7f8e840d0a70 2024-04-25T15:47:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e840ca8c0 con 0x7f8e840d0a70 2024-04-25T15:47:10.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34dbaa640 1 -- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd34806d5d0 msgr2=0x7fd348146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34dbaa640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd34806d5d0 0x7fd348146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34dbaa640 1 -- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3480b0790 msgr2=0x7fd3480b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.149+0000 7fd34dbaa640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3480b0790 0x7fd3480b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7fd34dbaa640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34815cb70 con 0x7fd34815c220 2024-04-25T15:47:10.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e840cae80 con 0x7f8e840d0a70 2024-04-25T15:47:10.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7fd34dbaa640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd34815c220 0x7fd34815c630 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c700 tx=0x7fd34000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340018070 con 0x7fd34815c220 2024-04-25T15:47:10.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340004d80 con 0x7fd34815c220 2024-04-25T15:47:10.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34000a880 con 0x7fd34815c220 2024-04-25T15:47:10.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f99dc044070 con 0x7f99f00af2e0 2024-04-25T15:47:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.150+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd348156640 con 0x7fd34815c220 2024-04-25T15:47:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd348156dc0 con 0x7fd34815c220 2024-04-25T15:47:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f99ed7fa640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99d40744e0 0x7f99d40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f99dc0b6430 con 0x7f99f00af2e0 2024-04-25T15:47:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f99f487e640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99d40744e0 0x7f99d40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df9e4c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 0x7f0df414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e84050740 con 0x7f8e840d0a70 2024-04-25T15:47:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df9e4c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df4070a00 0x7f0df41600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df9e4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40b48d0 0x7f0df409b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df9e4c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4164d20 con 0x7f0df40b48d0 2024-04-25T15:47:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df9e4c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4164ba0 con 0x7f0df406d5d0 2024-04-25T15:47:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df9e4c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0df4071350 con 0x7f0df4070a00 2024-04-25T15:47:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 0x7f0df414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f99f487e640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99d40744e0 0x7f99d40769f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009890 tx=0x7f99e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 0x7f0df414fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:46808/0 (socket says 172.21.15.80:46808) 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df37fe640 1 -- 172.21.15.80:0/1730585827 learned_addr learned my addr 172.21.15.80:0/1730585827 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.151+0000 7f0df3fff640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40b48d0 0x7f0df409b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f0df37fe640 1 -- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df4070a00 msgr2=0x7f0df41600f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f0df37fe640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df4070a00 0x7f0df41600f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f0df37fe640 1 -- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40b48d0 msgr2=0x7f0df409b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f0df37fe640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40b48d0 0x7f0df409b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f0df37fe640 1 -- 172.21.15.80:0/1730585827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df4160630 con 0x7f0df406d5d0 2024-04-25T15:47:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd348050740 con 0x7fd34815c220 2024-04-25T15:47:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8e7c005d10 con 0x7f8e840d0a70 2024-04-25T15:47:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.152+0000 7f0df37fe640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 0x7f0df414fd10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0de40098c0 tx=0x7f0de40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7f8e80ff9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e700744e0 0x7f8e700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd34000aa20 con 0x7fd34815c220 2024-04-25T15:47:10.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7f8e837fe640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e700744e0 0x7f8e700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f8e7c095f90 con 0x7f8e840d0a70 2024-04-25T15:47:10.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7f8e837fe640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e700744e0 0x7f8e700769f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8e78034000 tx=0x7f8e7802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7fd33dffb640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd32c0744b0 0x7fd32c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7fd34d3a9640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd32c0744b0 0x7fd32c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.153+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7fd340094840 con 0x7fd34815c220 2024-04-25T15:47:10.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.154+0000 7fd34d3a9640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd32c0744b0 0x7fd32c0769c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd34400bb10 tx=0x7fd344034000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.156+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99f01f7860 con 0x7f99f00af2e0 2024-04-25T15:47:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.157+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4041020 con 0x7f0df406d5d0 2024-04-25T15:47:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.157+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df409f960 con 0x7f0df406d5d0 2024-04-25T15:47:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.158+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df415f610 con 0x7f0df406d5d0 2024-04-25T15:47:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.158+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e7c022030 con 0x7f8e840d0a70 2024-04-25T15:47:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df4050740 con 0x7f0df406d5d0 2024-04-25T15:47:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.162+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4032440 con 0x7f0df406d5d0 2024-04-25T15:47:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.162+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037070 con 0x7f0df406d5d0 2024-04-25T15:47:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.162+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd34815e3b0 con 0x7fd34815c220 2024-04-25T15:47:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.164+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0de4044020 con 0x7f0df406d5d0 2024-04-25T15:47:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.164+0000 7f0ddbfff640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0de00744e0 0x7f0de00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.165+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6101+0+0 (secure 0 0 0) 0x7f0de40b6110 con 0x7f0df406d5d0 2024-04-25T15:47:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.165+0000 7f0df2ffd640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0de00744e0 0x7f0de00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.165+0000 7f0df2ffd640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0de00744e0 0x7f0de00769f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0df40b03c0 tx=0x7f0de80079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.167+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0de404b030 con 0x7f0df406d5d0 2024-04-25T15:47:10.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.412+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f99f0050740 con 0x7f99f00af2e0 2024-04-25T15:47:10.413 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:47:10.412+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:47:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.414+0000 7f99ed7fa640 1 -- 172.21.15.80:0/3167843771 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7548 v53) ==== 95+0+0 (secure 0 0 0) 0x7f99dc0803c0 con 0x7f99f00af2e0 2024-04-25T15:47:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7548 2024-04-25T15:47:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.416+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99d40744e0 msgr2=0x7f99d40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.416+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99d40744e0 0x7f99d40769f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009890 tx=0x7f99e4008040 comp rx=0 tx=0).stop 2024-04-25T15:47:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.416+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 msgr2=0x7f99f015ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.416+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 0x7f99f015ac90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f99dc02a770 tx=0x7f99dc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 shutdown_connections 2024-04-25T15:47:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f99d40744e0 0x7f99d40769f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e520 0x7f99f006f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99f00af2e0 0x7f99f015ac90 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 --2- 172.21.15.80:0/3167843771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006d5d0 0x7f99f0142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 >> 172.21.15.80:0/3167843771 conn(0x7f99f00d1e30 msgr2=0x7f99f015d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 shutdown_connections 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.419+0000 7f99f6ae2640 1 -- 172.21.15.80:0/3167843771 wait complete. 2024-04-25T15:47:10.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.421+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fd34806db80 con 0x7fd34815c220 2024-04-25T15:47:10.436 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:47:10.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:47:10.439 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:47:10.439 DEBUG:teuthology.parallel:result is None 2024-04-25T15:47:10.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.446+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f8e840d40a0 con 0x7f8e840d0a70 2024-04-25T15:47:10.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:10.450+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f0df4164840 con 0x7f0df406d5d0 2024-04-25T15:47:10.519 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:47:11.149 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:47:11.148+0000 7fde99bbe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:47:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.155+0000 7fd33dffb640 1 -- 172.21.15.80:0/441893217 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5993 v55) ==== 95+0+0 (secure 0 0 0) 0x7fd34005e6d0 con 0x7fd34815c220 2024-04-25T15:47:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.155+0000 7f8e80ff9640 1 -- 172.21.15.80:0/871032549 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5999 v55) ==== 95+0+0 (secure 0 0 0) 0x7f8e7c010040 con 0x7f8e840d0a70 2024-04-25T15:47:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.155+0000 7f0ddbfff640 1 -- 172.21.15.80:0/1730585827 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6670 v55) ==== 95+0+0 (secure 0 0 0) 0x7f0de40807a0 con 0x7f0df406d5d0 2024-04-25T15:47:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5993 2024-04-25T15:47:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5999 2024-04-25T15:47:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6670 2024-04-25T15:47:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd32c0744b0 msgr2=0x7fd32c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd32c0744b0 0x7fd32c0769c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd34400bb10 tx=0x7fd344034000 comp rx=0 tx=0).stop 2024-04-25T15:47:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd34815c220 msgr2=0x7fd34815c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd34815c220 0x7fd34815c630 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c700 tx=0x7fd34000cbc0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e700744e0 msgr2=0x7f8e700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e700744e0 0x7f8e700769f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8e78034000 tx=0x7f8e7802e000 comp rx=0 tx=0).stop 2024-04-25T15:47:11.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 msgr2=0x7f8e840cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 0x7f8e840cb960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009cd0 tx=0x7f8e7c00c490 comp rx=0 tx=0).stop 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 shutdown_connections 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd32c0744b0 0x7fd32c0769c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd34815c220 0x7fd34815c630 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3480b0790 0x7fd3480b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 --2- 172.21.15.80:0/441893217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd34806d5d0 0x7fd348146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 shutdown_connections 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f8e700744e0 0x7f8e700769f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e840c8ea0 0x7f8e84148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 >> 172.21.15.80:0/441893217 conn(0x7fd3480d1e30 msgr2=0x7fd34815e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e840ca150 0x7f8e840cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 --2- 172.21.15.80:0/871032549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e840d0a70 0x7f8e840cb960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.158+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 >> 172.21.15.80:0/871032549 conn(0x7f8e840d6620 msgr2=0x7f8e8415fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 shutdown_connections 2024-04-25T15:47:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7fd34f60d640 1 -- 172.21.15.80:0/441893217 wait complete. 2024-04-25T15:47:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 shutdown_connections 2024-04-25T15:47:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f8e8a6f9640 1 -- 172.21.15.80:0/871032549 wait complete. 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0de00744e0 msgr2=0x7f0de00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0de00744e0 0x7f0de00769f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0df40b03c0 tx=0x7f0de80079d0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 msgr2=0x7f0df414fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 0x7f0df414fd10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0de40098c0 tx=0x7f0de40046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 shutdown_connections 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0de00744e0 0x7f0de00769f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40b48d0 0x7f0df409b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df4070a00 0x7f0df41600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 --2- 172.21.15.80:0/1730585827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df406d5d0 0x7f0df414fd10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 >> 172.21.15.80:0/1730585827 conn(0x7f0df40d1e30 msgr2=0x7f0df4163680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:11.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 shutdown_connections 2024-04-25T15:47:11.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.159+0000 7f0df9e4c640 1 -- 172.21.15.80:0/1730585827 wait complete. 2024-04-25T15:47:11.177 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:47:11.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:47:11.182 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:47:11.182 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:47:11.183 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:47:11.183 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:47:11.185 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:47:11.186 DEBUG:teuthology.parallel:result is None 2024-04-25T15:47:11.187 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:47:11.187 DEBUG:teuthology.parallel:result is None 2024-04-25T15:47:11.223 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:47:11.224 DEBUG:teuthology.parallel:result is None 2024-04-25T15:47:11.224 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:11.277 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-25T15:47:11.278 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-04-25T15:47:11.308 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:47:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.333+0000 7f29df37a640 1 Processor -- start 2024-04-25T15:47:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.334+0000 7f29df37a640 1 -- start start 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29df37a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f29d80b2390 0x7f29d80cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29df37a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29d80d30a0 0x7f29d815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29df37a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d80b27a0 con 0x7f29d80cf460 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29df37a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f29d80b2a70 con 0x7f29d80d30a0 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29df37a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f29d80b2d50 con 0x7f29d80b2390 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29dd917640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29d80d30a0 0x7f29d815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29dd917640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29d80d30a0 0x7f29d815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51284/0 (socket says 172.21.15.80:51284) 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29dd917640 1 -- 172.21.15.80:0/776120565 learned_addr learned my addr 172.21.15.80:0/776120565 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29dd116640 1 --2- 172.21.15.80:0/776120565 >> v2:172.21.15.195:3300/0 conn(0x7f29d80b2390 0x7f29d80cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29dd917640 1 -- 172.21.15.80:0/776120565 >> v2:172.21.15.195:3300/0 conn(0x7f29d80b2390 msgr2=0x7f29d80cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.335+0000 7f29dd917640 1 --2- 172.21.15.80:0/776120565 >> v2:172.21.15.195:3300/0 conn(0x7f29d80b2390 0x7f29d80cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.336+0000 7f29dd917640 1 -- 172.21.15.80:0/776120565 >> v1:172.21.15.195:6789/0 conn(0x7f29d80cf460 legacy=0x7f29d80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.336+0000 7f29dd917640 1 -- 172.21.15.80:0/776120565 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d80b3030 con 0x7f29d80d30a0 2024-04-25T15:47:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.336+0000 7f29dd917640 1 --2- 172.21.15.80:0/776120565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80d30a0 0x7f29d815d690 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f29d806ffc0 tx=0x7f29d002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f570099948e3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.336+0000 7f29cffff640 1 -- 172.21.15.80:0/776120565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0036070 con 0x7f29d80d30a0 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.336+0000 7f29cffff640 1 -- 172.21.15.80:0/776120565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0031600 con 0x7f29d80d30a0 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.336+0000 7f29cffff640 1 -- 172.21.15.80:0/776120565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d00319d0 con 0x7f29d80d30a0 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 -- 172.21.15.80:0/776120565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80d30a0 msgr2=0x7f29d815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 --2- 172.21.15.80:0/776120565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80d30a0 0x7f29d815d690 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f29d806ffc0 tx=0x7f29d002a730 comp rx=0 tx=0).stop 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 -- 172.21.15.80:0/776120565 shutdown_connections 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 --2- 172.21.15.80:0/776120565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80d30a0 0x7f29d815d690 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 --2- 172.21.15.80:0/776120565 >> v2:172.21.15.195:3300/0 conn(0x7f29d80b2390 0x7f29d80cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 -- 172.21.15.80:0/776120565 >> 172.21.15.80:0/776120565 conn(0x7f29d80746b0 msgr2=0x7f29d80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 -- 172.21.15.80:0/776120565 shutdown_connections 2024-04-25T15:47:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.337+0000 7f29df37a640 1 -- 172.21.15.80:0/776120565 wait complete. 2024-04-25T15:47:11.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.339+0000 7f29df37a640 1 Processor -- start 2024-04-25T15:47:11.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.339+0000 7f29df37a640 1 -- start start 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29df37a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29d80b2390 0x7f29d81e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29df37a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 0x7f29d8160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29df37a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29d80d30a0 0x7f29d814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29df37a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f29d815dbd0 con 0x7f29d80cf460 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29df37a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29d80b35f0 con 0x7f29d80d30a0 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29df37a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f29d815dd50 con 0x7f29d80b2390 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29dc915640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 0x7f29d8160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29dc915640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 0x7f29d8160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51292/0 (socket says 172.21.15.80:51292) 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29dc915640 1 -- 172.21.15.80:0/3915745114 learned_addr learned my addr 172.21.15.80:0/3915745114 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29dd116640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29d80b2390 0x7f29d81e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.340+0000 7f29dd917640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29d80d30a0 0x7f29d814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29dc915640 1 -- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29d80b2390 msgr2=0x7f29d81e67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29dc915640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29d80b2390 0x7f29d81e67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29dc915640 1 -- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29d80d30a0 msgr2=0x7f29d814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29dc915640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29d80d30a0 0x7f29d814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29dc915640 1 -- 172.21.15.80:0/3915745114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d809d300 con 0x7f29d80cf460 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29dc915640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 0x7f29d8160430 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f29d400c470 tx=0x7f29d400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40052d0 con 0x7f29d80cf460 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4005490 con 0x7f29d80cf460 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d809d5c0 con 0x7f29d80cf460 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4007260 con 0x7f29d80cf460 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.341+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d814bbb0 con 0x7f29d80cf460 2024-04-25T15:47:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.342+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d8050740 con 0x7f29d80cf460 2024-04-25T15:47:11.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.343+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f29d4007400 con 0x7f29d80cf460 2024-04-25T15:47:11.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.343+0000 7f29cdffb640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29bc0744e0 0x7f29bc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:11.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.343+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f29d40947b0 con 0x7f29d80cf460 2024-04-25T15:47:11.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.343+0000 7f29dd116640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29bc0744e0 0x7f29bc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.344+0000 7f29dd116640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29bc0744e0 0x7f29bc0769f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009a90 tx=0x7f29c8009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:11.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.348+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29d405e740 con 0x7f29d80cf460 2024-04-25T15:47:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.560+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29d80cd450 con 0x7f29d80cf460 2024-04-25T15:47:11.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.561+0000 7f29cdffb640 1 -- 172.21.15.80:0/3915745114 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+2704 (secure 0 0 0) 0x7f29d4062a40 con 0x7f29d80cf460 2024-04-25T15:47:11.562 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:11.562 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:11.159466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:replay","state_seq":1,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T15:47:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 56 2024-04-25T15:47:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29bc0744e0 msgr2=0x7f29bc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29bc0744e0 0x7f29bc0769f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009a90 tx=0x7f29c8009110 comp rx=0 tx=0).stop 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 msgr2=0x7f29d8160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 0x7f29d8160430 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f29d400c470 tx=0x7f29d400c930 comp rx=0 tx=0).stop 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 shutdown_connections 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f29bc0744e0 0x7f29bc0769f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29d80d30a0 0x7f29d814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29d80cf460 0x7f29d8160430 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 --2- 172.21.15.80:0/3915745114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29d80b2390 0x7f29d81e67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 >> 172.21.15.80:0/3915745114 conn(0x7f29d80746b0 msgr2=0x7f29d806d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 shutdown_connections 2024-04-25T15:47:11.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:11.563+0000 7f29df37a640 1 -- 172.21.15.80:0/3915745114 wait complete. 2024-04-25T15:47:11.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:54.313611+0000', 'modified': '2024-04-25T15:47:11.159466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7824}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7824': {'gid': 7824, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.80:6835/3715281705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3715281705}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 3715281705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T15:47:11.979 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7824:up:replay 2024-04-25T15:47:12.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:13.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.101+0000 7faa420b1640 1 Processor -- start 2024-04-25T15:47:13.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.101+0000 7faa420b1640 1 -- start start 2024-04-25T15:47:13.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa420b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0b5ce0 0x7faa3c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa420b1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faa3c0b2dc0 0x7faa3c0d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa420b1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa3c161fa0 con 0x7faa3c0cefe0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa420b1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7faa3c162280 con 0x7faa3c0b2dc0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa420b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c162560 con 0x7faa3c0b5ce0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa3b7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa3c0cefe0 0x7faa3c0b55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33728/0 (socket says 172.21.15.80:33728) 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.102+0000 7faa3b7fe640 1 -- 172.21.15.80:0/2569516445 learned_addr learned my addr 172.21.15.80:0/2569516445 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2569516445 >> v2:172.21.15.195:3300/0 conn(0x7faa3c0b2dc0 0x7faa3c0d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3affd640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0b5ce0 0x7faa3c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119348687 0 0) 0x7faa3c161fa0 con 0x7faa3c0cefe0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa24003520 con 0x7faa3c0cefe0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4187560523 0 0) 0x7faa24003520 con 0x7faa3c0cefe0 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0b5ce0 msgr2=0x7faa3c15e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:13.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0b5ce0 0x7faa3c15e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 >> v2:172.21.15.195:3300/0 conn(0x7faa3c0b2dc0 msgr2=0x7faa3c0d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 --2- 172.21.15.80:0/2569516445 >> v2:172.21.15.195:3300/0 conn(0x7faa3c0b2dc0 0x7faa3c0d21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c162840 con 0x7faa3c0cefe0 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7faa2c001690 con 0x7faa3c0cefe0 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3affd640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0b5ce0 0x7faa3c15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2569516445 >> v2:172.21.15.195:3300/0 conn(0x7faa3c0b2dc0 0x7faa3c0d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 >> v1:172.21.15.80:6789/0 conn(0x7faa3c0cefe0 legacy=0x7faa3c0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240039b0 0x7faa24003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24004800 0x7faa24004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa24005150 0x7faa2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c162280 con 0x7faa24005150 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c162560 con 0x7faa240039b0 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa24004620 con 0x7faa24004800 2024-04-25T15:47:13.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa24005150 0x7faa2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3b7fe640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240039b0 0x7faa24003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.103+0000 7faa3affd640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24004800 0x7faa24004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.104+0000 7faa3bfff640 1 -- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24004800 msgr2=0x7faa24004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.104+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa24004800 0x7faa24004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.104+0000 7faa3bfff640 1 -- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240039b0 msgr2=0x7faa24003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.104+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa240039b0 0x7faa24003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.104+0000 7faa3bfff640 1 -- 172.21.15.80:0/2569516445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa24003520 con 0x7faa24005150 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.104+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa24005150 0x7faa2400b9c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7faa3c08cf00 tx=0x7faa24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63adbd18b832b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34009de0 con 0x7faa24005150 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa34003b90 con 0x7faa24005150 2024-04-25T15:47:13.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa3a7fc640 1 -- 172.21.15.80:0/2569516445 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34004020 con 0x7faa24005150 2024-04-25T15:47:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa420b1640 1 -- 172.21.15.80:0/2569516445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa24005150 msgr2=0x7faa2400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa420b1640 1 --2- 172.21.15.80:0/2569516445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa24005150 0x7faa2400b9c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7faa3c08cf00 tx=0x7faa24005830 comp rx=0 tx=0).stop 2024-04-25T15:47:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa3bfff640 1 -- 172.21.15.80:0/2569516445 reap_dead start 2024-04-25T15:47:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa420b1640 1 -- 172.21.15.80:0/2569516445 shutdown_connections 2024-04-25T15:47:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa420b1640 1 -- 172.21.15.80:0/2569516445 >> 172.21.15.80:0/2569516445 conn(0x7faa3c0d07b0 msgr2=0x7faa3c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:13.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa420b1640 1 -- 172.21.15.80:0/2569516445 shutdown_connections 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.105+0000 7faa420b1640 1 -- 172.21.15.80:0/2569516445 wait complete. 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.107+0000 7faa420b1640 1 Processor -- start 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.107+0000 7faa420b1640 1 -- start start 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.108+0000 7faa420b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 0x7faa3c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa3c15cec0 0x7faa3c0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0ce000 0x7faa3c1f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c0b5e60 con 0x7faa3c0b20e0 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c0b5ce0 con 0x7faa3c15cec0 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c15e2b0 con 0x7faa3c0ce000 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 0x7faa3c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 0x7faa3c15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51310/0 (socket says 172.21.15.80:51310) 2024-04-25T15:47:13.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 -- 172.21.15.80:0/2143194773 learned_addr learned my addr 172.21.15.80:0/2143194773 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3affd640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa3c15cec0 0x7faa3c0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3bfff640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0ce000 0x7faa3c1f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 -- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0ce000 msgr2=0x7faa3c1f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0ce000 0x7faa3c1f7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 -- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa3c15cec0 msgr2=0x7faa3c0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa3c15cec0 0x7faa3c0cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 -- 172.21.15.80:0/2143194773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c15d2d0 con 0x7faa3c0b20e0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa3b7fe640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 0x7faa3c15c980 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7faa2c007290 tx=0x7faa2c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00f9c0 con 0x7faa3c0b20e0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2c018070 con 0x7faa3c0b20e0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00fde0 con 0x7faa3c0b20e0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c1f4290 con 0x7faa3c0b20e0 2024-04-25T15:47:13.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.109+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1f4850 con 0x7faa3c0b20e0 2024-04-25T15:47:13.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.110+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c050740 con 0x7faa3c0b20e0 2024-04-25T15:47:13.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.111+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faa2c01d460 con 0x7faa3c0b20e0 2024-04-25T15:47:13.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.111+0000 7faa23fff640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa280744b0 0x7faa280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.111+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7faa2c0953e0 con 0x7faa3c0b20e0 2024-04-25T15:47:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.111+0000 7faa3affd640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa280744b0 0x7faa280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:13.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.112+0000 7faa3affd640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa280744b0 0x7faa280769c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faa30009bb0 tx=0x7faa30009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:13.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.116+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa2c05f370 con 0x7faa3c0b20e0 2024-04-25T15:47:13.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.327+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa3c0d1d90 con 0x7faa3c0b20e0 2024-04-25T15:47:13.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.328+0000 7faa23fff640 1 -- 172.21.15.80:0/2143194773 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5184 (secure 0 0 0) 0x7faa2c063670 con 0x7faa3c0b20e0 2024-04-25T15:47:13.329 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:13.329 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:12.176078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-25T15:47:13.330 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 58 2024-04-25T15:47:13.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa280744b0 msgr2=0x7faa280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa280744b0 0x7faa280769c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7faa30009bb0 tx=0x7faa30009190 comp rx=0 tx=0).stop 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 msgr2=0x7faa3c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 0x7faa3c15c980 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7faa2c007290 tx=0x7faa2c007750 comp rx=0 tx=0).stop 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 shutdown_connections 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7faa280744b0 0x7faa280769c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faa3c0ce000 0x7faa3c1f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa3c15cec0 0x7faa3c0cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 --2- 172.21.15.80:0/2143194773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa3c0b20e0 0x7faa3c15c980 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 >> 172.21.15.80:0/2143194773 conn(0x7faa3c0d07b0 msgr2=0x7faa3c0b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 shutdown_connections 2024-04-25T15:47:13.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:13.330+0000 7faa420b1640 1 -- 172.21.15.80:0/2143194773 wait complete. 2024-04-25T15:47:13.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:54.313611+0000', 'modified': '2024-04-25T15:47:12.176078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7824}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7824': {'gid': 7824, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.80:6835/3715281705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3715281705}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 3715281705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-25T15:47:13.746 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7824:up:rejoin 2024-04-25T15:47:14.747 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:14.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.870+0000 7f93834d1640 1 Processor -- start 2024-04-25T15:47:14.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.870+0000 7f93834d1640 1 -- start start 2024-04-25T15:47:14.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f93834d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c15d2c0 0x7f937c0d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:14.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f93834d1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f937c0d14a0 0x7f937c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:14.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f93834d1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f937c06c6f0 con 0x7f937c06f670 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f93834d1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f937c06c9d0 con 0x7f937c0d14a0 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f93834d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f937c0d02f0 con 0x7f937c15d2c0 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f937c0d14a0 0x7f937c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f937c0d14a0 0x7f937c06f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34988/0 (socket says 172.21.15.80:34988) 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 -- 172.21.15.80:0/2367803664 learned_addr learned my addr 172.21.15.80:0/2367803664 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9381a6e640 1 --1- 172.21.15.80:0/2367803664 >> v1:172.21.15.80:6789/0 conn(0x7f937c06f670 0x7f937c160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48548/0 (socket says 172.21.15.80:48548) 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f938126d640 1 --2- 172.21.15.80:0/2367803664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c15d2c0 0x7f937c0d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 -- 172.21.15.80:0/2367803664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c15d2c0 msgr2=0x7f937c0d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 --2- 172.21.15.80:0/2367803664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c15d2c0 0x7f937c0d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 -- 172.21.15.80:0/2367803664 >> v1:172.21.15.80:6789/0 conn(0x7f937c06f670 legacy=0x7f937c160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9373fff640 1 -- 172.21.15.80:0/2367803664 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 245396230 0 0) 0x7f937c06c6f0 con 0x7f937c06f670 2024-04-25T15:47:14.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 -- 172.21.15.80:0/2367803664 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c0d05d0 con 0x7f937c0d14a0 2024-04-25T15:47:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9380a6c640 1 --2- 172.21.15.80:0/2367803664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c06f130 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f936c00bb10 tx=0x7f936c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e81591621fbbbf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9373fff640 1 -- 172.21.15.80:0/2367803664 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c032790 con 0x7f937c0d14a0 2024-04-25T15:47:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9373fff640 1 -- 172.21.15.80:0/2367803664 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c038070 con 0x7f937c0d14a0 2024-04-25T15:47:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.873+0000 7f9373fff640 1 -- 172.21.15.80:0/2367803664 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c032b50 con 0x7f937c0d14a0 2024-04-25T15:47:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 -- 172.21.15.80:0/2367803664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 msgr2=0x7f937c06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 --2- 172.21.15.80:0/2367803664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c06f130 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f936c00bb10 tx=0x7f936c02c890 comp rx=0 tx=0).stop 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 -- 172.21.15.80:0/2367803664 shutdown_connections 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 --2- 172.21.15.80:0/2367803664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c06f130 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 --2- 172.21.15.80:0/2367803664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c15d2c0 0x7f937c0d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 -- 172.21.15.80:0/2367803664 >> 172.21.15.80:0/2367803664 conn(0x7f937c0ce420 msgr2=0x7f937c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 -- 172.21.15.80:0/2367803664 shutdown_connections 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.874+0000 7f93834d1640 1 -- 172.21.15.80:0/2367803664 wait complete. 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.876+0000 7f93834d1640 1 Processor -- start 2024-04-25T15:47:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.876+0000 7f93834d1640 1 -- start start 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f93834d1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c06f670 0x7f937c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f93834d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f93834d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c15d2c0 0x7f937c1f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f93834d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0b1460 con 0x7f937c0d14a0 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f93834d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0b12e0 con 0x7f937c15d2c0 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f93834d1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f937c06fa80 con 0x7f937c06f670 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f9380a6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f9380a6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c0cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34996/0 (socket says 172.21.15.80:34996) 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.877+0000 7f9380a6c640 1 -- 172.21.15.80:0/1927727921 learned_addr learned my addr 172.21.15.80:0/1927727921 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f938126d640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c06f670 0x7f937c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9381a6e640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c15d2c0 0x7f937c1f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9380a6c640 1 -- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c06f670 msgr2=0x7f937c0b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9380a6c640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c06f670 0x7f937c0b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9380a6c640 1 -- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c15d2c0 msgr2=0x7f937c1f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9380a6c640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c15d2c0 0x7f937c1f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9380a6c640 1 -- 172.21.15.80:0/1927727921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c0b1100 con 0x7f937c0d14a0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f938126d640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c06f670 0x7f937c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9381a6e640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c15d2c0 0x7f937c1f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9380a6c640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c0cbc40 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b2c0 tx=0x7f936c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c043070 con 0x7f937c0d14a0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c03c620 con 0x7f937c0d14a0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937c0cc590 con 0x7f937c0d14a0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c03ca10 con 0x7f937c0d14a0 2024-04-25T15:47:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.878+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937c0afe00 con 0x7f937c0d14a0 2024-04-25T15:47:14.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.879+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937c050740 con 0x7f937c0d14a0 2024-04-25T15:47:14.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.880+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f936c046070 con 0x7f937c0d14a0 2024-04-25T15:47:14.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.880+0000 7f9371ffb640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93600744b0 0x7f93600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:14.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.881+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f936c0b5aa0 con 0x7f937c0d14a0 2024-04-25T15:47:14.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.881+0000 7f938126d640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93600744b0 0x7f93600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:14.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.881+0000 7f938126d640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93600744b0 0x7f93600769c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f937c161da0 tx=0x7f9378007420 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:14.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:14.886+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f937c0b1100 con 0x7f937c0d14a0 2024-04-25T15:47:15.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.098+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f937c068b30 con 0x7f937c0d14a0 2024-04-25T15:47:15.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.098+0000 7f9371ffb640 1 -- 172.21.15.80:0/1927727921 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5191 (secure 0 0 0) 0x7f936c0b5020 con 0x7f937c0d14a0 2024-04-25T15:47:15.098 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:15.099 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7839,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:14.181026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7824]},"id":7}]} 2024-04-25T15:47:15.099 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 59 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.100+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93600744b0 msgr2=0x7f93600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.100+0000 7f93834d1640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93600744b0 0x7f93600769c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f937c161da0 tx=0x7f9378007420 comp rx=0 tx=0).stop 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.100+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 msgr2=0x7f937c0cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.100+0000 7f93834d1640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c0cbc40 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b2c0 tx=0x7f936c004730 comp rx=0 tx=0).stop 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 shutdown_connections 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f93600744b0 0x7f93600769c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f937c15d2c0 0x7f937c1f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f937c0d14a0 0x7f937c0cbc40 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 --2- 172.21.15.80:0/1927727921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f937c06f670 0x7f937c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 >> 172.21.15.80:0/1927727921 conn(0x7f937c0ce420 msgr2=0x7f937c0708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 shutdown_connections 2024-04-25T15:47:15.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.101+0000 7f93834d1640 1 -- 172.21.15.80:0/1927727921 wait complete. 2024-04-25T15:47:15.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:54.313611+0000', 'modified': '2024-04-25T15:47:14.181026+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7824}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7824': {'gid': 7824, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.80:6835/3715281705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3715281705}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 3715281705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7824, 'qdb_cluster': [7824]} 2024-04-25T15:47:15.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:47:15.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:47:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.627+0000 7f72d3d0e640 1 Processor -- start 2024-04-25T15:47:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.627+0000 7f72d3d0e640 1 -- start start 2024-04-25T15:47:15.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d3d0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d3d0e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f72cc0b44f0 0x7f72cc0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d3d0e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72cc0b4e40 con 0x7f72cc0d2950 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d3d0e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc0d2570 con 0x7f72cc0b44f0 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d3d0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc06d060 con 0x7f72cc0d1ab0 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d12a9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f72cc0b44f0 0x7f72cc0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d1aaa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d22ab640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f72cc0d2950 0x7f72cc0d2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:60552/0 (socket says 172.21.15.80:60552) 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d12a9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f72cc0b44f0 0x7f72cc0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:34134/0 (socket says 172.21.15.80:34134) 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d22ab640 1 -- 172.21.15.80:0/2262842315 learned_addr learned my addr 172.21.15.80:0/2262842315 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d12a9640 1 -- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 msgr2=0x7f72cc0d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc0d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d12a9640 1 -- 172.21.15.80:0/2262842315 >> v1:172.21.15.195:6789/0 conn(0x7f72cc0d2950 legacy=0x7f72cc0d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d12a9640 1 -- 172.21.15.80:0/2262842315 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc06d340 con 0x7f72cc0b44f0 2024-04-25T15:47:15.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.629+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc0d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:15.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.630+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0b44f0 0x7f72cc0b4900 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0097a0 tx=0x7f72bc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2d267a93bfda3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.630+0000 7f72d0aa8640 1 -- 172.21.15.80:0/2262842315 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc037070 con 0x7f72cc0b44f0 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.630+0000 7f72d0aa8640 1 -- 172.21.15.80:0/2262842315 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc02ae50 con 0x7f72cc0b44f0 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.630+0000 7f72d0aa8640 1 -- 172.21.15.80:0/2262842315 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc032660 con 0x7f72cc0b44f0 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0b44f0 msgr2=0x7f72cc0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0b44f0 0x7f72cc0b4900 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0097a0 tx=0x7f72bc02a100 comp rx=0 tx=0).stop 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2262842315 shutdown_connections 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0b44f0 0x7f72cc0b4900 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2262842315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc0d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2262842315 >> 172.21.15.80:0/2262842315 conn(0x7f72cc09b600 msgr2=0x7f72cc09ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2262842315 shutdown_connections 2024-04-25T15:47:15.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.631+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2262842315 wait complete. 2024-04-25T15:47:15.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.633+0000 7f72d3d0e640 1 Processor -- start 2024-04-25T15:47:15.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.633+0000 7f72d3d0e640 1 -- start start 2024-04-25T15:47:15.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d3d0e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 0x7f72cc15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d3d0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d3d0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0d2950 0x7f72cc160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d3d0e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc0b3160 con 0x7f72cc0b44f0 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d3d0e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc0cf4e0 con 0x7f72cc0d2950 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d3d0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0cb120 con 0x7f72cc0d1ab0 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d1aaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 0x7f72cc15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d1aaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 0x7f72cc15f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35004/0 (socket says 172.21.15.80:35004) 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d1aaa640 1 -- 172.21.15.80:0/2556517706 learned_addr learned my addr 172.21.15.80:0/2556517706 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d22ab640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0d2950 0x7f72cc160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.634+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d1aaa640 1 -- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 msgr2=0x7f72cc15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d1aaa640 1 -- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0d2950 msgr2=0x7f72cc160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0d2950 0x7f72cc160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d1aaa640 1 -- 172.21.15.80:0/2556517706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc15b160 con 0x7f72cc0b44f0 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 0x7f72cc15f1e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e990 tx=0x7f72c800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72c27fc640 1 -- 172.21.15.80:0/2556517706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8017070 con 0x7f72cc0b44f0 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72c27fc640 1 -- 172.21.15.80:0/2556517706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c800c9e0 con 0x7f72cc0b44f0 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc15fb50 con 0x7f72cc0b44f0 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72c27fc640 1 -- 172.21.15.80:0/2556517706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c800cdb0 con 0x7f72cc0b44f0 2024-04-25T15:47:15.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.635+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc0c6850 con 0x7f72cc0b44f0 2024-04-25T15:47:15.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.637+0000 7f72c27fc640 1 -- 172.21.15.80:0/2556517706 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72c801a070 con 0x7f72cc0b44f0 2024-04-25T15:47:15.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.637+0000 7f72c27fc640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72b00744b0 0x7f72b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.637+0000 7f72c27fc640 1 -- 172.21.15.80:0/2556517706 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f72c8095230 con 0x7f72cc0b44f0 2024-04-25T15:47:15.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.637+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72b00744b0 0x7f72b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.638+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72b00744b0 0x7f72b00769c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034000 tx=0x7f72bc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.638+0000 7f72dabbd740 1 Processor -- start 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.638+0000 7f72dabbd740 1 -- start start 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894fa9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894fa5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894f7f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72dabbd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556894ee3740 con 0x556894bbc590 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556894e7f3a0 con 0x556894bdd270 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x556894edf700 con 0x556894bb43b0 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894f7f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894f7f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35020/0 (socket says 172.21.15.80:35020) 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 -- 172.21.15.80:0/3118153788 learned_addr learned my addr 172.21.15.80:0/3118153788 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894fa9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d12a9640 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894fa5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 -- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 msgr2=0x556894fa5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894fa5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 -- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 msgr2=0x556894fa9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894fa9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 -- 172.21.15.80:0/3118153788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556894e9b750 con 0x556894bbc590 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d12a9640 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894fa5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72d22ab640 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894f7f260 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f72c40021a0 tx=0x7f72c4001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493cd137caa53243 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72af7fe640 1 -- 172.21.15.80:0/3118153788 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40070d0 con 0x556894bbc590 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72af7fe640 1 -- 172.21.15.80:0/3118153788 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4018070 con 0x556894bbc590 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.640+0000 7f72af7fe640 1 -- 172.21.15.80:0/3118153788 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4007470 con 0x556894bbc590 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 -- 172.21.15.80:0/3118153788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 msgr2=0x556894f7f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894f7f260 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f72c40021a0 tx=0x7f72c4001950 comp rx=0 tx=0).stop 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 -- 172.21.15.80:0/3118153788 shutdown_connections 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894f7f260 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894fa5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3118153788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894fa9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 -- 172.21.15.80:0/3118153788 >> 172.21.15.80:0/3118153788 conn(0x556894bd13c0 msgr2=0x556894f7e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 -- 172.21.15.80:0/3118153788 shutdown_connections 2024-04-25T15:47:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.641+0000 7f72dabbd740 1 -- 172.21.15.80:0/3118153788 wait complete. 2024-04-25T15:47:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.642+0000 7f72dabbd740 1 -- start start 2024-04-25T15:47:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.642+0000 7f72dabbd740 1 Processor -- start 2024-04-25T15:47:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.643+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894facae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.643+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894faa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.643+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894faa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.643+0000 7f72dabbd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556894e6afe0 con 0x556894bbc590 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.643+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556894fa1180 con 0x556894bdd270 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x556894fad2a0 con 0x556894bb43b0 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72dabbd740 10 client.0 _ll_register_callbacks cb 0x556894e81150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894faa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894faa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35032/0 (socket says 172.21.15.80:35032) 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 -- 172.21.15.80:0/2317886721 learned_addr learned my addr 172.21.15.80:0/2317886721 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d22ab640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894faa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894facae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 -- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 msgr2=0x556894facae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894facae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 -- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 msgr2=0x556894faa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894faa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 -- 172.21.15.80:0/2317886721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556894bf52d0 con 0x556894bbc590 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894facae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72d12a9640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894faa2a0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f72bc02a140 tx=0x7f72bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429e933d67301190 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72acff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72acff9640 1 -- 172.21.15.80:0/2317886721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc037040 con 0x556894bbc590 2024-04-25T15:47:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72acff9640 1 -- 172.21.15.80:0/2317886721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f72bc03cbb0 con 0x556894bbc590 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c4018070 con 0x556894bbc590 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72acff9640 1 -- 172.21.15.80:0/2317886721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f72bc055050 con 0x556894bbc590 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72dabbd740 10 client.7869 fetch_fsmap learned FSMap version 59 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.644+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x556894cbf6b0 con 0x556894bbc590 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72acff9640 1 -- 172.21.15.80:0/2317886721 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4018070 con 0x556894bbc590 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72acff9640 1 -- 172.21.15.80:0/2317886721 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 59) ==== 3494+0+0 (secure 0 0 0) 0x7f72bc058020 con 0x556894bbc590 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72dabbd740 10 client.7869 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72dabbd740 10 client.7869 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72dabbd740 20 client.7869 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72dabbd740 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b9be40 0x556894fa2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72dabbd740 4 client.7869 mds_command: new command op to 7824 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 --> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556894ef1350 con 0x556894b9be40 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b9be40 0x556894fa2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72acff9640 10 client.7869 ms_handle_connect on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.645+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b9be40 0x556894fa2590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b53a5fc5c1e4c852 server_cookie=379d8eb73393e3e4 in_seq=0 out_seq=0 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72acff9640 1 -- 172.21.15.80:0/2317886721 <== mds.0 v2:172.21.15.80:6834/3715281705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556894ef1350 con 0x556894b9be40 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72acff9640 10 client.7869 handle_command_reply: tid=0 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 client.7869 shutdown 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 msgr2=0x556894faa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894faa2a0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f72bc02a140 tx=0x7f72bc004730 comp rx=0 tx=0).stop 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 shutdown_connections 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b9be40 0x556894fa2590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bdd270 0x556894faa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72acff9640 0 client.7869 ms_handle_reset on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556894faa2a0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 --2- 172.21.15.80:0/2317886721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556894facae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 >> 172.21.15.80:0/2317886721 conn(0x556894bd13c0 msgr2=0x556894f78d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 shutdown_connections 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 1 -- 172.21.15.80:0/2317886721 wait complete. 2024-04-25T15:47:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.646+0000 7f72dabbd740 20 client.7869 trim_cache size 0 max 16384 2024-04-25T15:47:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.665+0000 7f72dabbd740 1 Processor -- start 2024-04-25T15:47:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.665+0000 7f72dabbd740 1 -- start start 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 0x556894fab950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bb43b0 0x556894fa1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bbc590 0x556894fa1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72dabbd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc200530 con 0x556894b9be40 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc1f8550 con 0x556894bb43b0 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc1fff10 con 0x556894bbc590 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 0x556894fab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 0x556894fab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35040/0 (socket says 172.21.15.80:35040) 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 -- 172.21.15.80:0/164799767 learned_addr learned my addr 172.21.15.80:0/164799767 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d12a9640 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bb43b0 0x556894fa1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 -- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bbc590 msgr2=0x556894fa1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bbc590 0x556894fa1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 -- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bb43b0 msgr2=0x556894fa1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bb43b0 0x556894fa1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 -- 172.21.15.80:0/164799767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556894fc7290 con 0x556894b9be40 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d12a9640 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bb43b0 0x556894fa1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 0x556894fab950 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f72c800c520 tx=0x7f72c800cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8997533f3559a5e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72aeffd640 1 -- 172.21.15.80:0/164799767 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8091070 con 0x556894b9be40 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72aeffd640 1 -- 172.21.15.80:0/164799767 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c8067ee0 con 0x556894b9be40 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.667+0000 7f72aeffd640 1 -- 172.21.15.80:0/164799767 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8021040 con 0x556894b9be40 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 -- 172.21.15.80:0/164799767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 msgr2=0x556894fab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 0x556894fab950 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f72c800c520 tx=0x7f72c800cfd0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 -- 172.21.15.80:0/164799767 shutdown_connections 2024-04-25T15:47:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bbc590 0x556894fa1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894bb43b0 0x556894fa1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 --2- 172.21.15.80:0/164799767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894b9be40 0x556894fab950 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 -- 172.21.15.80:0/164799767 >> 172.21.15.80:0/164799767 conn(0x556894bd13c0 msgr2=0x556894fc6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 -- 172.21.15.80:0/164799767 shutdown_connections 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.668+0000 7f72dabbd740 1 -- 172.21.15.80:0/164799767 wait complete. 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.669+0000 7f72dabbd740 1 -- start start 2024-04-25T15:47:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.669+0000 7f72dabbd740 1 Processor -- start 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894b9be40 0x556894fe7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556895049590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556895046810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556894fab5a0 con 0x556894bbc590 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556894fa0ec0 con 0x556894b9be40 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x556894fc49c0 con 0x556894bb43b0 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.670+0000 7f72dabbd740 10 client.0 _ll_register_callbacks cb 0x7f72bc035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556895046810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556895046810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35056/0 (socket says 172.21.15.80:35056) 2024-04-25T15:47:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 -- 172.21.15.80:0/3856567177 learned_addr learned my addr 172.21.15.80:0/3856567177 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894b9be40 0x556894fe7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d12a9640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556895049590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 -- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 msgr2=0x556895049590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556895049590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 -- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894b9be40 msgr2=0x556894fe7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894b9be40 0x556894fe7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 -- 172.21.15.80:0/3856567177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556894faabb0 con 0x556894bbc590 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72d22ab640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556895046810 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005c00 tx=0x7f72c4005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dd93fe02c876d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72acff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72acff9640 1 -- 172.21.15.80:0/3856567177 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4028440 con 0x556894bbc590 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72acff9640 1 -- 172.21.15.80:0/3856567177 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f72c401e410 con 0x556894bbc590 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c8067ee0 con 0x556894bbc590 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72acff9640 1 -- 172.21.15.80:0/3856567177 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f72c4030050 con 0x556894bbc590 2024-04-25T15:47:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72dabbd740 10 client.7875 fetch_fsmap learned FSMap version 59 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x556895045fa0 con 0x556894bbc590 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.671+0000 7f72acff9640 1 -- 172.21.15.80:0/3856567177 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c8067ee0 con 0x556894bbc590 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72acff9640 1 -- 172.21.15.80:0/3856567177 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 59) ==== 3494+0+0 (secure 0 0 0) 0x7f72c4033020 con 0x556894bbc590 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 10 client.7875 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 10 client.7875 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 20 client.7875 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b71280 0x556894fcba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 4 client.7875 mds_command: new command op to 7824 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 --> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] -- command(tid 0: {"prefix": "status"}) -- 0x556894eeb1c0 con 0x556894b71280 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b71280 0x556894fcba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72acff9640 10 client.7875 ms_handle_connect on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72d1aaa640 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b71280 0x556894fcba10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b6aff18ada2b95 server_cookie=e05b69c4218f96ed in_seq=0 out_seq=0 2024-04-25T15:47:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72acff9640 1 -- 172.21.15.80:0/3856567177 <== mds.0 v2:172.21.15.80:6834/3715281705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x556894eeb1c0 con 0x556894b71280 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72acff9640 10 client.7875 handle_command_reply: tid=0 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.672+0000 7f72dabbd740 1 client.7875 shutdown 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 msgr2=0x556895046810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556895046810 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005c00 tx=0x7f72c4005b70 comp rx=0 tx=0).stop 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 shutdown_connections 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x556894b71280 0x556894fcba10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556894bbc590 0x556895046810 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x556894bb43b0 0x556895049590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72acff9640 0 client.7875 ms_handle_reset on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 --2- 172.21.15.80:0/3856567177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556894b9be40 0x556894fe7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 >> 172.21.15.80:0/3856567177 conn(0x556894bd13c0 msgr2=0x556894fc6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 shutdown_connections 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 1 -- 172.21.15.80:0/3856567177 wait complete. 2024-04-25T15:47:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72dabbd740 20 client.7875 trim_cache size 0 max 16384 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7824, 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 4.5010026830000003, 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 59, 2024-04-25T15:47:15.680 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 103, 2024-04-25T15:47:15.681 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 103, 2024-04-25T15:47:15.681 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 5.1520787769999998 2024-04-25T15:47:15.681 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:15.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72b00744b0 msgr2=0x7f72b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72b00744b0 0x7f72b00769c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034000 tx=0x7f72bc02e000 comp rx=0 tx=0).stop 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 msgr2=0x7f72cc15f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 0x7f72cc15f1e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e990 tx=0x7f72c800ee50 comp rx=0 tx=0).stop 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 shutdown_connections 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72b00744b0 0x7f72b00769c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72cc0d2950 0x7f72cc160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72cc0d1ab0 0x7f72cc15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 --2- 172.21.15.80:0/2556517706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72cc0b44f0 0x7f72cc15f1e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 >> 172.21.15.80:0/2556517706 conn(0x7f72cc09b600 msgr2=0x7f72cc09ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 shutdown_connections 2024-04-25T15:47:15.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.673+0000 7f72d3d0e640 1 -- 172.21.15.80:0/2556517706 wait complete. 2024-04-25T15:47:15.684 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:47:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.791+0000 7f59799b2640 1 Processor -- start 2024-04-25T15:47:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.791+0000 7f59799b2640 1 -- start start 2024-04-25T15:47:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59799b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 0x7f597415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59799b2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59740b2dc0 0x7f59740b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59799b2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59740b5f20 con 0x7f59740b5b10 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59799b2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5974161fa0 con 0x7f59740b2dc0 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59799b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5974162280 con 0x7f59740cefe0 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59727fc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59740b2dc0 0x7f59740b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 0x7f597415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59737fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f59740b5b10 0x7f5974072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:60566/0 (socket says 172.21.15.80:60566) 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 0x7f597415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:53686/0 (socket says 172.21.15.80:53686) 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59727fc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59740b2dc0 0x7f59740b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:34190/0 (socket says 172.21.15.80:34190) 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.792+0000 7f59737fe640 1 -- 172.21.15.80:0/2732658871 learned_addr learned my addr 172.21.15.80:0/2732658871 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f59727fc640 1 -- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 msgr2=0x7f597415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f59727fc640 1 --2- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 0x7f597415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f59727fc640 1 -- 172.21.15.80:0/2732658871 >> v1:172.21.15.195:6789/0 conn(0x7f59740b5b10 legacy=0x7f5974072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f59727fc640 1 -- 172.21.15.80:0/2732658871 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5974162560 con 0x7f59740b2dc0 2024-04-25T15:47:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f5972ffd640 1 --2- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 0x7f597415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f59727fc640 1 --2- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740b2dc0 0x7f59740b55d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f59680097a0 tx=0x7f596802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef33bae09dd1189 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.793+0000 7f5971ffb640 1 -- 172.21.15.80:0/2732658871 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968037070 con 0x7f59740b2dc0 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f5971ffb640 1 -- 172.21.15.80:0/2732658871 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5968032440 con 0x7f59740b2dc0 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f5971ffb640 1 -- 172.21.15.80:0/2732658871 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968032810 con 0x7f59740b2dc0 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 -- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740b2dc0 msgr2=0x7f59740b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 --2- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740b2dc0 0x7f59740b55d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f59680097a0 tx=0x7f596802a180 comp rx=0 tx=0).stop 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 -- 172.21.15.80:0/2732658871 shutdown_connections 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 --2- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740b2dc0 0x7f59740b55d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 --2- 172.21.15.80:0/2732658871 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740cefe0 0x7f597415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 -- 172.21.15.80:0/2732658871 >> 172.21.15.80:0/2732658871 conn(0x7f59740d07b0 msgr2=0x7f59740d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 -- 172.21.15.80:0/2732658871 shutdown_connections 2024-04-25T15:47:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.794+0000 7f59799b2640 1 -- 172.21.15.80:0/2732658871 wait complete. 2024-04-25T15:47:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.796+0000 7f59799b2640 1 Processor -- start 2024-04-25T15:47:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.796+0000 7f59799b2640 1 -- start start 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.797+0000 7f59799b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 0x7f59740cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.797+0000 7f59799b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740b5b10 0x7f59740c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.797+0000 7f59799b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740cefe0 0x7f59741f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.797+0000 7f59799b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59740b2bb0 con 0x7f59740b2dc0 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.797+0000 7f59799b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f59740b2a30 con 0x7f59740cefe0 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.797+0000 7f59799b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f59740d31f0 con 0x7f59740b5b10 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 0x7f59740cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 0x7f59740cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35060/0 (socket says 172.21.15.80:35060) 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 -- 172.21.15.80:0/1296665389 learned_addr learned my addr 172.21.15.80:0/1296665389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f59727fc640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740b5b10 0x7f59740c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f59737fe640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740cefe0 0x7f59741f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 -- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740b5b10 msgr2=0x7f59740c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740b5b10 0x7f59740c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 -- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740cefe0 msgr2=0x7f59741f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740cefe0 0x7f59741f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 -- 172.21.15.80:0/1296665389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59740ccd00 con 0x7f59740b2dc0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f5972ffd640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 0x7f59740cc120 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f596400efc0 tx=0x7f596400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964018020 con 0x7f59740b2dc0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964014680 con 0x7f59740b2dc0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59740ccfe0 con 0x7f59740b2dc0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964014a50 con 0x7f59740b2dc0 2024-04-25T15:47:15.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.798+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59740cd5a0 con 0x7f59740b2dc0 2024-04-25T15:47:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.799+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5974050740 con 0x7f59740b2dc0 2024-04-25T15:47:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.800+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5964005d10 con 0x7f59740b2dc0 2024-04-25T15:47:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.800+0000 7f595bfff640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59600744b0 0x7f59600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.800+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f5964096030 con 0x7f59740b2dc0 2024-04-25T15:47:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.800+0000 7f59727fc640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59600744b0 0x7f59600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.801+0000 7f59727fc640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59600744b0 0x7f59600769c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5968034000 tx=0x7f596802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:15.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:15.805+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5964022030 con 0x7f59740b2dc0 2024-04-25T15:47:16.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.017+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f59740d1d90 con 0x7f59740b2dc0 2024-04-25T15:47:16.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.017+0000 7f595bfff640 1 -- 172.21.15.80:0/1296665389 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7f5964010040 con 0x7f59740b2dc0 2024-04-25T15:47:16.017 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:47:16.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59600744b0 msgr2=0x7f59600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59600744b0 0x7f59600769c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5968034000 tx=0x7f596802e000 comp rx=0 tx=0).stop 2024-04-25T15:47:16.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 msgr2=0x7f59740cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 0x7f59740cc120 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f596400efc0 tx=0x7f596400c490 comp rx=0 tx=0).stop 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 shutdown_connections 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f59600744b0 0x7f59600769c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59740cefe0 0x7f59741f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59740b5b10 0x7f59740c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 --2- 172.21.15.80:0/1296665389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59740b2dc0 0x7f59740cc120 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 >> 172.21.15.80:0/1296665389 conn(0x7f59740d07b0 msgr2=0x7f59740b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 shutdown_connections 2024-04-25T15:47:16.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.019+0000 7f59799b2640 1 -- 172.21.15.80:0/1296665389 wait complete. 2024-04-25T15:47:16.030 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:47:16.031 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:16.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.031 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T15:47:16.047 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42521sec preferred_lft 42521sec 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::29c2:fb12:773d:8398/64 scope link noprefixroute 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:47:16.048 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::9cc3:6aff:fefe:9b56/64 scope link 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 96:e4:f3:e3:65:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::94e4:f3ff:fee3:654b/64 scope link 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 52:5a:c9:75:88:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::505a:c9ff:fe75:8841/64 scope link 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:16.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.050 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:47:16.109 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T15:47:16.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.111 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T15:47:16.164 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-25T15:47:16.164+0000 7f8434921640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:47:16.166 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T15:47:16.166 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:47:16.166 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:47:16.166 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:47:16.167 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:47:16.167 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:16.167 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T15:47:16.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:47:16.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:47:16.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:47:16.167 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T15:47:16.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:16.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:16.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.290 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:47:16.305 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:47:16.305 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:47:16.306 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:16.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T15:47:16.369 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:16.369 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:16.425 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:16.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:16.425 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:16.479 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T15:47:16.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.480 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:16.571 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:16.571 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:16.582 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:16.582 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:16.582 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:47:16.582 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with new device syntax: 0@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:47:16.582 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:47:16.583 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T15:47:16.583 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:47:16.583 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:47:16.583 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:47:16.584 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:47:16.585 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:47:16.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:16.608 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:47:16.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:47:16.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:16.703 INFO:teuthology.orchestra.run.smithi080.stdout:client6967 2024-04-25T15:47:16.703 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:16.703 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:16.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:47:16.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.865+0000 7f249a0b6640 1 Processor -- start 2024-04-25T15:47:16.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.865+0000 7f249a0b6640 1 -- start start 2024-04-25T15:47:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f249a0b6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2494163ee0 0x7f24941642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f249a0b6640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24940ce900 con 0x7f249415dc90 2024-04-25T15:47:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f249a0b6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2494164960 con 0x7f24940b5620 2024-04-25T15:47:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f249a0b6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f24940d2460 con 0x7f2494163ee0 2024-04-25T15:47:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f2492ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2494163ee0 0x7f24941642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f24937fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f249415dc90 0x7f24940ce1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48558/0 (socket says 172.21.15.80:48558) 2024-04-25T15:47:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f2492ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2494163ee0 0x7f24941642f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35066/0 (socket says 172.21.15.80:35066) 2024-04-25T15:47:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f24937fe640 1 -- 172.21.15.80:0/3876150855 learned_addr learned my addr 172.21.15.80:0/3876150855 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f2492ffd640 1 -- 172.21.15.80:0/3876150855 >> v1:172.21.15.195:6789/0 conn(0x7f24940b5620 legacy=0x7f24940b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f2492ffd640 1 -- 172.21.15.80:0/3876150855 >> v1:172.21.15.80:6789/0 conn(0x7f249415dc90 legacy=0x7f24940ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f2492ffd640 1 -- 172.21.15.80:0/3876150855 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2494164c40 con 0x7f2494163ee0 2024-04-25T15:47:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.867+0000 7f24927fc640 1 -- 172.21.15.80:0/3876150855 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009774058 0 0) 0x7f24940ce900 con 0x7f249415dc90 2024-04-25T15:47:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.868+0000 7f2492ffd640 1 --2- 172.21.15.80:0/3876150855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f24941642f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f24880097a0 tx=0x7f248802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a4c2d97f5978d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.868+0000 7f24927fc640 1 -- 172.21.15.80:0/3876150855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488037070 con 0x7f2494163ee0 2024-04-25T15:47:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.868+0000 7f24927fc640 1 -- 172.21.15.80:0/3876150855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248802ae50 con 0x7f2494163ee0 2024-04-25T15:47:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.868+0000 7f24927fc640 1 -- 172.21.15.80:0/3876150855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488032660 con 0x7f2494163ee0 2024-04-25T15:47:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 -- 172.21.15.80:0/3876150855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 msgr2=0x7f24941642f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3876150855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f24941642f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f24880097a0 tx=0x7f248802a140 comp rx=0 tx=0).stop 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 -- 172.21.15.80:0/3876150855 shutdown_connections 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3876150855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f24941642f0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 -- 172.21.15.80:0/3876150855 >> 172.21.15.80:0/3876150855 conn(0x7f24940d0800 msgr2=0x7f24940d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 -- 172.21.15.80:0/3876150855 shutdown_connections 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.869+0000 7f249a0b6640 1 -- 172.21.15.80:0/3876150855 wait complete. 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.870+0000 7f249a0b6640 1 Processor -- start 2024-04-25T15:47:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.871+0000 7f249a0b6640 1 -- start start 2024-04-25T15:47:16.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f249a0b6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24940b5620 0x7f2494151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f249a0b6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f249415dc90 0x7f2494159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f249a0b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f2494159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f249a0b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b3000 con 0x7f2494163ee0 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f249a0b6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24940d2990 con 0x7f24940b5620 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f249a0b6640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f249415e0a0 con 0x7f249415dc90 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f2494159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f2494159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35070/0 (socket says 172.21.15.80:35070) 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 -- 172.21.15.80:0/3391184560 learned_addr learned my addr 172.21.15.80:0/3391184560 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f24937fe640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24940b5620 0x7f2494151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2492ffd640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f249415dc90 0x7f2494159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 -- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f249415dc90 msgr2=0x7f2494159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f249415dc90 0x7f2494159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 -- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24940b5620 msgr2=0x7f2494151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24940b5620 0x7f2494151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2493fff640 1 -- 172.21.15.80:0/3391184560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24940b4290 con 0x7f2494163ee0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.872+0000 7f2492ffd640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f249415dc90 0x7f2494159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.873+0000 7f2493fff640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f2494159cb0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f248c00b970 tx=0x7f248c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.873+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c019070 con 0x7f2494163ee0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.873+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c00cb40 con 0x7f2494163ee0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.873+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c014440 con 0x7f2494163ee0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.873+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24940b4570 con 0x7f2494163ee0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.873+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249415e7c0 con 0x7f2494163ee0 2024-04-25T15:47:16.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.874+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24940b3fe0 con 0x7f2494163ee0 2024-04-25T15:47:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.874+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f248c01c070 con 0x7f2494163ee0 2024-04-25T15:47:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.875+0000 7f247bfff640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24800744b0 0x7f24800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.875+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f248c095110 con 0x7f2494163ee0 2024-04-25T15:47:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.875+0000 7f24937fe640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24800744b0 0x7f24800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.875+0000 7f24937fe640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24800744b0 0x7f24800769c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2484000f60 tx=0x7f2484007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:16.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:16.880+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f248c05f660 con 0x7f2494163ee0 2024-04-25T15:47:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.090+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2494050740 con 0x7f2494163ee0 2024-04-25T15:47:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.091+0000 7f247bfff640 1 -- 172.21.15.80:0/3391184560 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7f248c05ef60 con 0x7f2494163ee0 2024-04-25T15:47:17.091 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:47:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24800744b0 msgr2=0x7f24800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24800744b0 0x7f24800769c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2484000f60 tx=0x7f2484007c00 comp rx=0 tx=0).stop 2024-04-25T15:47:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 msgr2=0x7f2494159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f2494159cb0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f248c00b970 tx=0x7f248c00be30 comp rx=0 tx=0).stop 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 shutdown_connections 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f24800744b0 0x7f24800769c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2494163ee0 0x7f2494159cb0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f249415dc90 0x7f2494159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 --2- 172.21.15.80:0/3391184560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24940b5620 0x7f2494151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 >> 172.21.15.80:0/3391184560 conn(0x7f24940d0800 msgr2=0x7f2494072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 shutdown_connections 2024-04-25T15:47:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:17.093+0000 7f249a0b6640 1 -- 172.21.15.80:0/3391184560 wait complete. 2024-04-25T15:47:17.104 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:47:17.105 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:47:17.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.105 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.126 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.127 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42498sec preferred_lft 42498sec 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::db3d:4c92:8c9b:6902/64 scope link noprefixroute 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::8434:76ff:fe41:85a/64 scope link 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 32:75:b6:05:f3:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:47:17.128 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3075:b6ff:fe05:f38f/64 scope link 2024-04-25T15:47:17.129 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.129 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T15:47:17.129 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 3a:82:90:8f:07:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:47:17.129 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::3882:90ff:fe8f:78e/64 scope link 2024-04-25T15:47:17.129 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.129 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:47:17.193 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T15:47:17.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.195 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T15:47:17.253 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T15:47:17.253 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:47:17.253 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:47:17.253 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:47:17.254 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:47:17.254 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:17.254 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T15:47:17.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:47:17.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:47:17.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:47:17.254 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T15:47:17.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:17.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:17.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.385 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:47:17.400 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:47:17.400 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:47:17.400 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:47:17.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.401 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T15:47:17.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:17.465 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:17.520 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:47:17.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:17.520 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:17.574 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T15:47:17.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.574 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:17.665 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:17.666 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:17.676 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T15:47:17.676 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T15:47:17.676 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.195:3300,172.21.15.195:3301" 2024-04-25T15:47:17.676 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with new device syntax: 1@e35f5388-3109-4b08-854a-9a0b33367f12.cephfs=/ 2024-04-25T15:47:17.676 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.80:3300/172.21.15.195:3300/172.21.15.195:3301" will pass to kernel 2024-04-25T15:47:17.679 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T15:47:17.679 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-04-25T15:47:17.679 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T15:47:17.679 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T15:47:17.679 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T15:47:17.679 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T15:47:17.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.679 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:17.705 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T15:47:17.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T15:47:17.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T15:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:17.800 INFO:teuthology.orchestra.run.smithi195.stdout:client6973 2024-04-25T15:47:17.801 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:17.801 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:17.816 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-04-25T15:47:17.950 INFO:teuthology.orchestra.run.smithi080.stdout:[{"id":6973,"entity":{"name":{"type":"client","num":6973},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":862305723}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":0.27099389400000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.9993786851257439,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6973 192.168.0.1:0/862305723","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x0000000000017bff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi195","kernel_version":"5.14.0-437.el9.x86_64","root":"/"}},{"id":6967,"entity":{"name":{"type":"client","num":6967},"addr":{"type":"any","addr":"172.21.15.80:0","nonce":4288989611}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":1.3649692520000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99685582554825181,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6967 172.21.15.80:0/4288989611","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x0000000000017bff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi080","kernel_version":"5.14.0-437.el9.x86_64","root":"/"}}] 2024-04-25T15:47:17.951 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x0000000000017bff" }, "entity_id": "1", "hostname": "smithi195", "kernel_version": "5.14.0-437.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 862305723, "type": "any" }, "name": { "num": 6973, "type": "client" } }, "id": 6973, "inst": "client.6973 192.168.0.1:0/862305723", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9993786851257439 }, "state": "open", "uptime": 0.270993894 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x0000000000017bff" }, "entity_id": "0", "hostname": "smithi080", "kernel_version": "5.14.0-437.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.80:0", "nonce": 4288989611, "type": "any" }, "name": { "num": 6967, "type": "client" } }, "id": 6967, "inst": "client.6967 172.21.15.80:0/4288989611", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9968558255482518 }, "state": "open", "uptime": 1.364969252 } ] 2024-04-25T15:47:17.951 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T15:47:18.082 INFO:teuthology.orchestra.run.smithi080.stdout:{"message":"","return_code":0} 2024-04-25T15:47:18.082 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T15:47:18.083 DEBUG:teuthology.orchestra.run.smithi080:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-04-25T15:47:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.133+0000 7f974001b280 1 -- start start 2024-04-25T15:47:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.133+0000 7f974001b280 1 Processor -- start 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f974001b280 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0efdafa80 0x55e0efcc8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f974001b280 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 0x55e0efcc8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f974001b280 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f6000 0x55e0efcc8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f974001b280 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e0efcd4180 con 0x55e0efdaf180 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f974001b280 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e0efc7a900 con 0x55e0efdafa80 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f974001b280 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e0efc7a480 con 0x55e0f09f6000 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 0x55e0efcc8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 0x55e0efcc8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35086/0 (socket says 172.21.15.80:35086) 2024-04-25T15:47:18.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 -- 172.21.15.80:0/1487865812 learned_addr learned my addr 172.21.15.80:0/1487865812 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973dc39640 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0efdafa80 0x55e0efcc8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973e43a640 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f6000 0x55e0efcc8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 -- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f6000 msgr2=0x55e0efcc8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f6000 0x55e0efcc8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 -- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0efdafa80 msgr2=0x55e0efcc8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0efdafa80 0x55e0efcc8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.134+0000 7f973d438640 1 -- 172.21.15.80:0/1487865812 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ebc1e780 con 0x55e0efdaf180 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f973d438640 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 0x55e0efcc8000 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x55e0f0a493b0 tx=0x55e0efd161e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21a8276ac6fb158 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f973b434640 1 -- 172.21.15.80:0/1487865812 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e0ebc0e680 con 0x55e0efdaf180 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f973b434640 1 -- 172.21.15.80:0/1487865812 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e0ebc14700 con 0x55e0efdaf180 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f973b434640 1 -- 172.21.15.80:0/1487865812 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e0ebc0eb60 con 0x55e0efdaf180 2024-04-25T15:47:18.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ebc1f4a0 con 0x55e0efdaf180 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e0ebc1e000 con 0x55e0efdaf180 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f974001b280 4 waiting for MDS map... 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f973b434640 1 -- 172.21.15.80:0/1487865812 <== mon.0 v2:172.21.15.80:3300/0 4 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x55e0f0aee600 con 0x55e0efdaf180 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f973b434640 1 -- 172.21.15.80:0/1487865812 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 59) ==== 3494+0+0 (secure 0 0 0) 0x55e0efc73180 con 0x55e0efdaf180 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f974001b280 4 Got MDS map 59 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f974001b280 10 main: main 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.135+0000 7f974001b280 4 main: connecting to RADOS... 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.136+0000 7f974001b280 1 Processor -- start 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.136+0000 7f974001b280 1 -- start start 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f974001b280 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f974001b280 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f974001b280 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f974001b280 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e0efc7a180 con 0x55e0f09f6900 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f974001b280 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e0efcd5500 con 0x55e0f09f6d80 2024-04-25T15:47:18.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f974001b280 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e0efcd5380 con 0x55e0f09f7200 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f973e43a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f973e43a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35098/0 (socket says 172.21.15.80:35098) 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f973e43a640 1 -- 172.21.15.80:0/4230537387 learned_addr learned my addr 172.21.15.80:0/4230537387 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f973dc39640 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.137+0000 7f973d438640 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973e43a640 1 -- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 msgr2=0x55e0efcc9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973e43a640 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973e43a640 1 -- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 msgr2=0x55e0efcc9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973e43a640 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973e43a640 1 -- 172.21.15.80:0/4230537387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ebc1e3c0 con 0x55e0f09f6900 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973d438640 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f973e43a640 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x55e0f0b0e660 tx=0x55e0f0b11800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58896af6e976b1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f9739430640 1 -- 172.21.15.80:0/4230537387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e0ebc0e680 con 0x55e0f09f6900 2024-04-25T15:47:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f9739430640 1 -- 172.21.15.80:0/4230537387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e0ebc14fc0 con 0x55e0f09f6900 2024-04-25T15:47:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f9739430640 1 -- 172.21.15.80:0/4230537387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e0ebc0eb60 con 0x55e0f09f6900 2024-04-25T15:47:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f974001b280 1 -- 172.21.15.80:0/4230537387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 msgr2=0x55e0efcc9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f974001b280 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x55e0f0b0e660 tx=0x55e0f0b11800 comp rx=0 tx=0).stop 2024-04-25T15:47:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.138+0000 7f974001b280 1 -- 172.21.15.80:0/4230537387 shutdown_connections 2024-04-25T15:47:18.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 --2- 172.21.15.80:0/4230537387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 -- 172.21.15.80:0/4230537387 >> 172.21.15.80:0/4230537387 conn(0x55e0f09f6480 msgr2=0x55e0efd45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 -- 172.21.15.80:0/4230537387 shutdown_connections 2024-04-25T15:47:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 -- 172.21.15.80:0/4230537387 wait complete. 2024-04-25T15:47:18.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 Processor -- start 2024-04-25T15:47:18.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.139+0000 7f974001b280 1 -- start start 2024-04-25T15:47:18.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.140+0000 7f974001b280 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.140+0000 7f974001b280 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.140+0000 7f974001b280 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.140+0000 7f974001b280 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e0efcd4780 con 0x55e0f09f6900 2024-04-25T15:47:18.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.140+0000 7f974001b280 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e0efcd4900 con 0x55e0f09f6d80 2024-04-25T15:47:18.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.140+0000 7f974001b280 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e0efcd4600 con 0x55e0f09f7200 2024-04-25T15:47:18.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35100/0 (socket says 172.21.15.80:35100) 2024-04-25T15:47:18.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 -- 172.21.15.80:0/2247944501 learned_addr learned my addr 172.21.15.80:0/2247944501 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:18.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973dc39640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973d438640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 -- 172.21.15.80:0/2247944501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 msgr2=0x55e0efcc9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f7200 0x55e0efcc9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 -- 172.21.15.80:0/2247944501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 msgr2=0x55e0efcc9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0f09f6d80 0x55e0efcc9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 -- 172.21.15.80:0/2247944501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ebc1e780 con 0x55e0f09f6900 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f973e43a640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x55e0f0b0f920 tx=0x55e0efd148a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f9737c2d640 1 -- 172.21.15.80:0/2247944501 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e0ebc0e4e0 con 0x55e0f09f6900 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f9737c2d640 1 -- 172.21.15.80:0/2247944501 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e0ebc14a80 con 0x55e0f09f6900 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0ebc1f4a0 con 0x55e0f09f6900 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f9737c2d640 1 -- 172.21.15.80:0/2247944501 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e0ebc0e680 con 0x55e0f09f6900 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ebc1e960 con 0x55e0f09f6900 2024-04-25T15:47:18.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.141+0000 7f974001b280 4 main: resolving pool 15 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f9737c2d640 1 -- 172.21.15.80:0/2247944501 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x55e0f0b68c00 con 0x55e0f09f6900 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f9737c2d640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x55e0f09f9a80 0x55e0efcca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f9737c2d640 1 -- 172.21.15.80:0/2247944501 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x55e0f0b66a00 con 0x55e0f09f6900 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f973dc39640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x55e0f09f9a80 0x55e0efcca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f974001b280 4 main: creating IoCtx.. 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f974001b280 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x55e0f09f7680 0x55e0efcca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- osd_op(unknown.0.0:1 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55e0f0b70800 con 0x55e0f09f7680 2024-04-25T15:47:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f973d438640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x55e0f09f7680 0x55e0efcca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.143+0000 7f973dc39640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x55e0f09f9a80 0x55e0efcca100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55e0ebc21e00 tx=0x55e0efd144e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.144+0000 7f973d438640 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x55e0f09f7680 0x55e0efcca680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.144+0000 7f973d438640 1 -- 172.21.15.80:0/2247944501 <== osd.2 v2:172.21.15.80:6800/1881939009 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55e0efcfe000 con 0x55e0f09f7680 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.144+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- osd_op(unknown.0.0:2 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55e0f0b70c00 con 0x55e0f09f7680 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.144+0000 7f973d438640 1 -- 172.21.15.80:0/2247944501 <== osd.2 v2:172.21.15.80:6800/1881939009 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=471b] v0'0 uv5 ondisk = 0) ==== 159+0+471 (crc 0 0 0) 0x55e0efcfe000 con 0x55e0f09f7680 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.144+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- osd_op(unknown.0.0:3 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55e0f0b71000 con 0x55e0f09f7680 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f973d438640 1 -- 172.21.15.80:0/2247944501 <== osd.2 v2:172.21.15.80:6800/1881939009 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55e0efcfe000 con 0x55e0f09f7680 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "0": { 2024-04-25T15:47:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "data": { 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions": [ 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 6973, 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 6973 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "any", 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 862305723 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 0.00099997699999999998, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "num_completed_requests": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "num_completed_flushes": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2024-04-25T15:47:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 1.5 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition": { 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 30 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "last_trim_completed_requests_tid": 0, 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "last_trim_completed_flushes_tid": 0, 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "delegated_inos": [], 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.6973 192.168.0.1:0/862305723", 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_features": { 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "feature_bits": "0x0000000000017bff" 2024-04-25T15:47:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "metric_spec": { 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "metric_flags": { 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "feature_bits": "0x000000000080ffff" 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi195", 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "5.14.0-437.el9.x86_64", 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 6967, 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2024-04-25T15:47:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 6967 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "any", 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4288989611 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 0, 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 0.00099997699999999998, 2024-04-25T15:47:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "num_completed_requests": 0, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "num_completed_flushes": 0, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 1.5 2024-04-25T15:47:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition": { 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 30 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "last_trim_completed_requests_tid": 0, 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "last_trim_completed_flushes_tid": 0, 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "delegated_inos": [], 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.6967 172.21.15.80:0/4288989611", 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "client_features": { 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "feature_bits": "0x0000000000017bff" 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "metric_spec": { 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "metric_flags": { 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "feature_bits": "0x000000000080ffff" 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "0", 2024-04-25T15:47:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "5.14.0-437.el9.x86_64", 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "result": 0 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x55e0f09f7680 msgr2=0x55e0efcca680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x55e0f09f7680 0x55e0efcca680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x55e0f09f9a80 msgr2=0x55e0efcca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x55e0f09f9a80 0x55e0efcca100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55e0ebc21e00 tx=0x55e0efd144e0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 msgr2=0x55e0efcc9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/2247944501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0f09f6900 0x55e0efcc9080 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x55e0f0b0f920 tx=0x55e0efd148a0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f973dc39640 1 -- 172.21.15.80:0/2247944501 reap_dead start 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 shutdown_connections 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 >> 172.21.15.80:0/2247944501 conn(0x55e0f09f6480 msgr2=0x55e0efd45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 shutdown_connections 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/2247944501 wait complete. 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 msgr2=0x55e0efcc8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 0x55e0efcc8000 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x55e0f0a493b0 tx=0x55e0efd161e0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 shutdown_connections 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e0f09f6000 0x55e0efcc8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0efdaf180 0x55e0efcc8000 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 --2- 172.21.15.80:0/1487865812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0efdafa80 0x55e0efcc8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 >> 172.21.15.80:0/1487865812 conn(0x55e0efdaf600 msgr2=0x55e0efd45000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 shutdown_connections 2024-04-25T15:47:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.145+0000 7f974001b280 1 -- 172.21.15.80:0/1487865812 wait complete. 2024-04-25T15:47:18.167 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.084781, result: { "0": { "data": { "sessions": [ { "id": 6973, "entity": { "name": { "type": "client", "num": 6973 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 862305723 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.00099997699999999998, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6973 192.168.0.1:0/862305723", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000017bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi195", "kernel_version": "5.14.0-437.el9.x86_64", "root": "/" } }, { "id": 6967, "entity": { "name": { "type": "client", "num": 6967 }, "addr": { "type": "any", "addr": "172.21.15.80:0", "nonce": 4288989611 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.00099997699999999998, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6967 172.21.15.80:0/4288989611", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000017bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi080", "kernel_version": "5.14.0-437.el9.x86_64", "root": "/" } } ] }, "result": 0 } } 2024-04-25T15:47:18.168 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 6973, "entity": { "name": { "type": "client", "num": 6973 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 862305723 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.000999977, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6973 192.168.0.1:0/862305723", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000017bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi195", "kernel_version": "5.14.0-437.el9.x86_64", "root": "/" } }, { "id": 6967, "entity": { "name": { "type": "client", "num": 6967 }, "addr": { "type": "any", "addr": "172.21.15.80:0", "nonce": 4288989611 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.000999977, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6967 172.21.15.80:0/4288989611", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000017bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi080", "kernel_version": "5.14.0-437.el9.x86_64", "root": "/" } } ] }, "result": 0 } } 2024-04-25T15:47:18.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:18.169 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2024-04-25T15:47:18.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:18.188 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2024-04-25T15:47:18.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:18.246 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2024-04-25T15:47:18.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-25T15:47:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.397+0000 7f47ef59e640 1 Processor -- start 2024-04-25T15:47:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.397+0000 7f47ef59e640 1 -- start start 2024-04-25T15:47:18.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47ef59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f00d44d0 0x7f47f00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47ef59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f00d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47ef59e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f00d1250 con 0x7f47f00d0e40 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47ef59e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f47f00b5300 con 0x7f47f00d44d0 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47ef59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f47f00d4ab0 con 0x7f47f0161060 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47ee59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f00d44d0 0x7f47f00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47eed9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f47f00d0e40 0x7f47f015f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48572/0 (socket says 172.21.15.80:48572) 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.398+0000 7f47eed9d640 1 -- 172.21.15.80:0/3633880820 learned_addr learned my addr 172.21.15.80:0/3633880820 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47e7fff640 1 --2- 172.21.15.80:0/3633880820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f00d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47ee59c640 1 -- 172.21.15.80:0/3633880820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 msgr2=0x7f47f00d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47ee59c640 1 --2- 172.21.15.80:0/3633880820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f00d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47ee59c640 1 -- 172.21.15.80:0/3633880820 >> v1:172.21.15.80:6789/0 conn(0x7f47f00d0e40 legacy=0x7f47f015f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47edd9b640 1 -- 172.21.15.80:0/3633880820 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131811318 0 0) 0x7f47e8001490 con 0x7f47f00d0e40 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47ee59c640 1 -- 172.21.15.80:0/3633880820 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f00d4d90 con 0x7f47f00d44d0 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.399+0000 7f47ee59c640 1 --2- 172.21.15.80:0/3633880820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f00b4dc0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097a0 tx=0x7f47e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988fc8ae2d43b5fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47edd9b640 1 -- 172.21.15.80:0/3633880820 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0037070 con 0x7f47f00d44d0 2024-04-25T15:47:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47edd9b640 1 -- 172.21.15.80:0/3633880820 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e0032440 con 0x7f47f00d44d0 2024-04-25T15:47:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47edd9b640 1 -- 172.21.15.80:0/3633880820 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0032810 con 0x7f47f00d44d0 2024-04-25T15:47:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 -- 172.21.15.80:0/3633880820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 msgr2=0x7f47f00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 --2- 172.21.15.80:0/3633880820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f00b4dc0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097a0 tx=0x7f47e002a180 comp rx=0 tx=0).stop 2024-04-25T15:47:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 -- 172.21.15.80:0/3633880820 shutdown_connections 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 --2- 172.21.15.80:0/3633880820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f00d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 --2- 172.21.15.80:0/3633880820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f00b4dc0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 -- 172.21.15.80:0/3633880820 >> 172.21.15.80:0/3633880820 conn(0x7f47f00b7640 msgr2=0x7f47f00b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 -- 172.21.15.80:0/3633880820 shutdown_connections 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.400+0000 7f47ef59e640 1 -- 172.21.15.80:0/3633880820 wait complete. 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.402+0000 7f47ef59e640 1 Processor -- start 2024-04-25T15:47:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.402+0000 7f47ef59e640 1 -- start start 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.403+0000 7f47ef59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f00d0e40 0x7f47f014e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.403+0000 7f47ef59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f01f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.403+0000 7f47ef59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47ef59e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0161470 con 0x7f47f00d44d0 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47ef59e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00d5350 con 0x7f47f00d0e40 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47ef59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f47f01615f0 con 0x7f47f0161060 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f01f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f01f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35114/0 (socket says 172.21.15.80:35114) 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 -- 172.21.15.80:0/1031590408 learned_addr learned my addr 172.21.15.80:0/1031590408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47ee59c640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f00d0e40 0x7f47f014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47eed9d640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 -- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 msgr2=0x7f47f015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 -- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f00d0e40 msgr2=0x7f47f014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f00d0e40 0x7f47f014e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 -- 172.21.15.80:0/1031590408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f0159900 con 0x7f47f00d44d0 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e7fff640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f01f9a80 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d5f0 tx=0x7f47d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80125f0 con 0x7f47f00d44d0 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d8019070 con 0x7f47f00d44d0 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f0159be0 con 0x7f47f00d44d0 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80129d0 con 0x7f47f00d44d0 2024-04-25T15:47:18.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.404+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f015b740 con 0x7f47f00d44d0 2024-04-25T15:47:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.405+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f0076b00 con 0x7f47f00d44d0 2024-04-25T15:47:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.406+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f47d8012b70 con 0x7f47f00d44d0 2024-04-25T15:47:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.406+0000 7f47e6ffd640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f47d00744e0 0x7f47d00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.406+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f47d8095660 con 0x7f47f00d44d0 2024-04-25T15:47:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.406+0000 7f47ee59c640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f47d00744e0 0x7f47d00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.407+0000 7f47ee59c640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f47d00744e0 0x7f47d00769f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f47e0034000 tx=0x7f47e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.411+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47d805f600 con 0x7f47f00d44d0 2024-04-25T15:47:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:18.623+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f47f015f8d0 con 0x7f47f00d44d0 2024-04-25T15:47:19.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.201+0000 7f47e6ffd640 1 -- 172.21.15.80:0/1031590408 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v60) ==== 105+0+0 (secure 0 0 0) 0x7f47d8063900 con 0x7f47f00d44d0 2024-04-25T15:47:19.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f47d00744e0 msgr2=0x7f47d00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f47d00744e0 0x7f47d00769f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f47e0034000 tx=0x7f47e002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:19.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 msgr2=0x7f47f01f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f01f9a80 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d5f0 tx=0x7f47d800dab0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 shutdown_connections 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f47d00744e0 0x7f47d00769f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47f0161060 0x7f47f015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f00d44d0 0x7f47f01f9a80 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 --2- 172.21.15.80:0/1031590408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f00d0e40 0x7f47f014e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 >> 172.21.15.80:0/1031590408 conn(0x7f47f00b7640 msgr2=0x7f47f006f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 shutdown_connections 2024-04-25T15:47:19.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.203+0000 7f47ef59e640 1 -- 172.21.15.80:0/1031590408 wait complete. 2024-04-25T15:47:19.218 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:19.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.325+0000 7fc645b6b640 1 Processor -- start 2024-04-25T15:47:19.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.325+0000 7fc645b6b640 1 -- start start 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc645b6b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc6400ce6d0 0x7fc6401603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc645b6b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 0x7fc64006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc645b6b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64006f570 con 0x7fc6400b55b0 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc645b6b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc6400d1700 con 0x7fc6400ce6d0 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc645b6b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc64006f850 con 0x7fc640164b40 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6400b55b0 0x7fc6400b59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48576/0 (socket says 172.21.15.80:48576) 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63ffff640 1 -- 172.21.15.80:0/2681600171 learned_addr learned my addr 172.21.15.80:0/2681600171 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706088859 0 0) 0x7fc64006f570 con 0x7fc6400b55b0 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63f7fe640 1 --2- 172.21.15.80:0/2681600171 >> v2:172.21.15.195:3300/0 conn(0x7fc6400ce6d0 0x7fc6401603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc628003520 con 0x7fc6400b55b0 2024-04-25T15:47:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63effd640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 0x7fc64006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 641353273 0 0) 0x7fc628003520 con 0x7fc6400b55b0 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 msgr2=0x7fc64006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 0x7fc64006ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 >> v2:172.21.15.195:3300/0 conn(0x7fc6400ce6d0 msgr2=0x7fc6401603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 --2- 172.21.15.80:0/2681600171 >> v2:172.21.15.195:3300/0 conn(0x7fc6400ce6d0 0x7fc6401603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64006fb30 con 0x7fc6400b55b0 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc6380019f0 con 0x7fc6400b55b0 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 >> v1:172.21.15.80:6789/0 conn(0x7fc6400b55b0 legacy=0x7fc6400b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6280039b0 0x7fc628003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc628004800 0x7fc628004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 0x7fc628005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc64006f850 con 0x7fc628004800 2024-04-25T15:47:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc62800ba70 con 0x7fc6280039b0 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc62800bc70 con 0x7fc640164b40 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.327+0000 7fc63effd640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc628004800 0x7fc628004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63f7fe640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6280039b0 0x7fc628003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63ffff640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 0x7fc628005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63effd640 1 -- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 msgr2=0x7fc628005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63effd640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc640164b40 0x7fc628005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63effd640 1 -- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6280039b0 msgr2=0x7fc628003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63effd640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6280039b0 0x7fc628003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63effd640 1 -- 172.21.15.80:0/2681600171 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628003520 con 0x7fc628004800 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.328+0000 7fc63effd640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc628004800 0x7fc628004c10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc634009ac0 tx=0x7fc628005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3fe0406e3c4f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634036070 con 0x7fc628004800 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634031400 con 0x7fc628004800 2024-04-25T15:47:19.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc63e7fc640 1 -- 172.21.15.80:0/2681600171 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634009690 con 0x7fc628004800 2024-04-25T15:47:19.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc645b6b640 1 -- 172.21.15.80:0/2681600171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc628004800 msgr2=0x7fc628004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc645b6b640 1 --2- 172.21.15.80:0/2681600171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc628004800 0x7fc628004c10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc634009ac0 tx=0x7fc628005830 comp rx=0 tx=0).stop 2024-04-25T15:47:19.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc63ffff640 1 -- 172.21.15.80:0/2681600171 reap_dead start 2024-04-25T15:47:19.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc645b6b640 1 -- 172.21.15.80:0/2681600171 shutdown_connections 2024-04-25T15:47:19.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc645b6b640 1 -- 172.21.15.80:0/2681600171 >> 172.21.15.80:0/2681600171 conn(0x7fc6400d0790 msgr2=0x7fc6400d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc645b6b640 1 -- 172.21.15.80:0/2681600171 shutdown_connections 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.329+0000 7fc645b6b640 1 -- 172.21.15.80:0/2681600171 wait complete. 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.331+0000 7fc645b6b640 1 Processor -- start 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.331+0000 7fc645b6b640 1 -- start start 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc628004800 0x7fc64015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 0x7fc6401497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6401624d0 0x7fc6401628e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc64006eea0 con 0x7fc6401493b0 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc64006ed20 con 0x7fc6401624d0 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc64006f020 con 0x7fc628004800 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 0x7fc6401497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 0x7fc6401497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35126/0 (socket says 172.21.15.80:35126) 2024-04-25T15:47:19.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 -- 172.21.15.80:0/3641059726 learned_addr learned my addr 172.21.15.80:0/3641059726 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63f7fe640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc628004800 0x7fc64015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63ffff640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6401624d0 0x7fc6401628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 -- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc628004800 msgr2=0x7fc64015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc628004800 0x7fc64015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 -- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6401624d0 msgr2=0x7fc6401628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6401624d0 0x7fc6401628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 -- 172.21.15.80:0/3641059726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc640162e20 con 0x7fc6401493b0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63ffff640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6401624d0 0x7fc6401628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc63effd640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 0x7fc6401497c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc634034040 tx=0x7fc634004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634040020 con 0x7fc6401493b0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634003c40 con 0x7fc6401493b0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64015edc0 con 0x7fc6401493b0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634036040 con 0x7fc6401493b0 2024-04-25T15:47:19.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.333+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64015f380 con 0x7fc6401493b0 2024-04-25T15:47:19.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.334+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc640149ea0 con 0x7fc6401493b0 2024-04-25T15:47:19.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.335+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc634043020 con 0x7fc6401493b0 2024-04-25T15:47:19.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.335+0000 7fc627fff640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc62c0744e0 0x7fc62c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:19.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.336+0000 7fc63f7fe640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc62c0744e0 0x7fc62c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:19.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.336+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fc6340b5700 con 0x7fc6401493b0 2024-04-25T15:47:19.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.336+0000 7fc63f7fe640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc62c0744e0 0x7fc62c0769f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc630006b10 tx=0x7fc630009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:19.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.340+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc63404a070 con 0x7fc6401493b0 2024-04-25T15:47:19.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.551+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc640050740 con 0x7fc6401493b0 2024-04-25T15:47:19.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.551+0000 7fc627fff640 1 -- 172.21.15.80:0/3641059726 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5207 (secure 0 0 0) 0x7fc640162e20 con 0x7fc6401493b0 2024-04-25T15:47:19.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:19.552 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:19.204109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7824,"mds_1":7839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7839":{"gid":7839,"name":"a","rank":1,"incarnation":61,"state":"up:creating","state_seq":1,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7824]},"id":7}]} 2024-04-25T15:47:19.552 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 61 2024-04-25T15:47:19.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc62c0744e0 msgr2=0x7fc62c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc62c0744e0 0x7fc62c0769f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc630006b10 tx=0x7fc630009190 comp rx=0 tx=0).stop 2024-04-25T15:47:19.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 msgr2=0x7fc6401497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 0x7fc6401497c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc634034040 tx=0x7fc634004730 comp rx=0 tx=0).stop 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 shutdown_connections 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc62c0744e0 0x7fc62c0769f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6401624d0 0x7fc6401628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6401493b0 0x7fc6401497c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.553+0000 7fc645b6b640 1 --2- 172.21.15.80:0/3641059726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc628004800 0x7fc64015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.554+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 >> 172.21.15.80:0/3641059726 conn(0x7fc6400d0790 msgr2=0x7fc6400b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.554+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 shutdown_connections 2024-04-25T15:47:19.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:19.554+0000 7fc645b6b640 1 -- 172.21.15.80:0/3641059726 wait complete. 2024-04-25T15:47:19.970 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:54.313611+0000', 'modified': '2024-04-25T15:47:19.204109+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7824, 'mds_1': 7839}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7824': {'gid': 7824, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.80:6835/3715281705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3715281705}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 3715281705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7839': {'gid': 7839, 'name': 'a', 'rank': 1, 'incarnation': 61, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.80:6837/2599426974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 2599426974}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 2599426974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7824, 'qdb_cluster': [7824]} 2024-04-25T15:47:19.970 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7839:up:creating 2024-04-25T15:47:20.971 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:21.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.096+0000 7f9216834640 1 Processor -- start 2024-04-25T15:47:21.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.096+0000 7f9216834640 1 -- start start 2024-04-25T15:47:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9216834640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9210161d70 0x7f9210162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9216834640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92100b55b0 0x7f92100b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9216834640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92100b5f00 con 0x7f92100b8f20 2024-04-25T15:47:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9216834640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f92101626c0 con 0x7f92100b55b0 2024-04-25T15:47:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9216834640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f92100ce7e0 con 0x7f9210161d70 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92100b55b0 0x7f92100b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92100b55b0 0x7f92100b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35130/0 (socket says 172.21.15.80:35130) 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 -- 172.21.15.80:0/3944159885 learned_addr learned my addr 172.21.15.80:0/3944159885 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f920ffff640 1 --1- 172.21.15.80:0/3944159885 >> v1:172.21.15.195:6789/0 conn(0x7f92100b8f20 0x7f92100b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:60580/0 (socket says 172.21.15.80:60580) 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f920f7fe640 1 --2- 172.21.15.80:0/3944159885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9210161d70 0x7f9210162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 -- 172.21.15.80:0/3944159885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9210161d70 msgr2=0x7f9210162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 --2- 172.21.15.80:0/3944159885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9210161d70 0x7f9210162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 -- 172.21.15.80:0/3944159885 >> v1:172.21.15.195:6789/0 conn(0x7f92100b8f20 legacy=0x7f92100b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.098+0000 7f9214dd1640 1 -- 172.21.15.80:0/3944159885 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92101628e0 con 0x7f92100b55b0 2024-04-25T15:47:21.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.099+0000 7f9214dd1640 1 --2- 172.21.15.80:0/3944159885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92100b55b0 0x7f92100b59c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f9208009e50 tx=0x7f920802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782701deb140c07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.099+0000 7f920effd640 1 -- 172.21.15.80:0/3944159885 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208036070 con 0x7f92100b55b0 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.099+0000 7f920effd640 1 -- 172.21.15.80:0/3944159885 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208031600 con 0x7f92100b55b0 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.099+0000 7f920effd640 1 -- 172.21.15.80:0/3944159885 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080319d0 con 0x7f92100b55b0 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 -- 172.21.15.80:0/3944159885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92100b55b0 msgr2=0x7f92100b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 --2- 172.21.15.80:0/3944159885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92100b55b0 0x7f92100b59c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f9208009e50 tx=0x7f920802a710 comp rx=0 tx=0).stop 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 -- 172.21.15.80:0/3944159885 shutdown_connections 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 --2- 172.21.15.80:0/3944159885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92100b55b0 0x7f92100b59c0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 --2- 172.21.15.80:0/3944159885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9210161d70 0x7f9210162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 -- 172.21.15.80:0/3944159885 >> 172.21.15.80:0/3944159885 conn(0x7f92100d0790 msgr2=0x7f92100d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 -- 172.21.15.80:0/3944159885 shutdown_connections 2024-04-25T15:47:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.100+0000 7f9216834640 1 -- 172.21.15.80:0/3944159885 wait complete. 2024-04-25T15:47:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.102+0000 7f9216834640 1 Processor -- start 2024-04-25T15:47:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.102+0000 7f9216834640 1 -- start start 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.103+0000 7f9216834640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92100b55b0 0x7f9210157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.103+0000 7f9216834640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92100b8f20 0x7f92100cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.103+0000 7f9216834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 0x7f921015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.103+0000 7f9216834640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92100d2800 con 0x7f9210161d70 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.103+0000 7f9216834640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f92100d2520 con 0x7f92100b55b0 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.103+0000 7f9216834640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9210162bc0 con 0x7f92100b8f20 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 0x7f921015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 0x7f921015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35134/0 (socket says 172.21.15.80:35134) 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 -- 172.21.15.80:0/1442526860 learned_addr learned my addr 172.21.15.80:0/1442526860 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f920ffff640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92100b55b0 0x7f9210157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f920f7fe640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92100b8f20 0x7f92100cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 -- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92100b8f20 msgr2=0x7f92100cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92100b8f20 0x7f92100cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 -- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92100b55b0 msgr2=0x7f9210157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92100b55b0 0x7f9210157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 -- 172.21.15.80:0/1442526860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100ca300 con 0x7f9210161d70 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9214dd1640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 0x7f921015a420 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f9208009f70 tx=0x7f9208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920803f020 con 0x7f9210161d70 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208037040 con 0x7f9210161d70 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92100cd040 con 0x7f9210161d70 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208036070 con 0x7f9210161d70 2024-04-25T15:47:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.104+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92100cb7f0 con 0x7f9210161d70 2024-04-25T15:47:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.106+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9210050740 con 0x7f9210161d70 2024-04-25T15:47:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.106+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9208042020 con 0x7f9210161d70 2024-04-25T15:47:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.107+0000 7f920cff9640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91fc0744e0 0x7f91fc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.107+0000 7f920ffff640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91fc0744e0 0x7f91fc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.107+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f92080b5ae0 con 0x7f9210161d70 2024-04-25T15:47:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.107+0000 7f920ffff640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91fc0744e0 0x7f91fc0769f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9200007fd0 tx=0x7f9200007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.112+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9208049020 con 0x7f9210161d70 2024-04-25T15:47:21.165 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-25T15:47:21.165+0000 7f8434921640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T15:47:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.326+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92100ca020 con 0x7f9210161d70 2024-04-25T15:47:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.326+0000 7f920cff9640 1 -- 172.21.15.80:0/1442526860 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5210 (secure 0 0 0) 0x7f920807f9e0 con 0x7f9210161d70 2024-04-25T15:47:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:21.326 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:20.206136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7824,"mds_1":7839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7839":{"gid":7839,"name":"a","rank":1,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7824,7839]},"id":7}]} 2024-04-25T15:47:21.327 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 62 2024-04-25T15:47:21.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91fc0744e0 msgr2=0x7f91fc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91fc0744e0 0x7f91fc0769f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9200007fd0 tx=0x7f9200007e80 comp rx=0 tx=0).stop 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 msgr2=0x7f921015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 0x7f921015a420 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f9208009f70 tx=0x7f9208004a40 comp rx=0 tx=0).stop 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 shutdown_connections 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91fc0744e0 0x7f91fc0769f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9210161d70 0x7f921015a420 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92100b8f20 0x7f92100cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 --2- 172.21.15.80:0/1442526860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92100b55b0 0x7f9210157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 >> 172.21.15.80:0/1442526860 conn(0x7f92100d0790 msgr2=0x7f92100d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 shutdown_connections 2024-04-25T15:47:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.328+0000 7f9216834640 1 -- 172.21.15.80:0/1442526860 wait complete. 2024-04-25T15:47:21.742 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:54.313611+0000', 'modified': '2024-04-25T15:47:20.206136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7824, 'mds_1': 7839}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7824': {'gid': 7824, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.80:6835/3715281705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 3715281705}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 3715281705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7839': {'gid': 7839, 'name': 'a', 'rank': 1, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6837/2599426974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 2599426974}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 2599426974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7824, 'qdb_cluster': [7824, 7839]} 2024-04-25T15:47:21.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-04-25T15:47:21.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:47:21.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.854+0000 7fed4cb2e640 1 Processor -- start 2024-04-25T15:47:21.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.854+0000 7fed4cb2e640 1 -- start start 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed4cb2e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed480b44d0 0x7fed480b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed4cb2e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed48160a20 con 0x7fed48160610 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed4cb2e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed480b4e20 con 0x7fed480b3f20 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed4cb2e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fed480b4330 con 0x7fed480b44d0 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed45d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed48160610 0x7fed480ce020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48582/0 (socket says 172.21.15.80:48582) 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed45d9b640 1 -- 172.21.15.80:0/2876039255 learned_addr learned my addr 172.21.15.80:0/2876039255 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed46d9d640 1 --2- 172.21.15.80:0/2876039255 >> v2:172.21.15.195:3300/0 conn(0x7fed480b44d0 0x7fed480b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204117548 0 0) 0x7fed3c001110 con 0x7fed48160610 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.856+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed30003520 con 0x7fed48160610 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 829032525 0 0) 0x7fed30003520 con 0x7fed48160610 2024-04-25T15:47:21.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 >> v2:172.21.15.195:3300/0 conn(0x7fed480b44d0 msgr2=0x7fed480b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 --2- 172.21.15.80:0/2876039255 >> v2:172.21.15.195:3300/0 conn(0x7fed480b44d0 0x7fed480b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 >> v1:172.21.15.195:6789/0 conn(0x7fed480b3f20 legacy=0x7fed4806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed480d1f10 con 0x7fed48160610 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fed3c001840 con 0x7fed48160610 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 >> v1:172.21.15.80:6789/0 conn(0x7fed48160610 legacy=0x7fed480ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300039b0 0x7fed30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed30004800 0x7fed30004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed300051c0 0x7fed3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed480b4330 con 0x7fed300051c0 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed3000c160 con 0x7fed300039b0 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed3000c360 con 0x7fed30004800 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed46d9d640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed300051c0 0x7fed3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed4659c640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300039b0 0x7fed30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed45d9b640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed30004800 0x7fed30004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed46d9d640 1 -- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed30004800 msgr2=0x7fed30004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed46d9d640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed30004800 0x7fed30004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed46d9d640 1 -- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300039b0 msgr2=0x7fed30003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed46d9d640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300039b0 0x7fed30003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.857+0000 7fed46d9d640 1 -- 172.21.15.80:0/2876039255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30003520 con 0x7fed300051c0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.858+0000 7fed46d9d640 1 -- 172.21.15.80:0/2876039255 reap_dead start 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.858+0000 7fed46d9d640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed300051c0 0x7fed3000b9c0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fed40009a90 tx=0x7fed30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a347321da13c49b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.858+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40009690 con 0x7fed300051c0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.858+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40004020 con 0x7fed300051c0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.858+0000 7fed4559a640 1 -- 172.21.15.80:0/2876039255 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40004410 con 0x7fed300051c0 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 -- 172.21.15.80:0/2876039255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed300051c0 msgr2=0x7fed3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed300051c0 0x7fed3000b9c0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fed40009a90 tx=0x7fed30005830 comp rx=0 tx=0).stop 2024-04-25T15:47:21.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 -- 172.21.15.80:0/2876039255 shutdown_connections 2024-04-25T15:47:21.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/2876039255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed300051c0 0x7fed3000b9c0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 -- 172.21.15.80:0/2876039255 >> 172.21.15.80:0/2876039255 conn(0x7fed4809b600 msgr2=0x7fed4809ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 -- 172.21.15.80:0/2876039255 shutdown_connections 2024-04-25T15:47:21.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.859+0000 7fed4cb2e640 1 -- 172.21.15.80:0/2876039255 wait complete. 2024-04-25T15:47:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.861+0000 7fed4cb2e640 1 Processor -- start 2024-04-25T15:47:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.861+0000 7fed4cb2e640 1 -- start start 2024-04-25T15:47:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4cb2e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300051c0 0x7fed481f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4cb2e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4815b4a0 0x7fed48146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4cb2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 0x7fed481622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4cb2e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed480ce870 con 0x7fed48147310 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4cb2e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed480d24d0 con 0x7fed300051c0 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4cb2e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed480b48e0 con 0x7fed4815b4a0 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 0x7fed481622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 0x7fed481622c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35150/0 (socket says 172.21.15.80:35150) 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 -- 172.21.15.80:0/1927188426 learned_addr learned my addr 172.21.15.80:0/1927188426 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4659c640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300051c0 0x7fed481f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 -- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4815b4a0 msgr2=0x7fed48146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4815b4a0 0x7fed48146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 -- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300051c0 msgr2=0x7fed481f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300051c0 0x7fed481f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed46d9d640 1 -- 172.21.15.80:0/1927188426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4815bf60 con 0x7fed48147310 2024-04-25T15:47:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.862+0000 7fed4659c640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300051c0 0x7fed481f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.863+0000 7fed46d9d640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 0x7fed481622c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fed40009ac0 tx=0x7fed40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.863+0000 7fed36ffd640 1 -- 172.21.15.80:0/1927188426 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4000f040 con 0x7fed48147310 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.863+0000 7fed36ffd640 1 -- 172.21.15.80:0/1927188426 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40040070 con 0x7fed48147310 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.863+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed48147720 con 0x7fed48147310 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.863+0000 7fed36ffd640 1 -- 172.21.15.80:0/1927188426 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4003a6b0 con 0x7fed48147310 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.863+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed48159d80 con 0x7fed48147310 2024-04-25T15:47:21.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.864+0000 7fed36ffd640 1 -- 172.21.15.80:0/1927188426 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed4003a850 con 0x7fed48147310 2024-04-25T15:47:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.865+0000 7fed36ffd640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed280744b0 0x7fed280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.865+0000 7fed36ffd640 1 -- 172.21.15.80:0/1927188426 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fed400b5780 con 0x7fed48147310 2024-04-25T15:47:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.865+0000 7fed4659c640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed280744b0 0x7fed280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.865+0000 7fed4659c640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed280744b0 0x7fed280769c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fed38000f80 tx=0x7fed38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.866+0000 7fed539dc740 1 Processor -- start 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.866+0000 7fed539dc740 1 -- start start 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b81270 0x55e775f4d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed539dc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f49fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b60590 0x55e775f23260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed539dc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e775e87740 con 0x55e775b583b0 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e775e233a0 con 0x55e775b81270 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e775e83700 con 0x55e775b60590 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed45d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f49fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed45d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f49fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35152/0 (socket says 172.21.15.80:35152) 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.867+0000 7fed45d9b640 1 -- 172.21.15.80:0/1286770757 learned_addr learned my addr 172.21.15.80:0/1286770757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed45d9b640 1 -- 172.21.15.80:0/1286770757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b60590 msgr2=0x55e775f23260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed45d9b640 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b60590 0x55e775f23260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed45d9b640 1 -- 172.21.15.80:0/1286770757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b81270 msgr2=0x55e775f4d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed45d9b640 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b81270 0x55e775f4d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed45d9b640 1 -- 172.21.15.80:0/1286770757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e775e3f750 con 0x55e775b583b0 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed45d9b640 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f49fa0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fed3c001360 tx=0x7fed3c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c334216a9a2e8101 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed27fff640 1 -- 172.21.15.80:0/1286770757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0017e0 con 0x55e775b583b0 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed27fff640 1 -- 172.21.15.80:0/1286770757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c018070 con 0x55e775b583b0 2024-04-25T15:47:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.868+0000 7fed27fff640 1 -- 172.21.15.80:0/1286770757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0133f0 con 0x55e775b583b0 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 -- 172.21.15.80:0/1286770757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 msgr2=0x55e775f49fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f49fa0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fed3c001360 tx=0x7fed3c004bb0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 -- 172.21.15.80:0/1286770757 shutdown_connections 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b60590 0x55e775f23260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f49fa0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 --2- 172.21.15.80:0/1286770757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b81270 0x55e775f4d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 -- 172.21.15.80:0/1286770757 >> 172.21.15.80:0/1286770757 conn(0x55e775b753c0 msgr2=0x55e775f229f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 -- 172.21.15.80:0/1286770757 shutdown_connections 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.869+0000 7fed539dc740 1 -- 172.21.15.80:0/1286770757 wait complete. 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.870+0000 7fed539dc740 1 -- start start 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.870+0000 7fed539dc740 1 Processor -- start 2024-04-25T15:47:21.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f67540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f50930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775f50e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e775e0efe0 con 0x55e775b583b0 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e775f77b40 con 0x55e775b60590 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e775f68020 con 0x55e775b81270 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed539dc740 10 client.0 _ll_register_callbacks cb 0x55e775e25150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed4659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f67540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed4659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f67540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35160/0 (socket says 172.21.15.80:35160) 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.871+0000 7fed4659c640 1 -- 172.21.15.80:0/1699419769 learned_addr learned my addr 172.21.15.80:0/1699419769 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed4659c640 1 -- 172.21.15.80:0/1699419769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 msgr2=0x55e775f50e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed4659c640 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775f50e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed4659c640 1 -- 172.21.15.80:0/1699419769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 msgr2=0x55e775f50930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed4659c640 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f50930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed4659c640 1 -- 172.21.15.80:0/1699419769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e775b992d0 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed4659c640 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f67540 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fed38016470 tx=0x7fed38001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0be0f85992dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed257fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed257fa640 1 -- 172.21.15.80:0/1699419769 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38023620 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed257fa640 1 -- 172.21.15.80:0/1699419769 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fed38021c50 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed3c018070 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed257fa640 1 -- 172.21.15.80:0/1699419769 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fed38021e50 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 10 client.7932 fetch_fsmap learned FSMap version 62 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55e775c636b0 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed257fa640 1 -- 172.21.15.80:0/1699419769 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c018070 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed257fa640 1 -- 172.21.15.80:0/1699419769 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 62) ==== 3514+0+0 (secure 0 0 0) 0x7fed380237c0 con 0x55e775b583b0 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 10 client.7932 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 10 client.7932 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 20 client.7932 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:21.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775b3fe40 0x55e775f7ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 4 client.7932 mds_command: new command op to 7824 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.872+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 --> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e775e95350 con 0x55e775b3fe40 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.873+0000 7fed45d9b640 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775b3fe40 0x55e775f7ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.873+0000 7fed257fa640 10 client.7932 ms_handle_connect on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.873+0000 7fed45d9b640 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775b3fe40 0x55e775f7ac90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47daf6b6d18c048e server_cookie=15593f52d7341e8b in_seq=0 out_seq=0 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed257fa640 1 -- 172.21.15.80:0/1699419769 <== mds.0 v2:172.21.15.80:6834/3715281705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e775e95350 con 0x55e775b3fe40 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed257fa640 10 client.7932 handle_command_reply: tid=0 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 client.7932 shutdown 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 msgr2=0x55e775f67540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f67540 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fed38016470 tx=0x7fed38001610 comp rx=0 tx=0).stop 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 shutdown_connections 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775b3fe40 0x55e775f7ac90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775f50e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f50930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 --2- 172.21.15.80:0/1699419769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b583b0 0x55e775f67540 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed257fa640 0 client.7932 ms_handle_reset on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 >> 172.21.15.80:0/1699419769 conn(0x55e775b753c0 msgr2=0x55e775f49f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 shutdown_connections 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 1 -- 172.21.15.80:0/1699419769 wait complete. 2024-04-25T15:47:21.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.874+0000 7fed539dc740 20 client.7932 trim_cache size 0 max 16384 2024-04-25T15:47:21.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.893+0000 7fed539dc740 1 Processor -- start 2024-04-25T15:47:21.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.893+0000 7fed539dc740 1 -- start start 2024-04-25T15:47:21.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b583b0 0x55e775f18a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f80fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed539dc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 0x55e775f814e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed539dc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed48203f00 con 0x55e775b81270 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed481faf40 con 0x55e775b60590 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed482028f0 con 0x55e775b583b0 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 0x55e775f814e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 0x55e775f814e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35168/0 (socket says 172.21.15.80:35168) 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 -- 172.21.15.80:0/3411585509 learned_addr learned my addr 172.21.15.80:0/3411585509 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed45d9b640 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f80fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed4659c640 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b583b0 0x55e775f18a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 -- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b583b0 msgr2=0x55e775f18a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b583b0 0x55e775f18a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 -- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 msgr2=0x55e775f80fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f80fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.894+0000 7fed46d9d640 1 -- 172.21.15.80:0/3411585509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e775f1f4b0 con 0x55e775b81270 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed46d9d640 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 0x55e775f814e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fed4007f5f0 tx=0x7fed4007f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138cd065b558c531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed277fe640 1 -- 172.21.15.80:0/3411585509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4007f170 con 0x55e775b81270 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed277fe640 1 -- 172.21.15.80:0/3411585509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40009110 con 0x55e775b81270 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed277fe640 1 -- 172.21.15.80:0/3411585509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed400881a0 con 0x55e775b81270 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 -- 172.21.15.80:0/3411585509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 msgr2=0x55e775f814e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 0x55e775f814e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fed4007f5f0 tx=0x7fed4007f500 comp rx=0 tx=0).stop 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 -- 172.21.15.80:0/3411585509 shutdown_connections 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b81270 0x55e775f814e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b60590 0x55e775f80fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 --2- 172.21.15.80:0/3411585509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b583b0 0x55e775f18a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 -- 172.21.15.80:0/3411585509 >> 172.21.15.80:0/3411585509 conn(0x55e775b753c0 msgr2=0x55e775f1d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 -- 172.21.15.80:0/3411585509 shutdown_connections 2024-04-25T15:47:21.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.895+0000 7fed539dc740 1 -- 172.21.15.80:0/3411585509 wait complete. 2024-04-25T15:47:21.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.896+0000 7fed539dc740 1 -- start start 2024-04-25T15:47:21.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.896+0000 7fed539dc740 1 Processor -- start 2024-04-25T15:47:21.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b583b0 0x55e775f229d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 0x55e775f4da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775fe5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e775f774e0 con 0x55e775b60590 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e775f4ee50 con 0x55e775b583b0 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e775f4f540 con 0x55e775b81270 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed539dc740 10 client.0 _ll_register_callbacks cb 0x7fed38003c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 0x55e775f4da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 0x55e775f4da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35176/0 (socket says 172.21.15.80:35176) 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 -- 172.21.15.80:0/3032661139 learned_addr learned my addr 172.21.15.80:0/3032661139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed4659c640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b583b0 0x55e775f229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed46d9d640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775fe5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 -- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 msgr2=0x55e775fe5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775fe5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 -- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b583b0 msgr2=0x55e775f229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b583b0 0x55e775f229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 -- 172.21.15.80:0/3032661139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e775f4dfb0 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed4659c640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b583b0 0x55e775f229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed45d9b640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 0x55e775f4da70 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fed3c014000 tx=0x7fed3c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8b93c140f7289b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed257fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.898+0000 7fed257fa640 1 -- 172.21.15.80:0/3032661139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0077f0 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed257fa640 1 -- 172.21.15.80:0/3032661139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fed3c02aa60 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed40009110 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed257fa640 1 -- 172.21.15.80:0/3032661139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fed3c02ac60 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 10 client.7938 fetch_fsmap learned FSMap version 62 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55e775fe6e00 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed257fa640 1 -- 172.21.15.80:0/3032661139 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40009110 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed257fa640 1 -- 172.21.15.80:0/3032661139 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 62) ==== 3514+0+0 (secure 0 0 0) 0x7fed3c026040 con 0x55e775b60590 2024-04-25T15:47:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 10 client.7938 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 10 client.7938 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 20 client.7938 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775f63ea0 0x55e775f642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 4 client.7938 mds_command: new command op to 7824 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 --> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] -- command(tid 0: {"prefix": "status"}) -- 0x55e775e8f1c0 con 0x55e775f63ea0 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed4659c640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775f63ea0 0x55e775f642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.899+0000 7fed257fa640 10 client.7938 ms_handle_connect on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed4659c640 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775f63ea0 0x55e775f642b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=face51ff939d45c1 server_cookie=fbf20d4930c84851 in_seq=0 out_seq=0 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed257fa640 1 -- 172.21.15.80:0/3032661139 <== mds.0 v2:172.21.15.80:6834/3715281705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55e775e8f1c0 con 0x55e775f63ea0 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed257fa640 10 client.7938 handle_command_reply: tid=0 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 client.7938 shutdown 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 msgr2=0x55e775f4da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 0x55e775f4da70 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fed3c014000 tx=0x7fed3c012000 comp rx=0 tx=0).stop 2024-04-25T15:47:21.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 shutdown_connections 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:6834/3715281705,v1:172.21.15.80:6835/3715281705] conn(0x55e775f63ea0 0x55e775f642b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e775b81270 0x55e775fe5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e775b60590 0x55e775f4da70 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed257fa640 0 client.7938 ms_handle_reset on v2:172.21.15.80:6834/3715281705 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 --2- 172.21.15.80:0/3032661139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e775b583b0 0x55e775f229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 >> 172.21.15.80:0/3032661139 conn(0x55e775b753c0 msgr2=0x55e775f6a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 shutdown_connections 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 1 -- 172.21.15.80:0/3032661139 wait complete. 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.900+0000 7fed539dc740 20 client.7938 trim_cache size 0 max 16384 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:21.905 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7824, 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 10.728408266000001, 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 62, 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 103, 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 103, 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 11.379484743000001 2024-04-25T15:47:21.906 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed280744b0 msgr2=0x7fed280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed280744b0 0x7fed280769c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fed38000f80 tx=0x7fed38009040 comp rx=0 tx=0).stop 2024-04-25T15:47:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 msgr2=0x7fed481622c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 0x7fed481622c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fed40009ac0 tx=0x7fed40004730 comp rx=0 tx=0).stop 2024-04-25T15:47:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 shutdown_connections 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed280744b0 0x7fed280769c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed48147310 0x7fed481622c0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed4815b4a0 0x7fed48146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 --2- 172.21.15.80:0/1927188426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed300051c0 0x7fed481f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 >> 172.21.15.80:0/1927188426 conn(0x7fed4809b600 msgr2=0x7fed48068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 shutdown_connections 2024-04-25T15:47:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:21.901+0000 7fed4cb2e640 1 -- 172.21.15.80:0/1927188426 wait complete. 2024-04-25T15:47:21.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T15:47:22.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.023+0000 7fcbfe80c640 1 Processor -- start 2024-04-25T15:47:22.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.023+0000 7fcbfe80c640 1 -- start start 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfe80c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcbf80d1ab0 0x7fcbf80d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfe80c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbf80b44f0 0x7fcbf80b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfe80c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf80b4e40 con 0x7fcbf80d2950 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfe80c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf80d2570 con 0x7fcbf80b44f0 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfe80c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf806d060 con 0x7fcbf80d1ab0 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf77fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbf80b44f0 0x7fcbf80b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfcda9640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcbf80d2950 0x7fcbf80d2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48598/0 (socket says 172.21.15.80:48598) 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbfcda9640 1 -- 172.21.15.80:0/160490182 learned_addr learned my addr 172.21.15.80:0/160490182 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/160490182 >> v2:172.21.15.195:3300/0 conn(0x7fcbf80d1ab0 0x7fcbf80d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf77fe640 1 -- 172.21.15.80:0/160490182 >> v2:172.21.15.195:3300/0 conn(0x7fcbf80d1ab0 msgr2=0x7fcbf80d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/160490182 >> v2:172.21.15.195:3300/0 conn(0x7fcbf80d1ab0 0x7fcbf80d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf77fe640 1 -- 172.21.15.80:0/160490182 >> v1:172.21.15.80:6789/0 conn(0x7fcbf80d2950 legacy=0x7fcbf80d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf77fe640 1 -- 172.21.15.80:0/160490182 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf806d340 con 0x7fcbf80b44f0 2024-04-25T15:47:22.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.024+0000 7fcbf6ffd640 1 -- 172.21.15.80:0/160490182 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863399667 0 0) 0x7fcbf0001490 con 0x7fcbf80d2950 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.025+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/160490182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf80b4900 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80d2920 tx=0x7fcbec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956d313491c07b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.025+0000 7fcbf6ffd640 1 -- 172.21.15.80:0/160490182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec037070 con 0x7fcbf80b44f0 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.025+0000 7fcbf6ffd640 1 -- 172.21.15.80:0/160490182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec032440 con 0x7fcbf80b44f0 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.025+0000 7fcbf6ffd640 1 -- 172.21.15.80:0/160490182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec02ae60 con 0x7fcbf80b44f0 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 -- 172.21.15.80:0/160490182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 msgr2=0x7fcbf80b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/160490182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf80b4900 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80d2920 tx=0x7fcbec02a110 comp rx=0 tx=0).stop 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 -- 172.21.15.80:0/160490182 shutdown_connections 2024-04-25T15:47:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/160490182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf80b4900 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/160490182 >> v2:172.21.15.195:3300/0 conn(0x7fcbf80d1ab0 0x7fcbf80d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 -- 172.21.15.80:0/160490182 >> 172.21.15.80:0/160490182 conn(0x7fcbf809b600 msgr2=0x7fcbf809ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 -- 172.21.15.80:0/160490182 shutdown_connections 2024-04-25T15:47:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.026+0000 7fcbfe80c640 1 -- 172.21.15.80:0/160490182 wait complete. 2024-04-25T15:47:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.028+0000 7fcbfe80c640 1 Processor -- start 2024-04-25T15:47:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.028+0000 7fcbfe80c640 1 -- start start 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbfe80c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf81f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbfe80c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf80d1ab0 0x7fcbf80c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbfe80c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf80d2950 0x7fcbf80c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbfe80c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf80b3160 con 0x7fcbf80b44f0 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbfe80c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf80cf4e0 con 0x7fcbf80d2950 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbfe80c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf81f56c0 con 0x7fcbf80d1ab0 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf81f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf81f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35192/0 (socket says 172.21.15.80:35192) 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.029+0000 7fcbf7fff640 1 -- 172.21.15.80:0/3324169115 learned_addr learned my addr 172.21.15.80:0/3324169115 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:22.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf80d2950 0x7fcbf80c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf80d1ab0 0x7fcbf80c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf7fff640 1 -- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf80d1ab0 msgr2=0x7fcbf80c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf80d1ab0 0x7fcbf80c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf7fff640 1 -- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf80d2950 msgr2=0x7fcbf80c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf80d2950 0x7fcbf80c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf7fff640 1 -- 172.21.15.80:0/3324169115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf815e970 con 0x7fcbf80b44f0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf80d2950 0x7fcbf80c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf81f7380 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800e870 tx=0x7fcbe800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf4ff9640 1 -- 172.21.15.80:0/3324169115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8017070 con 0x7fcbf80b44f0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf4ff9640 1 -- 172.21.15.80:0/3324169115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe800c940 con 0x7fcbf80b44f0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbf4ff9640 1 -- 172.21.15.80:0/3324169115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800cd30 con 0x7fcbf80b44f0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf815ec50 con 0x7fcbf80b44f0 2024-04-25T15:47:22.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.030+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf815f210 con 0x7fcbf80b44f0 2024-04-25T15:47:22.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.032+0000 7fcbf4ff9640 1 -- 172.21.15.80:0/3324169115 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcbe801a070 con 0x7fcbf80b44f0 2024-04-25T15:47:22.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.033+0000 7fcbf4ff9640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcbe40744e0 0x7fcbe40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.033+0000 7fcbf4ff9640 1 -- 172.21.15.80:0/3324169115 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fcbe80956a0 con 0x7fcbf80b44f0 2024-04-25T15:47:22.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.033+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcbe40744e0 0x7fcbe40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.033+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcbe40744e0 0x7fcbe40769f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcbec034000 tx=0x7fcbec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.034+0000 7fcc05797740 1 Processor -- start 2024-04-25T15:47:22.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.034+0000 7fcc05797740 1 -- start start 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498baf93b0 0x56498beeb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcc05797740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 0x56498bec4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcc05797740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56498be28740 con 0x56498bb01590 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56498bdc43a0 con 0x56498bb22270 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x56498be24700 con 0x56498baf93b0 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 0x56498bec4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 0x56498bec4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35206/0 (socket says 172.21.15.80:35206) 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 -- 172.21.15.80:0/1998508611 learned_addr learned my addr 172.21.15.80:0/1998508611 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 -- 172.21.15.80:0/1998508611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498baf93b0 msgr2=0x56498beeb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498baf93b0 0x56498beeb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 -- 172.21.15.80:0/1998508611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 msgr2=0x56498bebe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 -- 172.21.15.80:0/1998508611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498bde0750 con 0x56498bb01590 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.035+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 0x56498bec4260 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0001de0 tx=0x7fcbf000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d2e2ef211b841 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcbddffb640 1 -- 172.21.15.80:0/1998508611 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000de30 con 0x56498bb01590 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcbddffb640 1 -- 172.21.15.80:0/1998508611 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf0004b60 con 0x56498bb01590 2024-04-25T15:47:22.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcbddffb640 1 -- 172.21.15.80:0/1998508611 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00070d0 con 0x56498bb01590 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 -- 172.21.15.80:0/1998508611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 msgr2=0x56498bec4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 0x56498bec4260 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0001de0 tx=0x7fcbf000d520 comp rx=0 tx=0).stop 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 -- 172.21.15.80:0/1998508611 shutdown_connections 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb01590 0x56498bec4260 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498baf93b0 0x56498beeb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 --2- 172.21.15.80:0/1998508611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 -- 172.21.15.80:0/1998508611 >> 172.21.15.80:0/1998508611 conn(0x56498bb163c0 msgr2=0x56498bec39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 -- 172.21.15.80:0/1998508611 shutdown_connections 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.036+0000 7fcc05797740 1 -- 172.21.15.80:0/1998508611 wait complete. 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.037+0000 7fcc05797740 1 -- start start 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.038+0000 7fcc05797740 1 Processor -- start 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498baf93b0 0x56498bf069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 0x56498bf07820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56498bdaffe0 con 0x56498bb22270 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56498beeed40 con 0x56498baf93b0 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x56498bef03e0 con 0x56498bb01590 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcc05797740 10 client.0 _ll_register_callbacks cb 0x56498bdc6150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 0x56498bf07820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 0x56498bf07820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35216/0 (socket says 172.21.15.80:35216) 2024-04-25T15:47:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 -- 172.21.15.80:0/642589758 learned_addr learned my addr 172.21.15.80:0/642589758 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498baf93b0 0x56498bf069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 -- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 msgr2=0x56498bf072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 -- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498baf93b0 msgr2=0x56498bf069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498baf93b0 0x56498bf069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 -- 172.21.15.80:0/642589758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498bb3a2d0 con 0x56498bb22270 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498baf93b0 0x56498bf069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 0x56498bf07820 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00012e0 tx=0x7fcbf0007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a8c043e72ab88d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.039+0000 7fcbd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/642589758 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00072f0 con 0x56498bb22270 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/642589758 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fcbf0007490 con 0x56498bb22270 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbf0004b60 con 0x56498bb22270 2024-04-25T15:47:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/642589758 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fcbf002d050 con 0x56498bb22270 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 10 client.7953 fetch_fsmap learned FSMap version 62 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x56498bc046b0 con 0x56498bb22270 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/642589758 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf0004b60 con 0x56498bb22270 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/642589758 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 62) ==== 3514+0+0 (secure 0 0 0) 0x7fcbf0030020 con 0x56498bb22270 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 10 client.7953 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 10 client.7953 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 20 client.7953 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bae0e40 0x56498beeeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 4 client.7953 mds_command: new command op to 7839 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 --> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56498be36350 con 0x56498bae0e40 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bae0e40 0x56498beeeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.040+0000 7fcbd6ffd640 10 client.7953 ms_handle_connect on v2:172.21.15.80:6836/2599426974 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bae0e40 0x56498beeeec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=180c7662542efa4b server_cookie=b3a904e86c612a2f in_seq=0 out_seq=0 2024-04-25T15:47:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/642589758 <== mds.1 v2:172.21.15.80:6836/2599426974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56498be36350 con 0x56498bae0e40 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcbd6ffd640 10 client.7953 handle_command_reply: tid=0 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 client.7953 shutdown 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 msgr2=0x56498bf07820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 0x56498bf07820 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00012e0 tx=0x7fcbf0007cc0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 shutdown_connections 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bae0e40 0x56498beeeec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498bb22270 0x56498bf07820 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 --2- 172.21.15.80:0/642589758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498baf93b0 0x56498bf069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcbd6ffd640 0 client.7953 ms_handle_reset on v2:172.21.15.80:6836/2599426974 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.041+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 >> 172.21.15.80:0/642589758 conn(0x56498bb163c0 msgr2=0x56498bf0cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.042+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 shutdown_connections 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.042+0000 7fcc05797740 1 -- 172.21.15.80:0/642589758 wait complete. 2024-04-25T15:47:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.042+0000 7fcc05797740 20 client.7953 trim_cache size 0 max 16384 2024-04-25T15:47:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.060+0000 7fcc05797740 1 Processor -- start 2024-04-25T15:47:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.060+0000 7fcc05797740 1 -- start start 2024-04-25T15:47:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcc05797740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf05a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcc05797740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf81ff2c0 con 0x56498baf93b0 2024-04-25T15:47:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf81f5100 con 0x56498bb22270 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf80ce3c0 con 0x56498bb01590 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35228/0 (socket says 172.21.15.80:35228) 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 -- 172.21.15.80:0/1238593859 learned_addr learned my addr 172.21.15.80:0/1238593859 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 -- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 msgr2=0x56498bf05a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf05a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 -- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 msgr2=0x56498bebd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 -- 172.21.15.80:0/1238593859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498beea5b0 con 0x56498baf93b0 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf054c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fcbe805bae0 tx=0x7fcbe8095040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8622cee995f3a121 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbdd7fa640 1 -- 172.21.15.80:0/1238593859 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8091070 con 0x56498baf93b0 2024-04-25T15:47:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbdd7fa640 1 -- 172.21.15.80:0/1238593859 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe80638a0 con 0x56498baf93b0 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.062+0000 7fcbdd7fa640 1 -- 172.21.15.80:0/1238593859 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8021030 con 0x56498baf93b0 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 -- 172.21.15.80:0/1238593859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 msgr2=0x56498bf054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf054c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fcbe805bae0 tx=0x7fcbe8095040 comp rx=0 tx=0).stop 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 -- 172.21.15.80:0/1238593859 shutdown_connections 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498bebd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf05a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 --2- 172.21.15.80:0/1238593859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf054c0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 -- 172.21.15.80:0/1238593859 >> 172.21.15.80:0/1238593859 conn(0x56498bb163c0 msgr2=0x56498bf069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 -- 172.21.15.80:0/1238593859 shutdown_connections 2024-04-25T15:47:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.063+0000 7fcc05797740 1 -- 172.21.15.80:0/1238593859 wait complete. 2024-04-25T15:47:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.064+0000 7fcc05797740 1 -- start start 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.064+0000 7fcc05797740 1 Processor -- start 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf25ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498beeead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56498bef0580 con 0x56498baf93b0 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56498bdaffe0 con 0x56498bb22270 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x56498bee6e90 con 0x56498bb01590 2024-04-25T15:47:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcc05797740 10 client.0 _ll_register_callbacks cb 0x7fcbf0001bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.065+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf25ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf25ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35230/0 (socket says 172.21.15.80:35230) 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 -- 172.21.15.80:0/783515051 learned_addr learned my addr 172.21.15.80:0/783515051 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498beeead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 -- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 msgr2=0x56498bf26020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf26020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 -- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 msgr2=0x56498beeead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498beeead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 -- 172.21.15.80:0/783515051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498bf05d50 con 0x56498baf93b0 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf26020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbfcda9640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498beeead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbf7fff640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf25ae0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fcbe805f1f0 tx=0x7fcbe8009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5254474fecdbe82c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/783515051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8091070 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/783515051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fcbe8080bf0 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbe80638a0 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/783515051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fcbe8021070 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcc05797740 10 client.7959 fetch_fsmap learned FSMap version 62 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x56498bf8b3c0 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.066+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/783515051 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe80638a0 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/783515051 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 62) ==== 3514+0+0 (secure 0 0 0) 0x7fcbe8078ce0 con 0x56498baf93b0 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 10 client.7959 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 10 client.7959 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 20 client.7959 populate_metadata read hostname 'smithi080' 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bee9d80 0x56498beef080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 4 client.7959 mds_command: new command op to 7839 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 --> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] -- command(tid 0: {"prefix": "status"}) -- 0x56498be301c0 con 0x56498bee9d80 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bee9d80 0x56498beef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcbd6ffd640 10 client.7959 ms_handle_connect on v2:172.21.15.80:6836/2599426974 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcbf77fe640 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bee9d80 0x56498beef080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a690a9422c706b1f server_cookie=d6642464b795a099 in_seq=0 out_seq=0 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcbd6ffd640 1 -- 172.21.15.80:0/783515051 <== mds.1 v2:172.21.15.80:6836/2599426974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56498be301c0 con 0x56498bee9d80 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcbd6ffd640 10 client.7959 handle_command_reply: tid=0 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 1 client.7959 shutdown 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.067+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 msgr2=0x56498bf25ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf25ae0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fcbe805f1f0 tx=0x7fcbe8009f20 comp rx=0 tx=0).stop 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 shutdown_connections 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:6836/2599426974,v1:172.21.15.80:6837/2599426974] conn(0x56498bee9d80 0x56498beef080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56498bb22270 0x56498beeead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56498bb01590 0x56498bf26020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbd6ffd640 0 client.7959 ms_handle_reset on v2:172.21.15.80:6836/2599426974 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 --2- 172.21.15.80:0/783515051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56498baf93b0 0x56498bf25ae0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 >> 172.21.15.80:0/783515051 conn(0x56498bb163c0 msgr2=0x56498bf054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 shutdown_connections 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 1 -- 172.21.15.80:0/783515051 wait complete. 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcc05797740 20 client.7959 trim_cache size 0 max 16384 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "e35f5388-3109-4b08-854a-9a0b33367f12", 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7839, 2024-04-25T15:47:22.074 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 2.8624364789999999, 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 62, 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 103, 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 103, 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 10.757790577 2024-04-25T15:47:22.075 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcbe40744e0 msgr2=0x7fcbe40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcbe40744e0 0x7fcbe40769f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcbec034000 tx=0x7fcbec02e000 comp rx=0 tx=0).stop 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 msgr2=0x7fcbf81f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf81f7380 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800e870 tx=0x7fcbe800ed30 comp rx=0 tx=0).stop 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 shutdown_connections 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fcbe40744e0 0x7fcbe40769f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf80d2950 0x7fcbf80c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf80d1ab0 0x7fcbf80c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 --2- 172.21.15.80:0/3324169115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbf80b44f0 0x7fcbf81f7380 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:22.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 >> 172.21.15.80:0/3324169115 conn(0x7fcbf809b600 msgr2=0x7fcbf809ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:22.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 shutdown_connections 2024-04-25T15:47:22.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:22.068+0000 7fcbfe80c640 1 -- 172.21.15.80:0/3324169115 wait complete. 2024-04-25T15:47:22.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T15:47:22.206 INFO:teuthology.orchestra.run.smithi080.stdout:{"message":"","return_code":0} 2024-04-25T15:47:22.207 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T15:47:22.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2024-04-25T15:47:22.329 INFO:teuthology.orchestra.run.smithi080.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":40,"op_send_bytes":11562,"op_resend":33,"op_reply":40,"op_latency":{"avgcount":40,"sum":0.300993221,"avgtime":0.007524830},"op_inflight":0,"oplen_avg":{"avgcount":40,"sum":62},"op":40,"op_r":0,"op_w":40,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2024-04-25T15:47:22.330 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 40, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 40, "avgtime": 0.00752483, "sum": 0.300993221 }, "op_pg": 0, "op_r": 0, "op_reply": 40, "op_resend": 33, "op_rmw": 0, "op_send": 40, "op_send_bytes": 11562, "op_w": 40, "oplen_avg": { "avgcount": 40, "sum": 62 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-04-25T15:47:22.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json export dir /bravo 1 2024-04-25T15:47:22.451 INFO:teuthology.orchestra.run.smithi080.stdout:{"return_code":0} 2024-04-25T15:47:22.451 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-04-25T15:47:22.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2024-04-25T15:47:22.574 INFO:teuthology.orchestra.run.smithi080.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":40,"op_send_bytes":11562,"op_resend":33,"op_reply":40,"op_latency":{"avgcount":40,"sum":0.300993221,"avgtime":0.007524830},"op_inflight":0,"oplen_avg":{"avgcount":40,"sum":62},"op":40,"op_r":0,"op_w":40,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2024-04-25T15:47:22.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 40, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 40, "avgtime": 0.00752483, "sum": 0.300993221 }, "op_pg": 0, "op_r": 0, "op_reply": 40, "op_resend": 33, "op_rmw": 0, "op_send": 40, "op_send_bytes": 11562, "op_w": 40, "oplen_avg": { "avgcount": 40, "sum": 62 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-04-25T15:47:22.574 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-04-25T15:47:27.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2024-04-25T15:47:27.709 INFO:teuthology.orchestra.run.smithi080.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":15209,"op_resend":33,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.307993064,"avgtime":0.006999842},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":4,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":19,"omap_rd":0,"omap_del":1}} 2024-04-25T15:47:27.710 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 19, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.006999842, "sum": 0.307993064 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 33, "op_rmw": 0, "op_send": 44, "op_send_bytes": 15209, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-04-25T15:47:27.710 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-04-25T15:47:27.710 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:27.710 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:27.726 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:27.726 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:27.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:27.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.927+0000 7fe08b8bd640 1 Processor -- start 2024-04-25T15:47:27.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.927+0000 7fe08b8bd640 1 -- start start 2024-04-25T15:47:27.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe08b8bd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe0840d1170 0x7fe0840b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe08b8bd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 0x7fe08415fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe08b8bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0840d49c0 con 0x7fe0840d45b0 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe08b8bd640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe0840d4c40 con 0x7fe0840d1170 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe08b8bd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe0840d4f20 con 0x7fe08415fa00 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe089659640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0840d45b0 0x7fe0840d0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37268/0 (socket says 172.21.15.80:37268) 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.928+0000 7fe089659640 1 -- 172.21.15.80:0/3575579498 learned_addr learned my addr 172.21.15.80:0/3575579498 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe088e58640 1 --2- 172.21.15.80:0/3575579498 >> v2:172.21.15.195:3300/0 conn(0x7fe0840d1170 0x7fe0840b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235473661 0 0) 0x7fe080001110 con 0x7fe0840d45b0 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe070003520 con 0x7fe0840d45b0 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089e5a640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 0x7fe08415fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3180797194 0 0) 0x7fe070003520 con 0x7fe0840d45b0 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 msgr2=0x7fe08415fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 0x7fe08415fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:27.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 >> v2:172.21.15.195:3300/0 conn(0x7fe0840d1170 msgr2=0x7fe0840b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 --2- 172.21.15.80:0/3575579498 >> v2:172.21.15.195:3300/0 conn(0x7fe0840d1170 0x7fe0840b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840d5200 con 0x7fe0840d45b0 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe080001840 con 0x7fe0840d45b0 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 >> v1:172.21.15.80:6789/0 conn(0x7fe0840d45b0 legacy=0x7fe0840d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0700039b0 0x7fe070003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 0x7fe070004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe070004d40 0x7fe070005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe0840d4c40 con 0x7fe070004d40 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0840d4f20 con 0x7fe0700039b0 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe07000ba40 con 0x7fe08415fa00 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089e5a640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe070004d40 0x7fe070005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089659640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0700039b0 0x7fe070003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe088e58640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 0x7fe070004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089e5a640 1 -- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 msgr2=0x7fe070004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089e5a640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe08415fa00 0x7fe070004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089e5a640 1 -- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0700039b0 msgr2=0x7fe070003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.929+0000 7fe089e5a640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0700039b0 0x7fe070003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.930+0000 7fe089e5a640 1 -- 172.21.15.80:0/3575579498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe070003520 con 0x7fe070004d40 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.930+0000 7fe089e5a640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe070004d40 0x7fe070005150 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe0840cce30 tx=0x7fe070005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff66df8378410e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.930+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c009c10 con 0x7fe070004d40 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.930+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c036070 con 0x7fe070004d40 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.930+0000 7fe07bfff640 1 -- 172.21.15.80:0/3575579498 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0317f0 con 0x7fe070004d40 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe08b8bd640 1 -- 172.21.15.80:0/3575579498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe070004d40 msgr2=0x7fe070005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/3575579498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe070004d40 0x7fe070005150 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe0840cce30 tx=0x7fe070005830 comp rx=0 tx=0).stop 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe089e5a640 1 -- 172.21.15.80:0/3575579498 reap_dead start 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe08b8bd640 1 -- 172.21.15.80:0/3575579498 shutdown_connections 2024-04-25T15:47:27.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe08b8bd640 1 -- 172.21.15.80:0/3575579498 >> 172.21.15.80:0/3575579498 conn(0x7fe0840d2e60 msgr2=0x7fe0840d5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:27.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe08b8bd640 1 -- 172.21.15.80:0/3575579498 shutdown_connections 2024-04-25T15:47:27.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.931+0000 7fe08b8bd640 1 -- 172.21.15.80:0/3575579498 wait complete. 2024-04-25T15:47:27.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.933+0000 7fe08b8bd640 1 Processor -- start 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.933+0000 7fe08b8bd640 1 -- start start 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe08b8bd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe070004d40 0x7fe084159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe08b8bd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0840d0b40 0x7fe0840d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe08b8bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 0x7fe08415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe08b8bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe08415fe10 con 0x7fe08415b5a0 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe08b8bd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe0840d18c0 con 0x7fe0840d0b40 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe08b8bd640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe08415ff90 con 0x7fe070004d40 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe089e5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 0x7fe08415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe089e5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 0x7fe08415b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49994/0 (socket says 172.21.15.80:49994) 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe089e5a640 1 -- 172.21.15.80:0/2858317730 learned_addr learned my addr 172.21.15.80:0/2858317730 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe089659640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe070004d40 0x7fe084159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.934+0000 7fe088e58640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0840d0b40 0x7fe0840d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe089e5a640 1 -- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe070004d40 msgr2=0x7fe084159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:27.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe089e5a640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe070004d40 0x7fe084159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe089e5a640 1 -- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0840d0b40 msgr2=0x7fe0840d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe089e5a640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0840d0b40 0x7fe0840d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe089e5a640 1 -- 172.21.15.80:0/2858317730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0841596b0 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe089e5a640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 0x7fe08415b9b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00e230 tx=0x7fe07c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c009c10 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c045430 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe084159bc0 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c045820 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.935+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08415a180 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.936+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe084159930 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.937+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe07c005d10 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.937+0000 7fe079ffb640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0680744e0 0x7fe0680769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.937+0000 7fe089659640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0680744e0 0x7fe0680769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.938+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fe07c0b63d0 con 0x7fe08415b5a0 2024-04-25T15:47:27.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.938+0000 7fe089659640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0680744e0 0x7fe0680769f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe080000fb0 tx=0x7fe080009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:27.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:27.942+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe07c080920 con 0x7fe08415b5a0 2024-04-25T15:47:28.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.120+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe084050740 con 0x7fe08415b5a0 2024-04-25T15:47:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.121+0000 7fe079ffb640 1 -- 172.21.15.80:0/2858317730 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17123 (secure 0 0 0) 0x7fe07c080220 con 0x7fe08415b5a0 2024-04-25T15:47:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:28.122 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:47:11.149672+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6834/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.195:6832/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.80:6836/3726019359":"2024-04-26T15:47:10.413739+0000","172.21.15.80:6834/3726019359":"2024-04-26T15:47:10.413739+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0680744e0 msgr2=0x7fe0680769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0680744e0 0x7fe0680769f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe080000fb0 tx=0x7fe080009040 comp rx=0 tx=0).stop 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 msgr2=0x7fe08415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 0x7fe08415b9b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00e230 tx=0x7fe07c009750 comp rx=0 tx=0).stop 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 shutdown_connections 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe0680744e0 0x7fe0680769f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe08415b5a0 0x7fe08415b9b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0840d0b40 0x7fe0840d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 --2- 172.21.15.80:0/2858317730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe070004d40 0x7fe084159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 >> 172.21.15.80:0/2858317730 conn(0x7fe0840d2e60 msgr2=0x7fe08415f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 shutdown_connections 2024-04-25T15:47:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.123+0000 7fe08b8bd640 1 -- 172.21.15.80:0/2858317730 wait complete. 2024-04-25T15:47:28.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:52.572368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:53.267030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:47:28.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:47:28.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.245+0000 7f1c17434640 1 Processor -- start 2024-04-25T15:47:28.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.245+0000 7f1c17434640 1 -- start start 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.246+0000 7f1c17434640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c100b4800 0x7f1c100d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.246+0000 7f1c17434640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c100d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.246+0000 7f1c17434640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c100d4920 con 0x7f1c100b4d50 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.246+0000 7f1c17434640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1c100d4c00 con 0x7f1c100b4800 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.246+0000 7f1c17434640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c100d4ee0 con 0x7f1c10160350 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c100b4800 0x7f1c100d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c100b4800 0x7f1c100d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50004/0 (socket says 172.21.15.80:50004) 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 -- 172.21.15.80:0/879896259 learned_addr learned my addr 172.21.15.80:0/879896259 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c149cf640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c100d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 -- 172.21.15.80:0/879896259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 msgr2=0x7f1c100d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c100d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 -- 172.21.15.80:0/879896259 >> v1:172.21.15.195:6789/0 conn(0x7f1c100b4d50 legacy=0x7f1c10163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:28.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c151d0640 1 -- 172.21.15.80:0/879896259 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c100d51c0 con 0x7f1c100b4800 2024-04-25T15:47:28.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.247+0000 7f1c149cf640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c100d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:28.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c151d0640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4800 0x7f1c100d0950 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009870 tx=0x7f1c0c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48317a2fafd4f0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c07fff640 1 -- 172.21.15.80:0/879896259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c037070 con 0x7f1c100b4800 2024-04-25T15:47:28.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c07fff640 1 -- 172.21.15.80:0/879896259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0c02ae10 con 0x7f1c100b4800 2024-04-25T15:47:28.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c07fff640 1 -- 172.21.15.80:0/879896259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032660 con 0x7f1c100b4800 2024-04-25T15:47:28.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c17434640 1 -- 172.21.15.80:0/879896259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4800 msgr2=0x7f1c100d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c17434640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4800 0x7f1c100d0950 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009870 tx=0x7f1c0c02a100 comp rx=0 tx=0).stop 2024-04-25T15:47:28.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c17434640 1 -- 172.21.15.80:0/879896259 shutdown_connections 2024-04-25T15:47:28.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c17434640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c100d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c17434640 1 --2- 172.21.15.80:0/879896259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4800 0x7f1c100d0950 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.248+0000 7f1c17434640 1 -- 172.21.15.80:0/879896259 >> 172.21.15.80:0/879896259 conn(0x7f1c100d2ab0 msgr2=0x7f1c100d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:28.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.249+0000 7f1c17434640 1 -- 172.21.15.80:0/879896259 shutdown_connections 2024-04-25T15:47:28.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.249+0000 7f1c17434640 1 -- 172.21.15.80:0/879896259 wait complete. 2024-04-25T15:47:28.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.250+0000 7f1c17434640 1 Processor -- start 2024-04-25T15:47:28.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.250+0000 7f1c17434640 1 -- start start 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c100b4800 0x7f1c10154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 0x7f1c100cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c10160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1006d830 con 0x7f1c100b4d50 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1006d6b0 con 0x7f1c100b4800 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1006d9b0 con 0x7f1c10160350 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 0x7f1c100cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 0x7f1c100cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50018/0 (socket says 172.21.15.80:50018) 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 -- 172.21.15.80:0/4226765073 learned_addr learned my addr 172.21.15.80:0/4226765073 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:28.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c151d0640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c100b4800 0x7f1c10154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c159d1640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c10160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 -- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 msgr2=0x7f1c10160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c10160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 -- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c100b4800 msgr2=0x7f1c10154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c100b4800 0x7f1c10154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 -- 172.21.15.80:0/4226765073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1015adc0 con 0x7f1c100b4d50 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c159d1640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c10160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c149cf640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 0x7f1c100cf520 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c7f0 tx=0x7f1c0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00015070 con 0x7f1c100b4d50 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00007820 con 0x7f1c100b4d50 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1015b0a0 con 0x7f1c100b4d50 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.252+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00007bd0 con 0x7f1c100b4d50 2024-04-25T15:47:28.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.253+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c10161200 con 0x7f1c100b4d50 2024-04-25T15:47:28.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.254+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c10050740 con 0x7f1c100b4d50 2024-04-25T15:47:28.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.254+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c00018070 con 0x7f1c100b4d50 2024-04-25T15:47:28.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.254+0000 7f1c05ffb640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bf40744e0 0x7f1bf40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.255+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f1c00095530 con 0x7f1c100b4d50 2024-04-25T15:47:28.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.255+0000 7f1c151d0640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bf40744e0 0x7f1bf40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.255+0000 7f1c151d0640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bf40744e0 0x7f1bf40769f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c034000 tx=0x7f1c0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.259+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c0005fb10 con 0x7f1c100b4d50 2024-04-25T15:47:28.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.433+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c100cfae0 con 0x7f1c100b4d50 2024-04-25T15:47:28.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.434+0000 7f1c05ffb640 1 -- 172.21.15.80:0/4226765073 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7f1c0005f410 con 0x7f1c100b4d50 2024-04-25T15:47:28.435 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:47:28.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bf40744e0 msgr2=0x7f1bf40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bf40744e0 0x7f1bf40769f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c034000 tx=0x7f1c0c02e000 comp rx=0 tx=0).stop 2024-04-25T15:47:28.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 msgr2=0x7f1c100cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 0x7f1c100cf520 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000c7f0 tx=0x7f1c0000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 shutdown_connections 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1bf40744e0 0x7f1bf40769f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1c10160350 0x7f1c10160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c100b4d50 0x7f1c100cf520 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 --2- 172.21.15.80:0/4226765073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c100b4800 0x7f1c10154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 >> 172.21.15.80:0/4226765073 conn(0x7f1c100d2ab0 msgr2=0x7f1c100b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 shutdown_connections 2024-04-25T15:47:28.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.436+0000 7f1c17434640 1 -- 172.21.15.80:0/4226765073 wait complete. 2024-04-25T15:47:28.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:47:28.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.557+0000 7fe69cb6c640 1 Processor -- start 2024-04-25T15:47:28.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.557+0000 7fe69cb6c640 1 -- start start 2024-04-25T15:47:28.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.558+0000 7fe69cb6c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe6980cf650 0x7fe69806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.558+0000 7fe69cb6c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe698163dd0 con 0x7fe69815aa60 2024-04-25T15:47:28.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.558+0000 7fe69cb6c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe698164070 con 0x7fe6980d0240 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.558+0000 7fe69cb6c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe6980cfa60 con 0x7fe6980cf650 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.558+0000 7fe69659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe69815aa60 0x7fe698161160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37274/0 (socket says 172.21.15.80:37274) 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.558+0000 7fe69659c640 1 -- 172.21.15.80:0/443843167 learned_addr learned my addr 172.21.15.80:0/443843167 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788638018 0 0) 0x7fe698163dd0 con 0x7fe69815aa60 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe696d9d640 1 --2- 172.21.15.80:0/443843167 >> v2:172.21.15.195:3300/0 conn(0x7fe6980cf650 0x7fe69806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe684003520 con 0x7fe69815aa60 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 319332548 0 0) 0x7fe684003520 con 0x7fe69815aa60 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 >> v2:172.21.15.195:3300/0 conn(0x7fe6980cf650 msgr2=0x7fe69806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 --2- 172.21.15.80:0/443843167 >> v2:172.21.15.195:3300/0 conn(0x7fe6980cf650 0x7fe69806ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 >> v1:172.21.15.195:6789/0 conn(0x7fe6980d0240 legacy=0x7fe6980d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe698164350 con 0x7fe69815aa60 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe688001670 con 0x7fe69815aa60 2024-04-25T15:47:28.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 >> v1:172.21.15.80:6789/0 conn(0x7fe69815aa60 legacy=0x7fe698161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6840039b0 0x7fe684003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe684004800 0x7fe684004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6840051c0 0x7fe68400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6980cfa60 con 0x7fe6840051c0 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe68400c160 con 0x7fe684004800 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe68400c360 con 0x7fe6840039b0 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe696d9d640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6840051c0 0x7fe68400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe68ffff640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe684004800 0x7fe684004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.559+0000 7fe69659c640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6840039b0 0x7fe684003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 -- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6840039b0 msgr2=0x7fe684003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6840039b0 0x7fe684003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 -- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe684004800 msgr2=0x7fe684004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe684004800 0x7fe684004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 -- 172.21.15.80:0/443843167 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe684003520 con 0x7fe6840051c0 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 -- 172.21.15.80:0/443843167 reap_dead start 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe696d9d640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6840051c0 0x7fe68400b9c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe690009fc0 tx=0x7fe684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878b141a597f7417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690009c10 con 0x7fe6840051c0 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe690003bd0 con 0x7fe6840051c0 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.560+0000 7fe695d9b640 1 -- 172.21.15.80:0/443843167 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690004020 con 0x7fe6840051c0 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 -- 172.21.15.80:0/443843167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6840051c0 msgr2=0x7fe68400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6840051c0 0x7fe68400b9c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe690009fc0 tx=0x7fe684005830 comp rx=0 tx=0).stop 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 -- 172.21.15.80:0/443843167 shutdown_connections 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/443843167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6840051c0 0x7fe68400b9c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 -- 172.21.15.80:0/443843167 >> 172.21.15.80:0/443843167 conn(0x7fe698071580 msgr2=0x7fe698071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 -- 172.21.15.80:0/443843167 shutdown_connections 2024-04-25T15:47:28.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.561+0000 7fe69cb6c640 1 -- 172.21.15.80:0/443843167 wait complete. 2024-04-25T15:47:28.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.563+0000 7fe69cb6c640 1 Processor -- start 2024-04-25T15:47:28.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.563+0000 7fe69cb6c640 1 -- start start 2024-04-25T15:47:28.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe69cb6c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6840051c0 0x7fe6981f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe69cb6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 0x7fe6980b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe69cb6c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6980b85b0 0x7fe69815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe69cb6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe698164bf0 con 0x7fe6981fa160 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe69cb6c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe698164910 con 0x7fe6840051c0 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe69cb6c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe6980b2d70 con 0x7fe6980b85b0 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe68ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 0x7fe6980b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe68ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 0x7fe6980b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50034/0 (socket says 172.21.15.80:50034) 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.564+0000 7fe68ffff640 1 -- 172.21.15.80:0/3997161997 learned_addr learned my addr 172.21.15.80:0/3997161997 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe696d9d640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6980b85b0 0x7fe69815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe69659c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6840051c0 0x7fe6981f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68ffff640 1 -- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6980b85b0 msgr2=0x7fe69815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68ffff640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6980b85b0 0x7fe69815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68ffff640 1 -- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6840051c0 msgr2=0x7fe6981f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68ffff640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6840051c0 0x7fe6981f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68ffff640 1 -- 172.21.15.80:0/3997161997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6981fa570 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68ffff640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 0x7fe6980b8070 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe68000f620 tx=0x7fe68000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6800052e0 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680018070 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6980aec30 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680003810 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.565+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6980af1f0 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.566+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe698050740 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.567+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe6800039b0 con 0x7fe6981fa160 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.567+0000 7fe68effd640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6780744e0 0x7fe6780769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.567+0000 7fe69659c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6780744e0 0x7fe6780769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.568+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fe680095190 con 0x7fe6981fa160 2024-04-25T15:47:28.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.568+0000 7fe69659c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6780744e0 0x7fe6780769f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe688001050 tx=0x7fe688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.572+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6981fa570 con 0x7fe6981fa160 2024-04-25T15:47:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.745+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe69806e5b0 con 0x7fe6981fa160 2024-04-25T15:47:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.746+0000 7fe68effd640 1 -- 172.21.15.80:0/3997161997 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7fe68005f6e0 con 0x7fe6981fa160 2024-04-25T15:47:28.747 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:47:28.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6780744e0 msgr2=0x7fe6780769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6780744e0 0x7fe6780769f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe688001050 tx=0x7fe688009040 comp rx=0 tx=0).stop 2024-04-25T15:47:28.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 msgr2=0x7fe6980b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 0x7fe6980b8070 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe68000f620 tx=0x7fe68000fae0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 shutdown_connections 2024-04-25T15:47:28.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe6780744e0 0x7fe6780769f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6980b85b0 0x7fe69815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6981fa160 0x7fe6980b8070 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 --2- 172.21.15.80:0/3997161997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6840051c0 0x7fe6981f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 >> 172.21.15.80:0/3997161997 conn(0x7fe698071580 msgr2=0x7fe6980ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 shutdown_connections 2024-04-25T15:47:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.748+0000 7fe69cb6c640 1 -- 172.21.15.80:0/3997161997 wait complete. 2024-04-25T15:47:28.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:47:28.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.869+0000 7f511af46640 1 Processor -- start 2024-04-25T15:47:28.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.869+0000 7f511af46640 1 -- start start 2024-04-25T15:47:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f511af46640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511406c5c0 0x7f511406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f511af46640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5114163e70 0x7f51140b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f511af46640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51140b5190 con 0x7f51140d0a70 2024-04-25T15:47:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f511af46640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f511406ca80 con 0x7f511406c5c0 2024-04-25T15:47:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f511af46640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f511406cd60 con 0x7f5114163e70 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f5118ce2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511406c5c0 0x7f511406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f5118ce2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511406c5c0 0x7f511406db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50048/0 (socket says 172.21.15.80:50048) 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f5118ce2640 1 -- 172.21.15.80:0/1888082801 learned_addr learned my addr 172.21.15.80:0/1888082801 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.870+0000 7f5113fff640 1 --2- 172.21.15.80:0/1888082801 >> v2:172.21.15.195:3300/0 conn(0x7f5114163e70 0x7f51140b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.871+0000 7f5118ce2640 1 -- 172.21.15.80:0/1888082801 >> v2:172.21.15.195:3300/0 conn(0x7f5114163e70 msgr2=0x7f51140b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.871+0000 7f5118ce2640 1 --2- 172.21.15.80:0/1888082801 >> v2:172.21.15.195:3300/0 conn(0x7f5114163e70 0x7f51140b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.871+0000 7f5118ce2640 1 -- 172.21.15.80:0/1888082801 >> v1:172.21.15.195:6789/0 conn(0x7f51140d0a70 legacy=0x7f51140d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.871+0000 7f5118ce2640 1 -- 172.21.15.80:0/1888082801 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511406d040 con 0x7f511406c5c0 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.871+0000 7f5118ce2640 1 --2- 172.21.15.80:0/1888082801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511406c5c0 0x7f511406db20 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f51140d2de0 tx=0x7f510802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7e6e85cf1bd9cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.871+0000 7f51137fe640 1 -- 172.21.15.80:0/1888082801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108037070 con 0x7f511406c5c0 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f51137fe640 1 -- 172.21.15.80:0/1888082801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5108032440 con 0x7f511406c5c0 2024-04-25T15:47:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f51137fe640 1 -- 172.21.15.80:0/1888082801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108032810 con 0x7f511406c5c0 2024-04-25T15:47:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 -- 172.21.15.80:0/1888082801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511406c5c0 msgr2=0x7f511406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 --2- 172.21.15.80:0/1888082801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511406c5c0 0x7f511406db20 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f51140d2de0 tx=0x7f510802a270 comp rx=0 tx=0).stop 2024-04-25T15:47:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 -- 172.21.15.80:0/1888082801 shutdown_connections 2024-04-25T15:47:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 --2- 172.21.15.80:0/1888082801 >> v2:172.21.15.195:3300/0 conn(0x7f5114163e70 0x7f51140b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 --2- 172.21.15.80:0/1888082801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511406c5c0 0x7f511406db20 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 -- 172.21.15.80:0/1888082801 >> 172.21.15.80:0/1888082801 conn(0x7f51140d6620 msgr2=0x7f51140d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 -- 172.21.15.80:0/1888082801 shutdown_connections 2024-04-25T15:47:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.872+0000 7f511af46640 1 -- 172.21.15.80:0/1888082801 wait complete. 2024-04-25T15:47:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.874+0000 7f511af46640 1 Processor -- start 2024-04-25T15:47:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.874+0000 7f511af46640 1 -- start start 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.875+0000 7f511af46640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 0x7f51141549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.875+0000 7f511af46640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5114163e70 0x7f5114161f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.875+0000 7f511af46640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51141598e0 0x7f51141624a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.875+0000 7f511af46640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f51140d1590 con 0x7f51140d0a70 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.875+0000 7f511af46640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f511406d600 con 0x7f51141598e0 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.875+0000 7f511af46640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f51140d1710 con 0x7f5114163e70 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 0x7f51141549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 0x7f51141549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50052/0 (socket says 172.21.15.80:50052) 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 -- 172.21.15.80:0/1341001722 learned_addr learned my addr 172.21.15.80:0/1341001722 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f51194e3640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51141598e0 0x7f51141624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5113fff640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5114163e70 0x7f5114161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 -- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5114163e70 msgr2=0x7f5114161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5114163e70 0x7f5114161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 -- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51141598e0 msgr2=0x7f51141624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51141598e0 0x7f51141624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 -- 172.21.15.80:0/1341001722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5114154ef0 con 0x7f51140d0a70 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f51194e3640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51141598e0 0x7f51141624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f5118ce2640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 0x7f51141549b0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5108000c00 tx=0x7f51080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108041020 con 0x7f51140d0a70 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51080306c0 con 0x7f51140d0a70 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51141587b0 con 0x7f51140d0a70 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108037040 con 0x7f51140d0a70 2024-04-25T15:47:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.876+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5114156770 con 0x7f51140d0a70 2024-04-25T15:47:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.877+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5114050740 con 0x7f51140d0a70 2024-04-25T15:47:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.878+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5108044020 con 0x7f51140d0a70 2024-04-25T15:47:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.878+0000 7f51117fa640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50f80744e0 0x7f50f80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.878+0000 7f5113fff640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50f80744e0 0x7f50f80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.879+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f51080b5c10 con 0x7f51140d0a70 2024-04-25T15:47:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.879+0000 7f5113fff640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50f80744e0 0x7f50f80769f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5100006fd0 tx=0x7f5100008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:28.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:28.883+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f510804b030 con 0x7f51140d0a70 2024-04-25T15:47:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.058+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f51140b93d0 con 0x7f51140d0a70 2024-04-25T15:47:29.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.058+0000 7f51117fa640 1 -- 172.21.15.80:0/1341001722 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7f5108080160 con 0x7f51140d0a70 2024-04-25T15:47:29.059 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:47:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50f80744e0 msgr2=0x7f50f80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50f80744e0 0x7f50f80769f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5100006fd0 tx=0x7f5100008040 comp rx=0 tx=0).stop 2024-04-25T15:47:29.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 msgr2=0x7f51141549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 0x7f51141549b0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5108000c00 tx=0x7f51080046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 shutdown_connections 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f50f80744e0 0x7f50f80769f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51141598e0 0x7f51141624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5114163e70 0x7f5114161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 --2- 172.21.15.80:0/1341001722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51140d0a70 0x7f51141549b0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 >> 172.21.15.80:0/1341001722 conn(0x7f51140d6620 msgr2=0x7f51140b9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 shutdown_connections 2024-04-25T15:47:29.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.060+0000 7f511af46640 1 -- 172.21.15.80:0/1341001722 wait complete. 2024-04-25T15:47:29.073 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:47:29.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.180+0000 7f7288a96640 1 Processor -- start 2024-04-25T15:47:29.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.180+0000 7f7288a96640 1 -- start start 2024-04-25T15:47:29.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7288a96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72840cfe20 0x7f7284160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7288a96640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7284161590 con 0x7f7284160ad0 2024-04-25T15:47:29.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7288a96640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7284161870 con 0x7f728415d150 2024-04-25T15:47:29.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7288a96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72840d37b0 con 0x7f72840cfe20 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7281d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7284160ad0 0x7f72840cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37278/0 (socket says 172.21.15.80:37278) 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7281d9b640 1 -- 172.21.15.80:0/1462532004 learned_addr learned my addr 172.21.15.80:0/1462532004 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72840cfe20 0x7f7284160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013346530 0 0) 0x7f7284161590 con 0x7f7284160ad0 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f726c003520 con 0x7f7284160ad0 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2979658962 0 0) 0x7f726c003520 con 0x7f7284160ad0 2024-04-25T15:47:29.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72840cfe20 msgr2=0x7f7284160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72840cfe20 0x7f7284160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 >> v1:172.21.15.195:6789/0 conn(0x7f728415d150 legacy=0x7f72840d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72840d28a0 con 0x7f7284160ad0 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.182+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f72780019f0 con 0x7f7284160ad0 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 >> v1:172.21.15.80:6789/0 conn(0x7f7284160ad0 legacy=0x7f72840cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f726c0039e0 0x7f726c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c004800 0x7f726c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726c005150 0x7f726c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f726c00bf00 con 0x7f726c005150 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f726c00c080 con 0x7f726c0039e0 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f726c00c280 con 0x7f726c004800 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726c005150 0x7f726c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f728259c640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f726c0039e0 0x7f726c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7281d9b640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c004800 0x7f726c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7282d9d640 1 -- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c004800 msgr2=0x7f726c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c004800 0x7f726c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7282d9d640 1 -- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f726c0039e0 msgr2=0x7f726c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f726c0039e0 0x7f726c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.183+0000 7f7282d9d640 1 -- 172.21.15.80:0/1462532004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c003520 con 0x7f726c005150 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.184+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726c005150 0x7f726c00b9c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f72840d2450 tx=0x7f726c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9de9a9ea37be167 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.184+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274036070 con 0x7f726c005150 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.184+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274031400 con 0x7f726c005150 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.184+0000 7f728159a640 1 -- 172.21.15.80:0/1462532004 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274009690 con 0x7f726c005150 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.184+0000 7f7288a96640 1 -- 172.21.15.80:0/1462532004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726c005150 msgr2=0x7f726c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.184+0000 7f7288a96640 1 --2- 172.21.15.80:0/1462532004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726c005150 0x7f726c00b9c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f72840d2450 tx=0x7f726c005830 comp rx=0 tx=0).stop 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.185+0000 7f7282d9d640 1 -- 172.21.15.80:0/1462532004 reap_dead start 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.185+0000 7f7288a96640 1 -- 172.21.15.80:0/1462532004 shutdown_connections 2024-04-25T15:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.185+0000 7f7288a96640 1 -- 172.21.15.80:0/1462532004 >> 172.21.15.80:0/1462532004 conn(0x7f728409b600 msgr2=0x7f728409ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.185+0000 7f7288a96640 1 -- 172.21.15.80:0/1462532004 shutdown_connections 2024-04-25T15:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.185+0000 7f7288a96640 1 -- 172.21.15.80:0/1462532004 wait complete. 2024-04-25T15:47:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.187+0000 7f7288a96640 1 Processor -- start 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.187+0000 7f7288a96640 1 -- start start 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7288a96640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c005150 0x7f7284150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7288a96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72840b1bd0 0x7f7284158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7288a96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 0x7f7284140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7288a96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72840cfe20 con 0x7f7284140bd0 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7288a96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f72840d2c10 con 0x7f72840b1bd0 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7288a96640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72840cffa0 con 0x7f726c005150 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 0x7f7284140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 0x7f7284140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50076/0 (socket says 172.21.15.80:50076) 2024-04-25T15:47:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 -- 172.21.15.80:0/1270788449 learned_addr learned my addr 172.21.15.80:0/1270788449 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f728259c640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c005150 0x7f7284150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7281d9b640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72840b1bd0 0x7f7284158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 -- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c005150 msgr2=0x7f7284150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c005150 0x7f7284150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 -- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72840b1bd0 msgr2=0x7f7284158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72840b1bd0 0x7f7284158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7282d9d640 1 -- 172.21.15.80:0/1270788449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7284158eb0 con 0x7f7284140bd0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f728259c640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c005150 0x7f7284150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.188+0000 7f7281d9b640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72840b1bd0 0x7f7284158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.189+0000 7f7282d9d640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 0x7f7284140fe0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7274009b80 tx=0x7f7274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.189+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274036040 con 0x7f7284140bd0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.189+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274041070 con 0x7f7284140bd0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.189+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728415b7d0 con 0x7f7284140bd0 2024-04-25T15:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.189+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274009690 con 0x7f7284140bd0 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.189+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72840b13d0 con 0x7f7284140bd0 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.190+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72840b11c0 con 0x7f7284140bd0 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.191+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7274004270 con 0x7f7284140bd0 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.191+0000 7f7272ffd640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72640744b0 0x7f72640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.191+0000 7f728259c640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72640744b0 0x7f72640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.191+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f72740b5320 con 0x7f7284140bd0 2024-04-25T15:47:29.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.192+0000 7f728259c640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72640744b0 0x7f72640769c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f72840b3840 tx=0x7f727c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.196+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f727404b020 con 0x7f7284140bd0 2024-04-25T15:47:29.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.387+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7284050740 con 0x7f7284140bd0 2024-04-25T15:47:29.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.387+0000 7f7272ffd640 1 -- 172.21.15.80:0/1270788449 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v103) ==== 80+0+246 (secure 0 0 0) 0x7f727407f870 con 0x7f7284140bd0 2024-04-25T15:47:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.195:6834/2812835007 2024-04-26T15:47:11.149648+0000 2024-04-25T15:47:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.195:6832/2812835007 2024-04-26T15:47:11.149648+0000 2024-04-25T15:47:29.388 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6836/3726019359 2024-04-26T15:47:10.413739+0000 2024-04-25T15:47:29.389 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6834/3726019359 2024-04-26T15:47:10.413739+0000 2024-04-25T15:47:29.389 INFO:teuthology.orchestra.run.smithi080.stderr:listed 4 entries 2024-04-25T15:47:29.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72640744b0 msgr2=0x7f72640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72640744b0 0x7f72640769c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f72840b3840 tx=0x7f727c009040 comp rx=0 tx=0).stop 2024-04-25T15:47:29.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 msgr2=0x7f7284140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 0x7f7284140fe0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7274009b80 tx=0x7f7274004730 comp rx=0 tx=0).stop 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 shutdown_connections 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f72640744b0 0x7f72640769c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7284140bd0 0x7f7284140fe0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72840b1bd0 0x7f7284158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 --2- 172.21.15.80:0/1270788449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f726c005150 0x7f7284150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 >> 172.21.15.80:0/1270788449 conn(0x7f728409b600 msgr2=0x7f728406e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 shutdown_connections 2024-04-25T15:47:29.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.389+0000 7f7288a96640 1 -- 172.21.15.80:0/1270788449 wait complete. 2024-04-25T15:47:29.402 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T15:47:29.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:29.402 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:29.446 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:47:29.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:29.446 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T15:47:29.476 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:29.476 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:29.494 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:29.494 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:29.550 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:29.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.656+0000 7fd383b14640 1 Processor -- start 2024-04-25T15:47:29.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.657+0000 7fd383b14640 1 -- start start 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd383b14640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd37c0b5cc0 0x7fd37c1603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd383b14640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c06f570 con 0x7fd37c0ce6d0 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd383b14640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c06f850 con 0x7fd37c164b40 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd383b14640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd37c0d1700 con 0x7fd37c0b5cc0 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd3818b0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd37c0ce6d0 0x7fd37c06ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37286/0 (socket says 172.21.15.80:37286) 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd3818b0640 1 -- 172.21.15.80:0/754922724 learned_addr learned my addr 172.21.15.80:0/754922724 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd3820b1640 1 --2- 172.21.15.80:0/754922724 >> v2:172.21.15.195:3300/0 conn(0x7fd37c0b5cc0 0x7fd37c1603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723900547 0 0) 0x7fd37c06f570 con 0x7fd37c0ce6d0 2024-04-25T15:47:29.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.658+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd368003520 con 0x7fd37c0ce6d0 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 195115135 0 0) 0x7fd368003520 con 0x7fd37c0ce6d0 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 >> v2:172.21.15.195:3300/0 conn(0x7fd37c0b5cc0 msgr2=0x7fd37c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 --2- 172.21.15.80:0/754922724 >> v2:172.21.15.195:3300/0 conn(0x7fd37c0b5cc0 0x7fd37c1603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 >> v1:172.21.15.195:6789/0 conn(0x7fd37c164b40 legacy=0x7fd37c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c06fb30 con 0x7fd37c0ce6d0 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fd3780019f0 con 0x7fd37c0ce6d0 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 >> v1:172.21.15.80:6789/0 conn(0x7fd37c0ce6d0 legacy=0x7fd37c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd368005250 0x7fd36800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd36800c1b0 con 0x7fd3680039b0 2024-04-25T15:47:29.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd36800c360 con 0x7fd368005250 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd36800c560 con 0x7fd368004800 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3818b0640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3820b1640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd368005250 0x7fd36800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3810af640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3818b0640 1 -- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd368004800 msgr2=0x7fd368004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3818b0640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3818b0640 1 -- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd368005250 msgr2=0x7fd36800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3818b0640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd368005250 0x7fd36800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3818b0640 1 -- 172.21.15.80:0/754922724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368003520 con 0x7fd3680039b0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.659+0000 7fd3820b1640 1 -- 172.21.15.80:0/754922724 reap_dead start 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.660+0000 7fd3818b0640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd37c074130 tx=0x7fd368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0b2c0508c2ac6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.660+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37800a480 con 0x7fd3680039b0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.660+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37802f070 con 0x7fd3680039b0 2024-04-25T15:47:29.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.660+0000 7fd3808ae640 1 -- 172.21.15.80:0/754922724 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37802bc80 con 0x7fd3680039b0 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 -- 172.21.15.80:0/754922724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3680039b0 msgr2=0x7fd368003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd37c074130 tx=0x7fd368005830 comp rx=0 tx=0).stop 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 -- 172.21.15.80:0/754922724 shutdown_connections 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 --2- 172.21.15.80:0/754922724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 -- 172.21.15.80:0/754922724 >> 172.21.15.80:0/754922724 conn(0x7fd37c0d0790 msgr2=0x7fd37c0d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 -- 172.21.15.80:0/754922724 shutdown_connections 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.661+0000 7fd383b14640 1 -- 172.21.15.80:0/754922724 wait complete. 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.662+0000 7fd383b14640 1 Processor -- start 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.662+0000 7fd383b14640 1 -- start start 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3680039b0 0x7fd37c1f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 0x7fd37c1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd37c0cd780 0x7fd37c152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c160530 con 0x7fd37c1512b0 2024-04-25T15:47:29.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c1603b0 con 0x7fd37c0cd780 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c1606b0 con 0x7fd3680039b0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 0x7fd37c1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 0x7fd37c1613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50094/0 (socket says 172.21.15.80:50094) 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 -- 172.21.15.80:0/3316399644 learned_addr learned my addr 172.21.15.80:0/3316399644 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3818b0640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3680039b0 0x7fd37c1f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3820b1640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd37c0cd780 0x7fd37c152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 -- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3680039b0 msgr2=0x7fd37c1f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3680039b0 0x7fd37c1f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 -- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd37c0cd780 msgr2=0x7fd37c152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd37c0cd780 0x7fd37c152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 -- 172.21.15.80:0/3316399644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c0b6860 con 0x7fd37c1512b0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3810af640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 0x7fd37c1613c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00e410 tx=0x7fd36c00e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c019070 con 0x7fd37c1512b0 2024-04-25T15:47:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c0052e0 con 0x7fd37c1512b0 2024-04-25T15:47:29.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c003810 con 0x7fd37c1512b0 2024-04-25T15:47:29.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.664+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c0b6b40 con 0x7fd37c1512b0 2024-04-25T15:47:29.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.665+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c0b7100 con 0x7fd37c1512b0 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.666+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37c050740 con 0x7fd37c1512b0 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.666+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd36c01c070 con 0x7fd37c1512b0 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.667+0000 7fd3727fc640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3600744e0 0x7fd3600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.667+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fd36c094870 con 0x7fd37c1512b0 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.667+0000 7fd3818b0640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3600744e0 0x7fd3600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.667+0000 7fd3818b0640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3600744e0 0x7fd3600769f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd378033000 tx=0x7fd378009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.671+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd36c05e770 con 0x7fd37c1512b0 2024-04-25T15:47:29.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.847+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd37c0b52f0 con 0x7fd37c1512b0 2024-04-25T15:47:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.848+0000 7fd3727fc640 1 -- 172.21.15.80:0/3316399644 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17123 (secure 0 0 0) 0x7fd36c062a70 con 0x7fd37c1512b0 2024-04-25T15:47:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:29.850 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:47:11.149672+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6834/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.195:6832/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.80:6836/3726019359":"2024-04-26T15:47:10.413739+0000","172.21.15.80:6834/3726019359":"2024-04-26T15:47:10.413739+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3600744e0 msgr2=0x7fd3600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3600744e0 0x7fd3600769f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd378033000 tx=0x7fd378009030 comp rx=0 tx=0).stop 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 msgr2=0x7fd37c1613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 0x7fd37c1613c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00e410 tx=0x7fd36c00e810 comp rx=0 tx=0).stop 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 shutdown_connections 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd3600744e0 0x7fd3600769f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd37c0cd780 0x7fd37c152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37c1512b0 0x7fd37c1613c0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 --2- 172.21.15.80:0/3316399644 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3680039b0 0x7fd37c1f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 >> 172.21.15.80:0/3316399644 conn(0x7fd37c0d0790 msgr2=0x7fd37c0b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 shutdown_connections 2024-04-25T15:47:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.850+0000 7fd383b14640 1 -- 172.21.15.80:0/3316399644 wait complete. 2024-04-25T15:47:29.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:52.572368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:53.267030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:47:29.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:47:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.973+0000 7f32d8627640 1 Processor -- start 2024-04-25T15:47:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.973+0000 7f32d8627640 1 -- start start 2024-04-25T15:47:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.974+0000 7f32d8627640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f32d00d0b30 0x7f32d00d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.974+0000 7f32d8627640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d00b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.974+0000 7f32d8627640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d00d27f0 con 0x7f32d00ce520 2024-04-25T15:47:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d8627640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f32d00d3890 con 0x7f32d00d0b30 2024-04-25T15:47:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d8627640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f32d00d2ad0 con 0x7f32d015e070 2024-04-25T15:47:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d6bc4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d00b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d5bc2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f32d00d0b30 0x7f32d00d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d6bc4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d00b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:46888/0 (socket says 172.21.15.80:46888) 2024-04-25T15:47:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d6bc4640 1 -- 172.21.15.80:0/2769798929 learned_addr learned my addr 172.21.15.80:0/2769798929 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 msgr2=0x7f32d00b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d5bc2640 1 --2- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d00b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2769798929 >> v1:172.21.15.195:6789/0 conn(0x7f32d00ce520 legacy=0x7f32d00d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2769798929 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d00d2db0 con 0x7f32d00d0b30 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.975+0000 7f32d6bc4640 1 --2- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d00b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.976+0000 7f32d5bc2640 1 --2- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00d0b30 0x7f32d00d20f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097a0 tx=0x7f32c002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce77d1f8ff560ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.976+0000 7f32d53c1640 1 -- 172.21.15.80:0/2769798929 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0037070 con 0x7f32d00d0b30 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.976+0000 7f32d53c1640 1 -- 172.21.15.80:0/2769798929 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0032440 con 0x7f32d00d0b30 2024-04-25T15:47:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.976+0000 7f32d53c1640 1 -- 172.21.15.80:0/2769798929 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0032810 con 0x7f32d00d0b30 2024-04-25T15:47:29.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 -- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00d0b30 msgr2=0x7f32d00d20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 --2- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00d0b30 0x7f32d00d20f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097a0 tx=0x7f32c002a210 comp rx=0 tx=0).stop 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 -- 172.21.15.80:0/2769798929 shutdown_connections 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 --2- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d00b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 --2- 172.21.15.80:0/2769798929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00d0b30 0x7f32d00d20f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 -- 172.21.15.80:0/2769798929 >> 172.21.15.80:0/2769798929 conn(0x7f32d0071580 msgr2=0x7f32d0071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 -- 172.21.15.80:0/2769798929 shutdown_connections 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.977+0000 7f32d8627640 1 -- 172.21.15.80:0/2769798929 wait complete. 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.979+0000 7f32d8627640 1 Processor -- start 2024-04-25T15:47:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.979+0000 7f32d8627640 1 -- start start 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d8627640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00ce520 0x7f32d0149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d8627640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 0x7f32d01f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d8627640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d01f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d8627640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32d015e480 con 0x7f32d00d0b30 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d8627640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f32d00d3370 con 0x7f32d00ce520 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d8627640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f32d00b7360 con 0x7f32d015e070 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d5bc2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 0x7f32d01f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d5bc2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 0x7f32d01f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50096/0 (socket says 172.21.15.80:50096) 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2448306759 learned_addr learned my addr 172.21.15.80:0/2448306759 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:29.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d63c3640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00ce520 0x7f32d0149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.980+0000 7f32d6bc4640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d01f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 msgr2=0x7f32d01f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d5bc2640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d01f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00ce520 msgr2=0x7f32d0149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d5bc2640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00ce520 0x7f32d0149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d5bc2640 1 -- 172.21.15.80:0/2448306759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d00cba60 con 0x7f32d00d0b30 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d5bc2640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 0x7f32d01f3200 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f32c0035040 tx=0x7f32c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0037040 con 0x7f32d00d0b30 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0030500 con 0x7f32d00d0b30 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0030910 con 0x7f32d00d0b30 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d00cbd40 con 0x7f32d00d0b30 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.981+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d00cc300 con 0x7f32d00d0b30 2024-04-25T15:47:29.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.982+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d0050740 con 0x7f32d00d0b30 2024-04-25T15:47:29.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.983+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f32c0044020 con 0x7f32d00d0b30 2024-04-25T15:47:29.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.983+0000 7f32c6ffd640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32b40744b0 0x7f32b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:29.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.983+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f32c00b57c0 con 0x7f32d00d0b30 2024-04-25T15:47:29.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.983+0000 7f32d63c3640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32b40744b0 0x7f32b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:29.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.984+0000 7f32d63c3640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32b40744b0 0x7f32b40769c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f32d0074c70 tx=0x7f32cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:29.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:29.988+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f32c007fd10 con 0x7f32d00d0b30 2024-04-25T15:47:30.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.161+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32d00c6fa0 con 0x7f32d00d0b30 2024-04-25T15:47:30.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.161+0000 7f32c6ffd640 1 -- 172.21.15.80:0/2448306759 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7f32c007f610 con 0x7f32d00d0b30 2024-04-25T15:47:30.162 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:47:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32b40744b0 msgr2=0x7f32b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32b40744b0 0x7f32b40769c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f32d0074c70 tx=0x7f32cc009040 comp rx=0 tx=0).stop 2024-04-25T15:47:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 msgr2=0x7f32d01f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 0x7f32d01f3200 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f32c0035040 tx=0x7f32c00046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 shutdown_connections 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f32b40744b0 0x7f32b40769c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32d015e070 0x7f32d01f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32d00d0b30 0x7f32d01f3200 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 --2- 172.21.15.80:0/2448306759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d00ce520 0x7f32d0149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 >> 172.21.15.80:0/2448306759 conn(0x7f32d0071580 msgr2=0x7f32d00b77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 shutdown_connections 2024-04-25T15:47:30.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.163+0000 7f32d8627640 1 -- 172.21.15.80:0/2448306759 wait complete. 2024-04-25T15:47:30.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:47:30.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.285+0000 7fca57f00640 1 Processor -- start 2024-04-25T15:47:30.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.285+0000 7fca57f00640 1 -- start start 2024-04-25T15:47:30.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.286+0000 7fca57f00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca5015aa60 0x7fca50161160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.286+0000 7fca57f00640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca500d0240 0x7fca500d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.286+0000 7fca57f00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500d0b90 con 0x7fca5006ef60 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca57f00640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fca50163dd0 con 0x7fca500d0240 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca57f00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fca50164070 con 0x7fca5015aa60 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca500d0240 0x7fca500d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca500d0240 0x7fca500d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50104/0 (socket says 172.21.15.80:50104) 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 -- 172.21.15.80:0/2450377978 learned_addr learned my addr 172.21.15.80:0/2450377978 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 -- 172.21.15.80:0/2450377978 >> v2:172.21.15.195:3300/0 conn(0x7fca5015aa60 msgr2=0x7fca50161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 --2- 172.21.15.80:0/2450377978 >> v2:172.21.15.195:3300/0 conn(0x7fca5015aa60 0x7fca50161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 -- 172.21.15.80:0/2450377978 >> v1:172.21.15.195:6789/0 conn(0x7fca5006ef60 legacy=0x7fca5006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.287+0000 7fca5549b640 1 -- 172.21.15.80:0/2450377978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca50164350 con 0x7fca500d0240 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca5549b640 1 --2- 172.21.15.80:0/2450377978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500d0650 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fca5006e0f0 tx=0x7fca4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea292706bee15db4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca54c9a640 1 -- 172.21.15.80:0/2450377978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40037070 con 0x7fca500d0240 2024-04-25T15:47:30.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca54c9a640 1 -- 172.21.15.80:0/2450377978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca40032440 con 0x7fca500d0240 2024-04-25T15:47:30.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca54c9a640 1 -- 172.21.15.80:0/2450377978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40032810 con 0x7fca500d0240 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca57f00640 1 -- 172.21.15.80:0/2450377978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 msgr2=0x7fca500d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca57f00640 1 --2- 172.21.15.80:0/2450377978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500d0650 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fca5006e0f0 tx=0x7fca4002a230 comp rx=0 tx=0).stop 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca57f00640 1 -- 172.21.15.80:0/2450377978 shutdown_connections 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca57f00640 1 --2- 172.21.15.80:0/2450377978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500d0650 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca57f00640 1 --2- 172.21.15.80:0/2450377978 >> v2:172.21.15.195:3300/0 conn(0x7fca5015aa60 0x7fca50161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.288+0000 7fca57f00640 1 -- 172.21.15.80:0/2450377978 >> 172.21.15.80:0/2450377978 conn(0x7fca50071580 msgr2=0x7fca50071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.289+0000 7fca57f00640 1 -- 172.21.15.80:0/2450377978 shutdown_connections 2024-04-25T15:47:30.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.289+0000 7fca57f00640 1 -- 172.21.15.80:0/2450377978 wait complete. 2024-04-25T15:47:30.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.290+0000 7fca57f00640 1 Processor -- start 2024-04-25T15:47:30.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.290+0000 7fca57f00640 1 -- start start 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.291+0000 7fca57f00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca5006ef60 0x7fca5015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.291+0000 7fca57f00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.291+0000 7fca57f00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5015aa60 0x7fca501f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.291+0000 7fca57f00640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fca50164bf0 con 0x7fca500d0240 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.291+0000 7fca57f00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca50164910 con 0x7fca5006ef60 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.291+0000 7fca57f00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca501616a0 con 0x7fca5015aa60 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50118/0 (socket says 172.21.15.80:50118) 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 -- 172.21.15.80:0/643145755 learned_addr learned my addr 172.21.15.80:0/643145755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca55c9c640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca5006ef60 0x7fca5015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5649d640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5015aa60 0x7fca501f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 -- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5015aa60 msgr2=0x7fca501f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5015aa60 0x7fca501f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 -- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca5006ef60 msgr2=0x7fca5015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca5006ef60 0x7fca5015f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 -- 172.21.15.80:0/643145755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500afc80 con 0x7fca500d0240 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5649d640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5015aa60 0x7fca501f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca5549b640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500b20c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40041070 con 0x7fca500d0240 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4003c870 con 0x7fca500d0240 2024-04-25T15:47:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca500aff60 con 0x7fca500d0240 2024-04-25T15:47:30.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40037040 con 0x7fca500d0240 2024-04-25T15:47:30.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.292+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca500b0520 con 0x7fca500d0240 2024-04-25T15:47:30.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.293+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca50050740 con 0x7fca500d0240 2024-04-25T15:47:30.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.294+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fca40044070 con 0x7fca500d0240 2024-04-25T15:47:30.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.294+0000 7fca467fc640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca340744b0 0x7fca340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.294+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fca400b5ee0 con 0x7fca500d0240 2024-04-25T15:47:30.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.294+0000 7fca55c9c640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca340744b0 0x7fca340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.295+0000 7fca55c9c640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca340744b0 0x7fca340769c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fca50073ff0 tx=0x7fca4c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.299+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca500d0b90 con 0x7fca500d0240 2024-04-25T15:47:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.472+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fca50071a30 con 0x7fca500d0240 2024-04-25T15:47:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.473+0000 7fca467fc640 1 -- 172.21.15.80:0/643145755 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7fca4007fe70 con 0x7fca500d0240 2024-04-25T15:47:30.474 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca340744b0 msgr2=0x7fca340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca340744b0 0x7fca340769c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fca50073ff0 tx=0x7fca4c00d040 comp rx=0 tx=0).stop 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 msgr2=0x7fca500b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500b20c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca400046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 shutdown_connections 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fca340744b0 0x7fca340769c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca5015aa60 0x7fca501f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca500d0240 0x7fca500b20c0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 --2- 172.21.15.80:0/643145755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca5006ef60 0x7fca5015f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 >> 172.21.15.80:0/643145755 conn(0x7fca50071580 msgr2=0x7fca5015a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 shutdown_connections 2024-04-25T15:47:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.475+0000 7fca57f00640 1 -- 172.21.15.80:0/643145755 wait complete. 2024-04-25T15:47:30.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:47:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.596+0000 7fa2f704c640 1 Processor -- start 2024-04-25T15:47:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.596+0000 7fa2f704c640 1 -- start start 2024-04-25T15:47:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f704c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2f00b3d60 0x7fa2f00cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f704c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa2f00b76a0 0x7fa2f00b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f704c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f00b7ff0 con 0x7fa2f015d2d0 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f704c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f006edf0 con 0x7fa2f00b3d60 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f704c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f006eb10 con 0x7fa2f00b76a0 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2e7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2f00b3d60 0x7fa2f00cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2e7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa2f00b3d60 0x7fa2f00cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50130/0 (socket says 172.21.15.80:50130) 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f4de8640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa2f015d2d0 0x7fa2f01615b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37300/0 (socket says 172.21.15.80:37300) 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2e7fff640 1 -- 172.21.15.80:0/2855057111 learned_addr learned my addr 172.21.15.80:0/2855057111 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.597+0000 7fa2f55e9640 1 --2- 172.21.15.80:0/2855057111 >> v2:172.21.15.195:3300/0 conn(0x7fa2f00b76a0 0x7fa2f00b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e7fff640 1 -- 172.21.15.80:0/2855057111 >> v2:172.21.15.195:3300/0 conn(0x7fa2f00b76a0 msgr2=0x7fa2f00b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e7fff640 1 --2- 172.21.15.80:0/2855057111 >> v2:172.21.15.195:3300/0 conn(0x7fa2f00b76a0 0x7fa2f00b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e7fff640 1 -- 172.21.15.80:0/2855057111 >> v1:172.21.15.80:6789/0 conn(0x7fa2f015d2d0 legacy=0x7fa2f01615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e7fff640 1 -- 172.21.15.80:0/2855057111 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f0160db0 con 0x7fa2f00b3d60 2024-04-25T15:47:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e77fe640 1 -- 172.21.15.80:0/2855057111 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606390618 0 0) 0x7fa2ec0011d0 con 0x7fa2f015d2d0 2024-04-25T15:47:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e7fff640 1 --2- 172.21.15.80:0/2855057111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00b3d60 0x7fa2f00cfe80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0074130 tx=0x7fa2e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3623bb2a6f1b949e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.598+0000 7fa2e77fe640 1 -- 172.21.15.80:0/2855057111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037070 con 0x7fa2f00b3d60 2024-04-25T15:47:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2e77fe640 1 -- 172.21.15.80:0/2855057111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0032440 con 0x7fa2f00b3d60 2024-04-25T15:47:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2e77fe640 1 -- 172.21.15.80:0/2855057111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0032810 con 0x7fa2f00b3d60 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 -- 172.21.15.80:0/2855057111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00b3d60 msgr2=0x7fa2f00cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 --2- 172.21.15.80:0/2855057111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00b3d60 0x7fa2f00cfe80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0074130 tx=0x7fa2e002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 -- 172.21.15.80:0/2855057111 shutdown_connections 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 --2- 172.21.15.80:0/2855057111 >> v2:172.21.15.195:3300/0 conn(0x7fa2f00b76a0 0x7fa2f00b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 --2- 172.21.15.80:0/2855057111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f00b3d60 0x7fa2f00cfe80 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 -- 172.21.15.80:0/2855057111 >> 172.21.15.80:0/2855057111 conn(0x7fa2f009b600 msgr2=0x7fa2f009ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 -- 172.21.15.80:0/2855057111 shutdown_connections 2024-04-25T15:47:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.599+0000 7fa2f704c640 1 -- 172.21.15.80:0/2855057111 wait complete. 2024-04-25T15:47:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.601+0000 7fa2f704c640 1 Processor -- start 2024-04-25T15:47:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.601+0000 7fa2f704c640 1 -- start start 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.602+0000 7fa2f704c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f00b3d60 0x7fa2f00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.602+0000 7fa2f704c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f00b76a0 0x7fa2f01f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.602+0000 7fa2f704c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 0x7fa2f009c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.602+0000 7fa2f704c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f00d0510 con 0x7fa2f015d2d0 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.602+0000 7fa2f704c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f00cf920 con 0x7fa2f00b76a0 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.602+0000 7fa2f704c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f00d0690 con 0x7fa2f00b3d60 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 0x7fa2f009c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 0x7fa2f009c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50136/0 (socket says 172.21.15.80:50136) 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 -- 172.21.15.80:0/3621350047 learned_addr learned my addr 172.21.15.80:0/3621350047 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:30.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f4de8640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f00b3d60 0x7fa2f00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2e7fff640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f00b76a0 0x7fa2f01f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 -- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f00b3d60 msgr2=0x7fa2f00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f00b3d60 0x7fa2f00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 -- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f00b76a0 msgr2=0x7fa2f01f7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f00b76a0 0x7fa2f01f7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 -- 172.21.15.80:0/3621350047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f01f7ec0 con 0x7fa2f015d2d0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f4de8640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f00b3d60 0x7fa2f00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2e7fff640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f00b76a0 0x7fa2f01f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f55e9640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 0x7fa2f009c870 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800efc0 tx=0x7fa2e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8018020 con 0x7fa2f015d2d0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e8014480 con 0x7fa2f015d2d0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8009e60 con 0x7fa2f015d2d0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f00af890 con 0x7fa2f015d2d0 2024-04-25T15:47:30.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.603+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f00afe50 con 0x7fa2f015d2d0 2024-04-25T15:47:30.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.604+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f00b24d0 con 0x7fa2f015d2d0 2024-04-25T15:47:30.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.605+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa2e8005d10 con 0x7fa2f015d2d0 2024-04-25T15:47:30.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.605+0000 7fa2e57fa640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2dc0744b0 0x7fa2dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.605+0000 7fa2f4de8640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2dc0744b0 0x7fa2dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.605+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fa2e8096200 con 0x7fa2f015d2d0 2024-04-25T15:47:30.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.606+0000 7fa2f4de8640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2dc0744b0 0x7fa2dc0769c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec001020 tx=0x7fa2ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.610+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2e8022030 con 0x7fa2f015d2d0 2024-04-25T15:47:30.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.783+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa2f0050740 con 0x7fa2f015d2d0 2024-04-25T15:47:30.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.783+0000 7fa2e57fa640 1 -- 172.21.15.80:0/3621350047 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7fa2e8010040 con 0x7fa2f015d2d0 2024-04-25T15:47:30.784 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:47:30.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2dc0744b0 msgr2=0x7fa2dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2dc0744b0 0x7fa2dc0769c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec001020 tx=0x7fa2ec009040 comp rx=0 tx=0).stop 2024-04-25T15:47:30.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 msgr2=0x7fa2f009c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 0x7fa2f009c870 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800efc0 tx=0x7fa2e800c490 comp rx=0 tx=0).stop 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 shutdown_connections 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fa2dc0744b0 0x7fa2dc0769c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa2f015d2d0 0x7fa2f009c870 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f00b76a0 0x7fa2f01f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 --2- 172.21.15.80:0/3621350047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f00b3d60 0x7fa2f00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 >> 172.21.15.80:0/3621350047 conn(0x7fa2f009b600 msgr2=0x7fa2f00d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 shutdown_connections 2024-04-25T15:47:30.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.785+0000 7fa2f704c640 1 -- 172.21.15.80:0/3621350047 wait complete. 2024-04-25T15:47:30.797 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T15:47:30.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.903+0000 7f897557d640 1 Processor -- start 2024-04-25T15:47:30.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.904+0000 7f897557d640 1 -- start start 2024-04-25T15:47:30.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f897557d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f89700cef30 0x7f89700b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f897557d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700b76a0 0x7f89700b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f897557d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8970164010 0x7f8970164420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f897557d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8970160990 con 0x7f8970164010 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f897557d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f89700b2080 con 0x7f89700cef30 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f897557d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f89700cf340 con 0x7f89700b76a0 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8970164010 0x7f8970164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8970164010 0x7f8970164420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50140/0 (socket says 172.21.15.80:50140) 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 -- 172.21.15.80:0/1840256205 learned_addr learned my addr 172.21.15.80:0/1840256205 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896effd640 1 --2- 172.21.15.80:0/1840256205 >> v2:172.21.15.195:3300/0 conn(0x7f89700cef30 0x7f89700b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896e7fc640 1 --2- 172.21.15.80:0/1840256205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700b76a0 0x7f89700b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 -- 172.21.15.80:0/1840256205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700b76a0 msgr2=0x7f89700b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 --2- 172.21.15.80:0/1840256205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700b76a0 0x7f89700b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 -- 172.21.15.80:0/1840256205 >> v2:172.21.15.195:3300/0 conn(0x7f89700cef30 msgr2=0x7f89700b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:30.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 --2- 172.21.15.80:0/1840256205 >> v2:172.21.15.195:3300/0 conn(0x7f89700cef30 0x7f89700b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.905+0000 7f896f7fe640 1 -- 172.21.15.80:0/1840256205 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700b7ff0 con 0x7f8970164010 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.906+0000 7f896f7fe640 1 --2- 172.21.15.80:0/1840256205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8970164010 0x7f8970164420 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f89700740e0 tx=0x7f896002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bfe04c6f41c8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.906+0000 7f896dffb640 1 -- 172.21.15.80:0/1840256205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960037070 con 0x7f8970164010 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.906+0000 7f896dffb640 1 -- 172.21.15.80:0/1840256205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8960032440 con 0x7f8970164010 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.906+0000 7f896dffb640 1 -- 172.21.15.80:0/1840256205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960032810 con 0x7f8970164010 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 -- 172.21.15.80:0/1840256205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8970164010 msgr2=0x7f8970164420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 --2- 172.21.15.80:0/1840256205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8970164010 0x7f8970164420 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f89700740e0 tx=0x7f896002a210 comp rx=0 tx=0).stop 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 -- 172.21.15.80:0/1840256205 shutdown_connections 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 --2- 172.21.15.80:0/1840256205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8970164010 0x7f8970164420 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 --2- 172.21.15.80:0/1840256205 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700b76a0 0x7f89700b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 --2- 172.21.15.80:0/1840256205 >> v2:172.21.15.195:3300/0 conn(0x7f89700cef30 0x7f89700b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 -- 172.21.15.80:0/1840256205 >> 172.21.15.80:0/1840256205 conn(0x7f897009b600 msgr2=0x7f897009ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:30.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 -- 172.21.15.80:0/1840256205 shutdown_connections 2024-04-25T15:47:30.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.907+0000 7f897557d640 1 -- 172.21.15.80:0/1840256205 wait complete. 2024-04-25T15:47:30.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.909+0000 7f897557d640 1 Processor -- start 2024-04-25T15:47:30.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.909+0000 7f897557d640 1 -- start start 2024-04-25T15:47:30.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f897557d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 0x7f89700c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f897557d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700cef30 0x7f8970163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f897557d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8970164010 0x7f897015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f897557d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f89700d2b60 con 0x7f89700b76a0 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f897557d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f89700d2880 con 0x7f8970164010 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f897557d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f89700d2e40 con 0x7f89700cef30 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f896effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 0x7f89700c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f896effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 0x7f89700c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50144/0 (socket says 172.21.15.80:50144) 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f896effd640 1 -- 172.21.15.80:0/4176488039 learned_addr learned my addr 172.21.15.80:0/4176488039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f896e7fc640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700cef30 0x7f8970163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.910+0000 7f896f7fe640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8970164010 0x7f897015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f896effd640 1 -- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700cef30 msgr2=0x7f8970163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f896effd640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700cef30 0x7f8970163160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f896effd640 1 -- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8970164010 msgr2=0x7f897015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f896effd640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8970164010 0x7f897015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f896effd640 1 -- 172.21.15.80:0/4176488039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700af790 con 0x7f89700b76a0 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f896effd640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 0x7f89700c6450 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f896800efc0 tx=0x7f896800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968018020 con 0x7f89700b76a0 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8968014480 con 0x7f89700b76a0 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89700afa70 con 0x7f89700b76a0 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968014850 con 0x7f89700b76a0 2024-04-25T15:47:30.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.911+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897015d480 con 0x7f89700b76a0 2024-04-25T15:47:30.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.912+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8970050740 con 0x7f89700b76a0 2024-04-25T15:47:30.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.913+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f896801b020 con 0x7f89700b76a0 2024-04-25T15:47:30.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.913+0000 7f89677fe640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f89500744b0 0x7f89500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:30.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.913+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f89680961d0 con 0x7f89700b76a0 2024-04-25T15:47:30.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.913+0000 7f896e7fc640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f89500744b0 0x7f89500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:30.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.913+0000 7f896e7fc640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f89500744b0 0x7f89500769c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f89700b6f60 tx=0x7f8958009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:30.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:30.918+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8968022020 con 0x7f89700b76a0 2024-04-25T15:47:31.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.103+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f89700ce260 con 0x7f89700b76a0 2024-04-25T15:47:31.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.104+0000 7f89677fe640 1 -- 172.21.15.80:0/4176488039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v103) ==== 80+0+246 (secure 0 0 0) 0x7f8968010040 con 0x7f89700b76a0 2024-04-25T15:47:31.105 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.195:6834/2812835007 2024-04-26T15:47:11.149648+0000 2024-04-25T15:47:31.105 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.195:6832/2812835007 2024-04-26T15:47:11.149648+0000 2024-04-25T15:47:31.105 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6836/3726019359 2024-04-26T15:47:10.413739+0000 2024-04-25T15:47:31.105 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6834/3726019359 2024-04-26T15:47:10.413739+0000 2024-04-25T15:47:31.105 INFO:teuthology.orchestra.run.smithi080.stderr:listed 4 entries 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f89500744b0 msgr2=0x7f89500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f89500744b0 0x7f89500769c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f89700b6f60 tx=0x7f8958009190 comp rx=0 tx=0).stop 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 msgr2=0x7f89700c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 0x7f89700c6450 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f896800efc0 tx=0x7f896800c490 comp rx=0 tx=0).stop 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 shutdown_connections 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f89500744b0 0x7f89500769c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8970164010 0x7f897015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89700cef30 0x7f8970163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 --2- 172.21.15.80:0/4176488039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89700b76a0 0x7f89700c6450 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 >> 172.21.15.80:0/4176488039 conn(0x7f897009b600 msgr2=0x7f89700715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:31.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 shutdown_connections 2024-04-25T15:47:31.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.106+0000 7f897557d640 1 -- 172.21.15.80:0/4176488039 wait complete. 2024-04-25T15:47:31.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T15:47:31.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:31.118 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T15:47:31.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:47:31.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:31.154 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T15:47:31.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-04-25T15:47:31.338 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T15:47:31.339 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-04-25T15:47:31.339 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T15:47:31.467 INFO:teuthology.orchestra.run.smithi080.stdout:{"message":"","return_code":0} 2024-04-25T15:47:31.467 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T15:47:31.468 DEBUG:teuthology.orchestra.run.smithi080:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-04-25T15:47:31.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.517+0000 7f9b145e7280 1 -- start start 2024-04-25T15:47:31.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.517+0000 7f9b145e7280 1 Processor -- start 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f7a3da80 0x5632f795a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 0x5632f795a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760000 0x5632f795ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5632f795e180 con 0x5632f7a3d180 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5632f795e300 con 0x5632f7a3da80 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5632f795e480 con 0x5632f8760000 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 0x5632f795a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 0x5632f795a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50158/0 (socket says 172.21.15.80:50158) 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 -- 172.21.15.80:0/565273613 learned_addr learned my addr 172.21.15.80:0/565273613 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 -- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760000 msgr2=0x5632f795ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:31.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b13594640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760000 0x5632f795ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12d93640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f7a3da80 0x5632f795a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760000 0x5632f795ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 -- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f7a3da80 msgr2=0x5632f795a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f7a3da80 0x5632f795a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 -- 172.21.15.80:0/565273613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f38ac780 con 0x5632f7a3d180 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b13594640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760000 0x5632f795ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12d93640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f7a3da80 0x5632f795a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b12592640 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 0x5632f795a000 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x5632f86cf3b0 tx=0x5632f79a4180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82b26d8715d61e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b1058e640 1 -- 172.21.15.80:0/565273613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632f389c680 con 0x5632f7a3d180 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b1058e640 1 -- 172.21.15.80:0/565273613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5632f38a2fc0 con 0x5632f7a3d180 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b1058e640 1 -- 172.21.15.80:0/565273613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632f389cb60 con 0x5632f7a3d180 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.518+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f38ac3c0 con 0x5632f7a3d180 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5632f38ad680 con 0x5632f7a3d180 2024-04-25T15:47:31.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b145e7280 4 waiting for MDS map... 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b1058e640 1 -- 172.21.15.80:0/565273613 <== mon.0 v2:172.21.15.80:3300/0 4 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x5632f877aa00 con 0x5632f7a3d180 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b1058e640 1 -- 172.21.15.80:0/565273613 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 63) ==== 3518+0+0 (secure 0 0 0) 0x5632f7901180 con 0x5632f7a3d180 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b145e7280 4 Got MDS map 63 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b145e7280 10 main: main 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.519+0000 7f9b145e7280 4 main: connecting to RADOS... 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.520+0000 7f9b145e7280 1 Processor -- start 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.520+0000 7f9b145e7280 1 -- start start 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b145e7280 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5632f795e600 con 0x5632f8760d80 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b145e7280 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5632f795e780 con 0x5632f8761200 2024-04-25T15:47:31.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b145e7280 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5632f795e900 con 0x5632f8760900 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50164/0 (socket says 172.21.15.80:50164) 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 -- 172.21.15.80:0/2693012316 learned_addr learned my addr 172.21.15.80:0/2693012316 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12592640 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b13594640 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 -- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 msgr2=0x5632f795b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 -- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 msgr2=0x5632f795bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 -- 172.21.15.80:0/2693012316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f38ad4a0 con 0x5632f8760d80 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b13594640 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.521+0000 7f9b12d93640 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x5632f8796840 tx=0x5632f8798cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a87b73c7e1c756 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b0e58a640 1 -- 172.21.15.80:0/2693012316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632f389c680 con 0x5632f8760d80 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b0e58a640 1 -- 172.21.15.80:0/2693012316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5632f38a2a80 con 0x5632f8760d80 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b0e58a640 1 -- 172.21.15.80:0/2693012316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632f389cb60 con 0x5632f8760d80 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 -- 172.21.15.80:0/2693012316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 msgr2=0x5632f795b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x5632f8796840 tx=0x5632f8798cc0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 -- 172.21.15.80:0/2693012316 shutdown_connections 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 --2- 172.21.15.80:0/2693012316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 -- 172.21.15.80:0/2693012316 >> 172.21.15.80:0/2693012316 conn(0x5632f8760480 msgr2=0x5632f79d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 -- 172.21.15.80:0/2693012316 shutdown_connections 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.522+0000 7f9b145e7280 1 -- 172.21.15.80:0/2693012316 wait complete. 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.523+0000 7f9b145e7280 1 Processor -- start 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.523+0000 7f9b145e7280 1 -- start start 2024-04-25T15:47:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b145e7280 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b145e7280 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5632f795e900 con 0x5632f8760d80 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b145e7280 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5632f795ea80 con 0x5632f8761200 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b145e7280 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5632f795e780 con 0x5632f8760900 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b12d93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b12d93640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50166/0 (socket says 172.21.15.80:50166) 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.524+0000 7f9b12d93640 1 -- 172.21.15.80:0/3302383435 learned_addr learned my addr 172.21.15.80:0/3302383435 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b13594640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12592640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12d93640 1 -- 172.21.15.80:0/3302383435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 msgr2=0x5632f795b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12d93640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760900 0x5632f795b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12d93640 1 -- 172.21.15.80:0/3302383435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 msgr2=0x5632f795bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12d93640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f8761200 0x5632f795bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12d93640 1 -- 172.21.15.80:0/3302383435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f38ac780 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b12d93640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x5632f8797b00 tx=0x5632f8798c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b0cd87640 1 -- 172.21.15.80:0/3302383435 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632f389c4e0 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b0cd87640 1 -- 172.21.15.80:0/3302383435 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5632f38a2a80 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632f38ac3c0 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b0cd87640 1 -- 172.21.15.80:0/3302383435 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632f389c680 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f38ac000 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.525+0000 7f9b145e7280 4 main: resolving pool 15 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.526+0000 7f9b0cd87640 1 -- 172.21.15.80:0/3302383435 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x5632f8808c00 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b0cd87640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x5632f8763a80 0x5632f795c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b0cd87640 1 -- 172.21.15.80:0/3302383435 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x5632f8800a00 con 0x5632f8760d80 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b13594640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x5632f8763a80 0x5632f795c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b145e7280 4 main: creating IoCtx.. 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b145e7280 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x5632f8761680 0x5632f795c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- osd_op(unknown.0.0:1 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x5632f87fe800 con 0x5632f8761680 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b12592640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x5632f8761680 0x5632f795c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b13594640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x5632f8763a80 0x5632f795c100 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x5632f38afe00 tx=0x5632f79a2ae0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.527+0000 7f9b12592640 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x5632f8761680 0x5632f795c680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b12592640 1 -- 172.21.15.80:0/3302383435 <== osd.2 v2:172.21.15.80:6800/1881939009 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x5632f798c000 con 0x5632f8761680 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- osd_op(unknown.0.0:2 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x5632f87fec00 con 0x5632f8761680 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b12592640 1 -- 172.21.15.80:0/3302383435 <== osd.2 v2:172.21.15.80:6800/1881939009 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x5632f798c000 con 0x5632f8761680 2024-04-25T15:47:31.536 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: "0": { 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: "data": { 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions": [] 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: "result": 0 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:31.537 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x5632f8761680 msgr2=0x5632f795c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x5632f8761680 0x5632f795c680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x5632f8763a80 msgr2=0x5632f795c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x5632f8763a80 0x5632f795c100 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x5632f38afe00 tx=0x5632f79a2ae0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 msgr2=0x5632f795b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 --2- 172.21.15.80:0/3302383435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f8760d80 0x5632f795b600 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x5632f8797b00 tx=0x5632f8798c00 comp rx=0 tx=0).stop 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b12d93640 1 -- 172.21.15.80:0/3302383435 reap_dead start 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 shutdown_connections 2024-04-25T15:47:31.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 >> 172.21.15.80:0/3302383435 conn(0x5632f8760480 msgr2=0x5632f79d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 shutdown_connections 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/3302383435 wait complete. 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 msgr2=0x5632f795a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.528+0000 7f9b145e7280 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 0x5632f795a000 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x5632f86cf3b0 tx=0x5632f79a4180 comp rx=0 tx=0).stop 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 shutdown_connections 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5632f8760000 0x5632f795ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5632f7a3d180 0x5632f795a000 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 --2- 172.21.15.80:0/565273613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632f7a3da80 0x5632f795a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 >> 172.21.15.80:0/565273613 conn(0x5632f7a3d600 msgr2=0x5632f79d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 shutdown_connections 2024-04-25T15:47:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.529+0000 7f9b145e7280 1 -- 172.21.15.80:0/565273613 wait complete. 2024-04-25T15:47:31.541 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.072858, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-04-25T15:47:31.541 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-04-25T15:47:31.541 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T15:47:31.541 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:47:31.585 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T15:47:31.632 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T15:47:31.632 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:47:31.632 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:31.632 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:31.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:47:31.648 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:47:31.648 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:31.648 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:31.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:47:31.666 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:47:31.666 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:31.666 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:31.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:47:31.705 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T15:47:31.705 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:31.705 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:31.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:47:31.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:31.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.852+0000 7f6565f7d640 1 Processor -- start 2024-04-25T15:47:31.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.852+0000 7f6565f7d640 1 -- start start 2024-04-25T15:47:31.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f6565f7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 0x7f65600ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f6565f7d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 0x7f65601642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f6565f7d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6560164960 con 0x7f6560163ee0 2024-04-25T15:47:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f6565f7d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f65600d2460 con 0x7f65600b5d30 2024-04-25T15:47:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f6565f7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6560164c40 con 0x7f656015dc90 2024-04-25T15:47:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 0x7f65600ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655ffff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 0x7f65601642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 0x7f65600ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.80:46986/0 (socket says 172.21.15.80:46986) 2024-04-25T15:47:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655ffff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 0x7f65601642f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:44188/0 (socket says 172.21.15.80:44188) 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 -- 172.21.15.80:0/3633501603 learned_addr learned my addr 172.21.15.80:0/3633501603 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655effd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f6560163ee0 0x7f65600b5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:60032/0 (socket says 172.21.15.80:60032) 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 -- 172.21.15.80:0/3633501603 >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 msgr2=0x7f65601642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 --2- 172.21.15.80:0/3633501603 >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 0x7f65601642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 -- 172.21.15.80:0/3633501603 >> v1:172.21.15.195:6789/0 conn(0x7f6560163ee0 legacy=0x7f65600b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655f7fe640 1 -- 172.21.15.80:0/3633501603 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600d26b0 con 0x7f656015dc90 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.854+0000 7f655ffff640 1 --2- 172.21.15.80:0/3633501603 >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 0x7f65601642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.855+0000 7f655f7fe640 1 --2- 172.21.15.80:0/3633501603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 0x7f65600ce1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6550009870 tx=0x7f655002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c026b9ab5e7e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.855+0000 7f655e7fc640 1 -- 172.21.15.80:0/3633501603 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550037070 con 0x7f656015dc90 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.855+0000 7f655e7fc640 1 -- 172.21.15.80:0/3633501603 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6550032440 con 0x7f656015dc90 2024-04-25T15:47:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.855+0000 7f655e7fc640 1 -- 172.21.15.80:0/3633501603 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550032810 con 0x7f656015dc90 2024-04-25T15:47:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 -- 172.21.15.80:0/3633501603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 msgr2=0x7f65600ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 --2- 172.21.15.80:0/3633501603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 0x7f65600ce1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6550009870 tx=0x7f655002a270 comp rx=0 tx=0).stop 2024-04-25T15:47:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 -- 172.21.15.80:0/3633501603 shutdown_connections 2024-04-25T15:47:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 --2- 172.21.15.80:0/3633501603 >> v2:172.21.15.195:3300/0 conn(0x7f65600b5d30 0x7f65601642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 --2- 172.21.15.80:0/3633501603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f656015dc90 0x7f65600ce1f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 -- 172.21.15.80:0/3633501603 >> 172.21.15.80:0/3633501603 conn(0x7f65600d0800 msgr2=0x7f65600d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 -- 172.21.15.80:0/3633501603 shutdown_connections 2024-04-25T15:47:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.856+0000 7f6565f7d640 1 -- 172.21.15.80:0/3633501603 wait complete. 2024-04-25T15:47:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.858+0000 7f6565f7d640 1 Processor -- start 2024-04-25T15:47:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.858+0000 7f6565f7d640 1 -- start start 2024-04-25T15:47:31.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.859+0000 7f6565f7d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656015dc90 0x7f656014a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.859+0000 7f6565f7d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6560163ee0 0x7f6560158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.859+0000 7f6565f7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 0x7f65601594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.859+0000 7f6565f7d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65600ce730 con 0x7f65600b9190 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.859+0000 7f6565f7d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f65600b3000 con 0x7f656015dc90 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.859+0000 7f6565f7d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65600ce8b0 con 0x7f6560163ee0 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 0x7f65601594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 0x7f65601594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50176/0 (socket says 172.21.15.80:50176) 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 -- 172.21.15.80:0/352549697 learned_addr learned my addr 172.21.15.80:0/352549697 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655f7fe640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656015dc90 0x7f656014a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655effd640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6560163ee0 0x7f6560158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 -- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6560163ee0 msgr2=0x7f6560158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6560163ee0 0x7f6560158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 -- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656015dc90 msgr2=0x7f656014a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656015dc90 0x7f656014a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 -- 172.21.15.80:0/352549697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6560159b80 con 0x7f65600b9190 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f655ffff640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 0x7f65601594f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f6558009e10 tx=0x7f655800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558018020 con 0x7f65600b9190 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6560159e60 con 0x7f65600b9190 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558014480 con 0x7f65600b9190 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558014850 con 0x7f65600b9190 2024-04-25T15:47:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.860+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656015a420 con 0x7f65600b9190 2024-04-25T15:47:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.861+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6560050740 con 0x7f65600b9190 2024-04-25T15:47:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.862+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f655801b020 con 0x7f65600b9190 2024-04-25T15:47:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.862+0000 7f6547fff640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.862+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f65580960a0 con 0x7f65600b9190 2024-04-25T15:47:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.862+0000 7f655f7fe640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.863+0000 7f655f7fe640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6550034000 tx=0x7f655002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:31.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:31.867+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6558022020 con 0x7f65600b9190 2024-04-25T15:47:32.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.083+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65600b6850 con 0x7f65600b9190 2024-04-25T15:47:32.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.084+0000 7f6547fff640 1 -- 172.21.15.80:0/352549697 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5211 (secure 0 0 0) 0x7f6558010040 con 0x7f65600b9190 2024-04-25T15:47:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:32.085 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:25.523016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7824,"mds_1":7839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7839":{"gid":7839,"name":"a","rank":1,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7839,7824]},"id":7}]} 2024-04-25T15:47:32.085 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 63 2024-04-25T15:47:32.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 msgr2=0x7f654c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6550034000 tx=0x7f655002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:32.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 msgr2=0x7f65601594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 0x7f65601594f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f6558009e10 tx=0x7f655800c490 comp rx=0 tx=0).stop 2024-04-25T15:47:32.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 shutdown_connections 2024-04-25T15:47:32.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f654c0744b0 0x7f654c0769c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65600b9190 0x7f65601594f0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6560163ee0 0x7f6560158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 --2- 172.21.15.80:0/352549697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f656015dc90 0x7f656014a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 >> 172.21.15.80:0/352549697 conn(0x7f65600d0800 msgr2=0x7f6560161a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:32.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 shutdown_connections 2024-04-25T15:47:32.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.086+0000 7f6565f7d640 1 -- 172.21.15.80:0/352549697 wait complete. 2024-04-25T15:47:32.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:32.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.205+0000 7f345b1b2640 1 Processor -- start 2024-04-25T15:47:32.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.205+0000 7f345b1b2640 1 -- start start 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f345b1b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34540d0c40 0x7f34541692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f345b1b2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34540d2d60 con 0x7f34540b5040 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f345b1b2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34540cebe0 con 0x7f34540cfc80 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f345b1b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34540cf7f0 con 0x7f34540d0c40 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f344bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34540b5040 0x7f34540d0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37318/0 (socket says 172.21.15.80:37318) 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f344bfff640 1 -- 172.21.15.80:0/3150433367 learned_addr learned my addr 172.21.15.80:0/3150433367 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:32.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.206+0000 7f345974f640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34540d0c40 0x7f34541692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967130632 0 0) 0x7f3444001110 con 0x7f34540b5040 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f343c003520 con 0x7f34540b5040 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2632222909 0 0) 0x7f343c003520 con 0x7f34540b5040 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34540d0c40 msgr2=0x7f34541692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34540d0c40 0x7f34541692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 >> v1:172.21.15.195:6789/0 conn(0x7f34540cfc80 legacy=0x7f34540d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34540ceec0 con 0x7f34540b5040 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f3444001840 con 0x7f34540b5040 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 >> v1:172.21.15.80:6789/0 conn(0x7f34540b5040 legacy=0x7f34540d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c0039e0 0x7f343c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f343c004800 0x7f343c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c005150 0x7f343c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34540cf7f0 con 0x7f343c0039e0 2024-04-25T15:47:32.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f343c00bf00 con 0x7f343c005150 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f343c00c080 con 0x7f343c004800 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f3458f4e640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c0039e0 0x7f343c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f344bfff640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f343c004800 0x7f343c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f345974f640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c005150 0x7f343c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f3458f4e640 1 -- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f343c004800 msgr2=0x7f343c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f3458f4e640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f343c004800 0x7f343c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f3458f4e640 1 -- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c005150 msgr2=0x7f343c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f3458f4e640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c005150 0x7f343c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f3458f4e640 1 -- 172.21.15.80:0/3150433367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c003520 con 0x7f343c0039e0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.207+0000 7f345974f640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c005150 0x7f343c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.208+0000 7f3458f4e640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c0039e0 0x7f343c003e10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3450001910 tx=0x7f343c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06acf80e7126490 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.208+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450037070 con 0x7f343c0039e0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.208+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345002ac60 con 0x7f343c0039e0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.208+0000 7f344b7fe640 1 -- 172.21.15.80:0/3150433367 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34500014e0 con 0x7f343c0039e0 2024-04-25T15:47:32.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345b1b2640 1 -- 172.21.15.80:0/3150433367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c0039e0 msgr2=0x7f343c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345b1b2640 1 --2- 172.21.15.80:0/3150433367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f343c0039e0 0x7f343c003e10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3450001910 tx=0x7f343c005830 comp rx=0 tx=0).stop 2024-04-25T15:47:32.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345974f640 1 -- 172.21.15.80:0/3150433367 reap_dead start 2024-04-25T15:47:32.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345b1b2640 1 -- 172.21.15.80:0/3150433367 shutdown_connections 2024-04-25T15:47:32.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345b1b2640 1 -- 172.21.15.80:0/3150433367 >> 172.21.15.80:0/3150433367 conn(0x7f34540d3bd0 msgr2=0x7f34540d3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:32.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345b1b2640 1 -- 172.21.15.80:0/3150433367 shutdown_connections 2024-04-25T15:47:32.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.209+0000 7f345b1b2640 1 -- 172.21.15.80:0/3150433367 wait complete. 2024-04-25T15:47:32.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.211+0000 7f345b1b2640 1 Processor -- start 2024-04-25T15:47:32.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.211+0000 7f345b1b2640 1 -- start start 2024-04-25T15:47:32.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345b1b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c0039e0 0x7f34541609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345b1b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 0x7f34540c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345b1b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f345415c400 0x7f345415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345b1b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34540b5450 con 0x7f3454157010 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345b1b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f34540cf480 con 0x7f343c0039e0 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345b1b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34540ce890 con 0x7f345415c400 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f344bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 0x7f34540c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f344bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 0x7f34540c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50196/0 (socket says 172.21.15.80:50196) 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f344bfff640 1 -- 172.21.15.80:0/1561798357 learned_addr learned my addr 172.21.15.80:0/1561798357 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f3458f4e640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c0039e0 0x7f34541609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.212+0000 7f345974f640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f345415c400 0x7f345415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f344bfff640 1 -- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f345415c400 msgr2=0x7f345415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f344bfff640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f345415c400 0x7f345415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f344bfff640 1 -- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c0039e0 msgr2=0x7f34541609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f344bfff640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c0039e0 0x7f34541609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f344bfff640 1 -- 172.21.15.80:0/1561798357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345415cd50 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f345974f640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f345415c400 0x7f345415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f344bfff640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 0x7f34540c9a70 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f34440019b0 tx=0x7f3444007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344401a070 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344400f8e0 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344400fc90 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34541f4690 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.213+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34541f4c00 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.214+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3454050740 con 0x7f3454157010 2024-04-25T15:47:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.215+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f344401d360 con 0x7f3454157010 2024-04-25T15:47:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.215+0000 7f34497fa640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34400744e0 0x7f34400769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.215+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f3444094ea0 con 0x7f3454157010 2024-04-25T15:47:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.215+0000 7f3458f4e640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34400744e0 0x7f34400769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.216+0000 7f3458f4e640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34400744e0 0x7f34400769f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3450034000 tx=0x7f345002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.220+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f345415cd50 con 0x7f3454157010 2024-04-25T15:47:32.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.396+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3454073490 con 0x7f3454157010 2024-04-25T15:47:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.397+0000 7f34497fa640 1 -- 172.21.15.80:0/1561798357 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17123 (secure 0 0 0) 0x7f34540d2d60 con 0x7f3454157010 2024-04-25T15:47:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:32.399 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:47:11.149672+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6834/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.195:6832/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.80:6836/3726019359":"2024-04-26T15:47:10.413739+0000","172.21.15.80:6834/3726019359":"2024-04-26T15:47:10.413739+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.399+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34400744e0 msgr2=0x7f34400769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.399+0000 7f345b1b2640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34400744e0 0x7f34400769f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3450034000 tx=0x7f345002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.399+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 msgr2=0x7f34540c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.399+0000 7f345b1b2640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 0x7f34540c9a70 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f34440019b0 tx=0x7f3444007720 comp rx=0 tx=0).stop 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 shutdown_connections 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f34400744e0 0x7f34400769f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f345415c400 0x7f345415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3454157010 0x7f34540c9a70 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 --2- 172.21.15.80:0/1561798357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f343c0039e0 0x7f34541609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 >> 172.21.15.80:0/1561798357 conn(0x7f34540d3bd0 msgr2=0x7f345415df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:32.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 shutdown_connections 2024-04-25T15:47:32.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.400+0000 7f345b1b2640 1 -- 172.21.15.80:0/1561798357 wait complete. 2024-04-25T15:47:32.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:42:49.012146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:52.572368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:53.267030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:47:32.412 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:47:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.521+0000 7f5f21034640 1 Processor -- start 2024-04-25T15:47:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.521+0000 7f5f21034640 1 -- start start 2024-04-25T15:47:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f21034640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f1c0cef30 0x7f5f1c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f21034640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c0d25a0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f21034640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c0d2880 con 0x7f5f1c0ccf90 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f21034640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5f1c160990 con 0x7f5f1c0cef30 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f1c0cef30 0x7f5f1c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1a59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f1c0b76a0 0x7f5f1c0b7ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37322/0 (socket says 172.21.15.80:37322) 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1a59c640 1 -- 172.21.15.80:0/2983012285 learned_addr learned my addr 172.21.15.80:0/2983012285 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1ad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f1c0cef30 0x7f5f1c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50212/0 (socket says 172.21.15.80:50212) 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/2983012285 >> v1:172.21.15.195:6789/0 conn(0x7f5f1c0ccf90 legacy=0x7f5f1c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/2983012285 >> v1:172.21.15.80:6789/0 conn(0x7f5f1c0b76a0 legacy=0x7f5f1c0b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/2983012285 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c0d2b60 con 0x7f5f1c0cef30 2024-04-25T15:47:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.522+0000 7f5f19d9b640 1 -- 172.21.15.80:0/2983012285 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159521650 0 0) 0x7f5f1c0d25a0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.523+0000 7f5f1ad9d640 1 --2- 172.21.15.80:0/2983012285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c0b1b40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009790 tx=0x7f5f0c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286c417314cb7e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.523+0000 7f5f19d9b640 1 -- 172.21.15.80:0/2983012285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c037070 con 0x7f5f1c0cef30 2024-04-25T15:47:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.523+0000 7f5f19d9b640 1 -- 172.21.15.80:0/2983012285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c032440 con 0x7f5f1c0cef30 2024-04-25T15:47:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.523+0000 7f5f19d9b640 1 -- 172.21.15.80:0/2983012285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c032810 con 0x7f5f1c0cef30 2024-04-25T15:47:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 -- 172.21.15.80:0/2983012285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0cef30 msgr2=0x7f5f1c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 --2- 172.21.15.80:0/2983012285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c0b1b40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009790 tx=0x7f5f0c02a1c0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 -- 172.21.15.80:0/2983012285 shutdown_connections 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 --2- 172.21.15.80:0/2983012285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c0b1b40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 -- 172.21.15.80:0/2983012285 >> 172.21.15.80:0/2983012285 conn(0x7f5f1c09b600 msgr2=0x7f5f1c09ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 -- 172.21.15.80:0/2983012285 shutdown_connections 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.524+0000 7f5f21034640 1 -- 172.21.15.80:0/2983012285 wait complete. 2024-04-25T15:47:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.526+0000 7f5f21034640 1 Processor -- start 2024-04-25T15:47:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.526+0000 7f5f21034640 1 -- start start 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.527+0000 7f5f21034640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 0x7f5f1c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.527+0000 7f5f21034640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f1c0ccf90 0x7f5f1c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.527+0000 7f5f21034640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.527+0000 7f5f21034640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c0cf340 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.527+0000 7f5f21034640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c0b2080 con 0x7f5f1c0cef30 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.527+0000 7f5f21034640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1c0d3120 con 0x7f5f1c0ccf90 2024-04-25T15:47:32.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 0x7f5f1c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 0x7f5f1c160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50226/0 (socket says 172.21.15.80:50226) 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/3499286236 learned_addr learned my addr 172.21.15.80:0/3499286236 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1b59e640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1a59c640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f1c0ccf90 0x7f5f1c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f1c0ccf90 msgr2=0x7f5f1c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f1c0ccf90 0x7f5f1c159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f1c0cef30 msgr2=0x7f5f1c161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 -- 172.21.15.80:0/3499286236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c0b15e0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1b59e640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1a59c640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f1c0ccf90 0x7f5f1c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f1ad9d640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 0x7f5f1c160b10 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000c00 tx=0x7f5f0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c042070 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c004240 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c037040 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1c1633f0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.528+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1c1639b0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.529+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1c050740 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.530+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5f0c005990 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.530+0000 7f5f037fe640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5f080744b0 0x7f5f080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.531+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f5f0c0b6170 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.531+0000 7f5f1a59c640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5f080744b0 0x7f5f080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.531+0000 7f5f1a59c640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5f080744b0 0x7f5f080769c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5f10000f60 tx=0x7f5f10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.535+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f0c0806c0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.710+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f1c0cf500 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.710+0000 7f5f037fe640 1 -- 172.21.15.80:0/3499286236 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7f5f0c07ffc0 con 0x7f5f1c0b76a0 2024-04-25T15:47:32.712 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.712+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5f080744b0 msgr2=0x7f5f080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.712+0000 7f5f21034640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5f080744b0 0x7f5f080769c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5f10000f60 tx=0x7f5f10009040 comp rx=0 tx=0).stop 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.712+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 msgr2=0x7f5f1c160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.712+0000 7f5f21034640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 0x7f5f1c160b10 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000c00 tx=0x7f5f0c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 shutdown_connections 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f5f080744b0 0x7f5f080769c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f1c0cef30 0x7f5f1c161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f1c0ccf90 0x7f5f1c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 --2- 172.21.15.80:0/3499286236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f1c0b76a0 0x7f5f1c160b10 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 >> 172.21.15.80:0/3499286236 conn(0x7f5f1c09b600 msgr2=0x7f5f1c0b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 shutdown_connections 2024-04-25T15:47:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.713+0000 7f5f21034640 1 -- 172.21.15.80:0/3499286236 wait complete. 2024-04-25T15:47:32.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:47:32.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.833+0000 7fc6d7f97640 1 Processor -- start 2024-04-25T15:47:32.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.833+0000 7fc6d7f97640 1 -- start start 2024-04-25T15:47:32.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d7f97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6d00b7db0 0x7fc6d00cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d7f97640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d006edf0 con 0x7fc6d00b3d60 2024-04-25T15:47:32.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d7f97640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d006eb10 con 0x7fc6d015d2d0 2024-04-25T15:47:32.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d7f97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d0160db0 con 0x7fc6d00b7db0 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d5532640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6d00b3d60 0x7fc6d00b76a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37336/0 (socket says 172.21.15.80:37336) 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d5532640 1 -- 172.21.15.80:0/3128381186 learned_addr learned my addr 172.21.15.80:0/3128381186 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6d00b7db0 0x7fc6d00cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.834+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114231800 0 0) 0x7fc6d006edf0 con 0x7fc6d00b3d60 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6bc003520 con 0x7fc6d00b3d60 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747719229 0 0) 0x7fc6d006eb10 con 0x7fc6d015d2d0 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d006edf0 con 0x7fc6d015d2d0 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125103636 0 0) 0x7fc6bc003520 con 0x7fc6d00b3d60 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6d00b7db0 msgr2=0x7fc6d00cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6d00b7db0 0x7fc6d00cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 >> v1:172.21.15.195:6789/0 conn(0x7fc6d015d2d0 legacy=0x7fc6d01615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d0161090 con 0x7fc6d00b3d60 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fc6c0001670 con 0x7fc6d00b3d60 2024-04-25T15:47:32.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6d00b7db0 0x7fc6d00cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 >> v1:172.21.15.80:6789/0 conn(0x7fc6d00b3d60 legacy=0x7fc6d00b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc003b70 0x7fc6bc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6bc004800 0x7fc6bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6bc005150 0x7fc6bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0160db0 con 0x7fc6bc004800 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc00bfe0 con 0x7fc6bc005150 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc00c1e0 con 0x7fc6bc003b70 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5532640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6bc004800 0x7fc6bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5d33640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc003b70 0x7fc6bc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6bc005150 0x7fc6bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5532640 1 -- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc003b70 msgr2=0x7fc6bc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5532640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc003b70 0x7fc6bc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5532640 1 -- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6bc005150 msgr2=0x7fc6bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5532640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6bc005150 0x7fc6bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5532640 1 -- 172.21.15.80:0/3128381186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc003520 con 0x7fc6bc004800 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d5d33640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc003b70 0x7fc6bc003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.835+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6bc005150 0x7fc6bc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.836+0000 7fc6d5532640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6bc004800 0x7fc6bc004c10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0007ca0 tx=0x7fc6bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400464414093860d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.836+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0007ce0 con 0x7fc6bc004800 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.836+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c0036070 con 0x7fc6bc004800 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.836+0000 7fc6d4d31640 1 -- 172.21.15.80:0/3128381186 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0005d90 con 0x7fc6bc004800 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3128381186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6bc004800 msgr2=0x7fc6bc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3128381186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6bc004800 0x7fc6bc004c10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0007ca0 tx=0x7fc6bc005830 comp rx=0 tx=0).stop 2024-04-25T15:47:32.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d6534640 1 -- 172.21.15.80:0/3128381186 reap_dead start 2024-04-25T15:47:32.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3128381186 shutdown_connections 2024-04-25T15:47:32.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3128381186 >> 172.21.15.80:0/3128381186 conn(0x7fc6d009b600 msgr2=0x7fc6d009ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:32.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3128381186 shutdown_connections 2024-04-25T15:47:32.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.837+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3128381186 wait complete. 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.839+0000 7fc6d7f97640 1 Processor -- start 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.839+0000 7fc6d7f97640 1 -- start start 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d7f97640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc004800 0x7fc6d0153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d7f97640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d01560d0 0x7fc6d0158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d7f97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 0x7fc6d0158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d7f97640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d00b7f30 con 0x7fc6d01564e0 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d7f97640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d00b7db0 con 0x7fc6d01560d0 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d7f97640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d00cfe80 con 0x7fc6bc004800 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 0x7fc6d0158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 0x7fc6d0158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50244/0 (socket says 172.21.15.80:50244) 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 -- 172.21.15.80:0/3569827230 learned_addr learned my addr 172.21.15.80:0/3569827230 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:32.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d5532640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d01560d0 0x7fc6d0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d5d33640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc004800 0x7fc6d0153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 -- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc004800 msgr2=0x7fc6d0153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc004800 0x7fc6d0153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 -- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d01560d0 msgr2=0x7fc6d0158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d01560d0 0x7fc6d0158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 -- 172.21.15.80:0/3569827230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d0154370 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.840+0000 7fc6d6534640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 0x7fc6d0158c70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0074150 tx=0x7fc6c8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.841+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8004440 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.841+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c801b070 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.841+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d015c070 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.841+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8003830 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.841+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d015c630 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.842+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d0050740 con 0x7fc6d01564e0 2024-04-25T15:47:32.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.842+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc6c80039d0 con 0x7fc6d01564e0 2024-04-25T15:47:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.843+0000 7fc6c67fc640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6b40744b0 0x7fc6b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.843+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fc6c8095740 con 0x7fc6d01564e0 2024-04-25T15:47:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.843+0000 7fc6d5d33640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6b40744b0 0x7fc6b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.843+0000 7fc6d5d33640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6b40744b0 0x7fc6b40769c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0073ab0 tx=0x7fc6cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:32.847+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6d0154370 con 0x7fc6d01564e0 2024-04-25T15:47:33.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.021+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc6d00d1e90 con 0x7fc6d01564e0 2024-04-25T15:47:33.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.022+0000 7fc6c67fc640 1 -- 172.21.15.80:0/3569827230 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7fc6c805fd20 con 0x7fc6d01564e0 2024-04-25T15:47:33.023 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6b40744b0 msgr2=0x7fc6b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6b40744b0 0x7fc6b40769c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0073ab0 tx=0x7fc6cc009040 comp rx=0 tx=0).stop 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 msgr2=0x7fc6d0158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 0x7fc6d0158c70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0074150 tx=0x7fc6c8011920 comp rx=0 tx=0).stop 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 shutdown_connections 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6b40744b0 0x7fc6b40769c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6d01564e0 0x7fc6d0158c70 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d01560d0 0x7fc6d0158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.023+0000 7fc6d7f97640 1 --2- 172.21.15.80:0/3569827230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6bc004800 0x7fc6d0153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.024+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 >> 172.21.15.80:0/3569827230 conn(0x7fc6d009b600 msgr2=0x7fc6d00b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.024+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 shutdown_connections 2024-04-25T15:47:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.024+0000 7fc6d7f97640 1 -- 172.21.15.80:0/3569827230 wait complete. 2024-04-25T15:47:33.035 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:47:33.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.145+0000 7f7391a53640 1 Processor -- start 2024-04-25T15:47:33.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.145+0000 7f7391a53640 1 -- start start 2024-04-25T15:47:33.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f7391a53640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f738c0ce510 0x7f738c0b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f7391a53640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c15e1d0 0x7f738c161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f7391a53640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f738c0b5510 0x7f738c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f7391a53640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f738c0b5e60 con 0x7f738c0ce510 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f7391a53640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f738c15e5e0 con 0x7f738c0b5510 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f7391a53640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f738c162bc0 con 0x7f738c15e1d0 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f738affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f738c0ce510 0x7f738c0b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f738affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f738c0ce510 0x7f738c0b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50248/0 (socket says 172.21.15.80:50248) 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.146+0000 7f738affd640 1 -- 172.21.15.80:0/2187124069 learned_addr learned my addr 172.21.15.80:0/2187124069 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738b7fe640 1 --2- 172.21.15.80:0/2187124069 >> v2:172.21.15.195:3300/0 conn(0x7f738c0b5510 0x7f738c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738affd640 1 -- 172.21.15.80:0/2187124069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c15e1d0 msgr2=0x7f738c161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:33.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738a7fc640 1 --2- 172.21.15.80:0/2187124069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c15e1d0 0x7f738c161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738affd640 1 --2- 172.21.15.80:0/2187124069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c15e1d0 0x7f738c161cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738affd640 1 -- 172.21.15.80:0/2187124069 >> v2:172.21.15.195:3300/0 conn(0x7f738c0b5510 msgr2=0x7f738c0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738affd640 1 --2- 172.21.15.80:0/2187124069 >> v2:172.21.15.195:3300/0 conn(0x7f738c0b5510 0x7f738c0b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738affd640 1 -- 172.21.15.80:0/2187124069 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c162600 con 0x7f738c0ce510 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738b7fe640 1 --2- 172.21.15.80:0/2187124069 >> v2:172.21.15.195:3300/0 conn(0x7f738c0b5510 0x7f738c0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f738affd640 1 --2- 172.21.15.80:0/2187124069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c0b6d70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f738c0d02b0 tx=0x7f738402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a632d62f0e4eae41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.147+0000 7f7389ffb640 1 -- 172.21.15.80:0/2187124069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384036070 con 0x7f738c0ce510 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7389ffb640 1 -- 172.21.15.80:0/2187124069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7384031600 con 0x7f738c0ce510 2024-04-25T15:47:33.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7389ffb640 1 -- 172.21.15.80:0/2187124069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73840319d0 con 0x7f738c0ce510 2024-04-25T15:47:33.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 -- 172.21.15.80:0/2187124069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 msgr2=0x7f738c0b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 --2- 172.21.15.80:0/2187124069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c0b6d70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f738c0d02b0 tx=0x7f738402a610 comp rx=0 tx=0).stop 2024-04-25T15:47:33.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 -- 172.21.15.80:0/2187124069 shutdown_connections 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 --2- 172.21.15.80:0/2187124069 >> v2:172.21.15.195:3300/0 conn(0x7f738c0b5510 0x7f738c0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 --2- 172.21.15.80:0/2187124069 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c15e1d0 0x7f738c161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 --2- 172.21.15.80:0/2187124069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c0b6d70 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 -- 172.21.15.80:0/2187124069 >> 172.21.15.80:0/2187124069 conn(0x7f738c0d0510 msgr2=0x7f738c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 -- 172.21.15.80:0/2187124069 shutdown_connections 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.148+0000 7f7391a53640 1 -- 172.21.15.80:0/2187124069 wait complete. 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.150+0000 7f7391a53640 1 Processor -- start 2024-04-25T15:47:33.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.150+0000 7f7391a53640 1 -- start start 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.151+0000 7f7391a53640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c0b5510 0x7f738c1e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.151+0000 7f7391a53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.151+0000 7f7391a53640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f738c15e1d0 0x7f738c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.151+0000 7f7391a53640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f738c0d24f0 con 0x7f738c0ce510 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.151+0000 7f7391a53640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f738c0d2210 con 0x7f738c15e1d0 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.151+0000 7f7391a53640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f738c162210 con 0x7f738c0b5510 2024-04-25T15:47:33.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50256/0 (socket says 172.21.15.80:50256) 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 -- 172.21.15.80:0/1225012972 learned_addr learned my addr 172.21.15.80:0/1225012972 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738b7fe640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f738c15e1d0 0x7f738c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738affd640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c0b5510 0x7f738c1e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 -- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c0b5510 msgr2=0x7f738c1e90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c0b5510 0x7f738c1e90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 -- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f738c15e1d0 msgr2=0x7f738c156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f738c15e1d0 0x7f738c156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 -- 172.21.15.80:0/1225012972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c1e8040 con 0x7f738c0ce510 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738b7fe640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f738c15e1d0 0x7f738c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738affd640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c0b5510 0x7f738c1e90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f738a7fc640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c155840 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f737400c7f0 tx=0x7f737400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374015070 con 0x7f738c0ce510 2024-04-25T15:47:33.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7374004220 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c1e8320 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374007620 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.152+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1e88e0 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.153+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c1e7db0 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.154+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f73740077c0 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.154+0000 7f7383fff640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f736c0744b0 0x7f736c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.154+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f7374095530 con 0x7f738c0ce510 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.154+0000 7f738affd640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f736c0744b0 0x7f736c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.155+0000 7f738affd640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f736c0744b0 0x7f736c0769c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7384033000 tx=0x7f7384009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.159+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f737405fa80 con 0x7f738c0ce510 2024-04-25T15:47:33.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.337+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f738c050740 con 0x7f738c0ce510 2024-04-25T15:47:33.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.338+0000 7f7383fff640 1 -- 172.21.15.80:0/1225012972 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7f737405f380 con 0x7f738c0ce510 2024-04-25T15:47:33.339 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T15:47:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f736c0744b0 msgr2=0x7f736c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f736c0744b0 0x7f736c0769c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7384033000 tx=0x7f7384009000 comp rx=0 tx=0).stop 2024-04-25T15:47:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 msgr2=0x7f738c155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c155840 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f737400c7f0 tx=0x7f737400ccb0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 shutdown_connections 2024-04-25T15:47:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f736c0744b0 0x7f736c0769c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f738c15e1d0 0x7f738c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f738c0ce510 0x7f738c155840 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 --2- 172.21.15.80:0/1225012972 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f738c0b5510 0x7f738c1e90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 >> 172.21.15.80:0/1225012972 conn(0x7f738c0d0510 msgr2=0x7f738c0b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 shutdown_connections 2024-04-25T15:47:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.340+0000 7f7391a53640 1 -- 172.21.15.80:0/1225012972 wait complete. 2024-04-25T15:47:33.352 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:33.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.458+0000 7f16b6013640 1 Processor -- start 2024-04-25T15:47:33.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.458+0000 7f16b6013640 1 -- start start 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.459+0000 7f16b6013640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16b00b2f40 0x7f16b00b5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.459+0000 7f16b6013640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00d2970 0x7f16b015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.459+0000 7f16b6013640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b00b6f90 con 0x7f16b00b5b60 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.459+0000 7f16b6013640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f16b00ce9c0 con 0x7f16b00b2f40 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.459+0000 7f16b6013640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f16b00b5f70 con 0x7f16b00d2970 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16b00b2f40 0x7f16b00b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16b00b2f40 0x7f16b00b5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50268/0 (socket says 172.21.15.80:50268) 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16aeffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f16b00b5b60 0x7f16b00d2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37348/0 (socket says 172.21.15.80:37348) 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 -- 172.21.15.80:0/1041098461 learned_addr learned my addr 172.21.15.80:0/1041098461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:33.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 -- 172.21.15.80:0/1041098461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00d2970 msgr2=0x7f16b015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:33.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 --2- 172.21.15.80:0/1041098461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00d2970 0x7f16b015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 -- 172.21.15.80:0/1041098461 >> v1:172.21.15.80:6789/0 conn(0x7f16b00b5b60 legacy=0x7f16b00d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16af7fe640 1 -- 172.21.15.80:0/1041098461 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b00d2e40 con 0x7f16b00b2f40 2024-04-25T15:47:33.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.460+0000 7f16ae7fc640 1 -- 172.21.15.80:0/1041098461 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950759855 0 0) 0x7f16a4001110 con 0x7f16b00b5b60 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16af7fe640 1 --2- 172.21.15.80:0/1041098461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00b2f40 0x7f16b00b5620 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009870 tx=0x7f16a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe98ba93bfd91aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16ae7fc640 1 -- 172.21.15.80:0/1041098461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0037070 con 0x7f16b00b2f40 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16ae7fc640 1 -- 172.21.15.80:0/1041098461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a0032440 con 0x7f16b00b2f40 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16ae7fc640 1 -- 172.21.15.80:0/1041098461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0032810 con 0x7f16b00b2f40 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 -- 172.21.15.80:0/1041098461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00b2f40 msgr2=0x7f16b00b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 --2- 172.21.15.80:0/1041098461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00b2f40 0x7f16b00b5620 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009870 tx=0x7f16a002a270 comp rx=0 tx=0).stop 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 -- 172.21.15.80:0/1041098461 shutdown_connections 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 --2- 172.21.15.80:0/1041098461 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00d2970 0x7f16b015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 --2- 172.21.15.80:0/1041098461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00b2f40 0x7f16b00b5620 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 -- 172.21.15.80:0/1041098461 >> 172.21.15.80:0/1041098461 conn(0x7f16b00d0800 msgr2=0x7f16b00d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:33.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 -- 172.21.15.80:0/1041098461 shutdown_connections 2024-04-25T15:47:33.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.461+0000 7f16b6013640 1 -- 172.21.15.80:0/1041098461 wait complete. 2024-04-25T15:47:33.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.463+0000 7f16b6013640 1 Processor -- start 2024-04-25T15:47:33.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.463+0000 7f16b6013640 1 -- start start 2024-04-25T15:47:33.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16b6013640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16b00b2f40 0x7f16b015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16b6013640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00b5b60 0x7f16b01f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16b6013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 0x7f16b00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16b6013640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f16b00d36e0 con 0x7f16b00d2970 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16b6013640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f16b00d3400 con 0x7f16b00b2f40 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16b6013640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f16b00b3350 con 0x7f16b00b5b60 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 0x7f16b00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 0x7f16b00ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50270/0 (socket says 172.21.15.80:50270) 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 -- 172.21.15.80:0/606946792 learned_addr learned my addr 172.21.15.80:0/606946792 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16af7fe640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16b00b2f40 0x7f16b015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16aeffd640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00b5b60 0x7f16b01f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 -- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00b5b60 msgr2=0x7f16b01f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00b5b60 0x7f16b01f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 -- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16b00b2f40 msgr2=0x7f16b015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16b00b2f40 0x7f16b015aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 -- 172.21.15.80:0/606946792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b00ca170 con 0x7f16b00d2970 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f16affff640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 0x7f16b00ca930 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f16a800b9a0 tx=0x7f16a800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.465+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8019070 con 0x7f16b00d2970 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.466+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a800cbc0 con 0x7f16b00d2970 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.466+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8014440 con 0x7f16b00d2970 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.466+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b015a020 con 0x7f16b00d2970 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.466+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b015a2c0 con 0x7f16b00d2970 2024-04-25T15:47:33.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.466+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b0050740 con 0x7f16b00d2970 2024-04-25T15:47:33.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.467+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f16a801c070 con 0x7f16b00d2970 2024-04-25T15:47:33.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.468+0000 7f1697fff640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f169c0744e0 0x7f169c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.468+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f16a8095070 con 0x7f16b00d2970 2024-04-25T15:47:33.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.468+0000 7f16af7fe640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f169c0744e0 0x7f169c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.468+0000 7f16af7fe640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f169c0744e0 0x7f169c0769f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f16a0034000 tx=0x7f16a002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.472+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f16a805f000 con 0x7f16b00d2970 2024-04-25T15:47:33.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.681+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16b00b3660 con 0x7f16b00d2970 2024-04-25T15:47:33.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.682+0000 7f1697fff640 1 -- 172.21.15.80:0/606946792 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5211 (secure 0 0 0) 0x7f16a8063300 con 0x7f16b00d2970 2024-04-25T15:47:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:33.683 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:25.523016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7824,"mds_1":7839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7839":{"gid":7839,"name":"a","rank":1,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7839,7824]},"id":7}]} 2024-04-25T15:47:33.684 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 63 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f169c0744e0 msgr2=0x7f169c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f169c0744e0 0x7f169c0769f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f16a0034000 tx=0x7f16a002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 msgr2=0x7f16b00ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 0x7f16b00ca930 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f16a800b9a0 tx=0x7f16a800be60 comp rx=0 tx=0).stop 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 shutdown_connections 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f169c0744e0 0x7f169c0769f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b00d2970 0x7f16b00ca930 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16b00b5b60 0x7f16b01f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 --2- 172.21.15.80:0/606946792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16b00b2f40 0x7f16b015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 >> 172.21.15.80:0/606946792 conn(0x7f16b00d0800 msgr2=0x7f16b00b8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:33.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 shutdown_connections 2024-04-25T15:47:33.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.684+0000 7f16b6013640 1 -- 172.21.15.80:0/606946792 wait complete. 2024-04-25T15:47:33.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:33.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.802+0000 7f912db57640 1 Processor -- start 2024-04-25T15:47:33.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.802+0000 7f912db57640 1 -- start start 2024-04-25T15:47:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.803+0000 7f912db57640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91280d2990 0x7f91280d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.803+0000 7f912db57640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91280d32e0 con 0x7f912815d690 2024-04-25T15:47:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.803+0000 7f912db57640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91280b27a0 con 0x7f91280b2390 2024-04-25T15:47:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.803+0000 7f912db57640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f91280b2a70 con 0x7f91280d2990 2024-04-25T15:47:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9126ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91280d2990 0x7f91280d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9127fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f912815d690 0x7f912815daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37354/0 (socket says 172.21.15.80:37354) 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9126ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91280d2990 0x7f91280d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50284/0 (socket says 172.21.15.80:50284) 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9127fff640 1 -- 172.21.15.80:0/3852787627 learned_addr learned my addr 172.21.15.80:0/3852787627 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9126ffd640 1 -- 172.21.15.80:0/3852787627 >> v1:172.21.15.195:6789/0 conn(0x7f91280b2390 legacy=0x7f91280cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9126ffd640 1 -- 172.21.15.80:0/3852787627 >> v1:172.21.15.80:6789/0 conn(0x7f912815d690 legacy=0x7f912815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f91267fc640 1 -- 172.21.15.80:0/3852787627 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041380637 0 0) 0x7f91280d32e0 con 0x7f912815d690 2024-04-25T15:47:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.804+0000 7f9126ffd640 1 -- 172.21.15.80:0/3852787627 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91280b2d50 con 0x7f91280d2990 2024-04-25T15:47:33.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f9126ffd640 1 --2- 172.21.15.80:0/3852787627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d2990 0x7f91280d2da0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f911c0097d0 tx=0x7f911c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dcaed477445c9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f91267fc640 1 -- 172.21.15.80:0/3852787627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c037070 con 0x7f91280d2990 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f91267fc640 1 -- 172.21.15.80:0/3852787627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c032440 con 0x7f91280d2990 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f91267fc640 1 -- 172.21.15.80:0/3852787627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c032810 con 0x7f91280d2990 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 -- 172.21.15.80:0/3852787627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d2990 msgr2=0x7f91280d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 --2- 172.21.15.80:0/3852787627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d2990 0x7f91280d2da0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f911c0097d0 tx=0x7f911c02a270 comp rx=0 tx=0).stop 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 -- 172.21.15.80:0/3852787627 shutdown_connections 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 --2- 172.21.15.80:0/3852787627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d2990 0x7f91280d2da0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 -- 172.21.15.80:0/3852787627 >> 172.21.15.80:0/3852787627 conn(0x7f91280746b0 msgr2=0x7f91280b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 -- 172.21.15.80:0/3852787627 shutdown_connections 2024-04-25T15:47:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.805+0000 7f912db57640 1 -- 172.21.15.80:0/3852787627 wait complete. 2024-04-25T15:47:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.807+0000 7f912db57640 1 Processor -- start 2024-04-25T15:47:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.807+0000 7f912db57640 1 -- start start 2024-04-25T15:47:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91280b2390 0x7f91280c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91280d2990 0x7f91281480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 0x7f91281485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f91280b35f0 con 0x7f912815d690 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f91280b3310 con 0x7f91280d2990 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f91280cf630 con 0x7f91280b2390 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 0x7f91281485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 0x7f91281485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50300/0 (socket says 172.21.15.80:50300) 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 -- 172.21.15.80:0/1963428559 learned_addr learned my addr 172.21.15.80:0/1963428559 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9126ffd640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91280d2990 0x7f91281480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f91277fe640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91280b2390 0x7f91280c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 -- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91280b2390 msgr2=0x7f91280c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91280b2390 0x7f91280c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 -- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91280d2990 msgr2=0x7f91281480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91280d2990 0x7f91281480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 -- 172.21.15.80:0/1963428559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128147010 con 0x7f912815d690 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f9127fff640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 0x7f91281485f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f912000c700 tx=0x7f912000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120018070 con 0x7f912815d690 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912000ce10 con 0x7f912815d690 2024-04-25T15:47:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281472f0 con 0x7f912815d690 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912000a820 con 0x7f912815d690 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.809+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91281478b0 con 0x7f912815d690 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.810+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9128050740 con 0x7f912815d690 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.811+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f912001b070 con 0x7f912815d690 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.811+0000 7f910ffff640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91140744b0 0x7f91140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.811+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f91200947f0 con 0x7f912815d690 2024-04-25T15:47:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.811+0000 7f91277fe640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91140744b0 0x7f91140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:33.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.812+0000 7f91277fe640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91140744b0 0x7f91140769c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9118007fd0 tx=0x7f9118009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:33.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.816+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f912005e780 con 0x7f912815d690 2024-04-25T15:47:33.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.994+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f912806f8f0 con 0x7f912815d690 2024-04-25T15:47:33.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.995+0000 7f910ffff640 1 -- 172.21.15.80:0/1963428559 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17123 (secure 0 0 0) 0x7f9120062a80 con 0x7f912815d690 2024-04-25T15:47:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:33.997 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:47:11.149672+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6834/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.195:6832/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.80:6836/3726019359":"2024-04-26T15:47:10.413739+0000","172.21.15.80:6834/3726019359":"2024-04-26T15:47:10.413739+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91140744b0 msgr2=0x7f91140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91140744b0 0x7f91140769c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9118007fd0 tx=0x7f9118009040 comp rx=0 tx=0).stop 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 msgr2=0x7f91281485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 0x7f91281485f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f912000c700 tx=0x7f912000cbc0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 shutdown_connections 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f91140744b0 0x7f91140769c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912815d690 0x7f91281485f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91280d2990 0x7f91281480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 --2- 172.21.15.80:0/1963428559 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91280b2390 0x7f91280c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 >> 172.21.15.80:0/1963428559 conn(0x7f91280746b0 msgr2=0x7f91280b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:34.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 shutdown_connections 2024-04-25T15:47:34.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:33.997+0000 7f912db57640 1 -- 172.21.15.80:0/1963428559 wait complete. 2024-04-25T15:47:34.010 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:47:34.010 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:34.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.116+0000 7f3cd70e7640 1 Processor -- start 2024-04-25T15:47:34.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.116+0000 7f3cd70e7640 1 -- start start 2024-04-25T15:47:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3cd70e7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3cd00d2990 0x7f3cd00d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3cd70e7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3cd015d690 0x7f3cd015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3cd70e7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00d32e0 con 0x7f3cd00b2390 2024-04-25T15:47:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3cd70e7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00b27a0 con 0x7f3cd00d2990 2024-04-25T15:47:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3cd70e7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00b2a70 con 0x7f3cd015d690 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3cd00d2990 0x7f3cd00d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3cd00d2990 0x7f3cd00d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50312/0 (socket says 172.21.15.80:50312) 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 -- 172.21.15.80:0/229135112 learned_addr learned my addr 172.21.15.80:0/229135112 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3cd5684640 1 --2- 172.21.15.80:0/229135112 >> v2:172.21.15.195:3300/0 conn(0x7f3cd015d690 0x7f3cd015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 -- 172.21.15.80:0/229135112 >> v2:172.21.15.195:3300/0 conn(0x7f3cd015d690 msgr2=0x7f3cd015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 --2- 172.21.15.80:0/229135112 >> v2:172.21.15.195:3300/0 conn(0x7f3cd015d690 0x7f3cd015daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 -- 172.21.15.80:0/229135112 >> v1:172.21.15.195:6789/0 conn(0x7f3cd00b2390 legacy=0x7f3cd00cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:34.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.118+0000 7f3ccffff640 1 -- 172.21.15.80:0/229135112 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00b2d50 con 0x7f3cd00d2990 2024-04-25T15:47:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.119+0000 7f3ccffff640 1 --2- 172.21.15.80:0/229135112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd00d2990 0x7f3cd00d2da0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009870 tx=0x7f3cc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4a26a55d383add server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.119+0000 7f3ccf7fe640 1 -- 172.21.15.80:0/229135112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4037070 con 0x7f3cd00d2990 2024-04-25T15:47:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.119+0000 7f3ccf7fe640 1 -- 172.21.15.80:0/229135112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc4032440 con 0x7f3cd00d2990 2024-04-25T15:47:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.119+0000 7f3ccf7fe640 1 -- 172.21.15.80:0/229135112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4032810 con 0x7f3cd00d2990 2024-04-25T15:47:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 -- 172.21.15.80:0/229135112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd00d2990 msgr2=0x7f3cd00d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/229135112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd00d2990 0x7f3cd00d2da0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009870 tx=0x7f3cc402a270 comp rx=0 tx=0).stop 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 -- 172.21.15.80:0/229135112 shutdown_connections 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/229135112 >> v2:172.21.15.195:3300/0 conn(0x7f3cd015d690 0x7f3cd015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/229135112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd00d2990 0x7f3cd00d2da0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 -- 172.21.15.80:0/229135112 >> 172.21.15.80:0/229135112 conn(0x7f3cd00746b0 msgr2=0x7f3cd00b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 -- 172.21.15.80:0/229135112 shutdown_connections 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.120+0000 7f3cd70e7640 1 -- 172.21.15.80:0/229135112 wait complete. 2024-04-25T15:47:34.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.122+0000 7f3cd70e7640 1 Processor -- start 2024-04-25T15:47:34.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.122+0000 7f3cd70e7640 1 -- start start 2024-04-25T15:47:34.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd70e7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3cd00b2390 0x7f3cd01f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd70e7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cd00d2990 0x7f3cd015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd70e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 0x7f3cd015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd70e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00b35f0 con 0x7f3cd015d690 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd70e7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00b3310 con 0x7f3cd00d2990 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd70e7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd00cf630 con 0x7f3cd00b2390 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 0x7f3cd015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 0x7f3cd015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50326/0 (socket says 172.21.15.80:50326) 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 -- 172.21.15.80:0/2804797977 learned_addr learned my addr 172.21.15.80:0/2804797977 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3ccffff640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cd00d2990 0x7f3cd015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd4e83640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3cd00b2390 0x7f3cd01f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 -- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3cd00b2390 msgr2=0x7f3cd01f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3cd00b2390 0x7f3cd01f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 -- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cd00d2990 msgr2=0x7f3cd015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cd00d2990 0x7f3cd015ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3cd5684640 1 -- 172.21.15.80:0/2804797977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd01604a0 con 0x7f3cd015d690 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.123+0000 7f3ccffff640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cd00d2990 0x7f3cd015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.124+0000 7f3cd5684640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 0x7f3cd015eaf0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8007d80 tx=0x7f3cc800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.124+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8014420 con 0x7f3cd015d690 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.124+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc8019070 con 0x7f3cd015d690 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.124+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd0158f50 con 0x7f3cd015d690 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.124+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8014800 con 0x7f3cd015d690 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.124+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd0159510 con 0x7f3cd015d690 2024-04-25T15:47:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.125+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd0050740 con 0x7f3cd015d690 2024-04-25T15:47:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.125+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3cc80149a0 con 0x7f3cd015d690 2024-04-25T15:47:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.126+0000 7f3ccd7fa640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3cbc0744e0 0x7f3cbc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.126+0000 7f3cd4e83640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3cbc0744e0 0x7f3cbc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.126+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f3cc8095c50 con 0x7f3cd015d690 2024-04-25T15:47:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.127+0000 7f3cd4e83640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3cbc0744e0 0x7f3cbc0769f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000b7f0 tx=0x7f3cc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.131+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3cc809b020 con 0x7f3cd015d690 2024-04-25T15:47:34.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:34.328 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:34.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.344+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cd00a0920 con 0x7f3cd015d690 2024-04-25T15:47:34.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.345+0000 7f3ccd7fa640 1 -- 172.21.15.80:0/2804797977 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5211 (secure 0 0 0) 0x7f3cd01604a0 con 0x7f3cd015d690 2024-04-25T15:47:34.346 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:34.346 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:25.523016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7824,"mds_1":7839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7839":{"gid":7839,"name":"a","rank":1,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7839,7824]},"id":7}]} 2024-04-25T15:47:34.346 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 63 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3cbc0744e0 msgr2=0x7f3cbc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3cbc0744e0 0x7f3cbc0769f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000b7f0 tx=0x7f3cc0008040 comp rx=0 tx=0).stop 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 msgr2=0x7f3cd015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 0x7f3cd015eaf0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8007d80 tx=0x7f3cc800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 shutdown_connections 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3cbc0744e0 0x7f3cbc0769f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd015d690 0x7f3cd015eaf0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cd00d2990 0x7f3cd015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 --2- 172.21.15.80:0/2804797977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3cd00b2390 0x7f3cd01f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 >> 172.21.15.80:0/2804797977 conn(0x7f3cd00746b0 msgr2=0x7f3cd006ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:34.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 shutdown_connections 2024-04-25T15:47:34.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.347+0000 7f3cd70e7640 1 -- 172.21.15.80:0/2804797977 wait complete. 2024-04-25T15:47:34.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:47:34.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.517+0000 7f02804d9640 1 Processor -- start 2024-04-25T15:47:34.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.517+0000 7f02804d9640 1 -- start start 2024-04-25T15:47:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f02804d9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02780d0dd0 0x7f0278160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f02804d9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027806c6f0 con 0x7f027815d2c0 2024-04-25T15:47:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f02804d9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027806c9d0 con 0x7f02780d14a0 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f02804d9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f02780d02f0 con 0x7f02780d0dd0 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027ea76640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f02780d0dd0 0x7f0278160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027e275640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f027815d2c0 0x7f027806f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33584/0 (socket says 172.21.15.80:33584) 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027e275640 1 -- 172.21.15.80:0/1362333968 learned_addr learned my addr 172.21.15.80:0/1362333968 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027ea76640 1 -- 172.21.15.80:0/1362333968 >> v1:172.21.15.195:6789/0 conn(0x7f02780d14a0 legacy=0x7f027806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027ea76640 1 -- 172.21.15.80:0/1362333968 >> v1:172.21.15.80:6789/0 conn(0x7f027815d2c0 legacy=0x7f027806f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027d273640 1 -- 172.21.15.80:0/1362333968 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332318661 0 0) 0x7f027806c6f0 con 0x7f027815d2c0 2024-04-25T15:47:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.519+0000 7f027ea76640 1 -- 172.21.15.80:0/1362333968 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02780d05d0 con 0x7f02780d0dd0 2024-04-25T15:47:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.520+0000 7f027ea76640 1 --2- 172.21.15.80:0/1362333968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02780d0dd0 0x7f0278160ca0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f02700097a0 tx=0x7f027002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679e5128774ce1bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.520+0000 7f027d273640 1 -- 172.21.15.80:0/1362333968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270037070 con 0x7f02780d0dd0 2024-04-25T15:47:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.520+0000 7f027d273640 1 -- 172.21.15.80:0/1362333968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027002ae50 con 0x7f02780d0dd0 2024-04-25T15:47:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.520+0000 7f027d273640 1 -- 172.21.15.80:0/1362333968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270032660 con 0x7f02780d0dd0 2024-04-25T15:47:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 -- 172.21.15.80:0/1362333968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02780d0dd0 msgr2=0x7f0278160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 --2- 172.21.15.80:0/1362333968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02780d0dd0 0x7f0278160ca0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f02700097a0 tx=0x7f027002a140 comp rx=0 tx=0).stop 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 -- 172.21.15.80:0/1362333968 shutdown_connections 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 --2- 172.21.15.80:0/1362333968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02780d0dd0 0x7f0278160ca0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 -- 172.21.15.80:0/1362333968 >> 172.21.15.80:0/1362333968 conn(0x7f02780ce420 msgr2=0x7f02780ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 -- 172.21.15.80:0/1362333968 shutdown_connections 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.521+0000 7f02804d9640 1 -- 172.21.15.80:0/1362333968 wait complete. 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.523+0000 7f02804d9640 1 Processor -- start 2024-04-25T15:47:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.523+0000 7f02804d9640 1 -- start start 2024-04-25T15:47:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f02804d9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02780d0dd0 0x7f02781542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f02804d9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02780d14a0 0x7f0278156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f02804d9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 0x7f027815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f02804d9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02780b12e0 con 0x7f027815d2c0 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f02804d9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f02780d11e0 con 0x7f02780d14a0 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f02804d9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f02780b1460 con 0x7f02780d0dd0 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f027ea76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 0x7f027815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f027ea76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 0x7f027815ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51018/0 (socket says 172.21.15.80:51018) 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f027ea76640 1 -- 172.21.15.80:0/2683073757 learned_addr learned my addr 172.21.15.80:0/2683073757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f027da74640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02780d14a0 0x7f0278156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.524+0000 7f027e275640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02780d0dd0 0x7f02781542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f027ea76640 1 -- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02780d0dd0 msgr2=0x7f02781542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f027ea76640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02780d0dd0 0x7f02781542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f027ea76640 1 -- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02780d14a0 msgr2=0x7f0278156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f027ea76640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02780d14a0 0x7f0278156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f027ea76640 1 -- 172.21.15.80:0/2683073757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0278154aa0 con 0x7f027815d2c0 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f027ea76640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 0x7f027815ea50 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f02700097a0 tx=0x7f02700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270042070 con 0x7f027815d2c0 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0270032e10 con 0x7f027815d2c0 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0278154d80 con 0x7f027815d2c0 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270037040 con 0x7f027815d2c0 2024-04-25T15:47:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.525+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02780afd70 con 0x7f027815d2c0 2024-04-25T15:47:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.526+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0278050740 con 0x7f027815d2c0 2024-04-25T15:47:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.526+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0270045070 con 0x7f027815d2c0 2024-04-25T15:47:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.527+0000 7f026effd640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f025c0744b0 0x7f025c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.527+0000 7f027e275640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f025c0744b0 0x7f025c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.527+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f02700b5d20 con 0x7f027815d2c0 2024-04-25T15:47:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.527+0000 7f027e275640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f025c0744b0 0x7f025c0769c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0274007ed0 tx=0x7f0274007e60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.532+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0270080270 con 0x7f027815d2c0 2024-04-25T15:47:34.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.742+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0278154830 con 0x7f027815d2c0 2024-04-25T15:47:34.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.743+0000 7f026effd640 1 -- 172.21.15.80:0/2683073757 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5211 (secure 0 0 0) 0x7f02700882f0 con 0x7f027815d2c0 2024-04-25T15:47:34.744 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:34.744 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:54.313611+0000","modified":"2024-04-25T15:47:25.523016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7824,"mds_1":7839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/3715281705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3715281705},{"type":"v1","addr":"172.21.15.80:6835","nonce":3715281705}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7839":{"gid":7839,"name":"a","rank":1,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/2599426974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2599426974},{"type":"v1","addr":"172.21.15.80:6837","nonce":2599426974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7824,"qdb_cluster":[7839,7824]},"id":7}]} 2024-04-25T15:47:34.745 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 63 2024-04-25T15:47:34.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f025c0744b0 msgr2=0x7f025c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f025c0744b0 0x7f025c0769c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0274007ed0 tx=0x7f0274007e60 comp rx=0 tx=0).stop 2024-04-25T15:47:34.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 msgr2=0x7f027815ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 0x7f027815ea50 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f02700097a0 tx=0x7f02700046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 shutdown_connections 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f025c0744b0 0x7f025c0769c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f027815d2c0 0x7f027815ea50 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02780d14a0 0x7f0278156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 --2- 172.21.15.80:0/2683073757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02780d0dd0 0x7f02781542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 >> 172.21.15.80:0/2683073757 conn(0x7f02780ce420 msgr2=0x7f0278159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 shutdown_connections 2024-04-25T15:47:34.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.745+0000 7f02804d9640 1 -- 172.21.15.80:0/2683073757 wait complete. 2024-04-25T15:47:34.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.863+0000 7fed568f2640 1 Processor -- start 2024-04-25T15:47:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.863+0000 7fed568f2640 1 -- start start 2024-04-25T15:47:34.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed568f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 0x7fed500b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed568f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed500b3d30 con 0x7fed500af7e0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed568f2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed500b1bd0 con 0x7fed500cfdc0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed568f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed500b2190 con 0x7fed500cf6c0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed54e8f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed500af7e0 0x7fed500b2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33596/0 (socket says 172.21.15.80:33596) 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed54e8f640 1 -- 172.21.15.80:0/106039404 learned_addr learned my addr 172.21.15.80:0/106039404 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4ffff640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 0x7fed500b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259387520 0 0) 0x7fed500b3d30 con 0x7fed500af7e0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed38003520 con 0x7fed500af7e0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 371570828 0 0) 0x7fed38003520 con 0x7fed500af7e0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 msgr2=0x7fed500b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 0x7fed500b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 >> v1:172.21.15.195:6789/0 conn(0x7fed500cfdc0 legacy=0x7fed500b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed500b1eb0 con 0x7fed500af7e0 2024-04-25T15:47:34.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fed480019f0 con 0x7fed500af7e0 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 >> v1:172.21.15.80:6789/0 conn(0x7fed500af7e0 legacy=0x7fed500b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 0x7fed380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed38004d40 0x7fed38005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed500b2190 con 0x7fed38003f40 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed3800bad0 con 0x7fed38004d40 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.865+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed3800bcd0 con 0x7fed500cf6c0 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4ffff640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 0x7fed380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed54e8f640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed38004d40 0x7fed38005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 -- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 msgr2=0x7fed380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed500cf6c0 0x7fed380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 -- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed38004d40 msgr2=0x7fed38005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed38004d40 0x7fed38005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 -- 172.21.15.80:0/106039404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed38003520 con 0x7fed38003f40 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.866+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed38004800 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fed50073970 tx=0x7fed38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e85bfb1e3c23279 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44037070 con 0x7fed38003f40 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4402abc0 con 0x7fed38003f40 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed4effd640 1 -- 172.21.15.80:0/106039404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44001480 con 0x7fed38003f40 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed568f2640 1 -- 172.21.15.80:0/106039404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 msgr2=0x7fed38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed568f2640 1 --2- 172.21.15.80:0/106039404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed38004800 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fed50073970 tx=0x7fed38005830 comp rx=0 tx=0).stop 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed54e8f640 1 -- 172.21.15.80:0/106039404 reap_dead start 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed568f2640 1 -- 172.21.15.80:0/106039404 shutdown_connections 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed568f2640 1 -- 172.21.15.80:0/106039404 >> 172.21.15.80:0/106039404 conn(0x7fed500746b0 msgr2=0x7fed500b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed568f2640 1 -- 172.21.15.80:0/106039404 shutdown_connections 2024-04-25T15:47:34.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.867+0000 7fed568f2640 1 -- 172.21.15.80:0/106039404 wait complete. 2024-04-25T15:47:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.869+0000 7fed568f2640 1 Processor -- start 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.869+0000 7fed568f2640 1 -- start start 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.870+0000 7fed568f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed500cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.870+0000 7fed568f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed500c8ed0 0x7fed50161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.870+0000 7fed568f2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed50161f40 0x7fed5015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.870+0000 7fed568f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed500b5140 con 0x7fed38003f40 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed568f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed500b4060 con 0x7fed500c8ed0 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed568f2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed500b52c0 con 0x7fed50161f40 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed500cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed500cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51044/0 (socket says 172.21.15.80:51044) 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 -- 172.21.15.80:0/529918830 learned_addr learned my addr 172.21.15.80:0/529918830 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed54e8f640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed50161f40 0x7fed5015fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed500c8ed0 0x7fed50161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 -- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed50161f40 msgr2=0x7fed5015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed50161f40 0x7fed5015fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 -- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed500c8ed0 msgr2=0x7fed50161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed500c8ed0 0x7fed50161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 -- 172.21.15.80:0/529918830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed50162350 con 0x7fed38003f40 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4ffff640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed500cc8d0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fed400118e0 tx=0x7fed40011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40005ba0 con 0x7fed38003f40 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40005d40 con 0x7fed38003f40 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4000fa40 con 0x7fed38003f40 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed500c7650 con 0x7fed38003f40 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.871+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed500c7c10 con 0x7fed38003f40 2024-04-25T15:47:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.872+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed50050740 con 0x7fed38003f40 2024-04-25T15:47:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.873+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed40012040 con 0x7fed38003f40 2024-04-25T15:47:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.874+0000 7fed4cff9640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed3c0744e0 0x7fed3c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.874+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed3c0744e0 0x7fed3c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.874+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7fed40095900 con 0x7fed38003f40 2024-04-25T15:47:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.874+0000 7fed4f7fe640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed3c0744e0 0x7fed3c0769f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fed44034000 tx=0x7fed4402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:34.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:34.878+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed50162350 con 0x7fed38003f40 2024-04-25T15:47:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.060+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed500cce20 con 0x7fed38003f40 2024-04-25T15:47:35.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.061+0000 7fed4cff9640 1 -- 172.21.15.80:0/529918830 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17123 (secure 0 0 0) 0x7fed40018030 con 0x7fed38003f40 2024-04-25T15:47:35.062 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:35.062 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:47:11.149672+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:52.572368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:53.267030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6834/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.195:6832/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.80:6836/3726019359":"2024-04-26T15:47:10.413739+0000","172.21.15.80:6834/3726019359":"2024-04-26T15:47:10.413739+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed3c0744e0 msgr2=0x7fed3c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed3c0744e0 0x7fed3c0769f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fed44034000 tx=0x7fed4402e000 comp rx=0 tx=0).stop 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 msgr2=0x7fed500cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed500cc8d0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fed400118e0 tx=0x7fed40011ce0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 shutdown_connections 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fed3c0744e0 0x7fed3c0769f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed50161f40 0x7fed5015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed500c8ed0 0x7fed50161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 --2- 172.21.15.80:0/529918830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed38003f40 0x7fed500cc8d0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 >> 172.21.15.80:0/529918830 conn(0x7fed500746b0 msgr2=0x7fed500b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 shutdown_connections 2024-04-25T15:47:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.063+0000 7fed568f2640 1 -- 172.21.15.80:0/529918830 wait complete. 2024-04-25T15:47:35.076 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:47:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.182+0000 7f23f1f1c640 1 Processor -- start 2024-04-25T15:47:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.182+0000 7f23f1f1c640 1 -- start start 2024-04-25T15:47:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23f1f1c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23ec15d890 0x7f23ec0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23f1f1c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f23ec0739a0 0x7f23ec073db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23f1f1c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23f1f1c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f23ec06fc60 con 0x7f23ec15d890 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23f1f1c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f23ec0b6c70 con 0x7f23ec0739a0 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23f1f1c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f23ec0742f0 con 0x7f23ec160200 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23ec15d890 0x7f23ec0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23ec15d890 0x7f23ec0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51060/0 (socket says 172.21.15.80:51060) 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 -- 172.21.15.80:0/1975790340 learned_addr learned my addr 172.21.15.80:0/1975790340 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eaffd640 1 --2- 172.21.15.80:0/1975790340 >> v2:172.21.15.195:3300/0 conn(0x7f23ec0739a0 0x7f23ec073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23ebfff640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 -- 172.21.15.80:0/1975790340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 msgr2=0x7f23ec160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 -- 172.21.15.80:0/1975790340 >> v2:172.21.15.195:3300/0 conn(0x7f23ec0739a0 msgr2=0x7f23ec073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 --2- 172.21.15.80:0/1975790340 >> v2:172.21.15.195:3300/0 conn(0x7f23ec0739a0 0x7f23ec073db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eb7fe640 1 -- 172.21.15.80:0/1975790340 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec06f330 con 0x7f23ec15d890 2024-04-25T15:47:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23eaffd640 1 --2- 172.21.15.80:0/1975790340 >> v2:172.21.15.195:3300/0 conn(0x7f23ec0739a0 0x7f23ec073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.184+0000 7f23ebfff640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.185+0000 7f23eb7fe640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec15d890 0x7f23ec0b6420 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0721c0 tx=0x7f23dc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2448bcddb9208c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.185+0000 7f23ea7fc640 1 -- 172.21.15.80:0/1975790340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc037070 con 0x7f23ec15d890 2024-04-25T15:47:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.185+0000 7f23ea7fc640 1 -- 172.21.15.80:0/1975790340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc032440 con 0x7f23ec15d890 2024-04-25T15:47:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.185+0000 7f23ea7fc640 1 -- 172.21.15.80:0/1975790340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc032810 con 0x7f23ec15d890 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 -- 172.21.15.80:0/1975790340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec15d890 msgr2=0x7f23ec0b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec15d890 0x7f23ec0b6420 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0721c0 tx=0x7f23dc02a140 comp rx=0 tx=0).stop 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 -- 172.21.15.80:0/1975790340 shutdown_connections 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/1975790340 >> v2:172.21.15.195:3300/0 conn(0x7f23ec0739a0 0x7f23ec073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/1975790340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec15d890 0x7f23ec0b6420 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 -- 172.21.15.80:0/1975790340 >> 172.21.15.80:0/1975790340 conn(0x7f23ec0d1e30 msgr2=0x7f23ec073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 -- 172.21.15.80:0/1975790340 shutdown_connections 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.186+0000 7f23f1f1c640 1 -- 172.21.15.80:0/1975790340 wait complete. 2024-04-25T15:47:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.188+0000 7f23f1f1c640 1 Processor -- start 2024-04-25T15:47:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.188+0000 7f23f1f1c640 1 -- start start 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23f1f1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 0x7f23ec0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23f1f1c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec15d890 0x7f23ec0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23f1f1c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23f1f1c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec0b6960 con 0x7f23ec0739a0 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23f1f1c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec06f8f0 con 0x7f23ec15d890 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23f1f1c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f23ec157040 con 0x7f23ec160200 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 0x7f23ec0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 0x7f23ec0cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51066/0 (socket says 172.21.15.80:51066) 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.189+0000 7f23eb7fe640 1 -- 172.21.15.80:0/4057629613 learned_addr learned my addr 172.21.15.80:0/4057629613 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eaffd640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec15d890 0x7f23ec0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23ebfff640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eb7fe640 1 -- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 msgr2=0x7f23ec0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eb7fe640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec0b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eb7fe640 1 -- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec15d890 msgr2=0x7f23ec0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eb7fe640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec15d890 0x7f23ec0b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eb7fe640 1 -- 172.21.15.80:0/4057629613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec0cfe30 con 0x7f23ec0739a0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23eb7fe640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 0x7f23ec0cf0c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a180 tx=0x7f23dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc041020 con 0x7f23ec0739a0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc0306c0 con 0x7f23ec0739a0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc037040 con 0x7f23ec0739a0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec0d0110 con 0x7f23ec0739a0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.190+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ec0cb3c0 con 0x7f23ec0739a0 2024-04-25T15:47:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.191+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ec050740 con 0x7f23ec0739a0 2024-04-25T15:47:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.192+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f23dc044020 con 0x7f23ec0739a0 2024-04-25T15:47:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.192+0000 7f23d3fff640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23d80744e0 0x7f23d80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.192+0000 7f23eaffd640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23d80744e0 0x7f23d80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.192+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6273+0+0 (secure 0 0 0) 0x7f23dc0b5be0 con 0x7f23ec0739a0 2024-04-25T15:47:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.193+0000 7f23eaffd640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23d80744e0 0x7f23d80769f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f23ec069ac0 tx=0x7f23e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.197+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23dc04b030 con 0x7f23ec0739a0 2024-04-25T15:47:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.416+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f23ec1567b0 con 0x7f23ec0739a0 2024-04-25T15:47:35.417 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-25T15:47:35.416+0000 7fde9c3c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T15:47:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.418+0000 7f23d3fff640 1 -- 172.21.15.80:0/4057629613 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f23dc080130 con 0x7f23ec0739a0 2024-04-25T15:47:35.419 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:47:35.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23d80744e0 msgr2=0x7f23d80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23d80744e0 0x7f23d80769f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f23ec069ac0 tx=0x7f23e0008040 comp rx=0 tx=0).stop 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 msgr2=0x7f23ec0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 0x7f23ec0cf0c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f23dc02a180 tx=0x7f23dc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 shutdown_connections 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f23d80744e0 0x7f23d80769f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f23ec160200 0x7f23ec0b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec15d890 0x7f23ec0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 --2- 172.21.15.80:0/4057629613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23ec0739a0 0x7f23ec0cf0c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.421+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 >> 172.21.15.80:0/4057629613 conn(0x7f23ec0d1e30 msgr2=0x7f23ec15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:35.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.422+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 shutdown_connections 2024-04-25T15:47:35.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.422+0000 7f23f1f1c640 1 -- 172.21.15.80:0/4057629613 wait complete. 2024-04-25T15:47:35.425 INFO:tasks.ceph.mds.c.smithi080.stderr: -4699> 2024-04-25T15:47:16.164+0000 7f8434921640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:47:35.427 INFO:tasks.ceph.mds.c.smithi080.stderr: -2542> 2024-04-25T15:47:21.165+0000 7f8434921640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T15:47:35.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:47:35.473 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-25T15:47:35.480 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-25T15:47:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.547+0000 7f08d9051640 1 Processor -- start 2024-04-25T15:47:35.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.547+0000 7f08d9051640 1 -- start start 2024-04-25T15:47:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d9051640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08d40d1c70 0x7f08d40b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d9051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d9051640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f08d40ce310 0x7f08d4163f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d9051640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f08d40d02a0 con 0x7f08d40d1c70 2024-04-25T15:47:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d9051640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f08d40b36c0 con 0x7f08d40ce310 2024-04-25T15:47:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d9051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f08d40ce720 con 0x7f08d40cd9c0 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08d40d1c70 0x7f08d40b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08d40d1c70 0x7f08d40b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51118/0 (socket says 172.21.15.80:51118) 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 -- 172.21.15.80:0/426426332 learned_addr learned my addr 172.21.15.80:0/426426332 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d359e640 1 --2- 172.21.15.80:0/426426332 >> v2:172.21.15.195:3300/0 conn(0x7f08d40ce310 0x7f08d4163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d259c640 1 --2- 172.21.15.80:0/426426332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 -- 172.21.15.80:0/426426332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 msgr2=0x7f08d40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 --2- 172.21.15.80:0/426426332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d40cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 -- 172.21.15.80:0/426426332 >> v2:172.21.15.195:3300/0 conn(0x7f08d40ce310 msgr2=0x7f08d4163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 --2- 172.21.15.80:0/426426332 >> v2:172.21.15.195:3300/0 conn(0x7f08d40ce310 0x7f08d4163f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d2d9d640 1 -- 172.21.15.80:0/426426332 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d40cffc0 con 0x7f08d40d1c70 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.549+0000 7f08d359e640 1 --2- 172.21.15.80:0/426426332 >> v2:172.21.15.195:3300/0 conn(0x7f08d40ce310 0x7f08d4163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.550+0000 7f08d2d9d640 1 --2- 172.21.15.80:0/426426332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d40b3180 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f08d40d17a0 tx=0x7f08c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82267acf4ff9bde1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.550+0000 7f08d1d9b640 1 -- 172.21.15.80:0/426426332 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8037070 con 0x7f08d40d1c70 2024-04-25T15:47:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.550+0000 7f08d1d9b640 1 -- 172.21.15.80:0/426426332 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c8032440 con 0x7f08d40d1c70 2024-04-25T15:47:35.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.550+0000 7f08d1d9b640 1 -- 172.21.15.80:0/426426332 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8032810 con 0x7f08d40d1c70 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 -- 172.21.15.80:0/426426332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 msgr2=0x7f08d40b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 --2- 172.21.15.80:0/426426332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d40b3180 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f08d40d17a0 tx=0x7f08c802a140 comp rx=0 tx=0).stop 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 -- 172.21.15.80:0/426426332 shutdown_connections 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 --2- 172.21.15.80:0/426426332 >> v2:172.21.15.195:3300/0 conn(0x7f08d40ce310 0x7f08d4163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 --2- 172.21.15.80:0/426426332 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d40cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 --2- 172.21.15.80:0/426426332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d40b3180 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 -- 172.21.15.80:0/426426332 >> 172.21.15.80:0/426426332 conn(0x7f08d40b7700 msgr2=0x7f08d40b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 -- 172.21.15.80:0/426426332 shutdown_connections 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.551+0000 7f08d9051640 1 -- 172.21.15.80:0/426426332 wait complete. 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.553+0000 7f08d9051640 1 Processor -- start 2024-04-25T15:47:35.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.553+0000 7f08d9051640 1 -- start start 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d9051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d9051640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d40ce310 0x7f08d415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d9051640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d41f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d9051640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08d40d2080 con 0x7f08d40d1c70 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d9051640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f08d40cd4a0 con 0x7f08d40ce310 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d9051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f08d406f8b0 con 0x7f08d40cd9c0 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d41f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d41f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51122/0 (socket says 172.21.15.80:51122) 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.554+0000 7f08d359e640 1 -- 172.21.15.80:0/392685228 learned_addr learned my addr 172.21.15.80:0/392685228 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d2d9d640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d259c640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d40ce310 0x7f08d415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d359e640 1 -- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 msgr2=0x7f08d415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d359e640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d359e640 1 -- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d40ce310 msgr2=0x7f08d415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d359e640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d40ce310 0x7f08d415ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d359e640 1 -- 172.21.15.80:0/392685228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d40a0000 con 0x7f08d40d1c70 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d359e640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d41f63f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cd80 tx=0x7f08cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00f680 con 0x7f08d40d1c70 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc00f840 con 0x7f08d40d1c70 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d40a02a0 con 0x7f08d40d1c70 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00fc30 con 0x7f08d40d1c70 2024-04-25T15:47:35.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.555+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d415d320 con 0x7f08d40d1c70 2024-04-25T15:47:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.556+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d4050740 con 0x7f08d40d1c70 2024-04-25T15:47:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.557+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f08cc0223f0 con 0x7f08d40d1c70 2024-04-25T15:47:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.557+0000 7f08bb7fe640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08c00744b0 0x7f08c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.557+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6445+0+0 (secure 0 0 0) 0x7f08cc096030 con 0x7f08d40d1c70 2024-04-25T15:47:35.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.557+0000 7f08d2d9d640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08c00744b0 0x7f08c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:35.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.558+0000 7f08d2d9d640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08c00744b0 0x7f08c00769c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f08c8034000 tx=0x7f08c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.562+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08d40a0000 con 0x7f08d40d1c70 2024-04-25T15:47:35.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:35.775+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f08d40b0bb0 con 0x7f08d40d1c70 2024-04-25T15:47:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.419+0000 7f08bb7fe640 1 -- 172.21.15.80:0/392685228 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f08cc014030 con 0x7f08d40d1c70 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.421+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08c00744b0 msgr2=0x7f08c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.421+0000 7f08d9051640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08c00744b0 0x7f08c00769c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f08c8034000 tx=0x7f08c802e000 comp rx=0 tx=0).stop 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.421+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 msgr2=0x7f08d41f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.421+0000 7f08d9051640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d41f63f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cd80 tx=0x7f08cc00a650 comp rx=0 tx=0).stop 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 shutdown_connections 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f08c00744b0 0x7f08c00769c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08d40d1c70 0x7f08d41f63f0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d40ce310 0x7f08d415ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 --2- 172.21.15.80:0/392685228 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08d40cd9c0 0x7f08d415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 >> 172.21.15.80:0/392685228 conn(0x7f08d40b7700 msgr2=0x7f08d406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 shutdown_connections 2024-04-25T15:47:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.422+0000 7f08d9051640 1 -- 172.21.15.80:0/392685228 wait complete. 2024-04-25T15:47:36.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:47:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.592+0000 7fc1ca0aa640 1 Processor -- start 2024-04-25T15:47:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.592+0000 7fc1ca0aa640 1 -- start start 2024-04-25T15:47:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1ca0aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c40d34f0 0x7fc1c40d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1ca0aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1c4163850 0x7fc1c40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1ca0aa640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c4163c60 con 0x7fc1c40d0540 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1ca0aa640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c40d3900 con 0x7fc1c4163850 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1ca0aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c40d2450 con 0x7fc1c40d34f0 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c2ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1c4163850 0x7fc1c40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc1c40d0540 0x7fc1c40d0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33608/0 (socket says 172.21.15.80:33608) 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c3fff640 1 -- 172.21.15.80:0/280113374 learned_addr learned my addr 172.21.15.80:0/280113374 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c37fe640 1 --2- 172.21.15.80:0/280113374 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c40d34f0 0x7fc1c40d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c2ffd640 1 -- 172.21.15.80:0/280113374 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c40d34f0 msgr2=0x7fc1c40d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c2ffd640 1 --2- 172.21.15.80:0/280113374 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c40d34f0 0x7fc1c40d1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c2ffd640 1 -- 172.21.15.80:0/280113374 >> v1:172.21.15.80:6789/0 conn(0x7fc1c40d0540 legacy=0x7fc1c40d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c2ffd640 1 -- 172.21.15.80:0/280113374 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c40d2730 con 0x7fc1c4163850 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.593+0000 7fc1c27fc640 1 -- 172.21.15.80:0/280113374 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630544734 0 0) 0x7fc1c4163c60 con 0x7fc1c40d0540 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.594+0000 7fc1c2ffd640 1 --2- 172.21.15.80:0/280113374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c4163850 0x7fc1c40b4e90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80097a0 tx=0x7fc1b802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cba3f395c62b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.594+0000 7fc1c27fc640 1 -- 172.21.15.80:0/280113374 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8037070 con 0x7fc1c4163850 2024-04-25T15:47:36.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.594+0000 7fc1c27fc640 1 -- 172.21.15.80:0/280113374 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b8032440 con 0x7fc1c4163850 2024-04-25T15:47:36.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.594+0000 7fc1c27fc640 1 -- 172.21.15.80:0/280113374 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8032810 con 0x7fc1c4163850 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/280113374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c4163850 msgr2=0x7fc1c40b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/280113374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c4163850 0x7fc1c40b4e90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80097a0 tx=0x7fc1b802a180 comp rx=0 tx=0).stop 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/280113374 shutdown_connections 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/280113374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c4163850 0x7fc1c40b4e90 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/280113374 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c40d34f0 0x7fc1c40d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/280113374 >> 172.21.15.80:0/280113374 conn(0x7fc1c40d3b70 msgr2=0x7fc1c40d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/280113374 shutdown_connections 2024-04-25T15:47:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.595+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/280113374 wait complete. 2024-04-25T15:47:36.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.597+0000 7fc1ca0aa640 1 Processor -- start 2024-04-25T15:47:36.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.597+0000 7fc1ca0aa640 1 -- start start 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1ca0aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 0x7fc1c414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1ca0aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1c40d34f0 0x7fc1c40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1ca0aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c4163850 0x7fc1c415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1ca0aa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c40d2fd0 con 0x7fc1c40d0540 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1ca0aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c40d2d30 con 0x7fc1c40d34f0 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1ca0aa640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c40b53d0 con 0x7fc1c4163850 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1c37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 0x7fc1c414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:36.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1c37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 0x7fc1c414cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51138/0 (socket says 172.21.15.80:51138) 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1c37fe640 1 -- 172.21.15.80:0/1886195050 learned_addr learned my addr 172.21.15.80:0/1886195050 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1c3fff640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c4163850 0x7fc1c415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.598+0000 7fc1c2ffd640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1c40d34f0 0x7fc1c40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c37fe640 1 -- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c4163850 msgr2=0x7fc1c415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c37fe640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c4163850 0x7fc1c415fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c37fe640 1 -- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1c40d34f0 msgr2=0x7fc1c40c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c37fe640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1c40d34f0 0x7fc1c40c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c37fe640 1 -- 172.21.15.80:0/1886195050 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c414d4e0 con 0x7fc1c40d0540 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c3fff640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c4163850 0x7fc1c415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c2ffd640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1c40d34f0 0x7fc1c40c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1c37fe640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 0x7fc1c414cfa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400d600 tx=0x7fc1b400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40125f0 con 0x7fc1c40d0540 2024-04-25T15:47:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b4019070 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c4160f50 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40129f0 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.599+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c4161510 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.600+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c4050740 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.601+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc1b4012b90 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.601+0000 7fc1abfff640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc1b00744e0 0x7fc1b00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.601+0000 7fc1c2ffd640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc1b00744e0 0x7fc1b00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.602+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6445+0+0 (secure 0 0 0) 0x7fc1b40958b0 con 0x7fc1c40d0540 2024-04-25T15:47:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.602+0000 7fc1c2ffd640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc1b00744e0 0x7fc1b00769f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8034000 tx=0x7fc1b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:36.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.606+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1c414d4e0 con 0x7fc1c40d0540 2024-04-25T15:47:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:36.786+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc1c40b5180 con 0x7fc1c40d0540 2024-04-25T15:47:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.426+0000 7fc1abfff640 1 -- 172.21.15.80:0/1886195050 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fc1b405fdf0 con 0x7fc1c40d0540 2024-04-25T15:47:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:47:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.430+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc1b00744e0 msgr2=0x7fc1b00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.430+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc1b00744e0 0x7fc1b00769f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8034000 tx=0x7fc1b802e000 comp rx=0 tx=0).stop 2024-04-25T15:47:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.430+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 msgr2=0x7fc1c414cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.430+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 0x7fc1c414cfa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400d600 tx=0x7fc1b400dac0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 shutdown_connections 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc1b00744e0 0x7fc1b00769f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1c4163850 0x7fc1c415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1c40d34f0 0x7fc1c40c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 --2- 172.21.15.80:0/1886195050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c40d0540 0x7fc1c414cfa0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 >> 172.21.15.80:0/1886195050 conn(0x7fc1c40d3b70 msgr2=0x7fc1c40d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 shutdown_connections 2024-04-25T15:47:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.431+0000 7fc1ca0aa640 1 -- 172.21.15.80:0/1886195050 wait complete. 2024-04-25T15:47:37.445 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:47:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.557+0000 7f0c4aa14640 1 Processor -- start 2024-04-25T15:47:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.557+0000 7f0c4aa14640 1 -- start start 2024-04-25T15:47:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c4aa14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440ce6a0 0x7f0c440d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c4aa14640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c440b2e60 0x7f0c440b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c4aa14640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c44161cf0 con 0x7f0c440b7550 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c4aa14640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0c440b5840 con 0x7f0c440b2e60 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c4aa14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440b5b20 con 0x7f0c440ce6a0 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c437fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c440b2e60 0x7f0c440b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c437fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c440b2e60 0x7f0c440b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51140/0 (socket says 172.21.15.80:51140) 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.558+0000 7f0c437fe640 1 -- 172.21.15.80:0/1864807139 learned_addr learned my addr 172.21.15.80:0/1864807139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c43fff640 1 --2- 172.21.15.80:0/1864807139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440ce6a0 0x7f0c440d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c437fe640 1 -- 172.21.15.80:0/1864807139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440ce6a0 msgr2=0x7f0c440d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c437fe640 1 --2- 172.21.15.80:0/1864807139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440ce6a0 0x7f0c440d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c437fe640 1 -- 172.21.15.80:0/1864807139 >> v1:172.21.15.80:6789/0 conn(0x7f0c440b7550 legacy=0x7f0c440ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c437fe640 1 -- 172.21.15.80:0/1864807139 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440b5e00 con 0x7f0c440b2e60 2024-04-25T15:47:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c42ffd640 1 -- 172.21.15.80:0/1864807139 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219366843 0 0) 0x7f0c44161cf0 con 0x7f0c440b7550 2024-04-25T15:47:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.559+0000 7f0c437fe640 1 --2- 172.21.15.80:0/1864807139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440b7010 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a46350b658963f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c42ffd640 1 -- 172.21.15.80:0/1864807139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38037070 con 0x7f0c440b2e60 2024-04-25T15:47:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c42ffd640 1 -- 172.21.15.80:0/1864807139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c38032440 con 0x7f0c440b2e60 2024-04-25T15:47:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c42ffd640 1 -- 172.21.15.80:0/1864807139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38032810 con 0x7f0c440b2e60 2024-04-25T15:47:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 -- 172.21.15.80:0/1864807139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 msgr2=0x7f0c440b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/1864807139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440b7010 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 -- 172.21.15.80:0/1864807139 shutdown_connections 2024-04-25T15:47:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/1864807139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440b7010 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/1864807139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440ce6a0 0x7f0c440d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 -- 172.21.15.80:0/1864807139 >> 172.21.15.80:0/1864807139 conn(0x7f0c440d0630 msgr2=0x7f0c440d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 -- 172.21.15.80:0/1864807139 shutdown_connections 2024-04-25T15:47:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.560+0000 7f0c4aa14640 1 -- 172.21.15.80:0/1864807139 wait complete. 2024-04-25T15:47:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.562+0000 7f0c4aa14640 1 Processor -- start 2024-04-25T15:47:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.562+0000 7f0c4aa14640 1 -- start start 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.563+0000 7f0c4aa14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.563+0000 7f0c4aa14640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440b7550 0x7f0c440b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.563+0000 7f0c4aa14640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c440ce6a0 0x7f0c440b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c4aa14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440b33f0 con 0x7f0c440b2e60 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c4aa14640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440b3270 con 0x7f0c440ce6a0 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c4aa14640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440cf270 con 0x7f0c440b7550 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51142/0 (socket says 172.21.15.80:51142) 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 -- 172.21.15.80:0/3354500852 learned_addr learned my addr 172.21.15.80:0/3354500852 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c437fe640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440b7550 0x7f0c440b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 -- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440b7550 msgr2=0x7f0c440b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440b7550 0x7f0c440b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 -- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c440ce6a0 msgr2=0x7f0c440b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c440ce6a0 0x7f0c440b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 -- 172.21.15.80:0/3354500852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440b1e00 con 0x7f0c440b2e60 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c43fff640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440af330 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400d5d0 tx=0x7f0c3400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34004240 con 0x7f0c440b2e60 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c340043e0 con 0x7f0c440b2e60 2024-04-25T15:47:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34003830 con 0x7f0c440b2e60 2024-04-25T15:47:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c440b20e0 con 0x7f0c440b2e60 2024-04-25T15:47:37.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.564+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c440af870 con 0x7f0c440b2e60 2024-04-25T15:47:37.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.565+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44069870 con 0x7f0c440b2e60 2024-04-25T15:47:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.566+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0c340039d0 con 0x7f0c440b2e60 2024-04-25T15:47:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.566+0000 7f0c40ff9640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0c300744b0 0x7f0c300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.566+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6007+0+0 (secure 0 0 0) 0x7f0c34095680 con 0x7f0c440b2e60 2024-04-25T15:47:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.566+0000 7f0c437fe640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0c300744b0 0x7f0c300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:37.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.567+0000 7f0c437fe640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0c300744b0 0x7f0c300769c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0c38034000 tx=0x7f0c3802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:37.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.571+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c44069870 con 0x7f0c440b2e60 2024-04-25T15:47:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:37.744+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c44050740 con 0x7f0c440b2e60 2024-04-25T15:47:38.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.431+0000 7f0c40ff9640 1 -- 172.21.15.80:0/3354500852 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f0c3405fce0 con 0x7f0c440b2e60 2024-04-25T15:47:38.433 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T15:47:38.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.438+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0c300744b0 msgr2=0x7f0c300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.438+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0c300744b0 0x7f0c300769c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0c38034000 tx=0x7f0c3802e000 comp rx=0 tx=0).stop 2024-04-25T15:47:38.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.438+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 msgr2=0x7f0c440af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.438+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440af330 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400d5d0 tx=0x7f0c3400da90 comp rx=0 tx=0).stop 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.439+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 shutdown_connections 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.439+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0c300744b0 0x7f0c300769c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.439+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c440ce6a0 0x7f0c440b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.439+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c440b7550 0x7f0c440b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.439+0000 7f0c4aa14640 1 --2- 172.21.15.80:0/3354500852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c440b2e60 0x7f0c440af330 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.439+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 >> 172.21.15.80:0/3354500852 conn(0x7f0c440d0630 msgr2=0x7f0c440b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.440+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 shutdown_connections 2024-04-25T15:47:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.440+0000 7f0c4aa14640 1 -- 172.21.15.80:0/3354500852 wait complete. 2024-04-25T15:47:38.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:47:38.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:47:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on skipped message = False 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-04-25T15:47:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-04-25T15:47:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 20 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 20 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 10 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-04-25T15:47:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-25T15:47:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:47:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: mon down mkfs grace = 300 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:47:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = "" 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-04-25T15:47:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-25T15:47:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.511 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-25T15:47:38.512 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.513 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.80,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on skipped message = False 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = e35f5388-3109-4b08-854a-9a0b33367f12 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-25T15:47:38.514 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.515 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 20 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 20 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:38.516 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 10 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:38.517 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-25T15:47:38.518 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:47:38.519 INFO:teuthology.orchestra.run.smithi195.stdout: mon down mkfs grace = 300 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T15:47:38.520 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-04-25T15:47:38.521 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T15:47:38.522 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T15:47:38.522 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T15:47:38.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T15:47:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.671+0000 7fe2216e7640 1 Processor -- start 2024-04-25T15:47:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.671+0000 7fe2216e7640 1 -- start start 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe2216e7640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe21c0d2d50 0x7fe21c16b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe2216e7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c0d57e0 con 0x7fe21c0d0b00 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe2216e7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c1643f0 con 0x7fe21c0b5490 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe2216e7640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe21c1646d0 con 0x7fe21c0d2d50 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe21a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe21c0d0b00 0x7fe21c0d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33642/0 (socket says 172.21.15.80:33642) 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe21a7fc640 1 -- 172.21.15.80:0/3110548576 learned_addr learned my addr 172.21.15.80:0/3110548576 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe21b7fe640 1 --2- 172.21.15.80:0/3110548576 >> v2:172.21.15.195:3300/0 conn(0x7fe21c0d2d50 0x7fe21c16b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521520121 0 0) 0x7fe21c0d57e0 con 0x7fe21c0d0b00 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe204003520 con 0x7fe21c0d0b00 2024-04-25T15:47:38.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007707484 0 0) 0x7fe21c1643f0 con 0x7fe21c0b5490 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c0d57e0 con 0x7fe21c0b5490 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3257336754 0 0) 0x7fe204003520 con 0x7fe21c0d0b00 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 >> v2:172.21.15.195:3300/0 conn(0x7fe21c0d2d50 msgr2=0x7fe21c16b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 --2- 172.21.15.80:0/3110548576 >> v2:172.21.15.195:3300/0 conn(0x7fe21c0d2d50 0x7fe21c16b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 >> v1:172.21.15.195:6789/0 conn(0x7fe21c0b5490 legacy=0x7fe21c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c1649b0 con 0x7fe21c0d0b00 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fe210001670 con 0x7fe21c0d0b00 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 >> v1:172.21.15.80:6789/0 conn(0x7fe21c0d0b00 legacy=0x7fe21c0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204003b90 0x7fe204003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe204004800 0x7fe204004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe204005210 0x7fe20400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.673+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1646d0 con 0x7fe204005210 2024-04-25T15:47:38.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe20400c190 con 0x7fe204004800 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe20400c390 con 0x7fe204003b90 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe204005210 0x7fe20400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21a7fc640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe204004800 0x7fe204004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21affd640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204003b90 0x7fe204003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 -- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204003b90 msgr2=0x7fe204003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204003b90 0x7fe204003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 -- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe204004800 msgr2=0x7fe204004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe204004800 0x7fe204004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 -- 172.21.15.80:0/3110548576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe204003520 con 0x7fe204005210 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.674+0000 7fe21b7fe640 1 -- 172.21.15.80:0/3110548576 reap_dead start 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe21b7fe640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe204005210 0x7fe20400b9c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe214009a90 tx=0x7fe204005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b4a4210237adc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214009690 con 0x7fe204005210 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe214004020 con 0x7fe204005210 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe219ffb640 1 -- 172.21.15.80:0/3110548576 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2140043d0 con 0x7fe204005210 2024-04-25T15:47:38.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 -- 172.21.15.80:0/3110548576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe204005210 msgr2=0x7fe20400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe204005210 0x7fe20400b9c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe214009a90 tx=0x7fe204005830 comp rx=0 tx=0).stop 2024-04-25T15:47:38.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 -- 172.21.15.80:0/3110548576 shutdown_connections 2024-04-25T15:47:38.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3110548576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe204005210 0x7fe20400b9c0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 -- 172.21.15.80:0/3110548576 >> 172.21.15.80:0/3110548576 conn(0x7fe21c06e650 msgr2=0x7fe21c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:38.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 -- 172.21.15.80:0/3110548576 shutdown_connections 2024-04-25T15:47:38.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.675+0000 7fe2216e7640 1 -- 172.21.15.80:0/3110548576 wait complete. 2024-04-25T15:47:38.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.677+0000 7fe2216e7640 1 Processor -- start 2024-04-25T15:47:38.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.677+0000 7fe2216e7640 1 -- start start 2024-04-25T15:47:38.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204005210 0x7fe21c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 0x7fe21c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe21c1f68f0 0x7fe21c0b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0b94e0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0b9360 con 0x7fe21c1f68f0 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c163f80 con 0x7fe204005210 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 0x7fe21c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 0x7fe21c0b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51156/0 (socket says 172.21.15.80:51156) 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 -- 172.21.15.80:0/3613236899 learned_addr learned my addr 172.21.15.80:0/3613236899 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21affd640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204005210 0x7fe21c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21b7fe640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe21c1f68f0 0x7fe21c0b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 -- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204005210 msgr2=0x7fe21c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204005210 0x7fe21c0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 -- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe21c1f68f0 msgr2=0x7fe21c0b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe21c1f68f0 0x7fe21c0b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 -- 172.21.15.80:0/3613236899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0cc8a0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe21a7fc640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 0x7fe21c0b7080 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe210004e00 tx=0x7fe210007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21000f7b0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210018070 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c0ca970 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.679+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21000fbb0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.680+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c0caf30 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.681+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c06a100 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.681+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe21000fd50 con 0x7fe21c1f64e0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.681+0000 7fe2037fe640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2080744e0 0x7fe2080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.682+0000 7fe21affd640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2080744e0 0x7fe2080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.682+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fe210094ef0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.682+0000 7fe21affd640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2080744e0 0x7fe2080769f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000f80 tx=0x7fe20c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.686+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe21005f0a0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.870+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe21c0d41d0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.873+0000 7fe2037fe640 1 -- 172.21.15.80:0/3613236899 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7fe2100633a0 con 0x7fe21c1f64e0 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2080744e0 msgr2=0x7fe2080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2080744e0 0x7fe2080769f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000f80 tx=0x7fe20c009040 comp rx=0 tx=0).stop 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 msgr2=0x7fe21c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 0x7fe21c0b7080 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe210004e00 tx=0x7fe210007430 comp rx=0 tx=0).stop 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 shutdown_connections 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe2080744e0 0x7fe2080769f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe21c1f68f0 0x7fe21c0b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe21c1f64e0 0x7fe21c0b7080 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 --2- 172.21.15.80:0/3613236899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe204005210 0x7fe21c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 >> 172.21.15.80:0/3613236899 conn(0x7fe21c06e650 msgr2=0x7fe21c15df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:38.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 shutdown_connections 2024-04-25T15:47:38.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.876+0000 7fe2216e7640 1 -- 172.21.15.80:0/3613236899 wait complete. 2024-04-25T15:47:38.888 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-04-25T15:47:38.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.994+0000 7feb32f15640 1 Processor -- start 2024-04-25T15:47:38.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.994+0000 7feb32f15640 1 -- start start 2024-04-25T15:47:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb32f15640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb2c0b6620 0x7feb2c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb32f15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c071bb0 0x7feb2c06c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb32f15640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c0b75d0 con 0x7feb2c0b5640 2024-04-25T15:47:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb32f15640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7feb2c15dac0 con 0x7feb2c0b6620 2024-04-25T15:47:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb32f15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c15cf40 con 0x7feb2c071bb0 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb2c0b6620 0x7feb2c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb2c0b6620 0x7feb2c0b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51166/0 (socket says 172.21.15.80:51166) 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 -- 172.21.15.80:0/2477615360 learned_addr learned my addr 172.21.15.80:0/2477615360 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb2bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb2c0b5640 0x7feb2c0714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33644/0 (socket says 172.21.15.80:33644) 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb314b2640 1 --2- 172.21.15.80:0/2477615360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c071bb0 0x7feb2c06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 -- 172.21.15.80:0/2477615360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c071bb0 msgr2=0x7feb2c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 --2- 172.21.15.80:0/2477615360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c071bb0 0x7feb2c06c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb2b7fe640 1 -- 172.21.15.80:0/2477615360 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330949580 0 0) 0x7feb2c0b75d0 con 0x7feb2c0b5640 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 -- 172.21.15.80:0/2477615360 >> v1:172.21.15.80:6789/0 conn(0x7feb2c0b5640 legacy=0x7feb2c0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.996+0000 7feb30cb1640 1 -- 172.21.15.80:0/2477615360 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c15d220 con 0x7feb2c0b6620 2024-04-25T15:47:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.997+0000 7feb30cb1640 1 --2- 172.21.15.80:0/2477615360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b6620 0x7feb2c0b7090 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00bb10 tx=0x7feb1c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93609d418a685c26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.997+0000 7feb2b7fe640 1 -- 172.21.15.80:0/2477615360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c032790 con 0x7feb2c0b6620 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.997+0000 7feb2b7fe640 1 -- 172.21.15.80:0/2477615360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c038070 con 0x7feb2c0b6620 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.997+0000 7feb2b7fe640 1 -- 172.21.15.80:0/2477615360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c032b50 con 0x7feb2c0b6620 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 -- 172.21.15.80:0/2477615360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b6620 msgr2=0x7feb2c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 --2- 172.21.15.80:0/2477615360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b6620 0x7feb2c0b7090 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00bb10 tx=0x7feb1c02c890 comp rx=0 tx=0).stop 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 -- 172.21.15.80:0/2477615360 shutdown_connections 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 --2- 172.21.15.80:0/2477615360 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c071bb0 0x7feb2c06c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 --2- 172.21.15.80:0/2477615360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b6620 0x7feb2c0b7090 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 -- 172.21.15.80:0/2477615360 >> 172.21.15.80:0/2477615360 conn(0x7feb2c0d2080 msgr2=0x7feb2c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 -- 172.21.15.80:0/2477615360 shutdown_connections 2024-04-25T15:47:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.998+0000 7feb32f15640 1 -- 172.21.15.80:0/2477615360 wait complete. 2024-04-25T15:47:39.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.999+0000 7feb32f15640 1 Processor -- start 2024-04-25T15:47:39.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:38.999+0000 7feb32f15640 1 -- start start 2024-04-25T15:47:39.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb32f15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 0x7feb2c14b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb32f15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c0b6620 0x7feb2c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb32f15640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb2c0abff0 0x7feb2c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb32f15640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c0cecc0 con 0x7feb2c0b5640 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb32f15640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c15d7e0 con 0x7feb2c0abff0 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb32f15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c0b5a50 con 0x7feb2c0b6620 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 0x7feb2c14b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 0x7feb2c14b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51182/0 (socket says 172.21.15.80:51182) 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 -- 172.21.15.80:0/121342922 learned_addr learned my addr 172.21.15.80:0/121342922 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb314b2640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb2c0abff0 0x7feb2c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb2bfff640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c0b6620 0x7feb2c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 -- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c0b6620 msgr2=0x7feb2c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c0b6620 0x7feb2c15dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 -- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb2c0abff0 msgr2=0x7feb2c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb2c0abff0 0x7feb2c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 -- 172.21.15.80:0/121342922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c0ac760 con 0x7feb2c0b5640 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb30cb1640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 0x7feb2c14b980 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00b2c0 tx=0x7feb1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.001+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c033620 con 0x7feb2c0b5640 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.002+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c0337e0 con 0x7feb2c0b5640 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.002+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c033bd0 con 0x7feb2c0b5640 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.002+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c0aca40 con 0x7feb2c0b5640 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.002+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c0ad000 con 0x7feb2c0b5640 2024-04-25T15:47:39.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.003+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c15cb10 con 0x7feb2c0b5640 2024-04-25T15:47:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.003+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb1c04d060 con 0x7feb2c0b5640 2024-04-25T15:47:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.004+0000 7feb297fa640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb180744e0 0x7feb180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.004+0000 7feb2bfff640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb180744e0 0x7feb180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.004+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7feb1c0b7de0 con 0x7feb2c0b5640 2024-04-25T15:47:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.004+0000 7feb2bfff640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb180744e0 0x7feb180769f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7feb20007fd0 tx=0x7feb20007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.009+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb2c15cb10 con 0x7feb2c0b5640 2024-04-25T15:47:39.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.255+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) -- 0x7feb2c06a100 con 0x7feb2c0b5640 2024-04-25T15:47:39.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.433+0000 7feb297fa640 1 -- 172.21.15.80:0/121342922 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v288) ==== 145+0+0 (secure 0 0 0) 0x7feb1c041070 con 0x7feb2c0b5640 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb180744e0 msgr2=0x7feb180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb180744e0 0x7feb180769f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7feb20007fd0 tx=0x7feb20007c20 comp rx=0 tx=0).stop 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 msgr2=0x7feb2c14b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 0x7feb2c14b980 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00b2c0 tx=0x7feb1c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 shutdown_connections 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7feb180744e0 0x7feb180769f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb2c0abff0 0x7feb2c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb2c0b6620 0x7feb2c15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 --2- 172.21.15.80:0/121342922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c0b5640 0x7feb2c14b980 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 >> 172.21.15.80:0/121342922 conn(0x7feb2c0d2080 msgr2=0x7feb2c0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 shutdown_connections 2024-04-25T15:47:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:39.435+0000 7feb32f15640 1 -- 172.21.15.80:0/121342922 wait complete. 2024-04-25T15:47:39.447 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2024-04-25T15:47:39.447 INFO:tasks.cephfs_test_runner: 2024-04-25T15:47:39.447 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T15:47:39.447 INFO:tasks.cephfs_test_runner:Ran 6 tests in 231.010s 2024-04-25T15:47:39.447 INFO:tasks.cephfs_test_runner: 2024-04-25T15:47:39.447 INFO:tasks.cephfs_test_runner:OK (skipped=2) 2024-04-25T15:47:39.448 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T15:47:39.457 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T15:47:39.469 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T15:47:39.469 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:39.469 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:39.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:47:39.486 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T15:47:39.486 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:39.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1153 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T15:47:39.541 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:39.541 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:39.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:47:39.561 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T15:47:39.561 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T15:47:39.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=655 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T15:47:39.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.619 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:47:39.634 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T15:47:39.634 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T15:47:39.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T15:47:39.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.697 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:39.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T15:47:39.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.857 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T15:47:39.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.872 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T15:47:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-25T15:47:39.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:47:39.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.940 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:47:39.959 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T15:47:39.959 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T15:47:39.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:39.959 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T15:47:40.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:40.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:47:40.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:40.096 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T15:47:40.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:40.192 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T15:47:40.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:40.207 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T15:47:40.274 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T15:47:40.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:47:40.276 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T15:47:40.289 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:47:40.289 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:47:40.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.397+0000 7f0df1908640 1 Processor -- start 2024-04-25T15:47:40.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.397+0000 7f0df1908640 1 -- start start 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.398+0000 7f0df1908640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec0b0d80 0x7f0dec15c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.398+0000 7f0df1908640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dec074240 0x7f0dec0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.398+0000 7f0df1908640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dec0703e0 con 0x7f0dec0b65a0 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.398+0000 7f0df1908640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0dec0affc0 con 0x7f0dec074240 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.398+0000 7f0df1908640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec0b02a0 con 0x7f0dec0b0d80 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0deb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dec074240 0x7f0dec0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0dea7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0dec0b65a0 0x7f0dec073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33660/0 (socket says 172.21.15.80:33660) 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0deb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dec074240 0x7f0dec0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51198/0 (socket says 172.21.15.80:51198) 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0dea7fc640 1 -- 172.21.15.80:0/3453761179 learned_addr learned my addr 172.21.15.80:0/3453761179 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:40.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0deb7fe640 1 -- 172.21.15.80:0/3453761179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec0b0d80 msgr2=0x7f0dec15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0deb7fe640 1 --2- 172.21.15.80:0/3453761179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec0b0d80 0x7f0dec15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0deb7fe640 1 -- 172.21.15.80:0/3453761179 >> v1:172.21.15.80:6789/0 conn(0x7f0dec0b65a0 legacy=0x7f0dec073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0de9ffb640 1 -- 172.21.15.80:0/3453761179 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227258635 0 0) 0x7f0dec0703e0 con 0x7f0dec0b65a0 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.399+0000 7f0deb7fe640 1 -- 172.21.15.80:0/3453761179 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec0b0580 con 0x7f0dec074240 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0deb7fe640 1 --2- 172.21.15.80:0/3453761179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec074240 0x7f0dec0b4700 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0de400aea0 tx=0x7f0de402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8634a6dfc0119b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0de9ffb640 1 -- 172.21.15.80:0/3453761179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037070 con 0x7f0dec074240 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0de9ffb640 1 -- 172.21.15.80:0/3453761179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4008640 con 0x7f0dec074240 2024-04-25T15:47:40.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0de9ffb640 1 -- 172.21.15.80:0/3453761179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4008a10 con 0x7f0dec074240 2024-04-25T15:47:40.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 -- 172.21.15.80:0/3453761179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec074240 msgr2=0x7f0dec0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 --2- 172.21.15.80:0/3453761179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec074240 0x7f0dec0b4700 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0de400aea0 tx=0x7f0de402b7b0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 -- 172.21.15.80:0/3453761179 shutdown_connections 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 --2- 172.21.15.80:0/3453761179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec074240 0x7f0dec0b4700 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 --2- 172.21.15.80:0/3453761179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec0b0d80 0x7f0dec15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 -- 172.21.15.80:0/3453761179 >> 172.21.15.80:0/3453761179 conn(0x7f0dec0d1e20 msgr2=0x7f0dec073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.400+0000 7f0df1908640 1 -- 172.21.15.80:0/3453761179 shutdown_connections 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.401+0000 7f0df1908640 1 -- 172.21.15.80:0/3453761179 wait complete. 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.402+0000 7f0df1908640 1 Processor -- start 2024-04-25T15:47:40.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.402+0000 7f0df1908640 1 -- start start 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 0x7f0dec09c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dec0b65a0 0x7f0dec149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec14d0c0 0x7f0dec09eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec06fe10 con 0x7f0dec0b0d80 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec0ae7c0 con 0x7f0dec0b65a0 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec06ff90 con 0x7f0dec14d0c0 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 0x7f0dec09c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 0x7f0dec09c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51214/0 (socket says 172.21.15.80:51214) 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 -- 172.21.15.80:0/2381372531 learned_addr learned my addr 172.21.15.80:0/2381372531 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deb7fe640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec14d0c0 0x7f0dec09eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0dea7fc640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dec0b65a0 0x7f0dec149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 -- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec14d0c0 msgr2=0x7f0dec09eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec14d0c0 0x7f0dec09eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 -- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dec0b65a0 msgr2=0x7f0dec149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dec0b65a0 0x7f0dec149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 -- 172.21.15.80:0/2381372531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec14a4e0 con 0x7f0dec0b0d80 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0dea7fc640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dec0b65a0 0x7f0dec149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0deaffd640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 0x7f0dec09c0a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00b410 tx=0x7f0ddc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc015020 con 0x7f0dec0b0d80 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc011830 con 0x7f0dec0b0d80 2024-04-25T15:47:40.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec14a7c0 con 0x7f0dec0b0d80 2024-04-25T15:47:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011c20 con 0x7f0dec0b0d80 2024-04-25T15:47:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.404+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec14ad80 con 0x7f0dec0b0d80 2024-04-25T15:47:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.406+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec06a100 con 0x7f0dec0b0d80 2024-04-25T15:47:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.406+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0ddc018020 con 0x7f0dec0b0d80 2024-04-25T15:47:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.406+0000 7f0dd3fff640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0dd80744b0 0x7f0dd80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.407+0000 7f0dea7fc640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0dd80744b0 0x7f0dd80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.407+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f0ddc0950c0 con 0x7f0dec0b0d80 2024-04-25T15:47:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.407+0000 7f0dea7fc640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0dd80744b0 0x7f0dd80769c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0dec150a50 tx=0x7f0de0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.411+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ddc01f020 con 0x7f0dec0b0d80 2024-04-25T15:47:40.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.585+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0dec09c5e0 con 0x7f0dd80744b0 2024-04-25T15:47:40.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.585+0000 7f0dd3fff640 1 -- 172.21.15.80:0/2381372531 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7f0dec09c5e0 con 0x7f0dd80744b0 2024-04-25T15:47:40.587 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:47:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0dd80744b0 msgr2=0x7f0dd80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0dd80744b0 0x7f0dd80769c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0dec150a50 tx=0x7f0de0009040 comp rx=0 tx=0).stop 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 msgr2=0x7f0dec09c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 0x7f0dec09c0a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00b410 tx=0x7f0ddc00b8d0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 shutdown_connections 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f0dd80744b0 0x7f0dd80769c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0dec14d0c0 0x7f0dec09eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dec0b65a0 0x7f0dec149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 --2- 172.21.15.80:0/2381372531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec0b0d80 0x7f0dec09c0a0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.587+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 >> 172.21.15.80:0/2381372531 conn(0x7f0dec0d1e20 msgr2=0x7f0dec158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.588+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 shutdown_connections 2024-04-25T15:47:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.588+0000 7f0df1908640 1 -- 172.21.15.80:0/2381372531 wait complete. 2024-04-25T15:47:40.600 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-25T15:47:39.055766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":264932,"kb_used_data":11320,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709788,"statfs":{"total":773094113280,"available":772822822912,"internally_reserved":0,"allocated":11591680,"data_stored":5971942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22388,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-147,"num_write_kb":-74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001467"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":280,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-25T15:47:37.429938+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:47:37.429938+0000","last_peered":"2024-04-25T15:47:37.429938+0000","last_clean":"2024-04-25T15:47:37.429938+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:47:37.429938+0000","last_undegraded":"2024-04-25T15:47:37.429938+0000","last_fullsized":"2024-04-25T15:47:37.429938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36612,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1896448,"data_stored":1190898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1896448,"data_stored":1190898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1290240,"data_stored":593967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":594059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:47:40.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:47:40.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.707+0000 7fc702b7a640 1 Processor -- start 2024-04-25T15:47:40.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.707+0000 7fc702b7a640 1 -- start start 2024-04-25T15:47:40.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc702b7a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6fc0ce220 0x7fc6fc09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc702b7a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc6fc0cfd70 0x7fc6fc0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc702b7a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6fc1607c0 con 0x7fc6fc0cf960 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc702b7a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc6fc0cf4d0 con 0x7fc6fc0ce220 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc702b7a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc6fc0ce630 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6fc0ce220 0x7fc6fc09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6fc0ce220 0x7fc6fc09bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51228/0 (socket says 172.21.15.80:51228) 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc6fbfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6fc0cf960 0x7fc6fc0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33674/0 (socket says 172.21.15.80:33674) 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 -- 172.21.15.80:0/2787265355 learned_addr learned my addr 172.21.15.80:0/2787265355 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc701117640 1 --2- 172.21.15.80:0/2787265355 >> v2:172.21.15.195:3300/0 conn(0x7fc6fc0cfd70 0x7fc6fc0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 -- 172.21.15.80:0/2787265355 >> v2:172.21.15.195:3300/0 conn(0x7fc6fc0cfd70 msgr2=0x7fc6fc0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 --2- 172.21.15.80:0/2787265355 >> v2:172.21.15.195:3300/0 conn(0x7fc6fc0cfd70 0x7fc6fc0d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 -- 172.21.15.80:0/2787265355 >> v1:172.21.15.80:6789/0 conn(0x7fc6fc0cf960 legacy=0x7fc6fc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc700916640 1 -- 172.21.15.80:0/2787265355 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6fc0d0180 con 0x7fc6fc0ce220 2024-04-25T15:47:40.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.709+0000 7fc6fb7fe640 1 -- 172.21.15.80:0/2787265355 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217103184 0 0) 0x7fc6fc1607c0 con 0x7fc6fc0cf960 2024-04-25T15:47:40.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.710+0000 7fc700916640 1 --2- 172.21.15.80:0/2787265355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc09bb70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc073ce0 tx=0x7fc6ec02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d207b772ab7761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.710+0000 7fc6fb7fe640 1 -- 172.21.15.80:0/2787265355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec037070 con 0x7fc6fc0ce220 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.710+0000 7fc6fb7fe640 1 -- 172.21.15.80:0/2787265355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ec02ae50 con 0x7fc6fc0ce220 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.710+0000 7fc6fb7fe640 1 -- 172.21.15.80:0/2787265355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec032860 con 0x7fc6fc0ce220 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 -- 172.21.15.80:0/2787265355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0ce220 msgr2=0x7fc6fc09bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2787265355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc09bb70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc073ce0 tx=0x7fc6ec02a300 comp rx=0 tx=0).stop 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 -- 172.21.15.80:0/2787265355 shutdown_connections 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2787265355 >> v2:172.21.15.195:3300/0 conn(0x7fc6fc0cfd70 0x7fc6fc0d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2787265355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc09bb70 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 -- 172.21.15.80:0/2787265355 >> 172.21.15.80:0/2787265355 conn(0x7fc6fc0b7620 msgr2=0x7fc6fc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 -- 172.21.15.80:0/2787265355 shutdown_connections 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.711+0000 7fc702b7a640 1 -- 172.21.15.80:0/2787265355 wait complete. 2024-04-25T15:47:40.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.712+0000 7fc702b7a640 1 Processor -- start 2024-04-25T15:47:40.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.713+0000 7fc702b7a640 1 -- start start 2024-04-25T15:47:40.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc702b7a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc702b7a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6fc0cf960 0x7fc6fc155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc702b7a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 0x7fc6fc0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc702b7a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc6fc0cf160 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc702b7a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6fc0cee80 con 0x7fc6fc0ce220 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc702b7a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc6fc09c0b0 con 0x7fc6fc0cf960 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 0x7fc6fc0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 0x7fc6fc0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51234/0 (socket says 172.21.15.80:51234) 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 -- 172.21.15.80:0/2879802848 learned_addr learned my addr 172.21.15.80:0/2879802848 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc700916640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc6fbfff640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6fc0cf960 0x7fc6fc155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 -- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6fc0cf960 msgr2=0x7fc6fc155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6fc0cf960 0x7fc6fc155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 -- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6fc0ce220 msgr2=0x7fc6fc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.714+0000 7fc701117640 1 -- 172.21.15.80:0/2879802848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6fc1fa5d0 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.715+0000 7fc701117640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 0x7fc6fc0cbb90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.715+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4014420 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.715+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f4019070 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.715+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4014800 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.715+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6fc157640 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.715+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6fc1f9af0 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.716+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6fc06a100 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.716+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc6f40149a0 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.717+0000 7fc6f97fa640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6e80744b0 0x7fc6e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:40.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.717+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fc6f4095860 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.717+0000 7fc700916640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6e80744b0 0x7fc6e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:40.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.717+0000 7fc700916640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6e80744b0 0x7fc6e80769c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec034000 tx=0x7fc6ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:40.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.722+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6f4060180 con 0x7fc6fc0cfd70 2024-04-25T15:47:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.891+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6fc0b7cf0 con 0x7fc6e80744b0 2024-04-25T15:47:40.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.892+0000 7fc6f97fa640 1 -- 172.21.15.80:0/2879802848 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7fc6fc0b7cf0 con 0x7fc6e80744b0 2024-04-25T15:47:40.893 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:40.894 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6e80744b0 msgr2=0x7fc6e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6e80744b0 0x7fc6e80769c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec034000 tx=0x7fc6ec02e000 comp rx=0 tx=0).stop 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 msgr2=0x7fc6fc0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 0x7fc6fc0cbb90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f400e4b0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 shutdown_connections 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc6e80744b0 0x7fc6e80769c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6fc0cfd70 0x7fc6fc0cbb90 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6fc0cf960 0x7fc6fc155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 --2- 172.21.15.80:0/2879802848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6fc0ce220 0x7fc6fc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 >> 172.21.15.80:0/2879802848 conn(0x7fc6fc0b7620 msgr2=0x7fc6fc06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 shutdown_connections 2024-04-25T15:47:40.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:40.894+0000 7fc702b7a640 1 -- 172.21.15.80:0/2879802848 wait complete. 2024-04-25T15:47:40.906 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-25T15:47:39.055766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":264932,"kb_used_data":11320,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709788,"statfs":{"total":773094113280,"available":772822822912,"internally_reserved":0,"allocated":11591680,"data_stored":5971942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22388,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-147,"num_write_kb":-74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001467"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":280,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-25T15:47:37.429938+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:47:37.429938+0000","last_peered":"2024-04-25T15:47:37.429938+0000","last_clean":"2024-04-25T15:47:37.429938+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:47:37.429938+0000","last_undegraded":"2024-04-25T15:47:37.429938+0000","last_fullsized":"2024-04-25T15:47:37.429938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36612,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1896448,"data_stored":1190898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1896448,"data_stored":1190898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1290240,"data_stored":593967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":594059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:47:40.907 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:47:40.907 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:47:41.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.012+0000 7f4c31b72640 1 Processor -- start 2024-04-25T15:47:41.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.012+0000 7f4c31b72640 1 -- start start 2024-04-25T15:47:41.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c31b72640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c2c0b91c0 0x7f4c2c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c31b72640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4c2c0d2480 0x7f4c2c0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c31b72640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2c0b2f30 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c31b72640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2c06eb60 con 0x7f4c2c0b91c0 2024-04-25T15:47:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c31b72640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2c0b2c90 con 0x7f4c2c0d2480 2024-04-25T15:47:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c2c0b91c0 0x7f4c2c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c2c0b91c0 0x7f4c2c0d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51244/0 (socket says 172.21.15.80:51244) 2024-04-25T15:47:41.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 -- 172.21.15.80:0/1816783858 learned_addr learned my addr 172.21.15.80:0/1816783858 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 -- 172.21.15.80:0/1816783858 >> v2:172.21.15.195:3300/0 conn(0x7f4c2c0d2480 msgr2=0x7f4c2c0d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2bfff640 1 --2- 172.21.15.80:0/1816783858 >> v2:172.21.15.195:3300/0 conn(0x7f4c2c0d2480 0x7f4c2c0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 --2- 172.21.15.80:0/1816783858 >> v2:172.21.15.195:3300/0 conn(0x7f4c2c0d2480 0x7f4c2c0d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 -- 172.21.15.80:0/1816783858 >> v1:172.21.15.195:6789/0 conn(0x7f4c2c0b4b60 legacy=0x7f4c2c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.014+0000 7f4c2affd640 1 -- 172.21.15.80:0/1816783858 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c0d10a0 con 0x7f4c2c0b91c0 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.015+0000 7f4c2affd640 1 --2- 172.21.15.80:0/1816783858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b91c0 0x7f4c2c0d1f40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009870 tx=0x7f4c2002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e43d751f6e0185 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.015+0000 7f4c2a7fc640 1 -- 172.21.15.80:0/1816783858 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20037070 con 0x7f4c2c0b91c0 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.015+0000 7f4c2a7fc640 1 -- 172.21.15.80:0/1816783858 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c20032440 con 0x7f4c2c0b91c0 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.015+0000 7f4c2a7fc640 1 -- 172.21.15.80:0/1816783858 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20032810 con 0x7f4c2c0b91c0 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 -- 172.21.15.80:0/1816783858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b91c0 msgr2=0x7f4c2c0d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1816783858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b91c0 0x7f4c2c0d1f40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009870 tx=0x7f4c2002a1c0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 -- 172.21.15.80:0/1816783858 shutdown_connections 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1816783858 >> v2:172.21.15.195:3300/0 conn(0x7f4c2c0d2480 0x7f4c2c0d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1816783858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b91c0 0x7f4c2c0d1f40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 -- 172.21.15.80:0/1816783858 >> 172.21.15.80:0/1816783858 conn(0x7f4c2c0d0450 msgr2=0x7f4c2c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 -- 172.21.15.80:0/1816783858 shutdown_connections 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.016+0000 7f4c31b72640 1 -- 172.21.15.80:0/1816783858 wait complete. 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.017+0000 7f4c31b72640 1 Processor -- start 2024-04-25T15:47:41.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.018+0000 7f4c31b72640 1 -- start start 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c31b72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 0x7f4c2c1fa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c31b72640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c2c0b91c0 0x7f4c2c1f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c31b72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c2c0d2480 0x7f4c2c0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c31b72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c09d0e0 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c31b72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c09cbe0 con 0x7f4c2c0d2480 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c31b72640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c09d260 con 0x7f4c2c0b91c0 2024-04-25T15:47:41.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c2b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 0x7f4c2c1fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c2b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 0x7f4c2c1fa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51246/0 (socket says 172.21.15.80:51246) 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.019+0000 7f4c2b7fe640 1 -- 172.21.15.80:0/1165957803 learned_addr learned my addr 172.21.15.80:0/1165957803 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2bfff640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c2c0d2480 0x7f4c2c0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2b7fe640 1 -- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c2c0b91c0 msgr2=0x7f4c2c1f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2affd640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c2c0b91c0 0x7f4c2c1f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2b7fe640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c2c0b91c0 0x7f4c2c1f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2b7fe640 1 -- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c2c0d2480 msgr2=0x7f4c2c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2b7fe640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c2c0d2480 0x7f4c2c0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2b7fe640 1 -- 172.21.15.80:0/1165957803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c1f0900 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2bfff640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c2c0d2480 0x7f4c2c0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c2b7fe640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 0x7f4c2c1fa490 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c005d30 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c016070 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c1f6a50 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c006270 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.020+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c1f7010 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.021+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2c075c90 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.022+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4c1c006410 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.022+0000 7f4c13fff640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c180744e0 0x7f4c180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.022+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f4c1c094ab0 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.022+0000 7f4c2affd640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c180744e0 0x7f4c180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.023+0000 7f4c2affd640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c180744e0 0x7f4c180769f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4c20034000 tx=0x7f4c2002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:41.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.027+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c1c05f3d0 con 0x7f4c2c0b4b60 2024-04-25T15:47:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.199+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c2c06a100 con 0x7f4c180744e0 2024-04-25T15:47:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.200+0000 7f4c13fff640 1 -- 172.21.15.80:0/1165957803 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7f4c200444c0 con 0x7f4c180744e0 2024-04-25T15:47:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:47:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c180744e0 msgr2=0x7f4c180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c180744e0 0x7f4c180769f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4c20034000 tx=0x7f4c2002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 msgr2=0x7f4c2c1fa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 0x7f4c2c1fa490 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c00b870 comp rx=0 tx=0).stop 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 shutdown_connections 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4c180744e0 0x7f4c180769f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c2c0d2480 0x7f4c2c0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c2c0b91c0 0x7f4c2c1f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 --2- 172.21.15.80:0/1165957803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c2c0b4b60 0x7f4c2c1fa490 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 >> 172.21.15.80:0/1165957803 conn(0x7f4c2c0d0450 msgr2=0x7f4c2c06d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 shutdown_connections 2024-04-25T15:47:41.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.202+0000 7f4c31b72640 1 -- 172.21.15.80:0/1165957803 wait complete. 2024-04-25T15:47:41.214 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-04-25T15:47:41.056021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":264932,"kb_used_data":11320,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709788,"statfs":{"total":773094113280,"available":772822822912,"internally_reserved":0,"allocated":11591680,"data_stored":5971942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24623,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-168,"num_write_kb":-85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001304"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":280,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-25T15:47:37.429938+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:47:37.429938+0000","last_peered":"2024-04-25T15:47:37.429938+0000","last_clean":"2024-04-25T15:47:37.429938+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:47:37.429938+0000","last_undegraded":"2024-04-25T15:47:37.429938+0000","last_fullsized":"2024-04-25T15:47:37.429938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36612,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1302528,"data_stored":600530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1896448,"data_stored":1190898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1896448,"data_stored":1190898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1290240,"data_stored":593967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":594059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:47:41.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:47:41.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.321+0000 7ff9e8764640 1 Processor -- start 2024-04-25T15:47:41.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.321+0000 7ff9e8764640 1 -- start start 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e8764640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e00d2f20 0x7ff9e015e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e8764640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00ce6d0 con 0x7ff9e009b4a0 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e8764640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00ce9b0 con 0x7ff9e00ce210 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e8764640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00cec90 con 0x7ff9e00d2f20 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e6d01640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff9e009b4a0 0x7ff9e006cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33678/0 (socket says 172.21.15.80:33678) 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e6d01640 1 -- 172.21.15.80:0/1052993275 learned_addr learned my addr 172.21.15.80:0/1052993275 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e5cff640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e00d2f20 0x7ff9e015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376590511 0 0) 0x7ff9e00ce6d0 con 0x7ff9e009b4a0 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9cc003520 con 0x7ff9e009b4a0 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982960485 0 0) 0x7ff9e00ce9b0 con 0x7ff9e00ce210 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e00ce6d0 con 0x7ff9e00ce210 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1622685347 0 0) 0x7ff9cc003520 con 0x7ff9e009b4a0 2024-04-25T15:47:41.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e00d2f20 msgr2=0x7ff9e015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e00d2f20 0x7ff9e015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 >> v1:172.21.15.195:6789/0 conn(0x7ff9e00ce210 legacy=0x7ff9e00d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00cef70 con 0x7ff9e009b4a0 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7ff9d80019f0 con 0x7ff9e009b4a0 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 >> v1:172.21.15.80:6789/0 conn(0x7ff9e009b4a0 legacy=0x7ff9e006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.323+0000 7ff9e54fe640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc003b70 0x7ff9cc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e54fe640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc004800 0x7ff9cc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e54fe640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00cec90 con 0x7ff9cc005150 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc00c030 con 0x7ff9cc004800 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc00c230 con 0x7ff9cc003b70 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6d01640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6500640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc003b70 0x7ff9cc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e5cff640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc004800 0x7ff9cc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6d01640 1 -- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc003b70 msgr2=0x7ff9cc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6d01640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc003b70 0x7ff9cc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6d01640 1 -- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc004800 msgr2=0x7ff9cc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6d01640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc004800 0x7ff9cc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.324+0000 7ff9e6d01640 1 -- 172.21.15.80:0/1052993275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc003520 con 0x7ff9cc005150 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.325+0000 7ff9e6d01640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9cc00b9c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00d3930 tx=0x7ff9cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c60abe26be75834 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.325+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800a330 con 0x7ff9cc005150 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.325+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d802f070 con 0x7ff9cc005150 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.325+0000 7ff9e54fe640 1 -- 172.21.15.80:0/1052993275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d802bb10 con 0x7ff9cc005150 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e8764640 1 -- 172.21.15.80:0/1052993275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 msgr2=0x7ff9cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e8764640 1 --2- 172.21.15.80:0/1052993275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9cc00b9c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00d3930 tx=0x7ff9cc005830 comp rx=0 tx=0).stop 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e6d01640 1 -- 172.21.15.80:0/1052993275 reap_dead start 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e8764640 1 -- 172.21.15.80:0/1052993275 shutdown_connections 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e8764640 1 -- 172.21.15.80:0/1052993275 >> 172.21.15.80:0/1052993275 conn(0x7ff9e0074740 msgr2=0x7ff9e00b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:41.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e8764640 1 -- 172.21.15.80:0/1052993275 shutdown_connections 2024-04-25T15:47:41.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.326+0000 7ff9e8764640 1 -- 172.21.15.80:0/1052993275 wait complete. 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.327+0000 7ff9e8764640 1 Processor -- start 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.328+0000 7ff9e8764640 1 -- start start 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e8764640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9e0160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e8764640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e014d400 0x7ff9e014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e8764640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e014dd50 0x7ff9e01f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e8764640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00d30a0 con 0x7ff9cc005150 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e8764640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00d2f20 con 0x7ff9e014dd50 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e8764640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e009bf00 con 0x7ff9e014d400 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9e0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9e0160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51252/0 (socket says 172.21.15.80:51252) 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 -- 172.21.15.80:0/3202968421 learned_addr learned my addr 172.21.15.80:0/3202968421 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6d01640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e014dd50 0x7ff9e01f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e5cff640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e014d400 0x7ff9e014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 -- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e014d400 msgr2=0x7ff9e014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e014d400 0x7ff9e014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 -- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e014dd50 msgr2=0x7ff9e01f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e014dd50 0x7ff9e01f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 -- 172.21.15.80:0/3202968421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00c9a90 con 0x7ff9cc005150 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6d01640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e014dd50 0x7ff9e01f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.329+0000 7ff9e6500640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9e0160790 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000f810 tx=0x7ff9d000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.330+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000fe60 con 0x7ff9cc005150 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.330+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0018070 con 0x7ff9cc005150 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.330+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e00c9d70 con 0x7ff9cc005150 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.330+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000d6d0 con 0x7ff9cc005150 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.330+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e00ca330 con 0x7ff9cc005150 2024-04-25T15:47:41.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.331+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e006a100 con 0x7ff9cc005150 2024-04-25T15:47:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.331+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff9d000d870 con 0x7ff9cc005150 2024-04-25T15:47:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.332+0000 7ff9d6ffd640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9c40744b0 0x7ff9c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.332+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7ff9d0095090 con 0x7ff9cc005150 2024-04-25T15:47:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.332+0000 7ff9e5cff640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9c40744b0 0x7ff9c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.332+0000 7ff9e5cff640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9c40744b0 0x7ff9c40769c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00b5720 tx=0x7ff9dc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.336+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9d005f9b0 con 0x7ff9cc005150 2024-04-25T15:47:41.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.515+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9e015bf90 con 0x7ff9cc005150 2024-04-25T15:47:41.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.516+0000 7ff9d6ffd640 1 -- 172.21.15.80:0/3202968421 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13675 (secure 0 0 0) 0x7ff9d005f2b0 con 0x7ff9cc005150 2024-04-25T15:47:41.517 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:41.517 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":106,"fsid":"e35f5388-3109-4b08-854a-9a0b33367f12","created":"2024-04-25T15:42:36.843092+0000","modified":"2024-04-25T15:47:38.427673+0000","last_up_change":"2024-04-25T15:42:48.209139+0000","last_in_change":"2024-04-25T15:42:39.076130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:42:49.012146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2943c120-51b2-4818-bfd7-9b2baf1a86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6810","nonce":4108878667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6815","nonce":4108878667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6823","nonce":4108878667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6817","nonce":4108878667},{"type":"v1","addr":"172.21.15.80:6819","nonce":4108878667}]},"public_addr":"172.21.15.80:6810/4108878667","cluster_addr":"172.21.15.80:6815/4108878667","heartbeat_back_addr":"172.21.15.80:6823/4108878667","heartbeat_front_addr":"172.21.15.80:6819/4108878667","state":["exists","up"]},{"osd":1,"uuid":"6edee3a0-8e7f-484c-b8ec-0c323840b462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6825","nonce":70437144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6827","nonce":70437144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6831","nonce":70437144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":70437144},{"type":"v1","addr":"172.21.15.80:6829","nonce":70437144}]},"public_addr":"172.21.15.80:6825/70437144","cluster_addr":"172.21.15.80:6827/70437144","heartbeat_back_addr":"172.21.15.80:6831/70437144","heartbeat_front_addr":"172.21.15.80:6829/70437144","state":["exists","up"]},{"osd":2,"uuid":"0b43b3cf-8ea6-4c2d-845a-f5a9261ebdcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6801","nonce":1881939009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6803","nonce":1881939009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6807","nonce":1881939009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1881939009},{"type":"v1","addr":"172.21.15.80:6805","nonce":1881939009}]},"public_addr":"172.21.15.80:6801/1881939009","cluster_addr":"172.21.15.80:6803/1881939009","heartbeat_back_addr":"172.21.15.80:6807/1881939009","heartbeat_front_addr":"172.21.15.80:6805/1881939009","state":["exists","up"]},{"osd":3,"uuid":"cdf05e74-3831-4b2e-9eec-cacec0ea3b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6811","nonce":3224498559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6813","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6814","nonce":3224498559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6821","nonce":3224498559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":3224498559},{"type":"v1","addr":"172.21.15.80:6818","nonce":3224498559}]},"public_addr":"172.21.15.80:6811/3224498559","cluster_addr":"172.21.15.80:6814/3224498559","heartbeat_back_addr":"172.21.15.80:6821/3224498559","heartbeat_front_addr":"172.21.15.80:6818/3224498559","state":["exists","up"]},{"osd":4,"uuid":"ee93c108-d2f4-44fa-88f2-9029d0a1002e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6809","nonce":2711684180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6811","nonce":2711684180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6815","nonce":2711684180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2711684180},{"type":"v1","addr":"172.21.15.195:6813","nonce":2711684180}]},"public_addr":"172.21.15.195:6809/2711684180","cluster_addr":"172.21.15.195:6811/2711684180","heartbeat_back_addr":"172.21.15.195:6815/2711684180","heartbeat_front_addr":"172.21.15.195:6813/2711684180","state":["exists","up"]},{"osd":5,"uuid":"35258f96-0ef1-4a49-a732-25d05c3ed73f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6801","nonce":1786051066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6803","nonce":1786051066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6807","nonce":1786051066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1786051066},{"type":"v1","addr":"172.21.15.195:6805","nonce":1786051066}]},"public_addr":"172.21.15.195:6801/1786051066","cluster_addr":"172.21.15.195:6803/1786051066","heartbeat_back_addr":"172.21.15.195:6807/1786051066","heartbeat_front_addr":"172.21.15.195:6805/1786051066","state":["exists","up"]},{"osd":6,"uuid":"4b187a84-2107-4e8e-b674-fbe439014fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6825","nonce":3079831018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6827","nonce":3079831018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6831","nonce":3079831018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3079831018},{"type":"v1","addr":"172.21.15.195:6829","nonce":3079831018}]},"public_addr":"172.21.15.195:6825/3079831018","cluster_addr":"172.21.15.195:6827/3079831018","heartbeat_back_addr":"172.21.15.195:6831/3079831018","heartbeat_front_addr":"172.21.15.195:6829/3079831018","state":["exists","up"]},{"osd":7,"uuid":"9b484b8a-acda-45b2-a9e9-772f421ae600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6817","nonce":1930343330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6819","nonce":1930343330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6823","nonce":1930343330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1930343330},{"type":"v1","addr":"172.21.15.195:6821","nonce":1930343330}]},"public_addr":"172.21.15.195:6817/1930343330","cluster_addr":"172.21.15.195:6819/1930343330","heartbeat_back_addr":"172.21.15.195:6823/1930343330","heartbeat_front_addr":"172.21.15.195:6821/1930343330","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.239649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.231164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.282893+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.226174+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.119591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.255178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.236090+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:42:44.283760+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6837/2599426974":"2024-04-26T15:47:35.417599+0000","172.21.15.80:6834/3715281705":"2024-04-26T15:47:35.417581+0000","172.21.15.80:6836/2599426974":"2024-04-26T15:47:35.417599+0000","172.21.15.80:6835/3715281705":"2024-04-26T15:47:35.417581+0000","172.21.15.195:6834/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.195:6832/2812835007":"2024-04-26T15:47:11.149648+0000","172.21.15.80:6836/3726019359":"2024-04-26T15:47:10.413739+0000","172.21.15.80:6834/3726019359":"2024-04-26T15:47:10.413739+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:47:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9c40744b0 msgr2=0x7ff9c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9c40744b0 0x7ff9c40769c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00b5720 tx=0x7ff9dc009190 comp rx=0 tx=0).stop 2024-04-25T15:47:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 msgr2=0x7ff9e0160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9e0160790 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000f810 tx=0x7ff9d000fc10 comp rx=0 tx=0).stop 2024-04-25T15:47:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 shutdown_connections 2024-04-25T15:47:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff9c40744b0 0x7ff9c40769c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e014dd50 0x7ff9e01f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9e014d400 0x7ff9e014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 --2- 172.21.15.80:0/3202968421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9cc005150 0x7ff9e0160790 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 >> 172.21.15.80:0/3202968421 conn(0x7ff9e0074740 msgr2=0x7ff9e006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 shutdown_connections 2024-04-25T15:47:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:41.518+0000 7ff9e8764640 1 -- 172.21.15.80:0/3202968421 wait complete. 2024-04-25T15:47:42.531 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T15:47:42.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:42.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.644+0000 7ff77c1f3640 1 Processor -- start 2024-04-25T15:47:42.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.644+0000 7ff77c1f3640 1 -- start start 2024-04-25T15:47:42.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77c1f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff774153f70 0x7ff7740b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77c1f3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7740b0c00 0x7ff77406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77c1f3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff77406db10 0x7ff774160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77c1f3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff77406df20 con 0x7ff7740b0c00 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77c1f3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff7740b1180 con 0x7ff77406db10 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77c1f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff77415d4f0 con 0x7ff774153f70 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77978e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7740b0c00 0x7ff77406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.645+0000 7ff77978e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7740b0c00 0x7ff77406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51266/0 (socket says 172.21.15.80:51266) 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 -- 172.21.15.80:0/1798733384 learned_addr learned my addr 172.21.15.80:0/1798733384 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77a790640 1 --2- 172.21.15.80:0/1798733384 >> v2:172.21.15.195:3300/0 conn(0x7ff77406db10 0x7ff774160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 -- 172.21.15.80:0/1798733384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff774153f70 msgr2=0x7ff7740b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 --2- 172.21.15.80:0/1798733384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff774153f70 0x7ff7740b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 -- 172.21.15.80:0/1798733384 >> v2:172.21.15.195:3300/0 conn(0x7ff77406db10 msgr2=0x7ff774160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:42.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 --2- 172.21.15.80:0/1798733384 >> v2:172.21.15.195:3300/0 conn(0x7ff77406db10 0x7ff774160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 -- 172.21.15.80:0/1798733384 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77415e270 con 0x7ff7740b0c00 2024-04-25T15:47:42.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77a790640 1 --2- 172.21.15.80:0/1798733384 >> v2:172.21.15.195:3300/0 conn(0x7ff77406db10 0x7ff774160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:42.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.646+0000 7ff77978e640 1 --2- 172.21.15.80:0/1798733384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7740b0c00 0x7ff77406d5d0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff7740d17a0 tx=0x7ff76402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3ab10b7b927ca5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff778f8d640 1 -- 172.21.15.80:0/1798733384 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764037070 con 0x7ff7740b0c00 2024-04-25T15:47:42.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff778f8d640 1 -- 172.21.15.80:0/1798733384 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff764032440 con 0x7ff7740b0c00 2024-04-25T15:47:42.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff778f8d640 1 -- 172.21.15.80:0/1798733384 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764032810 con 0x7ff7740b0c00 2024-04-25T15:47:42.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 -- 172.21.15.80:0/1798733384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7740b0c00 msgr2=0x7ff77406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/1798733384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7740b0c00 0x7ff77406d5d0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff7740d17a0 tx=0x7ff76402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 -- 172.21.15.80:0/1798733384 shutdown_connections 2024-04-25T15:47:42.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/1798733384 >> v2:172.21.15.195:3300/0 conn(0x7ff77406db10 0x7ff774160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/1798733384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7740b0c00 0x7ff77406d5d0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/1798733384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff774153f70 0x7ff7740b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 -- 172.21.15.80:0/1798733384 >> 172.21.15.80:0/1798733384 conn(0x7ff7740d1e20 msgr2=0x7ff774073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 -- 172.21.15.80:0/1798733384 shutdown_connections 2024-04-25T15:47:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.647+0000 7ff77c1f3640 1 -- 172.21.15.80:0/1798733384 wait complete. 2024-04-25T15:47:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.649+0000 7ff77c1f3640 1 Processor -- start 2024-04-25T15:47:42.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.649+0000 7ff77c1f3640 1 -- start start 2024-04-25T15:47:42.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.650+0000 7ff77c1f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff77406db10 0x7ff774147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.650+0000 7ff77c1f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7740b0c00 0x7ff77414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.650+0000 7ff77c1f3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff774153f70 0x7ff7740b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77c1f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7740aefe0 con 0x7ff77406db10 2024-04-25T15:47:42.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77c1f3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff77415da70 con 0x7ff774153f70 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77c1f3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff7740af160 con 0x7ff7740b0c00 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff77406db10 0x7ff774147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff77406db10 0x7ff774147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51274/0 (socket says 172.21.15.80:51274) 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 -- 172.21.15.80:0/4018038908 learned_addr learned my addr 172.21.15.80:0/4018038908 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77a790640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff774153f70 0x7ff7740b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77978e640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7740b0c00 0x7ff77414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 -- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7740b0c00 msgr2=0x7ff77414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7740b0c00 0x7ff77414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 -- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff774153f70 msgr2=0x7ff7740b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff774153f70 0x7ff7740b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 -- 172.21.15.80:0/4018038908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7740b5f90 con 0x7ff77406db10 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77a790640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff774153f70 0x7ff7740b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:42.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77978e640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7740b0c00 0x7ff77414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff779f8f640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff77406db10 0x7ff774147870 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff77000b410 tx=0x7ff77000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770015020 con 0x7ff77406db10 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff770011850 con 0x7ff77406db10 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77414abe0 con 0x7ff77406db10 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770011c40 con 0x7ff77406db10 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.651+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7740b6490 con 0x7ff77406db10 2024-04-25T15:47:42.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.652+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff77414bbc0 con 0x7ff77406db10 2024-04-25T15:47:42.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.653+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff770018020 con 0x7ff77406db10 2024-04-25T15:47:42.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.653+0000 7ff76a7fc640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7580744b0 0x7ff7580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff77978e640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7580744b0 0x7ff7580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7ff770095780 con 0x7ff77406db10 2024-04-25T15:47:42.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff76a7fc640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7ff75807ab80 0x7ff75807d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 --> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff75807d6e0 con 0x7ff75807ab80 2024-04-25T15:47:42.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7ff770095c10 con 0x7ff77406db10 2024-04-25T15:47:42.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff77a790640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7ff75807ab80 0x7ff75807d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff77978e640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7580744b0 0x7ff7580769c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff76402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.654+0000 7ff77a790640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7ff75807ab80 0x7ff75807d010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.655+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== osd.0 v2:172.21.15.80:6808/4108878667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff75807d6e0 con 0x7ff75807ab80 2024-04-25T15:47:42.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 --> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff77406a100 con 0x7ff75807ab80 2024-04-25T15:47:42.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff76a7fc640 1 -- 172.21.15.80:0/4018038908 <== osd.0 v2:172.21.15.80:6808/4108878667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff77406a100 con 0x7ff75807ab80 2024-04-25T15:47:42.669 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:42.669 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:42.669 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:42.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7ff75807ab80 msgr2=0x7ff75807d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6808/4108878667,v1:172.21.15.80:6810/4108878667] conn(0x7ff75807ab80 0x7ff75807d010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7580744b0 msgr2=0x7ff7580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff7580744b0 0x7ff7580769c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff76402e000 comp rx=0 tx=0).stop 2024-04-25T15:47:42.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff77406db10 msgr2=0x7ff774147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 --2- 172.21.15.80:0/4018038908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff77406db10 0x7ff774147870 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff77000b410 tx=0x7ff77000b8d0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77a790640 1 -- 172.21.15.80:0/4018038908 reap_dead start 2024-04-25T15:47:42.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 shutdown_connections 2024-04-25T15:47:42.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 >> 172.21.15.80:0/4018038908 conn(0x7ff7740d1e20 msgr2=0x7ff774150410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:42.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 shutdown_connections 2024-04-25T15:47:42.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.668+0000 7ff77c1f3640 1 -- 172.21.15.80:0/4018038908 wait complete. 2024-04-25T15:47:42.680 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T15:47:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.786+0000 7f952c442640 1 Processor -- start 2024-04-25T15:47:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.786+0000 7f952c442640 1 -- start start 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952c442640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95240ce220 0x7f952409bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952c442640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240cf960 0x7f95240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952c442640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95241607c0 con 0x7f95240b1ef0 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952c442640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f95240cf4d0 con 0x7f95240ce220 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952c442640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95240ce630 con 0x7f95240cf960 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95240ce220 0x7f952409bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95240ce220 0x7f952409bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51286/0 (socket says 172.21.15.80:51286) 2024-04-25T15:47:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 -- 172.21.15.80:0/2870900652 learned_addr learned my addr 172.21.15.80:0/2870900652 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f95299dd640 1 --2- 172.21.15.80:0/2870900652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240cf960 0x7f95240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 -- 172.21.15.80:0/2870900652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240cf960 msgr2=0x7f95240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 --2- 172.21.15.80:0/2870900652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240cf960 0x7f95240cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 -- 172.21.15.80:0/2870900652 >> v1:172.21.15.195:6789/0 conn(0x7f95240b1ef0 legacy=0x7f95240d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.788+0000 7f952a1de640 1 -- 172.21.15.80:0/2870900652 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240ceba0 con 0x7f95240ce220 2024-04-25T15:47:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.789+0000 7f952a1de640 1 --2- 172.21.15.80:0/2870900652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240ce220 0x7f952409bb70 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f952002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0a34c8bdf68cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.789+0000 7f95291dc640 1 -- 172.21.15.80:0/2870900652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520037070 con 0x7f95240ce220 2024-04-25T15:47:42.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.789+0000 7f95291dc640 1 -- 172.21.15.80:0/2870900652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952002ae50 con 0x7f95240ce220 2024-04-25T15:47:42.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.789+0000 7f95291dc640 1 -- 172.21.15.80:0/2870900652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520032860 con 0x7f95240ce220 2024-04-25T15:47:42.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 -- 172.21.15.80:0/2870900652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240ce220 msgr2=0x7f952409bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 --2- 172.21.15.80:0/2870900652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240ce220 0x7f952409bb70 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f952002a300 comp rx=0 tx=0).stop 2024-04-25T15:47:42.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 -- 172.21.15.80:0/2870900652 shutdown_connections 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 --2- 172.21.15.80:0/2870900652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240cf960 0x7f95240cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 --2- 172.21.15.80:0/2870900652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240ce220 0x7f952409bb70 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 -- 172.21.15.80:0/2870900652 >> 172.21.15.80:0/2870900652 conn(0x7f95240b7620 msgr2=0x7f95240b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 -- 172.21.15.80:0/2870900652 shutdown_connections 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.790+0000 7f952c442640 1 -- 172.21.15.80:0/2870900652 wait complete. 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.792+0000 7f952c442640 1 Processor -- start 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.792+0000 7f952c442640 1 -- start start 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952c442640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 0x7f95241548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952c442640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240ce220 0x7f95240b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952c442640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95240cf960 0x7f952406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952c442640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f952409c0b0 con 0x7f95240b1ef0 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952c442640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f95240cf160 con 0x7f95240cf960 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952c442640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95240d3530 con 0x7f95240ce220 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 0x7f95241548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 0x7f95241548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51298/0 (socket says 172.21.15.80:51298) 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 -- 172.21.15.80:0/1263445693 learned_addr learned my addr 172.21.15.80:0/1263445693 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f95299dd640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240ce220 0x7f95240b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a9df640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95240cf960 0x7f952406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 -- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240ce220 msgr2=0x7f95240b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240ce220 0x7f95240b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 -- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95240cf960 msgr2=0x7f952406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95240cf960 0x7f952406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.793+0000 7f952a1de640 1 -- 172.21.15.80:0/1263445693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95241f9ce0 con 0x7f95240b1ef0 2024-04-25T15:47:42.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.794+0000 7f952a1de640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 0x7f95241548f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f95200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.794+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520041020 con 0x7f95240b1ef0 2024-04-25T15:47:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.794+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952003c870 con 0x7f95240b1ef0 2024-04-25T15:47:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.794+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95241f9fc0 con 0x7f95240b1ef0 2024-04-25T15:47:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.794+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520037040 con 0x7f95240b1ef0 2024-04-25T15:47:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.794+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95241fa580 con 0x7f95240b1ef0 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.795+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952406a100 con 0x7f95240b1ef0 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.795+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9520044020 con 0x7f95240b1ef0 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.796+0000 7f951affd640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95080744b0 0x7f95080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.796+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f95200b5980 con 0x7f95240b1ef0 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.796+0000 7f95299dd640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95080744b0 0x7f95080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.796+0000 7f95299dd640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95080744b0 0x7f95080769c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f95241f96d0 tx=0x7f9514009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:42.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.801+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f952004b030 con 0x7f95240b1ef0 2024-04-25T15:47:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.978+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9524154e30 con 0x7f95080744b0 2024-04-25T15:47:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.979+0000 7f951affd640 1 -- 172.21.15.80:0/1263445693 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f95140119d0 con 0x7f95080744b0 2024-04-25T15:47:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T15:47:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95080744b0 msgr2=0x7f95080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95080744b0 0x7f95080769c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f95241f96d0 tx=0x7f9514009190 comp rx=0 tx=0).stop 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 msgr2=0x7f95241548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 0x7f95241548f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f95200046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 shutdown_connections 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f95080744b0 0x7f95080769c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95240cf960 0x7f952406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95240ce220 0x7f95240b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 --2- 172.21.15.80:0/1263445693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95240b1ef0 0x7f95241548f0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:42.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 >> 172.21.15.80:0/1263445693 conn(0x7f95240b7620 msgr2=0x7f95240b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:42.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 shutdown_connections 2024-04-25T15:47:42.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:42.981+0000 7f952c442640 1 -- 172.21.15.80:0/1263445693 wait complete. 2024-04-25T15:47:42.993 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T15:47:42.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.104+0000 7f11f0ba8640 1 Processor -- start 2024-04-25T15:47:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.104+0000 7f11f0ba8640 1 -- start start 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11f0ba8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f11ec06d5d0 0x7f11ec06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11f0ba8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ec06df20 con 0x7f11ec153f70 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11f0ba8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ec0b1180 con 0x7f11ec0b4700 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11f0ba8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f11ec15d4f0 con 0x7f11ec06d5d0 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11ea59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f11ec153f70 0x7f11ec0b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33688/0 (socket says 172.21.15.80:33688) 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11ea59c640 1 -- 172.21.15.80:0/1987826178 learned_addr learned my addr 172.21.15.80:0/1987826178 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11e9d9b640 1 --2- 172.21.15.80:0/1987826178 >> v2:172.21.15.195:3300/0 conn(0x7f11ec06d5d0 0x7f11ec06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501033968 0 0) 0x7f11dc001490 con 0x7f11ec153f70 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d4003520 con 0x7f11ec153f70 2024-04-25T15:47:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.106+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046709009 0 0) 0x7f11ec0b1180 con 0x7f11ec0b4700 2024-04-25T15:47:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11dc001490 con 0x7f11ec0b4700 2024-04-25T15:47:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837702232 0 0) 0x7f11d4003520 con 0x7f11ec153f70 2024-04-25T15:47:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e9d9b640 1 -- 172.21.15.80:0/1987826178 >> v1:172.21.15.195:6789/0 conn(0x7f11ec0b4700 legacy=0x7f11ec0b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e9d9b640 1 -- 172.21.15.80:0/1987826178 >> v1:172.21.15.80:6789/0 conn(0x7f11ec153f70 legacy=0x7f11ec0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e9d9b640 1 -- 172.21.15.80:0/1987826178 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec15e270 con 0x7f11ec06d5d0 2024-04-25T15:47:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e9d9b640 1 --2- 172.21.15.80:0/1987826178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec06d5d0 0x7f11ec06d9e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f11e00097a0 tx=0x7f11e002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb04fc161c732f08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.107+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0037070 con 0x7f11ec06d5d0 2024-04-25T15:47:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e002ac50 con 0x7f11ec06d5d0 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11e959a640 1 -- 172.21.15.80:0/1987826178 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc001bc0 con 0x7f11ec06d5d0 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 -- 172.21.15.80:0/1987826178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec06d5d0 msgr2=0x7f11ec06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 --2- 172.21.15.80:0/1987826178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec06d5d0 0x7f11ec06d9e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f11e00097a0 tx=0x7f11e002a1c0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 -- 172.21.15.80:0/1987826178 shutdown_connections 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 --2- 172.21.15.80:0/1987826178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec06d5d0 0x7f11ec06d9e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 -- 172.21.15.80:0/1987826178 >> 172.21.15.80:0/1987826178 conn(0x7f11ec0d1e20 msgr2=0x7f11ec073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 -- 172.21.15.80:0/1987826178 shutdown_connections 2024-04-25T15:47:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.108+0000 7f11f0ba8640 1 -- 172.21.15.80:0/1987826178 wait complete. 2024-04-25T15:47:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.110+0000 7f11f0ba8640 1 Processor -- start 2024-04-25T15:47:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.110+0000 7f11f0ba8640 1 -- start start 2024-04-25T15:47:43.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.111+0000 7f11f0ba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11ec06d5d0 0x7f11ec152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.111+0000 7f11f0ba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11ec0b4700 0x7f11ec1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11f0ba8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec153f70 0x7f11ec1f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11f0ba8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec0b0dd0 con 0x7f11ec06d5d0 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11f0ba8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec15da70 con 0x7f11ec153f70 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11f0ba8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec1f4940 con 0x7f11ec0b4700 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11ec06d5d0 0x7f11ec152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11ec06d5d0 0x7f11ec152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51300/0 (socket says 172.21.15.80:51300) 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 -- 172.21.15.80:0/872252500 learned_addr learned my addr 172.21.15.80:0/872252500 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ead9d640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec153f70 0x7f11ec1f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11e9d9b640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11ec0b4700 0x7f11ec1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 -- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11ec0b4700 msgr2=0x7f11ec1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11ec0b4700 0x7f11ec1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 -- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec153f70 msgr2=0x7f11ec1f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec153f70 0x7f11ec1f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 -- 172.21.15.80:0/872252500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec09c4a0 con 0x7f11ec06d5d0 2024-04-25T15:47:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ead9d640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11ec153f70 0x7f11ec1f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11ea59c640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11ec06d5d0 0x7f11ec152e30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f11dc001b90 tx=0x7f11dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc017070 con 0x7f11ec06d5d0 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11dc012620 con 0x7f11ec06d5d0 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ec152be0 con 0x7f11ec06d5d0 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc012a10 con 0x7f11ec06d5d0 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.112+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ec09c720 con 0x7f11ec06d5d0 2024-04-25T15:47:43.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.113+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11ec06a100 con 0x7f11ec06d5d0 2024-04-25T15:47:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.114+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f11dc01a070 con 0x7f11ec06d5d0 2024-04-25T15:47:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.114+0000 7f11daffd640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11cc0744e0 0x7f11cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.114+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f11dc095a50 con 0x7f11ec06d5d0 2024-04-25T15:47:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.114+0000 7f11e9d9b640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11cc0744e0 0x7f11cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.115+0000 7f11daffd640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f11cc07abb0 0x7f11cc07d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.115+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 --> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11cc07d710 con 0x7f11cc07abb0 2024-04-25T15:47:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.115+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f11dc095e40 con 0x7f11ec06d5d0 2024-04-25T15:47:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.115+0000 7f11ead9d640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f11cc07abb0 0x7f11cc07d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.115+0000 7f11e9d9b640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11cc0744e0 0x7f11cc0769f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f11e0034000 tx=0x7f11e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.115+0000 7f11ead9d640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f11cc07abb0 0x7f11cc07d040 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.116+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== osd.1 v2:172.21.15.80:6824/70437144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11cc07d710 con 0x7f11cc07abb0 2024-04-25T15:47:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 --> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f11ec070570 con 0x7f11cc07abb0 2024-04-25T15:47:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11daffd640 1 -- 172.21.15.80:0/872252500 <== osd.1 v2:172.21.15.80:6824/70437144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f11ec070570 con 0x7f11cc07abb0 2024-04-25T15:47:43.130 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:43.130 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:43.130 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f11cc07abb0 msgr2=0x7f11cc07d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6824/70437144,v1:172.21.15.80:6825/70437144] conn(0x7f11cc07abb0 0x7f11cc07d040 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11cc0744e0 msgr2=0x7f11cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f11cc0744e0 0x7f11cc0769f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f11e0034000 tx=0x7f11e002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11ec06d5d0 msgr2=0x7f11ec152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 --2- 172.21.15.80:0/872252500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11ec06d5d0 0x7f11ec152e30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f11dc001b90 tx=0x7f11dc00a430 comp rx=0 tx=0).stop 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11ead9d640 1 -- 172.21.15.80:0/872252500 reap_dead start 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 shutdown_connections 2024-04-25T15:47:43.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 >> 172.21.15.80:0/872252500 conn(0x7f11ec0d1e20 msgr2=0x7f11ec0b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 shutdown_connections 2024-04-25T15:47:43.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.129+0000 7f11f0ba8640 1 -- 172.21.15.80:0/872252500 wait complete. 2024-04-25T15:47:43.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T15:47:43.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.247+0000 7fad2230d640 1 Processor -- start 2024-04-25T15:47:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.247+0000 7fad2230d640 1 -- start start 2024-04-25T15:47:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad2230d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad1c0d22c0 0x7fad1c0d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad2230d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c1626e0 0x7fad1c162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad2230d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad1c163030 0x7fad1c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad2230d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c09cd00 con 0x7fad1c0d22c0 2024-04-25T15:47:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad2230d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c0cfe50 con 0x7fad1c163030 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad2230d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0d37e0 con 0x7fad1c1626e0 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad1c0d22c0 0x7fad1c0d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad1c0d22c0 0x7fad1c0d26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51316/0 (socket says 172.21.15.80:51316) 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 -- 172.21.15.80:0/904548829 learned_addr learned my addr 172.21.15.80:0/904548829 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c1626e0 0x7fad1c162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad208aa640 1 --2- 172.21.15.80:0/904548829 >> v2:172.21.15.195:3300/0 conn(0x7fad1c163030 0x7fad1c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 -- 172.21.15.80:0/904548829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c1626e0 msgr2=0x7fad1c162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c1626e0 0x7fad1c162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 -- 172.21.15.80:0/904548829 >> v2:172.21.15.195:3300/0 conn(0x7fad1c163030 msgr2=0x7fad1c0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 --2- 172.21.15.80:0/904548829 >> v2:172.21.15.195:3300/0 conn(0x7fad1c163030 0x7fad1c0b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1bfff640 1 -- 172.21.15.80:0/904548829 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0b91c0 con 0x7fad1c0d22c0 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.249+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c1626e0 0x7fad1c162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.250+0000 7fad1bfff640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c0d26d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fad1c074330 tx=0x7fad0c02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef46655a30408ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.250+0000 7fad1affd640 1 -- 172.21.15.80:0/904548829 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c02ade0 con 0x7fad1c0d22c0 2024-04-25T15:47:43.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.250+0000 7fad1affd640 1 -- 172.21.15.80:0/904548829 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c004030 con 0x7fad1c0d22c0 2024-04-25T15:47:43.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.250+0000 7fad1affd640 1 -- 172.21.15.80:0/904548829 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c004460 con 0x7fad1c0d22c0 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 -- 172.21.15.80:0/904548829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 msgr2=0x7fad1c0d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c0d26d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fad1c074330 tx=0x7fad0c02a0d0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 -- 172.21.15.80:0/904548829 shutdown_connections 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 --2- 172.21.15.80:0/904548829 >> v2:172.21.15.195:3300/0 conn(0x7fad1c163030 0x7fad1c0b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c1626e0 0x7fad1c162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 --2- 172.21.15.80:0/904548829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c0d26d0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 -- 172.21.15.80:0/904548829 >> 172.21.15.80:0/904548829 conn(0x7fad1c0d0450 msgr2=0x7fad1c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 -- 172.21.15.80:0/904548829 shutdown_connections 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.251+0000 7fad2230d640 1 -- 172.21.15.80:0/904548829 wait complete. 2024-04-25T15:47:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.253+0000 7fad2230d640 1 Processor -- start 2024-04-25T15:47:43.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.253+0000 7fad2230d640 1 -- start start 2024-04-25T15:47:43.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad2230d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad2230d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad1c1626e0 0x7fad1c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad2230d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c163030 0x7fad1c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad2230d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c09d190 con 0x7fad1c0d22c0 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad2230d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c163440 con 0x7fad1c1626e0 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad2230d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0d47e0 con 0x7fad1c163030 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51326/0 (socket says 172.21.15.80:51326) 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 -- 172.21.15.80:0/93641425 learned_addr learned my addr 172.21.15.80:0/93641425 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad1c1626e0 0x7fad1c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad208aa640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c163030 0x7fad1c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 -- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c163030 msgr2=0x7fad1c1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c163030 0x7fad1c1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 -- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad1c1626e0 msgr2=0x7fad1c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad1c1626e0 0x7fad1c15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.254+0000 7fad1bfff640 1 -- 172.21.15.80:0/93641425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0cc310 con 0x7fad1c0d22c0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.255+0000 7fad1bfff640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c153760 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009970 tx=0x7fad0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.255+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c041030 con 0x7fad1c0d22c0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.255+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c003610 con 0x7fad1c0d22c0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.255+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c153ca0 con 0x7fad1c0d22c0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.255+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0044e0 con 0x7fad1c0d22c0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.255+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c0cc8d0 con 0x7fad1c0d22c0 2024-04-25T15:47:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.256+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c06a100 con 0x7fad1c0d22c0 2024-04-25T15:47:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.256+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fad0c044070 con 0x7fad1c0d22c0 2024-04-25T15:47:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.257+0000 7fad18ff9640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad080744b0 0x7fad080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.257+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fad0c0b56d0 con 0x7fad1c0d22c0 2024-04-25T15:47:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.257+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad080744b0 0x7fad080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.257+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad080744b0 0x7fad080769c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0d1c90 tx=0x7fad10009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.261+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad0c07f880 con 0x7fad1c0d22c0 2024-04-25T15:47:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.440+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fad1c0c7060 con 0x7fad080744b0 2024-04-25T15:47:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.441+0000 7fad18ff9640 1 -- 172.21.15.80:0/93641425 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fad1c0c7060 con 0x7fad080744b0 2024-04-25T15:47:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad080744b0 msgr2=0x7fad080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad080744b0 0x7fad080769c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0d1c90 tx=0x7fad10009190 comp rx=0 tx=0).stop 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 msgr2=0x7fad1c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c153760 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009970 tx=0x7fad0c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 shutdown_connections 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fad080744b0 0x7fad080769c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad1c163030 0x7fad1c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad1c1626e0 0x7fad1c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 --2- 172.21.15.80:0/93641425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d22c0 0x7fad1c153760 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 >> 172.21.15.80:0/93641425 conn(0x7fad1c0d0450 msgr2=0x7fad1c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 shutdown_connections 2024-04-25T15:47:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.443+0000 7fad2230d640 1 -- 172.21.15.80:0/93641425 wait complete. 2024-04-25T15:47:43.455 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T15:47:43.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:43.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.565+0000 7f096cd0d640 1 Processor -- start 2024-04-25T15:47:43.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.565+0000 7f096cd0d640 1 -- start start 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096cd0d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f09680b2a40 0x7f09680b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096cd0d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096809d2a0 con 0x7f09680cff30 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096cd0d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09680b9350 con 0x7f096809ce90 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096cd0d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f09680cfb70 con 0x7f09680b2a40 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f09680cff30 0x7f09680d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33698/0 (socket says 172.21.15.80:33698) 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096659c640 1 -- 172.21.15.80:0/2726075500 learned_addr learned my addr 172.21.15.80:0/2726075500 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170236540 0 0) 0x7f0958001610 con 0x7f09680cff30 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0950003520 con 0x7f09680cff30 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f0965d9b640 1 --2- 172.21.15.80:0/2726075500 >> v2:172.21.15.195:3300/0 conn(0x7f09680b2a40 0x7f09680b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3164824911 0 0) 0x7f0950003520 con 0x7f09680cff30 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 >> v2:172.21.15.195:3300/0 conn(0x7f09680b2a40 msgr2=0x7f09680b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 --2- 172.21.15.80:0/2726075500 >> v2:172.21.15.195:3300/0 conn(0x7f09680b2a40 0x7f09680b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 >> v1:172.21.15.195:6789/0 conn(0x7f096809ce90 legacy=0x7f09680d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680cf890 con 0x7f09680cff30 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f0958001d40 con 0x7f09680cff30 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 >> v1:172.21.15.80:6789/0 conn(0x7f09680cff30 legacy=0x7f09680d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09500039b0 0x7f0950003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0950004800 0x7f0950004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0950005250 0x7f095000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09680cfb70 con 0x7f09500039b0 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f095000c1e0 con 0x7f0950005250 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.567+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f095000c3e0 con 0x7f0950004800 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f096659c640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09500039b0 0x7f0950003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f0966d9d640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0950005250 0x7f095000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f0965d9b640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0950004800 0x7f0950004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f096659c640 1 -- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0950004800 msgr2=0x7f0950004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f096659c640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0950004800 0x7f0950004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f096659c640 1 -- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0950005250 msgr2=0x7f095000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f096659c640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0950005250 0x7f095000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f096659c640 1 -- 172.21.15.80:0/2726075500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0950003520 con 0x7f09500039b0 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.568+0000 7f0966d9d640 1 -- 172.21.15.80:0/2726075500 reap_dead start 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096659c640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09500039b0 0x7f0950003e20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f095800a660 tx=0x7f0950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df91349f6dea4a6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095800a2b0 con 0x7f09500039b0 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095802f070 con 0x7f09500039b0 2024-04-25T15:47:43.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096559a640 1 -- 172.21.15.80:0/2726075500 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095802b670 con 0x7f09500039b0 2024-04-25T15:47:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 -- 172.21.15.80:0/2726075500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09500039b0 msgr2=0x7f0950003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09500039b0 0x7f0950003e20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f095800a660 tx=0x7f0950005830 comp rx=0 tx=0).stop 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 -- 172.21.15.80:0/2726075500 shutdown_connections 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 --2- 172.21.15.80:0/2726075500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09500039b0 0x7f0950003e20 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 -- 172.21.15.80:0/2726075500 >> 172.21.15.80:0/2726075500 conn(0x7f09680d0450 msgr2=0x7f09680d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 -- 172.21.15.80:0/2726075500 shutdown_connections 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.569+0000 7f096cd0d640 1 -- 172.21.15.80:0/2726075500 wait complete. 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.571+0000 7f096cd0d640 1 Processor -- start 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.571+0000 7f096cd0d640 1 -- start start 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09500039b0 0x7f096815ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09681f6520 0x7f096806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096806f260 0x7f09680cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09680d10f0 con 0x7f09681f6520 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f09680d0f70 con 0x7f096806f260 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f09680b7230 con 0x7f09500039b0 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09681f6520 0x7f096806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09681f6520 0x7f096806ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51356/0 (socket says 172.21.15.80:51356) 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 -- 172.21.15.80:0/2087041376 learned_addr learned my addr 172.21.15.80:0/2087041376 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0966d9d640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096806f260 0x7f09680cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096659c640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09500039b0 0x7f096815ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 -- 172.21.15.80:0/2087041376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09500039b0 msgr2=0x7f096815ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09500039b0 0x7f096815ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 -- 172.21.15.80:0/2087041376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096806f260 msgr2=0x7f09680cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096806f260 0x7f09680cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 -- 172.21.15.80:0/2087041376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680cb9e0 con 0x7f09681f6520 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0965d9b640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09681f6520 0x7f096806ed20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f095c011990 tx=0x7f095c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c019070 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c004240 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09680cbcc0 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.573+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c00f8c0 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.574+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09680cc280 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.574+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f096806a100 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.575+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f095c01c070 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.575+0000 7f0956ffd640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09480744b0 0x7f09480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f095c095c00 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f096659c640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09480744b0 0x7f09480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f0956ffd640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7f094807ab80 0x7f094807d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f094807d6e0 con 0x7f094807ab80 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f095c096090 con 0x7f09681f6520 2024-04-25T15:47:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f0966d9d640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7f094807ab80 0x7f094807d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f096659c640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09480744b0 0x7f09480769c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0958033000 tx=0x7f0958009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.576+0000 7f0966d9d640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7f094807ab80 0x7f094807d010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.577+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== osd.2 v2:172.21.15.80:6800/1881939009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f094807d6e0 con 0x7f094807ab80 2024-04-25T15:47:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 --> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f096806f730 con 0x7f094807ab80 2024-04-25T15:47:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f0956ffd640 1 -- 172.21.15.80:0/2087041376 <== osd.2 v2:172.21.15.80:6800/1881939009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f096806f730 con 0x7f094807ab80 2024-04-25T15:47:43.592 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:43.592 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7f094807ab80 msgr2=0x7f094807d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6800/1881939009,v1:172.21.15.80:6801/1881939009] conn(0x7f094807ab80 0x7f094807d010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09480744b0 msgr2=0x7f09480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f09480744b0 0x7f09480769c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0958033000 tx=0x7f0958009030 comp rx=0 tx=0).stop 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09681f6520 msgr2=0x7f096806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f096cd0d640 1 --2- 172.21.15.80:0/2087041376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09681f6520 0x7f096806ed20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f095c011990 tx=0x7f095c011e50 comp rx=0 tx=0).stop 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.590+0000 7f0966d9d640 1 -- 172.21.15.80:0/2087041376 reap_dead start 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.591+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 shutdown_connections 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.591+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 >> 172.21.15.80:0/2087041376 conn(0x7f09680d0450 msgr2=0x7f09680720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.591+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 shutdown_connections 2024-04-25T15:47:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.591+0000 7f096cd0d640 1 -- 172.21.15.80:0/2087041376 wait complete. 2024-04-25T15:47:43.602 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T15:47:43.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.709+0000 7fba05db2640 1 Processor -- start 2024-04-25T15:47:43.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.709+0000 7fba05db2640 1 -- start start 2024-04-25T15:47:43.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fba05db2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba000ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fba05db2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba0006d0d0 0x7fba0006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fba05db2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0006c660 con 0x7fba000d2830 2024-04-25T15:47:43.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fba05db2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fba0006cc40 con 0x7fba0006d0d0 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fba05db2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fba000ced60 con 0x7fba0009bea0 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9fffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba0006d0d0 0x7fba0006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9feffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fba000d2830 0x7fba000d2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33710/0 (socket says 172.21.15.80:33710) 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9feffd640 1 -- 172.21.15.80:0/3464191519 learned_addr learned my addr 172.21.15.80:0/3464191519 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9ff7fe640 1 --2- 172.21.15.80:0/3464191519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba000ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9fffff640 1 -- 172.21.15.80:0/3464191519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 msgr2=0x7fba000ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9fffff640 1 --2- 172.21.15.80:0/3464191519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba000ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9fffff640 1 -- 172.21.15.80:0/3464191519 >> v1:172.21.15.80:6789/0 conn(0x7fba000d2830 legacy=0x7fba000d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9fe7fc640 1 -- 172.21.15.80:0/3464191519 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016164312 0 0) 0x7fba0006c660 con 0x7fba000d2830 2024-04-25T15:47:43.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.711+0000 7fb9fffff640 1 -- 172.21.15.80:0/3464191519 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0006c8d0 con 0x7fba0006d0d0 2024-04-25T15:47:43.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.712+0000 7fb9fffff640 1 --2- 172.21.15.80:0/3464191519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba0006d4e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009d90 tx=0x7fb9f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe85de7d93c3eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.712+0000 7fb9fe7fc640 1 -- 172.21.15.80:0/3464191519 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8007740 con 0x7fba0006d0d0 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.712+0000 7fb9fe7fc640 1 -- 172.21.15.80:0/3464191519 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f80078e0 con 0x7fba0006d0d0 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.712+0000 7fb9fe7fc640 1 -- 172.21.15.80:0/3464191519 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8007cb0 con 0x7fba0006d0d0 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 -- 172.21.15.80:0/3464191519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 msgr2=0x7fba0006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 --2- 172.21.15.80:0/3464191519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba0006d4e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009d90 tx=0x7fb9f802a660 comp rx=0 tx=0).stop 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 -- 172.21.15.80:0/3464191519 shutdown_connections 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 --2- 172.21.15.80:0/3464191519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba0006d4e0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 --2- 172.21.15.80:0/3464191519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba000ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 -- 172.21.15.80:0/3464191519 >> 172.21.15.80:0/3464191519 conn(0x7fba000b7620 msgr2=0x7fba000b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 -- 172.21.15.80:0/3464191519 shutdown_connections 2024-04-25T15:47:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.713+0000 7fba05db2640 1 -- 172.21.15.80:0/3464191519 wait complete. 2024-04-25T15:47:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.714+0000 7fba05db2640 1 Processor -- start 2024-04-25T15:47:43.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.715+0000 7fba05db2640 1 -- start start 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fba05db2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba001f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fba05db2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba001f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fba05db2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba000d2830 0x7fba0015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fba05db2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba000ce8c0 con 0x7fba0006d0d0 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fba05db2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fba000cf040 con 0x7fba000d2830 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fba05db2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fba000cea40 con 0x7fba0009bea0 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba001f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba001f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51362/0 (socket says 172.21.15.80:51362) 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 -- 172.21.15.80:0/2894992486 learned_addr learned my addr 172.21.15.80:0/2894992486 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9feffd640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba001f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9fffff640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba000d2830 0x7fba0015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 -- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 msgr2=0x7fba001f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba001f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 -- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba000d2830 msgr2=0x7fba0015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba000d2830 0x7fba0015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 -- 172.21.15.80:0/2894992486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba001f9f20 con 0x7fba0006d0d0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.716+0000 7fb9ff7fe640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba001f6ed0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e870 tx=0x7fb9f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.717+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0017070 con 0x7fba0006d0d0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.717+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f000c940 con 0x7fba0006d0d0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.717+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba001fa200 con 0x7fba0006d0d0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.717+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000cd10 con 0x7fba0006d0d0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.717+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba001fa7c0 con 0x7fba0006d0d0 2024-04-25T15:47:43.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.718+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0006a100 con 0x7fba0006d0d0 2024-04-25T15:47:43.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.718+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9f001a070 con 0x7fba0006d0d0 2024-04-25T15:47:43.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.719+0000 7fb9e7fff640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9ec0744e0 0x7fb9ec0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:43.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.719+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fb9f00953f0 con 0x7fba0006d0d0 2024-04-25T15:47:43.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.719+0000 7fb9feffd640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9ec0744e0 0x7fb9ec0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:43.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.719+0000 7fb9feffd640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9ec0744e0 0x7fb9ec0769f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4000f60 tx=0x7fb9f4007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:43.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.723+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9f005fbf0 con 0x7fba0006d0d0 2024-04-25T15:47:43.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.898+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fba000b41b0 con 0x7fb9ec0744e0 2024-04-25T15:47:43.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.898+0000 7fb9e7fff640 1 -- 172.21.15.80:0/2894992486 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fba000b41b0 con 0x7fb9ec0744e0 2024-04-25T15:47:43.900 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9ec0744e0 msgr2=0x7fb9ec0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9ec0744e0 0x7fb9ec0769f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4000f60 tx=0x7fb9f4007c00 comp rx=0 tx=0).stop 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 msgr2=0x7fba001f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba001f6ed0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e870 tx=0x7fb9f000ed30 comp rx=0 tx=0).stop 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 shutdown_connections 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fb9ec0744e0 0x7fb9ec0769f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba000d2830 0x7fba0015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba0009bea0 0x7fba001f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 --2- 172.21.15.80:0/2894992486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba0006d0d0 0x7fba001f6ed0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 >> 172.21.15.80:0/2894992486 conn(0x7fba000b7620 msgr2=0x7fba000b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.900+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 shutdown_connections 2024-04-25T15:47:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:43.901+0000 7fba05db2640 1 -- 172.21.15.80:0/2894992486 wait complete. 2024-04-25T15:47:43.912 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T15:47:43.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.024+0000 7f1b51c49640 1 Processor -- start 2024-04-25T15:47:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.024+0000 7f1b51c49640 1 -- start start 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b51c49640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b51c49640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b4c0b0c00 0x7f1b4c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b51c49640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1b4c06db10 0x7f1b4c160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b51c49640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c06df20 con 0x7f1b4c0b0c00 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b51c49640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c0b1180 con 0x7f1b4c06db10 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b51c49640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c15d4f0 con 0x7f1b4c153f70 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b4c0b0c00 0x7f1b4c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b4c0b0c00 0x7f1b4c06d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51378/0 (socket says 172.21.15.80:51378) 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 -- 172.21.15.80:0/3896560835 learned_addr learned my addr 172.21.15.80:0/3896560835 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4bfff640 1 --2- 172.21.15.80:0/3896560835 >> v2:172.21.15.195:3300/0 conn(0x7f1b4c06db10 0x7f1b4c160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4b7fe640 1 --2- 172.21.15.80:0/3896560835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 -- 172.21.15.80:0/3896560835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 msgr2=0x7f1b4c0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 --2- 172.21.15.80:0/3896560835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 -- 172.21.15.80:0/3896560835 >> v2:172.21.15.195:3300/0 conn(0x7f1b4c06db10 msgr2=0x7f1b4c160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 --2- 172.21.15.80:0/3896560835 >> v2:172.21.15.195:3300/0 conn(0x7f1b4c06db10 0x7f1b4c160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.025+0000 7f1b4affd640 1 -- 172.21.15.80:0/3896560835 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c15e270 con 0x7f1b4c0b0c00 2024-04-25T15:47:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.026+0000 7f1b4affd640 1 --2- 172.21.15.80:0/3896560835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c0b0c00 0x7f1b4c06d5d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0d17a0 tx=0x7f1b4002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7249f674e3460e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.026+0000 7f1b4a7fc640 1 -- 172.21.15.80:0/3896560835 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40037070 con 0x7f1b4c0b0c00 2024-04-25T15:47:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.026+0000 7f1b4a7fc640 1 -- 172.21.15.80:0/3896560835 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b40032440 con 0x7f1b4c0b0c00 2024-04-25T15:47:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.026+0000 7f1b4a7fc640 1 -- 172.21.15.80:0/3896560835 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40032810 con 0x7f1b4c0b0c00 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 -- 172.21.15.80:0/3896560835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c0b0c00 msgr2=0x7f1b4c06d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 --2- 172.21.15.80:0/3896560835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c0b0c00 0x7f1b4c06d5d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0d17a0 tx=0x7f1b4002a210 comp rx=0 tx=0).stop 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 -- 172.21.15.80:0/3896560835 shutdown_connections 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 --2- 172.21.15.80:0/3896560835 >> v2:172.21.15.195:3300/0 conn(0x7f1b4c06db10 0x7f1b4c160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 --2- 172.21.15.80:0/3896560835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c0b0c00 0x7f1b4c06d5d0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 --2- 172.21.15.80:0/3896560835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 -- 172.21.15.80:0/3896560835 >> 172.21.15.80:0/3896560835 conn(0x7f1b4c0d1e20 msgr2=0x7f1b4c073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 -- 172.21.15.80:0/3896560835 shutdown_connections 2024-04-25T15:47:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.027+0000 7f1b51c49640 1 -- 172.21.15.80:0/3896560835 wait complete. 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.029+0000 7f1b51c49640 1 Processor -- start 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.029+0000 7f1b51c49640 1 -- start start 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b51c49640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c06db10 0x7f1b4c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b51c49640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b4c0b0c00 0x7f1b4c1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b51c49640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b51c49640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0aefe0 con 0x7f1b4c06db10 2024-04-25T15:47:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b51c49640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c15da70 con 0x7f1b4c0b0c00 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b51c49640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c0af160 con 0x7f1b4c153f70 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b4b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c06db10 0x7f1b4c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b4b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c06db10 0x7f1b4c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51388/0 (socket says 172.21.15.80:51388) 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.030+0000 7f1b4b7fe640 1 -- 172.21.15.80:0/1822446695 learned_addr learned my addr 172.21.15.80:0/1822446695 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4affd640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b4c0b0c00 0x7f1b4c1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4bfff640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4b7fe640 1 -- 172.21.15.80:0/1822446695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 msgr2=0x7f1b4c0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4b7fe640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b4c153f70 0x7f1b4c0b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4b7fe640 1 -- 172.21.15.80:0/1822446695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b4c0b0c00 msgr2=0x7f1b4c1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4b7fe640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b4c0b0c00 0x7f1b4c1454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4b7fe640 1 -- 172.21.15.80:0/1822446695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c14a810 con 0x7f1b4c06db10 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b4b7fe640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c06db10 0x7f1b4c1555a0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00d5f0 tx=0x7f1b3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0125f0 con 0x7f1b4c06db10 2024-04-25T15:47:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c019070 con 0x7f1b4c06db10 2024-04-25T15:47:44.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c1616d0 con 0x7f1b4c06db10 2024-04-25T15:47:44.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0129d0 con 0x7f1b4c06db10 2024-04-25T15:47:44.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.031+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c14a530 con 0x7f1b4c06db10 2024-04-25T15:47:44.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.032+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b4c06a100 con 0x7f1b4c06db10 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1b3c012b70 con 0x7f1b4c06db10 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b33fff640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1b380744b0 0x7f1b380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f1b3c095ee0 con 0x7f1b4c06db10 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b4affd640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1b380744b0 0x7f1b380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b33fff640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f1b3807ab80 0x7f1b3807d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 --> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b3c013e50 con 0x7f1b3807ab80 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.033+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f1b3c096370 con 0x7f1b4c06db10 2024-04-25T15:47:44.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.034+0000 7f1b4bfff640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f1b3807ab80 0x7f1b3807d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.034+0000 7f1b4affd640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1b380744b0 0x7f1b380769c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1b40034000 tx=0x7f1b4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.034+0000 7f1b4bfff640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f1b3807ab80 0x7f1b3807d010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.035+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== osd.3 v2:172.21.15.80:6809/3224498559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b3c013e50 con 0x7f1b3807ab80 2024-04-25T15:47:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.048+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 --> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b4c070570 con 0x7f1b3807ab80 2024-04-25T15:47:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.048+0000 7f1b33fff640 1 -- 172.21.15.80:0/1822446695 <== osd.3 v2:172.21.15.80:6809/3224498559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b4c070570 con 0x7f1b3807ab80 2024-04-25T15:47:44.050 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:44.050 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:44.050 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.048+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f1b3807ab80 msgr2=0x7f1b3807d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.048+0000 7f1b51c49640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6809/3224498559,v1:172.21.15.80:6811/3224498559] conn(0x7f1b3807ab80 0x7f1b3807d010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1b380744b0 msgr2=0x7f1b380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f1b380744b0 0x7f1b380769c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1b40034000 tx=0x7f1b4002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c06db10 msgr2=0x7f1b4c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 --2- 172.21.15.80:0/1822446695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c06db10 0x7f1b4c1555a0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00d5f0 tx=0x7f1b3c00dab0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b4bfff640 1 -- 172.21.15.80:0/1822446695 reap_dead start 2024-04-25T15:47:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 shutdown_connections 2024-04-25T15:47:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 >> 172.21.15.80:0/1822446695 conn(0x7f1b4c0d1e20 msgr2=0x7f1b4c073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 shutdown_connections 2024-04-25T15:47:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.049+0000 7f1b51c49640 1 -- 172.21.15.80:0/1822446695 wait complete. 2024-04-25T15:47:44.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T15:47:44.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.168+0000 7fc40de13640 1 Processor -- start 2024-04-25T15:47:44.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.168+0000 7fc40de13640 1 -- start start 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc40de13640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4080d21f0 0x7fc40809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc40de13640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc40de13640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4080b3fe0 con 0x7fc4081604d0 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc40de13640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc4080ce6d0 con 0x7fc4080d21f0 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc40de13640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc4080ce110 con 0x7fc4080cee60 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc406ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4080d21f0 0x7fc40809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc4077fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4081604d0 0x7fc4080d1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33720/0 (socket says 172.21.15.80:33720) 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc4077fe640 1 -- 172.21.15.80:0/1894079523 learned_addr learned my addr 172.21.15.80:0/1894079523 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc406ffd640 1 -- 172.21.15.80:0/1894079523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 msgr2=0x7fc4080cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc406ffd640 1 --2- 172.21.15.80:0/1894079523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc406ffd640 1 -- 172.21.15.80:0/1894079523 >> v1:172.21.15.80:6789/0 conn(0x7fc4081604d0 legacy=0x7fc4080d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc4067fc640 1 -- 172.21.15.80:0/1894079523 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945065147 0 0) 0x7fc4080b3fe0 con 0x7fc4081604d0 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.169+0000 7fc406ffd640 1 -- 172.21.15.80:0/1894079523 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4080ce3f0 con 0x7fc4080d21f0 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.170+0000 7fc406ffd640 1 --2- 172.21.15.80:0/1894079523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40809bdf0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0097a0 tx=0x7fc3fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb34364c54e7bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.170+0000 7fc4067fc640 1 -- 172.21.15.80:0/1894079523 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc037070 con 0x7fc4080d21f0 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.170+0000 7fc4067fc640 1 -- 172.21.15.80:0/1894079523 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc032440 con 0x7fc4080d21f0 2024-04-25T15:47:44.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.170+0000 7fc4067fc640 1 -- 172.21.15.80:0/1894079523 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc032810 con 0x7fc4080d21f0 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 -- 172.21.15.80:0/1894079523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 msgr2=0x7fc40809bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 --2- 172.21.15.80:0/1894079523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40809bdf0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0097a0 tx=0x7fc3fc02a1a0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 -- 172.21.15.80:0/1894079523 shutdown_connections 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 --2- 172.21.15.80:0/1894079523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 --2- 172.21.15.80:0/1894079523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40809bdf0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 -- 172.21.15.80:0/1894079523 >> 172.21.15.80:0/1894079523 conn(0x7fc4080b7620 msgr2=0x7fc4080b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 -- 172.21.15.80:0/1894079523 shutdown_connections 2024-04-25T15:47:44.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.171+0000 7fc40de13640 1 -- 172.21.15.80:0/1894079523 wait complete. 2024-04-25T15:47:44.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.173+0000 7fc40de13640 1 Processor -- start 2024-04-25T15:47:44.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.173+0000 7fc40de13640 1 -- start start 2024-04-25T15:47:44.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc40de13640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc40de13640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40814ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc40de13640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4081604d0 0x7fc4080c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc40de13640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4080b3cf0 con 0x7fc4080d21f0 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc40de13640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc4080b3b70 con 0x7fc4081604d0 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc40de13640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc4080cf7b0 con 0x7fc4080cee60 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40814ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40814ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51396/0 (socket says 172.21.15.80:51396) 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc406ffd640 1 -- 172.21.15.80:0/3711322480 learned_addr learned my addr 172.21.15.80:0/3711322480 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc407fff640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4081604d0 0x7fc4080c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.174+0000 7fc4077fe640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc406ffd640 1 -- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 msgr2=0x7fc4080ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc406ffd640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc406ffd640 1 -- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4081604d0 msgr2=0x7fc4080c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc406ffd640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4081604d0 0x7fc4080c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc406ffd640 1 -- 172.21.15.80:0/3711322480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4081612c0 con 0x7fc4080d21f0 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc4077fe640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:44.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc406ffd640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40814ede0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc02a790 tx=0x7fc3fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc041070 con 0x7fc4080d21f0 2024-04-25T15:47:44.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc03c870 con 0x7fc4080d21f0 2024-04-25T15:47:44.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc037040 con 0x7fc4080d21f0 2024-04-25T15:47:44.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4080c65e0 con 0x7fc4080d21f0 2024-04-25T15:47:44.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.175+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4080c6880 con 0x7fc4080d21f0 2024-04-25T15:47:44.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.176+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40806a100 con 0x7fc4080d21f0 2024-04-25T15:47:44.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.177+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc3fc044070 con 0x7fc4080d21f0 2024-04-25T15:47:44.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.177+0000 7fc3effff640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3f40744e0 0x7fc3f40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.177+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fc3fc0b5c00 con 0x7fc4080d21f0 2024-04-25T15:47:44.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.177+0000 7fc4077fe640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3f40744e0 0x7fc3f40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.178+0000 7fc4077fe640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3f40744e0 0x7fc3f40769f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8000f60 tx=0x7fc3f8007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.182+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3fc0bc080 con 0x7fc4080d21f0 2024-04-25T15:47:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.357+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc4080ce960 con 0x7fc3f40744e0 2024-04-25T15:47:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.357+0000 7fc3effff640 1 -- 172.21.15.80:0/3711322480 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc4080ce960 con 0x7fc3f40744e0 2024-04-25T15:47:44.359 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T15:47:44.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3f40744e0 msgr2=0x7fc3f40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3f40744e0 0x7fc3f40769f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8000f60 tx=0x7fc3f8007ca0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 msgr2=0x7fc40814ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40814ede0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc02a790 tx=0x7fc3fc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 shutdown_connections 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc3f40744e0 0x7fc3f40769f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4081604d0 0x7fc4080c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4080d21f0 0x7fc40814ede0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 --2- 172.21.15.80:0/3711322480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4080cee60 0x7fc4080ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 >> 172.21.15.80:0/3711322480 conn(0x7fc4080b7620 msgr2=0x7fc4080b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 shutdown_connections 2024-04-25T15:47:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.359+0000 7fc40de13640 1 -- 172.21.15.80:0/3711322480 wait complete. 2024-04-25T15:47:44.372 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T15:47:44.372 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:44.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.482+0000 7f26cea05640 1 Processor -- start 2024-04-25T15:47:44.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.482+0000 7f26cea05640 1 -- start start 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26cea05640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 0x7f26c80b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26cea05640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f26c80b3850 0x7f26c816a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26cea05640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c80b2f30 con 0x7f26c806d6d0 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26cea05640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f26c806eb60 con 0x7f26c80b3850 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26cea05640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26c80b2c90 con 0x7f26c80b4b60 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f26c806d6d0 0x7f26c80b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40316/0 (socket says 172.21.15.80:40316) 2024-04-25T15:47:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c77fe640 1 -- 172.21.15.80:0/2489343780 learned_addr learned my addr 172.21.15.80:0/2489343780 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26ccfa2640 1 --2- 172.21.15.80:0/2489343780 >> v2:172.21.15.195:3300/0 conn(0x7f26c80b3850 0x7f26c816a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c7fff640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 0x7f26c80b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143496418 0 0) 0x7f26c80b2f30 con 0x7f26c806d6d0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b0003520 con 0x7f26c806d6d0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2535546718 0 0) 0x7f26b0003520 con 0x7f26c806d6d0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 msgr2=0x7f26c80b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 0x7f26c80b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 >> v2:172.21.15.195:3300/0 conn(0x7f26c80b3850 msgr2=0x7f26c816a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 --2- 172.21.15.80:0/2489343780 >> v2:172.21.15.195:3300/0 conn(0x7f26c80b3850 0x7f26c816a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c80d10a0 con 0x7f26c806d6d0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f26bc001670 con 0x7f26c806d6d0 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 >> v1:172.21.15.80:6789/0 conn(0x7f26c806d6d0 legacy=0x7f26c80b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.484+0000 7f26c6ffd640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b00039b0 0x7f26b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c6ffd640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c6ffd640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 0x7f26b0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f26c806eb60 con 0x7f26b0004800 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f26c80b2c90 con 0x7f26b00039b0 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26b000ba70 con 0x7f26c80b4b60 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c77fe640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26ccfa2640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 0x7f26b0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c7fff640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b00039b0 0x7f26b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c77fe640 1 -- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 msgr2=0x7f26b0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c77fe640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c80b4b60 0x7f26b0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c77fe640 1 -- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b00039b0 msgr2=0x7f26b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c77fe640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26b00039b0 0x7f26b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.485+0000 7f26c77fe640 1 -- 172.21.15.80:0/2489343780 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b0003520 con 0x7f26b0004800 2024-04-25T15:47:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26c77fe640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26b0004c10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f26bc001050 tx=0x7f26b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0bb588f748fcb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc007d70 con 0x7f26b0004800 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc005af0 con 0x7f26b0004800 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26c6ffd640 1 -- 172.21.15.80:0/2489343780 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc007070 con 0x7f26b0004800 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26cea05640 1 -- 172.21.15.80:0/2489343780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 msgr2=0x7f26b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26cea05640 1 --2- 172.21.15.80:0/2489343780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26b0004c10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f26bc001050 tx=0x7f26b0005830 comp rx=0 tx=0).stop 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26ccfa2640 1 -- 172.21.15.80:0/2489343780 reap_dead start 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26cea05640 1 -- 172.21.15.80:0/2489343780 shutdown_connections 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26cea05640 1 -- 172.21.15.80:0/2489343780 >> 172.21.15.80:0/2489343780 conn(0x7f26c80d0450 msgr2=0x7f26c80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26cea05640 1 -- 172.21.15.80:0/2489343780 shutdown_connections 2024-04-25T15:47:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.486+0000 7f26cea05640 1 -- 172.21.15.80:0/2489343780 wait complete. 2024-04-25T15:47:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.488+0000 7f26cea05640 1 Processor -- start 2024-04-25T15:47:44.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.488+0000 7f26cea05640 1 -- start start 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26c81f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c80a0c80 0x7f26c80a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c8071e90 0x7f26c80722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f26c80d2f50 con 0x7f26b0004800 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f26c809cbe0 con 0x7f26c80a0c80 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f26c809d0e0 con 0x7f26c8071e90 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26c81f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26c81f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50498/0 (socket says 172.21.15.80:50498) 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 -- 172.21.15.80:0/923184470 learned_addr learned my addr 172.21.15.80:0/923184470 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c77fe640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c80a0c80 0x7f26c80a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26ccfa2640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c8071e90 0x7f26c80722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 -- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c8071e90 msgr2=0x7f26c80722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c8071e90 0x7f26c80722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 -- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c80a0c80 msgr2=0x7f26c80a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c80a0c80 0x7f26c80a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 -- 172.21.15.80:0/923184470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c81f5d80 con 0x7f26b0004800 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c7fff640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26c81f5840 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f26b80118e0 tx=0x7f26b8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8005c60 con 0x7f26b0004800 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b8005e00 con 0x7f26b0004800 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c80727e0 con 0x7f26b0004800 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b800fa60 con 0x7f26b0004800 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.490+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c809dc10 con 0x7f26b0004800 2024-04-25T15:47:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.491+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26c806a100 con 0x7f26b0004800 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.492+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f26b8012040 con 0x7f26b0004800 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.492+0000 7f26c4ff9640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26b40744b0 0x7f26b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f26b8095750 con 0x7f26b0004800 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26c77fe640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26b40744b0 0x7f26b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26c4ff9640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f26b407ab80 0x7f26b407d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 --> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26b407d6e0 con 0x7f26b407ab80 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f26b809c050 con 0x7f26b0004800 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26c77fe640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26b40744b0 0x7f26b40769c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f26bc001050 tx=0x7f26bc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.493+0000 7f26ccfa2640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f26b407ab80 0x7f26b407d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.494+0000 7f26ccfa2640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f26b407ab80 0x7f26b407d010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.494+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== osd.4 v2:172.21.15.195:6808/2711684180 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26b407d6e0 con 0x7f26b407ab80 2024-04-25T15:47:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.507+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 --> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f26c806e760 con 0x7f26b407ab80 2024-04-25T15:47:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.507+0000 7f26c4ff9640 1 -- 172.21.15.80:0/923184470 <== osd.4 v2:172.21.15.195:6808/2711684180 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f26c806e760 con 0x7f26b407ab80 2024-04-25T15:47:44.509 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:44.509 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:44.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f26b407ab80 msgr2=0x7f26b407d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.195:6808/2711684180,v1:172.21.15.195:6809/2711684180] conn(0x7f26b407ab80 0x7f26b407d010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26b40744b0 msgr2=0x7f26b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f26b40744b0 0x7f26b40769c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f26bc001050 tx=0x7f26bc009030 comp rx=0 tx=0).stop 2024-04-25T15:47:44.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 msgr2=0x7f26c81f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 --2- 172.21.15.80:0/923184470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26b0004800 0x7f26c81f5840 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f26b80118e0 tx=0x7f26b8011da0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26ccfa2640 1 -- 172.21.15.80:0/923184470 reap_dead start 2024-04-25T15:47:44.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 shutdown_connections 2024-04-25T15:47:44.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 >> 172.21.15.80:0/923184470 conn(0x7f26c80d0450 msgr2=0x7f26c80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 shutdown_connections 2024-04-25T15:47:44.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.508+0000 7f26cea05640 1 -- 172.21.15.80:0/923184470 wait complete. 2024-04-25T15:47:44.520 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T15:47:44.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.628+0000 7f2c725ce640 1 Processor -- start 2024-04-25T15:47:44.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.628+0000 7f2c725ce640 1 -- start start 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c725ce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c06ee50 0x7f2c6c0d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c725ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c6c0b1bb0 0x7f2c6c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c725ce640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c0cfdd0 con 0x7f2c6c0b23a0 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c725ce640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2c6c0d0340 con 0x7f2c6c0b1bb0 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c725ce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c0b3cc0 con 0x7f2c6c06ee50 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c6c0b1bb0 0x7f2c6c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c70b6b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2c6c0b23a0 0x7f2c6c0b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40324/0 (socket says 172.21.15.80:40324) 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c6c0b1bb0 0x7f2c6c0d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50506/0 (socket says 172.21.15.80:50506) 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c70b6b640 1 -- 172.21.15.80:0/1992258320 learned_addr learned my addr 172.21.15.80:0/1992258320 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6bfff640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c06ee50 0x7f2c6c0d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6b7fe640 1 -- 172.21.15.80:0/1992258320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c06ee50 msgr2=0x7f2c6c0d2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6b7fe640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c06ee50 0x7f2c6c0d2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6b7fe640 1 -- 172.21.15.80:0/1992258320 >> v1:172.21.15.80:6789/0 conn(0x7f2c6c0b23a0 legacy=0x7f2c6c0b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.630+0000 7f2c6b7fe640 1 -- 172.21.15.80:0/1992258320 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c0d0060 con 0x7f2c6c0b1bb0 2024-04-25T15:47:44.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.629+0000 7f2c6affd640 1 -- 172.21.15.80:0/1992258320 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268130395 0 0) 0x7f2c6c0cfdd0 con 0x7f2c6c0b23a0 2024-04-25T15:47:44.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.630+0000 7f2c6bfff640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c06ee50 0x7f2c6c0d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.630+0000 7f2c6b7fe640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c0b1bb0 0x7f2c6c0d2bd0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f2c600097a0 tx=0x7f2c6002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa704c3fdb7e9d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.630+0000 7f2c6affd640 1 -- 172.21.15.80:0/1992258320 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60037070 con 0x7f2c6c0b1bb0 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.630+0000 7f2c6affd640 1 -- 172.21.15.80:0/1992258320 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60032440 con 0x7f2c6c0b1bb0 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.630+0000 7f2c6affd640 1 -- 172.21.15.80:0/1992258320 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60032810 con 0x7f2c6c0b1bb0 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 -- 172.21.15.80:0/1992258320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c0b1bb0 msgr2=0x7f2c6c0d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c0b1bb0 0x7f2c6c0d2bd0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f2c600097a0 tx=0x7f2c6002a180 comp rx=0 tx=0).stop 2024-04-25T15:47:44.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 -- 172.21.15.80:0/1992258320 shutdown_connections 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c0b1bb0 0x7f2c6c0d2bd0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 --2- 172.21.15.80:0/1992258320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c06ee50 0x7f2c6c0d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 -- 172.21.15.80:0/1992258320 >> 172.21.15.80:0/1992258320 conn(0x7f2c6c0b7750 msgr2=0x7f2c6c0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 -- 172.21.15.80:0/1992258320 shutdown_connections 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.631+0000 7f2c725ce640 1 -- 172.21.15.80:0/1992258320 wait complete. 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.633+0000 7f2c725ce640 1 Processor -- start 2024-04-25T15:47:44.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.633+0000 7f2c725ce640 1 -- start start 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c725ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 0x7f2c6c1fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c725ce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c0b1bb0 0x7f2c6c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c725ce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c6c0b23a0 0x7f2c6c071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c725ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0cd090 con 0x7f2c6c06ee50 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c725ce640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c09c250 con 0x7f2c6c0b23a0 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c725ce640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c0b4150 con 0x7f2c6c0b1bb0 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c6bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 0x7f2c6c1fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c6bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 0x7f2c6c1fa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50518/0 (socket says 172.21.15.80:50518) 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.634+0000 7f2c6bfff640 1 -- 172.21.15.80:0/64718770 learned_addr learned my addr 172.21.15.80:0/64718770 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c70b6b640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c6c0b23a0 0x7f2c6c071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6b7fe640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c0b1bb0 0x7f2c6c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6bfff640 1 -- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c0b1bb0 msgr2=0x7f2c6c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6bfff640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c0b1bb0 0x7f2c6c14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6bfff640 1 -- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c6c0b23a0 msgr2=0x7f2c6c071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6bfff640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c6c0b23a0 0x7f2c6c071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6bfff640 1 -- 172.21.15.80:0/64718770 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c14cfa0 con 0x7f2c6c06ee50 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c70b6b640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c6c0b23a0 0x7f2c6c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c6bfff640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 0x7f2c6c1fa310 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d830 tx=0x7f2c5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0096a0 con 0x7f2c6c06ee50 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c019070 con 0x7f2c6c06ee50 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c009a80 con 0x7f2c6c06ee50 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c14d280 con 0x7f2c6c06ee50 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.635+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c14d840 con 0x7f2c6c06ee50 2024-04-25T15:47:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.636+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c06a100 con 0x7f2c6c06ee50 2024-04-25T15:47:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.637+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2c5c01e460 con 0x7f2c6c06ee50 2024-04-25T15:47:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.637+0000 7f2c68ff9640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c580744e0 0x7f2c580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.637+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f2c5c095840 con 0x7f2c6c06ee50 2024-04-25T15:47:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.637+0000 7f2c6b7fe640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c580744e0 0x7f2c580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.638+0000 7f2c6b7fe640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c580744e0 0x7f2c580769f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2c60034000 tx=0x7f2c6002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.642+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c5c060040 con 0x7f2c6c06ee50 2024-04-25T15:47:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.818+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2c6c0cc970 con 0x7f2c580744e0 2024-04-25T15:47:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.818+0000 7f2c68ff9640 1 -- 172.21.15.80:0/64718770 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c6c0cc970 con 0x7f2c580744e0 2024-04-25T15:47:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T15:47:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c580744e0 msgr2=0x7f2c580769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c580744e0 0x7f2c580769f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2c60034000 tx=0x7f2c6002e000 comp rx=0 tx=0).stop 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 msgr2=0x7f2c6c1fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 0x7f2c6c1fa310 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d830 tx=0x7f2c5c00dcf0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 shutdown_connections 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f2c580744e0 0x7f2c580769f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c6c0b23a0 0x7f2c6c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2c6c0b1bb0 0x7f2c6c14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 --2- 172.21.15.80:0/64718770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6c06ee50 0x7f2c6c1fa310 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 >> 172.21.15.80:0/64718770 conn(0x7f2c6c0b7750 msgr2=0x7f2c6c0b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 shutdown_connections 2024-04-25T15:47:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.820+0000 7f2c725ce640 1 -- 172.21.15.80:0/64718770 wait complete. 2024-04-25T15:47:44.832 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T15:47:44.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:44.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.942+0000 7fd3206b1640 1 Processor -- start 2024-04-25T15:47:44.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.942+0000 7fd3206b1640 1 -- start start 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.943+0000 7fd3206b1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3180b4b60 0x7fd3180b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.943+0000 7fd3206b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd31806d6d0 0x7fd3180b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.943+0000 7fd3206b1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180b2f30 con 0x7fd3180b3680 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.943+0000 7fd3206b1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd31806eb60 con 0x7fd3180b4b60 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.943+0000 7fd3206b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd3180b2c90 con 0x7fd31806d6d0 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3180b4b60 0x7fd3180b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31dc4c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd31806d6d0 0x7fd3180b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3180b4b60 0x7fd3180b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:33692/0 (socket says 172.21.15.80:33692) 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 -- 172.21.15.80:0/2932552236 learned_addr learned my addr 172.21.15.80:0/2932552236 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31ec4e640 1 --1- 172.21.15.80:0/2932552236 >> v1:172.21.15.195:6789/0 conn(0x7fd3180b3680 0x7fd3180d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54036/0 (socket says 172.21.15.80:54036) 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 -- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd31806d6d0 msgr2=0x7fd3180b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 --2- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd31806d6d0 0x7fd3180b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 -- 172.21.15.80:0/2932552236 >> v1:172.21.15.195:6789/0 conn(0x7fd3180b3680 legacy=0x7fd3180d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.944+0000 7fd31e44d640 1 -- 172.21.15.80:0/2932552236 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180d10a0 con 0x7fd3180b4b60 2024-04-25T15:47:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.945+0000 7fd31e44d640 1 --2- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b4b60 0x7fd3180b91c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd314009850 tx=0x7fd31402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b2cbd639fd9fcf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.945+0000 7fd31d44b640 1 -- 172.21.15.80:0/2932552236 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314004030 con 0x7fd3180b4b60 2024-04-25T15:47:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.945+0000 7fd31d44b640 1 -- 172.21.15.80:0/2932552236 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3140041d0 con 0x7fd3180b4b60 2024-04-25T15:47:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.945+0000 7fd31d44b640 1 -- 172.21.15.80:0/2932552236 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314003610 con 0x7fd3180b4b60 2024-04-25T15:47:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 -- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b4b60 msgr2=0x7fd3180b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 --2- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b4b60 0x7fd3180b91c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd314009850 tx=0x7fd31402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 -- 172.21.15.80:0/2932552236 shutdown_connections 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 --2- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd31806d6d0 0x7fd3180b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 --2- 172.21.15.80:0/2932552236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b4b60 0x7fd3180b91c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 -- 172.21.15.80:0/2932552236 >> 172.21.15.80:0/2932552236 conn(0x7fd3180d0450 msgr2=0x7fd3180d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 -- 172.21.15.80:0/2932552236 shutdown_connections 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.946+0000 7fd3206b1640 1 -- 172.21.15.80:0/2932552236 wait complete. 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.948+0000 7fd3206b1640 1 Processor -- start 2024-04-25T15:47:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.948+0000 7fd3206b1640 1 -- start start 2024-04-25T15:47:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd3206b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd31806d6d0 0x7fd31809e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd3206b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b3680 0x7fd3180a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd3206b1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3180b4b60 0x7fd3180a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd3206b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd31809d0e0 con 0x7fd31806d6d0 2024-04-25T15:47:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd3206b1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd31809cbe0 con 0x7fd3180b3680 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd3206b1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd31809d260 con 0x7fd3180b4b60 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd31806d6d0 0x7fd31809e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd31806d6d0 0x7fd31809e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50530/0 (socket says 172.21.15.80:50530) 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 -- 172.21.15.80:0/4015212784 learned_addr learned my addr 172.21.15.80:0/4015212784 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31dc4c640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b3680 0x7fd3180a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31ec4e640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3180b4b60 0x7fd3180a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 -- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3180b4b60 msgr2=0x7fd3180a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3180b4b60 0x7fd3180a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 -- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b3680 msgr2=0x7fd3180a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3180b3680 0x7fd3180a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 -- 172.21.15.80:0/4015212784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31809f1f0 con 0x7fd31806d6d0 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.949+0000 7fd31e44d640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd31806d6d0 0x7fd31809e910 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd31402a1e0 tx=0x7fd3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.950+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314041020 con 0x7fd31806d6d0 2024-04-25T15:47:44.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.950+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd314003c50 con 0x7fd31806d6d0 2024-04-25T15:47:44.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.950+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314004030 con 0x7fd31806d6d0 2024-04-25T15:47:44.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.950+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3180c74a0 con 0x7fd31806d6d0 2024-04-25T15:47:44.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.950+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180c9000 con 0x7fd31806d6d0 2024-04-25T15:47:44.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.950+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd31806a100 con 0x7fd31806d6d0 2024-04-25T15:47:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.951+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd314044020 con 0x7fd31806d6d0 2024-04-25T15:47:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd30effd640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2fc0744e0 0x7fd2fc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd31dc4c640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2fc0744e0 0x7fd2fc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fd3140b6130 con 0x7fd31806d6d0 2024-04-25T15:47:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd30effd640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fd2fc07abb0 0x7fd2fc07d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 --> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd314047e50 con 0x7fd2fc07abb0 2024-04-25T15:47:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fd3140b65c0 con 0x7fd31806d6d0 2024-04-25T15:47:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd31ec4e640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fd2fc07abb0 0x7fd2fc07d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.952+0000 7fd31dc4c640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2fc0744e0 0x7fd2fc0769f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd3180cce40 tx=0x7fd308009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.953+0000 7fd31ec4e640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fd2fc07abb0 0x7fd2fc07d040 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.954+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== osd.5 v2:172.21.15.195:6800/1786051066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd314047e50 con 0x7fd2fc07abb0 2024-04-25T15:47:44.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.966+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 --> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3180a1620 con 0x7fd2fc07abb0 2024-04-25T15:47:44.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd30effd640 1 -- 172.21.15.80:0/4015212784 <== osd.5 v2:172.21.15.195:6800/1786051066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd3180a1620 con 0x7fd2fc07abb0 2024-04-25T15:47:44.968 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:44.968 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:44.968 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fd2fc07abb0 msgr2=0x7fd2fc07d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.195:6800/1786051066,v1:172.21.15.195:6801/1786051066] conn(0x7fd2fc07abb0 0x7fd2fc07d040 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2fc0744e0 msgr2=0x7fd2fc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd2fc0744e0 0x7fd2fc0769f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd3180cce40 tx=0x7fd308009190 comp rx=0 tx=0).stop 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd31806d6d0 msgr2=0x7fd31809e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 --2- 172.21.15.80:0/4015212784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd31806d6d0 0x7fd31809e910 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd31402a1e0 tx=0x7fd3140046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd31ec4e640 1 -- 172.21.15.80:0/4015212784 reap_dead start 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 shutdown_connections 2024-04-25T15:47:44.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 >> 172.21.15.80:0/4015212784 conn(0x7fd3180d0450 msgr2=0x7fd3180b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:44.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 shutdown_connections 2024-04-25T15:47:44.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:44.967+0000 7fd3206b1640 1 -- 172.21.15.80:0/4015212784 wait complete. 2024-04-25T15:47:44.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T15:47:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.086+0000 7fc77b49f640 1 Processor -- start 2024-04-25T15:47:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.086+0000 7fc77b49f640 1 -- start start 2024-04-25T15:47:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc77b49f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc77b49f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc77406d0d0 0x7fc77406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc77b49f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77406c660 con 0x7fc7740d2830 2024-04-25T15:47:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc77b49f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc77406cc40 con 0x7fc77406d0d0 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc77b49f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc7740ced60 con 0x7fc77409bea0 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc77406d0d0 0x7fc77406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc77406d0d0 0x7fc77406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50542/0 (socket says 172.21.15.80:50542) 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 -- 172.21.15.80:0/1422371128 learned_addr learned my addr 172.21.15.80:0/1422371128 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc77923b640 1 --2- 172.21.15.80:0/1422371128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 -- 172.21.15.80:0/1422371128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 msgr2=0x7fc7740ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 --2- 172.21.15.80:0/1422371128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 -- 172.21.15.80:0/1422371128 >> v1:172.21.15.195:6789/0 conn(0x7fc7740d2830 legacy=0x7fc7740d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.088+0000 7fc779a3c640 1 -- 172.21.15.80:0/1422371128 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77406c8d0 con 0x7fc77406d0d0 2024-04-25T15:47:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.089+0000 7fc779a3c640 1 --2- 172.21.15.80:0/1422371128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc77406d0d0 0x7fc77406d4e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41216b46edc05a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.089+0000 7fc76bfff640 1 -- 172.21.15.80:0/1422371128 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c036070 con 0x7fc77406d0d0 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.089+0000 7fc76bfff640 1 -- 172.21.15.80:0/1422371128 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c031600 con 0x7fc77406d0d0 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.089+0000 7fc76bfff640 1 -- 172.21.15.80:0/1422371128 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0319d0 con 0x7fc77406d0d0 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 -- 172.21.15.80:0/1422371128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc77406d0d0 msgr2=0x7fc77406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 --2- 172.21.15.80:0/1422371128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc77406d0d0 0x7fc77406d4e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c02a6c0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 -- 172.21.15.80:0/1422371128 shutdown_connections 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 --2- 172.21.15.80:0/1422371128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc77406d0d0 0x7fc77406d4e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 --2- 172.21.15.80:0/1422371128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 -- 172.21.15.80:0/1422371128 >> 172.21.15.80:0/1422371128 conn(0x7fc7740b7620 msgr2=0x7fc7740b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 -- 172.21.15.80:0/1422371128 shutdown_connections 2024-04-25T15:47:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.090+0000 7fc77b49f640 1 -- 172.21.15.80:0/1422371128 wait complete. 2024-04-25T15:47:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.091+0000 7fc77b49f640 1 Processor -- start 2024-04-25T15:47:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.092+0000 7fc77b49f640 1 -- start start 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77b49f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc77406d0d0 0x7fc7741608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77b49f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77b49f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 0x7fc774151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77b49f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc7740ce8c0 con 0x7fc7740d2830 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77b49f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc7740cf040 con 0x7fc77406d0d0 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77b49f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc7740cea40 con 0x7fc77409bea0 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 0x7fc774151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 0x7fc774151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50544/0 (socket says 172.21.15.80:50544) 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 -- 172.21.15.80:0/2499919212 learned_addr learned my addr 172.21.15.80:0/2499919212 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc778a3a640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc77923b640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc77406d0d0 0x7fc7741608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 -- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 msgr2=0x7fc7740c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 -- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc77406d0d0 msgr2=0x7fc7741608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc77406d0d0 0x7fc7741608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 -- 172.21.15.80:0/2499919212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7740ca8b0 con 0x7fc7740d2830 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.093+0000 7fc779a3c640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 0x7fc774151900 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.094+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c036050 con 0x7fc7740d2830 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.094+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c042070 con 0x7fc7740d2830 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.094+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7740cab90 con 0x7fc7740d2830 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.094+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c009510 con 0x7fc7740d2830 2024-04-25T15:47:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.094+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7740cb150 con 0x7fc7740d2830 2024-04-25T15:47:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.095+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77406a100 con 0x7fc7740d2830 2024-04-25T15:47:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.096+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc76c007bf0 con 0x7fc7740d2830 2024-04-25T15:47:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.096+0000 7fc769ffb640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7580744b0 0x7fc7580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.096+0000 7fc77923b640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7580744b0 0x7fc7580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.096+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fc76c0b5fb0 con 0x7fc7740d2830 2024-04-25T15:47:45.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.097+0000 7fc77923b640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7580744b0 0x7fc7580769c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc77409c430 tx=0x7fc770008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.101+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc76c0801f0 con 0x7fc7740d2830 2024-04-25T15:47:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.273+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc77406f530 con 0x7fc7580744b0 2024-04-25T15:47:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.274+0000 7fc769ffb640 1 -- 172.21.15.80:0/2499919212 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc77406f530 con 0x7fc7580744b0 2024-04-25T15:47:45.275 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7580744b0 msgr2=0x7fc7580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7580744b0 0x7fc7580769c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc77409c430 tx=0x7fc770008040 comp rx=0 tx=0).stop 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 msgr2=0x7fc774151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 0x7fc774151900 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c004a40 comp rx=0 tx=0).stop 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 shutdown_connections 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fc7580744b0 0x7fc7580769c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7740d2830 0x7fc774151900 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc77409bea0 0x7fc7740c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 --2- 172.21.15.80:0/2499919212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc77406d0d0 0x7fc7741608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 >> 172.21.15.80:0/2499919212 conn(0x7fc7740b7620 msgr2=0x7fc774071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 shutdown_connections 2024-04-25T15:47:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.276+0000 7fc77b49f640 1 -- 172.21.15.80:0/2499919212 wait complete. 2024-04-25T15:47:45.287 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T15:47:45.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.398+0000 7ff671d7a640 1 Processor -- start 2024-04-25T15:47:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.398+0000 7ff671d7a640 1 -- start start 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff671d7a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff66c09c100 0x7ff66c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff671d7a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c15e3c0 0x7ff66c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff671d7a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66c0d3320 con 0x7ff66c0d2f10 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff671d7a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff66c0ce4b0 con 0x7ff66c09c100 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff671d7a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c0ce750 con 0x7ff66c15e3c0 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff66c09c100 0x7ff66c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff66c09c100 0x7ff66c06e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50552/0 (socket says 172.21.15.80:50552) 2024-04-25T15:47:45.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 -- 172.21.15.80:0/4074232856 learned_addr learned my addr 172.21.15.80:0/4074232856 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff662ffd640 1 --2- 172.21.15.80:0/4074232856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c15e3c0 0x7ff66c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 -- 172.21.15.80:0/4074232856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c15e3c0 msgr2=0x7ff66c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 --2- 172.21.15.80:0/4074232856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c15e3c0 0x7ff66c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 -- 172.21.15.80:0/4074232856 >> v1:172.21.15.195:6789/0 conn(0x7ff66c0d2f10 legacy=0x7ff66c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.399+0000 7ff66b7fe640 1 -- 172.21.15.80:0/4074232856 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c0cea30 con 0x7ff66c09c100 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.400+0000 7ff66b7fe640 1 --2- 172.21.15.80:0/4074232856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c09c100 0x7ff66c06e790 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009870 tx=0x7ff65c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47f61543ba3dacc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.400+0000 7ff66affd640 1 -- 172.21.15.80:0/4074232856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c037070 con 0x7ff66c09c100 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.400+0000 7ff66affd640 1 -- 172.21.15.80:0/4074232856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c032440 con 0x7ff66c09c100 2024-04-25T15:47:45.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.400+0000 7ff66affd640 1 -- 172.21.15.80:0/4074232856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c032810 con 0x7ff66c09c100 2024-04-25T15:47:45.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 -- 172.21.15.80:0/4074232856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c09c100 msgr2=0x7ff66c06e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 --2- 172.21.15.80:0/4074232856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c09c100 0x7ff66c06e790 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009870 tx=0x7ff65c02a1c0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 -- 172.21.15.80:0/4074232856 shutdown_connections 2024-04-25T15:47:45.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 --2- 172.21.15.80:0/4074232856 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c15e3c0 0x7ff66c0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 --2- 172.21.15.80:0/4074232856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c09c100 0x7ff66c06e790 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 -- 172.21.15.80:0/4074232856 >> 172.21.15.80:0/4074232856 conn(0x7ff66c0b7750 msgr2=0x7ff66c0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 -- 172.21.15.80:0/4074232856 shutdown_connections 2024-04-25T15:47:45.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.401+0000 7ff671d7a640 1 -- 172.21.15.80:0/4074232856 wait complete. 2024-04-25T15:47:45.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.403+0000 7ff671d7a640 1 Processor -- start 2024-04-25T15:47:45.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.403+0000 7ff671d7a640 1 -- start start 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff671d7a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c09c100 0x7ff66c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff671d7a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c0d2f10 0x7ff66c1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff671d7a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c15e3c0 0x7ff66c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff671d7a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c06ecd0 con 0x7ff66c15e3c0 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff671d7a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0ceff0 con 0x7ff66c09c100 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff671d7a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c06ee50 con 0x7ff66c0d2f10 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c15e3c0 0x7ff66c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c15e3c0 0x7ff66c0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50562/0 (socket says 172.21.15.80:50562) 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff66bfff640 1 -- 172.21.15.80:0/3363460107 learned_addr learned my addr 172.21.15.80:0/3363460107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:45.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff66b7fe640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c09c100 0x7ff66c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.404+0000 7ff662ffd640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c0d2f10 0x7ff66c1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff66bfff640 1 -- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c0d2f10 msgr2=0x7ff66c1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff66bfff640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff66c0d2f10 0x7ff66c1f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff66bfff640 1 -- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c09c100 msgr2=0x7ff66c15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff66bfff640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c09c100 0x7ff66c15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff66bfff640 1 -- 172.21.15.80:0/3363460107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c0c9a80 con 0x7ff66c15e3c0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff66bfff640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c15e3c0 0x7ff66c0cbdb0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c6b0 tx=0x7ff66400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664003b70 con 0x7ff66c15e3c0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664003d10 con 0x7ff66c15e3c0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c0cb010 con 0x7ff66c15e3c0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664005310 con 0x7ff66c15e3c0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.405+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c0cb2d0 con 0x7ff66c15e3c0 2024-04-25T15:47:45.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.406+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff66c06a100 con 0x7ff66c15e3c0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff6640054b0 con 0x7ff66c15e3c0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff668ff9640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff64c0744b0 0x7ff64c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7ff6640958a0 con 0x7ff66c15e3c0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff66b7fe640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff64c0744b0 0x7ff64c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff668ff9640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7ff64c07ab80 0x7ff64c07d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 --> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff64c07d6e0 con 0x7ff64c07ab80 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.407+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7ff664095d30 con 0x7ff66c15e3c0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.408+0000 7ff662ffd640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7ff64c07ab80 0x7ff64c07d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.408+0000 7ff66b7fe640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff64c0744b0 0x7ff64c0769c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff65c034000 tx=0x7ff65c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.408+0000 7ff662ffd640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7ff64c07ab80 0x7ff64c07d010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.409+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== osd.6 v2:172.21.15.195:6824/3079831018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff64c07d6e0 con 0x7ff64c07ab80 2024-04-25T15:47:45.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.422+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 --> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff66c161370 con 0x7ff64c07ab80 2024-04-25T15:47:45.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.422+0000 7ff668ff9640 1 -- 172.21.15.80:0/3363460107 <== osd.6 v2:172.21.15.195:6824/3079831018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff66c161370 con 0x7ff64c07ab80 2024-04-25T15:47:45.423 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:45.424 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:45.424 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7ff64c07ab80 msgr2=0x7ff64c07d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.195:6824/3079831018,v1:172.21.15.195:6825/3079831018] conn(0x7ff64c07ab80 0x7ff64c07d010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff64c0744b0 msgr2=0x7ff64c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7ff64c0744b0 0x7ff64c0769c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff65c034000 tx=0x7ff65c02e000 comp rx=0 tx=0).stop 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c15e3c0 msgr2=0x7ff66c0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 --2- 172.21.15.80:0/3363460107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff66c15e3c0 0x7ff66c0cbdb0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c6b0 tx=0x7ff66400cb70 comp rx=0 tx=0).stop 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff66bfff640 1 -- 172.21.15.80:0/3363460107 reap_dead start 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 shutdown_connections 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 >> 172.21.15.80:0/3363460107 conn(0x7ff66c0b7750 msgr2=0x7ff66c06ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 shutdown_connections 2024-04-25T15:47:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.423+0000 7ff671d7a640 1 -- 172.21.15.80:0/3363460107 wait complete. 2024-04-25T15:47:45.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T15:47:45.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.541+0000 7f3d4c757640 1 Processor -- start 2024-04-25T15:47:45.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.541+0000 7f3d4c757640 1 -- start start 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4c757640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b0d80 0x7f3d4415c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4c757640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d44074240 0x7f3d440b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4c757640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d440703e0 con 0x7f3d440b65a0 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4c757640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3d440affc0 con 0x7f3d44074240 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4c757640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d440b02a0 con 0x7f3d440b0d80 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4acf4640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d44074240 0x7f3d440b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4a4f3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b0d80 0x7f3d4415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d49cf2640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f3d440b65a0 0x7f3d44073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:54060/0 (socket says 172.21.15.80:54060) 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4acf4640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d44074240 0x7f3d440b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.80:33748/0 (socket says 172.21.15.80:33748) 2024-04-25T15:47:45.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d49cf2640 1 -- 172.21.15.80:0/2829129589 learned_addr learned my addr 172.21.15.80:0/2829129589 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:45.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b0d80 msgr2=0x7f3d4415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4acf4640 1 --2- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b0d80 0x7f3d4415c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2829129589 >> v1:172.21.15.195:6789/0 conn(0x7f3d440b65a0 legacy=0x7f3d44073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2829129589 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d440b0580 con 0x7f3d44074240 2024-04-25T15:47:45.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.543+0000 7f3d494f1640 1 -- 172.21.15.80:0/2829129589 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241675102 0 0) 0x7f3d440703e0 con 0x7f3d440b65a0 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.544+0000 7f3d4acf4640 1 --2- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d44074240 0x7f3d440b4700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dcf3d394a3cd169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.544+0000 7f3d494f1640 1 -- 172.21.15.80:0/2829129589 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c007740 con 0x7f3d44074240 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.544+0000 7f3d494f1640 1 -- 172.21.15.80:0/2829129589 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c0078e0 con 0x7f3d44074240 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.544+0000 7f3d494f1640 1 -- 172.21.15.80:0/2829129589 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c007cb0 con 0x7f3d44074240 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 -- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d44074240 msgr2=0x7f3d440b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d44074240 0x7f3d440b4700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c02a660 comp rx=0 tx=0).stop 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 -- 172.21.15.80:0/2829129589 shutdown_connections 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d44074240 0x7f3d440b4700 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2829129589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b0d80 0x7f3d4415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 -- 172.21.15.80:0/2829129589 >> 172.21.15.80:0/2829129589 conn(0x7f3d440d1e20 msgr2=0x7f3d44073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 -- 172.21.15.80:0/2829129589 shutdown_connections 2024-04-25T15:47:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.545+0000 7f3d4c757640 1 -- 172.21.15.80:0/2829129589 wait complete. 2024-04-25T15:47:45.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.547+0000 7f3d4c757640 1 Processor -- start 2024-04-25T15:47:45.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.547+0000 7f3d4c757640 1 -- start start 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4c757640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d440b0d80 0x7f3d4409ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4c757640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b65a0 0x7f3d4409d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4c757640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 0x7f3d4413d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4c757640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4406fe10 con 0x7f3d44154490 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4c757640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d440ae7c0 con 0x7f3d440b0d80 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4c757640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4406ff90 con 0x7f3d440b65a0 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4acf4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 0x7f3d4413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4acf4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 0x7f3d4413d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50576/0 (socket says 172.21.15.80:50576) 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2397958177 learned_addr learned my addr 172.21.15.80:0/2397958177 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d4a4f3640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d440b0d80 0x7f3d4409ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.548+0000 7f3d49cf2640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b65a0 0x7f3d4409d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b65a0 msgr2=0x7f3d4409d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4acf4640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b65a0 0x7f3d4409d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d440b0d80 msgr2=0x7f3d4409ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4acf4640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d440b0d80 0x7f3d4409ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4acf4640 1 -- 172.21.15.80:0/2397958177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4409de60 con 0x7f3d44154490 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d49cf2640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b65a0 0x7f3d4409d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4acf4640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 0x7f3d4413d550 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c03f070 con 0x7f3d44154490 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c031c40 con 0x7f3d44154490 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4409e140 con 0x7f3d44154490 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c009450 con 0x7f3d44154490 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.549+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4409e700 con 0x7f3d44154490 2024-04-25T15:47:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.550+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4406a100 con 0x7f3d44154490 2024-04-25T15:47:45.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.551+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d3c003990 con 0x7f3d44154490 2024-04-25T15:47:45.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.551+0000 7f3d3affd640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d280744b0 0x7f3d280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.551+0000 7f3d4a4f3640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d280744b0 0x7f3d280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.551+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f3d3c0b5f50 con 0x7f3d44154490 2024-04-25T15:47:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.552+0000 7f3d4a4f3640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d280744b0 0x7f3d280769c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3d440b1240 tx=0x7f3d40009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.556+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d3c080080 con 0x7f3d44154490 2024-04-25T15:47:45.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.728+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f3d440d0410 con 0x7f3d280744b0 2024-04-25T15:47:45.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.729+0000 7f3d3affd640 1 -- 172.21.15.80:0/2397958177 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d440d0410 con 0x7f3d280744b0 2024-04-25T15:47:45.730 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.730+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d280744b0 msgr2=0x7f3d280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.730+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d280744b0 0x7f3d280769c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3d440b1240 tx=0x7f3d40009190 comp rx=0 tx=0).stop 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.730+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 msgr2=0x7f3d4413d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.730+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 0x7f3d4413d550 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c004a40 comp rx=0 tx=0).stop 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 shutdown_connections 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f3d280744b0 0x7f3d280769c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d44154490 0x7f3d4413d550 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d440b65a0 0x7f3d4409d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 --2- 172.21.15.80:0/2397958177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d440b0d80 0x7f3d4409ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 >> 172.21.15.80:0/2397958177 conn(0x7f3d440d1e20 msgr2=0x7f3d440d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 shutdown_connections 2024-04-25T15:47:45.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.731+0000 7f3d4c757640 1 -- 172.21.15.80:0/2397958177 wait complete. 2024-04-25T15:47:45.743 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T15:47:45.743 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:47:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.852+0000 7fd53e88c640 1 Processor -- start 2024-04-25T15:47:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.852+0000 7fd53e88c640 1 -- start start 2024-04-25T15:47:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.853+0000 7fd53e88c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 0x7fd53809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.853+0000 7fd53e88c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5381607c0 con 0x7fd5380cfd70 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.853+0000 7fd53e88c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5380d0180 con 0x7fd5380cf960 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.853+0000 7fd53e88c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd5380cf4d0 con 0x7fd5380ce220 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.853+0000 7fd53ce29640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd5380cfd70 0x7fd5380d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40338/0 (socket says 172.21.15.80:40338) 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.853+0000 7fd53ce29640 1 -- 172.21.15.80:0/768572955 learned_addr learned my addr 172.21.15.80:0/768572955 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd537fff640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 0x7fd53809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199077304 0 0) 0x7fd5381607c0 con 0x7fd5380cfd70 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd520003520 con 0x7fd5380cfd70 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 244832219 0 0) 0x7fd520003520 con 0x7fd5380cfd70 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 msgr2=0x7fd53809bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 0x7fd53809bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 >> v1:172.21.15.195:6789/0 conn(0x7fd5380cf960 legacy=0x7fd5380b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5380ceba0 con 0x7fd5380cfd70 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7fd5300019f0 con 0x7fd5380cfd70 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 >> v1:172.21.15.80:6789/0 conn(0x7fd5380cfd70 legacy=0x7fd5380d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5200039e0 0x7fd520003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 0x7fd520004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd520004d40 0x7fd520005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd5380cf4d0 con 0x7fd520004d40 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd52000ba70 con 0x7fd5200039e0 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd52000bc70 con 0x7fd5380ce220 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd53ce29640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd520004d40 0x7fd520005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd537fff640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5200039e0 0x7fd520003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd5377fe640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 0x7fd520004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd53ce29640 1 -- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 msgr2=0x7fd520004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd53ce29640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380ce220 0x7fd520004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.854+0000 7fd53ce29640 1 -- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5200039e0 msgr2=0x7fd520003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.855+0000 7fd53ce29640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5200039e0 0x7fd520003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.855+0000 7fd53ce29640 1 -- 172.21.15.80:0/768572955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd520003520 con 0x7fd520004d40 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.855+0000 7fd53ce29640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd520004d40 0x7fd520005150 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd5380ccf10 tx=0x7fd520005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d57464a25059c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.855+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53000a4c0 con 0x7fd520004d40 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.855+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53002f070 con 0x7fd520004d40 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.855+0000 7fd536ffd640 1 -- 172.21.15.80:0/768572955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53002bc90 con 0x7fd520004d40 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53e88c640 1 -- 172.21.15.80:0/768572955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd520004d40 msgr2=0x7fd520005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53e88c640 1 --2- 172.21.15.80:0/768572955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd520004d40 0x7fd520005150 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd5380ccf10 tx=0x7fd520005830 comp rx=0 tx=0).stop 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53ce29640 1 -- 172.21.15.80:0/768572955 reap_dead start 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53e88c640 1 -- 172.21.15.80:0/768572955 shutdown_connections 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53e88c640 1 -- 172.21.15.80:0/768572955 >> 172.21.15.80:0/768572955 conn(0x7fd5380b7620 msgr2=0x7fd5380b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53e88c640 1 -- 172.21.15.80:0/768572955 shutdown_connections 2024-04-25T15:47:45.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.856+0000 7fd53e88c640 1 -- 172.21.15.80:0/768572955 wait complete. 2024-04-25T15:47:45.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.858+0000 7fd53e88c640 1 Processor -- start 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.858+0000 7fd53e88c640 1 -- start start 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd53e88c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538156e60 0x7fd5380b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd53e88c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380b00e0 0x7fd53806e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd53e88c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53806e660 0x7fd5380c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd53e88c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd5380cf160 con 0x7fd538156e60 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd53e88c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd5380ce630 con 0x7fd53806e660 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd53e88c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd5380d3530 con 0x7fd5380b00e0 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd537fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538156e60 0x7fd5380b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd537fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538156e60 0x7fd5380b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50586/0 (socket says 172.21.15.80:50586) 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.859+0000 7fd537fff640 1 -- 172.21.15.80:0/1058099292 learned_addr learned my addr 172.21.15.80:0/1058099292 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd53ce29640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53806e660 0x7fd5380c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd5377fe640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380b00e0 0x7fd53806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd537fff640 1 -- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380b00e0 msgr2=0x7fd53806e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd537fff640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380b00e0 0x7fd53806e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd537fff640 1 -- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53806e660 msgr2=0x7fd5380c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd537fff640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53806e660 0x7fd5380c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd537fff640 1 -- 172.21.15.80:0/1058099292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53806ea70 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd5377fe640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5380b00e0 0x7fd53806e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd537fff640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538156e60 0x7fd5380b25a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd5280119d0 tx=0x7fd528011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52800fb50 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52800fcf0 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52800fea0 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd538157270 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.860+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5380b2ff0 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.861+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5380ce7b0 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.862+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd528012040 con 0x7fd538156e60 2024-04-25T15:47:45.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.862+0000 7fd534ff9640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5240744b0 0x7fd5240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.862+0000 7fd5377fe640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5240744b0 0x7fd5240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.862+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fd528095820 con 0x7fd538156e60 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.863+0000 7fd534ff9640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7fd52407ab80 0x7fd52407d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.863+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 --> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd52800be50 con 0x7fd52407ab80 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.863+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fd52809a2c0 con 0x7fd538156e60 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.863+0000 7fd53ce29640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7fd52407ab80 0x7fd52407d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.863+0000 7fd5377fe640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5240744b0 0x7fd5240769c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5380a0860 tx=0x7fd52c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.863+0000 7fd53ce29640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7fd52407ab80 0x7fd52407d010 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:45.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.864+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== osd.7 v2:172.21.15.195:6816/1930343330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd52800be50 con 0x7fd52407ab80 2024-04-25T15:47:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.877+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 --> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd53806a100 con 0x7fd52407ab80 2024-04-25T15:47:45.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.878+0000 7fd534ff9640 1 -- 172.21.15.80:0/1058099292 <== osd.7 v2:172.21.15.195:6816/1930343330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd53806a100 con 0x7fd52407ab80 2024-04-25T15:47:45.879 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T15:47:45.879 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:47:45.880 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7fd52407ab80 msgr2=0x7fd52407d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.195:6816/1930343330,v1:172.21.15.195:6817/1930343330] conn(0x7fd52407ab80 0x7fd52407d010 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5240744b0 msgr2=0x7fd5240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fd5240744b0 0x7fd5240769c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5380a0860 tx=0x7fd52c009040 comp rx=0 tx=0).stop 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538156e60 msgr2=0x7fd5380b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 --2- 172.21.15.80:0/1058099292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538156e60 0x7fd5380b25a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd5280119d0 tx=0x7fd528011e90 comp rx=0 tx=0).stop 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53ce29640 1 -- 172.21.15.80:0/1058099292 reap_dead start 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 shutdown_connections 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 >> 172.21.15.80:0/1058099292 conn(0x7fd5380b7620 msgr2=0x7fd5380cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 shutdown_connections 2024-04-25T15:47:45.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.879+0000 7fd53e88c640 1 -- 172.21.15.80:0/1058099292 wait complete. 2024-04-25T15:47:45.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T15:47:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.998+0000 7f4d8cba8640 1 Processor -- start 2024-04-25T15:47:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.998+0000 7f4d8cba8640 1 -- start start 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.999+0000 7f4d8cba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 0x7f4d8806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.999+0000 7f4d8cba8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8806df20 con 0x7f4d880b4700 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.999+0000 7f4d8cba8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d880b1180 con 0x7f4d88153f70 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:45.999+0000 7f4d8cba8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8815d4f0 con 0x7f4d8806d5d0 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d86d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d880b4700 0x7f4d880b4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40352/0 (socket says 172.21.15.80:40352) 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d86d9d640 1 -- 172.21.15.80:0/1757836456 learned_addr learned my addr 172.21.15.80:0/1757836456 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678552110 0 0) 0x7f4d80001490 con 0x7f4d880b4700 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d74003520 con 0x7f4d880b4700 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d7ffff640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 0x7f4d8806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938374774 0 0) 0x7f4d74003520 con 0x7f4d880b4700 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 msgr2=0x7f4d8806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 0x7f4d8806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 >> v1:172.21.15.195:6789/0 conn(0x7f4d88153f70 legacy=0x7f4d880b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8815e270 con 0x7f4d880b4700 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f4d80001bc0 con 0x7f4d880b4700 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 >> v1:172.21.15.80:6789/0 conn(0x7f4d880b4700 legacy=0x7f4d880b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 0x7f4d740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d74004010 0x7f4d74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d74004d40 0x7f4d74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8815d4f0 con 0x7f4d74004010 2024-04-25T15:47:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7400de60 con 0x7f4d74004d40 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7400e060 con 0x7f4d8806d5d0 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d7ffff640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d74004010 0x7f4d74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d8659c640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 0x7f4d740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.000+0000 7f4d86d9d640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d74004d40 0x7f4d74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d7ffff640 1 -- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 msgr2=0x7f4d740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d7ffff640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d8806d5d0 0x7f4d740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d7ffff640 1 -- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d74004d40 msgr2=0x7f4d74005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d7ffff640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d74004d40 0x7f4d74005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d7ffff640 1 -- 172.21.15.80:0/1757836456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d74003520 con 0x7f4d74004010 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d7ffff640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d74004010 0x7f4d74004800 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000ba30 tx=0x7f4d74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81579885366075a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70030070 con 0x7f4d74004010 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7002ae00 con 0x7f4d74004010 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.001+0000 7f4d85d9b640 1 -- 172.21.15.80:0/1757836456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000b600 con 0x7f4d74004010 2024-04-25T15:47:46.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1757836456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d74004010 msgr2=0x7f4d74004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1757836456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d74004010 0x7f4d74004800 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000ba30 tx=0x7f4d74005830 comp rx=0 tx=0).stop 2024-04-25T15:47:46.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d86d9d640 1 -- 172.21.15.80:0/1757836456 reap_dead start 2024-04-25T15:47:46.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1757836456 shutdown_connections 2024-04-25T15:47:46.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1757836456 >> 172.21.15.80:0/1757836456 conn(0x7f4d880d1e20 msgr2=0x7f4d88073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:46.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1757836456 shutdown_connections 2024-04-25T15:47:46.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.002+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1757836456 wait complete. 2024-04-25T15:47:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.004+0000 7f4d8cba8640 1 Processor -- start 2024-04-25T15:47:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.004+0000 7f4d8cba8640 1 -- start start 2024-04-25T15:47:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d8cba8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d74004010 0x7f4d8809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d8cba8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d8813bf80 0x7f4d8813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d8cba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 0x7f4d8813da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d8cba8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4d880b0dd0 con 0x7f4d8813eda0 2024-04-25T15:47:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d8cba8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8815da70 con 0x7f4d8813bf80 2024-04-25T15:47:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d8cba8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8809b970 con 0x7f4d74004010 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d86d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 0x7f4d8813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d86d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 0x7f4d8813da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50610/0 (socket says 172.21.15.80:50610) 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d86d9d640 1 -- 172.21.15.80:0/1905282814 learned_addr learned my addr 172.21.15.80:0/1905282814 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.005+0000 7f4d7ffff640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d8813bf80 0x7f4d8813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d8659c640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d74004010 0x7f4d8809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d86d9d640 1 -- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d74004010 msgr2=0x7f4d8809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d86d9d640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d74004010 0x7f4d8809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d86d9d640 1 -- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d8813bf80 msgr2=0x7f4d8813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d86d9d640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d8813bf80 0x7f4d8813e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d86d9d640 1 -- 172.21.15.80:0/1905282814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8813f1b0 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d86d9d640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 0x7f4d8813da10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4d88071460 tx=0x7f4d80007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000eb00 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8000ecc0 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8813c970 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80013420 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.006+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8813cf30 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.007+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8806a100 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.008+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4d8001a020 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.008+0000 7f4d7effd640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d680744b0 0x7f4d680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.008+0000 7f4d8659c640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d680744b0 0x7f4d680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.008+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f4d80094b10 con 0x7f4d8813eda0 2024-04-25T15:47:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.009+0000 7f4d8659c640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d680744b0 0x7f4d680769c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4d78000c00 tx=0x7f4d78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.013+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d80021020 con 0x7f4d8813eda0 2024-04-25T15:47:46.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.185+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f4d88070570 con 0x7f4d680744b0 2024-04-25T15:47:46.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.185+0000 7f4d7effd640 1 -- 172.21.15.80:0/1905282814 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4d88070570 con 0x7f4d680744b0 2024-04-25T15:47:46.187 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T15:47:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d680744b0 msgr2=0x7f4d680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d680744b0 0x7f4d680769c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4d78000c00 tx=0x7f4d78009040 comp rx=0 tx=0).stop 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 msgr2=0x7f4d8813da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 0x7f4d8813da10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4d88071460 tx=0x7f4d80007bc0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 shutdown_connections 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4d680744b0 0x7f4d680769c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d8813eda0 0x7f4d8813da10 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d8813bf80 0x7f4d8813e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 --2- 172.21.15.80:0/1905282814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d74004010 0x7f4d8809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 >> 172.21.15.80:0/1905282814 conn(0x7f4d880d1e20 msgr2=0x7f4d880b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 shutdown_connections 2024-04-25T15:47:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.187+0000 7f4d8cba8640 1 -- 172.21.15.80:0/1905282814 wait complete. 2024-04-25T15:47:46.199 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:47:46.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.306+0000 7fe50006e640 1 Processor -- start 2024-04-25T15:47:46.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.306+0000 7fe50006e640 1 -- start start 2024-04-25T15:47:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.307+0000 7fe50006e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b91c0 0x7fe4f80d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.307+0000 7fe50006e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f80b2f30 con 0x7fe4f80d2480 2024-04-25T15:47:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.307+0000 7fe50006e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f80b2c90 con 0x7fe4f80b4b60 2024-04-25T15:47:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.307+0000 7fe50006e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f806eb60 con 0x7fe4f80b91c0 2024-04-25T15:47:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fe60b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe4f80d2480 0x7fe4f80d2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40362/0 (socket says 172.21.15.80:40362) 2024-04-25T15:47:46.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fe60b640 1 -- 172.21.15.80:0/49377340 learned_addr learned my addr 172.21.15.80:0/49377340 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fd609640 1 --2- 172.21.15.80:0/49377340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b91c0 0x7fe4f80d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286740252 0 0) 0x7fe4f80b2f30 con 0x7fe4f80d2480 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4e4003520 con 0x7fe4f80d2480 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596476793 0 0) 0x7fe4f80b2c90 con 0x7fe4f80b4b60 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f80b2f30 con 0x7fe4f80b4b60 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fd609640 1 -- 172.21.15.80:0/49377340 >> v1:172.21.15.195:6789/0 conn(0x7fe4f80b4b60 legacy=0x7fe4f806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fd609640 1 -- 172.21.15.80:0/49377340 >> v1:172.21.15.80:6789/0 conn(0x7fe4f80d2480 legacy=0x7fe4f80d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.308+0000 7fe4fd609640 1 -- 172.21.15.80:0/49377340 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f80d10a0 con 0x7fe4f80b91c0 2024-04-25T15:47:46.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.309+0000 7fe4fd609640 1 --2- 172.21.15.80:0/49377340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b91c0 0x7fe4f80d1f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80097d0 tx=0x7fe4e802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338c5415359806e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:46.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.309+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8037070 con 0x7fe4f80b91c0 2024-04-25T15:47:46.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.309+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8032440 con 0x7fe4f80b91c0 2024-04-25T15:47:46.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.309+0000 7fe4fce08640 1 -- 172.21.15.80:0/49377340 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80327f0 con 0x7fe4f80b91c0 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 -- 172.21.15.80:0/49377340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b91c0 msgr2=0x7fe4f80d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 --2- 172.21.15.80:0/49377340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b91c0 0x7fe4f80d1f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80097d0 tx=0x7fe4e802a180 comp rx=0 tx=0).stop 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 -- 172.21.15.80:0/49377340 shutdown_connections 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 --2- 172.21.15.80:0/49377340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b91c0 0x7fe4f80d1f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 -- 172.21.15.80:0/49377340 >> 172.21.15.80:0/49377340 conn(0x7fe4f80d0450 msgr2=0x7fe4f80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 -- 172.21.15.80:0/49377340 shutdown_connections 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.310+0000 7fe50006e640 1 -- 172.21.15.80:0/49377340 wait complete. 2024-04-25T15:47:46.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.312+0000 7fe50006e640 1 Processor -- start 2024-04-25T15:47:46.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.312+0000 7fe50006e640 1 -- start start 2024-04-25T15:47:46.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe50006e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b4b60 0x7fe4f81d5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe50006e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 0x7fe4f81eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe50006e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f80d2480 0x7fe4f81d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe50006e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f80d2fa0 con 0x7fe4f80b91c0 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe50006e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f809cbe0 con 0x7fe4f80d2480 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe50006e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f809d0e0 con 0x7fe4f80b4b60 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 0x7fe4f81eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 0x7fe4f81eba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50620/0 (socket says 172.21.15.80:50620) 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 -- 172.21.15.80:0/834561667 learned_addr learned my addr 172.21.15.80:0/834561667 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fe60b640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f80d2480 0x7fe4f81d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fde0a640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b4b60 0x7fe4f81d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 -- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b4b60 msgr2=0x7fe4f81d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b4b60 0x7fe4f81d5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 -- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f80d2480 msgr2=0x7fe4f81d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f80d2480 0x7fe4f81d7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.313+0000 7fe4fd609640 1 -- 172.21.15.80:0/834561667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f81d5f30 con 0x7fe4f80b91c0 2024-04-25T15:47:46.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.314+0000 7fe4fd609640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 0x7fe4f81eba00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80098f0 tx=0x7fe4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:46.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.314+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8037040 con 0x7fe4f80b91c0 2024-04-25T15:47:46.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.314+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8042070 con 0x7fe4f80b91c0 2024-04-25T15:47:46.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.314+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8032810 con 0x7fe4f80b91c0 2024-04-25T15:47:46.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.314+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f81d6210 con 0x7fe4f80b91c0 2024-04-25T15:47:46.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.314+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f81d67d0 con 0x7fe4f80b91c0 2024-04-25T15:47:46.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.315+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f806a100 con 0x7fe4f80b91c0 2024-04-25T15:47:46.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.315+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe4e80329b0 con 0x7fe4f80b91c0 2024-04-25T15:47:46.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.316+0000 7fe4ee7fc640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4dc0744b0 0x7fe4dc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:46.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.316+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7fe4e80b5a00 con 0x7fe4f80b91c0 2024-04-25T15:47:46.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.316+0000 7fe4fde0a640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4dc0744b0 0x7fe4dc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:46.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.316+0000 7fe4fde0a640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4dc0744b0 0x7fe4dc0769c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4000fb0 tx=0x7fe4f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:46.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.320+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4e8080290 con 0x7fe4f80b91c0 2024-04-25T15:47:46.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.497+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4f80d31c0 con 0x7fe4dc0744b0 2024-04-25T15:47:46.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.497+0000 7fe4ee7fc640 1 -- 172.21.15.80:0/834561667 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13426 (secure 0 0 0) 0x7fe4f80d31c0 con 0x7fe4dc0744b0 2024-04-25T15:47:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:47:46.499 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4dc0744b0 msgr2=0x7fe4dc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4dc0744b0 0x7fe4dc0769c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4000fb0 tx=0x7fe4f4009040 comp rx=0 tx=0).stop 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 msgr2=0x7fe4f81eba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 0x7fe4f81eba00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80098f0 tx=0x7fe4e80046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 shutdown_connections 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7fe4dc0744b0 0x7fe4dc0769c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f80d2480 0x7fe4f81d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f80b91c0 0x7fe4f81eba00 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 --2- 172.21.15.80:0/834561667 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe4f80b4b60 0x7fe4f81d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.499+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 >> 172.21.15.80:0/834561667 conn(0x7fe4f80d0450 msgr2=0x7fe4f806d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.500+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 shutdown_connections 2024-04-25T15:47:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:47:46.500+0000 7fe50006e640 1 -- 172.21.15.80:0/834561667 wait complete. 2024-04-25T15:47:46.511 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-25T15:47:45.056667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":265076,"kb_used_data":11464,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709644,"statfs":{"total":773094113280,"available":772822675456,"internally_reserved":0,"allocated":11739136,"data_stored":6034696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24623,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-168,"num_write_kb":-85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001283"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":282,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T15:47:38.435108+0000","last_change":"2024-04-25T15:42:50.260594+0000","last_active":"2024-04-25T15:47:38.435108+0000","last_peered":"2024-04-25T15:47:38.435108+0000","last_clean":"2024-04-25T15:47:38.435108+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:47:38.435108+0000","last_undegraded":"2024-04-25T15:47:38.435108+0000","last_fullsized":"2024-04-25T15:47:38.435108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:42:49.211301+0000","last_clean_scrub_stamp":"2024-04-25T15:42:49.211301+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:08.204551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36632,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335208,"statfs":{"total":96636764160,"available":96599252992,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542206,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1912832,"data_stored":1197113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1912832,"data_stored":1197113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:47:46.514 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T15:42:49.211301+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=42, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=47, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:47:46.514 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T15:48:04.391 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:04.394 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:06.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:48:06.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.641+0000 7f7a0726e640 1 Processor -- start 2024-04-25T15:48:06.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.641+0000 7f7a0726e640 1 -- start start 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0726e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a000b4b60 0x7f7a000b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0726e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a0006d6d0 0x7f7a000b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0726e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a000b2f30 con 0x7f7a000b3680 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0726e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0006eb60 con 0x7f7a0006d6d0 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0726e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a000b2c90 con 0x7f7a000b4b60 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0580b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7a000b3680 0x7f7a000d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33716/0 (socket says 172.21.15.80:33716) 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0580b640 1 -- 172.21.15.80:0/4130822363 learned_addr learned my addr 172.21.15.80:0/4130822363 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a04809640 1 --2- 172.21.15.80:0/4130822363 >> v2:172.21.15.195:3300/0 conn(0x7f7a0006d6d0 0x7f7a000b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f7a0500a640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a000b4b60 0x7f7a000b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055151694 0 0) 0x7f7a000b2f30 con 0x7f7a000b3680 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.643+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79ec003520 con 0x7f7a000b3680 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848440966 0 0) 0x7f79ec003520 con 0x7f7a000b3680 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a000b4b60 msgr2=0x7f7a000b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a000b4b60 0x7f7a000b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 >> v2:172.21.15.195:3300/0 conn(0x7f7a0006d6d0 msgr2=0x7f7a000b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 --2- 172.21.15.80:0/4130822363 >> v2:172.21.15.195:3300/0 conn(0x7f7a0006d6d0 0x7f7a000b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a000d10a0 con 0x7f7a000b3680 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 858905110 0 0) 0x7f79f80019f0 con 0x7f7a000b3680 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 >> v1:172.21.15.80:6789/0 conn(0x7f7a000b3680 legacy=0x7f7a000d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec0039b0 0x7f79ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79ec004800 0x7f79ec004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79ec005150 0x7f79ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0006eb60 con 0x7f79ec005150 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7a000b2c90 con 0x7f79ec0039b0 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec00c030 con 0x7f79ec004800 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a04809640 1 --2- 172.21.15.80:0/4130822363 >> v2:172.21.15.195:3300/0 conn(0x7f7a0006d6d0 0x7f7a000b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0500a640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a000b4b60 0x7f7a000b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0580b640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79ec005150 0x7f79ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a04809640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79ec004800 0x7f79ec004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0500a640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec0039b0 0x7f79ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0580b640 1 -- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79ec004800 msgr2=0x7f79ec004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0580b640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79ec004800 0x7f79ec004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0580b640 1 -- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec0039b0 msgr2=0x7f79ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0580b640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec0039b0 0x7f79ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a0580b640 1 -- 172.21.15.80:0/4130822363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec003520 con 0x7f79ec005150 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.644+0000 7f7a04809640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f79ec004800 0x7f79ec004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:48:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.645+0000 7f7a0580b640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79ec005150 0x7f79ec00b9c0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f79f800a8a0 tx=0x7f79ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab2a53cc2357bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.645+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f800a4c0 con 0x7f79ec005150 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.645+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f802f070 con 0x7f79ec005150 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.645+0000 7f79f7fff640 1 -- 172.21.15.80:0/4130822363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f802bd30 con 0x7f79ec005150 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0726e640 1 -- 172.21.15.80:0/4130822363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79ec005150 msgr2=0x7f79ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0726e640 1 --2- 172.21.15.80:0/4130822363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79ec005150 0x7f79ec00b9c0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f79f800a8a0 tx=0x7f79ec005830 comp rx=0 tx=0).stop 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0580b640 1 -- 172.21.15.80:0/4130822363 reap_dead start 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0726e640 1 -- 172.21.15.80:0/4130822363 shutdown_connections 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0726e640 1 -- 172.21.15.80:0/4130822363 >> 172.21.15.80:0/4130822363 conn(0x7f7a000d0450 msgr2=0x7f7a000d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0726e640 1 -- 172.21.15.80:0/4130822363 shutdown_connections 2024-04-25T15:48:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.646+0000 7f7a0726e640 1 -- 172.21.15.80:0/4130822363 wait complete. 2024-04-25T15:48:06.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.648+0000 7f7a0726e640 1 Processor -- start 2024-04-25T15:48:06.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.648+0000 7f7a0726e640 1 -- start start 2024-04-25T15:48:06.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0726e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec005150 0x7f7a001eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0726e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a001f6ce0 0x7f7a0009fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0726e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 0x7f7a000a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0726e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0009d0e0 con 0x7f7a000a0dc0 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0726e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0009cbe0 con 0x7f79ec005150 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0726e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0009d260 con 0x7f7a001f6ce0 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0580b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 0x7f7a000a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0580b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 0x7f7a000a11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59984/0 (socket says 172.21.15.80:59984) 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.649+0000 7f7a0580b640 1 -- 172.21.15.80:0/1079415948 learned_addr learned my addr 172.21.15.80:0/1079415948 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0500a640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec005150 0x7f7a001eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a04809640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a001f6ce0 0x7f7a0009fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0580b640 1 -- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a001f6ce0 msgr2=0x7f7a0009fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0580b640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a001f6ce0 0x7f7a0009fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0580b640 1 -- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec005150 msgr2=0x7f7a001eaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0580b640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec005150 0x7f7a001eaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0580b640 1 -- 172.21.15.80:0/1079415948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a000a1710 con 0x7f7a000a0dc0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0580b640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 0x7f7a000a11d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f79f800a9c0 tx=0x7f79f8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8044070 con 0x7f7a000a0dc0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f80019e0 con 0x7f7a000a0dc0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f800a4c0 con 0x7f7a000a0dc0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a001ec500 con 0x7f7a000a0dc0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.650+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a001eb740 con 0x7f7a000a0dc0 2024-04-25T15:48:06.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.651+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0006a100 con 0x7f7a000a0dc0 2024-04-25T15:48:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.652+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f79f8047070 con 0x7f7a000a0dc0 2024-04-25T15:48:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.652+0000 7f79f5ffb640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f79e40744b0 0x7f79e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.653+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f79f80b53f0 con 0x7f7a000a0dc0 2024-04-25T15:48:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.653+0000 7f7a0500a640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f79e40744b0 0x7f79e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.653+0000 7f7a0500a640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f79e40744b0 0x7f79e40769c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7a00075e60 tx=0x7f79fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:06.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.657+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a000a1710 con 0x7f7a000a0dc0 2024-04-25T15:48:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.829+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 --> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a0006f620 con 0x7f79e40744b0 2024-04-25T15:48:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.830+0000 7f79f5ffb640 1 -- 172.21.15.80:0/1079415948 <== mgr.4110 v2:172.21.15.80:6832/824495164 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7f7a0006f620 con 0x7f79e40744b0 2024-04-25T15:48:06.830 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:48:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f79e40744b0 msgr2=0x7f79e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f79e40744b0 0x7f79e40769c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7a00075e60 tx=0x7f79fc008040 comp rx=0 tx=0).stop 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 msgr2=0x7f7a000a11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 0x7f7a000a11d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f79f800a9c0 tx=0x7f79f8001dc0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 shutdown_connections 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f79e40744b0 0x7f79e40769c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a000a0dc0 0x7f7a000a11d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a001f6ce0 0x7f7a0009fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 --2- 172.21.15.80:0/1079415948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79ec005150 0x7f7a001eaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.832+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 >> 172.21.15.80:0/1079415948 conn(0x7f7a000d0450 msgr2=0x7f7a000b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.833+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 shutdown_connections 2024-04-25T15:48:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.833+0000 7f7a0726e640 1 -- 172.21.15.80:0/1079415948 wait complete. 2024-04-25T15:48:06.843 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-04-25T15:48:05.060897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":265060,"kb_used_data":11464,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709660,"statfs":{"total":773094113280,"available":772822691840,"internally_reserved":0,"allocated":11739136,"data_stored":6034696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002712"},"pg_stats":[{"pgid":"1.0","version":"106'74","reported_seq":293,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T15:47:46.777094+0000","last_change":"2024-04-25T15:47:46.777172+0000","last_active":"2024-04-25T15:47:46.777094+0000","last_peered":"2024-04-25T15:47:46.777094+0000","last_clean":"2024-04-25T15:47:46.777094+0000","last_became_active":"2024-04-25T15:42:50.259589+0000","last_became_peered":"2024-04-25T15:42:50.259589+0000","last_unstale":"2024-04-25T15:47:46.777094+0000","last_undegraded":"2024-04-25T15:47:46.777094+0000","last_fullsized":"2024-04-25T15:47:46.777094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'74","last_scrub_stamp":"2024-04-25T15:47:46.776994+0000","last_deep_scrub":"106'74","last_deep_scrub_stamp":"2024-04-25T15:47:46.776994+0000","last_clean_scrub_stamp":"2024-04-25T15:47:46.776994+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:10.811765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36632,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335208,"statfs":{"total":96636764160,"available":96599252992,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1912832,"data_stored":1197113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1912832,"data_stored":1197113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":606745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:48:06.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T15:48:06.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.952+0000 7f945a84c640 1 Processor -- start 2024-04-25T15:48:06.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.952+0000 7f945a84c640 1 -- start start 2024-04-25T15:48:06.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f945a84c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94540b2f90 0x7f94540ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f945a84c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540d3870 0x7f94540d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f945a84c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9454164670 con 0x7f9454163e40 2024-04-25T15:48:06.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f945a84c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9454164950 con 0x7f94540b2f90 2024-04-25T15:48:06.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f945a84c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9454164c30 con 0x7f94540d3870 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9453fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94540b2f90 0x7f94540ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f94537fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9454163e40 0x7f9454160140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33722/0 (socket says 172.21.15.80:33722) 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9453fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94540b2f90 0x7f94540ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59998/0 (socket says 172.21.15.80:59998) 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f94537fe640 1 -- 172.21.15.80:0/3357499119 learned_addr learned my addr 172.21.15.80:0/3357499119 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9458de9640 1 --2- 172.21.15.80:0/3357499119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540d3870 0x7f94540d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9453fff640 1 -- 172.21.15.80:0/3357499119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540d3870 msgr2=0x7f94540d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9453fff640 1 --2- 172.21.15.80:0/3357499119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540d3870 0x7f94540d3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9453fff640 1 -- 172.21.15.80:0/3357499119 >> v1:172.21.15.80:6789/0 conn(0x7f9454163e40 legacy=0x7f9454160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9452ffd640 1 -- 172.21.15.80:0/3357499119 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254936735 0 0) 0x7f9454164670 con 0x7f9454163e40 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.953+0000 7f9453fff640 1 -- 172.21.15.80:0/3357499119 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945406db50 con 0x7f94540b2f90 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.954+0000 7f9453fff640 1 --2- 172.21.15.80:0/3357499119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540b2f90 0x7f94540ce730 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f94440097a0 tx=0x7f944402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e781caec5673f16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.954+0000 7f9452ffd640 1 -- 172.21.15.80:0/3357499119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444037070 con 0x7f94540b2f90 2024-04-25T15:48:06.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.954+0000 7f9452ffd640 1 -- 172.21.15.80:0/3357499119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944402ae50 con 0x7f94540b2f90 2024-04-25T15:48:06.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.954+0000 7f9452ffd640 1 -- 172.21.15.80:0/3357499119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444032660 con 0x7f94540b2f90 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 -- 172.21.15.80:0/3357499119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540b2f90 msgr2=0x7f94540ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 --2- 172.21.15.80:0/3357499119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540b2f90 0x7f94540ce730 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f94440097a0 tx=0x7f944402a100 comp rx=0 tx=0).stop 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 -- 172.21.15.80:0/3357499119 shutdown_connections 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 --2- 172.21.15.80:0/3357499119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540d3870 0x7f94540d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 --2- 172.21.15.80:0/3357499119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540b2f90 0x7f94540ce730 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 -- 172.21.15.80:0/3357499119 >> 172.21.15.80:0/3357499119 conn(0x7f94540b5510 msgr2=0x7f94540b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 -- 172.21.15.80:0/3357499119 shutdown_connections 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.955+0000 7f945a84c640 1 -- 172.21.15.80:0/3357499119 wait complete. 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.957+0000 7f945a84c640 1 Processor -- start 2024-04-25T15:48:06.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.957+0000 7f945a84c640 1 -- start start 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f945a84c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540b2f90 0x7f94540cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f945a84c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 0x7f94540b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f945a84c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9454163e40 0x7f9454162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f945a84c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f94541643d0 con 0x7f94540d3870 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f945a84c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9454164250 con 0x7f9454163e40 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f945a84c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f945406e350 con 0x7f94540b2f90 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f94537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 0x7f94540b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f94537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 0x7f94540b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60002/0 (socket says 172.21.15.80:60002) 2024-04-25T15:48:06.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.958+0000 7f94537fe640 1 -- 172.21.15.80:0/531406381 learned_addr learned my addr 172.21.15.80:0/531406381 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f9458de9640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9454163e40 0x7f9454162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f9453fff640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540b2f90 0x7f94540cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f94537fe640 1 -- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540b2f90 msgr2=0x7f94540cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f94537fe640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540b2f90 0x7f94540cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f94537fe640 1 -- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9454163e40 msgr2=0x7f9454162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f94537fe640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9454163e40 0x7f9454162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f94537fe640 1 -- 172.21.15.80:0/531406381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94540b7860 con 0x7f94540d3870 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f9458de9640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9454163e40 0x7f9454162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f94537fe640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 0x7f94540b8900 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f944800c410 tx=0x7f944800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94480074e0 con 0x7f94540d3870 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94480047e0 con 0x7f94540d3870 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94540b7b40 con 0x7f94540d3870 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448004bd0 con 0x7f94540d3870 2024-04-25T15:48:06.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.959+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94540b8100 con 0x7f94540d3870 2024-04-25T15:48:06.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.960+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945406a100 con 0x7f94540d3870 2024-04-25T15:48:06.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.961+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9448011070 con 0x7f94540d3870 2024-04-25T15:48:06.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.961+0000 7f9450ff9640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94400744b0 0x7f94400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:06.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.961+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f9448094e40 con 0x7f94540d3870 2024-04-25T15:48:06.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.961+0000 7f9453fff640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94400744b0 0x7f94400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:06.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.962+0000 7f9453fff640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94400744b0 0x7f94400769c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9444034000 tx=0x7f944402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:06.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:06.966+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f944805f640 con 0x7f94540d3870 2024-04-25T15:48:07.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.140+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9454160260 con 0x7f94540d3870 2024-04-25T15:48:07.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.143+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) ==== 123+0+0 (secure 0 0 0) 0x7f944805ef40 con 0x7f94540d3870 2024-04-25T15:48:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.145+0000 7f9450ff9640 1 -- 172.21.15.80:0/531406381 <== mon.0 v2:172.21.15.80:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f944805ea50 con 0x7f94540d3870 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94400744b0 msgr2=0x7f94400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94400744b0 0x7f94400769c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9444034000 tx=0x7f944402e000 comp rx=0 tx=0).stop 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 msgr2=0x7f94540b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 0x7f94540b8900 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f944800c410 tx=0x7f944800c8d0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 shutdown_connections 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f94400744b0 0x7f94400769c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9454163e40 0x7f9454162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94540d3870 0x7f94540b8900 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 --2- 172.21.15.80:0/531406381 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94540b2f90 0x7f94540cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 >> 172.21.15.80:0/531406381 conn(0x7f94540b5510 msgr2=0x7f94540cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 shutdown_connections 2024-04-25T15:48:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.146+0000 7f945a84c640 1 -- 172.21.15.80:0/531406381 wait complete. 2024-04-25T15:48:07.158 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:48:07.158 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:48:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.265+0000 7f4a5921e640 1 Processor -- start 2024-04-25T15:48:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.266+0000 7f4a5921e640 1 -- start start 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a5921e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a54071950 0x7f4a54072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a5921e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4a540d2a90 0x7f4a540d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a5921e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a540d33e0 con 0x7f4a54161c80 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a5921e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4a54072aa0 con 0x7f4a540d2a90 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a5921e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4a541624d0 con 0x7f4a54071950 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a5359e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4a540d2a90 0x7f4a540d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a52d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a54071950 0x7f4a54072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a4bfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4a54161c80 0x7f4a540b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.80:50260/0 (socket says 172.21.15.80:50260) 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.267+0000 7f4a4bfff640 1 -- 172.21.15.80:0/895186196 learned_addr learned my addr 172.21.15.80:0/895186196 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.268+0000 7f4a52d9d640 1 -- 172.21.15.80:0/895186196 >> v2:172.21.15.195:3300/0 conn(0x7f4a540d2a90 msgr2=0x7f4a540d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.268+0000 7f4a52d9d640 1 --2- 172.21.15.80:0/895186196 >> v2:172.21.15.195:3300/0 conn(0x7f4a540d2a90 0x7f4a540d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.268+0000 7f4a52d9d640 1 -- 172.21.15.80:0/895186196 >> v1:172.21.15.195:6789/0 conn(0x7f4a54161c80 legacy=0x7f4a540b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.268+0000 7f4a52d9d640 1 -- 172.21.15.80:0/895186196 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a541627b0 con 0x7f4a54071950 2024-04-25T15:48:07.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.268+0000 7f4a5359e640 1 --2- 172.21.15.80:0/895186196 >> v2:172.21.15.195:3300/0 conn(0x7f4a540d2a90 0x7f4a540d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.268+0000 7f4a52d9d640 1 --2- 172.21.15.80:0/895186196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a54071950 0x7f4a54072560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097a0 tx=0x7f4a4402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993c38701c4c4abf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5259c640 1 -- 172.21.15.80:0/895186196 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44037070 con 0x7f4a54071950 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5259c640 1 -- 172.21.15.80:0/895186196 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4a4402ae50 con 0x7f4a54071950 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5259c640 1 -- 172.21.15.80:0/895186196 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44032680 con 0x7f4a54071950 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 -- 172.21.15.80:0/895186196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a54071950 msgr2=0x7f4a54072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 --2- 172.21.15.80:0/895186196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a54071950 0x7f4a54072560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097a0 tx=0x7f4a4402a100 comp rx=0 tx=0).stop 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 -- 172.21.15.80:0/895186196 shutdown_connections 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 --2- 172.21.15.80:0/895186196 >> v2:172.21.15.195:3300/0 conn(0x7f4a540d2a90 0x7f4a540d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 --2- 172.21.15.80:0/895186196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a54071950 0x7f4a54072560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 -- 172.21.15.80:0/895186196 >> 172.21.15.80:0/895186196 conn(0x7f4a540d3ea0 msgr2=0x7f4a540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:48:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 -- 172.21.15.80:0/895186196 shutdown_connections 2024-04-25T15:48:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.269+0000 7f4a5921e640 1 -- 172.21.15.80:0/895186196 wait complete. 2024-04-25T15:48:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.271+0000 7f4a5921e640 1 Processor -- start 2024-04-25T15:48:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.271+0000 7f4a5921e640 1 -- start start 2024-04-25T15:48:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 0x7f4a540c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a540d2a90 0x7f4a540cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a54161c80 0x7f4a5414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4a540b7690 con 0x7f4a54071950 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4a540d2290 con 0x7f4a54161c80 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4a540b7810 con 0x7f4a540d2a90 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 0x7f4a540c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 0x7f4a540c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60004/0 (socket says 172.21.15.80:60004) 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 -- 172.21.15.80:0/2690106101 learned_addr learned my addr 172.21.15.80:0/2690106101 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5359e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a54161c80 0x7f4a5414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a4bfff640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a540d2a90 0x7f4a540cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 -- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a540d2a90 msgr2=0x7f4a540cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a540d2a90 0x7f4a540cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 -- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a54161c80 msgr2=0x7f4a5414a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a54161c80 0x7f4a5414a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 -- 172.21.15.80:0/2690106101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a540cdc00 con 0x7f4a54071950 2024-04-25T15:48:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a4bfff640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a540d2a90 0x7f4a540cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a52d9d640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 0x7f4a540c92b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4a4402a140 tx=0x7f4a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44041070 con 0x7f4a54071950 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4a4403c460 con 0x7f4a54071950 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a54149970 con 0x7f4a54071950 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.273+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44037040 con 0x7f4a54071950 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.274+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a54149f30 con 0x7f4a54071950 2024-04-25T15:48:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.274+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5406a100 con 0x7f4a54071950 2024-04-25T15:48:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.275+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4a44044070 con 0x7f4a54071950 2024-04-25T15:48:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.276+0000 7f4a4b7fe640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a340744b0 0x7f4a340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:48:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.276+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5593+0+0 (secure 0 0 0) 0x7f4a440b58c0 con 0x7f4a54071950 2024-04-25T15:48:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.276+0000 7f4a4bfff640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a340744b0 0x7f4a340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:48:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.276+0000 7f4a4bfff640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a340744b0 0x7f4a340769c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0058d0 tx=0x7f4a3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:48:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.280+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a44080040 con 0x7f4a54071950 2024-04-25T15:48:07.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.496+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a540d1e40 con 0x7f4a54071950 2024-04-25T15:48:07.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.496+0000 7f4a4b7fe640 1 -- 172.21.15.80:0/2690106101 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3875 (secure 0 0 0) 0x7f4a4407f940 con 0x7f4a54071950 2024-04-25T15:48:07.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T15:48:07.497 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3386429072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3386429072},{"type":"v1","addr":"172.21.15.195:6834","nonce":3386429072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6913,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1409458956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":1409458956},{"type":"v1","addr":"172.21.15.195:6835","nonce":1409458956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":8115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/3361038298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3361038298},{"type":"v1","addr":"172.21.15.80:6835","nonce":3361038298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8118,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2554613912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":2554613912},{"type":"v1","addr":"172.21.15.80:6837","nonce":2554613912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[]} 2024-04-25T15:48:07.497 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2024-04-25T15:48:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a340744b0 msgr2=0x7f4a340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a340744b0 0x7f4a340769c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0058d0 tx=0x7f4a3c009040 comp rx=0 tx=0).stop 2024-04-25T15:48:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 msgr2=0x7f4a540c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:48:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 0x7f4a540c92b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4a4402a140 tx=0x7f4a440046c0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 shutdown_connections 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:6832/824495164,v1:172.21.15.80:6833/824495164] conn(0x7f4a340744b0 0x7f4a340769c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a54161c80 0x7f4a5414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a540d2a90 0x7f4a540cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.498+0000 7f4a5921e640 1 --2- 172.21.15.80:0/2690106101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a54071950 0x7f4a540c92b0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.499+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 >> 172.21.15.80:0/2690106101 conn(0x7f4a540d3ea0 msgr2=0x7f4a540b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.499+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 shutdown_connections 2024-04-25T15:48:07.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T15:48:07.499+0000 7f4a5921e640 1 -- 172.21.15.80:0/2690106101 wait complete. 2024-04-25T15:48:07.510 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T15:48:07.510 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T15:48:07.510 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:48:07.510 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.522 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:48:07.522 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:48:07.522 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.573 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:48:07.573 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:48:07.574 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.585 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:48:07.586 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:48:07.586 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.638 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:48:07.638 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T15:48:07.638 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T15:48:07.638 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.667 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T15:48:07.668 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T15:48:07.668 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.736 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T15:48:07.736 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T15:48:07.736 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.804 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T15:48:07.804 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T15:48:07.804 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.871 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T15:48:07.871 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T15:48:07.871 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.899 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T15:48:07.900 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T15:48:07.900 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:07.970 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T15:48:07.971 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T15:48:07.971 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.037 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T15:48:08.037 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T15:48:08.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.109 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T15:48:08.110 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T15:48:08.110 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T15:48:08.110 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.136 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T15:48:08.136 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T15:48:08.136 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.177 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T15:48:08.177 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T15:48:08.178 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T15:48:08.178 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.189 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T15:48:08.189 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T15:48:08.189 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.230 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T15:48:08.231 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T15:48:08.231 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:48:08.283 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T15:48:08.284 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T15:48:08.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'client session with non-allowable root' | head -n 1 2024-04-25T15:48:08.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:48:08.320 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T15:48:08.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:48:08.512 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T15:48:08.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:48:08.608 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T15:48:08.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:48:08.664 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T15:48:08.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:48:08.716 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T15:48:08.872 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:48:08.872 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T15:48:08.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:48:08.936 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T15:48:08.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:48:08.985 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T15:48:09.042 INFO:tasks.ceph:Archiving mon data... 2024-04-25T15:48:09.043 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/data/mon.a.tgz 2024-04-25T15:48:09.044 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-04-25T15:48:09.059 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.ZCHi5r8EUv 2024-04-25T15:48:09.059 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZCHi5r8EUv 2024-04-25T15:48:09.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.ZCHi5r8EUv 2024-04-25T15:48:09.319 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.ZCHi5r8EUv is 509KB 2024-04-25T15:48:09.419 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.ZCHi5r8EUv 2024-04-25T15:48:09.433 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/data/mon.b.tgz 2024-04-25T15:48:09.433 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-25T15:48:09.451 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.GFCvJtYmBv 2024-04-25T15:48:09.451 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.GFCvJtYmBv 2024-04-25T15:48:09.653 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.GFCvJtYmBv 2024-04-25T15:48:09.735 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.GFCvJtYmBv is 653KB 2024-04-25T15:48:09.807 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.GFCvJtYmBv 2024-04-25T15:48:09.821 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/data/mon.c.tgz 2024-04-25T15:48:09.822 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-25T15:48:09.875 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.MppL3vFn8U 2024-04-25T15:48:09.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MppL3vFn8U 2024-04-25T15:48:10.065 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.MppL3vFn8U 2024-04-25T15:48:10.145 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.MppL3vFn8U is 653KB 2024-04-25T15:48:10.244 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.MppL3vFn8U 2024-04-25T15:48:10.259 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T15:48:10.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T15:48:10.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T15:48:10.340 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T15:48:10.377 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T15:48:10.377 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T15:48:10.379 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/remote/smithi080/crash 2024-04-25T15:48:10.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T15:48:10.405 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/remote/smithi195/crash 2024-04-25T15:48:10.406 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T15:48:10.440 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T15:48:10.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:10.449 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:10.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:10.564 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:10.587 INFO:tasks.ceph:Compressing logs... 2024-04-25T15:48:10.588 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T15:48:10.607 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T15:48:10.707 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34671.log 2024-04-25T15:48:10.707 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43219.log 2024-04-25T15:48:10.707 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41748.log 2024-04-25T15:48:10.707 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.43219.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34671.log.gz 2024-04-25T15:48:10.707 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T15:48:10.707 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43219.log.gz 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.41748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34540.log 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41748.log.gz 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 88.1% 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.34540.log.gz 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34751.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T15:48:10.708 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34591.log 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.4.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40657.log 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34591.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T15:48:10.709 INFO:teuthology.orchestra.run.smithi195.stderr: 88.2%/var/log/ceph/ceph-client.3.40657.log: -- replaced with /var/log/ceph/ceph-client.admin.34591.log.gz 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.40657.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose/var/log/ceph/ceph-mgr.x.log: -- /var/log/ceph/ceph-osd.6.log 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44113.log 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.44113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44113.log.gz 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41253.log 2024-04-25T15:48:10.710 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34631.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34500.log 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.41253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41253.log.gz 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40259.log 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.34500.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34500.log.gz 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34460.log 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.40259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40259.log.gz 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42227.log 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr: 93.6%/var/log/ceph/ceph-client.admin.34460.log: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34460.log.gz 2024-04-25T15:48:10.711 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42706.log 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.42227.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42227.log.gz 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.42706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42706.log.gz 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43714.log 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.b.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.43714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43714.log.gz 2024-04-25T15:48:10.712 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T15:48:10.815 INFO:teuthology.orchestra.run.smithi195.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T15:48:10.867 INFO:teuthology.orchestra.run.smithi195.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T15:48:11.021 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40644.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47635.log: /var/log/ceph/ceph-client.admin.51235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40644.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz -5 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61971.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40644.log.gz 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64793.log 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-04-25T15:48:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60052.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64793.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61971.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41299.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60052.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64793.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62406.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41299.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60052.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62406.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41299.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58832.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62406.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46468.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58832.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-04-25T15:48:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51173.log 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34868.log 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58832.log.gz 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51173.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68387.log 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51173.log.gz 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61376.log 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:gzip/var/log/ceph/ceph-client.admin.68387.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50334.log 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34868.log.gz 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62015.log 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68387.log.gz 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61376.log.gz 2024-04-25T15:48:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59894.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62015.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50334.log.gz 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69291.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62015.log.gz/var/log/ceph/ceph-client.admin.59894.log: 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68555.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59894.log.gz 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.69291.log: -- /var/log/ceph/ceph-client.admin.63370.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57924.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69291.log.gz 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63370.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.68555.log.gz 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.58195.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57924.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.63370.log.gz /var/log/ceph/ceph-client.admin.61292.log 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57924.log.gz 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58195.log.gz 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56036.log 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1%/var/log/ceph/ceph-client.admin.42832.log: -- replaced with /var/log/ceph/ceph-client.admin.61292.log.gz 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47677.log 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55941.log 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56036.log.gz 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52310.log 2024-04-25T15:48:11.026 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55941.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52310.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55941.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48601.log 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44824.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52310.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49537.log 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48601.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49537.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43000.log 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46216.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49537.log.gz 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56460.log 2024-04-25T15:48:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43000.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68597.log 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56460.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43000.log.gz 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67838.log 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62150.log 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56460.log.gz 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68597.log.gz 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62762.log 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62150.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67838.log.gz 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.62762.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62150.log.gz 2024-04-25T15:48:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53090.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62762.log.gz 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68345.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53090.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gzgzip 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68345.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53090.log.gz 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59585.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64200.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68345.log.gz 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42706.log 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59585.log.gz 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64200.log.gz 2024-04-25T15:48:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61597.log 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42706.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67880.log 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61597.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42706.log.gz 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52665.log 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61597.log.gz 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57966.log 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53695.log 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67880.log.gz 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52665.log.gz 2024-04-25T15:48:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53695.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57966.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69765.log 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56208.log 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53695.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68126.log 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69765.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7%/var/log/ceph/ceph-client.admin.68126.log: -- replaced with /var/log/ceph/ceph-client.admin.56208.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60010.log 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68126.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-04-25T15:48:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60010.log.gz 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60094.log 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46972.log 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68429.log 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gz 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46972.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60094.log.gz 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58746.log 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68429.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46972.log.gz 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50142.log 2024-04-25T15:48:11.032 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58746.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68429.log.gz 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58746.log.gz 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:gzip/var/log/ceph/ceph-client.admin.50142.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52268.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50142.log.gz 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52844.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46510.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52268.log.gz -- 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.63719.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52844.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51680.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63719.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52844.log.gz 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-04-25T15:48:11.033 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63719.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55346.log 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44428.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51680.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59183.log 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65146.log 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55346.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65146.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.42146.log -- replaced with /var/log/ceph/ceph-client.admin.59183.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40602.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 88.0% 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65146.log.gz 2024-04-25T15:48:11.034 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42146.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56544.log 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54411.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56544.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67448.log 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49676.log 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67448.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-04-25T15:48:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44386.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44386.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.67448.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42874.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49676.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44386.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55813.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53803.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55813.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42874.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43874.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55813.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69933.log 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43874.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53803.log.gz 2024-04-25T15:48:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63761.log 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43874.log.gz 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69933.log.gz 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63761.log.gz 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57386.log 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49806.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T15:48:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45922.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.2.log: gzip 88.1% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57386.log.gz /var/log/ceph/ceph-client.admin.51932.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63593.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45922.log.gz 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60136.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63593.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51932.log.gz 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60136.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63593.log.gz 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63677.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60136.log.gz 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2024-04-25T15:48:11.038 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68783.log 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63677.log.gz 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68783.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64463.log 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68783.log.gz 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69249.log 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66236.log 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64463.log.gz 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66033.log 2024-04-25T15:48:11.039 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69249.log.gz 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62841.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66033.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.66236.log.gz -- 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.70202.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62841.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66033.log.gz 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40855.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.70202.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62841.log.gz 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51131.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70202.log.gz/var/log/ceph/ceph-client.admin.40855.log: 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40855.log.gz 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43872.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47893.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51131.log.gz 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2024-04-25T15:48:11.040 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52413.log 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43872.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70160.log 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52413.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gzgzip 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58703.log 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.70160.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52413.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53355.log 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70160.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57344.log 88.5% 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58703.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53355.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-04-25T15:48:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48265.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57344.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53048.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61801.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53048.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61801.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61759.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53611.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61759.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66320.log 2024-04-25T15:48:11.042 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61759.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62957.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53611.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58458.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62957.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66320.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62957.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65875.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58458.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59968.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48685.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65875.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62490.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63845.log 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48685.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59968.log.gz 2024-04-25T15:48:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57798.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48685.log.gz 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59057.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63845.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62490.log.gz 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46258.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63845.log.gz 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose 88.6% --/var/log/ceph/ceph-client.admin.59057.log: -- replaced with /var/log/ceph/ceph-client.admin.57798.log.gz /var/log/ceph/ceph-client.admin.65230.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46258.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59057.log.gzgzip 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61250.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46258.log.gz 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65230.log: /var/log/ceph/ceph-client.admin.61250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2024-04-25T15:48:11.044 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65230.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61250.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51638.log 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51638.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52016.log 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51638.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53132.log 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64116.log 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53132.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.52016.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65590.log 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53132.log.gz 2024-04-25T15:48:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55985.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64116.log.gz 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55985.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65590.log.gz 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61927.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50268.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55985.log.gz 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68863.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45880.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68863.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61927.log.gz 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68863.log.gz 2024-04-25T15:48:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45880.log: /var/log/ceph/ceph-client.admin.47977.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45880.log.gz 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64368.log 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49411.log 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61334.log 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64368.log.gz 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55075.log 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49411.log.gz 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2024-04-25T15:48:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55075.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61334.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65188.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55075.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57630.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49327.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57630.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.65188.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47178.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57630.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69975.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49327.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69975.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.47178.log.gz 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2024-04-25T15:48:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56502.log 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69975.log.gz 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43553.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gzgzip 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56502.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.70059.log 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57672.log 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56502.log.gz 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.70059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54949.log 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57672.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70059.log.gz 2024-04-25T15:48:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54949.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57672.log.gz 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48643.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54949.log.gz 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64158.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46132.log: /var/log/ceph/ceph-client.admin.48643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64158.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48643.log.gz 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52623.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64158.log.gz 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68699.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48097.log: /var/log/ceph/ceph-client.admin.52623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66362.log 2024-04-25T15:48:11.050 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68699.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52623.log.gz 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54679.log 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68699.log.gz 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63412.log 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66362.log: /var/log/ceph/ceph-client.admin.54679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54823.log 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66362.log.gz 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63412.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54679.log.gz 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61502.log 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69017.log 2024-04-25T15:48:11.051 INFO:teuthology.orchestra.run.smithi080.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.63412.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54823.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48727.log 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63202.log 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61502.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48727.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69017.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63328.log 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48727.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59393.log 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63202.log: /var/log/ceph/ceph-client.admin.63328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65356.log 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63202.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63328.log.gz 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62066.log 2024-04-25T15:48:11.052 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59393.log.gz 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log/var/log/ceph/ceph-client.admin.65356.log: 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65356.log.gz 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43042.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62066.log.gz 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58008.log 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59852.log 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44698.log: /var/log/ceph/ceph-client.admin.58008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68975.log 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59852.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58008.log.gz 2024-04-25T15:48:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58279.log 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68975.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59852.log.gz 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50601.log 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68975.log.gz 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60504.log 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58279.log: /var/log/ceph/ceph-client.admin.50601.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58279.log.gz 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50601.log.gz 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51974.log 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.43560.log: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.60504.log.gz 2024-04-25T15:48:11.054 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65991.log 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69334.log 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51974.log.gz 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49200.log 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65991.log.gz 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz/var/log/ceph/ceph-client.admin.69334.log: 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69334.log.gz 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63041.log 2024-04-25T15:48:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49200.log: /var/log/ceph/ceph-client.admin.46636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60937.log 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49200.log.gz 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63041.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65398.log 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63041.log.gz 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69723.log 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60937.log.gz 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42916.log 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65398.log: /var/log/ceph/ceph-client.admin.69723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69471.log 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65398.log.gz 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52100.log 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69723.log.gz 2024-04-25T15:48:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69471.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42916.log.gz 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64013.log 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5/var/log/ceph/ceph-client.admin.52100.log: --verbose -- /var/log/ceph/ceph-client.admin.41383.log 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69471.log.gz 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52100.log.gz 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41383.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.64013.log.gz 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50184.log 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52707.log 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50184.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53991.log 2024-04-25T15:48:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57756.log 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50184.log.gz 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.53991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45746.log 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53991.log.gz 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52707.log.gz 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57756.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57756.log.gz 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.2.45746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64326.log 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45746.log.gz 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.64326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42748.log 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65062.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64326.log.gz 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58321.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42748.log.gz/var/log/ceph/ceph-client.admin.65062.log: 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65062.log.gz 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58363.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58321.log: /var/log/ceph/ceph-client.admin.47935.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1%/var/log/ceph/ceph-client.admin.58363.log: -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58321.log.gz 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58363.log.gz 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55771.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67310.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58969.log 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55771.log.gz 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67310.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67310.log.gz 2024-04-25T15:48:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56250.log 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58969.log.gz 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40687.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64074.log 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66194.log 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56250.log: /var/log/ceph/ceph-client.admin.64074.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56250.log.gz 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64074.log.gz 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53262.log 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60643.log 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66194.log: /var/log/ceph/ceph-client.admin.53262.log: 89.0% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66194.log.gz 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53262.log.gz 2024-04-25T15:48:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69207.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59225.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60643.log: /var/log/ceph/ceph-client.admin.69207.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60643.log.gz 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69207.log.gz 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64284.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69807.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59225.log: /var/log/ceph/ceph-client.admin.64284.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59225.log.gz 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64284.log.gz 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66669.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54207.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69807.log.gz 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66669.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66669.log.gz 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47263.log 2024-04-25T15:48:11.061 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63551.log 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54207.log: /var/log/ceph/ceph-client.admin.47263.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54207.log.gz 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47263.log.gz 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65524.log 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63551.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63551.log.gz 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61021.log 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55897.log 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65524.log: /var/log/ceph/ceph-client.admin.61021.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61021.log.gz 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65524.log.gz 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-04-25T15:48:11.062 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55897.log: /var/log/ceph/ceph-client.admin.53569.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55897.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43876.log 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67361.log 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47065.log: /var/log/ceph/ceph-client.admin.43876.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43876.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63083.log 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67361.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67361.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66278.log 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63083.log: /var/log/ceph/ceph-client.admin.46846.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63083.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2024-04-25T15:48:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66278.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66278.log.gz 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40521.log 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54537.log 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43220.log: /var/log/ceph/ceph-client.admin.40521.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64881.log 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40521.log.gz 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54537.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54537.log.gz 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63160.log 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50759.log 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64881.log: /var/log/ceph/ceph-client.admin.63160.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64881.log.gz 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63160.log.gz 2024-04-25T15:48:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50759.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50759.log.gz 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53218.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46720.log: /var/log/ceph/ceph-client.admin.53218.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53218.log.gz 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49495.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56628.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50801.log: /var/log/ceph/ceph-client.admin.56628.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62999.log 2024-04-25T15:48:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46426.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56628.log.gz 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58619.log 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43213.log 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62999.log: /var/log/ceph/ceph-client.admin.58619.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62999.log.gz 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52581.log 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58619.log.gz 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43213.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43213.log.gz 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49932.log 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52581.log: /var/log/ceph/ceph-client.admin.49932.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52581.log.gz 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49932.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56292.log 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46048.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55472.log 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56292.log: /var/log/ceph/ceph-client.admin.55472.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56292.log.gz 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55472.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60214.log 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42272.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60214.log: /var/log/ceph/ceph-client.admin.53443.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60214.log.gz 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2024-04-25T15:48:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48475.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43756.log: /var/log/ceph/ceph-client.admin.41215.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64751.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43875.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60769.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64751.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64751.log.gz 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62364.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60769.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60769.log.gz 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62364.log: 87.5% 91.5% -- replaced with /var/log/ceph/ceph-client.admin.62364.log.gz 2024-04-25T15:48:11.068 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50100.log 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62238.log 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40985.log: /var/log/ceph/ceph-client.admin.50100.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50100.log.gz 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65796.log 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62238.log.gz 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.65796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65796.log.gz 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67796.log 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66819.log 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2024-04-25T15:48:11.069 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69681.log 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66819.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67796.log.gz 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69513.log 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr: 91.0%/var/log/ceph/ceph-client.admin.69681.log: -- replaced with /var/log/ceph/ceph-client.admin.66819.log.gz 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69681.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46930.log 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 89.1% 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69513.log.gz 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47389.log: /var/log/ceph/ceph-client.admin.46930.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46930.log.gz 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49974.log 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5/var/log/ceph/ceph-client.admin.46174.log: --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-04-25T15:48:11.070 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47221.log 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49974.log.gz 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49035.log 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz/var/log/ceph/ceph-client.admin.47221.log: 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57714.log 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0%/var/log/ceph/ceph-client.admin.49035.log: -- replaced with /var/log/ceph/ceph-client.admin.47221.log.gz 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54453.log 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49035.log.gz 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58111.log 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54453.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57714.log.gz 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54453.log.gz 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56334.log 2024-04-25T15:48:11.071 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51554.log 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58111.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64974.log 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51554.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56334.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62556.log 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51554.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62556.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64974.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62556.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61717.log 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64666.log 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61717.log: /var/log/ceph/ceph-client.admin.48055.log: 89.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61717.log.gz 2024-04-25T15:48:11.072 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40332.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60979.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64666.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66731.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60979.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40332.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66490.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60979.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57056.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66490.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66731.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66490.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67152.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65949.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57056.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69597.log 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65949.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67152.log.gz 2024-04-25T15:48:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65949.log.gz 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69387.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42188.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69597.log.gz 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57182.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5/var/log/ceph/ceph-client.admin.69387.log: --verbose -- /var/log/ceph/ceph-client.admin.61063.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69387.log.gz 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40813.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61063.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57182.log.gz 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67406.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61063.log.gz 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2024-04-25T15:48:11.074 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8%/var/log/ceph/ceph-client.admin.67406.log: -- replaced with /var/log/ceph/ceph-client.admin.40813.log.gz 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67406.log.gz 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46300.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.0.45307.log 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52142.log 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.45307.log: 89.5% 0.0% -- replaced with /var/log/ceph/ceph-client.0.45307.log.gz 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60256.log 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52142.log.gz 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-04-25T15:48:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44176.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60256.log.gz 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57428.log 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57428.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57428.log.gz 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64543.log 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51722.log 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64543.log: /var/log/ceph/ceph-client.admin.44218.log: 87.5% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64543.log.gz 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58927.log 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62280.log 2024-04-25T15:48:11.076 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51722.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58237.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51890.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5%/var/log/ceph/ceph-client.admin.62280.log: -- replaced with /var/log/ceph/ceph-client.admin.58927.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58237.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61843.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62280.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58237.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53313.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43547.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61843.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50522.log 2024-04-25T15:48:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53313.log: /var/log/ceph/ceph-client.admin.44782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59773.log 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53313.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.50522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50522.log.gz 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.59773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51005.log 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59773.log.gz 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68657.log 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz/var/log/ceph/ceph-client.admin.51005.log: 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56961.log 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51005.log.gz 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46762.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68657.log.gz 2024-04-25T15:48:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65016.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69555.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56961.log: /var/log/ceph/ceph-client.admin.65016.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65016.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56961.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42414.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42414.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69555.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64837.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42414.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48181.log: /var/log/ceph/ceph-client.admin.64837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42664.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64837.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66492.log 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-04-25T15:48:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54907.log: -- /var/log/ceph/ceph-client.admin.34971.log 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66492.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62322.log 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66492.log.gz 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51089.log 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55855.log 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62322.log: /var/log/ceph/ceph-client.admin.51089.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51089.log.gz 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62322.log.gz 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28547.log 2024-04-25T15:48:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59351.log 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.tmp-client.admin.28547.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55855.log.gz 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28547.log.gz 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57140.log 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69849.log/var/log/ceph/ceph-client.admin.59351.log: 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57140.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42372.log 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59351.log.gz 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57140.log.gz 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6%/var/log/ceph/ceph-client.admin.42372.log: -- replaced with /var/log/ceph/ceph-client.admin.69849.log.gz 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69429.log 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42372.log.gz 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66117.log 2024-04-25T15:48:11.081 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54165.log 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69429.log: /var/log/ceph/ceph-client.admin.66117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63244.log 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54165.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69429.log.gz 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66117.log.gz 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67958.log 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54165.log.gz 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55388.log 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57098.log 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63244.log.gz 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55388.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67958.log.gz 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55430.log 2024-04-25T15:48:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56166.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55388.log.gz 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57098.log.gz 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58876.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55430.log.gz/var/log/ceph/ceph-client.admin.56166.log: 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62915.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56166.log.gz 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56586.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58876.log.gz 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52539.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62915.log.gz 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47551.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56586.log.gz 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61105.log 2024-04-25T15:48:11.083 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52539.log.gz 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47551.log.gz 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61105.log: /var/log/ceph/ceph-client.admin.50226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63803.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44638.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61105.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62196.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63635.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62196.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63803.log.gz 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58069.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62196.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70017.log 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63635.log: /var/log/ceph/ceph-client.admin.58069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52749.log 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.70017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58069.log.gz 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63635.log.gz 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70017.log.gz 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.68513.log 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60340.log 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52749.log.gz 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46678.log 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68513.log.gz 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59141.log 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60340.log: /var/log/ceph/ceph-client.admin.46678.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60340.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46678.log.gz 2024-04-25T15:48:11.085 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49581.log 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59141.log: gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59141.log.gz 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.56078.log 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56120.log 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49581.log.gz 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66885.log 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56078.log.gz 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67712.log 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66075.log 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66885.log: /var/log/ceph/ceph-client.admin.67712.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56120.log.gz 2024-04-25T15:48:11.086 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66885.log.gz 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61885.log 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67712.log.gz 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66075.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66075.log.gz 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42498.log 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48433.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61885.log.gz 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53653.log 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8%/var/log/ceph/ceph-client.admin.42498.log: -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59309.log 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42498.log.gz 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53737.log 2024-04-25T15:48:11.087 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53653.log.gz 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60382.log 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59309.log: /var/log/ceph/ceph-client.admin.53737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60382.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59309.log.gz 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60382.log.gz 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53737.log.gz 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50885.log 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48139.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-04-25T15:48:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70120.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49718.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50885.log: /var/log/ceph/ceph-client.admin.70120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49718.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50885.log.gz 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70120.log.gz 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:gzip 88.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.59267.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49718.log.gz 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59099.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42456.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59267.log: /var/log/ceph/ceph-client.admin.59099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40729.log 2024-04-25T15:48:11.089 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59267.log.gz 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42456.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59099.log.gz 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50643.log 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42456.log.gz 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40729.log.gz 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5%/var/log/ceph/ceph-client.admin.46804.log: -- replaced with /var/log/ceph/ceph-client.admin.50643.log.gz 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40425.log 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48517.log 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2024-04-25T15:48:11.090 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40425.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54579.log 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40425.log.gz 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48517.log: /var/log/ceph/ceph-client.admin.54579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48517.log.gz 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43552.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54579.log.gz 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56376.log 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57882.log 2024-04-25T15:48:11.091 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43218.log: /var/log/ceph/ceph-client.admin.56376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66491.log 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57882.log: 87.7% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56376.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57882.log.gz 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.54495.log 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66491.log: gzip -5 87.9% --verbose -- /var/log/ceph/ceph-client.admin.66777.log 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66491.log.gz 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49116.log 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3%/var/log/ceph/ceph-client.admin.66777.log: -- replaced with /var/log/ceph/ceph-client.admin.54495.log.gz 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68303.log 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66777.log.gz 2024-04-25T15:48:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54291.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49116.log: /var/log/ceph/ceph-client.admin.68303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57470.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49116.log.gz 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68303.log.gz 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54291.log.gz 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5/var/log/ceph/ceph-client.admin.57470.log: --verbose -- /var/log/ceph/ceph-client.admin.47509.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42621.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48769.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57470.log.gz 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55220.log 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47509.log.gz 2024-04-25T15:48:11.093 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5%/var/log/ceph/ceph-client.admin.43219.log: -- replaced with /var/log/ceph/ceph-client.admin.48769.log.gz 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49243.log 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz/var/log/ceph/ceph-client.admin.55220.log: 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49243.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55220.log.gz 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50058.log 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52924.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49243.log.gz 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52058.log 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50058.log.gz 2024-04-25T15:48:11.094 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7%/var/log/ceph/ceph-client.admin.52058.log: -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53006.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44988.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52058.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53006.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55647.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53006.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62108.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55647.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44988.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44512.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55647.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50963.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:gzip/var/log/ceph/ceph-client.admin.62108.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60853.log 2024-04-25T15:48:11.095 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54333.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62108.log.gz 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60853.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50963.log.gz 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69891.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3%/var/log/ceph/ceph-client.admin.54333.log: -- replaced with /var/log/ceph/ceph-client.admin.60853.log.gz 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68905.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54333.log.gz 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69891.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69891.log.gz 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.51047.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60727.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68905.log.gz/var/log/ceph/ceph-client.admin.51047.log: 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63286.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51047.log.gz 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56694.log 2024-04-25T15:48:11.096 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63286.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60727.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.56694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65482.log 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56694.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63286.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48913.log 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60811.log 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65482.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64242.log 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48913.log: /var/log/ceph/ceph-client.admin.60811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41027.log 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64242.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60811.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48913.log.gz 2024-04-25T15:48:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64242.log.gz 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65314.log 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65272.log 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41027.log.gz 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55729.log 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65314.log.gz 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58788.log 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65272.log: /var/log/ceph/ceph-client.admin.55729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58788.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55729.log.gz 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65272.log.gz 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58788.log.gz 2024-04-25T15:48:11.098 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48871.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48955.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47593.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48871.log: /var/log/ceph/ceph-client.admin.48955.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48871.log.gz 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48955.log.gz 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60895.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57570.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47593.log.gz 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54865.log 2024-04-25T15:48:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57570.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60895.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57570.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52352.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55033.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54865.log: /var/log/ceph/ceph-client.admin.52352.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54865.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52352.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60685.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53397.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60685.log: /var/log/ceph/ceph-client.admin.55033.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55033.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60685.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61418.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68189.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53397.log: /var/log/ceph/ceph-client.admin.61418.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53397.log.gz 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61418.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61166.log 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57528.log 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68189.log: /var/log/ceph/ceph-client.admin.61166.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.68189.log.gz 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61166.log.gz 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54637.log 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45964.log 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57528.log: /var/log/ceph/ceph-client.admin.54637.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57528.log.gz 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54637.log.gz 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59011.log 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60442.log 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59011.log: /var/log/ceph/ceph-client.admin.45964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45964.log.gz 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59011.log.gz 2024-04-25T15:48:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42790.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.60442.log: /var/log/ceph/ceph-client.admin.42790.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60442.log.gz 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42790.log.gz 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40943.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54763.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40943.log: /var/log/ceph/ceph-client.admin.44134.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40943.log.gz 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51423.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54763.log: /var/log/ceph/ceph-client.0.51423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51423.log.gz 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54763.log.gz 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57840.log 2024-04-25T15:48:11.102 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58153.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59477.log: /var/log/ceph/ceph-client.admin.57840.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57840.log.gz 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66489.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41449.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.66489.log: /var/log/ceph/ceph-client.admin.58153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58153.log.gz 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66489.log.gz 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55567.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64932.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41449.log: /var/log/ceph/ceph-client.admin.55567.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41449.log.gz 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.55567.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49369.log 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64932.log: /var/log/ceph/ceph-client.admin.46552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 88.9% 2024-04-25T15:48:11.103 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64932.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53174.log 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59435.log 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49369.log: /var/log/ceph/ceph-client.admin.53174.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49369.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53174.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.59435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34604.log 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43221.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59435.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49285.log 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67514.log 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34604.log: /var/log/ceph/ceph-client.admin.49285.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34604.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49285.log.gz 2024-04-25T15:48:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57224.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67514.log: /var/log/ceph/ceph-client.admin.46006.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.67514.log.gz 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63971.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.57224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51596.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57224.log.gz 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42330.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51596.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63971.log.gz 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51596.log.gz 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58661.log 2024-04-25T15:48:11.105 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42330.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56882.log 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8%/var/log/ceph/ceph-client.admin.58661.log: -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63929.log 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58661.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54991.log 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.56882.log: /var/log/ceph/ceph-client.admin.63929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56882.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63929.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49760.log 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41173.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54991.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58538.log 2024-04-25T15:48:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49760.log: -- /var/log/ceph/ceph-client.admin.62448.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49760.log.gz 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.58538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61460.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.62448.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58538.log.gz 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62448.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42062.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67073.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61460.log: /var/log/ceph/ceph-client.admin.42062.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61460.log.gz 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40771.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42062.log.gz 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.67073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67073.log.gz 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-04-25T15:48:11.107 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40771.log.gz 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48307.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68000.log 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44260.log 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47015.log: /var/log/ceph/ceph-client.admin.68000.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68000.log.gz 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68084.log 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44260.log: /var/log/ceph/ceph-client.admin.47851.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65440.log 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65104.log 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68084.log: /var/log/ceph/ceph-client.admin.65440.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68084.log.gz 2024-04-25T15:48:11.108 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52497.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65440.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.65104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64708.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52497.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65104.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52497.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57302.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68471.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64708.log: /var/log/ceph/ceph-client.admin.57302.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64708.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57302.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54721.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68471.log: /var/log/ceph/ceph-client.admin.54721.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.68471.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54721.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44554.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2024-04-25T15:48:11.109 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64624.log 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61208.log 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.64624.log: /var/log/ceph/ceph-client.admin.41131.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64624.log.gz 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68042.log 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.61208.log: /var/log/ceph/ceph-client.admin.43896.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61208.log.gz 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54249.log 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55178.log 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54249.log: /var/log/ceph/ceph-client.admin.68042.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68042.log.gz 2024-04-25T15:48:11.110 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54249.log.gz 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55178.log: /var/log/ceph/ceph-client.admin.49158.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55178.log.gz 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56418.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63887.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42958.log: /var/log/ceph/ceph-client.admin.56418.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56418.log.gz 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69639.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.63887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63887.log.gz 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.69639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67215.log 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50843.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69639.log.gz 2024-04-25T15:48:11.111 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50016.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67215.log: /var/log/ceph/ceph-client.admin.50016.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.67215.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50016.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60298.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44302.log: /var/log/ceph/ceph-client.admin.52226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46888.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9%/var/log/ceph/ceph-client.admin.60298.log: -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60298.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68741.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67754.log 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46888.log.gz 2024-04-25T15:48:11.112 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.68741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55304.log 2024-04-25T15:48:11.113 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68741.log.gz 2024-04-25T15:48:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.67754.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67754.log.gz 2024-04-25T15:48:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55304.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55304.log.gz 2024-04-25T15:48:11.349 INFO:teuthology.orchestra.run.smithi080.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T15:48:11.539 INFO:teuthology.orchestra.run.smithi195.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T15:48:11.573 INFO:teuthology.orchestra.run.smithi080.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T15:48:11.612 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T15:48:11.617 INFO:teuthology.orchestra.run.smithi080.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T15:48:11.649 INFO:teuthology.orchestra.run.smithi080.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T15:48:11.657 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T15:48:11.684 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T15:48:11.686 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-25T15:48:11.686 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m1.039s 2024-04-25T15:48:11.686 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m4.140s 2024-04-25T15:48:11.686 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.147s 2024-04-25T15:48:11.828 INFO:teuthology.orchestra.run.smithi080.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T15:48:11.830 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T15:48:11.831 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m1.212s 2024-04-25T15:48:11.831 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m4.913s 2024-04-25T15:48:11.831 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.470s 2024-04-25T15:48:11.831 INFO:tasks.ceph:Archiving logs... 2024-04-25T15:48:11.831 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/remote/smithi080/log 2024-04-25T15:48:11.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T15:48:13.021 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/remote/smithi195/log 2024-04-25T15:48:13.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T15:48:13.646 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T15:48:13.657 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T15:48:13.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T15:48:13.660 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T15:48:13.742 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T15:48:13.753 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T15:48:13.753 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:48:13.756 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:48:13.769 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:48:13.772 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:48:13.773 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:48:13.774 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-25T15:48:13.774 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1005us[+1002us] +/- 59ms 2024-04-25T15:48:13.774 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -960us[ -960us] +/- 68ms 2024-04-25T15:48:13.774 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -318us[ -318us] +/- 89ms 2024-04-25T15:48:13.774 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:48:13.778 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:48:13.778 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T15:48:13.778 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1040us[+1055us] +/- 59ms 2024-04-25T15:48:13.779 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -935us[ -919us] +/- 68ms 2024-04-25T15:48:13.779 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -293us[ -293us] +/- 90ms 2024-04-25T15:48:13.779 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:48:13.779 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T15:48:13.789 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T15:48:13.790 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T15:48:13.801 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T15:48:13.895 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T15:48:13.963 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:48:13.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:48:13.992 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:48:14.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:48:14.020 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T15:48:14.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T15:48:14.043 INFO:teuthology.task.internal:Duration was 676.284094 seconds 2024-04-25T15:48:14.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T15:48:14.055 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T15:48:14.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T15:48:14.057 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T15:48:14.092 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:48:14.099 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:48:14.464 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T15:48:14.464 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T15:48:14.464 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T15:48:14.523 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T15:48:14.523 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T15:48:14.547 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T15:48:14.547 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T15:48:14.565 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T15:48:14.613 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T15:48:14.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T15:48:14.630 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T15:48:14.756 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T15:48:14.766 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T15:48:14.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T15:48:14.790 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T15:48:14.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T15:48:14.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:48:14.833 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:48:14.852 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-04-25T15:48:14.875 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-25T15:48:14.888 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:48:14.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:48:14.919 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:48:14.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:48:14.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T15:48:14.953 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T15:48:14.953 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/remote/smithi080 2024-04-25T15:48:14.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T15:48:14.993 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673230/remote/smithi195 2024-04-25T15:48:14.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T15:48:15.025 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T15:48:15.025 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T15:48:15.029 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T15:48:15.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T15:48:15.087 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T15:48:15.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T15:48:15.101 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T15:48:15.101 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T15:48:15.104 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T15:48:15.116 INFO:teuthology.orchestra.run.smithi080.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 15:48 /home/ubuntu/cephtest 2024-04-25T15:48:15.130 INFO:teuthology.orchestra.run.smithi195.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 15:48 /home/ubuntu/cephtest 2024-04-25T15:48:15.131 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T15:48:15.142 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T15:48:15.167 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} duration: 676.2840940952301 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T15:48:15.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:48:15.250 INFO:teuthology.run:pass